2024-04-26T10:08:49.993 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-26T10:08:49.993 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112 --owner scheduled_teuthology@teuthology --verbose --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/ubuntu_20.04 tasks/admin_socket_objecter_requests thrashosds-health} -- /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112/orig.config.yaml 2024-04-26T10:08:50.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T10:08:50.113 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112 branch: reef description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/ubuntu_20.04 tasks/admin_socket_objecter_requests thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7674112' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: reef ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: dc093b5e41f728edab6e0330295fdf9156d31664 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: dc093b5e41f728edab6e0330295fdf9156d31664 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 1136 sha1: dc093b5e41f728edab6e0330295fdf9156d31664 sleep_before_teardown: 0 subset: 0/4 suite: powercycle suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 7d2137f0a666c92a9411c1af5c33e4968be54da6 targets: smithi052.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi120.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - radosbench: clients: - client.0 time: 60 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_22:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-26T10:08:50.113 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa; will attempt to use it 2024-04-26T10:08:50.114 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa/tasks 2024-04-26T10:08:50.114 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-26T10:08:50.115 INFO:teuthology.task.internal:Checking packages... 2024-04-26T10:08:50.140 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'dc093b5e41f728edab6e0330295fdf9156d31664' 2024-04-26T10:08:50.140 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-26T10:08:50.140 INFO:teuthology.packaging:ref: None 2024-04-26T10:08:50.140 INFO:teuthology.packaging:tag: None 2024-04-26T10:08:50.140 INFO:teuthology.packaging:branch: reef 2024-04-26T10:08:50.140 INFO:teuthology.packaging:sha1: dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:08:50.140 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=reef 2024-04-26T10:08:50.458 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1258-g7d2137f0-1focal 2024-04-26T10:08:50.460 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-26T10:08:50.466 INFO:teuthology.task.internal:no buildpackages task found 2024-04-26T10:08:50.467 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-26T10:08:50.491 INFO:teuthology.task.internal:Saving configuration 2024-04-26T10:08:50.504 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-26T10:08:50.524 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-26T10:08:50.548 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi052.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 10:01:54.873109', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-04-26T10:08:50.566 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 10:01:54.876604', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-04-26T10:08:50.585 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 10:01:54.874354', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-04-26T10:08:50.605 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-26 10:01:54.875499', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-04-26T10:08:50.606 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-26T10:08:50.612 INFO:teuthology.task.internal:roles: ubuntu@smithi052.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-26T10:08:50.612 INFO:teuthology.task.internal:roles: ubuntu@smithi120.front.sepia.ceph.com - ['osd.0'] 2024-04-26T10:08:50.612 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['osd.1'] 2024-04-26T10:08:50.612 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['osd.2'] 2024-04-26T10:08:50.612 INFO:teuthology.run_tasks:Running task console_log... 2024-04-26T10:08:50.776 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb545cd1280>, signals=[15]) 2024-04-26T10:08:50.776 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-26T10:08:50.784 INFO:teuthology.task.internal:Opening connections... 2024-04-26T10:08:50.784 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi052.front.sepia.ceph.com 2024-04-26T10:08:50.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:08:50.881 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi120.front.sepia.ceph.com 2024-04-26T10:08:50.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:08:50.970 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-04-26T10:08:50.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:08:51.066 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2024-04-26T10:08:51.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:08:51.153 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-26T10:08:51.161 DEBUG:teuthology.orchestra.run.smithi052:> uname -m 2024-04-26T10:08:51.168 INFO:teuthology.orchestra.run.smithi052.stdout:x86_64 2024-04-26T10:08:51.168 DEBUG:teuthology.orchestra.run.smithi052:> cat /etc/os-release 2024-04-26T10:08:51.216 INFO:teuthology.orchestra.run.smithi052.stdout:NAME="Ubuntu" 2024-04-26T10:08:51.216 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-26T10:08:51.217 INFO:teuthology.orchestra.run.smithi052.stdout:ID=ubuntu 2024-04-26T10:08:51.217 INFO:teuthology.orchestra.run.smithi052.stdout:ID_LIKE=debian 2024-04-26T10:08:51.217 INFO:teuthology.orchestra.run.smithi052.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-26T10:08:51.217 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_ID="20.04" 2024-04-26T10:08:51.217 INFO:teuthology.orchestra.run.smithi052.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T10:08:51.217 INFO:teuthology.orchestra.run.smithi052.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T10:08:51.217 INFO:teuthology.orchestra.run.smithi052.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T10:08:51.217 INFO:teuthology.orchestra.run.smithi052.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T10:08:51.217 INFO:teuthology.orchestra.run.smithi052.stdout:VERSION_CODENAME=focal 2024-04-26T10:08:51.217 INFO:teuthology.orchestra.run.smithi052.stdout:UBUNTU_CODENAME=focal 2024-04-26T10:08:51.218 INFO:teuthology.lock.ops:Updating smithi052.front.sepia.ceph.com on lock server 2024-04-26T10:08:51.247 DEBUG:teuthology.orchestra.run.smithi120:> uname -m 2024-04-26T10:08:51.254 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64 2024-04-26T10:08:51.254 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release 2024-04-26T10:08:51.302 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="Ubuntu" 2024-04-26T10:08:51.302 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-26T10:08:51.302 INFO:teuthology.orchestra.run.smithi120.stdout:ID=ubuntu 2024-04-26T10:08:51.302 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE=debian 2024-04-26T10:08:51.302 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-26T10:08:51.302 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="20.04" 2024-04-26T10:08:51.302 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T10:08:51.302 INFO:teuthology.orchestra.run.smithi120.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T10:08:51.302 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T10:08:51.302 INFO:teuthology.orchestra.run.smithi120.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T10:08:51.302 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_CODENAME=focal 2024-04-26T10:08:51.303 INFO:teuthology.orchestra.run.smithi120.stdout:UBUNTU_CODENAME=focal 2024-04-26T10:08:51.303 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server 2024-04-26T10:08:51.322 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-04-26T10:08:51.328 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-04-26T10:08:51.329 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-04-26T10:08:51.336 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Ubuntu" 2024-04-26T10:08:51.336 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-26T10:08:51.336 INFO:teuthology.orchestra.run.smithi154.stdout:ID=ubuntu 2024-04-26T10:08:51.336 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE=debian 2024-04-26T10:08:51.336 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-26T10:08:51.336 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="20.04" 2024-04-26T10:08:51.337 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T10:08:51.337 INFO:teuthology.orchestra.run.smithi154.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T10:08:51.337 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T10:08:51.337 INFO:teuthology.orchestra.run.smithi154.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T10:08:51.337 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_CODENAME=focal 2024-04-26T10:08:51.337 INFO:teuthology.orchestra.run.smithi154.stdout:UBUNTU_CODENAME=focal 2024-04-26T10:08:51.337 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-04-26T10:08:51.355 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-04-26T10:08:51.361 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-04-26T10:08:51.362 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-04-26T10:08:51.409 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="Ubuntu" 2024-04-26T10:08:51.409 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-26T10:08:51.409 INFO:teuthology.orchestra.run.smithi164.stdout:ID=ubuntu 2024-04-26T10:08:51.409 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE=debian 2024-04-26T10:08:51.409 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-26T10:08:51.409 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="20.04" 2024-04-26T10:08:51.409 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-26T10:08:51.409 INFO:teuthology.orchestra.run.smithi164.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-26T10:08:51.409 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-26T10:08:51.409 INFO:teuthology.orchestra.run.smithi164.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-26T10:08:51.410 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_CODENAME=focal 2024-04-26T10:08:51.410 INFO:teuthology.orchestra.run.smithi164.stdout:UBUNTU_CODENAME=focal 2024-04-26T10:08:51.410 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-04-26T10:08:51.430 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-26T10:08:51.440 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-26T10:08:51.466 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-26T10:08:51.466 DEBUG:teuthology.orchestra.run.smithi052:> test '!' -e /home/ubuntu/cephtest 2024-04-26T10:08:51.469 DEBUG:teuthology.orchestra.run.smithi120:> test '!' -e /home/ubuntu/cephtest 2024-04-26T10:08:51.471 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-04-26T10:08:51.474 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2024-04-26T10:08:51.480 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-26T10:08:51.491 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-26T10:08:51.492 DEBUG:teuthology.orchestra.run.smithi052:> test -z $(ls -A /var/lib/ceph) 2024-04-26T10:08:51.516 DEBUG:teuthology.orchestra.run.smithi120:> test -z $(ls -A /var/lib/ceph) 2024-04-26T10:08:51.521 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-04-26T10:08:51.523 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2024-04-26T10:08:51.546 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-26T10:08:51.632 INFO:teuthology.run_tasks:Running task kernel... 2024-04-26T10:08:51.651 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-26T10:08:51.652 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-26T10:08:51.652 DEBUG:teuthology.orchestra.run.smithi052:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T10:08:51.653 DEBUG:teuthology.orchestra.run.smithi120:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T10:08:51.653 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T10:08:51.654 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-26T10:08:51.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:08:51.660 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-04-26T10:08:51.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:08:51.661 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:08:51.661 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:08:51.662 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-04-26T10:08:51.662 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-04-26T10:08:51.663 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-04-26T10:08:51.669 INFO:teuthology.orchestra.run.smithi164.stdout:5.4.0-124-generic 2024-04-26T10:08:51.669 INFO:teuthology.orchestra.run.smithi154.stdout:5.4.0-124-generic 2024-04-26T10:08:51.669 INFO:teuthology.task.kernel:Running kernel on smithi164: 5.4.0-124-generic 2024-04-26T10:08:51.670 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-get clean 2024-04-26T10:08:51.670 INFO:teuthology.task.kernel:Running kernel on smithi154: 5.4.0-124-generic 2024-04-26T10:08:51.670 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get clean 2024-04-26T10:08:51.708 INFO:teuthology.orchestra.run.smithi052.stdout:5.4.0-124-generic 2024-04-26T10:08:51.708 INFO:teuthology.task.kernel:Running kernel on smithi052: 5.4.0-124-generic 2024-04-26T10:08:51.709 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get clean 2024-04-26T10:08:51.710 INFO:teuthology.orchestra.run.smithi120.stdout:5.4.0-124-generic 2024-04-26T10:08:51.710 INFO:teuthology.task.kernel:Running kernel on smithi120: 5.4.0-124-generic 2024-04-26T10:08:51.710 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get clean 2024-04-26T10:08:51.812 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get update 2024-04-26T10:08:51.815 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-get update 2024-04-26T10:08:51.825 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-04-26T10:08:51.829 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get update 2024-04-26T10:08:51.966 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T10:08:51.977 INFO:teuthology.orchestra.run.smithi164.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-04-26T10:08:51.978 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-04-26T10:08:51.991 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T10:08:51.993 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-04-26T10:08:51.993 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-04-26T10:08:52.009 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T10:08:52.021 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-04-26T10:08:52.048 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-04-26T10:08:52.069 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-04-26T10:08:52.074 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-04-26T10:08:52.084 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T10:08:52.100 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-04-26T10:08:52.114 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-04-26T10:08:52.166 INFO:teuthology.orchestra.run.smithi164.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-04-26T10:08:52.290 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,891 kB] 2024-04-26T10:08:52.372 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,270 kB] 2024-04-26T10:08:52.388 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [743 kB] 2024-04-26T10:08:52.395 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [968 kB] 2024-04-26T10:08:52.453 INFO:teuthology.orchestra.run.smithi164.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [743 kB] 2024-04-26T10:08:52.466 INFO:teuthology.orchestra.run.smithi164.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [435 kB] 2024-04-26T10:08:52.472 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-04-26T10:08:52.472 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-04-26T10:08:52.473 INFO:teuthology.orchestra.run.smithi164.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,772 kB] 2024-04-26T10:08:52.510 INFO:teuthology.orchestra.run.smithi164.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-04-26T10:08:52.513 INFO:teuthology.orchestra.run.smithi164.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [387 kB] 2024-04-26T10:08:52.517 INFO:teuthology.orchestra.run.smithi164.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-04-26T10:08:52.517 INFO:teuthology.orchestra.run.smithi164.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [957 kB] 2024-04-26T10:08:52.529 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,891 kB] 2024-04-26T10:08:52.529 INFO:teuthology.orchestra.run.smithi164.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [656 kB] 2024-04-26T10:08:52.537 INFO:teuthology.orchestra.run.smithi164.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [201 kB] 2024-04-26T10:08:52.542 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,270 kB] 2024-04-26T10:08:52.543 INFO:teuthology.orchestra.run.smithi164.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-04-26T10:08:52.544 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [968 kB] 2024-04-26T10:08:52.551 INFO:teuthology.orchestra.run.smithi164.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-04-26T10:08:52.552 INFO:teuthology.orchestra.run.smithi164.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-04-26T10:08:52.552 INFO:teuthology.orchestra.run.smithi164.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-04-26T10:08:52.575 INFO:teuthology.orchestra.run.smithi164.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-04-26T10:08:52.576 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [968 kB] 2024-04-26T10:08:52.593 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [517 kB] 2024-04-26T10:08:52.599 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-04-26T10:08:52.599 INFO:teuthology.orchestra.run.smithi052.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,889 kB] 2024-04-26T10:08:52.633 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [517 kB] 2024-04-26T10:08:52.635 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [435 kB] 2024-04-26T10:08:52.650 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-04-26T10:08:52.651 INFO:teuthology.orchestra.run.smithi120.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,889 kB] 2024-04-26T10:08:52.656 INFO:teuthology.orchestra.run.smithi164.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [968 kB] 2024-04-26T10:08:52.658 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-04-26T10:08:52.659 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-04-26T10:08:52.659 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,772 kB] 2024-04-26T10:08:52.676 INFO:teuthology.orchestra.run.smithi052.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-04-26T10:08:52.677 INFO:teuthology.orchestra.run.smithi052.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [403 kB] 2024-04-26T10:08:52.692 INFO:teuthology.orchestra.run.smithi052.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-04-26T10:08:52.692 INFO:teuthology.orchestra.run.smithi052.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [783 kB] 2024-04-26T10:08:52.705 INFO:teuthology.orchestra.run.smithi052.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,891 kB] 2024-04-26T10:08:52.714 INFO:teuthology.orchestra.run.smithi120.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [743 kB] 2024-04-26T10:08:52.765 INFO:teuthology.orchestra.run.smithi120.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-04-26T10:08:52.765 INFO:teuthology.orchestra.run.smithi120.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [403 kB] 2024-04-26T10:08:52.765 INFO:teuthology.orchestra.run.smithi052.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,182 kB] 2024-04-26T10:08:52.770 INFO:teuthology.orchestra.run.smithi120.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-04-26T10:08:52.770 INFO:teuthology.orchestra.run.smithi120.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [783 kB] 2024-04-26T10:08:52.775 INFO:teuthology.orchestra.run.smithi052.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [283 kB] 2024-04-26T10:08:52.776 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [387 kB] 2024-04-26T10:08:52.777 INFO:teuthology.orchestra.run.smithi052.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-04-26T10:08:52.778 INFO:teuthology.orchestra.run.smithi052.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-04-26T10:08:52.779 INFO:teuthology.orchestra.run.smithi052.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-04-26T10:08:52.779 INFO:teuthology.orchestra.run.smithi052.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-04-26T10:08:52.779 INFO:teuthology.orchestra.run.smithi052.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-04-26T10:08:52.780 INFO:teuthology.orchestra.run.smithi052.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-04-26T10:08:52.780 INFO:teuthology.orchestra.run.smithi052.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-04-26T10:08:52.781 INFO:teuthology.orchestra.run.smithi120.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,182 kB] 2024-04-26T10:08:52.781 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-04-26T10:08:52.781 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [656 kB] 2024-04-26T10:08:52.786 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [957 kB] 2024-04-26T10:08:52.787 INFO:teuthology.orchestra.run.smithi052.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-04-26T10:08:52.788 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,270 kB] 2024-04-26T10:08:52.799 INFO:teuthology.orchestra.run.smithi120.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [283 kB] 2024-04-26T10:08:52.803 INFO:teuthology.orchestra.run.smithi120.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-04-26T10:08:52.804 INFO:teuthology.orchestra.run.smithi120.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-04-26T10:08:52.804 INFO:teuthology.orchestra.run.smithi120.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-04-26T10:08:52.805 INFO:teuthology.orchestra.run.smithi120.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-04-26T10:08:52.805 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [201 kB] 2024-04-26T10:08:52.806 INFO:teuthology.orchestra.run.smithi120.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-04-26T10:08:52.808 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-04-26T10:08:52.808 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-04-26T10:08:52.809 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-04-26T10:08:52.809 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-04-26T10:08:52.809 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-04-26T10:08:52.814 INFO:teuthology.orchestra.run.smithi052.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-04-26T10:08:52.815 INFO:teuthology.orchestra.run.smithi052.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-04-26T10:08:52.816 INFO:teuthology.orchestra.run.smithi052.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-04-26T10:08:52.817 INFO:teuthology.orchestra.run.smithi120.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-04-26T10:08:52.818 INFO:teuthology.orchestra.run.smithi120.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-04-26T10:08:52.818 INFO:teuthology.orchestra.run.smithi120.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-04-26T10:08:52.838 INFO:teuthology.orchestra.run.smithi120.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-04-26T10:08:52.839 INFO:teuthology.orchestra.run.smithi120.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-04-26T10:08:52.839 INFO:teuthology.orchestra.run.smithi120.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-04-26T10:08:52.878 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [517 kB] 2024-04-26T10:08:52.883 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-04-26T10:08:52.883 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,889 kB] 2024-04-26T10:08:52.913 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-04-26T10:08:52.914 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [403 kB] 2024-04-26T10:08:52.919 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-04-26T10:08:52.919 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [783 kB] 2024-04-26T10:08:52.926 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,182 kB] 2024-04-26T10:08:52.940 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [283 kB] 2024-04-26T10:08:52.943 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-04-26T10:08:52.944 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-04-26T10:08:52.944 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-04-26T10:08:52.960 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-04-26T10:08:52.960 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-04-26T10:08:52.960 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-04-26T10:08:52.961 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-04-26T10:08:52.961 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-04-26T10:08:52.963 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-04-26T10:08:52.964 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-04-26T10:08:52.964 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-04-26T10:08:53.056 INFO:teuthology.orchestra.run.smithi120.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,891 kB] 2024-04-26T10:08:53.198 INFO:teuthology.orchestra.run.smithi052.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [743 kB] 2024-04-26T10:08:53.212 INFO:teuthology.orchestra.run.smithi052.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [435 kB] 2024-04-26T10:08:53.220 INFO:teuthology.orchestra.run.smithi052.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-04-26T10:08:53.221 INFO:teuthology.orchestra.run.smithi052.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-04-26T10:08:53.222 INFO:teuthology.orchestra.run.smithi052.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,772 kB] 2024-04-26T10:08:53.249 INFO:teuthology.orchestra.run.smithi120.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [435 kB] 2024-04-26T10:08:53.264 INFO:teuthology.orchestra.run.smithi120.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-04-26T10:08:53.264 INFO:teuthology.orchestra.run.smithi120.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,772 kB] 2024-04-26T10:08:53.305 INFO:teuthology.orchestra.run.smithi052.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [387 kB] 2024-04-26T10:08:53.312 INFO:teuthology.orchestra.run.smithi052.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-04-26T10:08:53.312 INFO:teuthology.orchestra.run.smithi052.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [957 kB] 2024-04-26T10:08:53.330 INFO:teuthology.orchestra.run.smithi052.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [656 kB] 2024-04-26T10:08:53.339 INFO:teuthology.orchestra.run.smithi120.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-04-26T10:08:53.340 INFO:teuthology.orchestra.run.smithi120.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [387 kB] 2024-04-26T10:08:53.349 INFO:teuthology.orchestra.run.smithi120.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-04-26T10:08:53.349 INFO:teuthology.orchestra.run.smithi120.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [656 kB] 2024-04-26T10:08:53.379 INFO:teuthology.orchestra.run.smithi120.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [957 kB] 2024-04-26T10:08:53.527 INFO:teuthology.orchestra.run.smithi052.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [201 kB] 2024-04-26T10:08:53.559 INFO:teuthology.orchestra.run.smithi120.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [201 kB] 2024-04-26T10:08:53.955 INFO:teuthology.orchestra.run.smithi052.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-04-26T10:08:53.960 INFO:teuthology.orchestra.run.smithi052.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-04-26T10:08:53.967 INFO:teuthology.orchestra.run.smithi052.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-04-26T10:08:53.970 INFO:teuthology.orchestra.run.smithi052.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-04-26T10:08:53.971 INFO:teuthology.orchestra.run.smithi052.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-04-26T10:08:53.994 INFO:teuthology.orchestra.run.smithi120.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-04-26T10:08:53.999 INFO:teuthology.orchestra.run.smithi120.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-04-26T10:08:54.007 INFO:teuthology.orchestra.run.smithi120.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-04-26T10:08:54.008 INFO:teuthology.orchestra.run.smithi120.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-04-26T10:08:54.010 INFO:teuthology.orchestra.run.smithi120.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-04-26T10:08:55.129 INFO:teuthology.orchestra.run.smithi164.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,270 kB] 2024-04-26T10:08:56.002 INFO:teuthology.orchestra.run.smithi164.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [517 kB] 2024-04-26T10:08:56.070 INFO:teuthology.orchestra.run.smithi164.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-04-26T10:08:56.071 INFO:teuthology.orchestra.run.smithi164.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-04-26T10:08:56.077 INFO:teuthology.orchestra.run.smithi164.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,889 kB] 2024-04-26T10:08:56.353 INFO:teuthology.orchestra.run.smithi164.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [403 kB] 2024-04-26T10:08:56.383 INFO:teuthology.orchestra.run.smithi164.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-04-26T10:08:56.548 INFO:teuthology.orchestra.run.smithi164.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,182 kB] 2024-04-26T10:08:56.784 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 20.0 MB in 3s (6,904 kB/s) 2024-04-26T10:08:56.829 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 20.0 MB in 3s (7,005 kB/s) 2024-04-26T10:08:56.916 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 20.0 MB in 3s (6,596 kB/s) 2024-04-26T10:08:57.192 INFO:teuthology.orchestra.run.smithi164.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [783 kB] 2024-04-26T10:08:57.231 INFO:teuthology.orchestra.run.smithi164.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [283 kB] 2024-04-26T10:08:57.244 INFO:teuthology.orchestra.run.smithi164.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-04-26T10:08:57.246 INFO:teuthology.orchestra.run.smithi164.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-04-26T10:08:57.247 INFO:teuthology.orchestra.run.smithi164.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-04-26T10:08:57.247 INFO:teuthology.orchestra.run.smithi164.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-04-26T10:08:57.248 INFO:teuthology.orchestra.run.smithi164.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-04-26T10:08:57.248 INFO:teuthology.orchestra.run.smithi164.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-04-26T10:08:57.249 INFO:teuthology.orchestra.run.smithi164.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-04-26T10:08:57.274 INFO:teuthology.orchestra.run.smithi164.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-04-26T10:08:57.438 INFO:teuthology.orchestra.run.smithi164.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-04-26T10:08:57.629 INFO:teuthology.orchestra.run.smithi164.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-04-26T10:08:57.652 INFO:teuthology.orchestra.run.smithi164.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-04-26T10:08:58.327 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-04-26T10:08:58.353 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T10:08:58.370 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-04-26T10:08:58.397 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T10:08:58.421 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-04-26T10:08:58.476 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-04-26T10:08:58.479 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-04-26T10:08:58.505 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T10:08:58.593 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-04-26T10:08:58.633 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-04-26T10:08:58.633 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-04-26T10:08:58.690 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-04-26T10:08:58.691 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-04-26T10:08:58.809 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2024-04-26T10:08:58.810 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2024-04-26T10:08:58.833 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-04-26T10:08:58.833 INFO:teuthology.orchestra.run.smithi154.stdout: linux-generic linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-26T10:08:58.834 INFO:teuthology.orchestra.run.smithi154.stdout: linux-headers-generic linux-image-5.4.0-177-generic 2024-04-26T10:08:58.834 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-5.4.0-177-generic linux-modules-extra-5.4.0-177-generic 2024-04-26T10:08:58.835 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-04-26T10:08:58.835 INFO:teuthology.orchestra.run.smithi154.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-04-26T10:08:58.835 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2024-04-26T10:08:58.835 INFO:teuthology.orchestra.run.smithi154.stdout: thermald 2024-04-26T10:08:58.878 INFO:teuthology.orchestra.run.smithi120.stdout:The following additional packages will be installed: 2024-04-26T10:08:58.879 INFO:teuthology.orchestra.run.smithi120.stdout: linux-generic linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-26T10:08:58.879 INFO:teuthology.orchestra.run.smithi120.stdout: linux-headers-generic linux-image-5.4.0-177-generic 2024-04-26T10:08:58.879 INFO:teuthology.orchestra.run.smithi120.stdout: linux-modules-5.4.0-177-generic linux-modules-extra-5.4.0-177-generic 2024-04-26T10:08:58.880 INFO:teuthology.orchestra.run.smithi120.stdout:Suggested packages: 2024-04-26T10:08:58.880 INFO:teuthology.orchestra.run.smithi120.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-04-26T10:08:58.880 INFO:teuthology.orchestra.run.smithi120.stdout:Recommended packages: 2024-04-26T10:08:58.880 INFO:teuthology.orchestra.run.smithi120.stdout: thermald 2024-04-26T10:08:58.899 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-04-26T10:08:58.899 INFO:teuthology.orchestra.run.smithi154.stdout: linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-26T10:08:58.899 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-177-generic linux-modules-5.4.0-177-generic 2024-04-26T10:08:58.900 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-extra-5.4.0-177-generic 2024-04-26T10:08:58.901 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages will be upgraded: 2024-04-26T10:08:58.901 INFO:teuthology.orchestra.run.smithi154.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T10:08:58.936 INFO:teuthology.orchestra.run.smithi120.stdout:The following NEW packages will be installed: 2024-04-26T10:08:58.936 INFO:teuthology.orchestra.run.smithi120.stdout: linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-26T10:08:58.936 INFO:teuthology.orchestra.run.smithi120.stdout: linux-image-5.4.0-177-generic linux-modules-5.4.0-177-generic 2024-04-26T10:08:58.936 INFO:teuthology.orchestra.run.smithi120.stdout: linux-modules-extra-5.4.0-177-generic 2024-04-26T10:08:58.937 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages will be upgraded: 2024-04-26T10:08:58.938 INFO:teuthology.orchestra.run.smithi120.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T10:08:58.998 INFO:teuthology.orchestra.run.smithi120.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-04-26T10:08:58.998 INFO:teuthology.orchestra.run.smithi120.stdout:Need to get 77.1 MB of archives. 2024-04-26T10:08:58.998 INFO:teuthology.orchestra.run.smithi120.stdout:After this operation, 380 MB of additional disk space will be used. 2024-04-26T10:08:58.998 INFO:teuthology.orchestra.run.smithi120.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-177-generic amd64 5.4.0-177.197 [15.0 MB] 2024-04-26T10:08:59.017 INFO:teuthology.orchestra.run.smithi052.stdout:The following additional packages will be installed: 2024-04-26T10:08:59.017 INFO:teuthology.orchestra.run.smithi052.stdout: linux-generic linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-26T10:08:59.017 INFO:teuthology.orchestra.run.smithi052.stdout: linux-headers-generic linux-image-5.4.0-177-generic 2024-04-26T10:08:59.017 INFO:teuthology.orchestra.run.smithi052.stdout: linux-modules-5.4.0-177-generic linux-modules-extra-5.4.0-177-generic 2024-04-26T10:08:59.018 INFO:teuthology.orchestra.run.smithi052.stdout:Suggested packages: 2024-04-26T10:08:59.018 INFO:teuthology.orchestra.run.smithi052.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-04-26T10:08:59.018 INFO:teuthology.orchestra.run.smithi052.stdout:Recommended packages: 2024-04-26T10:08:59.018 INFO:teuthology.orchestra.run.smithi052.stdout: thermald 2024-04-26T10:08:59.072 INFO:teuthology.orchestra.run.smithi052.stdout:The following NEW packages will be installed: 2024-04-26T10:08:59.072 INFO:teuthology.orchestra.run.smithi052.stdout: linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-26T10:08:59.073 INFO:teuthology.orchestra.run.smithi052.stdout: linux-image-5.4.0-177-generic linux-modules-5.4.0-177-generic 2024-04-26T10:08:59.073 INFO:teuthology.orchestra.run.smithi052.stdout: linux-modules-extra-5.4.0-177-generic 2024-04-26T10:08:59.074 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages will be upgraded: 2024-04-26T10:08:59.075 INFO:teuthology.orchestra.run.smithi052.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T10:08:59.084 INFO:teuthology.orchestra.run.smithi154.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-04-26T10:08:59.085 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 77.1 MB of archives. 2024-04-26T10:08:59.085 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 380 MB of additional disk space will be used. 2024-04-26T10:08:59.085 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-177-generic amd64 5.4.0-177.197 [15.0 MB] 2024-04-26T10:08:59.135 INFO:teuthology.orchestra.run.smithi052.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-04-26T10:08:59.135 INFO:teuthology.orchestra.run.smithi052.stdout:Need to get 77.1 MB of archives. 2024-04-26T10:08:59.135 INFO:teuthology.orchestra.run.smithi052.stdout:After this operation, 380 MB of additional disk space will be used. 2024-04-26T10:08:59.135 INFO:teuthology.orchestra.run.smithi052.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-177-generic amd64 5.4.0-177.197 [15.0 MB] 2024-04-26T10:08:59.467 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-177-generic amd64 5.4.0-177.197 [10.5 MB] 2024-04-26T10:08:59.602 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 20.0 MB in 6s (3,477 kB/s) 2024-04-26T10:08:59.664 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-177-generic amd64 5.4.0-177.197 [39.2 MB] 2024-04-26T10:08:59.811 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-177-generic amd64 5.4.0-177.197 [10.5 MB] 2024-04-26T10:09:00.016 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-177-generic amd64 5.4.0-177.197 [39.2 MB] 2024-04-26T10:09:00.208 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-177-generic amd64 5.4.0-177.197 [10.5 MB] 2024-04-26T10:09:00.478 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-177-generic amd64 5.4.0-177.197 [39.2 MB] 2024-04-26T10:09:00.626 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.177.175 [1,900 B] 2024-04-26T10:09:00.626 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.177.175 [2,612 B] 2024-04-26T10:09:00.627 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177 all 5.4.0-177.197 [11.0 MB] 2024-04-26T10:09:00.827 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177-generic amd64 5.4.0-177.197 [1,377 kB] 2024-04-26T10:09:00.853 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.177.175 [2,480 B] 2024-04-26T10:09:00.974 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.177.175 [1,900 B] 2024-04-26T10:09:00.975 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.177.175 [2,612 B] 2024-04-26T10:09:00.975 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177 all 5.4.0-177.197 [11.0 MB] 2024-04-26T10:09:01.086 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177-generic amd64 5.4.0-177.197 [1,377 kB] 2024-04-26T10:09:01.100 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.177.175 [2,480 B] 2024-04-26T10:09:01.122 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2024-04-26T10:09:01.147 DEBUG:teuthology.orchestra.run.smithi164:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T10:09:01.232 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2024-04-26T10:09:01.442 INFO:teuthology.orchestra.run.smithi164.stdout:Building dependency tree... 2024-04-26T10:09:01.442 INFO:teuthology.orchestra.run.smithi164.stdout:Reading state information... 2024-04-26T10:09:01.556 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 77.1 MB in 2s (40.4 MB/s) 2024-04-26T10:09:01.654 INFO:teuthology.orchestra.run.smithi164.stdout:The following additional packages will be installed: 2024-04-26T10:09:01.654 INFO:teuthology.orchestra.run.smithi164.stdout: linux-generic linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-26T10:09:01.654 INFO:teuthology.orchestra.run.smithi164.stdout: linux-headers-generic linux-image-5.4.0-177-generic 2024-04-26T10:09:01.655 INFO:teuthology.orchestra.run.smithi164.stdout: linux-modules-5.4.0-177-generic linux-modules-extra-5.4.0-177-generic 2024-04-26T10:09:01.655 INFO:teuthology.orchestra.run.smithi164.stdout:Suggested packages: 2024-04-26T10:09:01.655 INFO:teuthology.orchestra.run.smithi164.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-04-26T10:09:01.656 INFO:teuthology.orchestra.run.smithi164.stdout:Recommended packages: 2024-04-26T10:09:01.656 INFO:teuthology.orchestra.run.smithi164.stdout: thermald 2024-04-26T10:09:01.712 INFO:teuthology.orchestra.run.smithi164.stdout:The following NEW packages will be installed: 2024-04-26T10:09:01.712 INFO:teuthology.orchestra.run.smithi164.stdout: linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-26T10:09:01.712 INFO:teuthology.orchestra.run.smithi164.stdout: linux-image-5.4.0-177-generic linux-modules-5.4.0-177-generic 2024-04-26T10:09:01.712 INFO:teuthology.orchestra.run.smithi164.stdout: linux-modules-extra-5.4.0-177-generic 2024-04-26T10:09:01.713 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages will be upgraded: 2024-04-26T10:09:01.714 INFO:teuthology.orchestra.run.smithi164.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-26T10:09:01.771 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-modules-5.4.0-177-generic. 2024-04-26T10:09:01.774 INFO:teuthology.orchestra.run.smithi164.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-04-26T10:09:01.774 INFO:teuthology.orchestra.run.smithi164.stdout:Need to get 77.1 MB of archives. 2024-04-26T10:09:01.774 INFO:teuthology.orchestra.run.smithi164.stdout:After this operation, 380 MB of additional disk space will be used. 2024-04-26T10:09:01.774 INFO:teuthology.orchestra.run.smithi164.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-177-generic amd64 5.4.0-177.197 [15.0 MB] 2024-04-26T10:09:01.822 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.177.175 [1,900 B] 2024-04-26T10:09:01.823 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.177.175 [2,612 B] 2024-04-26T10:09:01.823 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177 all 5.4.0-177.197 [11.0 MB] 2024-04-26T10:09:01.832 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 77.1 MB in 2s (38.2 MB/s) 2024-04-26T10:09:02.068 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-modules-5.4.0-177-generic. 2024-04-26T10:09:02.121 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177-generic amd64 5.4.0-177.197 [1,377 kB] 2024-04-26T10:09:02.128 INFO:teuthology.orchestra.run.smithi164.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-177-generic amd64 5.4.0-177.197 [10.5 MB] 2024-04-26T10:09:02.166 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.177.175 [2,480 B] 2024-04-26T10:09:02.229 INFO:teuthology.orchestra.run.smithi164.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-177-generic amd64 5.4.0-177.197 [39.2 MB] 2024-04-26T10:09:02.814 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.177.175 [1,900 B] 2024-04-26T10:09:02.814 INFO:teuthology.orchestra.run.smithi164.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.177.175 [2,612 B] 2024-04-26T10:09:02.814 INFO:teuthology.orchestra.run.smithi164.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177 all 5.4.0-177.197 [11.0 MB] 2024-04-26T10:09:02.836 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 77.1 MB in 3s (23.7 MB/s) 2024-04-26T10:09:03.006 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177-generic amd64 5.4.0-177.197 [1,377 kB] 2024-04-26T10:09:03.027 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.177.175 [2,480 B] 2024-04-26T10:09:03.045 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-modules-5.4.0-177-generic. 2024-04-26T10:09:03.470 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-04-26T10:09:03.475 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../0-linux-modules-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T10:09:03.618 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:03.731 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 77.1 MB in 1s (59.0 MB/s) 2024-04-26T10:09:03.789 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-04-26T10:09:03.794 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../0-linux-modules-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T10:09:03.905 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package linux-modules-5.4.0-177-generic. 2024-04-26T10:09:03.932 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:04.742 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-04-26T10:09:04.747 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../0-linux-modules-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T10:09:04.834 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:05.642 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-04-26T10:09:05.647 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../0-linux-modules-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T10:09:05.718 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-image-5.4.0-177-generic. 2024-04-26T10:09:05.734 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../1-linux-image-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T10:09:05.786 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:05.841 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:05.858 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-image-5.4.0-177-generic. 2024-04-26T10:09:05.872 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../1-linux-image-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T10:09:05.977 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:06.835 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-image-5.4.0-177-generic. 2024-04-26T10:09:06.849 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../1-linux-image-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T10:09:06.920 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-177-generic. 2024-04-26T10:09:06.933 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T10:09:06.951 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:06.970 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:07.086 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-177-generic. 2024-04-26T10:09:07.100 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T10:09:07.144 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:07.761 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package linux-image-5.4.0-177-generic. 2024-04-26T10:09:07.774 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../1-linux-image-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T10:09:07.865 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:08.055 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-177-generic. 2024-04-26T10:09:08.069 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T10:09:08.113 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:08.997 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-177-generic. 2024-04-26T10:09:09.012 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T10:09:09.064 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:12.192 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../3-linux-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T10:09:12.200 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../3-linux-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T10:09:12.315 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T10:09:12.349 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T10:09:12.657 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T10:09:12.675 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T10:09:12.810 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-image-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T10:09:12.819 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-image-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T10:09:12.884 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../3-linux-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T10:09:13.044 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T10:09:13.146 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-headers-5.4.0-177. 2024-04-26T10:09:13.147 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-headers-5.4.0-177. 2024-04-26T10:09:13.161 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../5-linux-headers-5.4.0-177_5.4.0-177.197_all.deb ... 2024-04-26T10:09:13.161 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../5-linux-headers-5.4.0-177_5.4.0-177.197_all.deb ... 2024-04-26T10:09:13.204 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-26T10:09:13.205 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-26T10:09:13.388 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T10:09:13.515 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T10:09:13.859 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-headers-5.4.0-177. 2024-04-26T10:09:13.873 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../5-linux-headers-5.4.0-177_5.4.0-177.197_all.deb ... 2024-04-26T10:09:13.918 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-26T10:09:13.950 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../3-linux-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T10:09:14.101 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T10:09:14.444 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T10:09:14.571 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-image-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T10:09:14.941 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package linux-headers-5.4.0-177. 2024-04-26T10:09:14.954 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../5-linux-headers-5.4.0-177_5.4.0-177.197_all.deb ... 2024-04-26T10:09:14.999 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-26T10:09:18.863 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package linux-headers-5.4.0-177-generic. 2024-04-26T10:09:18.885 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../6-linux-headers-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T10:09:18.930 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:19.061 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package linux-headers-5.4.0-177-generic. 2024-04-26T10:09:19.083 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../6-linux-headers-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T10:09:19.177 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:19.961 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-headers-5.4.0-177-generic. 2024-04-26T10:09:19.985 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../6-linux-headers-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T10:09:20.027 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:20.608 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package linux-headers-5.4.0-177-generic. 2024-04-26T10:09:20.630 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../6-linux-headers-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-26T10:09:20.674 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:21.694 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T10:09:21.857 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking linux-headers-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T10:09:21.933 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T10:09:22.086 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking linux-headers-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T10:09:22.207 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:22.421 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:22.742 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T10:09:22.864 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T10:09:23.230 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:23.443 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-26T10:09:23.512 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.177.175_amd64.deb ... 2024-04-26T10:09:23.575 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:23.665 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking linux-headers-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-26T10:09:23.693 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:23.700 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-26T10:09:23.826 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:23.927 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:24.026 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:24.436 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-26T10:09:24.588 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:24.713 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:24.864 INFO:teuthology.orchestra.run.smithi120.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-177-generic 2024-04-26T10:09:24.864 INFO:teuthology.orchestra.run.smithi120.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-177-generic 2024-04-26T10:09:24.995 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-headers-generic (5.4.0.177.175) ... 2024-04-26T10:09:25.229 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-26T10:09:25.347 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:25.448 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:25.506 INFO:teuthology.orchestra.run.smithi052.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-177-generic 2024-04-26T10:09:25.506 INFO:teuthology.orchestra.run.smithi052.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-177-generic 2024-04-26T10:09:25.662 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-headers-generic (5.4.0.177.175) ... 2024-04-26T10:09:25.788 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:25.857 INFO:teuthology.orchestra.run.smithi154.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-177-generic 2024-04-26T10:09:25.857 INFO:teuthology.orchestra.run.smithi154.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-177-generic 2024-04-26T10:09:26.024 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-generic (5.4.0.177.175) ... 2024-04-26T10:09:26.150 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:26.261 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:26.849 INFO:teuthology.orchestra.run.smithi164.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-177-generic 2024-04-26T10:09:26.850 INFO:teuthology.orchestra.run.smithi164.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-177-generic 2024-04-26T10:09:27.006 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-image-generic (5.4.0.177.175) ... 2024-04-26T10:09:27.166 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up linux-generic (5.4.0.177.175) ... 2024-04-26T10:09:27.292 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:27.334 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-generic (5.4.0.177.175) ... 2024-04-26T10:09:27.367 INFO:teuthology.orchestra.run.smithi052.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T10:09:27.367 INFO:teuthology.orchestra.run.smithi052.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-177-generic 2024-04-26T10:09:27.477 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-generic (5.4.0.177.175) ... 2024-04-26T10:09:27.531 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-image-generic (5.4.0.177.175) ... 2024-04-26T10:09:27.657 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up linux-generic (5.4.0.177.175) ... 2024-04-26T10:09:27.660 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:27.800 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:27.867 INFO:teuthology.orchestra.run.smithi120.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T10:09:27.867 INFO:teuthology.orchestra.run.smithi120.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-177-generic 2024-04-26T10:09:28.262 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-headers-generic (5.4.0.177.175) ... 2024-04-26T10:09:28.493 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:28.616 INFO:teuthology.orchestra.run.smithi154.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T10:09:28.616 INFO:teuthology.orchestra.run.smithi154.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-177-generic 2024-04-26T10:09:29.702 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-image-generic (5.4.0.177.175) ... 2024-04-26T10:09:29.853 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up linux-generic (5.4.0.177.175) ... 2024-04-26T10:09:29.980 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-26T10:09:30.062 INFO:teuthology.orchestra.run.smithi164.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-26T10:09:30.062 INFO:teuthology.orchestra.run.smithi164.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-177-generic 2024-04-26T10:09:49.977 INFO:teuthology.orchestra.run.smithi052.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T10:09:49.977 INFO:teuthology.orchestra.run.smithi052.stdout:Sourcing file `/etc/default/grub' 2024-04-26T10:09:50.001 INFO:teuthology.orchestra.run.smithi052.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T10:09:50.022 INFO:teuthology.orchestra.run.smithi052.stdout:Generating grub configuration file ... 2024-04-26T10:09:50.128 INFO:teuthology.orchestra.run.smithi120.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T10:09:50.129 INFO:teuthology.orchestra.run.smithi120.stdout:Sourcing file `/etc/default/grub' 2024-04-26T10:09:50.140 INFO:teuthology.orchestra.run.smithi120.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T10:09:50.177 INFO:teuthology.orchestra.run.smithi120.stdout:Generating grub configuration file ... 2024-04-26T10:09:50.424 INFO:teuthology.orchestra.run.smithi052.stdout:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-26T10:09:50.446 INFO:teuthology.orchestra.run.smithi052.stdout:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-26T10:09:50.517 INFO:teuthology.orchestra.run.smithi120.stdout:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-26T10:09:50.538 INFO:teuthology.orchestra.run.smithi120.stdout:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-26T10:09:50.878 INFO:teuthology.orchestra.run.smithi052.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-26T10:09:50.890 INFO:teuthology.orchestra.run.smithi052.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-26T10:09:50.932 INFO:teuthology.orchestra.run.smithi120.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-26T10:09:50.944 INFO:teuthology.orchestra.run.smithi120.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-26T10:09:51.508 INFO:teuthology.orchestra.run.smithi154.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T10:09:51.508 INFO:teuthology.orchestra.run.smithi154.stdout:Sourcing file `/etc/default/grub' 2024-04-26T10:09:51.529 INFO:teuthology.orchestra.run.smithi154.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T10:09:51.557 INFO:teuthology.orchestra.run.smithi154.stdout:Generating grub configuration file ... 2024-04-26T10:09:51.903 INFO:teuthology.orchestra.run.smithi164.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-26T10:09:51.904 INFO:teuthology.orchestra.run.smithi164.stdout:Sourcing file `/etc/default/grub' 2024-04-26T10:09:51.919 INFO:teuthology.orchestra.run.smithi164.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T10:09:51.928 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-26T10:09:51.934 INFO:teuthology.orchestra.run.smithi164.stdout:Generating grub configuration file ... 2024-04-26T10:09:51.952 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-26T10:09:52.304 INFO:teuthology.orchestra.run.smithi164.stdout:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-26T10:09:52.326 INFO:teuthology.orchestra.run.smithi164.stdout:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-26T10:09:52.332 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-26T10:09:52.344 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-26T10:09:52.760 INFO:teuthology.orchestra.run.smithi164.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-26T10:09:52.772 INFO:teuthology.orchestra.run.smithi164.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-26T10:09:52.796 INFO:teuthology.orchestra.run.smithi120.stdout:done 2024-04-26T10:09:53.216 DEBUG:teuthology.orchestra.run.smithi120:> dpkg -s linux-image-generic 2024-04-26T10:09:53.259 INFO:teuthology.orchestra.run.smithi120.stdout:Package: linux-image-generic 2024-04-26T10:09:53.260 INFO:teuthology.orchestra.run.smithi120.stdout:Status: install ok installed 2024-04-26T10:09:53.260 INFO:teuthology.orchestra.run.smithi120.stdout:Priority: optional 2024-04-26T10:09:53.260 INFO:teuthology.orchestra.run.smithi120.stdout:Section: kernel 2024-04-26T10:09:53.260 INFO:teuthology.orchestra.run.smithi120.stdout:Installed-Size: 20 2024-04-26T10:09:53.260 INFO:teuthology.orchestra.run.smithi120.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T10:09:53.260 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: amd64 2024-04-26T10:09:53.260 INFO:teuthology.orchestra.run.smithi120.stdout:Source: linux-meta 2024-04-26T10:09:53.260 INFO:teuthology.orchestra.run.smithi120.stdout:Version: 5.4.0.177.175 2024-04-26T10:09:53.260 INFO:teuthology.orchestra.run.smithi120.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-26T10:09:53.260 INFO:teuthology.orchestra.run.smithi120.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T10:09:53.260 INFO:teuthology.orchestra.run.smithi120.stdout:Recommends: thermald 2024-04-26T10:09:53.260 INFO:teuthology.orchestra.run.smithi120.stdout:Description: Generic Linux kernel image 2024-04-26T10:09:53.261 INFO:teuthology.orchestra.run.smithi120.stdout: This package will always depend on the latest generic kernel image 2024-04-26T10:09:53.261 INFO:teuthology.orchestra.run.smithi120.stdout: available. 2024-04-26T10:09:53.261 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-177-generic 2024-04-26T10:09:53.261 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T10:09:53.261 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T10:09:53.261 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-04-26T10:09:53.261 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi120.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T10:09:53.261 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get clean 2024-04-26T10:09:53.364 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get update 2024-04-26T10:09:53.464 INFO:teuthology.orchestra.run.smithi052.stdout:done 2024-04-26T10:09:53.624 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T10:09:53.624 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-26T10:09:53.695 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-26T10:09:53.777 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-26T10:09:53.887 DEBUG:teuthology.orchestra.run.smithi052:> dpkg -s linux-image-generic 2024-04-26T10:09:53.937 INFO:teuthology.orchestra.run.smithi052.stdout:Package: linux-image-generic 2024-04-26T10:09:53.937 INFO:teuthology.orchestra.run.smithi052.stdout:Status: install ok installed 2024-04-26T10:09:53.937 INFO:teuthology.orchestra.run.smithi052.stdout:Priority: optional 2024-04-26T10:09:53.938 INFO:teuthology.orchestra.run.smithi052.stdout:Section: kernel 2024-04-26T10:09:53.938 INFO:teuthology.orchestra.run.smithi052.stdout:Installed-Size: 20 2024-04-26T10:09:53.938 INFO:teuthology.orchestra.run.smithi052.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T10:09:53.938 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: amd64 2024-04-26T10:09:53.938 INFO:teuthology.orchestra.run.smithi052.stdout:Source: linux-meta 2024-04-26T10:09:53.938 INFO:teuthology.orchestra.run.smithi052.stdout:Version: 5.4.0.177.175 2024-04-26T10:09:53.938 INFO:teuthology.orchestra.run.smithi052.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-26T10:09:53.938 INFO:teuthology.orchestra.run.smithi052.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T10:09:53.938 INFO:teuthology.orchestra.run.smithi052.stdout:Recommends: thermald 2024-04-26T10:09:53.938 INFO:teuthology.orchestra.run.smithi052.stdout:Description: Generic Linux kernel image 2024-04-26T10:09:53.938 INFO:teuthology.orchestra.run.smithi052.stdout: This package will always depend on the latest generic kernel image 2024-04-26T10:09:53.938 INFO:teuthology.orchestra.run.smithi052.stdout: available. 2024-04-26T10:09:53.939 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-177-generic 2024-04-26T10:09:53.939 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T10:09:53.939 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T10:09:53.939 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-26T10:09:53.939 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi052.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T10:09:53.939 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get clean 2024-04-26T10:09:54.037 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get update 2024-04-26T10:09:54.151 INFO:teuthology.orchestra.run.smithi154.stdout:done 2024-04-26T10:09:54.174 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T10:09:54.183 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-26T10:09:54.203 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-26T10:09:54.286 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-26T10:09:54.575 DEBUG:teuthology.orchestra.run.smithi154:> dpkg -s linux-image-generic 2024-04-26T10:09:54.597 INFO:teuthology.orchestra.run.smithi164.stdout:done 2024-04-26T10:09:54.617 INFO:teuthology.orchestra.run.smithi154.stdout:Package: linux-image-generic 2024-04-26T10:09:54.617 INFO:teuthology.orchestra.run.smithi154.stdout:Status: install ok installed 2024-04-26T10:09:54.617 INFO:teuthology.orchestra.run.smithi154.stdout:Priority: optional 2024-04-26T10:09:54.617 INFO:teuthology.orchestra.run.smithi154.stdout:Section: kernel 2024-04-26T10:09:54.617 INFO:teuthology.orchestra.run.smithi154.stdout:Installed-Size: 20 2024-04-26T10:09:54.618 INFO:teuthology.orchestra.run.smithi154.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T10:09:54.618 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: amd64 2024-04-26T10:09:54.618 INFO:teuthology.orchestra.run.smithi154.stdout:Source: linux-meta 2024-04-26T10:09:54.618 INFO:teuthology.orchestra.run.smithi154.stdout:Version: 5.4.0.177.175 2024-04-26T10:09:54.618 INFO:teuthology.orchestra.run.smithi154.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-26T10:09:54.618 INFO:teuthology.orchestra.run.smithi154.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T10:09:54.618 INFO:teuthology.orchestra.run.smithi154.stdout:Recommends: thermald 2024-04-26T10:09:54.618 INFO:teuthology.orchestra.run.smithi154.stdout:Description: Generic Linux kernel image 2024-04-26T10:09:54.618 INFO:teuthology.orchestra.run.smithi154.stdout: This package will always depend on the latest generic kernel image 2024-04-26T10:09:54.618 INFO:teuthology.orchestra.run.smithi154.stdout: available. 2024-04-26T10:09:54.618 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-177-generic 2024-04-26T10:09:54.618 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T10:09:54.619 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T10:09:54.619 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-04-26T10:09:54.619 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi154.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T10:09:54.619 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get clean 2024-04-26T10:09:54.717 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-04-26T10:09:54.921 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T10:09:54.964 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-26T10:09:54.967 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-26T10:09:55.006 DEBUG:teuthology.orchestra.run.smithi164:> dpkg -s linux-image-generic 2024-04-26T10:09:55.024 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-26T10:09:55.048 INFO:teuthology.orchestra.run.smithi164.stdout:Package: linux-image-generic 2024-04-26T10:09:55.048 INFO:teuthology.orchestra.run.smithi164.stdout:Status: install ok installed 2024-04-26T10:09:55.048 INFO:teuthology.orchestra.run.smithi164.stdout:Priority: optional 2024-04-26T10:09:55.048 INFO:teuthology.orchestra.run.smithi164.stdout:Section: kernel 2024-04-26T10:09:55.048 INFO:teuthology.orchestra.run.smithi164.stdout:Installed-Size: 20 2024-04-26T10:09:55.049 INFO:teuthology.orchestra.run.smithi164.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T10:09:55.049 INFO:teuthology.orchestra.run.smithi164.stdout:Architecture: amd64 2024-04-26T10:09:55.049 INFO:teuthology.orchestra.run.smithi164.stdout:Source: linux-meta 2024-04-26T10:09:55.049 INFO:teuthology.orchestra.run.smithi164.stdout:Version: 5.4.0.177.175 2024-04-26T10:09:55.049 INFO:teuthology.orchestra.run.smithi164.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-26T10:09:55.049 INFO:teuthology.orchestra.run.smithi164.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T10:09:55.049 INFO:teuthology.orchestra.run.smithi164.stdout:Recommends: thermald 2024-04-26T10:09:55.049 INFO:teuthology.orchestra.run.smithi164.stdout:Description: Generic Linux kernel image 2024-04-26T10:09:55.049 INFO:teuthology.orchestra.run.smithi164.stdout: This package will always depend on the latest generic kernel image 2024-04-26T10:09:55.049 INFO:teuthology.orchestra.run.smithi164.stdout: available. 2024-04-26T10:09:55.049 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-177-generic 2024-04-26T10:09:55.050 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-26T10:09:55.050 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-26T10:09:55.050 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-04-26T10:09:55.050 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi164.front.sepia.ceph.com, path=None, version=distro) 2024-04-26T10:09:55.050 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-get clean 2024-04-26T10:09:55.146 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-get update 2024-04-26T10:09:55.296 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T10:09:55.296 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-26T10:09:55.305 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-26T10:09:55.326 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-26T10:09:55.431 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-04-26T10:09:55.456 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T10:09:55.524 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-04-26T10:09:55.711 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-04-26T10:09:55.712 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-04-26T10:09:55.935 INFO:teuthology.orchestra.run.smithi120.stdout:linux-image-generic is already the newest version (5.4.0.177.175). 2024-04-26T10:09:55.935 INFO:teuthology.orchestra.run.smithi120.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-04-26T10:09:55.937 DEBUG:teuthology.orchestra.run.smithi120:> dpkg -s linux-image-generic 2024-04-26T10:09:55.959 INFO:teuthology.orchestra.run.smithi120.stdout:Package: linux-image-generic 2024-04-26T10:09:55.959 INFO:teuthology.orchestra.run.smithi120.stdout:Status: install ok installed 2024-04-26T10:09:55.959 INFO:teuthology.orchestra.run.smithi120.stdout:Priority: optional 2024-04-26T10:09:55.959 INFO:teuthology.orchestra.run.smithi120.stdout:Section: kernel 2024-04-26T10:09:55.960 INFO:teuthology.orchestra.run.smithi120.stdout:Installed-Size: 20 2024-04-26T10:09:55.960 INFO:teuthology.orchestra.run.smithi120.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T10:09:55.960 INFO:teuthology.orchestra.run.smithi120.stdout:Architecture: amd64 2024-04-26T10:09:55.960 INFO:teuthology.orchestra.run.smithi120.stdout:Source: linux-meta 2024-04-26T10:09:55.960 INFO:teuthology.orchestra.run.smithi120.stdout:Version: 5.4.0.177.175 2024-04-26T10:09:55.960 INFO:teuthology.orchestra.run.smithi120.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-26T10:09:55.960 INFO:teuthology.orchestra.run.smithi120.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T10:09:55.960 INFO:teuthology.orchestra.run.smithi120.stdout:Recommends: thermald 2024-04-26T10:09:55.960 INFO:teuthology.orchestra.run.smithi120.stdout:Description: Generic Linux kernel image 2024-04-26T10:09:55.960 INFO:teuthology.orchestra.run.smithi120.stdout: This package will always depend on the latest generic kernel image 2024-04-26T10:09:55.960 INFO:teuthology.orchestra.run.smithi120.stdout: available. 2024-04-26T10:09:55.961 DEBUG:teuthology.orchestra.run.smithi120:> mktemp 2024-04-26T10:09:55.965 INFO:teuthology.orchestra.run.smithi120.stdout:/tmp/tmp.NuOAMCgKpT 2024-04-26T10:09:55.966 DEBUG:teuthology.orchestra.run.smithi120:> sudo cp /boot/grub/grub.cfg /tmp/tmp.NuOAMCgKpT 2024-04-26T10:09:55.978 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0666 /tmp/tmp.NuOAMCgKpT 2024-04-26T10:09:56.016 DEBUG:teuthology.orchestra.remote:smithi120:/tmp/tmp.NuOAMCgKpT is 9KB 2024-04-26T10:09:56.031 DEBUG:teuthology.orchestra.run.smithi120:> rm -fr /tmp/tmp.NuOAMCgKpT 2024-04-26T10:09:56.037 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T10:09:56.051 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-04-26T10:09:56.079 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T10:09:56.095 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T10:09:56.095 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T10:09:56.095 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T10:09:56.129 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-177-generic 2024-04-26T10:09:56.129 DEBUG:teuthology.orchestra.run.smithi120:> sudo update-grub 2024-04-26T10:09:56.151 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-04-26T10:09:56.352 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2024-04-26T10:09:56.353 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2024-04-26T10:09:56.582 INFO:teuthology.orchestra.run.smithi052.stdout:linux-image-generic is already the newest version (5.4.0.177.175). 2024-04-26T10:09:56.582 INFO:teuthology.orchestra.run.smithi052.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-04-26T10:09:56.584 DEBUG:teuthology.orchestra.run.smithi052:> dpkg -s linux-image-generic 2024-04-26T10:09:56.606 INFO:teuthology.orchestra.run.smithi052.stdout:Package: linux-image-generic 2024-04-26T10:09:56.606 INFO:teuthology.orchestra.run.smithi052.stdout:Status: install ok installed 2024-04-26T10:09:56.606 INFO:teuthology.orchestra.run.smithi052.stdout:Priority: optional 2024-04-26T10:09:56.606 INFO:teuthology.orchestra.run.smithi052.stdout:Section: kernel 2024-04-26T10:09:56.606 INFO:teuthology.orchestra.run.smithi052.stdout:Installed-Size: 20 2024-04-26T10:09:56.606 INFO:teuthology.orchestra.run.smithi052.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T10:09:56.606 INFO:teuthology.orchestra.run.smithi052.stdout:Architecture: amd64 2024-04-26T10:09:56.607 INFO:teuthology.orchestra.run.smithi052.stdout:Source: linux-meta 2024-04-26T10:09:56.607 INFO:teuthology.orchestra.run.smithi052.stdout:Version: 5.4.0.177.175 2024-04-26T10:09:56.607 INFO:teuthology.orchestra.run.smithi052.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-26T10:09:56.607 INFO:teuthology.orchestra.run.smithi052.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T10:09:56.607 INFO:teuthology.orchestra.run.smithi052.stdout:Recommends: thermald 2024-04-26T10:09:56.607 INFO:teuthology.orchestra.run.smithi052.stdout:Description: Generic Linux kernel image 2024-04-26T10:09:56.607 INFO:teuthology.orchestra.run.smithi052.stdout: This package will always depend on the latest generic kernel image 2024-04-26T10:09:56.607 INFO:teuthology.orchestra.run.smithi052.stdout: available. 2024-04-26T10:09:56.607 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-04-26T10:09:56.612 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.dg7ZdDUgcu 2024-04-26T10:09:56.612 DEBUG:teuthology.orchestra.run.smithi052:> sudo cp /boot/grub/grub.cfg /tmp/tmp.dg7ZdDUgcu 2024-04-26T10:09:56.626 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.dg7ZdDUgcu 2024-04-26T10:09:56.703 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.dg7ZdDUgcu is 9KB 2024-04-26T10:09:56.717 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.dg7ZdDUgcu 2024-04-26T10:09:56.721 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-04-26T10:09:56.723 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T10:09:56.748 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T10:09:56.777 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T10:09:56.777 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T10:09:56.777 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T10:09:56.802 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-177-generic 2024-04-26T10:09:56.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo update-grub 2024-04-26T10:09:56.818 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-04-26T10:09:57.005 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-04-26T10:09:57.006 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-04-26T10:09:57.089 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2024-04-26T10:09:57.115 DEBUG:teuthology.orchestra.run.smithi164:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-26T10:09:57.183 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2024-04-26T10:09:57.228 INFO:teuthology.orchestra.run.smithi154.stdout:linux-image-generic is already the newest version (5.4.0.177.175). 2024-04-26T10:09:57.228 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-04-26T10:09:57.230 DEBUG:teuthology.orchestra.run.smithi154:> dpkg -s linux-image-generic 2024-04-26T10:09:57.248 INFO:teuthology.orchestra.run.smithi154.stdout:Package: linux-image-generic 2024-04-26T10:09:57.248 INFO:teuthology.orchestra.run.smithi154.stdout:Status: install ok installed 2024-04-26T10:09:57.248 INFO:teuthology.orchestra.run.smithi154.stdout:Priority: optional 2024-04-26T10:09:57.248 INFO:teuthology.orchestra.run.smithi154.stdout:Section: kernel 2024-04-26T10:09:57.248 INFO:teuthology.orchestra.run.smithi154.stdout:Installed-Size: 20 2024-04-26T10:09:57.248 INFO:teuthology.orchestra.run.smithi154.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T10:09:57.248 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: amd64 2024-04-26T10:09:57.249 INFO:teuthology.orchestra.run.smithi154.stdout:Source: linux-meta 2024-04-26T10:09:57.249 INFO:teuthology.orchestra.run.smithi154.stdout:Version: 5.4.0.177.175 2024-04-26T10:09:57.249 INFO:teuthology.orchestra.run.smithi154.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-26T10:09:57.249 INFO:teuthology.orchestra.run.smithi154.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T10:09:57.249 INFO:teuthology.orchestra.run.smithi154.stdout:Recommends: thermald 2024-04-26T10:09:57.249 INFO:teuthology.orchestra.run.smithi154.stdout:Description: Generic Linux kernel image 2024-04-26T10:09:57.249 INFO:teuthology.orchestra.run.smithi154.stdout: This package will always depend on the latest generic kernel image 2024-04-26T10:09:57.249 INFO:teuthology.orchestra.run.smithi154.stdout: available. 2024-04-26T10:09:57.249 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-04-26T10:09:57.253 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.aYu4Q9dpWX 2024-04-26T10:09:57.253 DEBUG:teuthology.orchestra.run.smithi154:> sudo cp /boot/grub/grub.cfg /tmp/tmp.aYu4Q9dpWX 2024-04-26T10:09:57.266 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.aYu4Q9dpWX 2024-04-26T10:09:57.314 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.aYu4Q9dpWX is 9KB 2024-04-26T10:09:57.328 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.aYu4Q9dpWX 2024-04-26T10:09:57.334 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T10:09:57.371 INFO:teuthology.orchestra.run.smithi164.stdout:Building dependency tree... 2024-04-26T10:09:57.372 INFO:teuthology.orchestra.run.smithi164.stdout:Reading state information... 2024-04-26T10:09:57.391 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T10:09:57.391 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T10:09:57.391 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T10:09:57.422 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-177-generic 2024-04-26T10:09:57.423 DEBUG:teuthology.orchestra.run.smithi154:> sudo update-grub 2024-04-26T10:09:57.566 INFO:teuthology.orchestra.run.smithi120.stderr:Sourcing file `/etc/default/grub' 2024-04-26T10:09:57.577 INFO:teuthology.orchestra.run.smithi120.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T10:09:57.593 INFO:teuthology.orchestra.run.smithi120.stderr:Generating grub configuration file ... 2024-04-26T10:09:57.594 INFO:teuthology.orchestra.run.smithi164.stdout:linux-image-generic is already the newest version (5.4.0.177.175). 2024-04-26T10:09:57.594 INFO:teuthology.orchestra.run.smithi164.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-04-26T10:09:57.596 DEBUG:teuthology.orchestra.run.smithi164:> dpkg -s linux-image-generic 2024-04-26T10:09:57.617 INFO:teuthology.orchestra.run.smithi164.stdout:Package: linux-image-generic 2024-04-26T10:09:57.617 INFO:teuthology.orchestra.run.smithi164.stdout:Status: install ok installed 2024-04-26T10:09:57.617 INFO:teuthology.orchestra.run.smithi164.stdout:Priority: optional 2024-04-26T10:09:57.617 INFO:teuthology.orchestra.run.smithi164.stdout:Section: kernel 2024-04-26T10:09:57.617 INFO:teuthology.orchestra.run.smithi164.stdout:Installed-Size: 20 2024-04-26T10:09:57.617 INFO:teuthology.orchestra.run.smithi164.stdout:Maintainer: Ubuntu Kernel Team 2024-04-26T10:09:57.617 INFO:teuthology.orchestra.run.smithi164.stdout:Architecture: amd64 2024-04-26T10:09:57.617 INFO:teuthology.orchestra.run.smithi164.stdout:Source: linux-meta 2024-04-26T10:09:57.617 INFO:teuthology.orchestra.run.smithi164.stdout:Version: 5.4.0.177.175 2024-04-26T10:09:57.617 INFO:teuthology.orchestra.run.smithi164.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-26T10:09:57.617 INFO:teuthology.orchestra.run.smithi164.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-26T10:09:57.617 INFO:teuthology.orchestra.run.smithi164.stdout:Recommends: thermald 2024-04-26T10:09:57.618 INFO:teuthology.orchestra.run.smithi164.stdout:Description: Generic Linux kernel image 2024-04-26T10:09:57.618 INFO:teuthology.orchestra.run.smithi164.stdout: This package will always depend on the latest generic kernel image 2024-04-26T10:09:57.618 INFO:teuthology.orchestra.run.smithi164.stdout: available. 2024-04-26T10:09:57.618 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-04-26T10:09:57.665 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.qScERxR3OH 2024-04-26T10:09:57.665 DEBUG:teuthology.orchestra.run.smithi164:> sudo cp /boot/grub/grub.cfg /tmp/tmp.qScERxR3OH 2024-04-26T10:09:57.680 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.qScERxR3OH 2024-04-26T10:09:57.720 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.qScERxR3OH is 9KB 2024-04-26T10:09:57.734 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.qScERxR3OH 2024-04-26T10:09:57.740 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-26T10:09:57.798 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T10:09:57.798 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-26T10:09:57.798 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-26T10:09:57.820 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-26T10:09:57.829 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-177-generic 2024-04-26T10:09:57.829 DEBUG:teuthology.orchestra.run.smithi164:> sudo update-grub 2024-04-26T10:09:57.833 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-26T10:09:58.172 INFO:teuthology.orchestra.run.smithi052.stderr:Sourcing file `/etc/default/grub' 2024-04-26T10:09:58.172 INFO:teuthology.orchestra.run.smithi120.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-26T10:09:58.183 INFO:teuthology.orchestra.run.smithi052.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T10:09:58.184 INFO:teuthology.orchestra.run.smithi120.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-26T10:09:58.197 INFO:teuthology.orchestra.run.smithi052.stderr:Generating grub configuration file ... 2024-04-26T10:09:58.546 INFO:teuthology.orchestra.run.smithi052.stderr:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-26T10:09:58.558 INFO:teuthology.orchestra.run.smithi052.stderr:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-26T10:09:58.717 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub' 2024-04-26T10:09:58.726 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T10:09:58.739 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2024-04-26T10:09:58.920 INFO:teuthology.orchestra.run.smithi120.stderr:done 2024-04-26T10:09:58.922 DEBUG:teuthology.orchestra.run.smithi120:> sudo shutdown -r now 2024-04-26T10:09:58.993 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-26T10:09:59.005 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-26T10:09:59.010 INFO:teuthology.orchestra.run.smithi052.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-26T10:09:59.022 INFO:teuthology.orchestra.run.smithi052.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-26T10:09:59.145 INFO:teuthology.orchestra.run.smithi164.stderr:Sourcing file `/etc/default/grub' 2024-04-26T10:09:59.151 INFO:teuthology.orchestra.run.smithi164.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-26T10:09:59.162 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2024-04-26T10:09:59.360 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-26T10:09:59.372 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-26T10:09:59.469 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-26T10:09:59.481 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-26T10:09:59.912 INFO:teuthology.orchestra.run.smithi164.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-26T10:09:59.924 INFO:teuthology.orchestra.run.smithi164.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-26T10:10:00.151 INFO:teuthology.orchestra.run.smithi154.stderr:done 2024-04-26T10:10:00.153 DEBUG:teuthology.orchestra.run.smithi154:> sudo shutdown -r now 2024-04-26T10:10:00.691 INFO:teuthology.orchestra.run.smithi164.stderr:done 2024-04-26T10:10:00.693 DEBUG:teuthology.orchestra.run.smithi164:> sudo shutdown -r now 2024-04-26T10:10:00.729 INFO:teuthology.orchestra.run.smithi052.stderr:done 2024-04-26T10:10:00.731 DEBUG:teuthology.orchestra.run.smithi052:> sudo shutdown -r now 2024-04-26T10:10:28.953 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-04-26T10:10:28.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-26T10:10:28.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:10:30.157 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-04-26T10:10:30.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-26T10:10:30.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:10:30.734 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-26T10:10:30.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-04-26T10:10:30.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:10:30.738 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-04-26T10:10:30.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-26T10:10:30.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:11:03.583 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-26T10:11:04.606 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-04-26T10:11:05.374 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-26T10:11:12.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-26T10:11:12.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:11:13.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-26T10:11:13.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:11:14.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-26T10:11:14.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:11:15.650 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-26T10:11:27.663 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-26T10:11:27.664 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:11:30.718 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.120 2024-04-26T10:11:30.737 DEBUG:teuthology.orchestra.remote:timed out 2024-04-26T10:11:32.002 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-04-26T10:11:32.770 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-04-26T10:11:39.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-04-26T10:11:39.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:11:39.744 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.52 2024-04-26T10:11:44.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-26T10:11:44.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:11:44.505 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-04-26T10:11:44.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-26T10:11:44.772 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:11:45.420 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-26T10:11:45.420 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.4.0-177-generic"... 2024-04-26T10:11:45.420 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-04-26T10:11:45.427 INFO:teuthology.orchestra.run.smithi154.stdout:5.4.0-177-generic 2024-04-26T10:11:45.427 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-177-generic vs 5.4.0-177-generic 2024-04-26T10:11:45.427 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T10:11:45.427 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T10:11:45.483 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-04-26T10:11:45.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-26T10:11:45.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:11:45.968 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-04-26T10:11:46.313 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-26T10:11:46.313 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.4.0-177-generic"... 2024-04-26T10:11:46.313 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-04-26T10:11:46.320 INFO:teuthology.orchestra.run.smithi164.stdout:5.4.0-177-generic 2024-04-26T10:11:46.320 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-177-generic vs 5.4.0-177-generic 2024-04-26T10:11:46.321 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T10:11:46.321 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T10:11:46.428 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-26T10:11:46.429 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T10:11:46.552 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-26T10:11:46.553 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.4.0-177-generic"... 2024-04-26T10:11:46.553 DEBUG:teuthology.orchestra.run.smithi120:> uname -r 2024-04-26T10:11:46.559 INFO:teuthology.orchestra.run.smithi120.stdout:5.4.0-177-generic 2024-04-26T10:11:46.559 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-177-generic vs 5.4.0-177-generic 2024-04-26T10:11:46.559 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T10:11:46.559 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T10:11:46.572 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2024-04-26T10:11:46.608 DEBUG:teuthology.parallel:result is None 2024-04-26T10:11:47.321 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-26T10:11:47.321 DEBUG:teuthology.orchestra.run.smithi164:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T10:11:47.490 INFO:teuthology.orchestra.run.smithi164.stdout:ttyS1 2024-04-26T10:11:47.516 DEBUG:teuthology.parallel:result is None 2024-04-26T10:11:47.560 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-26T10:11:47.560 DEBUG:teuthology.orchestra.run.smithi120:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T10:11:47.628 INFO:teuthology.orchestra.run.smithi120.stdout:ttyS1 2024-04-26T10:11:47.648 DEBUG:teuthology.parallel:result is None 2024-04-26T10:11:51.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-04-26T10:11:51.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:11:51.999 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-04-26T10:11:52.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-04-26T10:11:52.569 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-177-generic"... 2024-04-26T10:11:52.569 DEBUG:teuthology.orchestra.run.smithi052:> uname -r 2024-04-26T10:11:52.576 INFO:teuthology.orchestra.run.smithi052.stdout:5.4.0-177-generic 2024-04-26T10:11:52.576 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-177-generic vs 5.4.0-177-generic 2024-04-26T10:11:52.576 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-26T10:11:52.576 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-26T10:11:53.577 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-26T10:11:53.577 DEBUG:teuthology.orchestra.run.smithi052:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-26T10:11:53.641 INFO:teuthology.orchestra.run.smithi052.stdout:ttyS1 2024-04-26T10:11:53.658 DEBUG:teuthology.parallel:result is None 2024-04-26T10:11:53.658 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-26T10:11:53.664 INFO:teuthology.task.internal:Creating test directory... 2024-04-26T10:11:53.665 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T10:11:53.667 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T10:11:53.669 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T10:11:53.672 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-26T10:11:53.679 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-26T10:11:53.721 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-26T10:11:53.768 INFO:teuthology.task.internal:Creating archive directory... 2024-04-26T10:11:53.768 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T10:11:53.770 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T10:11:53.772 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T10:11:53.775 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-26T10:11:53.815 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-26T10:11:53.821 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-26T10:11:53.822 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T10:11:53.824 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T10:11:53.840 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T10:11:53.849 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T10:11:53.856 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T10:11:53.858 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-26T10:11:53.880 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T10:11:53.880 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T10:11:53.890 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T10:11:53.891 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T10:11:53.893 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T10:11:53.903 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-26T10:11:53.905 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-26T10:11:53.912 INFO:teuthology.task.internal:Configuring sudo... 2024-04-26T10:11:53.912 DEBUG:teuthology.orchestra.run.smithi052:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T10:11:53.914 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T10:11:53.917 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T10:11:53.919 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-26T10:11:53.933 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-26T10:11:53.945 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-26T10:11:53.945 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T10:11:53.948 DEBUG:teuthology.orchestra.run.smithi120:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T10:11:53.950 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T10:11:53.975 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-26T10:11:53.982 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T10:11:54.002 DEBUG:teuthology.orchestra.run.smithi052:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T10:11:54.009 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T10:11:54.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T10:11:54.031 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T10:11:54.038 DEBUG:teuthology.orchestra.run.smithi120:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T10:11:54.046 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T10:11:54.046 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T10:11:54.068 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T10:11:54.076 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T10:11:54.124 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T10:11:54.124 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T10:11:54.143 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-26T10:11:54.150 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-26T10:11:54.157 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T10:11:54.157 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-26T10:11:54.176 DEBUG:teuthology.orchestra.run.smithi052:> sudo service rsyslog restart 2024-04-26T10:11:54.179 DEBUG:teuthology.orchestra.run.smithi120:> sudo service rsyslog restart 2024-04-26T10:11:54.181 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-04-26T10:11:54.183 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2024-04-26T10:11:54.262 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-26T10:11:54.269 INFO:teuthology.task.internal:Starting timer... 2024-04-26T10:11:54.269 INFO:teuthology.run_tasks:Running task pcp... 2024-04-26T10:11:54.313 INFO:teuthology.run_tasks:Running task selinux... 2024-04-26T10:11:54.362 DEBUG:teuthology.task.selinux:Excluding smithi052: OS 'ubuntu' does not support SELinux 2024-04-26T10:11:54.363 DEBUG:teuthology.task.selinux:Excluding smithi120: OS 'ubuntu' does not support SELinux 2024-04-26T10:11:54.363 DEBUG:teuthology.task.selinux:Excluding smithi154: OS 'ubuntu' does not support SELinux 2024-04-26T10:11:54.363 DEBUG:teuthology.task.selinux:Excluding smithi164: OS 'ubuntu' does not support SELinux 2024-04-26T10:11:54.363 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-26T10:11:54.363 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-26T10:11:54.363 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-26T10:11:54.364 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-26T10:11:54.412 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-26T10:11:54.431 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-26T10:11:54.432 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi052.front.sepia.ceph.com,smithi120.front.sepia.ceph.com,smithi154.front.sepia.ceph.com,smithi164.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-26T10:17:38.536 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi052.front.sepia.ceph.com'), Remote(name='ubuntu@smithi120.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com')] 2024-04-26T10:17:38.538 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-04-26T10:17:38.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi052.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:17:38.636 DEBUG:teuthology.orchestra.run.smithi052:> true 2024-04-26T10:17:38.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi052.front.sepia.ceph.com' 2024-04-26T10:17:38.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-26T10:17:38.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:17:38.864 DEBUG:teuthology.orchestra.run.smithi120:> true 2024-04-26T10:17:38.983 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com' 2024-04-26T10:17:38.984 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-26T10:17:38.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:17:39.085 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-04-26T10:17:39.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-04-26T10:17:39.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-26T10:17:39.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:17:39.303 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-04-26T10:17:39.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-26T10:17:39.429 INFO:teuthology.run_tasks:Running task clock... 2024-04-26T10:17:39.440 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-26T10:17:39.440 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T10:17:39.441 DEBUG:teuthology.orchestra.run.smithi052:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:17:39.443 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T10:17:39.443 DEBUG:teuthology.orchestra.run.smithi120:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:17:39.445 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T10:17:39.446 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:17:39.448 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-26T10:17:39.448 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:17:39.476 INFO:teuthology.orchestra.run.smithi120.stdout:26 Apr 10:17:39 ntpd[13020]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-04-26T10:17:39.476 INFO:teuthology.orchestra.run.smithi120.stdout:26 Apr 10:17:39 ntpd[13020]: Command line: ntpd -gq 2024-04-26T10:17:39.477 INFO:teuthology.orchestra.run.smithi120.stdout:26 Apr 10:17:39 ntpd[13020]: proto: precision = 0.092 usec (-23) 2024-04-26T10:17:39.478 INFO:teuthology.orchestra.run.smithi120.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T10:17:39.478 INFO:teuthology.orchestra.run.smithi120.stdout:26 Apr 10:17:39 ntpd[13020]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T10:17:39.479 INFO:teuthology.orchestra.run.smithi120.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T10:17:39.479 INFO:teuthology.orchestra.run.smithi120.stdout:26 Apr 10:17:39 ntpd[13020]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T10:17:39.479 INFO:teuthology.orchestra.run.smithi120.stdout:26 Apr 10:17:39 ntpd[13020]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T10:17:39.480 INFO:teuthology.orchestra.run.smithi120.stdout:26 Apr 10:17:39 ntpd[13020]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T10:17:39.480 INFO:teuthology.orchestra.run.smithi120.stdout:26 Apr 10:17:39 ntpd[13020]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T10:17:39.480 INFO:teuthology.orchestra.run.smithi120.stdout:26 Apr 10:17:39 ntpd[13020]: Listen normally on 3 enp3s0f1 172.21.15.120:123 2024-04-26T10:17:39.480 INFO:teuthology.orchestra.run.smithi120.stdout:26 Apr 10:17:39 ntpd[13020]: Listen normally on 4 lo [::1]:123 2024-04-26T10:17:39.480 INFO:teuthology.orchestra.run.smithi120.stdout:26 Apr 10:17:39 ntpd[13020]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:478f%5]:123 2024-04-26T10:17:39.480 INFO:teuthology.orchestra.run.smithi120.stdout:26 Apr 10:17:39 ntpd[13020]: Listening on routing socket on fd #22 for interface updates 2024-04-26T10:17:39.481 INFO:teuthology.orchestra.run.smithi052.stdout:26 Apr 10:17:39 ntpd[12872]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-04-26T10:17:39.481 INFO:teuthology.orchestra.run.smithi052.stdout:26 Apr 10:17:39 ntpd[12872]: Command line: ntpd -gq 2024-04-26T10:17:39.481 INFO:teuthology.orchestra.run.smithi052.stdout:26 Apr 10:17:39 ntpd[12872]: proto: precision = 0.123 usec (-23) 2024-04-26T10:17:39.481 INFO:teuthology.orchestra.run.smithi154.stdout:26 Apr 10:17:39 ntpd[13049]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-04-26T10:17:39.482 INFO:teuthology.orchestra.run.smithi154.stdout:26 Apr 10:17:39 ntpd[13049]: Command line: ntpd -gq 2024-04-26T10:17:39.482 INFO:teuthology.orchestra.run.smithi154.stdout:26 Apr 10:17:39 ntpd[13049]: proto: precision = 0.224 usec (-22) 2024-04-26T10:17:39.482 INFO:teuthology.orchestra.run.smithi052.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T10:17:39.482 INFO:teuthology.orchestra.run.smithi154.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T10:17:39.483 INFO:teuthology.orchestra.run.smithi052.stdout:26 Apr 10:17:39 ntpd[12872]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T10:17:39.483 INFO:teuthology.orchestra.run.smithi154.stdout:26 Apr 10:17:39 ntpd[13049]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T10:17:39.483 INFO:teuthology.orchestra.run.smithi052.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T10:17:39.483 INFO:teuthology.orchestra.run.smithi154.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T10:17:39.485 INFO:teuthology.orchestra.run.smithi052.stdout:26 Apr 10:17:39 ntpd[12872]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T10:17:39.485 INFO:teuthology.orchestra.run.smithi052.stdout:26 Apr 10:17:39 ntpd[12872]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T10:17:39.485 INFO:teuthology.orchestra.run.smithi052.stdout:26 Apr 10:17:39 ntpd[12872]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T10:17:39.485 INFO:teuthology.orchestra.run.smithi052.stdout:26 Apr 10:17:39 ntpd[12872]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T10:17:39.485 INFO:teuthology.orchestra.run.smithi052.stdout:26 Apr 10:17:39 ntpd[12872]: Listen normally on 3 ens1f0 172.21.15.52:123 2024-04-26T10:17:39.486 INFO:teuthology.orchestra.run.smithi052.stdout:26 Apr 10:17:39 ntpd[12872]: Listen normally on 4 lo [::1]:123 2024-04-26T10:17:39.486 INFO:teuthology.orchestra.run.smithi052.stdout:26 Apr 10:17:39 ntpd[12872]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15de%4]:123 2024-04-26T10:17:39.486 INFO:teuthology.orchestra.run.smithi052.stdout:26 Apr 10:17:39 ntpd[12872]: Listening on routing socket on fd #22 for interface updates 2024-04-26T10:17:39.486 INFO:teuthology.orchestra.run.smithi154.stdout:26 Apr 10:17:39 ntpd[13049]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T10:17:39.486 INFO:teuthology.orchestra.run.smithi154.stdout:26 Apr 10:17:39 ntpd[13049]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T10:17:39.486 INFO:teuthology.orchestra.run.smithi154.stdout:26 Apr 10:17:39 ntpd[13049]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T10:17:39.486 INFO:teuthology.orchestra.run.smithi154.stdout:26 Apr 10:17:39 ntpd[13049]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T10:17:39.486 INFO:teuthology.orchestra.run.smithi154.stdout:26 Apr 10:17:39 ntpd[13049]: Listen normally on 3 enp3s0f1 172.21.15.154:123 2024-04-26T10:17:39.486 INFO:teuthology.orchestra.run.smithi154.stdout:26 Apr 10:17:39 ntpd[13049]: Listen normally on 4 lo [::1]:123 2024-04-26T10:17:39.486 INFO:teuthology.orchestra.run.smithi154.stdout:26 Apr 10:17:39 ntpd[13049]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7761%5]:123 2024-04-26T10:17:39.486 INFO:teuthology.orchestra.run.smithi154.stdout:26 Apr 10:17:39 ntpd[13049]: Listening on routing socket on fd #22 for interface updates 2024-04-26T10:17:39.487 INFO:teuthology.orchestra.run.smithi164.stdout:26 Apr 10:17:39 ntpd[12958]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-04-26T10:17:39.487 INFO:teuthology.orchestra.run.smithi164.stdout:26 Apr 10:17:39 ntpd[12958]: Command line: ntpd -gq 2024-04-26T10:17:39.487 INFO:teuthology.orchestra.run.smithi164.stdout:26 Apr 10:17:39 ntpd[12958]: proto: precision = 0.117 usec (-23) 2024-04-26T10:17:39.487 INFO:teuthology.orchestra.run.smithi164.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T10:17:39.488 INFO:teuthology.orchestra.run.smithi164.stdout:26 Apr 10:17:39 ntpd[12958]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-26T10:17:39.488 INFO:teuthology.orchestra.run.smithi164.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-26T10:17:39.489 INFO:teuthology.orchestra.run.smithi164.stdout:26 Apr 10:17:39 ntpd[12958]: restrict ::: KOD does nothing without LIMITED. 2024-04-26T10:17:39.489 INFO:teuthology.orchestra.run.smithi164.stdout:26 Apr 10:17:39 ntpd[12958]: Listen and drop on 0 v6wildcard [::]:123 2024-04-26T10:17:39.489 INFO:teuthology.orchestra.run.smithi164.stdout:26 Apr 10:17:39 ntpd[12958]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-26T10:17:39.489 INFO:teuthology.orchestra.run.smithi164.stdout:26 Apr 10:17:39 ntpd[12958]: Listen normally on 2 lo 127.0.0.1:123 2024-04-26T10:17:39.489 INFO:teuthology.orchestra.run.smithi164.stdout:26 Apr 10:17:39 ntpd[12958]: Listen normally on 3 enp3s0f1 172.21.15.164:123 2024-04-26T10:17:39.489 INFO:teuthology.orchestra.run.smithi164.stdout:26 Apr 10:17:39 ntpd[12958]: Listen normally on 4 lo [::1]:123 2024-04-26T10:17:39.490 INFO:teuthology.orchestra.run.smithi164.stdout:26 Apr 10:17:39 ntpd[12958]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:73f3%5]:123 2024-04-26T10:17:39.490 INFO:teuthology.orchestra.run.smithi164.stdout:26 Apr 10:17:39 ntpd[12958]: Listening on routing socket on fd #22 for interface updates 2024-04-26T10:17:40.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:40 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:40.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:40 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:40.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:40 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:40.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:40 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:40.481 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:40 ntpd[12872]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:40.481 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:40 ntpd[12872]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:40.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:40 ntpd[12958]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:40.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:40 ntpd[12958]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:40.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:40 ntpd[12958]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:40.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:40 ntpd[12958]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:40.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:40 ntpd[12958]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:40.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:40 ntpd[12958]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:40.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:40 ntpd[12958]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:40.485 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:40 ntpd[12958]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:41.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:41 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:41.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:41 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:41.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:41 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:41.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:41 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:41.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:41 ntpd[13020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:41.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:41 ntpd[13020]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:41.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:41 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:41.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:41 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:41.481 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:41 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:41.481 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:41 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:41.481 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:41 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:41.481 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:41 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:41.481 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:41 ntpd[12872]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:41.481 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:41 ntpd[12872]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:41.481 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:41 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:41.481 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:41 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:41.481 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:41 ntpd[12872]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:41.481 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:41 ntpd[12872]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:42.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:42 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:42.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:42 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:42.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:42 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:42.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:42 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:42.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:42 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:42.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:42 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:42.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:42 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:42.479 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:42 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:42.479 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:42 ntpd[13020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:42.479 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:42 ntpd[13020]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:42.479 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:42 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:42.479 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:42 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:42.479 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:42 ntpd[13020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:42.479 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:42 ntpd[13020]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:42.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:42 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:42.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:42 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:42.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:42 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:42.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:42 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:42.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:42 ntpd[12872]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:42.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:42 ntpd[12872]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:42.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:42 ntpd[12958]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:42.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:42 ntpd[12958]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:42.485 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:42 ntpd[12958]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:42.485 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:42 ntpd[12958]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:42.485 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:42 ntpd[12958]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:42.485 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:42 ntpd[12958]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:43.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:43 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:43.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:43 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:43.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:43 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:43.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:43 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:43.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:43 ntpd[13020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:43.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:43 ntpd[13020]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:43.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:43.482 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:43.483 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:43.483 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:43 ntpd[13049]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:43.484 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:43 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:43.484 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:43 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:43.484 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:43 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:43.484 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:43 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:43.484 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:43 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:43.485 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:43 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:43.485 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:43 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:43.485 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:43 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:43.485 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:43 ntpd[12872]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:43.485 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:43 ntpd[12872]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:43.485 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:43 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:43.485 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:43 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:43.485 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:43 ntpd[12872]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:43.485 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:43 ntpd[12872]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:43.486 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:43 ntpd[12958]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:43.486 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:43 ntpd[12958]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:43.486 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:43 ntpd[12958]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:43.486 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:43 ntpd[12958]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:43.487 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:43 ntpd[12958]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:43.487 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:43 ntpd[12958]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:43.487 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:43 ntpd[12958]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:43.487 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:43 ntpd[12958]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:43.487 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:43 ntpd[12958]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:43.487 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:43 ntpd[12958]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:43.487 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:43 ntpd[12958]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:43.487 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:43 ntpd[12958]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:44.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:44 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:44.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:44 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:44.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:44 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:44.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:44 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:44.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:44 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:44.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:44 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:44.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:44 ntpd[13020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:44.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:44 ntpd[13020]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:44.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:44 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:44.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:44 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:44.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:44 ntpd[13020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:44.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:44 ntpd[13020]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:44.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:44 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:44.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:44 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:44.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:44 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:44.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:44 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:44.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:44 ntpd[12872]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:44.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:44 ntpd[12872]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:44.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:44 ntpd[12958]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:44.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:44 ntpd[12958]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:44.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:44 ntpd[12958]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:44.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:44 ntpd[12958]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:44.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:44 ntpd[12958]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:44.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:44 ntpd[12958]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:45.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:45 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:45.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:45 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:45.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:45 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:45.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:45 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:45.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:45 ntpd[13020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:45.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:45 ntpd[13020]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:45.480 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:45 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:45.480 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:45 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:45.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:45 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:45.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:45 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:45.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:45 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:45.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:45 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:45.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:45 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:45.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:45 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:45.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:45 ntpd[13049]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:45.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:45 ntpd[13049]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:45.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:45 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:45.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:45 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:45.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:45 ntpd[13049]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:45.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:45 ntpd[13049]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:45.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:45 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:45.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:45 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:45.482 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:45 ntpd[13049]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:45.482 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:45 ntpd[13049]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:45 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:45 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:45 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:45 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:45.483 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:45 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:45 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:45 ntpd[12872]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:45 ntpd[12872]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:45 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:45 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:45 ntpd[12872]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:45.484 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:45 ntpd[12872]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:45.485 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:45 ntpd[12958]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:45.485 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:45 ntpd[12958]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:45.485 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:45 ntpd[12958]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:45.485 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:45 ntpd[12958]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:45.485 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:45 ntpd[12958]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:45.485 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:45 ntpd[12958]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:45.485 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:45 ntpd[12958]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:45.486 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:45 ntpd[12958]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:45.486 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:45 ntpd[12958]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:45.486 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:45 ntpd[12958]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:45.486 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:45 ntpd[12958]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:45.486 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:45 ntpd[12958]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:46.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:46 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:46.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:46 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:46.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:46 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:46.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:46 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:46.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:46 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:46.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:46 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:46.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:46 ntpd[13020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:46.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:46 ntpd[13020]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:46.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:46 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:46.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:46 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:46.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:46 ntpd[13020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:46.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:46 ntpd[13020]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:46.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:46 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:46.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:46 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:46.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:46 ntpd[12872]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:46.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:46 ntpd[12872]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:46.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:46 ntpd[12872]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:46.480 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:46 ntpd[12872]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:46.481 INFO:teuthology.orchestra.run.smithi052.stdout:26 Apr 10:17:46 ntpd[12872]: ntpd: time slew +0.002827 s 2024-04-26T10:17:46.481 INFO:teuthology.orchestra.run.smithi052.stdout:ntpd: time slew +0.002827s 2024-04-26T10:17:46.481 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:46 ntpd[12872]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T10:17:46.481 INFO:teuthology.orchestra.run.smithi052.stderr:26 Apr 10:17:46 ntpd[12872]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T10:17:46.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:46 ntpd[12958]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:46.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:46 ntpd[12958]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:46.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:46 ntpd[12958]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:46.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:46 ntpd[12958]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:46.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:46 ntpd[12958]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:46.484 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:46 ntpd[12958]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:46.485 INFO:teuthology.orchestra.run.smithi164.stdout:26 Apr 10:17:46 ntpd[12958]: ntpd: time slew +0.004160 s 2024-04-26T10:17:46.485 INFO:teuthology.orchestra.run.smithi164.stdout:ntpd: time slew +0.004160s 2024-04-26T10:17:46.485 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:46 ntpd[12958]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T10:17:46.486 INFO:teuthology.orchestra.run.smithi164.stderr:26 Apr 10:17:46 ntpd[12958]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T10:17:46.539 INFO:teuthology.orchestra.run.smithi052.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T10:17:46.539 INFO:teuthology.orchestra.run.smithi052.stdout:============================================================================== 2024-04-26T10:17:46.539 INFO:teuthology.orchestra.run.smithi052.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T10:17:46.539 INFO:teuthology.orchestra.run.smithi052.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T10:17:46.539 INFO:teuthology.orchestra.run.smithi052.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T10:17:46.539 INFO:teuthology.orchestra.run.smithi052.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T10:17:46.550 INFO:teuthology.orchestra.run.smithi164.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T10:17:46.550 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================== 2024-04-26T10:17:46.550 INFO:teuthology.orchestra.run.smithi164.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T10:17:46.550 INFO:teuthology.orchestra.run.smithi164.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T10:17:46.550 INFO:teuthology.orchestra.run.smithi164.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T10:17:46.550 INFO:teuthology.orchestra.run.smithi164.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T10:17:47.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:47 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:47.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:47 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:47.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:47 ntpd[13020]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:47.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:47 ntpd[13020]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:47.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:47 ntpd[13020]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:47.477 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:47 ntpd[13020]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:47.478 INFO:teuthology.orchestra.run.smithi120.stdout:26 Apr 10:17:47 ntpd[13020]: ntpd: time slew -0.000001 s 2024-04-26T10:17:47.478 INFO:teuthology.orchestra.run.smithi120.stdout:ntpd: time slew -0.000001s 2024-04-26T10:17:47.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:47 ntpd[13020]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T10:17:47.478 INFO:teuthology.orchestra.run.smithi120.stderr:26 Apr 10:17:47 ntpd[13020]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T10:17:47.480 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:47 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:47.480 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:47 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:47 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:47 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:47 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:47 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:47 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:47 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:47 ntpd[13049]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:47 ntpd[13049]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:47 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:47 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:47 ntpd[13049]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:47 ntpd[13049]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:47 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:47 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:47.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:47 ntpd[13049]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:47.482 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:47 ntpd[13049]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:47.539 INFO:teuthology.orchestra.run.smithi120.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T10:17:47.539 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================== 2024-04-26T10:17:47.539 INFO:teuthology.orchestra.run.smithi120.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T10:17:47.539 INFO:teuthology.orchestra.run.smithi120.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T10:17:47.539 INFO:teuthology.orchestra.run.smithi120.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T10:17:47.539 INFO:teuthology.orchestra.run.smithi120.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T10:17:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:49 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:49 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:49 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:49 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:49 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:49 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:49.480 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:49 ntpd[13049]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-26T10:17:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:49 ntpd[13049]: can't open /var/log/ntpstats/rawstats.20240426: Permission denied 2024-04-26T10:17:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:49 ntpd[13049]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-26T10:17:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:49 ntpd[13049]: can't open /var/log/ntpstats/peerstats.20240426: Permission denied 2024-04-26T10:17:49.481 INFO:teuthology.orchestra.run.smithi154.stdout:26 Apr 10:17:49 ntpd[13049]: ntpd: time slew +0.000323 s 2024-04-26T10:17:49.481 INFO:teuthology.orchestra.run.smithi154.stdout:ntpd: time slew +0.000323s 2024-04-26T10:17:49.481 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:49 ntpd[13049]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-26T10:17:49.482 INFO:teuthology.orchestra.run.smithi154.stderr:26 Apr 10:17:49 ntpd[13049]: can't open /var/log/ntpstats/loopstats.20240426: Permission denied 2024-04-26T10:17:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T10:17:49.548 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2024-04-26T10:17:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T10:17:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T10:17:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T10:17:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T10:17:49.549 INFO:teuthology.run_tasks:Running task install... 2024-04-26T10:17:49.558 DEBUG:teuthology.task.install:project ceph 2024-04-26T10:17:49.558 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}} 2024-04-26T10:17:49.558 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'} 2024-04-26T10:17:49.559 INFO:teuthology.task.install:Using flavor: default 2024-04-26T10:17:49.565 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-26T10:17:49.565 INFO:teuthology.task.install:extra packages: [] 2024-04-26T10:17:49.565 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-key list | grep Ceph 2024-04-26T10:17:49.566 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-key list | grep Ceph 2024-04-26T10:17:49.566 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-key list | grep Ceph 2024-04-26T10:17:49.566 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-key list | grep Ceph 2024-04-26T10:17:49.670 INFO:teuthology.orchestra.run.smithi120.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-04-26T10:17:49.671 INFO:teuthology.orchestra.run.smithi164.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-04-26T10:17:49.677 INFO:teuthology.orchestra.run.smithi052.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-04-26T10:17:49.696 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-04-26T10:17:49.731 INFO:teuthology.orchestra.run.smithi120.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T10:17:49.732 INFO:teuthology.orchestra.run.smithi120.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T10:17:49.733 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T10:17:49.733 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-26T10:17:49.733 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:17:49.738 INFO:teuthology.orchestra.run.smithi164.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T10:17:49.738 INFO:teuthology.orchestra.run.smithi164.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T10:17:49.739 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T10:17:49.739 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-26T10:17:49.739 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:17:49.742 INFO:teuthology.orchestra.run.smithi052.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T10:17:49.743 INFO:teuthology.orchestra.run.smithi052.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T10:17:49.743 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T10:17:49.743 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-26T10:17:49.743 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:17:49.757 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-26T10:17:49.757 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph.com (release key) 2024-04-26T10:17:49.758 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-26T10:17:49.758 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-26T10:17:49.758 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:17:49.887 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default/ 2024-04-26T10:17:49.888 INFO:teuthology.task.install.deb:Package version is 18.2.2-1256-gdc093b5e-1focal 2024-04-26T10:17:49.891 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default/ 2024-04-26T10:17:49.891 INFO:teuthology.task.install.deb:Package version is 18.2.2-1256-gdc093b5e-1focal 2024-04-26T10:17:49.951 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default/ 2024-04-26T10:17:49.951 INFO:teuthology.task.install.deb:Package version is 18.2.2-1256-gdc093b5e-1focal 2024-04-26T10:17:49.973 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default/ 2024-04-26T10:17:49.973 INFO:teuthology.task.install.deb:Package version is 18.2.2-1256-gdc093b5e-1focal 2024-04-26T10:17:50.008 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T10:17:50.008 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T10:17:50.025 DEBUG:teuthology.orchestra.run.smithi120:> sudo apt-get update 2024-04-26T10:17:50.070 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T10:17:50.070 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T10:17:50.076 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T10:17:50.076 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T10:17:50.082 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T10:17:50.082 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-26T10:17:50.087 DEBUG:teuthology.orchestra.run.smithi164:> sudo apt-get update 2024-04-26T10:17:50.092 DEBUG:teuthology.orchestra.run.smithi052:> sudo apt-get update 2024-04-26T10:17:50.098 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-04-26T10:17:50.218 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-26T10:17:50.235 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T10:17:50.242 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-26T10:17:50.245 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-26T10:17:50.263 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-26T10:17:50.278 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T10:17:50.284 INFO:teuthology.orchestra.run.smithi052.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal InRelease 2024-04-26T10:17:50.287 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-26T10:17:50.305 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-04-26T10:17:50.308 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-26T10:17:50.325 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T10:17:50.325 INFO:teuthology.orchestra.run.smithi120.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal InRelease 2024-04-26T10:17:50.328 INFO:teuthology.orchestra.run.smithi052.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal Release.gpg 2024-04-26T10:17:50.350 INFO:teuthology.orchestra.run.smithi052.stdout:Hit:7 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-26T10:17:50.350 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-04-26T10:17:50.353 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal InRelease 2024-04-26T10:17:50.356 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-26T10:17:50.362 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-04-26T10:17:50.383 INFO:teuthology.orchestra.run.smithi052.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main i386 Packages [3,424 B] 2024-04-26T10:17:50.386 INFO:teuthology.orchestra.run.smithi164.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal InRelease 2024-04-26T10:17:50.389 INFO:teuthology.orchestra.run.smithi164.stdout:Hit:5 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-26T10:17:50.390 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-04-26T10:17:50.401 INFO:teuthology.orchestra.run.smithi120.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal Release.gpg 2024-04-26T10:17:50.409 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-26T10:17:50.431 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal Release.gpg 2024-04-26T10:17:50.432 INFO:teuthology.orchestra.run.smithi164.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-04-26T10:17:50.437 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main i386 Packages [3,424 B] 2024-04-26T10:17:50.438 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-26T10:17:50.467 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main i386 Packages [3,424 B] 2024-04-26T10:17:50.469 INFO:teuthology.orchestra.run.smithi164.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal Release.gpg 2024-04-26T10:17:50.497 INFO:teuthology.orchestra.run.smithi120.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-26T10:17:50.498 INFO:teuthology.orchestra.run.smithi120.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-04-26T10:17:50.506 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main i386 Packages [3,424 B] 2024-04-26T10:17:50.514 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-04-26T10:17:50.525 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-26T10:17:50.552 INFO:teuthology.orchestra.run.smithi164.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-04-26T10:17:50.863 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 28.7 kB in 1s (45.9 kB/s) 2024-04-26T10:17:50.884 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 28.7 kB in 1s (45.9 kB/s) 2024-04-26T10:17:50.911 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 28.7 kB in 1s (43.8 kB/s) 2024-04-26T10:17:50.949 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 28.7 kB in 1s (43.6 kB/s) 2024-04-26T10:17:51.967 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-04-26T10:17:51.986 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-04-26T10:17:51.992 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1256-gdc093b5e-1focal cephadm=18.2.2-1256-gdc093b5e-1focal ceph-mds=18.2.2-1256-gdc093b5e-1focal ceph-mgr=18.2.2-1256-gdc093b5e-1focal ceph-common=18.2.2-1256-gdc093b5e-1focal ceph-fuse=18.2.2-1256-gdc093b5e-1focal ceph-test=18.2.2-1256-gdc093b5e-1focal ceph-volume=18.2.2-1256-gdc093b5e-1focal radosgw=18.2.2-1256-gdc093b5e-1focal python3-rados=18.2.2-1256-gdc093b5e-1focal python3-rgw=18.2.2-1256-gdc093b5e-1focal python3-cephfs=18.2.2-1256-gdc093b5e-1focal python3-rbd=18.2.2-1256-gdc093b5e-1focal libcephfs2=18.2.2-1256-gdc093b5e-1focal libcephfs-dev=18.2.2-1256-gdc093b5e-1focal librados2=18.2.2-1256-gdc093b5e-1focal librbd1=18.2.2-1256-gdc093b5e-1focal rbd-fuse=18.2.2-1256-gdc093b5e-1focal 2024-04-26T10:17:52.010 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1256-gdc093b5e-1focal cephadm=18.2.2-1256-gdc093b5e-1focal ceph-mds=18.2.2-1256-gdc093b5e-1focal ceph-mgr=18.2.2-1256-gdc093b5e-1focal ceph-common=18.2.2-1256-gdc093b5e-1focal ceph-fuse=18.2.2-1256-gdc093b5e-1focal ceph-test=18.2.2-1256-gdc093b5e-1focal ceph-volume=18.2.2-1256-gdc093b5e-1focal radosgw=18.2.2-1256-gdc093b5e-1focal python3-rados=18.2.2-1256-gdc093b5e-1focal python3-rgw=18.2.2-1256-gdc093b5e-1focal python3-cephfs=18.2.2-1256-gdc093b5e-1focal python3-rbd=18.2.2-1256-gdc093b5e-1focal libcephfs2=18.2.2-1256-gdc093b5e-1focal libcephfs-dev=18.2.2-1256-gdc093b5e-1focal librados2=18.2.2-1256-gdc093b5e-1focal librbd1=18.2.2-1256-gdc093b5e-1focal rbd-fuse=18.2.2-1256-gdc093b5e-1focal 2024-04-26T10:17:52.053 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2024-04-26T10:17:52.060 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-04-26T10:17:52.062 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-04-26T10:17:52.077 DEBUG:teuthology.orchestra.run.smithi164:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1256-gdc093b5e-1focal cephadm=18.2.2-1256-gdc093b5e-1focal ceph-mds=18.2.2-1256-gdc093b5e-1focal ceph-mgr=18.2.2-1256-gdc093b5e-1focal ceph-common=18.2.2-1256-gdc093b5e-1focal ceph-fuse=18.2.2-1256-gdc093b5e-1focal ceph-test=18.2.2-1256-gdc093b5e-1focal ceph-volume=18.2.2-1256-gdc093b5e-1focal radosgw=18.2.2-1256-gdc093b5e-1focal python3-rados=18.2.2-1256-gdc093b5e-1focal python3-rgw=18.2.2-1256-gdc093b5e-1focal python3-cephfs=18.2.2-1256-gdc093b5e-1focal python3-rbd=18.2.2-1256-gdc093b5e-1focal libcephfs2=18.2.2-1256-gdc093b5e-1focal libcephfs-dev=18.2.2-1256-gdc093b5e-1focal librados2=18.2.2-1256-gdc093b5e-1focal librbd1=18.2.2-1256-gdc093b5e-1focal rbd-fuse=18.2.2-1256-gdc093b5e-1focal 2024-04-26T10:17:52.081 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-04-26T10:17:52.088 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1256-gdc093b5e-1focal cephadm=18.2.2-1256-gdc093b5e-1focal ceph-mds=18.2.2-1256-gdc093b5e-1focal ceph-mgr=18.2.2-1256-gdc093b5e-1focal ceph-common=18.2.2-1256-gdc093b5e-1focal ceph-fuse=18.2.2-1256-gdc093b5e-1focal ceph-test=18.2.2-1256-gdc093b5e-1focal ceph-volume=18.2.2-1256-gdc093b5e-1focal radosgw=18.2.2-1256-gdc093b5e-1focal python3-rados=18.2.2-1256-gdc093b5e-1focal python3-rgw=18.2.2-1256-gdc093b5e-1focal python3-cephfs=18.2.2-1256-gdc093b5e-1focal python3-rbd=18.2.2-1256-gdc093b5e-1focal libcephfs2=18.2.2-1256-gdc093b5e-1focal libcephfs-dev=18.2.2-1256-gdc093b5e-1focal librados2=18.2.2-1256-gdc093b5e-1focal librbd1=18.2.2-1256-gdc093b5e-1focal rbd-fuse=18.2.2-1256-gdc093b5e-1focal 2024-04-26T10:17:52.144 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2024-04-26T10:17:52.158 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-04-26T10:17:52.269 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-04-26T10:17:52.270 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-04-26T10:17:52.271 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-04-26T10:17:52.272 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-04-26T10:17:52.332 INFO:teuthology.orchestra.run.smithi164.stdout:Building dependency tree... 2024-04-26T10:17:52.332 INFO:teuthology.orchestra.run.smithi164.stdout:Reading state information... 2024-04-26T10:17:52.373 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2024-04-26T10:17:52.373 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2024-04-26T10:17:52.454 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T10:17:52.455 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-26T10:17:52.456 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T10:17:52.456 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-04-26T10:17:52.456 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T10:17:52.456 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-04-26T10:17:52.456 INFO:teuthology.orchestra.run.smithi154.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-04-26T10:17:52.456 INFO:teuthology.orchestra.run.smithi154.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-04-26T10:17:52.456 INFO:teuthology.orchestra.run.smithi154.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-04-26T10:17:52.457 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-04-26T10:17:52.457 INFO:teuthology.orchestra.run.smithi154.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-26T10:17:52.457 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-26T10:17:52.457 INFO:teuthology.orchestra.run.smithi154.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-26T10:17:52.457 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-04-26T10:17:52.457 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-04-26T10:17:52.457 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-26T10:17:52.457 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-26T10:17:52.457 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-26T10:17:52.458 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-26T10:17:52.458 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-26T10:17:52.458 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T10:17:52.458 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-26T10:17:52.458 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-26T10:17:52.458 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-26T10:17:52.458 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-26T10:17:52.458 INFO:teuthology.orchestra.run.smithi154.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-26T10:17:52.459 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-04-26T10:17:52.459 INFO:teuthology.orchestra.run.smithi154.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-04-26T10:17:52.459 INFO:teuthology.orchestra.run.smithi154.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-04-26T10:17:52.459 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-04-26T10:17:52.459 INFO:teuthology.orchestra.run.smithi154.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-04-26T10:17:52.459 INFO:teuthology.orchestra.run.smithi154.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-04-26T10:17:52.459 INFO:teuthology.orchestra.run.smithi154.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-04-26T10:17:52.459 INFO:teuthology.orchestra.run.smithi154.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-04-26T10:17:52.459 INFO:teuthology.orchestra.run.smithi154.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T10:17:52.459 INFO:teuthology.orchestra.run.smithi154.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-04-26T10:17:52.460 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2024-04-26T10:17:52.460 INFO:teuthology.orchestra.run.smithi154.stdout: btrfs-tools 2024-04-26T10:17:52.461 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T10:17:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-26T10:17:52.463 INFO:teuthology.orchestra.run.smithi120.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T10:17:52.463 INFO:teuthology.orchestra.run.smithi120.stdout:The following additional packages will be installed: 2024-04-26T10:17:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T10:17:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-04-26T10:17:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-04-26T10:17:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-04-26T10:17:52.463 INFO:teuthology.orchestra.run.smithi120.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-04-26T10:17:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-04-26T10:17:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-26T10:17:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-26T10:17:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-26T10:17:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-04-26T10:17:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-04-26T10:17:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-26T10:17:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-26T10:17:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-26T10:17:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-26T10:17:52.465 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-26T10:17:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T10:17:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-26T10:17:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-26T10:17:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-26T10:17:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-26T10:17:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-26T10:17:52.466 INFO:teuthology.orchestra.run.smithi120.stdout:Suggested packages: 2024-04-26T10:17:52.466 INFO:teuthology.orchestra.run.smithi120.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-04-26T10:17:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-04-26T10:17:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-04-26T10:17:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-04-26T10:17:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-04-26T10:17:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-04-26T10:17:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-04-26T10:17:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T10:17:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-04-26T10:17:52.467 INFO:teuthology.orchestra.run.smithi120.stdout:Recommended packages: 2024-04-26T10:17:52.467 INFO:teuthology.orchestra.run.smithi120.stdout: btrfs-tools 2024-04-26T10:17:52.514 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T10:17:52.515 INFO:teuthology.orchestra.run.smithi164.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-26T10:17:52.515 INFO:teuthology.orchestra.run.smithi164.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T10:17:52.515 INFO:teuthology.orchestra.run.smithi164.stdout:The following additional packages will be installed: 2024-04-26T10:17:52.516 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T10:17:52.516 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-04-26T10:17:52.516 INFO:teuthology.orchestra.run.smithi164.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-04-26T10:17:52.516 INFO:teuthology.orchestra.run.smithi164.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-04-26T10:17:52.516 INFO:teuthology.orchestra.run.smithi164.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-04-26T10:17:52.516 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-04-26T10:17:52.517 INFO:teuthology.orchestra.run.smithi164.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-26T10:17:52.517 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-26T10:17:52.517 INFO:teuthology.orchestra.run.smithi164.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-26T10:17:52.517 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-04-26T10:17:52.517 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-04-26T10:17:52.517 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-26T10:17:52.517 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-26T10:17:52.517 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-26T10:17:52.517 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-26T10:17:52.517 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-26T10:17:52.517 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T10:17:52.517 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-26T10:17:52.518 INFO:teuthology.orchestra.run.smithi164.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-26T10:17:52.518 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-26T10:17:52.518 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-26T10:17:52.518 INFO:teuthology.orchestra.run.smithi164.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-26T10:17:52.518 INFO:teuthology.orchestra.run.smithi164.stdout:Suggested packages: 2024-04-26T10:17:52.518 INFO:teuthology.orchestra.run.smithi164.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-04-26T10:17:52.518 INFO:teuthology.orchestra.run.smithi164.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-04-26T10:17:52.518 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-04-26T10:17:52.518 INFO:teuthology.orchestra.run.smithi164.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-04-26T10:17:52.518 INFO:teuthology.orchestra.run.smithi164.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-04-26T10:17:52.519 INFO:teuthology.orchestra.run.smithi164.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-04-26T10:17:52.519 INFO:teuthology.orchestra.run.smithi164.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-04-26T10:17:52.519 INFO:teuthology.orchestra.run.smithi164.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T10:17:52.519 INFO:teuthology.orchestra.run.smithi164.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-04-26T10:17:52.519 INFO:teuthology.orchestra.run.smithi164.stdout:Recommended packages: 2024-04-26T10:17:52.519 INFO:teuthology.orchestra.run.smithi164.stdout: btrfs-tools 2024-04-26T10:17:52.573 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-04-26T10:17:52.573 INFO:teuthology.orchestra.run.smithi154.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T10:17:52.574 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T10:17:52.574 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T10:17:52.575 INFO:teuthology.orchestra.run.smithi154.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-04-26T10:17:52.575 INFO:teuthology.orchestra.run.smithi154.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-04-26T10:17:52.575 INFO:teuthology.orchestra.run.smithi154.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T10:17:52.575 INFO:teuthology.orchestra.run.smithi154.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-04-26T10:17:52.575 INFO:teuthology.orchestra.run.smithi154.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-04-26T10:17:52.575 INFO:teuthology.orchestra.run.smithi154.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-04-26T10:17:52.575 INFO:teuthology.orchestra.run.smithi154.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-04-26T10:17:52.575 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T10:17:52.576 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-04-26T10:17:52.576 INFO:teuthology.orchestra.run.smithi154.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-04-26T10:17:52.576 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-26T10:17:52.576 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-26T10:17:52.576 INFO:teuthology.orchestra.run.smithi154.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-26T10:17:52.576 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-26T10:17:52.576 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-26T10:17:52.576 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-04-26T10:17:52.576 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-04-26T10:17:52.576 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T10:17:52.576 INFO:teuthology.orchestra.run.smithi154.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-04-26T10:17:52.576 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-04-26T10:17:52.576 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-04-26T10:17:52.576 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet 2024-04-26T10:17:52.577 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages will be upgraded: 2024-04-26T10:17:52.577 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 librbd1 2024-04-26T10:17:52.580 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T10:17:52.582 INFO:teuthology.orchestra.run.smithi052.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-26T10:17:52.582 INFO:teuthology.orchestra.run.smithi052.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T10:17:52.582 INFO:teuthology.orchestra.run.smithi052.stdout:The following additional packages will be installed: 2024-04-26T10:17:52.582 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-26T10:17:52.582 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-04-26T10:17:52.582 INFO:teuthology.orchestra.run.smithi052.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-04-26T10:17:52.582 INFO:teuthology.orchestra.run.smithi052.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-04-26T10:17:52.582 INFO:teuthology.orchestra.run.smithi052.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-04-26T10:17:52.586 INFO:teuthology.orchestra.run.smithi052.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-04-26T10:17:52.586 INFO:teuthology.orchestra.run.smithi052.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-26T10:17:52.586 INFO:teuthology.orchestra.run.smithi052.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-26T10:17:52.587 INFO:teuthology.orchestra.run.smithi052.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-26T10:17:52.587 INFO:teuthology.orchestra.run.smithi052.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-04-26T10:17:52.587 INFO:teuthology.orchestra.run.smithi052.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-04-26T10:17:52.587 INFO:teuthology.orchestra.run.smithi052.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-26T10:17:52.587 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-26T10:17:52.587 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-26T10:17:52.587 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-26T10:17:52.587 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-26T10:17:52.587 INFO:teuthology.orchestra.run.smithi052.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-04-26T10:17:52.587 INFO:teuthology.orchestra.run.smithi052.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-26T10:17:52.587 INFO:teuthology.orchestra.run.smithi052.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-26T10:17:52.587 INFO:teuthology.orchestra.run.smithi052.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-26T10:17:52.587 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-26T10:17:52.587 INFO:teuthology.orchestra.run.smithi052.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-26T10:17:52.588 INFO:teuthology.orchestra.run.smithi052.stdout:Suggested packages: 2024-04-26T10:17:52.588 INFO:teuthology.orchestra.run.smithi052.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-04-26T10:17:52.588 INFO:teuthology.orchestra.run.smithi052.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-04-26T10:17:52.588 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-04-26T10:17:52.588 INFO:teuthology.orchestra.run.smithi052.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-04-26T10:17:52.588 INFO:teuthology.orchestra.run.smithi052.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-04-26T10:17:52.588 INFO:teuthology.orchestra.run.smithi052.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-04-26T10:17:52.588 INFO:teuthology.orchestra.run.smithi052.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-04-26T10:17:52.588 INFO:teuthology.orchestra.run.smithi052.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-26T10:17:52.588 INFO:teuthology.orchestra.run.smithi052.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-04-26T10:17:52.588 INFO:teuthology.orchestra.run.smithi052.stdout:Recommended packages: 2024-04-26T10:17:52.588 INFO:teuthology.orchestra.run.smithi052.stdout: btrfs-tools 2024-04-26T10:17:52.589 INFO:teuthology.orchestra.run.smithi120.stdout:The following NEW packages will be installed: 2024-04-26T10:17:52.589 INFO:teuthology.orchestra.run.smithi120.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T10:17:52.589 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T10:17:52.589 INFO:teuthology.orchestra.run.smithi120.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T10:17:52.589 INFO:teuthology.orchestra.run.smithi120.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-04-26T10:17:52.589 INFO:teuthology.orchestra.run.smithi120.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-04-26T10:17:52.589 INFO:teuthology.orchestra.run.smithi120.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T10:17:52.589 INFO:teuthology.orchestra.run.smithi120.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-04-26T10:17:52.589 INFO:teuthology.orchestra.run.smithi120.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-04-26T10:17:52.589 INFO:teuthology.orchestra.run.smithi120.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-04-26T10:17:52.590 INFO:teuthology.orchestra.run.smithi120.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-04-26T10:17:52.590 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T10:17:52.590 INFO:teuthology.orchestra.run.smithi120.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-04-26T10:17:52.590 INFO:teuthology.orchestra.run.smithi120.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-04-26T10:17:52.590 INFO:teuthology.orchestra.run.smithi120.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-26T10:17:52.590 INFO:teuthology.orchestra.run.smithi120.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-26T10:17:52.590 INFO:teuthology.orchestra.run.smithi120.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-26T10:17:52.590 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-26T10:17:52.590 INFO:teuthology.orchestra.run.smithi120.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-26T10:17:52.590 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-04-26T10:17:52.590 INFO:teuthology.orchestra.run.smithi120.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-04-26T10:17:52.590 INFO:teuthology.orchestra.run.smithi120.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T10:17:52.590 INFO:teuthology.orchestra.run.smithi120.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-04-26T10:17:52.590 INFO:teuthology.orchestra.run.smithi120.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-04-26T10:17:52.591 INFO:teuthology.orchestra.run.smithi120.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-04-26T10:17:52.591 INFO:teuthology.orchestra.run.smithi120.stdout: xmlstarlet 2024-04-26T10:17:52.591 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages will be upgraded: 2024-04-26T10:17:52.591 INFO:teuthology.orchestra.run.smithi120.stdout: librados2 librbd1 2024-04-26T10:17:52.633 INFO:teuthology.orchestra.run.smithi164.stdout:The following NEW packages will be installed: 2024-04-26T10:17:52.633 INFO:teuthology.orchestra.run.smithi164.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T10:17:52.633 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T10:17:52.633 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T10:17:52.633 INFO:teuthology.orchestra.run.smithi164.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-04-26T10:17:52.634 INFO:teuthology.orchestra.run.smithi164.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-04-26T10:17:52.634 INFO:teuthology.orchestra.run.smithi164.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T10:17:52.634 INFO:teuthology.orchestra.run.smithi164.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-04-26T10:17:52.634 INFO:teuthology.orchestra.run.smithi164.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-04-26T10:17:52.634 INFO:teuthology.orchestra.run.smithi164.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-04-26T10:17:52.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-04-26T10:17:52.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T10:17:52.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-04-26T10:17:52.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-04-26T10:17:52.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-26T10:17:52.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-26T10:17:52.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-26T10:17:52.634 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-26T10:17:52.635 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-26T10:17:52.635 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-04-26T10:17:52.635 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-04-26T10:17:52.635 INFO:teuthology.orchestra.run.smithi164.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T10:17:52.635 INFO:teuthology.orchestra.run.smithi164.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-04-26T10:17:52.635 INFO:teuthology.orchestra.run.smithi164.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-04-26T10:17:52.635 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-04-26T10:17:52.635 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet 2024-04-26T10:17:52.635 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages will be upgraded: 2024-04-26T10:17:52.636 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 librbd1 2024-04-26T10:17:52.704 INFO:teuthology.orchestra.run.smithi052.stdout:The following NEW packages will be installed: 2024-04-26T10:17:52.704 INFO:teuthology.orchestra.run.smithi052.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-26T10:17:52.705 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-26T10:17:52.705 INFO:teuthology.orchestra.run.smithi052.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-26T10:17:52.705 INFO:teuthology.orchestra.run.smithi052.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-04-26T10:17:52.705 INFO:teuthology.orchestra.run.smithi052.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-04-26T10:17:52.705 INFO:teuthology.orchestra.run.smithi052.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-26T10:17:52.705 INFO:teuthology.orchestra.run.smithi052.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-04-26T10:17:52.706 INFO:teuthology.orchestra.run.smithi164.stdout:2 upgraded, 110 newly installed, 0 to remove and 277 not upgraded. 2024-04-26T10:17:52.706 INFO:teuthology.orchestra.run.smithi164.stdout:Need to get 198 MB of archives. 2024-04-26T10:17:52.706 INFO:teuthology.orchestra.run.smithi164.stdout:After this operation, 975 MB of additional disk space will be used. 2024-04-26T10:17:52.706 INFO:teuthology.orchestra.run.smithi164.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-04-26T10:17:52.708 INFO:teuthology.orchestra.run.smithi052.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-04-26T10:17:52.708 INFO:teuthology.orchestra.run.smithi052.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-04-26T10:17:52.708 INFO:teuthology.orchestra.run.smithi052.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-04-26T10:17:52.708 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-26T10:17:52.708 INFO:teuthology.orchestra.run.smithi052.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-04-26T10:17:52.708 INFO:teuthology.orchestra.run.smithi052.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-04-26T10:17:52.708 INFO:teuthology.orchestra.run.smithi052.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-26T10:17:52.709 INFO:teuthology.orchestra.run.smithi052.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-26T10:17:52.709 INFO:teuthology.orchestra.run.smithi052.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-26T10:17:52.709 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-26T10:17:52.709 INFO:teuthology.orchestra.run.smithi052.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-26T10:17:52.709 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-04-26T10:17:52.709 INFO:teuthology.orchestra.run.smithi052.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-04-26T10:17:52.709 INFO:teuthology.orchestra.run.smithi052.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-26T10:17:52.709 INFO:teuthology.orchestra.run.smithi052.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-04-26T10:17:52.709 INFO:teuthology.orchestra.run.smithi052.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-04-26T10:17:52.709 INFO:teuthology.orchestra.run.smithi052.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-04-26T10:17:52.709 INFO:teuthology.orchestra.run.smithi052.stdout: xmlstarlet 2024-04-26T10:17:52.709 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages will be upgraded: 2024-04-26T10:17:52.709 INFO:teuthology.orchestra.run.smithi052.stdout: librados2 librbd1 2024-04-26T10:17:52.724 INFO:teuthology.orchestra.run.smithi154.stdout:2 upgraded, 110 newly installed, 0 to remove and 277 not upgraded. 2024-04-26T10:17:52.725 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 198 MB of archives. 2024-04-26T10:17:52.725 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 975 MB of additional disk space will be used. 2024-04-26T10:17:52.725 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1256-gdc093b5e-1focal [3,445 kB] 2024-04-26T10:17:52.770 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-04-26T10:17:52.778 INFO:teuthology.orchestra.run.smithi120.stdout:2 upgraded, 110 newly installed, 0 to remove and 277 not upgraded. 2024-04-26T10:17:52.778 INFO:teuthology.orchestra.run.smithi120.stdout:Need to get 198 MB of archives. 2024-04-26T10:17:52.778 INFO:teuthology.orchestra.run.smithi120.stdout:After this operation, 975 MB of additional disk space will be used. 2024-04-26T10:17:52.778 INFO:teuthology.orchestra.run.smithi120.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-04-26T10:17:52.780 INFO:teuthology.orchestra.run.smithi052.stdout:2 upgraded, 110 newly installed, 0 to remove and 277 not upgraded. 2024-04-26T10:17:52.780 INFO:teuthology.orchestra.run.smithi052.stdout:Need to get 198 MB of archives. 2024-04-26T10:17:52.780 INFO:teuthology.orchestra.run.smithi052.stdout:After this operation, 975 MB of additional disk space will be used. 2024-04-26T10:17:52.780 INFO:teuthology.orchestra.run.smithi052.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-04-26T10:17:52.784 INFO:teuthology.orchestra.run.smithi164.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1256-gdc093b5e-1focal [3,445 kB] 2024-04-26T10:17:52.806 INFO:teuthology.orchestra.run.smithi164.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-04-26T10:17:52.809 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1256-gdc093b5e-1focal [3,445 kB] 2024-04-26T10:17:52.810 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-04-26T10:17:52.830 INFO:teuthology.orchestra.run.smithi164.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-04-26T10:17:52.880 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-04-26T10:17:52.885 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-04-26T10:17:52.895 INFO:teuthology.orchestra.run.smithi164.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-04-26T10:17:52.898 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-04-26T10:17:52.909 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-04-26T10:17:52.911 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-04-26T10:17:52.913 INFO:teuthology.orchestra.run.smithi164.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-04-26T10:17:52.914 INFO:teuthology.orchestra.run.smithi164.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-04-26T10:17:52.915 INFO:teuthology.orchestra.run.smithi164.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-04-26T10:17:52.916 INFO:teuthology.orchestra.run.smithi164.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-04-26T10:17:52.921 INFO:teuthology.orchestra.run.smithi164.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-04-26T10:17:52.922 INFO:teuthology.orchestra.run.smithi164.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-04-26T10:17:52.925 INFO:teuthology.orchestra.run.smithi164.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-04-26T10:17:52.946 INFO:teuthology.orchestra.run.smithi164.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-04-26T10:17:52.947 INFO:teuthology.orchestra.run.smithi164.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-04-26T10:17:52.947 INFO:teuthology.orchestra.run.smithi164.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-04-26T10:17:52.949 INFO:teuthology.orchestra.run.smithi164.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T10:17:52.949 INFO:teuthology.orchestra.run.smithi164.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-04-26T10:17:52.950 INFO:teuthology.orchestra.run.smithi164.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-04-26T10:17:52.951 INFO:teuthology.orchestra.run.smithi164.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-04-26T10:17:52.952 INFO:teuthology.orchestra.run.smithi164.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-04-26T10:17:52.954 INFO:teuthology.orchestra.run.smithi164.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-04-26T10:17:52.957 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1256-gdc093b5e-1focal [4,029 kB] 2024-04-26T10:17:52.970 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1256-gdc093b5e-1focal [3,445 kB] 2024-04-26T10:17:52.975 INFO:teuthology.orchestra.run.smithi164.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-04-26T10:17:52.975 INFO:teuthology.orchestra.run.smithi164.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-04-26T10:17:52.983 INFO:teuthology.orchestra.run.smithi164.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-04-26T10:17:52.984 INFO:teuthology.orchestra.run.smithi164.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-04-26T10:17:52.984 INFO:teuthology.orchestra.run.smithi164.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-04-26T10:17:52.989 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-04-26T10:17:52.992 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-04-26T10:17:52.999 INFO:teuthology.orchestra.run.smithi164.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-04-26T10:17:53.000 INFO:teuthology.orchestra.run.smithi164.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-04-26T10:17:53.003 INFO:teuthology.orchestra.run.smithi164.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-04-26T10:17:53.004 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-04-26T10:17:53.004 INFO:teuthology.orchestra.run.smithi164.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-04-26T10:17:53.007 INFO:teuthology.orchestra.run.smithi164.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-04-26T10:17:53.009 INFO:teuthology.orchestra.run.smithi052.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-04-26T10:17:53.009 INFO:teuthology.orchestra.run.smithi052.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-04-26T10:17:53.011 INFO:teuthology.orchestra.run.smithi052.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-04-26T10:17:53.011 INFO:teuthology.orchestra.run.smithi052.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-04-26T10:17:53.016 INFO:teuthology.orchestra.run.smithi052.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-04-26T10:17:53.016 INFO:teuthology.orchestra.run.smithi052.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-04-26T10:17:53.020 INFO:teuthology.orchestra.run.smithi052.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-04-26T10:17:53.026 INFO:teuthology.orchestra.run.smithi164.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-04-26T10:17:53.028 INFO:teuthology.orchestra.run.smithi164.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-04-26T10:17:53.030 INFO:teuthology.orchestra.run.smithi164.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-04-26T10:17:53.031 INFO:teuthology.orchestra.run.smithi164.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-04-26T10:17:53.032 INFO:teuthology.orchestra.run.smithi164.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-04-26T10:17:53.039 INFO:teuthology.orchestra.run.smithi052.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-04-26T10:17:53.040 INFO:teuthology.orchestra.run.smithi052.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-04-26T10:17:53.041 INFO:teuthology.orchestra.run.smithi052.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-04-26T10:17:53.042 INFO:teuthology.orchestra.run.smithi052.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T10:17:53.043 INFO:teuthology.orchestra.run.smithi052.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-04-26T10:17:53.043 INFO:teuthology.orchestra.run.smithi052.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-04-26T10:17:53.045 INFO:teuthology.orchestra.run.smithi052.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-04-26T10:17:53.045 INFO:teuthology.orchestra.run.smithi052.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-04-26T10:17:53.046 INFO:teuthology.orchestra.run.smithi164.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-04-26T10:17:53.047 INFO:teuthology.orchestra.run.smithi052.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-04-26T10:17:53.048 INFO:teuthology.orchestra.run.smithi164.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-04-26T10:17:53.048 INFO:teuthology.orchestra.run.smithi164.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-04-26T10:17:53.048 INFO:teuthology.orchestra.run.smithi164.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-04-26T10:17:53.049 INFO:teuthology.orchestra.run.smithi164.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-04-26T10:17:53.064 INFO:teuthology.orchestra.run.smithi052.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-04-26T10:17:53.064 INFO:teuthology.orchestra.run.smithi052.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-04-26T10:17:53.070 INFO:teuthology.orchestra.run.smithi164.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T10:17:53.070 INFO:teuthology.orchestra.run.smithi164.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-04-26T10:17:53.070 INFO:teuthology.orchestra.run.smithi052.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-04-26T10:17:53.072 INFO:teuthology.orchestra.run.smithi164.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-04-26T10:17:53.074 INFO:teuthology.orchestra.run.smithi164.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-04-26T10:17:53.077 INFO:teuthology.orchestra.run.smithi164.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-04-26T10:17:53.084 INFO:teuthology.orchestra.run.smithi052.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-04-26T10:17:53.085 INFO:teuthology.orchestra.run.smithi052.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-04-26T10:17:53.085 INFO:teuthology.orchestra.run.smithi052.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-04-26T10:17:53.087 INFO:teuthology.orchestra.run.smithi052.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-04-26T10:17:53.090 INFO:teuthology.orchestra.run.smithi052.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-04-26T10:17:53.091 INFO:teuthology.orchestra.run.smithi052.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-04-26T10:17:53.092 INFO:teuthology.orchestra.run.smithi164.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-04-26T10:17:53.093 INFO:teuthology.orchestra.run.smithi164.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-04-26T10:17:53.095 INFO:teuthology.orchestra.run.smithi052.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-04-26T10:17:53.124 INFO:teuthology.orchestra.run.smithi052.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-04-26T10:17:53.127 INFO:teuthology.orchestra.run.smithi052.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-04-26T10:17:53.129 INFO:teuthology.orchestra.run.smithi052.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-04-26T10:17:53.162 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1256-gdc093b5e-1focal [744 kB] 2024-04-26T10:17:53.168 INFO:teuthology.orchestra.run.smithi052.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-04-26T10:17:53.169 INFO:teuthology.orchestra.run.smithi052.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-04-26T10:17:53.169 INFO:teuthology.orchestra.run.smithi052.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-04-26T10:17:53.171 INFO:teuthology.orchestra.run.smithi052.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-04-26T10:17:53.172 INFO:teuthology.orchestra.run.smithi052.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-04-26T10:17:53.173 INFO:teuthology.orchestra.run.smithi052.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-04-26T10:17:53.174 INFO:teuthology.orchestra.run.smithi052.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-04-26T10:17:53.176 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-04-26T10:17:53.186 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-04-26T10:17:53.190 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-04-26T10:17:53.200 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-04-26T10:17:53.204 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1256-gdc093b5e-1focal [387 kB] 2024-04-26T10:17:53.214 INFO:teuthology.orchestra.run.smithi052.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T10:17:53.215 INFO:teuthology.orchestra.run.smithi052.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-04-26T10:17:53.217 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1256-gdc093b5e-1focal [31.9 kB] 2024-04-26T10:17:53.218 INFO:teuthology.orchestra.run.smithi052.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-04-26T10:17:53.218 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1256-gdc093b5e-1focal [200 kB] 2024-04-26T10:17:53.227 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1256-gdc093b5e-1focal [62.4 kB] 2024-04-26T10:17:53.229 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1256-gdc093b5e-1focal [365 kB] 2024-04-26T10:17:53.239 INFO:teuthology.orchestra.run.smithi164.stdout:Get:52 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1256-gdc093b5e-1focal [4,029 kB] 2024-04-26T10:17:53.251 INFO:teuthology.orchestra.run.smithi164.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-04-26T10:17:53.259 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1256-gdc093b5e-1focal [6,590 kB] 2024-04-26T10:17:53.261 INFO:teuthology.orchestra.run.smithi052.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-04-26T10:17:53.263 INFO:teuthology.orchestra.run.smithi052.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-04-26T10:17:53.264 INFO:teuthology.orchestra.run.smithi052.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-04-26T10:17:53.265 INFO:teuthology.orchestra.run.smithi052.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-04-26T10:17:53.274 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-04-26T10:17:53.285 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-04-26T10:17:53.383 INFO:teuthology.orchestra.run.smithi164.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-26T10:17:53.384 INFO:teuthology.orchestra.run.smithi164.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-04-26T10:17:53.397 INFO:teuthology.orchestra.run.smithi164.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-04-26T10:17:53.397 INFO:teuthology.orchestra.run.smithi164.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-04-26T10:17:53.397 INFO:teuthology.orchestra.run.smithi164.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-04-26T10:17:53.398 INFO:teuthology.orchestra.run.smithi164.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-04-26T10:17:53.398 INFO:teuthology.orchestra.run.smithi164.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-04-26T10:17:53.399 INFO:teuthology.orchestra.run.smithi164.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-04-26T10:17:53.399 INFO:teuthology.orchestra.run.smithi164.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-04-26T10:17:53.405 INFO:teuthology.orchestra.run.smithi164.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-04-26T10:17:53.433 INFO:teuthology.orchestra.run.smithi164.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-04-26T10:17:53.434 INFO:teuthology.orchestra.run.smithi164.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-04-26T10:17:53.438 INFO:teuthology.orchestra.run.smithi164.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-04-26T10:17:53.440 INFO:teuthology.orchestra.run.smithi164.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-04-26T10:17:53.443 INFO:teuthology.orchestra.run.smithi164.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-04-26T10:17:53.444 INFO:teuthology.orchestra.run.smithi164.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-04-26T10:17:53.449 INFO:teuthology.orchestra.run.smithi164.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-04-26T10:17:53.453 INFO:teuthology.orchestra.run.smithi164.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-04-26T10:17:53.520 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-04-26T10:17:53.528 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-04-26T10:17:53.530 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-04-26T10:17:53.539 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-04-26T10:17:53.552 INFO:teuthology.orchestra.run.smithi164.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-04-26T10:17:53.558 INFO:teuthology.orchestra.run.smithi164.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-04-26T10:17:53.558 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-04-26T10:17:53.561 INFO:teuthology.orchestra.run.smithi052.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-04-26T10:17:53.562 INFO:teuthology.orchestra.run.smithi164.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-04-26T10:17:53.567 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-04-26T10:17:53.567 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-04-26T10:17:53.568 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-04-26T10:17:53.571 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-04-26T10:17:53.573 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-04-26T10:17:53.575 INFO:teuthology.orchestra.run.smithi120.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-04-26T10:17:53.576 INFO:teuthology.orchestra.run.smithi120.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-04-26T10:17:53.577 INFO:teuthology.orchestra.run.smithi052.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-26T10:17:53.579 INFO:teuthology.orchestra.run.smithi120.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-04-26T10:17:53.581 INFO:teuthology.orchestra.run.smithi120.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-04-26T10:17:53.585 INFO:teuthology.orchestra.run.smithi052.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-04-26T10:17:53.592 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1256-gdc093b5e-1focal [113 kB] 2024-04-26T10:17:53.597 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1256-gdc093b5e-1focal [476 kB] 2024-04-26T10:17:53.614 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1256-gdc093b5e-1focal [25.1 MB] 2024-04-26T10:17:53.627 INFO:teuthology.orchestra.run.smithi164.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-04-26T10:17:53.628 INFO:teuthology.orchestra.run.smithi164.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-04-26T10:17:53.628 INFO:teuthology.orchestra.run.smithi164.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-04-26T10:17:53.630 INFO:teuthology.orchestra.run.smithi164.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-04-26T10:17:53.635 INFO:teuthology.orchestra.run.smithi052.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-04-26T10:17:53.635 INFO:teuthology.orchestra.run.smithi052.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-04-26T10:17:53.637 INFO:teuthology.orchestra.run.smithi052.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-04-26T10:17:53.640 INFO:teuthology.orchestra.run.smithi052.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-04-26T10:17:53.640 INFO:teuthology.orchestra.run.smithi052.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-04-26T10:17:53.640 INFO:teuthology.orchestra.run.smithi052.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-04-26T10:17:53.641 INFO:teuthology.orchestra.run.smithi052.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-04-26T10:17:53.642 INFO:teuthology.orchestra.run.smithi052.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-04-26T10:17:53.642 INFO:teuthology.orchestra.run.smithi052.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-04-26T10:17:53.657 INFO:teuthology.orchestra.run.smithi164.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T10:17:53.657 INFO:teuthology.orchestra.run.smithi164.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-04-26T10:17:53.659 INFO:teuthology.orchestra.run.smithi164.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-04-26T10:17:53.659 INFO:teuthology.orchestra.run.smithi164.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-04-26T10:17:53.659 INFO:teuthology.orchestra.run.smithi164.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-04-26T10:17:53.674 INFO:teuthology.orchestra.run.smithi052.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-04-26T10:17:53.680 INFO:teuthology.orchestra.run.smithi052.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-04-26T10:17:53.683 INFO:teuthology.orchestra.run.smithi052.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-04-26T10:17:53.685 INFO:teuthology.orchestra.run.smithi052.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-04-26T10:17:53.686 INFO:teuthology.orchestra.run.smithi052.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-04-26T10:17:53.690 INFO:teuthology.orchestra.run.smithi052.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-04-26T10:17:53.692 INFO:teuthology.orchestra.run.smithi052.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-04-26T10:17:53.701 INFO:teuthology.orchestra.run.smithi164.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1256-gdc093b5e-1focal [744 kB] 2024-04-26T10:17:53.724 INFO:teuthology.orchestra.run.smithi052.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-04-26T10:17:53.728 INFO:teuthology.orchestra.run.smithi052.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-04-26T10:17:53.732 INFO:teuthology.orchestra.run.smithi052.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-04-26T10:17:53.748 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-04-26T10:17:53.757 INFO:teuthology.orchestra.run.smithi120.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-04-26T10:17:53.783 INFO:teuthology.orchestra.run.smithi164.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1256-gdc093b5e-1focal [387 kB] 2024-04-26T10:17:53.817 INFO:teuthology.orchestra.run.smithi052.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-04-26T10:17:53.817 INFO:teuthology.orchestra.run.smithi052.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-04-26T10:17:53.818 INFO:teuthology.orchestra.run.smithi052.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-04-26T10:17:53.818 INFO:teuthology.orchestra.run.smithi052.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-04-26T10:17:53.841 INFO:teuthology.orchestra.run.smithi052.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T10:17:53.841 INFO:teuthology.orchestra.run.smithi052.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-04-26T10:17:53.842 INFO:teuthology.orchestra.run.smithi052.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-04-26T10:17:53.842 INFO:teuthology.orchestra.run.smithi052.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-04-26T10:17:53.843 INFO:teuthology.orchestra.run.smithi052.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-04-26T10:17:53.867 INFO:teuthology.orchestra.run.smithi164.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1256-gdc093b5e-1focal [31.9 kB] 2024-04-26T10:17:53.869 INFO:teuthology.orchestra.run.smithi164.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1256-gdc093b5e-1focal [200 kB] 2024-04-26T10:17:53.873 INFO:teuthology.orchestra.run.smithi164.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1256-gdc093b5e-1focal [62.4 kB] 2024-04-26T10:17:53.873 INFO:teuthology.orchestra.run.smithi164.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1256-gdc093b5e-1focal [365 kB] 2024-04-26T10:17:53.876 INFO:teuthology.orchestra.run.smithi164.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1256-gdc093b5e-1focal [6,590 kB] 2024-04-26T10:17:54.008 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-04-26T10:17:54.011 INFO:teuthology.orchestra.run.smithi120.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-04-26T10:17:54.184 INFO:teuthology.orchestra.run.smithi120.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-04-26T10:17:54.198 INFO:teuthology.orchestra.run.smithi120.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-04-26T10:17:54.204 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-04-26T10:17:54.207 INFO:teuthology.orchestra.run.smithi120.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-04-26T10:17:54.213 INFO:teuthology.orchestra.run.smithi120.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-04-26T10:17:54.220 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-04-26T10:17:54.229 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-04-26T10:17:54.236 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-04-26T10:17:54.241 INFO:teuthology.orchestra.run.smithi120.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T10:17:54.247 INFO:teuthology.orchestra.run.smithi120.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-04-26T10:17:54.250 INFO:teuthology.orchestra.run.smithi120.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-04-26T10:17:54.263 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-26T10:17:54.267 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-04-26T10:17:54.270 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-04-26T10:17:54.280 INFO:teuthology.orchestra.run.smithi120.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-04-26T10:17:54.287 INFO:teuthology.orchestra.run.smithi120.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-04-26T10:17:54.299 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-04-26T10:17:54.308 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-04-26T10:17:54.470 INFO:teuthology.orchestra.run.smithi120.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-04-26T10:17:54.492 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-04-26T10:17:54.576 INFO:teuthology.orchestra.run.smithi164.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1256-gdc093b5e-1focal [113 kB] 2024-04-26T10:17:54.579 INFO:teuthology.orchestra.run.smithi164.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1256-gdc093b5e-1focal [476 kB] 2024-04-26T10:17:54.638 INFO:teuthology.orchestra.run.smithi164.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1256-gdc093b5e-1focal [25.1 MB] 2024-04-26T10:17:54.793 INFO:teuthology.orchestra.run.smithi120.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-04-26T10:17:54.804 INFO:teuthology.orchestra.run.smithi120.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-04-26T10:17:54.815 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-04-26T10:17:54.826 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-04-26T10:17:55.032 INFO:teuthology.orchestra.run.smithi052.stdout:Get:83 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1256-gdc093b5e-1focal [4,029 kB] 2024-04-26T10:17:55.041 INFO:teuthology.orchestra.run.smithi120.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-04-26T10:17:55.042 INFO:teuthology.orchestra.run.smithi120.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-04-26T10:17:55.048 INFO:teuthology.orchestra.run.smithi120.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-04-26T10:17:55.055 INFO:teuthology.orchestra.run.smithi120.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-04-26T10:17:55.071 INFO:teuthology.orchestra.run.smithi120.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-04-26T10:17:55.097 INFO:teuthology.orchestra.run.smithi120.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-04-26T10:17:55.101 INFO:teuthology.orchestra.run.smithi120.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-04-26T10:17:55.114 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-04-26T10:17:55.115 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-04-26T10:17:55.116 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-04-26T10:17:55.129 INFO:teuthology.orchestra.run.smithi120.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-04-26T10:17:55.166 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-04-26T10:17:55.166 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1256-gdc093b5e-1focal [9,602 kB] 2024-04-26T10:17:55.168 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-04-26T10:17:55.173 INFO:teuthology.orchestra.run.smithi154.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-04-26T10:17:55.174 INFO:teuthology.orchestra.run.smithi154.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-04-26T10:17:55.182 INFO:teuthology.orchestra.run.smithi154.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-04-26T10:17:55.294 INFO:teuthology.orchestra.run.smithi120.stdout:Get:35 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1256-gdc093b5e-1focal [4,029 kB] 2024-04-26T10:17:55.297 INFO:teuthology.orchestra.run.smithi120.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-04-26T10:17:55.353 INFO:teuthology.orchestra.run.smithi154.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-04-26T10:17:55.621 INFO:teuthology.orchestra.run.smithi154.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1256-gdc093b5e-1focal [238 kB] 2024-04-26T10:17:55.630 INFO:teuthology.orchestra.run.smithi154.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1256-gdc093b5e-1focal [148 kB] 2024-04-26T10:17:55.635 INFO:teuthology.orchestra.run.smithi154.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1256-gdc093b5e-1focal [1,571 kB] 2024-04-26T10:17:55.696 INFO:teuthology.orchestra.run.smithi120.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-04-26T10:17:55.734 INFO:teuthology.orchestra.run.smithi120.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-04-26T10:17:55.741 INFO:teuthology.orchestra.run.smithi120.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-04-26T10:17:55.747 INFO:teuthology.orchestra.run.smithi154.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1256-gdc093b5e-1focal [6,638 kB] 2024-04-26T10:17:55.754 INFO:teuthology.orchestra.run.smithi120.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-04-26T10:17:55.778 INFO:teuthology.orchestra.run.smithi120.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-04-26T10:17:55.803 INFO:teuthology.orchestra.run.smithi120.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-04-26T10:17:55.806 INFO:teuthology.orchestra.run.smithi120.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-04-26T10:17:55.817 INFO:teuthology.orchestra.run.smithi120.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-04-26T10:17:55.824 INFO:teuthology.orchestra.run.smithi120.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-04-26T10:17:55.872 INFO:teuthology.orchestra.run.smithi120.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T10:17:55.897 INFO:teuthology.orchestra.run.smithi154.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-04-26T10:17:55.961 INFO:teuthology.orchestra.run.smithi154.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-04-26T10:17:55.973 INFO:teuthology.orchestra.run.smithi154.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-04-26T10:17:55.995 INFO:teuthology.orchestra.run.smithi154.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-04-26T10:17:56.008 INFO:teuthology.orchestra.run.smithi154.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-04-26T10:17:56.037 INFO:teuthology.orchestra.run.smithi120.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-04-26T10:17:56.048 INFO:teuthology.orchestra.run.smithi154.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-04-26T10:17:56.052 INFO:teuthology.orchestra.run.smithi154.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-04-26T10:17:56.079 INFO:teuthology.orchestra.run.smithi154.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-04-26T10:17:56.090 INFO:teuthology.orchestra.run.smithi154.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-04-26T10:17:56.094 INFO:teuthology.orchestra.run.smithi052.stdout:Get:84 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1256-gdc093b5e-1focal [744 kB] 2024-04-26T10:17:56.136 INFO:teuthology.orchestra.run.smithi154.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1256-gdc093b5e-1focal [24.5 MB] 2024-04-26T10:17:56.263 INFO:teuthology.orchestra.run.smithi052.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1256-gdc093b5e-1focal [387 kB] 2024-04-26T10:17:56.370 INFO:teuthology.orchestra.run.smithi052.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1256-gdc093b5e-1focal [31.9 kB] 2024-04-26T10:17:56.370 INFO:teuthology.orchestra.run.smithi052.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1256-gdc093b5e-1focal [200 kB] 2024-04-26T10:17:56.373 INFO:teuthology.orchestra.run.smithi052.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1256-gdc093b5e-1focal [62.4 kB] 2024-04-26T10:17:56.374 INFO:teuthology.orchestra.run.smithi052.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1256-gdc093b5e-1focal [365 kB] 2024-04-26T10:17:56.389 INFO:teuthology.orchestra.run.smithi120.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-04-26T10:17:56.445 INFO:teuthology.orchestra.run.smithi052.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1256-gdc093b5e-1focal [6,590 kB] 2024-04-26T10:17:56.450 INFO:teuthology.orchestra.run.smithi120.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-04-26T10:17:56.460 INFO:teuthology.orchestra.run.smithi154.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-26T10:17:56.515 INFO:teuthology.orchestra.run.smithi120.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-04-26T10:17:56.521 INFO:teuthology.orchestra.run.smithi120.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-04-26T10:17:56.536 INFO:teuthology.orchestra.run.smithi120.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-04-26T10:17:56.634 INFO:teuthology.orchestra.run.smithi154.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-04-26T10:17:57.003 INFO:teuthology.orchestra.run.smithi154.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-04-26T10:17:57.074 INFO:teuthology.orchestra.run.smithi154.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-04-26T10:17:57.105 INFO:teuthology.orchestra.run.smithi120.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-04-26T10:17:57.125 INFO:teuthology.orchestra.run.smithi120.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-26T10:17:57.127 INFO:teuthology.orchestra.run.smithi120.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-04-26T10:17:57.140 INFO:teuthology.orchestra.run.smithi154.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-04-26T10:17:57.146 INFO:teuthology.orchestra.run.smithi154.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-04-26T10:17:57.163 INFO:teuthology.orchestra.run.smithi154.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-04-26T10:17:57.201 INFO:teuthology.orchestra.run.smithi120.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-04-26T10:17:57.201 INFO:teuthology.orchestra.run.smithi120.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-04-26T10:17:57.366 INFO:teuthology.orchestra.run.smithi120.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-04-26T10:17:57.576 INFO:teuthology.orchestra.run.smithi120.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-04-26T10:17:57.621 INFO:teuthology.orchestra.run.smithi120.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-04-26T10:17:57.660 INFO:teuthology.orchestra.run.smithi120.stdout:Get:61 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1256-gdc093b5e-1focal [744 kB] 2024-04-26T10:17:57.691 INFO:teuthology.orchestra.run.smithi120.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-04-26T10:17:57.705 INFO:teuthology.orchestra.run.smithi164.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1256-gdc093b5e-1focal [9,602 kB] 2024-04-26T10:17:57.720 INFO:teuthology.orchestra.run.smithi120.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-04-26T10:17:57.764 INFO:teuthology.orchestra.run.smithi052.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1256-gdc093b5e-1focal [113 kB] 2024-04-26T10:17:57.780 INFO:teuthology.orchestra.run.smithi154.stdout:Get:69 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1256-gdc093b5e-1focal [13.7 kB] 2024-04-26T10:17:57.784 INFO:teuthology.orchestra.run.smithi052.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1256-gdc093b5e-1focal [476 kB] 2024-04-26T10:17:57.795 INFO:teuthology.orchestra.run.smithi120.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-04-26T10:17:57.806 INFO:teuthology.orchestra.run.smithi120.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-04-26T10:17:57.828 INFO:teuthology.orchestra.run.smithi120.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-04-26T10:17:57.837 INFO:teuthology.orchestra.run.smithi154.stdout:Get:70 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1256-gdc093b5e-1focal [853 kB] 2024-04-26T10:17:57.853 INFO:teuthology.orchestra.run.smithi154.stdout:Get:71 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1256-gdc093b5e-1focal [2,291 kB] 2024-04-26T10:17:57.874 INFO:teuthology.orchestra.run.smithi052.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1256-gdc093b5e-1focal [25.1 MB] 2024-04-26T10:17:57.923 INFO:teuthology.orchestra.run.smithi120.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-04-26T10:17:57.926 INFO:teuthology.orchestra.run.smithi154.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1256-gdc093b5e-1focal [237 kB] 2024-04-26T10:17:57.936 INFO:teuthology.orchestra.run.smithi154.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1256-gdc093b5e-1focal [142 kB] 2024-04-26T10:17:57.946 INFO:teuthology.orchestra.run.smithi154.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1256-gdc093b5e-1focal [7,011 kB] 2024-04-26T10:17:57.954 INFO:teuthology.orchestra.run.smithi120.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-04-26T10:17:57.975 INFO:teuthology.orchestra.run.smithi120.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-04-26T10:17:58.053 INFO:teuthology.orchestra.run.smithi120.stdout:Get:70 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1256-gdc093b5e-1focal [387 kB] 2024-04-26T10:17:58.147 INFO:teuthology.orchestra.run.smithi120.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-04-26T10:17:58.290 INFO:teuthology.orchestra.run.smithi120.stdout:Get:72 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1256-gdc093b5e-1focal [31.9 kB] 2024-04-26T10:17:58.304 INFO:teuthology.orchestra.run.smithi120.stdout:Get:73 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1256-gdc093b5e-1focal [200 kB] 2024-04-26T10:17:58.393 INFO:teuthology.orchestra.run.smithi120.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1256-gdc093b5e-1focal [62.4 kB] 2024-04-26T10:17:58.406 INFO:teuthology.orchestra.run.smithi154.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1256-gdc093b5e-1focal [7,889 kB] 2024-04-26T10:17:58.460 INFO:teuthology.orchestra.run.smithi120.stdout:Get:75 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1256-gdc093b5e-1focal [365 kB] 2024-04-26T10:17:58.632 INFO:teuthology.orchestra.run.smithi120.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-04-26T10:17:58.648 INFO:teuthology.orchestra.run.smithi120.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1256-gdc093b5e-1focal [6,590 kB] 2024-04-26T10:17:58.682 INFO:teuthology.orchestra.run.smithi120.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-04-26T10:17:58.799 INFO:teuthology.orchestra.run.smithi164.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1256-gdc093b5e-1focal [238 kB] 2024-04-26T10:17:58.832 INFO:teuthology.orchestra.run.smithi164.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1256-gdc093b5e-1focal [148 kB] 2024-04-26T10:17:58.859 INFO:teuthology.orchestra.run.smithi164.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1256-gdc093b5e-1focal [1,571 kB] 2024-04-26T10:17:58.911 INFO:teuthology.orchestra.run.smithi120.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-04-26T10:17:58.919 INFO:teuthology.orchestra.run.smithi154.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1256-gdc093b5e-1focal [13.8 kB] 2024-04-26T10:17:58.919 INFO:teuthology.orchestra.run.smithi154.stdout:Get:77 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1256-gdc093b5e-1focal [46.7 MB] 2024-04-26T10:17:58.922 INFO:teuthology.orchestra.run.smithi120.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-04-26T10:17:58.931 INFO:teuthology.orchestra.run.smithi120.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-04-26T10:17:59.063 INFO:teuthology.orchestra.run.smithi164.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1256-gdc093b5e-1focal [6,638 kB] 2024-04-26T10:17:59.084 INFO:teuthology.orchestra.run.smithi120.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-04-26T10:17:59.086 INFO:teuthology.orchestra.run.smithi120.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-04-26T10:17:59.086 INFO:teuthology.orchestra.run.smithi120.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-04-26T10:17:59.087 INFO:teuthology.orchestra.run.smithi120.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-04-26T10:17:59.133 INFO:teuthology.orchestra.run.smithi120.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T10:17:59.298 INFO:teuthology.orchestra.run.smithi120.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-04-26T10:17:59.686 INFO:teuthology.orchestra.run.smithi120.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-04-26T10:17:59.695 INFO:teuthology.orchestra.run.smithi120.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-04-26T10:17:59.718 INFO:teuthology.orchestra.run.smithi120.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-04-26T10:17:59.890 INFO:teuthology.orchestra.run.smithi164.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1256-gdc093b5e-1focal [24.5 MB] 2024-04-26T10:18:02.205 INFO:teuthology.orchestra.run.smithi154.stdout:Get:78 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1256-gdc093b5e-1focal [119 kB] 2024-04-26T10:18:02.207 INFO:teuthology.orchestra.run.smithi154.stdout:Get:79 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1256-gdc093b5e-1focal [37.4 kB] 2024-04-26T10:18:02.208 INFO:teuthology.orchestra.run.smithi154.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1256-gdc093b5e-1focal [13.4 MB] 2024-04-26T10:18:02.264 INFO:teuthology.orchestra.run.smithi120.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1256-gdc093b5e-1focal [113 kB] 2024-04-26T10:18:02.285 INFO:teuthology.orchestra.run.smithi120.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1256-gdc093b5e-1focal [476 kB] 2024-04-26T10:18:02.455 INFO:teuthology.orchestra.run.smithi052.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1256-gdc093b5e-1focal [9,602 kB] 2024-04-26T10:18:02.540 INFO:teuthology.orchestra.run.smithi120.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1256-gdc093b5e-1focal [25.1 MB] 2024-04-26T10:18:02.911 INFO:teuthology.orchestra.run.smithi154.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1256-gdc093b5e-1focal [107 kB] 2024-04-26T10:18:03.039 INFO:teuthology.orchestra.run.smithi164.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1256-gdc093b5e-1focal [13.7 kB] 2024-04-26T10:18:03.040 INFO:teuthology.orchestra.run.smithi164.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1256-gdc093b5e-1focal [853 kB] 2024-04-26T10:18:03.053 INFO:teuthology.orchestra.run.smithi164.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1256-gdc093b5e-1focal [2,291 kB] 2024-04-26T10:18:03.155 INFO:teuthology.orchestra.run.smithi164.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1256-gdc093b5e-1focal [237 kB] 2024-04-26T10:18:03.169 INFO:teuthology.orchestra.run.smithi164.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1256-gdc093b5e-1focal [142 kB] 2024-04-26T10:18:03.179 INFO:teuthology.orchestra.run.smithi164.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1256-gdc093b5e-1focal [7,011 kB] 2024-04-26T10:18:03.592 INFO:teuthology.orchestra.run.smithi052.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1256-gdc093b5e-1focal [238 kB] 2024-04-26T10:18:03.613 INFO:teuthology.orchestra.run.smithi164.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1256-gdc093b5e-1focal [7,889 kB] 2024-04-26T10:18:03.619 INFO:teuthology.orchestra.run.smithi052.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1256-gdc093b5e-1focal [148 kB] 2024-04-26T10:18:03.631 INFO:teuthology.orchestra.run.smithi052.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1256-gdc093b5e-1focal [1,571 kB] 2024-04-26T10:18:03.792 INFO:teuthology.orchestra.run.smithi052.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1256-gdc093b5e-1focal [6,638 kB] 2024-04-26T10:18:04.116 INFO:teuthology.orchestra.run.smithi164.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1256-gdc093b5e-1focal [13.8 kB] 2024-04-26T10:18:04.116 INFO:teuthology.orchestra.run.smithi164.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1256-gdc093b5e-1focal [46.7 MB] 2024-04-26T10:18:04.477 INFO:teuthology.orchestra.run.smithi052.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1256-gdc093b5e-1focal [24.5 MB] 2024-04-26T10:18:06.983 INFO:teuthology.orchestra.run.smithi120.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1256-gdc093b5e-1focal [9,602 kB] 2024-04-26T10:18:07.235 INFO:teuthology.orchestra.run.smithi052.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1256-gdc093b5e-1focal [13.7 kB] 2024-04-26T10:18:07.236 INFO:teuthology.orchestra.run.smithi052.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1256-gdc093b5e-1focal [853 kB] 2024-04-26T10:18:07.296 INFO:teuthology.orchestra.run.smithi052.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1256-gdc093b5e-1focal [2,291 kB] 2024-04-26T10:18:07.584 INFO:teuthology.orchestra.run.smithi164.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1256-gdc093b5e-1focal [119 kB] 2024-04-26T10:18:07.586 INFO:teuthology.orchestra.run.smithi164.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1256-gdc093b5e-1focal [37.4 kB] 2024-04-26T10:18:07.587 INFO:teuthology.orchestra.run.smithi164.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1256-gdc093b5e-1focal [13.4 MB] 2024-04-26T10:18:07.597 INFO:teuthology.orchestra.run.smithi052.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1256-gdc093b5e-1focal [237 kB] 2024-04-26T10:18:07.635 INFO:teuthology.orchestra.run.smithi052.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1256-gdc093b5e-1focal [142 kB] 2024-04-26T10:18:07.640 INFO:teuthology.orchestra.run.smithi052.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1256-gdc093b5e-1focal [7,011 kB] 2024-04-26T10:18:07.951 INFO:teuthology.orchestra.run.smithi120.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1256-gdc093b5e-1focal [238 kB] 2024-04-26T10:18:07.965 INFO:teuthology.orchestra.run.smithi120.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1256-gdc093b5e-1focal [148 kB] 2024-04-26T10:18:07.970 INFO:teuthology.orchestra.run.smithi120.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1256-gdc093b5e-1focal [1,571 kB] 2024-04-26T10:18:08.139 INFO:teuthology.orchestra.run.smithi120.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1256-gdc093b5e-1focal [6,638 kB] 2024-04-26T10:18:08.432 INFO:teuthology.orchestra.run.smithi164.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1256-gdc093b5e-1focal [107 kB] 2024-04-26T10:18:08.479 INFO:teuthology.orchestra.run.smithi052.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1256-gdc093b5e-1focal [7,889 kB] 2024-04-26T10:18:08.647 INFO:teuthology.orchestra.run.smithi120.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1256-gdc093b5e-1focal [24.5 MB] 2024-04-26T10:18:09.064 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 198 MB in 16s (12.6 MB/s) 2024-04-26T10:18:09.103 INFO:teuthology.orchestra.run.smithi052.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1256-gdc093b5e-1focal [13.8 kB] 2024-04-26T10:18:09.103 INFO:teuthology.orchestra.run.smithi052.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1256-gdc093b5e-1focal [46.7 MB] 2024-04-26T10:18:09.186 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-04-26T10:18:09.240 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-04-26T10:18:09.244 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-04-26T10:18:09.317 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-26T10:18:09.662 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T10:18:09.682 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-04-26T10:18:09.720 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-26T10:18:10.090 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T10:18:10.107 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-04-26T10:18:10.148 INFO:teuthology.orchestra.run.smithi120.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1256-gdc093b5e-1focal [13.7 kB] 2024-04-26T10:18:10.148 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-26T10:18:10.149 INFO:teuthology.orchestra.run.smithi120.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1256-gdc093b5e-1focal [853 kB] 2024-04-26T10:18:10.163 INFO:teuthology.orchestra.run.smithi120.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1256-gdc093b5e-1focal [2,291 kB] 2024-04-26T10:18:10.203 INFO:teuthology.orchestra.run.smithi120.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1256-gdc093b5e-1focal [237 kB] 2024-04-26T10:18:10.216 INFO:teuthology.orchestra.run.smithi120.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1256-gdc093b5e-1focal [142 kB] 2024-04-26T10:18:10.221 INFO:teuthology.orchestra.run.smithi120.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1256-gdc093b5e-1focal [7,011 kB] 2024-04-26T10:18:10.560 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T10:18:10.576 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T10:18:10.601 INFO:teuthology.orchestra.run.smithi120.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1256-gdc093b5e-1focal [7,889 kB] 2024-04-26T10:18:10.620 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:18:10.989 INFO:teuthology.orchestra.run.smithi120.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1256-gdc093b5e-1focal [13.8 kB] 2024-04-26T10:18:10.990 INFO:teuthology.orchestra.run.smithi120.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1256-gdc093b5e-1focal [46.7 MB] 2024-04-26T10:18:11.155 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T10:18:11.171 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T10:18:11.213 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:18:11.583 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T10:18:11.602 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T10:18:11.641 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:18:12.011 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-04-26T10:18:12.030 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-04-26T10:18:12.061 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-26T10:18:12.439 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../007-librbd1_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:12.564 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librbd1 (18.2.2-1256-gdc093b5e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-26T10:18:13.262 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../008-librados2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:13.410 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librados2 (18.2.2-1256-gdc093b5e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-26T10:18:13.452 INFO:teuthology.orchestra.run.smithi052.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1256-gdc093b5e-1focal [119 kB] 2024-04-26T10:18:13.455 INFO:teuthology.orchestra.run.smithi052.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1256-gdc093b5e-1focal [37.4 kB] 2024-04-26T10:18:13.457 INFO:teuthology.orchestra.run.smithi052.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1256-gdc093b5e-1focal [13.4 MB] 2024-04-26T10:18:13.742 INFO:teuthology.orchestra.run.smithi120.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1256-gdc093b5e-1focal [119 kB] 2024-04-26T10:18:13.745 INFO:teuthology.orchestra.run.smithi120.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1256-gdc093b5e-1focal [37.4 kB] 2024-04-26T10:18:13.746 INFO:teuthology.orchestra.run.smithi120.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1256-gdc093b5e-1focal [13.4 MB] 2024-04-26T10:18:14.068 INFO:teuthology.orchestra.run.smithi052.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1256-gdc093b5e-1focal [107 kB] 2024-04-26T10:18:14.148 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T10:18:14.164 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../009-libcephfs2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:14.206 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libcephfs2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:14.261 INFO:teuthology.orchestra.run.smithi120.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/reef/dc093b5e41f728edab6e0330295fdf9156d31664/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1256-gdc093b5e-1focal [107 kB] 2024-04-26T10:18:14.542 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rados. 2024-04-26T10:18:14.559 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../010-python3-rados_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:14.600 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rados (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:14.724 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 198 MB in 21s (9,295 kB/s) 2024-04-26T10:18:14.897 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 198 MB in 22s (9,160 kB/s) 2024-04-26T10:18:14.905 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-04-26T10:18:14.961 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-04-26T10:18:14.966 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-04-26T10:18:14.977 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T10:18:14.993 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:15.035 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-ceph-argparse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:15.046 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-26T10:18:15.051 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-04-26T10:18:15.109 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-04-26T10:18:15.113 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-04-26T10:18:15.225 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-26T10:18:15.288 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T10:18:15.306 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../012-python3-cephfs_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:15.346 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cephfs (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:15.416 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T10:18:15.432 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-04-26T10:18:15.474 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-26T10:18:15.579 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T10:18:15.596 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-04-26T10:18:15.637 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-26T10:18:15.649 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T10:18:15.669 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:15.740 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:15.777 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T10:18:15.795 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-04-26T10:18:15.860 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-26T10:18:15.982 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T10:18:15.998 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-04-26T10:18:16.040 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-26T10:18:16.060 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T10:18:16.076 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-04-26T10:18:16.118 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-04-26T10:18:16.331 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T10:18:16.347 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T10:18:16.379 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T10:18:16.395 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../015-python3-rbd_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:16.399 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:18:16.437 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rbd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:16.560 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T10:18:16.577 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T10:18:16.646 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:18:16.807 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-04-26T10:18:16.823 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-04-26T10:18:16.873 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-26T10:18:16.909 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T10:18:16.927 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T10:18:16.967 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:18:17.214 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T10:18:17.230 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T10:18:17.260 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-04-26T10:18:17.272 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:18:17.275 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-04-26T10:18:17.318 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-04-26T10:18:17.345 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T10:18:17.361 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T10:18:17.403 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:18:17.660 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T10:18:17.671 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T10:18:17.678 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T10:18:17.690 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-04-26T10:18:17.718 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:18:17.721 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-26T10:18:17.803 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-04-26T10:18:17.822 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-04-26T10:18:17.864 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-26T10:18:18.057 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package librgw2. 2024-04-26T10:18:18.077 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../019-librgw2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:18.121 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-04-26T10:18:18.140 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-04-26T10:18:18.140 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking librgw2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:18.179 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-26T10:18:18.226 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../007-librbd1_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:18.377 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librbd1 (18.2.2-1256-gdc093b5e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-26T10:18:18.557 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../007-librbd1_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:18.666 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librbd1 (18.2.2-1256-gdc093b5e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-26T10:18:19.018 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T10:18:19.037 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:19.047 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../008-librados2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:19.110 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:19.173 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librados2 (18.2.2-1256-gdc093b5e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-26T10:18:19.429 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../008-librados2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:19.453 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package liboath0. 2024-04-26T10:18:19.471 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-04-26T10:18:19.512 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-04-26T10:18:19.554 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librados2 (18.2.2-1256-gdc093b5e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-26T10:18:19.865 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T10:18:19.885 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:19.923 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libradosstriper1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:19.944 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T10:18:19.960 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../009-libcephfs2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:19.993 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libcephfs2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:20.250 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T10:18:20.266 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../009-libcephfs2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:20.298 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rados. 2024-04-26T10:18:20.300 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcephfs2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:20.319 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../010-python3-rados_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:20.354 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rados (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:20.410 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-common. 2024-04-26T10:18:20.425 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:20.467 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:20.652 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rados. 2024-04-26T10:18:20.671 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../010-python3-rados_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:20.690 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T10:18:20.706 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:20.720 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rados (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:20.748 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-ceph-argparse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:21.034 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T10:18:21.051 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../012-python3-cephfs_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:21.089 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T10:18:21.092 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cephfs (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:21.108 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:21.148 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-ceph-argparse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:21.434 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T10:18:21.450 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../012-python3-cephfs_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:21.462 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T10:18:21.478 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:21.492 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cephfs (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:21.562 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:21.812 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T10:18:21.831 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:21.865 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T10:18:21.870 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:21.881 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-04-26T10:18:21.915 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-04-26T10:18:22.126 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T10:18:22.146 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../015-python3-rbd_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:22.184 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rbd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:22.257 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T10:18:22.276 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-04-26T10:18:22.315 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-04-26T10:18:22.554 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-04-26T10:18:22.574 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-04-26T10:18:22.612 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-26T10:18:22.818 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T10:18:22.836 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../015-python3-rbd_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:22.982 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-04-26T10:18:22.999 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-04-26T10:18:23.039 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-04-26T10:18:23.276 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rbd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:23.301 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T10:18:23.317 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-04-26T10:18:23.368 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-26T10:18:23.557 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-base. 2024-04-26T10:18:23.573 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:23.625 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-base (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:23.712 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package librgw2. 2024-04-26T10:18:23.729 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../019-librgw2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:23.770 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking librgw2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:23.771 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-04-26T10:18:23.788 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-04-26T10:18:23.829 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-26T10:18:24.208 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-04-26T10:18:24.223 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-04-26T10:18:24.291 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-04-26T10:18:24.644 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T10:18:24.661 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-04-26T10:18:24.664 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T10:18:24.682 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:24.702 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-26T10:18:24.722 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:24.877 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T10:18:24.893 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-04-26T10:18:24.935 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-04-26T10:18:25.064 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package librgw2. 2024-04-26T10:18:25.067 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package liboath0. 2024-04-26T10:18:25.083 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../019-librgw2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:25.087 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-04-26T10:18:25.122 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking librgw2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:25.125 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-04-26T10:18:25.314 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T10:18:25.330 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-04-26T10:18:25.372 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-04-26T10:18:25.454 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T10:18:25.471 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:25.511 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libradosstriper1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:25.717 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T10:18:25.736 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-04-26T10:18:25.775 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-04-26T10:18:26.007 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-common. 2024-04-26T10:18:26.024 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:26.033 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T10:18:26.049 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:26.065 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:26.086 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T10:18:26.091 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:26.105 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-04-26T10:18:26.144 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-04-26T10:18:26.447 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-mako. 2024-04-26T10:18:26.466 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-04-26T10:18:26.505 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-26T10:18:26.530 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liboath0. 2024-04-26T10:18:26.547 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-04-26T10:18:26.586 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-04-26T10:18:26.766 INFO:teuthology.orchestra.run.smithi154.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-04-26T10:18:26.834 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T10:18:26.851 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T10:18:26.906 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T10:18:26.917 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T10:18:26.924 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:26.964 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libradosstriper1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:27.219 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T10:18:27.236 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-04-26T10:18:27.278 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-04-26T10:18:27.417 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-common. 2024-04-26T10:18:27.436 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:27.500 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:27.614 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-webob. 2024-04-26T10:18:27.631 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2024-04-26T10:18:27.664 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-04-26T10:18:27.992 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-soupsieve. 2024-04-26T10:18:28.008 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-04-26T10:18:28.050 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-26T10:18:28.377 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-bs4. 2024-04-26T10:18:28.393 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-04-26T10:18:28.436 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-04-26T10:18:28.804 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T10:18:28.823 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-04-26T10:18:28.854 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-base. 2024-04-26T10:18:28.860 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-26T10:18:28.871 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:28.922 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-base (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:29.186 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T10:18:29.203 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-04-26T10:18:29.244 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-04-26T10:18:29.580 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-paste. 2024-04-26T10:18:29.596 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-04-26T10:18:29.638 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-04-26T10:18:29.990 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-base. 2024-04-26T10:18:30.000 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T10:18:30.006 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:30.016 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-04-26T10:18:30.058 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-base (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:30.058 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-04-26T10:18:30.209 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T10:18:30.227 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-04-26T10:18:30.267 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-04-26T10:18:30.362 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T10:18:30.381 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-04-26T10:18:30.419 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-04-26T10:18:30.620 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T10:18:30.637 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-04-26T10:18:30.670 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-04-26T10:18:30.747 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T10:18:30.766 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-04-26T10:18:30.805 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-04-26T10:18:30.998 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T10:18:31.018 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-04-26T10:18:31.056 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-04-26T10:18:31.125 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T10:18:31.141 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-04-26T10:18:31.209 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-04-26T10:18:31.334 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T10:18:31.350 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-04-26T10:18:31.378 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T10:18:31.392 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-04-26T10:18:31.396 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-04-26T10:18:31.461 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-04-26T10:18:31.563 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T10:18:31.582 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-04-26T10:18:31.621 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-26T10:18:31.720 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-mako. 2024-04-26T10:18:31.737 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-04-26T10:18:31.778 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-26T10:18:31.798 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T10:18:31.814 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-04-26T10:18:31.848 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-04-26T10:18:31.924 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T10:18:31.943 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:31.983 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:32.140 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T10:18:32.159 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T10:18:32.160 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T10:18:32.177 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-04-26T10:18:32.198 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T10:18:32.218 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-04-26T10:18:32.337 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T10:18:32.358 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:32.374 INFO:teuthology.orchestra.run.smithi154.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-26T10:18:32.396 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:32.501 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T10:18:32.520 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-04-26T10:18:32.546 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T10:18:32.559 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-04-26T10:18:32.562 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-04-26T10:18:32.604 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-04-26T10:18:32.726 INFO:teuthology.orchestra.run.smithi154.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-26T10:18:32.757 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T10:18:32.773 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../045-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-04-26T10:18:32.815 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-26T10:18:32.854 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-webob. 2024-04-26T10:18:32.870 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2024-04-26T10:18:32.891 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-mako. 2024-04-26T10:18:32.909 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-04-26T10:18:32.912 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-04-26T10:18:32.941 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-26T10:18:33.048 INFO:teuthology.orchestra.run.smithi154.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-04-26T10:18:33.143 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cryptography. 2024-04-26T10:18:33.162 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../046-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-04-26T10:18:33.201 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-26T10:18:33.223 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-soupsieve. 2024-04-26T10:18:33.239 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-04-26T10:18:33.281 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-26T10:18:33.319 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T10:18:33.335 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T10:18:33.346 INFO:teuthology.orchestra.run.smithi154.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-04-26T10:18:33.346 INFO:teuthology.orchestra.run.smithi154.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-04-26T10:18:33.349 INFO:teuthology.orchestra.run.smithi154.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-04-26T10:18:33.351 INFO:teuthology.orchestra.run.smithi154.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-04-26T10:18:33.352 INFO:teuthology.orchestra.run.smithi154.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-04-26T10:18:33.355 INFO:teuthology.orchestra.run.smithi154.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-04-26T10:18:33.355 INFO:teuthology.orchestra.run.smithi154.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-04-26T10:18:33.360 INFO:teuthology.orchestra.run.smithi154.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-04-26T10:18:33.361 INFO:teuthology.orchestra.run.smithi154.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-04-26T10:18:33.394 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T10:18:33.531 INFO:teuthology.orchestra.run.smithi154.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-04-26T10:18:33.572 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T10:18:33.588 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../047-python3-openssl_19.0.0-1build1_all.deb ... 2024-04-26T10:18:33.626 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-bs4. 2024-04-26T10:18:33.647 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-04-26T10:18:33.655 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-04-26T10:18:33.684 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-04-26T10:18:33.697 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T10:18:33.716 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-04-26T10:18:33.747 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-04-26T10:18:33.991 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T10:18:34.004 INFO:teuthology.orchestra.run.smithi154.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-04-26T10:18:34.010 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../048-ceph-mgr_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:34.036 INFO:teuthology.orchestra.run.smithi154.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-04-26T10:18:34.050 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:34.062 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T10:18:34.064 INFO:teuthology.orchestra.run.smithi154.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-04-26T10:18:34.078 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-04-26T10:18:34.083 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-webob. 2024-04-26T10:18:34.092 INFO:teuthology.orchestra.run.smithi154.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-04-26T10:18:34.099 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2024-04-26T10:18:34.123 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-26T10:18:34.141 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-04-26T10:18:34.160 INFO:teuthology.orchestra.run.smithi154.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-04-26T10:18:34.190 INFO:teuthology.orchestra.run.smithi154.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-04-26T10:18:34.326 INFO:teuthology.orchestra.run.smithi154.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-04-26T10:18:34.338 INFO:teuthology.orchestra.run.smithi154.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-04-26T10:18:34.346 INFO:teuthology.orchestra.run.smithi154.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-04-26T10:18:34.449 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T10:18:34.466 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-04-26T10:18:34.503 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T10:18:34.503 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-soupsieve. 2024-04-26T10:18:34.507 INFO:teuthology.orchestra.run.smithi154.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-04-26T10:18:34.515 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-04-26T10:18:34.522 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../049-ceph-mon_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:34.523 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-04-26T10:18:34.562 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-26T10:18:34.586 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mon (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:34.673 INFO:teuthology.orchestra.run.smithi154.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-04-26T10:18:34.756 INFO:teuthology.orchestra.run.smithi154.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-04-26T10:18:34.827 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-paste. 2024-04-26T10:18:34.847 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-04-26T10:18:34.885 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-04-26T10:18:34.889 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-bs4. 2024-04-26T10:18:34.906 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-04-26T10:18:34.947 INFO:teuthology.orchestra.run.smithi154.stdout:Get:107 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-04-26T10:18:34.948 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-04-26T10:18:35.213 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T10:18:35.229 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-04-26T10:18:35.271 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-04-26T10:18:35.280 INFO:teuthology.orchestra.run.smithi154.stdout:Get:108 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-26T10:18:35.287 INFO:teuthology.orchestra.run.smithi154.stdout:Get:109 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-04-26T10:18:35.294 INFO:teuthology.orchestra.run.smithi154.stdout:Get:110 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-04-26T10:18:35.296 INFO:teuthology.orchestra.run.smithi154.stdout:Get:111 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-04-26T10:18:35.299 INFO:teuthology.orchestra.run.smithi154.stdout:Get:112 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-04-26T10:18:35.318 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T10:18:35.336 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-04-26T10:18:35.379 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-26T10:18:35.573 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T10:18:35.589 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../050-ceph-osd_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:35.599 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T10:18:35.616 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-04-26T10:18:35.631 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-osd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:35.657 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-04-26T10:18:35.730 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T10:18:35.748 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-04-26T10:18:35.788 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-04-26T10:18:35.946 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T10:18:35.962 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-04-26T10:18:36.016 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 198 MB in 43s (4,638 kB/s) 2024-04-26T10:18:36.037 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-04-26T10:18:36.108 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-paste. 2024-04-26T10:18:36.124 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-04-26T10:18:36.166 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-04-26T10:18:36.190 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-04-26T10:18:36.247 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-04-26T10:18:36.251 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-04-26T10:18:36.348 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T10:18:36.355 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-26T10:18:36.367 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-04-26T10:18:36.406 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-04-26T10:18:36.478 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T10:18:36.495 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-04-26T10:18:36.527 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-04-26T10:18:36.700 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-26T10:18:36.719 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-04-26T10:18:36.758 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-26T10:18:36.786 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T10:18:36.802 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-04-26T10:18:36.844 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-26T10:18:36.864 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T10:18:36.881 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-04-26T10:18:36.955 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-04-26T10:18:37.087 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-26T10:18:37.105 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-04-26T10:18:37.145 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-26T10:18:37.180 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T10:18:37.197 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:37.238 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:37.284 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T10:18:37.301 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-04-26T10:18:37.342 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-04-26T10:18:37.687 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T10:18:37.703 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-04-26T10:18:37.735 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T10:18:37.745 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-04-26T10:18:37.754 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:37.840 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-26T10:18:37.860 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T10:18:37.868 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph. 2024-04-26T10:18:37.885 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../051-ceph_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:37.909 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:18:37.946 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:37.951 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:38.142 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T10:18:38.158 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-04-26T10:18:38.234 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-26T10:18:38.245 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T10:18:38.265 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../052-ceph-fuse_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:38.295 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:38.296 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T10:18:38.313 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../045-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-04-26T10:18:38.371 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-26T10:18:38.477 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-26T10:18:38.494 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T10:18:38.535 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:18:38.554 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T10:18:38.570 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:38.612 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:38.707 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cryptography. 2024-04-26T10:18:38.724 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../046-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-04-26T10:18:38.732 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T10:18:38.751 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../053-ceph-mds_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:38.765 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-26T10:18:38.790 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mds (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:38.914 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-26T10:18:38.931 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-26T10:18:38.989 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:18:39.169 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T10:18:39.185 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../047-python3-openssl_19.0.0-1build1_all.deb ... 2024-04-26T10:18:39.226 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-04-26T10:18:39.268 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package cephadm. 2024-04-26T10:18:39.286 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../054-cephadm_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:39.318 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:39.341 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-04-26T10:18:39.357 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-04-26T10:18:39.384 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T10:18:39.392 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-26T10:18:39.401 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:39.442 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:39.563 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T10:18:39.583 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../048-ceph-mgr_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:39.621 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:39.654 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T10:18:39.671 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../055-python3-asyncssh_1.12.2-1_all.deb ... 2024-04-26T10:18:39.712 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-04-26T10:18:39.789 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../007-librbd1_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:39.804 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T10:18:39.821 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../045-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-04-26T10:18:39.862 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-26T10:18:39.912 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librbd1 (18.2.2-1256-gdc093b5e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-26T10:18:40.082 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T10:18:40.102 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-04-26T10:18:40.107 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T10:18:40.125 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../049-ceph-mon_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:40.140 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-26T10:18:40.165 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mon (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:40.182 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cryptography. 2024-04-26T10:18:40.198 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../046-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-04-26T10:18:40.273 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-26T10:18:40.477 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T10:18:40.492 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:40.535 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:40.640 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../008-librados2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:40.652 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T10:18:40.669 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../047-python3-openssl_19.0.0-1build1_all.deb ... 2024-04-26T10:18:40.710 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-04-26T10:18:40.783 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librados2 (18.2.2-1256-gdc093b5e-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-26T10:18:40.896 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-jwt. 2024-04-26T10:18:40.913 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-04-26T10:18:40.954 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-26T10:18:41.072 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T10:18:41.092 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../048-ceph-mgr_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:41.130 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:41.152 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T10:18:41.169 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../050-ceph-osd_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:41.210 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-osd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:41.299 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-attr. 2024-04-26T10:18:41.318 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-04-26T10:18:41.357 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-04-26T10:18:41.512 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs2. 2024-04-26T10:18:41.528 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../009-libcephfs2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:41.570 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:41.642 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T10:18:41.658 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../049-ceph-mon_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:41.685 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T10:18:41.700 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mon (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:41.701 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-04-26T10:18:41.775 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-04-26T10:18:41.923 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rados. 2024-04-26T10:18:41.939 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../010-python3-rados_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:42.006 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rados (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:42.088 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-py. 2024-04-26T10:18:42.106 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-04-26T10:18:42.146 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-04-26T10:18:42.342 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-26T10:18:42.361 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:42.392 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-argparse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:42.491 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-atomicwrites. 2024-04-26T10:18:42.510 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-04-26T10:18:42.541 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-04-26T10:18:42.638 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cephfs. 2024-04-26T10:18:42.646 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T10:18:42.654 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../012-python3-cephfs_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:42.664 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../050-ceph-osd_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:42.704 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-osd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:42.713 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cephfs (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:42.860 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-packaging. 2024-04-26T10:18:42.876 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-04-26T10:18:42.918 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-packaging (20.3-1) ... 2024-04-26T10:18:43.074 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-26T10:18:43.091 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:43.132 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:43.254 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T10:18:43.272 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-04-26T10:18:43.312 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-26T10:18:43.468 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-prettytable. 2024-04-26T10:18:43.489 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-04-26T10:18:43.497 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph. 2024-04-26T10:18:43.513 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../051-ceph_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:43.526 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-04-26T10:18:43.572 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:43.657 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T10:18:43.677 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-04-26T10:18:43.732 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-04-26T10:18:43.754 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rbd. 2024-04-26T10:18:43.771 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../015-python3-rbd_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:43.804 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rbd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:43.891 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T10:18:43.908 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../052-ceph-fuse_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:43.949 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:44.083 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T10:18:44.100 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T10:18:44.140 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-04-26T10:18:44.158 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-04-26T10:18:44.164 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T10:18:44.198 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-26T10:18:44.377 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T10:18:44.393 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../053-ceph-mds_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:44.420 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libjs-underscore. 2024-04-26T10:18:44.437 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-04-26T10:18:44.443 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mds (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:44.478 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-26T10:18:44.584 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-04-26T10:18:44.600 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-04-26T10:18:44.665 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-04-26T10:18:44.772 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-04-26T10:18:44.790 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-04-26T10:18:44.830 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-26T10:18:44.899 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph. 2024-04-26T10:18:44.917 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../051-ceph_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:44.955 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package cephadm. 2024-04-26T10:18:44.957 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:44.971 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-26T10:18:44.974 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../054-cephadm_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:44.990 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-04-26T10:18:45.029 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:45.054 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-26T10:18:45.175 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-routes. 2024-04-26T10:18:45.191 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-04-26T10:18:45.233 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-04-26T10:18:45.319 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T10:18:45.337 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../052-ceph-fuse_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:45.349 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T10:18:45.365 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../055-python3-asyncssh_1.12.2-1_all.deb ... 2024-04-26T10:18:45.365 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librgw2. 2024-04-26T10:18:45.377 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:45.385 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../019-librgw2_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:45.407 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-04-26T10:18:45.415 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librgw2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:45.570 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T10:18:45.585 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:45.652 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:45.801 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T10:18:45.818 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-04-26T10:18:45.839 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T10:18:45.856 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../053-ceph-mds_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:45.859 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-26T10:18:45.897 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mds (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:46.238 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T10:18:46.254 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:46.292 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rgw. 2024-04-26T10:18:46.295 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:46.310 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:46.351 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:46.483 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package cephadm. 2024-04-26T10:18:46.502 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../054-cephadm_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:46.541 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:46.691 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-jwt. 2024-04-26T10:18:46.707 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-04-26T10:18:46.748 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-26T10:18:46.779 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liboath0. 2024-04-26T10:18:46.798 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-04-26T10:18:46.837 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-04-26T10:18:46.903 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T10:18:46.923 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../055-python3-asyncssh_1.12.2-1_all.deb ... 2024-04-26T10:18:46.961 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-04-26T10:18:47.051 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-attr. 2024-04-26T10:18:47.068 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-04-26T10:18:47.083 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-decorator. 2024-04-26T10:18:47.101 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-04-26T10:18:47.102 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-04-26T10:18:47.141 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-04-26T10:18:47.148 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libradosstriper1. 2024-04-26T10:18:47.164 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:47.198 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libradosstriper1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:47.339 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T10:18:47.357 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-04-26T10:18:47.397 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-26T10:18:47.429 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T10:18:47.444 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-04-26T10:18:47.446 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-04-26T10:18:47.460 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-04-26T10:18:47.487 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-04-26T10:18:47.523 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-26T10:18:47.676 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-common. 2024-04-26T10:18:47.694 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:47.767 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T10:18:47.768 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:47.788 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:47.815 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-py. 2024-04-26T10:18:47.825 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:47.833 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-04-26T10:18:47.838 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-scipy. 2024-04-26T10:18:47.856 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-04-26T10:18:47.873 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-04-26T10:18:47.888 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-04-26T10:18:48.196 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-jwt. 2024-04-26T10:18:48.216 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-04-26T10:18:48.254 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-26T10:18:48.276 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-atomicwrites. 2024-04-26T10:18:48.293 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-04-26T10:18:48.334 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-04-26T10:18:48.582 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-attr. 2024-04-26T10:18:48.598 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-04-26T10:18:48.640 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-04-26T10:18:48.662 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-packaging. 2024-04-26T10:18:48.678 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-04-26T10:18:48.720 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-packaging (20.3-1) ... 2024-04-26T10:18:48.981 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T10:18:48.985 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T10:18:49.002 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-04-26T10:18:49.004 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-04-26T10:18:49.069 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-04-26T10:18:49.072 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-26T10:18:49.252 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-04-26T10:18:49.269 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-04-26T10:18:49.308 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-26T10:18:49.375 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T10:18:49.393 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-04-26T10:18:49.433 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-04-26T10:18:49.488 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-py. 2024-04-26T10:18:49.506 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-04-26T10:18:49.546 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-04-26T10:18:49.787 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T10:18:49.806 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T10:18:49.844 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T10:18:49.854 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T10:18:49.874 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-04-26T10:18:49.900 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-atomicwrites. 2024-04-26T10:18:49.917 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-04-26T10:18:49.937 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-04-26T10:18:49.958 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-04-26T10:18:50.151 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libjs-underscore. 2024-04-26T10:18:50.168 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-04-26T10:18:50.209 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-26T10:18:50.286 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-packaging. 2024-04-26T10:18:50.290 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T10:18:50.302 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-04-26T10:18:50.307 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-04-26T10:18:50.339 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-base. 2024-04-26T10:18:50.348 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-26T10:18:50.355 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:50.377 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-packaging (20.3-1) ... 2024-04-26T10:18:50.417 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-base (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:50.510 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-04-26T10:18:50.531 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-04-26T10:18:50.570 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-26T10:18:50.714 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T10:18:50.730 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-04-26T10:18:50.772 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-26T10:18:50.881 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-routes. 2024-04-26T10:18:50.898 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-04-26T10:18:50.939 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-04-26T10:18:51.108 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T10:18:51.109 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T10:18:51.124 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:51.125 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-04-26T10:18:51.166 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:51.167 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-04-26T10:18:51.259 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T10:18:51.279 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:51.308 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:51.606 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T10:18:51.622 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T10:18:51.689 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T10:18:51.727 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-26T10:18:51.743 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-04-26T10:18:51.785 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-04-26T10:18:51.925 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libjs-underscore. 2024-04-26T10:18:51.942 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-04-26T10:18:52.017 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-26T10:18:52.180 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-natsort. 2024-04-26T10:18:52.197 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-04-26T10:18:52.236 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T10:18:52.238 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-04-26T10:18:52.252 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-04-26T10:18:52.285 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-04-26T10:18:52.319 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-04-26T10:18:52.339 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-04-26T10:18:52.377 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-26T10:18:52.558 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-logutils. 2024-04-26T10:18:52.577 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-04-26T10:18:52.597 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T10:18:52.613 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-04-26T10:18:52.616 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-04-26T10:18:52.655 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-04-26T10:18:52.714 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-decorator. 2024-04-26T10:18:52.714 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-routes. 2024-04-26T10:18:52.730 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-04-26T10:18:52.731 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-04-26T10:18:52.772 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-04-26T10:18:52.772 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-04-26T10:18:52.961 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-26T10:18:52.977 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-04-26T10:18:53.000 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T10:18:53.017 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-04-26T10:18:53.019 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-04-26T10:18:53.058 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-26T10:18:53.066 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-04-26T10:18:53.085 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-04-26T10:18:53.116 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-26T10:18:53.134 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T10:18:53.150 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:53.192 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:53.364 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-mako. 2024-04-26T10:18:53.380 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-04-26T10:18:53.422 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-26T10:18:53.427 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-scipy. 2024-04-26T10:18:53.444 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-04-26T10:18:53.485 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-04-26T10:18:53.505 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T10:18:53.523 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-04-26T10:18:53.563 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-rsa (4.0-3) ... 2024-04-26T10:18:53.783 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-26T10:18:53.799 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-26T10:18:53.841 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-26T10:18:54.092 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T10:18:54.108 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-04-26T10:18:54.142 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-04-26T10:18:54.169 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-26T10:18:54.186 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-04-26T10:18:54.244 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-04-26T10:18:54.454 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-blinker. 2024-04-26T10:18:54.472 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-04-26T10:18:54.512 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-26T10:18:54.580 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webob. 2024-04-26T10:18:54.596 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2024-04-26T10:18:54.632 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-decorator. 2024-04-26T10:18:54.638 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-04-26T10:18:54.648 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-04-26T10:18:54.689 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-04-26T10:18:54.831 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-04-26T10:18:54.840 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-oauthlib. 2024-04-26T10:18:54.849 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-04-26T10:18:54.857 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-04-26T10:18:54.889 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-26T10:18:54.898 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-26T10:18:55.030 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-04-26T10:18:55.041 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-soupsieve. 2024-04-26T10:18:55.049 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-04-26T10:18:55.061 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-04-26T10:18:55.088 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-26T10:18:55.099 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-26T10:18:55.236 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T10:18:55.252 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-04-26T10:18:55.319 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-26T10:18:55.425 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T10:18:55.441 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-scipy. 2024-04-26T10:18:55.442 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-04-26T10:18:55.444 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-bs4. 2024-04-26T10:18:55.458 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-04-26T10:18:55.459 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-04-26T10:18:55.499 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-04-26T10:18:55.502 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-04-26T10:18:55.507 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-04-26T10:18:55.598 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T10:18:55.615 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-04-26T10:18:55.648 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-04-26T10:18:55.880 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-waitress. 2024-04-26T10:18:55.898 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-04-26T10:18:55.903 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T10:18:55.919 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-04-26T10:18:55.962 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-26T10:18:55.984 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-26T10:18:55.985 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T10:18:56.001 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-04-26T10:18:56.043 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-04-26T10:18:56.283 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempita. 2024-04-26T10:18:56.300 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-04-26T10:18:56.358 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-04-26T10:18:56.590 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T10:18:56.606 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:56.648 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:56.686 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-paste. 2024-04-26T10:18:56.686 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T10:18:56.702 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-04-26T10:18:56.703 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:56.744 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:56.744 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-04-26T10:18:56.901 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-04-26T10:18:56.918 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-04-26T10:18:56.958 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-26T10:18:57.009 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T10:18:57.028 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-04-26T10:18:57.056 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-26T10:18:57.058 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-04-26T10:18:57.074 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-04-26T10:18:57.114 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-04-26T10:18:57.445 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T10:18:57.450 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-26T10:18:57.462 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-26T10:18:57.466 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-04-26T10:18:57.503 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-26T10:18:57.508 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-04-26T10:18:57.563 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T10:18:57.581 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-04-26T10:18:57.620 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-04-26T10:18:57.806 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package jq. 2024-04-26T10:18:57.824 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-26T10:18:57.853 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webtest. 2024-04-26T10:18:57.864 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-04-26T10:18:57.868 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-04-26T10:18:57.897 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T10:18:57.911 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-04-26T10:18:57.914 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-04-26T10:18:57.955 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-04-26T10:18:57.967 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T10:18:57.983 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-04-26T10:18:58.017 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-26T10:18:58.100 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package socat. 2024-04-26T10:18:58.116 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-04-26T10:18:58.181 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking socat (1.7.3.3-2) ... 2024-04-26T10:18:58.256 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pecan. 2024-04-26T10:18:58.274 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-04-26T10:18:58.291 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T10:18:58.309 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-04-26T10:18:58.314 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-04-26T10:18:58.349 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-04-26T10:18:58.512 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T10:18:58.528 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-04-26T10:18:58.570 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-04-26T10:18:58.702 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T10:18:58.705 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-26T10:18:58.719 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-04-26T10:18:58.725 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-04-26T10:18:58.760 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-26T10:18:58.768 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-26T10:18:58.793 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T10:18:58.809 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:58.851 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:58.916 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-test. 2024-04-26T10:18:58.932 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../094-ceph-test_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:58.974 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-test (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:59.088 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-26T10:18:59.107 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:18:59.146 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:59.182 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T10:18:59.199 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-04-26T10:18:59.240 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-rsa (4.0-3) ... 2024-04-26T10:18:59.534 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-26T10:18:59.551 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:18:59.586 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T10:18:59.592 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:18:59.602 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-04-26T10:18:59.644 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-04-26T10:18:59.954 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-26T10:18:59.954 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T10:18:59.970 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-04-26T10:18:59.971 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../045-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-04-26T10:18:59.973 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-blinker. 2024-04-26T10:18:59.989 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-04-26T10:19:00.003 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-04-26T10:19:00.031 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-26T10:19:00.037 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-26T10:19:00.324 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T10:19:00.344 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-04-26T10:19:00.348 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cryptography. 2024-04-26T10:19:00.359 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-oauthlib. 2024-04-26T10:19:00.364 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../046-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-04-26T10:19:00.375 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-04-26T10:19:00.407 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-04-26T10:19:00.414 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-26T10:19:00.416 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-26T10:19:00.760 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T10:19:00.770 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T10:19:00.777 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-04-26T10:19:00.791 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-04-26T10:19:00.810 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-openssl. 2024-04-26T10:19:00.818 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-26T10:19:00.827 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../047-python3-openssl_19.0.0-1build1_all.deb ... 2024-04-26T10:19:00.828 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-26T10:19:00.868 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-04-26T10:19:01.182 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T10:19:01.198 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-04-26T10:19:01.225 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T10:19:01.238 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr. 2024-04-26T10:19:01.239 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-04-26T10:19:01.241 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-04-26T10:19:01.255 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../048-ceph-mgr_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:01.274 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-rsa (4.0-3) ... 2024-04-26T10:19:01.296 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:01.561 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T10:19:01.577 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-04-26T10:19:01.595 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T10:19:01.616 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-04-26T10:19:01.643 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-04-26T10:19:01.687 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-04-26T10:19:01.808 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mon. 2024-04-26T10:19:01.826 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../049-ceph-mon_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:01.866 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mon (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:02.041 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-blinker. 2024-04-26T10:19:02.058 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-04-26T10:19:02.099 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-26T10:19:02.190 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T10:19:02.206 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:19:02.248 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:02.437 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-oauthlib. 2024-04-26T10:19:02.454 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-04-26T10:19:02.495 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-26T10:19:02.576 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T10:19:02.593 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-04-26T10:19:02.651 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-04-26T10:19:02.836 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-osd. 2024-04-26T10:19:02.854 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../050-ceph-osd_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:02.866 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T10:19:02.882 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-04-26T10:19:02.894 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-osd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:02.949 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-26T10:19:03.004 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T10:19:03.021 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-26T10:19:03.062 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-26T10:19:03.137 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T10:19:03.155 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../095-ceph-volume_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:19:03.195 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking ceph-volume (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:03.261 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T10:19:03.280 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-04-26T10:19:03.310 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-04-26T10:19:03.356 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package jq. 2024-04-26T10:19:03.373 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-26T10:19:03.414 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-04-26T10:19:03.515 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package fonts-mathjax. 2024-04-26T10:19:03.532 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-26T10:19:03.573 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-26T10:19:03.597 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T10:19:03.614 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-04-26T10:19:03.656 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-04-26T10:19:03.709 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package socat. 2024-04-26T10:19:03.727 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-04-26T10:19:03.767 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking socat (1.7.3.3-2) ... 2024-04-26T10:19:04.078 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T10:19:04.097 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-04-26T10:19:04.104 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T10:19:04.122 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:04.144 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-04-26T10:19:04.162 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libcephfs-dev (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:04.286 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T10:19:04.305 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:19:04.344 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:04.457 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-test. 2024-04-26T10:19:04.476 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../094-ceph-test_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:04.515 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-test (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:04.574 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T10:19:04.590 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-04-26T10:19:04.649 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-04-26T10:19:04.722 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T10:19:04.738 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-04-26T10:19:04.780 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-04-26T10:19:04.988 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T10:19:05.007 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-04-26T10:19:05.046 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-04-26T10:19:05.122 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph. 2024-04-26T10:19:05.141 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../051-ceph_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:05.167 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T10:19:05.180 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:05.183 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-26T10:19:05.259 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-26T10:19:05.424 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libjs-mathjax. 2024-04-26T10:19:05.441 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-26T10:19:05.482 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-26T10:19:05.550 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-fuse. 2024-04-26T10:19:05.562 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package jq. 2024-04-26T10:19:05.567 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../052-ceph-fuse_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:05.581 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-26T10:19:05.608 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:05.620 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-04-26T10:19:05.923 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package socat. 2024-04-26T10:19:05.944 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-04-26T10:19:05.981 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking socat (1.7.3.3-2) ... 2024-04-26T10:19:06.061 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mds. 2024-04-26T10:19:06.077 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../053-ceph-mds_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:06.152 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mds (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:06.319 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T10:19:06.336 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-04-26T10:19:06.376 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-04-26T10:19:06.714 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephadm. 2024-04-26T10:19:06.731 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../054-cephadm_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:06.764 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-test. 2024-04-26T10:19:06.771 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:06.782 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../094-ceph-test_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:06.849 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-test (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:07.133 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-26T10:19:07.152 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../055-python3-asyncssh_1.12.2-1_all.deb ... 2024-04-26T10:19:07.181 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python-natsort-doc. 2024-04-26T10:19:07.199 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-04-26T10:19:07.202 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-04-26T10:19:07.239 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-04-26T10:19:07.585 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jinja2. 2024-04-26T10:19:07.594 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-webencodings. 2024-04-26T10:19:07.602 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-04-26T10:19:07.612 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-04-26T10:19:07.646 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-26T10:19:07.652 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-26T10:19:07.989 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-html5lib. 2024-04-26T10:19:08.005 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-26T10:19:08.010 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-04-26T10:19:08.020 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:19:08.047 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-04-26T10:19:08.063 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:08.417 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-04-26T10:19:08.434 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-04-26T10:19:08.475 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-26T10:19:08.974 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T10:19:08.995 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T10:19:09.008 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jwt. 2024-04-26T10:19:09.024 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-04-26T10:19:09.032 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T10:19:09.036 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T10:19:09.054 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../095-ceph-volume_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:19:09.066 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-26T10:19:09.094 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking ceph-volume (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:09.373 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package fonts-mathjax. 2024-04-26T10:19:09.377 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-attr. 2024-04-26T10:19:09.390 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-26T10:19:09.397 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-04-26T10:19:09.431 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-26T10:19:09.435 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-04-26T10:19:09.469 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T10:19:09.489 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-04-26T10:19:09.560 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-04-26T10:19:09.780 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pluggy. 2024-04-26T10:19:09.798 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-04-26T10:19:09.838 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-04-26T10:19:09.913 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T10:19:09.929 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-04-26T10:19:09.959 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T10:19:09.971 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-26T10:19:09.980 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:10.034 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libcephfs-dev (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:10.183 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-py. 2024-04-26T10:19:10.199 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-04-26T10:19:10.241 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-04-26T10:19:10.276 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T10:19:10.293 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-04-26T10:19:10.351 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-26T10:19:10.420 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T10:19:10.438 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-04-26T10:19:10.521 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-04-26T10:19:10.586 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-atomicwrites. 2024-04-26T10:19:10.595 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T10:19:10.602 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-04-26T10:19:10.615 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-04-26T10:19:10.653 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-26T10:19:10.674 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-04-26T10:19:10.842 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T10:19:10.859 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-04-26T10:19:10.892 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-04-26T10:19:11.019 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-packaging. 2024-04-26T10:19:11.036 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-04-26T10:19:11.053 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T10:19:11.070 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../095-ceph-volume_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:19:11.077 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-packaging (20.3-1) ... 2024-04-26T10:19:11.110 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking ceph-volume (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:11.262 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libjs-mathjax. 2024-04-26T10:19:11.280 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-26T10:19:11.319 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-26T10:19:11.349 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package radosgw. 2024-04-26T10:19:11.366 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../110-radosgw_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:11.405 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-26T10:19:11.406 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package fonts-mathjax. 2024-04-26T10:19:11.407 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking radosgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:11.422 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-04-26T10:19:11.425 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-26T10:19:11.463 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-26T10:19:11.506 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-26T10:19:11.774 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pytest. 2024-04-26T10:19:11.793 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-04-26T10:19:11.832 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-04-26T10:19:12.077 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T10:19:12.097 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:12.170 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libcephfs-dev (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:12.186 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-26T10:19:12.205 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-04-26T10:19:12.244 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-26T10:19:12.538 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjs-underscore. 2024-04-26T10:19:12.557 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-04-26T10:19:12.581 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T10:19:12.596 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-26T10:19:12.597 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-04-26T10:19:12.656 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-04-26T10:19:12.810 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T10:19:12.828 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../111-rbd-fuse_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:12.869 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking rbd-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:12.907 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-04-26T10:19:12.924 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-04-26T10:19:12.965 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-26T10:19:13.002 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T10:19:13.020 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-04-26T10:19:13.060 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-04-26T10:19:13.113 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python-natsort-doc. 2024-04-26T10:19:13.135 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-04-26T10:19:13.168 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-attr (19.3.0-2) ... 2024-04-26T10:19:13.171 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-04-26T10:19:13.310 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-routes. 2024-04-26T10:19:13.329 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-04-26T10:19:13.368 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-04-26T10:19:13.464 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libjs-mathjax. 2024-04-26T10:19:13.481 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-04-26T10:19:13.484 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-26T10:19:13.516 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-webencodings. 2024-04-26T10:19:13.522 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-26T10:19:13.536 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-04-26T10:19:13.574 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-26T10:19:13.607 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-26T10:19:13.713 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-26T10:19:13.733 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:19:13.742 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-04-26T10:19:13.804 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:13.905 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-html5lib. 2024-04-26T10:19:13.918 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:13.924 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-04-26T10:19:13.963 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-04-26T10:19:14.307 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-04-26T10:19:14.328 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-04-26T10:19:14.365 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-26T10:19:14.478 INFO:teuthology.orchestra.run.smithi164.stdout:Adding system user cephadm....done 2024-04-26T10:19:14.658 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-26T10:19:14.809 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-26T10:19:14.844 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T10:19:14.864 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T10:19:14.902 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T10:19:15.169 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T10:19:15.251 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T10:19:15.255 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-decorator. 2024-04-26T10:19:15.267 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-04-26T10:19:15.271 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-04-26T10:19:15.290 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python-natsort-doc. 2024-04-26T10:19:15.307 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-04-26T10:19:15.310 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-04-26T10:19:15.313 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-04-26T10:19:15.348 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-04-26T10:19:15.470 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-26T10:19:15.621 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-04-26T10:19:15.640 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-04-26T10:19:15.656 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-04-26T10:19:15.669 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T10:19:15.687 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-04-26T10:19:15.698 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-26T10:19:15.727 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-26T10:19:15.743 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-webencodings. 2024-04-26T10:19:15.747 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-04-26T10:19:15.764 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-04-26T10:19:15.801 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-26T10:19:16.050 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-scipy. 2024-04-26T10:19:16.066 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T10:19:16.067 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-04-26T10:19:16.082 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-04-26T10:19:16.091 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-html5lib. 2024-04-26T10:19:16.099 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-04-26T10:19:16.110 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-04-26T10:19:16.121 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-26T10:19:16.140 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-04-26T10:19:16.141 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-04-26T10:19:16.392 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T10:19:16.410 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-04-26T10:19:16.467 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-26T10:19:16.501 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-26T10:19:16.546 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-04-26T10:19:16.563 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-04-26T10:19:16.604 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-26T10:19:16.836 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-04-26T10:19:17.115 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T10:19:17.129 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package radosgw. 2024-04-26T10:19:17.132 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T10:19:17.145 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-26T10:19:17.149 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../110-radosgw_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:17.187 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking radosgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:17.198 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T10:19:17.430 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-26T10:19:17.484 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-04-26T10:19:17.502 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-04-26T10:19:17.542 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-26T10:19:17.554 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T10:19:17.571 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-04-26T10:19:17.612 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-04-26T10:19:17.756 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-ceph-argparse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:17.973 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T10:19:17.990 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-04-26T10:19:18.031 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-26T10:19:18.057 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-26T10:19:18.138 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-joblib. 2024-04-26T10:19:18.154 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-04-26T10:19:18.166 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-04-26T10:19:18.196 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-04-26T10:19:18.376 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T10:19:18.392 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-04-26T10:19:18.459 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-26T10:19:18.492 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-26T10:19:18.549 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn. 2024-04-26T10:19:18.569 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-04-26T10:19:18.607 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-26T10:19:18.632 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T10:19:18.652 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../111-rbd-fuse_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:18.690 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking rbd-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:18.752 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-26T10:19:18.766 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T10:19:18.785 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-04-26T10:19:18.836 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-26T10:19:18.853 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-04-26T10:19:19.024 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-attr (19.3.0-2) ... 2024-04-26T10:19:19.262 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-04-26T10:19:19.324 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-26T10:19:19.340 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:19:19.345 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-04-26T10:19:19.407 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:19.504 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-26T10:19:19.523 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package radosgw. 2024-04-26T10:19:19.544 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../110-radosgw_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:19.555 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-04-26T10:19:19.581 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking radosgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:19.630 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-04-26T10:19:19.831 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:19.857 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-26T10:19:20.224 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-04-26T10:19:20.433 INFO:teuthology.orchestra.run.smithi052.stdout:Adding system user cephadm....done 2024-04-26T10:19:20.517 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-26T10:19:20.554 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-26T10:19:20.576 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cachetools. 2024-04-26T10:19:20.593 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-04-26T10:19:20.634 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-04-26T10:19:20.680 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-26T10:19:20.835 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-04-26T10:19:20.987 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-26T10:19:20.993 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T10:19:21.004 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-04-26T10:19:21.012 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../111-rbd-fuse_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:21.031 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T10:19:21.045 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-04-26T10:19:21.050 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking rbd-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:21.136 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-packaging (20.3-1) ... 2024-04-26T10:19:21.324 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-26T10:19:21.385 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-attr (19.3.0-2) ... 2024-04-26T10:19:21.407 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-26T10:19:21.423 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-04-26T10:19:21.437 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-04-26T10:19:21.465 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-26T10:19:21.475 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-04-26T10:19:21.563 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-26T10:19:21.601 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-04-26T10:19:21.690 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-26T10:19:21.735 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-04-26T10:19:21.865 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-26T10:19:21.920 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rsa. 2024-04-26T10:19:21.936 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-04-26T10:19:21.944 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-04-26T10:19:21.974 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-04-26T10:19:21.978 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rsa (4.0-3) ... 2024-04-26T10:19:21.991 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-04-26T10:19:22.209 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:22.309 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-google-auth. 2024-04-26T10:19:22.327 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-04-26T10:19:22.346 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-26T10:19:22.367 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-04-26T10:19:22.392 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-26T10:19:22.672 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-04-26T10:19:22.697 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-blinker. 2024-04-26T10:19:22.717 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-04-26T10:19:22.752 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-26T10:19:22.755 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-26T10:19:22.810 INFO:teuthology.orchestra.run.smithi120.stdout:Adding system user cephadm....done 2024-04-26T10:19:22.965 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-26T10:19:22.999 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-26T10:19:23.100 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-oauthlib. 2024-04-26T10:19:23.116 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-04-26T10:19:23.124 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-26T10:19:23.137 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up socat (1.7.3.3-2) ... 2024-04-26T10:19:23.158 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-26T10:19:23.283 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-26T10:19:23.297 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:23.484 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T10:19:23.537 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-26T10:19:23.557 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-04-26T10:19:23.576 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-ceph-argparse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:23.595 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-26T10:19:23.640 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:19:23.785 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-26T10:19:23.799 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-04-26T10:19:23.877 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-26T10:19:23.915 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-websocket. 2024-04-26T10:19:23.919 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-04-26T10:19:23.934 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-04-26T10:19:23.973 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-04-26T10:19:24.028 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-04-26T10:19:24.070 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-04-26T10:19:24.143 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-26T10:19:24.269 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-04-26T10:19:24.320 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-26T10:19:24.335 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-26T10:19:24.351 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-04-26T10:19:24.369 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-04-26T10:19:24.392 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-04-26T10:19:24.397 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-04-26T10:19:24.630 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-26T10:19:24.663 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-26T10:19:24.755 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-04-26T10:19:24.816 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-26T10:19:24.972 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-26T10:19:24.993 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:19:25.030 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:25.109 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-04-26T10:19:25.140 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-04-26T10:19:25.392 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-26T10:19:25.397 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:19:25.401 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-26T10:19:25.408 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-04-26T10:19:25.433 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-04-26T10:19:25.450 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-04-26T10:19:25.523 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-26T10:19:25.650 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-04-26T10:19:25.703 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-26T10:19:25.708 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-26T10:19:25.828 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-26T10:19:25.844 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-26T10:19:25.903 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-26T10:19:25.971 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-04-26T10:19:25.987 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-ceph-argparse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:26.077 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-04-26T10:19:26.204 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package jq. 2024-04-26T10:19:26.225 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-26T10:19:26.272 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-04-26T10:19:26.272 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-04-26T10:19:26.296 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-26T10:19:26.385 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-26T10:19:26.422 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-04-26T10:19:26.549 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package socat. 2024-04-26T10:19:26.569 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-04-26T10:19:26.598 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-26T10:19:26.616 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking socat (1.7.3.3-2) ... 2024-04-26T10:19:26.724 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T10:19:26.729 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-04-26T10:19:26.740 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-26T10:19:26.961 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package xmlstarlet. 2024-04-26T10:19:26.979 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-04-26T10:19:27.019 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-04-26T10:19:27.021 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-packaging (20.3-1) ... 2024-04-26T10:19:27.024 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-26T10:19:27.050 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-04-26T10:19:27.150 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-04-26T10:19:27.322 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-04-26T10:19:27.343 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-26T10:19:27.424 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-test. 2024-04-26T10:19:27.442 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../094-ceph-test_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:27.482 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-test (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:27.490 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-26T10:19:27.576 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-04-26T10:19:27.616 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-26T10:19:27.619 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-04-26T10:19:27.911 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-04-26T10:19:27.925 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-04-26T10:19:28.006 INFO:teuthology.orchestra.run.smithi164.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-04-26T10:19:28.220 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-26T10:19:28.280 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-04-26T10:19:28.335 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-26T10:19:28.406 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-26T10:19:28.605 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-04-26T10:19:28.737 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-26T10:19:28.758 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-04-26T10:19:28.897 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-26T10:19:29.080 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up socat (1.7.3.3-2) ... 2024-04-26T10:19:29.109 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-26T10:19:29.206 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:29.232 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-04-26T10:19:29.254 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-26T10:19:29.380 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-04-26T10:19:29.533 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-packaging (20.3-1) ... 2024-04-26T10:19:29.540 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:19:29.675 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-04-26T10:19:29.740 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-26T10:19:29.850 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-04-26T10:19:29.976 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-26T10:19:30.018 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-26T10:19:30.024 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-04-26T10:19:30.124 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-26T10:19:30.144 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-04-26T10:19:30.270 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-04-26T10:19:30.470 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-04-26T10:19:30.587 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-26T10:19:30.863 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-26T10:19:30.897 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:19:31.023 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-26T10:19:31.149 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-04-26T10:19:31.231 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-26T10:19:31.467 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-04-26T10:19:31.497 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-26T10:19:31.608 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up socat (1.7.3.3-2) ... 2024-04-26T10:19:31.635 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-04-26T10:19:31.644 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-volume. 2024-04-26T10:19:31.662 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../095-ceph-volume_18.2.2-1256-gdc093b5e-1focal_all.deb ... 2024-04-26T10:19:31.702 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-volume (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:31.751 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-04-26T10:19:31.759 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:32.015 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package fonts-mathjax. 2024-04-26T10:19:32.026 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-04-26T10:19:32.033 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-26T10:19:32.073 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-26T10:19:32.078 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-26T10:19:32.094 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:19:32.206 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T10:19:32.236 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-04-26T10:19:32.360 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-04-26T10:19:32.490 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-04-26T10:19:32.588 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-26T10:19:32.653 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:19:32.669 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-26T10:19:32.687 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:32.726 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs-dev (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:32.748 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-04-26T10:19:32.779 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-04-26T10:19:32.783 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-26T10:19:32.884 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-04-26T10:19:33.122 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-26T10:19:33.146 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package nvme-cli. 2024-04-26T10:19:33.150 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-04-26T10:19:33.163 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-04-26T10:19:33.168 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-26T10:19:33.239 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-04-26T10:19:33.450 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-04-26T10:19:33.503 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:19:33.539 INFO:teuthology.orchestra.run.smithi052.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-04-26T10:19:33.568 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-26T10:19:33.588 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-04-26T10:19:33.626 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-04-26T10:19:33.662 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-26T10:19:33.788 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-04-26T10:19:33.838 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-04-26T10:19:33.852 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-26T10:19:33.962 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-26T10:19:34.021 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjs-mathjax. 2024-04-26T10:19:34.039 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-26T10:19:34.079 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-26T10:19:34.123 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-04-26T10:19:34.195 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-26T10:19:34.272 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-04-26T10:19:34.416 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-04-26T10:19:34.640 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-26T10:19:34.717 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-26T10:19:34.766 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-26T10:19:34.842 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T10:19:34.917 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-04-26T10:19:35.160 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-04-26T10:19:35.233 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-26T10:19:35.243 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-26T10:19:35.359 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-04-26T10:19:35.462 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-26T10:19:35.510 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-04-26T10:19:35.578 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-04-26T10:19:35.636 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rsa (4.0-3) ... 2024-04-26T10:19:35.754 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-04-26T10:19:35.853 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-natsort-doc. 2024-04-26T10:19:35.874 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-04-26T10:19:35.938 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-04-26T10:19:35.962 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-26T10:19:36.080 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-04-26T10:19:36.155 INFO:teuthology.orchestra.run.smithi120.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-04-26T10:19:36.284 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webencodings. 2024-04-26T10:19:36.300 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-04-26T10:19:36.341 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-26T10:19:36.373 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-26T10:19:36.418 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-04-26T10:19:36.577 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-26T10:19:36.653 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-html5lib. 2024-04-26T10:19:36.673 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-04-26T10:19:36.674 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T10:19:36.711 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-04-26T10:19:36.919 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-04-26T10:19:36.992 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-04-26T10:19:37.089 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-04-26T10:19:37.102 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-26T10:19:37.107 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-04-26T10:19:37.174 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-26T10:19:37.227 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-04-26T10:19:37.279 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-26T10:19:37.382 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librados2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:37.405 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-26T10:19:37.511 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-04-26T10:19:37.556 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-04-26T10:19:37.596 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-04-26T10:19:37.637 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librgw2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:37.661 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastescript. 2024-04-26T10:19:37.681 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-04-26T10:19:37.719 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-26T10:19:37.755 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:37.874 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-26T10:19:37.880 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-04-26T10:19:37.983 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libcephfs2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:38.081 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-psutil. 2024-04-26T10:19:38.097 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-04-26T10:19:38.109 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-routes (2.4.1-2) ... 2024-04-26T10:19:38.139 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-04-26T10:19:38.173 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:19:38.183 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-04-26T10:19:38.298 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-04-26T10:19:38.402 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libradosstriper1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:38.483 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-26T10:19:38.500 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-04-26T10:19:38.528 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-04-26T10:19:38.558 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-26T10:19:38.659 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-26T10:19:38.847 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up librbd1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:38.919 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplejson. 2024-04-26T10:19:38.936 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-04-26T10:19:38.964 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:38.977 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-26T10:19:39.003 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-04-26T10:19:39.090 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:39.288 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-26T10:19:39.305 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-04-26T10:19:39.314 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T10:19:39.314 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T10:19:39.347 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-26T10:19:39.387 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-26T10:19:39.640 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-26T10:19:39.782 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-04-26T10:19:39.808 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libcephfs-dev (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:39.934 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rados (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:39.947 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-26T10:19:40.060 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-04-26T10:19:40.159 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-04-26T10:19:40.342 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package radosgw. 2024-04-26T10:19:40.360 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../110-radosgw_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:40.400 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking radosgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:40.443 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-04-26T10:19:40.744 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:19:40.870 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-04-26T10:19:40.989 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rbd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:41.035 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-26T10:19:41.115 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up rbd-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:41.161 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-04-26T10:19:41.230 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-26T10:19:41.283 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-rgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:41.287 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-04-26T10:19:41.409 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up python3-cephfs (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:41.429 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rsa (4.0-3) ... 2024-04-26T10:19:41.535 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:41.573 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-04-26T10:19:41.714 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-26T10:19:41.837 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package rbd-fuse. 2024-04-26T10:19:41.840 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-04-26T10:19:41.853 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../111-rbd-fuse_18.2.2-1256-gdc093b5e-1focal_amd64.deb ... 2024-04-26T10:19:41.894 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking rbd-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:42.033 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-26T10:19:42.079 INFO:teuthology.orchestra.run.smithi164.stdout:Adding group ceph....done 2024-04-26T10:19:42.174 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-26T10:19:42.221 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-attr (19.3.0-2) ... 2024-04-26T10:19:42.367 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-26T10:19:42.467 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T10:19:42.489 INFO:teuthology.orchestra.run.smithi164.stdout:Adding system user ceph....done 2024-04-26T10:19:42.499 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-04-26T10:19:42.608 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-26T10:19:42.690 INFO:teuthology.orchestra.run.smithi164.stdout:Setting system user ceph properties....done 2024-04-26T10:19:42.714 INFO:teuthology.orchestra.run.smithi164.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T10:19:42.751 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-04-26T10:19:42.802 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-04-26T10:19:42.864 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T10:19:42.944 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:43.170 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librados2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:43.175 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T10:19:43.288 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-04-26T10:19:43.406 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-26T10:19:43.432 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librgw2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:43.532 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-04-26T10:19:43.554 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user cephadm....done 2024-04-26T10:19:43.556 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:43.644 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-test (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:43.682 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-04-26T10:19:43.742 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-26T10:19:43.768 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libcephfs2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:43.770 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up radosgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:43.808 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rsa (4.0-3) ... 2024-04-26T10:19:43.843 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-26T10:19:43.902 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-routes (2.4.1-2) ... 2024-04-26T10:19:44.118 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-26T10:19:44.211 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-26T10:19:44.220 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libradosstriper1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:44.256 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T10:19:44.256 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T10:19:44.260 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-04-26T10:19:44.363 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-04-26T10:19:44.504 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-26T10:19:44.595 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-26T10:19:44.630 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-04-26T10:19:44.639 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up librbd1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:44.706 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-base (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:44.765 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:44.789 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-04-26T10:19:44.891 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:44.913 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T10:19:45.107 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T10:19:45.124 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-04-26T10:19:45.153 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T10:19:45.153 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T10:19:45.239 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-04-26T10:19:45.526 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-26T10:19:45.575 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mds (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:45.678 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libcephfs-dev (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:45.788 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rados (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:45.802 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T10:19:45.802 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T10:19:45.810 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-04-26T10:19:45.930 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-04-26T10:19:45.949 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librados2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:46.075 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-04-26T10:19:46.112 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-26T10:19:46.201 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librgw2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:46.243 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:46.344 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:46.438 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-26T10:19:46.474 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T10:19:46.474 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T10:19:46.569 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcephfs2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:46.698 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-routes (2.4.1-2) ... 2024-04-26T10:19:46.764 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-argparse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:46.910 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rbd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:46.919 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-osd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:46.991 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libradosstriper1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:47.057 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-26T10:19:47.061 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up rbd-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:47.117 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-04-26T10:19:47.179 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-rgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:47.199 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-04-26T10:19:47.280 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up python3-cephfs (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:47.381 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:47.434 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T10:19:47.434 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T10:19:47.443 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up librbd1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:47.476 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-26T10:19:47.611 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:47.737 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:47.743 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-26T10:19:47.871 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:47.903 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-04-26T10:19:47.942 INFO:teuthology.orchestra.run.smithi052.stdout:Adding group ceph....done 2024-04-26T10:19:47.960 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T10:19:47.961 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T10:19:48.030 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:48.173 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mon (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:48.279 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-04-26T10:19:48.319 INFO:teuthology.orchestra.run.smithi052.stdout:Adding system user ceph....done 2024-04-26T10:19:48.402 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T10:19:48.402 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T10:19:48.430 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libcephfs-dev (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:48.512 INFO:teuthology.orchestra.run.smithi052.stdout:Setting system user ceph properties....done 2024-04-26T10:19:48.538 INFO:teuthology.orchestra.run.smithi052.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T10:19:48.580 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-04-26T10:19:48.581 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rados (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:48.694 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T10:19:48.707 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-04-26T10:19:48.848 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-26T10:19:48.905 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:49.012 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T10:19:49.050 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:49.160 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:49.191 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-04-26T10:19:49.294 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up ceph-volume (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:49.482 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-test (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:49.509 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-26T10:19:49.608 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up radosgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:49.661 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rbd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:49.697 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-26T10:19:49.787 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up rbd-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:49.826 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-04-26T10:19:49.882 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-26T10:19:49.888 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-rgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:49.988 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up python3-cephfs (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:50.089 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T10:19:50.090 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T10:19:50.133 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-packaging (20.3-1) ... 2024-04-26T10:19:50.148 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:50.158 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-26T10:19:50.420 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-04-26T10:19:50.535 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-base (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:50.571 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-26T10:19:50.697 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-26T10:19:50.747 INFO:teuthology.orchestra.run.smithi120.stdout:Adding group ceph....done 2024-04-26T10:19:50.929 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T10:19:51.015 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-04-26T10:19:51.152 INFO:teuthology.orchestra.run.smithi120.stdout:Adding system user ceph....done 2024-04-26T10:19:51.322 INFO:teuthology.orchestra.run.smithi120.stdout:Setting system user ceph properties....done 2024-04-26T10:19:51.345 INFO:teuthology.orchestra.run.smithi120.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T10:19:51.379 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mds (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:51.417 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-26T10:19:51.494 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T10:19:51.639 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T10:19:51.639 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T10:19:51.802 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-26T10:19:51.815 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T10:19:52.081 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:52.220 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up socat (1.7.3.3-2) ... 2024-04-26T10:19:52.249 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-test (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:52.303 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T10:19:52.304 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T10:19:52.355 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:52.400 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up radosgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:52.667 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:19:52.732 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-osd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:52.777 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-04-26T10:19:52.856 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T10:19:52.857 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T10:19:53.028 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-04-26T10:19:53.145 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-26T10:19:53.258 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T10:19:53.258 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T10:19:53.296 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-04-26T10:19:53.324 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-base (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:53.422 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-04-26T10:19:53.624 INFO:teuthology.orchestra.run.smithi164.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T10:19:53.627 DEBUG:teuthology.orchestra.run.smithi164:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-26T10:19:53.698 INFO:teuthology.orchestra.run.smithi164.stdout:Reading package lists... 2024-04-26T10:19:53.706 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-26T10:19:53.708 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:53.709 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T10:19:53.826 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:53.909 INFO:teuthology.orchestra.run.smithi164.stdout:Building dependency tree... 2024-04-26T10:19:53.910 INFO:teuthology.orchestra.run.smithi164.stdout:Reading state information... 2024-04-26T10:19:53.994 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mon (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:54.024 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:19:54.120 INFO:teuthology.orchestra.run.smithi164.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-04-26T10:19:54.120 INFO:teuthology.orchestra.run.smithi164.stdout:flex is already the newest version (2.6.4-6.2). 2024-04-26T10:19:54.120 INFO:teuthology.orchestra.run.smithi164.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-04-26T10:19:54.120 INFO:teuthology.orchestra.run.smithi164.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-04-26T10:19:54.120 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T10:19:54.121 INFO:teuthology.orchestra.run.smithi164.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-26T10:19:54.121 INFO:teuthology.orchestra.run.smithi164.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T10:19:54.122 INFO:teuthology.orchestra.run.smithi164.stdout:Suggested packages: 2024-04-26T10:19:54.122 INFO:teuthology.orchestra.run.smithi164.stdout: libssl-doc 2024-04-26T10:19:54.135 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-26T10:19:54.159 INFO:teuthology.orchestra.run.smithi164.stdout:The following NEW packages will be installed: 2024-04-26T10:19:54.160 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-dev libelf-dev libssl-dev 2024-04-26T10:19:54.161 INFO:teuthology.orchestra.run.smithi164.stdout:The following packages will be upgraded: 2024-04-26T10:19:54.162 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mds (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:54.162 INFO:teuthology.orchestra.run.smithi164.stdout: libdw1 libelf1 libssl1.1 libuuid1 uuid-dev 2024-04-26T10:19:54.233 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T10:19:54.233 INFO:teuthology.orchestra.run.smithi052.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T10:19:54.247 INFO:teuthology.orchestra.run.smithi164.stdout:5 upgraded, 3 newly installed, 0 to remove and 272 not upgraded. 2024-04-26T10:19:54.247 INFO:teuthology.orchestra.run.smithi164.stdout:Need to get 3,303 kB of archives. 2024-04-26T10:19:54.247 INFO:teuthology.orchestra.run.smithi164.stdout:After this operation, 8,471 kB of additional disk space will be used. 2024-04-26T10:19:54.247 INFO:teuthology.orchestra.run.smithi164.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-04-26T10:19:54.287 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-04-26T10:19:54.312 INFO:teuthology.orchestra.run.smithi164.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-04-26T10:19:54.326 INFO:teuthology.orchestra.run.smithi164.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-04-26T10:19:54.387 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T10:19:54.387 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T10:19:54.394 INFO:teuthology.orchestra.run.smithi164.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-04-26T10:19:54.396 INFO:teuthology.orchestra.run.smithi164.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-04-26T10:19:54.452 INFO:teuthology.orchestra.run.smithi164.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-04-26T10:19:54.452 INFO:teuthology.orchestra.run.smithi164.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-04-26T10:19:54.453 INFO:teuthology.orchestra.run.smithi164.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-04-26T10:19:54.597 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-04-26T10:19:54.679 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:54.792 INFO:teuthology.orchestra.run.smithi164.stdout:Preconfiguring packages ... 2024-04-26T10:19:54.822 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:54.830 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:54.906 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-04-26T10:19:54.934 INFO:teuthology.orchestra.run.smithi164.stdout:Fetched 3,303 kB in 0s (10.7 MB/s) 2024-04-26T10:19:55.022 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:55.080 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-26T10:19:55.084 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-26T10:19:55.092 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T10:19:55.093 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T10:19:55.182 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-26T10:19:55.233 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-26T10:19:55.327 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-26T10:19:55.332 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up ceph-volume (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:55.590 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-osd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:55.620 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-04-26T10:19:55.706 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-26T10:19:55.727 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-26T10:19:55.880 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-26T10:19:55.905 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-26T10:19:55.930 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-26T10:19:56.071 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T10:19:56.072 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T10:19:56.197 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-26T10:19:56.264 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-04-26T10:19:56.559 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:56.626 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-04-26T10:19:56.701 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:56.808 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-26T10:19:56.869 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mon (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:56.900 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-04-26T10:19:57.010 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-26T10:19:57.098 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T10:19:57.098 INFO:teuthology.orchestra.run.smithi120.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T10:19:57.259 INFO:teuthology.orchestra.run.smithi164.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-26T10:19:57.263 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../0-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T10:19:57.319 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-04-26T10:19:57.397 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-26T10:19:57.545 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:57.671 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-26T10:19:57.688 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:57.797 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-26T10:19:57.830 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:57.894 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../1-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T10:19:57.949 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-04-26T10:19:57.973 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up ceph-volume (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:19:58.028 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-26T10:19:58.292 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-26T10:19:58.343 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-26T10:19:58.452 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../2-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-26T10:19:58.528 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-26T10:19:58.577 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-04-26T10:19:58.616 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-04-26T10:19:58.812 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-26T10:19:59.053 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T10:19:59.070 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../3-libaio-dev_0.3.112-5_amd64.deb ... 2024-04-26T10:19:59.111 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-04-26T10:19:59.233 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-04-26T10:19:59.347 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T10:19:59.368 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../4-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T10:19:59.405 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T10:19:59.692 INFO:teuthology.orchestra.run.smithi164.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T10:19:59.709 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing to unpack .../5-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-26T10:19:59.750 INFO:teuthology.orchestra.run.smithi164.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T10:19:59.850 INFO:teuthology.orchestra.run.smithi052.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T10:19:59.853 DEBUG:teuthology.orchestra.run.smithi052:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-26T10:19:59.926 INFO:teuthology.orchestra.run.smithi052.stdout:Reading package lists... 2024-04-26T10:20:00.083 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-26T10:20:00.146 INFO:teuthology.orchestra.run.smithi052.stdout:Building dependency tree... 2024-04-26T10:20:00.147 INFO:teuthology.orchestra.run.smithi052.stdout:Reading state information... 2024-04-26T10:20:00.209 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-04-26T10:20:00.244 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T10:20:00.360 INFO:teuthology.orchestra.run.smithi052.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-04-26T10:20:00.360 INFO:teuthology.orchestra.run.smithi052.stdout:flex is already the newest version (2.6.4-6.2). 2024-04-26T10:20:00.361 INFO:teuthology.orchestra.run.smithi052.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-04-26T10:20:00.361 INFO:teuthology.orchestra.run.smithi052.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-04-26T10:20:00.361 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T10:20:00.361 INFO:teuthology.orchestra.run.smithi052.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-26T10:20:00.361 INFO:teuthology.orchestra.run.smithi052.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T10:20:00.362 INFO:teuthology.orchestra.run.smithi052.stdout:Suggested packages: 2024-04-26T10:20:00.362 INFO:teuthology.orchestra.run.smithi052.stdout: libssl-doc 2024-04-26T10:20:00.405 INFO:teuthology.orchestra.run.smithi052.stdout:The following NEW packages will be installed: 2024-04-26T10:20:00.406 INFO:teuthology.orchestra.run.smithi052.stdout: libaio-dev libelf-dev libssl-dev 2024-04-26T10:20:00.407 INFO:teuthology.orchestra.run.smithi052.stdout:The following packages will be upgraded: 2024-04-26T10:20:00.408 INFO:teuthology.orchestra.run.smithi052.stdout: libdw1 libelf1 libssl1.1 libuuid1 uuid-dev 2024-04-26T10:20:00.588 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-04-26T10:20:00.589 INFO:teuthology.orchestra.run.smithi052.stdout:5 upgraded, 3 newly installed, 0 to remove and 272 not upgraded. 2024-04-26T10:20:00.589 INFO:teuthology.orchestra.run.smithi052.stdout:Need to get 3,303 kB of archives. 2024-04-26T10:20:00.589 INFO:teuthology.orchestra.run.smithi052.stdout:After this operation, 8,471 kB of additional disk space will be used. 2024-04-26T10:20:00.589 INFO:teuthology.orchestra.run.smithi052.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-04-26T10:20:00.593 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-04-26T10:20:00.714 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-26T10:20:00.790 INFO:teuthology.orchestra.run.smithi052.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-04-26T10:20:00.822 INFO:teuthology.orchestra.run.smithi052.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-04-26T10:20:00.840 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T10:20:00.937 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-04-26T10:20:01.000 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T10:20:01.044 INFO:teuthology.orchestra.run.smithi052.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-04-26T10:20:01.065 INFO:teuthology.orchestra.run.smithi052.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-04-26T10:20:01.117 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T10:20:01.243 INFO:teuthology.orchestra.run.smithi164.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T10:20:01.254 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-26T10:20:01.258 INFO:teuthology.orchestra.run.smithi052.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-04-26T10:20:01.258 INFO:teuthology.orchestra.run.smithi052.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-04-26T10:20:01.264 INFO:teuthology.orchestra.run.smithi052.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-04-26T10:20:01.370 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-26T10:20:01.414 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-04-26T10:20:01.660 INFO:teuthology.orchestra.run.smithi052.stdout:Preconfiguring packages ... 2024-04-26T10:20:01.673 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-04-26T10:20:01.757 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-26T10:20:01.784 INFO:teuthology.orchestra.run.smithi052.stdout:Fetched 3,303 kB in 1s (3,571 kB/s) 2024-04-26T10:20:01.934 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-26T10:20:01.939 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-26T10:20:02.063 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-26T10:20:02.092 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-04-26T10:20:02.273 INFO:teuthology.orchestra.run.smithi120.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T10:20:02.275 DEBUG:teuthology.orchestra.run.smithi120:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-26T10:20:02.350 INFO:teuthology.orchestra.run.smithi120.stdout:Reading package lists... 2024-04-26T10:20:02.468 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-26T10:20:02.553 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-26T10:20:02.562 INFO:teuthology.orchestra.run.smithi120.stdout:Building dependency tree... 2024-04-26T10:20:02.563 INFO:teuthology.orchestra.run.smithi120.stdout:Reading state information... 2024-04-26T10:20:02.736 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-26T10:20:02.773 INFO:teuthology.orchestra.run.smithi120.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-04-26T10:20:02.773 INFO:teuthology.orchestra.run.smithi120.stdout:flex is already the newest version (2.6.4-6.2). 2024-04-26T10:20:02.773 INFO:teuthology.orchestra.run.smithi120.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-04-26T10:20:02.773 INFO:teuthology.orchestra.run.smithi120.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-04-26T10:20:02.773 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T10:20:02.774 INFO:teuthology.orchestra.run.smithi120.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-26T10:20:02.774 INFO:teuthology.orchestra.run.smithi120.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T10:20:02.775 INFO:teuthology.orchestra.run.smithi120.stdout:Suggested packages: 2024-04-26T10:20:02.776 INFO:teuthology.orchestra.run.smithi120.stdout: libssl-doc 2024-04-26T10:20:02.795 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-26T10:20:02.817 INFO:teuthology.orchestra.run.smithi120.stdout:The following NEW packages will be installed: 2024-04-26T10:20:02.818 INFO:teuthology.orchestra.run.smithi120.stdout: libaio-dev libelf-dev libssl-dev 2024-04-26T10:20:02.819 INFO:teuthology.orchestra.run.smithi120.stdout:The following packages will be upgraded: 2024-04-26T10:20:02.820 INFO:teuthology.orchestra.run.smithi120.stdout: libdw1 libelf1 libssl1.1 libuuid1 uuid-dev 2024-04-26T10:20:02.882 INFO:teuthology.orchestra.run.smithi120.stdout:5 upgraded, 3 newly installed, 0 to remove and 272 not upgraded. 2024-04-26T10:20:02.882 INFO:teuthology.orchestra.run.smithi120.stdout:Need to get 3,303 kB of archives. 2024-04-26T10:20:02.882 INFO:teuthology.orchestra.run.smithi120.stdout:After this operation, 8,471 kB of additional disk space will be used. 2024-04-26T10:20:02.882 INFO:teuthology.orchestra.run.smithi120.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-04-26T10:20:02.924 INFO:teuthology.orchestra.run.smithi164.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-26T10:20:02.934 INFO:teuthology.orchestra.run.smithi120.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-04-26T10:20:02.941 INFO:teuthology.orchestra.run.smithi120.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-04-26T10:20:02.997 INFO:teuthology.orchestra.run.smithi120.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-04-26T10:20:03.001 INFO:teuthology.orchestra.run.smithi120.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-04-26T10:20:03.052 INFO:teuthology.orchestra.run.smithi120.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-04-26T10:20:03.052 INFO:teuthology.orchestra.run.smithi120.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-04-26T10:20:03.052 INFO:teuthology.orchestra.run.smithi120.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-04-26T10:20:03.081 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-26T10:20:03.375 INFO:teuthology.orchestra.run.smithi120.stdout:Preconfiguring packages ... 2024-04-26T10:20:03.382 INFO:teuthology.orchestra.run.smithi164.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T10:20:03.387 DEBUG:teuthology.parallel:result is None 2024-04-26T10:20:03.508 INFO:teuthology.orchestra.run.smithi120.stdout:Fetched 3,303 kB in 0s (13.5 MB/s) 2024-04-26T10:20:03.539 INFO:teuthology.orchestra.run.smithi052.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-26T10:20:03.544 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../0-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T10:20:03.655 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-26T10:20:03.660 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-26T10:20:03.677 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-26T10:20:03.786 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-26T10:20:03.825 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-26T10:20:03.951 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-04-26T10:20:04.080 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-04-26T10:20:04.153 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../1-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T10:20:04.212 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rsa (4.0-3) ... 2024-04-26T10:20:04.283 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-26T10:20:04.316 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-26T10:20:04.434 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-26T10:20:04.505 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-26T10:20:04.631 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-04-26T10:20:04.801 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-26T10:20:04.849 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../2-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-26T10:20:04.941 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-26T10:20:04.979 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-04-26T10:20:05.242 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-26T10:20:05.286 INFO:teuthology.orchestra.run.smithi120.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-26T10:20:05.291 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../0-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T10:20:05.408 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T10:20:05.424 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-26T10:20:05.426 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../3-libaio-dev_0.3.112-5_amd64.deb ... 2024-04-26T10:20:05.492 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-04-26T10:20:05.568 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-04-26T10:20:05.737 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T10:20:05.754 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../4-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T10:20:05.829 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T10:20:05.912 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librados2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:05.955 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../1-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T10:20:06.038 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-04-26T10:20:06.080 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-26T10:20:06.081 INFO:teuthology.orchestra.run.smithi052.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T10:20:06.099 INFO:teuthology.orchestra.run.smithi052.stdout:Preparing to unpack .../5-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-26T10:20:06.139 INFO:teuthology.orchestra.run.smithi052.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T10:20:06.206 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librgw2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:06.332 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:06.585 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs2 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:06.625 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T10:20:06.703 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-routes (2.4.1-2) ... 2024-04-26T10:20:06.777 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../2-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-26T10:20:06.928 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-04-26T10:20:06.944 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-04-26T10:20:07.046 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libradosstriper1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:07.054 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-26T10:20:07.180 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T10:20:07.206 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-04-26T10:20:07.331 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T10:20:07.381 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T10:20:07.398 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../3-libaio-dev_0.3.112-5_amd64.deb ... 2024-04-26T10:20:07.457 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T10:20:07.458 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-04-26T10:20:07.507 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librbd1 (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:07.583 INFO:teuthology.orchestra.run.smithi052.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T10:20:07.625 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-modules-core (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:07.702 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-26T10:20:07.717 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T10:20:07.726 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:07.734 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../4-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T10:20:07.800 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T10:20:07.969 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T10:20:07.969 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-26T10:20:08.053 INFO:teuthology.orchestra.run.smithi120.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T10:20:08.070 INFO:teuthology.orchestra.run.smithi120.stdout:Preparing to unpack .../5-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-26T10:20:08.153 INFO:teuthology.orchestra.run.smithi120.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T10:20:08.420 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs-dev (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:08.579 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rados (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:08.638 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T10:20:08.705 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-04-26T10:20:08.983 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-04-26T10:20:09.125 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-26T10:20:09.243 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T10:20:09.279 INFO:teuthology.orchestra.run.smithi052.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-26T10:20:09.411 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T10:20:09.537 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T10:20:09.650 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rbd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:09.663 INFO:teuthology.orchestra.run.smithi120.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T10:20:09.731 INFO:teuthology.orchestra.run.smithi052.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T10:20:09.735 DEBUG:teuthology.parallel:result is None 2024-04-26T10:20:09.768 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up rbd-fuse (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:09.815 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-26T10:20:09.927 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:10.053 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cephfs (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:10.538 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-common (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:11.132 INFO:teuthology.orchestra.run.smithi154.stdout:Adding group ceph....done 2024-04-26T10:20:11.375 INFO:teuthology.orchestra.run.smithi120.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-26T10:20:11.476 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user ceph....done 2024-04-26T10:20:11.677 INFO:teuthology.orchestra.run.smithi154.stdout:Setting system user ceph properties....done 2024-04-26T10:20:11.702 INFO:teuthology.orchestra.run.smithi154.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-26T10:20:11.854 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-26T10:20:11.921 INFO:teuthology.orchestra.run.smithi120.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T10:20:11.925 DEBUG:teuthology.parallel:result is None 2024-04-26T10:20:12.182 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-26T10:20:12.682 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-test (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:12.808 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up radosgw (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:13.284 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T10:20:13.285 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-26T10:20:13.718 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-base (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:14.114 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-26T10:20:14.545 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mds (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:14.801 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T10:20:14.801 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-26T10:20:15.247 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:15.504 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T10:20:15.504 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-26T10:20:15.949 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-osd (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:16.477 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T10:20:16.478 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-26T10:20:16.900 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:17.059 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:17.211 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mon (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:17.437 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T10:20:17.437 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-26T10:20:17.879 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-cephadm (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:18.055 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:18.181 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-dashboard (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:18.350 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-volume (18.2.2-1256-gdc093b5e-1focal) ... 2024-04-26T10:20:18.719 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-26T10:20:18.870 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-26T10:20:19.155 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-26T10:20:21.950 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-04-26T10:20:22.591 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T10:20:22.594 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-26T10:20:22.662 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-04-26T10:20:22.874 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-04-26T10:20:22.875 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-04-26T10:20:23.067 INFO:teuthology.orchestra.run.smithi154.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-04-26T10:20:23.067 INFO:teuthology.orchestra.run.smithi154.stdout:flex is already the newest version (2.6.4-6.2). 2024-04-26T10:20:23.067 INFO:teuthology.orchestra.run.smithi154.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-04-26T10:20:23.067 INFO:teuthology.orchestra.run.smithi154.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-04-26T10:20:23.067 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-04-26T10:20:23.068 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-26T10:20:23.068 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-26T10:20:23.069 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-04-26T10:20:23.069 INFO:teuthology.orchestra.run.smithi154.stdout: libssl-doc 2024-04-26T10:20:23.105 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-04-26T10:20:23.105 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-dev libelf-dev libssl-dev 2024-04-26T10:20:23.106 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages will be upgraded: 2024-04-26T10:20:23.107 INFO:teuthology.orchestra.run.smithi154.stdout: libdw1 libelf1 libssl1.1 libuuid1 uuid-dev 2024-04-26T10:20:23.167 INFO:teuthology.orchestra.run.smithi154.stdout:5 upgraded, 3 newly installed, 0 to remove and 272 not upgraded. 2024-04-26T10:20:23.167 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 3,303 kB of archives. 2024-04-26T10:20:23.167 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 8,471 kB of additional disk space will be used. 2024-04-26T10:20:23.167 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-04-26T10:20:23.219 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-04-26T10:20:23.227 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-04-26T10:20:23.284 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-04-26T10:20:23.289 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-04-26T10:20:23.339 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-04-26T10:20:23.339 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-04-26T10:20:23.340 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-04-26T10:20:23.671 INFO:teuthology.orchestra.run.smithi154.stdout:Preconfiguring packages ... 2024-04-26T10:20:23.809 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 3,303 kB in 0s (13.4 MB/s) 2024-04-26T10:20:23.957 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-26T10:20:23.962 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-26T10:20:24.129 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-26T10:20:24.602 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-26T10:20:24.811 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-26T10:20:25.171 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-26T10:20:25.639 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-26T10:20:25.644 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../0-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T10:20:26.014 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-26T10:20:26.567 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../1-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T10:20:26.734 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-26T10:20:27.224 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../2-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-26T10:20:27.355 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-04-26T10:20:27.784 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-26T10:20:27.804 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../3-libaio-dev_0.3.112-5_amd64.deb ... 2024-04-26T10:20:27.842 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-04-26T10:20:28.104 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-26T10:20:28.123 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../4-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-26T10:20:28.162 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T10:20:28.473 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-26T10:20:28.491 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../5-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-26T10:20:28.531 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T10:20:29.018 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T10:20:29.345 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-04-26T10:20:29.496 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-26T10:20:29.622 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-26T10:20:29.773 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T10:20:29.899 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T10:20:30.034 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-26T10:20:30.178 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-26T10:20:31.681 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-26T10:20:32.156 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-26T10:20:32.161 DEBUG:teuthology.parallel:result is None 2024-04-26T10:20:32.161 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:20:32.310 DEBUG:teuthology.orchestra.run.smithi052:> dpkg-query -W -f '${Version}' ceph 2024-04-26T10:20:32.332 INFO:teuthology.orchestra.run.smithi052.stdout:18.2.2-1256-gdc093b5e-1focal 2024-04-26T10:20:32.333 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256-gdc093b5e-1focal 2024-04-26T10:20:32.333 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256-gdc093b5e-1focal is installed. 2024-04-26T10:20:32.335 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:20:32.559 DEBUG:teuthology.orchestra.run.smithi120:> dpkg-query -W -f '${Version}' ceph 2024-04-26T10:20:32.583 INFO:teuthology.orchestra.run.smithi120.stdout:18.2.2-1256-gdc093b5e-1focal 2024-04-26T10:20:32.583 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256-gdc093b5e-1focal 2024-04-26T10:20:32.583 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256-gdc093b5e-1focal is installed. 2024-04-26T10:20:32.585 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:20:32.812 DEBUG:teuthology.orchestra.run.smithi154:> dpkg-query -W -f '${Version}' ceph 2024-04-26T10:20:32.836 INFO:teuthology.orchestra.run.smithi154.stdout:18.2.2-1256-gdc093b5e-1focal 2024-04-26T10:20:32.837 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256-gdc093b5e-1focal 2024-04-26T10:20:32.837 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256-gdc093b5e-1focal is installed. 2024-04-26T10:20:32.839 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=dc093b5e41f728edab6e0330295fdf9156d31664 2024-04-26T10:20:32.981 DEBUG:teuthology.orchestra.run.smithi164:> dpkg-query -W -f '${Version}' ceph 2024-04-26T10:20:33.006 INFO:teuthology.orchestra.run.smithi164.stdout:18.2.2-1256-gdc093b5e-1focal 2024-04-26T10:20:33.006 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1256-gdc093b5e-1focal 2024-04-26T10:20:33.006 INFO:teuthology.task.install:The correct ceph version 18.2.2-1256-gdc093b5e-1focal is installed. 2024-04-26T10:20:33.008 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-26T10:20:33.008 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T10:20:33.008 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T10:20:33.025 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T10:20:33.025 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T10:20:33.041 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T10:20:33.041 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T10:20:33.058 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T10:20:33.058 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-26T10:20:33.075 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-26T10:20:33.075 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T10:20:33.075 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T10:20:33.089 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T10:20:33.103 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T10:20:33.103 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T10:20:33.119 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T10:20:33.133 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T10:20:33.133 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T10:20:33.148 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T10:20:33.162 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T10:20:33.162 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2024-04-26T10:20:33.178 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-26T10:20:33.193 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-26T10:20:33.193 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T10:20:33.193 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T10:20:33.209 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T10:20:33.265 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T10:20:33.265 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T10:20:33.281 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T10:20:33.291 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T10:20:33.291 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T10:20:33.306 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T10:20:33.362 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T10:20:33.363 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-26T10:20:33.379 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-26T10:20:33.394 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-26T10:20:33.394 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T10:20:33.394 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T10:20:33.411 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T10:20:33.426 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T10:20:33.426 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T10:20:33.442 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T10:20:33.452 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T10:20:33.452 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T10:20:33.468 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T10:20:33.526 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T10:20:33.526 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2024-04-26T10:20:33.541 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-26T10:20:33.600 INFO:teuthology.run_tasks:Running task ceph... 2024-04-26T10:20:33.684 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-26T10:20:33.684 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 777 /var/log/ceph 2024-04-26T10:20:33.686 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 777 /var/log/ceph 2024-04-26T10:20:33.689 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2024-04-26T10:20:33.691 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2024-04-26T10:20:33.706 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-26T10:20:33.706 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T10:20:33.744 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T10:20:33.748 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T10:20:33.750 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-26T10:20:33.765 INFO:tasks.ceph:Creating extra log directories... 2024-04-26T10:20:33.765 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T10:20:33.767 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T10:20:33.770 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T10:20:33.772 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-26T10:20:33.834 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-26T10:20:33.834 INFO:tasks.ceph:config {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-26T10:20:33.834 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112', 'branch': 'reef', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/ubuntu_20.04 tasks/admin_socket_objecter_requests thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7674112', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 1136, 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664', 'sleep_before_teardown': 0, 'subset': '0/4', 'suite': 'powercycle', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_7d2137f0a666c92a9411c1af5c33e4968be54da6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6', 'targets': {'smithi052.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi120.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi154.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi164.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'radosbench': {'clients': ['client.0'], 'time': 60}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_22:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-26T10:20:33.834 DEBUG:teuthology.orchestra.run.smithi052:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T10:20:33.837 DEBUG:teuthology.orchestra.run.smithi120:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T10:20:33.839 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T10:20:33.841 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-26T10:20:33.848 DEBUG:teuthology.orchestra.run.smithi052:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T10:20:33.888 DEBUG:teuthology.orchestra.run.smithi120:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T10:20:33.890 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T10:20:33.893 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T10:20:33.909 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T10:20:33.909 DEBUG:teuthology.orchestra.run.smithi120:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T10:20:33.953 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T10:20:33.953 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_1 2024-04-26T10:20:33.960 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T10:20:33.961 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:20:33.961 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 359 Links: 1 2024-04-26T10:20:33.961 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:20:33.961 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-04-26 10:16:02.737535579 +0000 2024-04-26T10:20:33.961 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-04-26 10:16:02.533540283 +0000 2024-04-26T10:20:33.961 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-04-26 10:16:02.533540283 +0000 2024-04-26T10:20:33.961 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-04-26T10:20:33.961 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T10:20:33.971 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-04-26T10:20:33.971 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-04-26T10:20:33.971 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000445294 s, 1.1 MB/s 2024-04-26T10:20:33.972 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T10:20:34.022 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_2 2024-04-26T10:20:34.030 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T10:20:34.030 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:20:34.030 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 366 Links: 1 2024-04-26T10:20:34.030 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:20:34.030 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-04-26 10:16:03.177525432 +0000 2024-04-26T10:20:34.030 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-04-26 10:16:02.949530690 +0000 2024-04-26T10:20:34.030 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-04-26 10:16:02.949530690 +0000 2024-04-26T10:20:34.030 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-04-26T10:20:34.031 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T10:20:34.044 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-04-26T10:20:34.044 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-04-26T10:20:34.044 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000428678 s, 1.2 MB/s 2024-04-26T10:20:34.046 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T10:20:34.054 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_3 2024-04-26T10:20:34.105 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T10:20:34.105 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:20:34.105 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 374 Links: 1 2024-04-26T10:20:34.105 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:20:34.105 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-04-26 10:16:03.613515377 +0000 2024-04-26T10:20:34.105 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-04-26 10:16:03.405520174 +0000 2024-04-26T10:20:34.105 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-04-26 10:16:03.405520174 +0000 2024-04-26T10:20:34.105 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-04-26T10:20:34.105 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T10:20:34.116 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-04-26T10:20:34.116 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-04-26T10:20:34.116 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000410545 s, 1.2 MB/s 2024-04-26T10:20:34.117 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T10:20:34.125 DEBUG:teuthology.orchestra.run.smithi120:> stat /dev/vg_nvme/lv_4 2024-04-26T10:20:34.173 INFO:teuthology.orchestra.run.smithi120.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T10:20:34.173 INFO:teuthology.orchestra.run.smithi120.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:20:34.173 INFO:teuthology.orchestra.run.smithi120.stdout:Device: 6h/6d Inode: 379 Links: 1 2024-04-26T10:20:34.173 INFO:teuthology.orchestra.run.smithi120.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:20:34.173 INFO:teuthology.orchestra.run.smithi120.stdout:Access: 2024-04-26 10:16:04.065504954 +0000 2024-04-26T10:20:34.173 INFO:teuthology.orchestra.run.smithi120.stdout:Modify: 2024-04-26 10:16:03.857509751 +0000 2024-04-26T10:20:34.173 INFO:teuthology.orchestra.run.smithi120.stdout:Change: 2024-04-26 10:16:03.857509751 +0000 2024-04-26T10:20:34.173 INFO:teuthology.orchestra.run.smithi120.stdout: Birth: - 2024-04-26T10:20:34.174 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T10:20:34.187 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records in 2024-04-26T10:20:34.188 INFO:teuthology.orchestra.run.smithi120.stderr:1+0 records out 2024-04-26T10:20:34.188 INFO:teuthology.orchestra.run.smithi120.stderr:512 bytes copied, 0.000388695 s, 1.3 MB/s 2024-04-26T10:20:34.189 DEBUG:teuthology.orchestra.run.smithi120:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T10:20:34.197 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T10:20:34.197 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T10:20:34.197 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T10:20:34.204 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T10:20:34.204 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-04-26T10:20:34.254 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T10:20:34.255 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:20:34.255 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 358 Links: 1 2024-04-26T10:20:34.255 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:20:34.255 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-26 10:16:00.988206012 +0000 2024-04-26T10:20:34.255 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-26 10:16:00.776210902 +0000 2024-04-26T10:20:34.255 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-26 10:16:00.776210902 +0000 2024-04-26T10:20:34.255 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-04-26T10:20:34.255 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T10:20:34.267 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-26T10:20:34.267 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-26T10:20:34.267 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.00043781 s, 1.2 MB/s 2024-04-26T10:20:34.268 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T10:20:34.276 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-04-26T10:20:34.284 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T10:20:34.284 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:20:34.284 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 366 Links: 1 2024-04-26T10:20:34.284 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:20:34.284 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-26 10:16:01.436195680 +0000 2024-04-26T10:20:34.284 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-26 10:16:01.216200754 +0000 2024-04-26T10:20:34.284 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-26 10:16:01.216200754 +0000 2024-04-26T10:20:34.284 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-04-26T10:20:34.284 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T10:20:34.339 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-26T10:20:34.339 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-26T10:20:34.339 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000432317 s, 1.2 MB/s 2024-04-26T10:20:34.340 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T10:20:34.349 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-04-26T10:20:34.355 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T10:20:34.355 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:20:34.356 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 373 Links: 1 2024-04-26T10:20:34.356 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:20:34.356 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-26 10:16:01.892185166 +0000 2024-04-26T10:20:34.356 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-26 10:16:01.676190146 +0000 2024-04-26T10:20:34.356 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-26 10:16:01.676190146 +0000 2024-04-26T10:20:34.356 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-04-26T10:20:34.356 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T10:20:34.369 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-26T10:20:34.369 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-26T10:20:34.370 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000373955 s, 1.4 MB/s 2024-04-26T10:20:34.370 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T10:20:34.420 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-04-26T10:20:34.427 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T10:20:34.427 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:20:34.427 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 6h/6d Inode: 378 Links: 1 2024-04-26T10:20:34.427 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:20:34.427 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-04-26 10:16:02.368174187 +0000 2024-04-26T10:20:34.427 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-04-26 10:16:02.132179630 +0000 2024-04-26T10:20:34.427 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-04-26 10:16:02.132179630 +0000 2024-04-26T10:20:34.428 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-04-26T10:20:34.428 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T10:20:34.442 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-04-26T10:20:34.442 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-04-26T10:20:34.442 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000324519 s, 1.6 MB/s 2024-04-26T10:20:34.443 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T10:20:34.450 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T10:20:34.450 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T10:20:34.450 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2024-04-26T10:20:34.457 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-26T10:20:34.457 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 2024-04-26T10:20:34.465 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-26T10:20:34.465 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:20:34.465 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 360 Links: 1 2024-04-26T10:20:34.465 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:20:34.465 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-26 10:16:09.831890361 +0000 2024-04-26T10:20:34.465 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-26 10:16:09.615895338 +0000 2024-04-26T10:20:34.465 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-26 10:16:09.615895338 +0000 2024-04-26T10:20:34.465 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2024-04-26T10:20:34.465 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-26T10:20:34.478 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-26T10:20:34.478 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-26T10:20:34.478 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000423814 s, 1.2 MB/s 2024-04-26T10:20:34.479 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-26T10:20:34.529 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 2024-04-26T10:20:34.536 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-26T10:20:34.537 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:20:34.537 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 366 Links: 1 2024-04-26T10:20:34.537 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:20:34.537 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-26 10:16:10.103884091 +0000 2024-04-26T10:20:34.537 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-26 10:16:10.099884182 +0000 2024-04-26T10:20:34.537 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-26 10:16:10.099884182 +0000 2024-04-26T10:20:34.537 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2024-04-26T10:20:34.537 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-26T10:20:34.550 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-26T10:20:34.550 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-26T10:20:34.550 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000371606 s, 1.4 MB/s 2024-04-26T10:20:34.550 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-26T10:20:34.557 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 2024-04-26T10:20:34.607 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-26T10:20:34.608 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:20:34.608 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 371 Links: 1 2024-04-26T10:20:34.608 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:20:34.608 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-26 10:16:10.787868324 +0000 2024-04-26T10:20:34.608 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-26 10:16:10.575873210 +0000 2024-04-26T10:20:34.608 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-26 10:16:10.575873210 +0000 2024-04-26T10:20:34.608 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2024-04-26T10:20:34.608 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-26T10:20:34.618 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-26T10:20:34.619 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-26T10:20:34.619 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000401144 s, 1.3 MB/s 2024-04-26T10:20:34.620 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-26T10:20:34.627 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 2024-04-26T10:20:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-26T10:20:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-26T10:20:34.680 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 378 Links: 1 2024-04-26T10:20:34.680 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-26T10:20:34.680 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-04-26 10:16:11.287856799 +0000 2024-04-26T10:20:34.680 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-04-26 10:16:11.067861870 +0000 2024-04-26T10:20:34.681 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-04-26 10:16:11.067861870 +0000 2024-04-26T10:20:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2024-04-26T10:20:34.681 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-26T10:20:34.696 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-04-26T10:20:34.696 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-04-26T10:20:34.696 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000366721 s, 1.4 MB/s 2024-04-26T10:20:34.697 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-26T10:20:34.705 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T10:20:34.705 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T10:20:34.705 INFO:tasks.ceph:Generating config... 2024-04-26T10:20:34.707 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T10:20:34.707 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-26T10:20:34.707 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-26T10:20:34.707 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-26T10:20:34.707 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-26T10:20:34.707 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-26T10:20:34.707 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-26T10:20:34.707 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2024-04-26T10:20:34.707 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-26T10:20:34.707 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-26T10:20:34.707 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-26T10:20:34.708 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-26T10:20:34.708 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-26T10:20:34.708 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-26T10:20:34.708 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-26T10:20:34.708 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-26T10:20:34.708 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-26T10:20:34.708 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-26T10:20:34.708 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-26T10:20:34.708 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-26T10:20:34.708 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-26T10:20:34.708 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-26T10:20:34.708 INFO:tasks.ceph:Setting up mon.a... 2024-04-26T10:20:34.709 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-26T10:20:34.751 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.keyring 2024-04-26T10:20:34.771 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-26T10:20:34.859 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T10:20:34.876 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.52'), ('mon.b', '[v2:172.21.15.52:3301,v1:172.21.15.52:6790]'), ('mon.c', '[v2:172.21.15.52:3302,v1:172.21.15.52:6791]')] 2024-04-26T10:20:34.876 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}} 2024-04-26T10:20:34.877 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T10:20:34.877 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T10:20:34.925 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.52 --addv b '[v2:172.21.15.52:3301,v1:172.21.15.52:6790]' --addv c '[v2:172.21.15.52:3302,v1:172.21.15.52:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:20:34.970 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:20:34.970 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: generated fsid 485c78cb-ad62-4584-aba6-316dd9c93a12 2024-04-26T10:20:34.970 INFO:teuthology.orchestra.run.smithi052.stdout:setting min_mon_release = pacific 2024-04-26T10:20:34.970 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 0 2024-04-26T10:20:34.971 INFO:teuthology.orchestra.run.smithi052.stdout:fsid 485c78cb-ad62-4584-aba6-316dd9c93a12 2024-04-26T10:20:34.971 INFO:teuthology.orchestra.run.smithi052.stdout:last_changed 2024-04-26T10:20:34.968056+0000 2024-04-26T10:20:34.971 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-04-26T10:20:34.968056+0000 2024-04-26T10:20:34.971 INFO:teuthology.orchestra.run.smithi052.stdout:min_mon_release 16 (pacific) 2024-04-26T10:20:34.971 INFO:teuthology.orchestra.run.smithi052.stdout:election_strategy: 1 2024-04-26T10:20:34.971 INFO:teuthology.orchestra.run.smithi052.stdout:0: [v2:172.21.15.52:3300/0,v1:172.21.15.52:6789/0] mon.a 2024-04-26T10:20:34.971 INFO:teuthology.orchestra.run.smithi052.stdout:1: [v2:172.21.15.52:3301/0,v1:172.21.15.52:6790/0] mon.b 2024-04-26T10:20:34.971 INFO:teuthology.orchestra.run.smithi052.stdout:2: [v2:172.21.15.52:3302/0,v1:172.21.15.52:6791/0] mon.c 2024-04-26T10:20:34.971 INFO:teuthology.orchestra.run.smithi052.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-26T10:20:34.972 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-26T10:20:34.976 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 485c78cb-ad62-4584-aba6-316dd9c93a12... 2024-04-26T10:20:34.977 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T10:20:34.979 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T10:20:34.981 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T10:20:34.984 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-26T10:20:35.009 INFO:teuthology.orchestra.run.smithi052.stdout:[global] 2024-04-26T10:20:35.009 INFO:teuthology.orchestra.run.smithi052.stdout: chdir = "" 2024-04-26T10:20:35.010 INFO:teuthology.orchestra.run.smithi052.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T10:20:35.010 INFO:teuthology.orchestra.run.smithi052.stdout: auth supported = cephx 2024-04-26T10:20:35.010 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.010 INFO:teuthology.orchestra.run.smithi052.stdout: filestore xattr use omap = true 2024-04-26T10:20:35.010 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.010 INFO:teuthology.orchestra.run.smithi052.stdout: mon clock drift allowed = 1.000 2024-04-26T10:20:35.010 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.010 INFO:teuthology.orchestra.run.smithi052.stdout: osd crush chooseleaf type = 0 2024-04-26T10:20:35.010 INFO:teuthology.orchestra.run.smithi052.stdout: auth debug = true 2024-04-26T10:20:35.010 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.010 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on old message = true 2024-04-26T10:20:35.010 INFO:teuthology.orchestra.run.smithi052.stdout: ms die on bug = true 2024-04-26T10:20:35.010 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.010 INFO:teuthology.orchestra.run.smithi052.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T10:20:35.011 INFO:teuthology.orchestra.run.smithi052.stdout: mon pg warn max object skew = 0 2024-04-26T10:20:35.011 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.011 INFO:teuthology.orchestra.run.smithi052.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T10:20:35.011 INFO:teuthology.orchestra.run.smithi052.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T10:20:35.011 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.011 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default size = 2 2024-04-26T10:20:35.011 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.011 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow primary affinity = true 2024-04-26T10:20:35.011 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd allow pg remap = true 2024-04-26T10:20:35.011 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on legacy crush tunables = false 2024-04-26T10:20:35.011 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on crush straw calc version zero = false 2024-04-26T10:20:35.011 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on no sortbitwise = false 2024-04-26T10:20:35.011 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on osd down out interval zero = false 2024-04-26T10:20:35.011 INFO:teuthology.orchestra.run.smithi052.stdout: mon warn on too few osds = false 2024-04-26T10:20:35.011 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T10:20:35.012 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T10:20:35.012 INFO:teuthology.orchestra.run.smithi052.stdout: mon_allow_pool_size_one = true 2024-04-26T10:20:35.012 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.012 INFO:teuthology.orchestra.run.smithi052.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T10:20:35.012 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.012 INFO:teuthology.orchestra.run.smithi052.stdout: osd default data pool replay window = 5 2024-04-26T10:20:35.012 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.012 INFO:teuthology.orchestra.run.smithi052.stdout: mon allow pool delete = true 2024-04-26T10:20:35.012 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.012 INFO:teuthology.orchestra.run.smithi052.stdout: mon cluster log file level = debug 2024-04-26T10:20:35.012 INFO:teuthology.orchestra.run.smithi052.stdout: debug asserts on shutdown = true 2024-04-26T10:20:35.012 INFO:teuthology.orchestra.run.smithi052.stdout: mon health detail to clog = false 2024-04-26T10:20:35.012 INFO:teuthology.orchestra.run.smithi052.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]" 2024-04-26T10:20:35.012 INFO:teuthology.orchestra.run.smithi052.stdout: fsid = 485c78cb-ad62-4584-aba6-316dd9c93a12 2024-04-26T10:20:35.012 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.013 INFO:teuthology.orchestra.run.smithi052.stdout:[osd] 2024-04-26T10:20:35.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd journal size = 100 2024-04-26T10:20:35.013 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub load threshold = 5.0 2024-04-26T10:20:35.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd scrub max interval = 600 2024-04-26T10:20:35.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd mclock profile = high_recovery_ops 2024-04-26T10:20:35.013 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd recover clone overlap = true 2024-04-26T10:20:35.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd recovery max chunk = 1048576 2024-04-26T10:20:35.013 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug shutdown = true 2024-04-26T10:20:35.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug op order = true 2024-04-26T10:20:35.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug verify stray on activate = true 2024-04-26T10:20:35.013 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.013 INFO:teuthology.orchestra.run.smithi052.stdout: osd open classes on start = true 2024-04-26T10:20:35.014 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug pg log writeout = true 2024-04-26T10:20:35.014 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.014 INFO:teuthology.orchestra.run.smithi052.stdout: osd deep scrub update digest min age = 30 2024-04-26T10:20:35.014 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.014 INFO:teuthology.orchestra.run.smithi052.stdout: osd map max advance = 10 2024-04-26T10:20:35.014 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.014 INFO:teuthology.orchestra.run.smithi052.stdout: journal zero on create = true 2024-04-26T10:20:35.014 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.014 INFO:teuthology.orchestra.run.smithi052.stdout: filestore ondisk finisher threads = 3 2024-04-26T10:20:35.014 INFO:teuthology.orchestra.run.smithi052.stdout: filestore apply finisher threads = 3 2024-04-26T10:20:35.014 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.014 INFO:teuthology.orchestra.run.smithi052.stdout: bdev debug aio = true 2024-04-26T10:20:35.014 INFO:teuthology.orchestra.run.smithi052.stdout: osd debug misdirected ops = true 2024-04-26T10:20:35.015 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore block size = 96636764160 2024-04-26T10:20:35.015 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore compression algorithm = zstd 2024-04-26T10:20:35.015 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore compression mode = aggressive 2024-04-26T10:20:35.015 INFO:teuthology.orchestra.run.smithi052.stdout: bluestore fsck on mount = True 2024-04-26T10:20:35.015 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluefs = 1/20 2024-04-26T10:20:35.015 INFO:teuthology.orchestra.run.smithi052.stdout: debug bluestore = 1/20 2024-04-26T10:20:35.015 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-04-26T10:20:35.015 INFO:teuthology.orchestra.run.smithi052.stdout: debug osd = 20 2024-04-26T10:20:35.015 INFO:teuthology.orchestra.run.smithi052.stdout: debug rocksdb = 4/10 2024-04-26T10:20:35.015 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T10:20:35.015 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd full ratio = 0.9 2024-04-26T10:20:35.015 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd nearfull ratio = 0.8 2024-04-26T10:20:35.015 INFO:teuthology.orchestra.run.smithi052.stdout: osd blocked scrub grace period = 3600 2024-04-26T10:20:35.015 INFO:teuthology.orchestra.run.smithi052.stdout: osd failsafe full ratio = 0.95 2024-04-26T10:20:35.015 INFO:teuthology.orchestra.run.smithi052.stdout: osd max markdown count = 1000 2024-04-26T10:20:35.016 INFO:teuthology.orchestra.run.smithi052.stdout: osd objectstore = bluestore 2024-04-26T10:20:35.016 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.016 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr] 2024-04-26T10:20:35.016 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-04-26T10:20:35.016 INFO:teuthology.orchestra.run.smithi052.stdout: debug mgr = 20 2024-04-26T10:20:35.016 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-04-26T10:20:35.016 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-04-26T10:20:35.016 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:20:35.016 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:20:35.016 INFO:teuthology.orchestra.run.smithi052.stdout: mgr/telemetry/nag = false 2024-04-26T10:20:35.016 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.016 INFO:teuthology.orchestra.run.smithi052.stdout:[mon] 2024-04-26T10:20:35.016 INFO:teuthology.orchestra.run.smithi052.stdout: debug ms = 1 2024-04-26T10:20:35.016 INFO:teuthology.orchestra.run.smithi052.stdout: debug mon = 20 2024-04-26T10:20:35.016 INFO:teuthology.orchestra.run.smithi052.stdout: debug paxos = 20 2024-04-26T10:20:35.016 INFO:teuthology.orchestra.run.smithi052.stdout: debug auth = 20 2024-04-26T10:20:35.017 INFO:teuthology.orchestra.run.smithi052.stdout: mon data avail warn = 5 2024-04-26T10:20:35.017 INFO:teuthology.orchestra.run.smithi052.stdout: mon mgr mkfs grace = 240 2024-04-26T10:20:35.017 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:20:35.017 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd reporter subtree level = osd 2024-04-26T10:20:35.017 INFO:teuthology.orchestra.run.smithi052.stdout: mon osd prime pg temp = true 2024-04-26T10:20:35.017 INFO:teuthology.orchestra.run.smithi052.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:20:35.017 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.017 INFO:teuthology.orchestra.run.smithi052.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T10:20:35.017 INFO:teuthology.orchestra.run.smithi052.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T10:20:35.017 INFO:teuthology.orchestra.run.smithi052.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T10:20:35.017 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.017 INFO:teuthology.orchestra.run.smithi052.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T10:20:35.017 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T10:20:35.017 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T10:20:35.017 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.017 INFO:teuthology.orchestra.run.smithi052.stdout: # 1m isn't quite enough 2024-04-26T10:20:35.018 INFO:teuthology.orchestra.run.smithi052.stdout: mon_down_mkfs_grace = 2m 2024-04-26T10:20:35.018 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.018 INFO:teuthology.orchestra.run.smithi052.stdout: mon_warn_on_filestore_osds = false 2024-04-26T10:20:35.018 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:35.018 INFO:teuthology.orchestra.run.smithi052.stdout:[client] 2024-04-26T10:20:35.018 INFO:teuthology.orchestra.run.smithi052.stdout: rgw cache enabled = true 2024-04-26T10:20:35.018 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable ops log = true 2024-04-26T10:20:35.018 INFO:teuthology.orchestra.run.smithi052.stdout: rgw enable usage log = true 2024-04-26T10:20:35.018 INFO:teuthology.orchestra.run.smithi052.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T10:20:35.018 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T10:20:35.018 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.a] 2024-04-26T10:20:35.018 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.b] 2024-04-26T10:20:35.018 INFO:teuthology.orchestra.run.smithi052.stdout:[mon.c] 2024-04-26T10:20:35.018 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2024-04-26T10:20:35.019 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-04-26T10:20:35.019 INFO:teuthology.orchestra.run.smithi052.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T10:20:35.019 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2024-04-26T10:20:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2024-04-26T10:20:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T10:20:35.019 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2024-04-26T10:20:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2024-04-26T10:20:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2024-04-26T10:20:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2024-04-26T10:20:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2024-04-26T10:20:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2024-04-26T10:20:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2024-04-26T10:20:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T10:20:35.020 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2024-04-26T10:20:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T10:20:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T10:20:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2024-04-26T10:20:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2024-04-26T10:20:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2024-04-26T10:20:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2024-04-26T10:20:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2024-04-26T10:20:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2024-04-26T10:20:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2024-04-26T10:20:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2024-04-26T10:20:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T10:20:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T10:20:35.021 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2024-04-26T10:20:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T10:20:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2024-04-26T10:20:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2024-04-26T10:20:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2024-04-26T10:20:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2024-04-26T10:20:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2024-04-26T10:20:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]" 2024-04-26T10:20:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = 485c78cb-ad62-4584-aba6-316dd9c93a12 2024-04-26T10:20:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.022 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2024-04-26T10:20:35.022 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2024-04-26T10:20:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2024-04-26T10:20:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2024-04-26T10:20:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2024-04-26T10:20:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2024-04-26T10:20:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2024-04-26T10:20:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2024-04-26T10:20:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2024-04-26T10:20:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2024-04-26T10:20:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2024-04-26T10:20:35.023 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2024-04-26T10:20:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2024-04-26T10:20:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2024-04-26T10:20:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2024-04-26T10:20:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2024-04-26T10:20:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2024-04-26T10:20:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2024-04-26T10:20:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2024-04-26T10:20:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2024-04-26T10:20:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore compression algorithm = zstd 2024-04-26T10:20:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore compression mode = aggressive 2024-04-26T10:20:35.024 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2024-04-26T10:20:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2024-04-26T10:20:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2024-04-26T10:20:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-26T10:20:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2024-04-26T10:20:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2024-04-26T10:20:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T10:20:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2024-04-26T10:20:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2024-04-26T10:20:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: osd blocked scrub grace period = 3600 2024-04-26T10:20:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2024-04-26T10:20:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: osd max markdown count = 1000 2024-04-26T10:20:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2024-04-26T10:20:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.025 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2024-04-26T10:20:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-26T10:20:35.025 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2024-04-26T10:20:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-04-26T10:20:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-04-26T10:20:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:20:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:20:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2024-04-26T10:20:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.026 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2024-04-26T10:20:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-04-26T10:20:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-04-26T10:20:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2024-04-26T10:20:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-04-26T10:20:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2024-04-26T10:20:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2024-04-26T10:20:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:20:35.026 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2024-04-26T10:20:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2024-04-26T10:20:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:20:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T10:20:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T10:20:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T10:20:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T10:20:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T10:20:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T10:20:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2024-04-26T10:20:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2024-04-26T10:20:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2024-04-26T10:20:35.027 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-04-26T10:20:35.028 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2024-04-26T10:20:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2024-04-26T10:20:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2024-04-26T10:20:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2024-04-26T10:20:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T10:20:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T10:20:35.028 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2024-04-26T10:20:35.028 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2024-04-26T10:20:35.028 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2024-04-26T10:20:35.028 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2024-04-26T10:20:35.028 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2024-04-26T10:20:35.028 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T10:20:35.028 INFO:teuthology.orchestra.run.smithi120.stdout:[global] 2024-04-26T10:20:35.028 INFO:teuthology.orchestra.run.smithi120.stdout: chdir = "" 2024-04-26T10:20:35.029 INFO:teuthology.orchestra.run.smithi120.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T10:20:35.029 INFO:teuthology.orchestra.run.smithi120.stdout: auth supported = cephx 2024-04-26T10:20:35.029 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.029 INFO:teuthology.orchestra.run.smithi120.stdout: filestore xattr use omap = true 2024-04-26T10:20:35.029 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.029 INFO:teuthology.orchestra.run.smithi120.stdout: mon clock drift allowed = 1.000 2024-04-26T10:20:35.029 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.029 INFO:teuthology.orchestra.run.smithi120.stdout: osd crush chooseleaf type = 0 2024-04-26T10:20:35.029 INFO:teuthology.orchestra.run.smithi120.stdout: auth debug = true 2024-04-26T10:20:35.029 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.029 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on old message = true 2024-04-26T10:20:35.029 INFO:teuthology.orchestra.run.smithi120.stdout: ms die on bug = true 2024-04-26T10:20:35.029 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.029 INFO:teuthology.orchestra.run.smithi120.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T10:20:35.029 INFO:teuthology.orchestra.run.smithi120.stdout: mon pg warn max object skew = 0 2024-04-26T10:20:35.029 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.030 INFO:teuthology.orchestra.run.smithi120.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T10:20:35.030 INFO:teuthology.orchestra.run.smithi120.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T10:20:35.030 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.030 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default size = 2 2024-04-26T10:20:35.030 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.030 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow primary affinity = true 2024-04-26T10:20:35.030 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd allow pg remap = true 2024-04-26T10:20:35.030 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on legacy crush tunables = false 2024-04-26T10:20:35.030 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on crush straw calc version zero = false 2024-04-26T10:20:35.030 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on no sortbitwise = false 2024-04-26T10:20:35.030 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on osd down out interval zero = false 2024-04-26T10:20:35.030 INFO:teuthology.orchestra.run.smithi120.stdout: mon warn on too few osds = false 2024-04-26T10:20:35.030 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T10:20:35.030 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T10:20:35.031 INFO:teuthology.orchestra.run.smithi120.stdout: mon_allow_pool_size_one = true 2024-04-26T10:20:35.031 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.031 INFO:teuthology.orchestra.run.smithi120.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T10:20:35.031 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.031 INFO:teuthology.orchestra.run.smithi120.stdout: osd default data pool replay window = 5 2024-04-26T10:20:35.031 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.031 INFO:teuthology.orchestra.run.smithi120.stdout: mon allow pool delete = true 2024-04-26T10:20:35.031 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.031 INFO:teuthology.orchestra.run.smithi120.stdout: mon cluster log file level = debug 2024-04-26T10:20:35.031 INFO:teuthology.orchestra.run.smithi120.stdout: debug asserts on shutdown = true 2024-04-26T10:20:35.031 INFO:teuthology.orchestra.run.smithi120.stdout: mon health detail to clog = false 2024-04-26T10:20:35.031 INFO:teuthology.orchestra.run.smithi120.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]" 2024-04-26T10:20:35.031 INFO:teuthology.orchestra.run.smithi120.stdout: fsid = 485c78cb-ad62-4584-aba6-316dd9c93a12 2024-04-26T10:20:35.031 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.031 INFO:teuthology.orchestra.run.smithi120.stdout:[osd] 2024-04-26T10:20:35.032 INFO:teuthology.orchestra.run.smithi120.stdout: osd journal size = 100 2024-04-26T10:20:35.032 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.032 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub load threshold = 5.0 2024-04-26T10:20:35.032 INFO:teuthology.orchestra.run.smithi120.stdout: osd scrub max interval = 600 2024-04-26T10:20:35.032 INFO:teuthology.orchestra.run.smithi120.stdout: osd mclock profile = high_recovery_ops 2024-04-26T10:20:35.032 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.032 INFO:teuthology.orchestra.run.smithi120.stdout: osd recover clone overlap = true 2024-04-26T10:20:35.032 INFO:teuthology.orchestra.run.smithi120.stdout: osd recovery max chunk = 1048576 2024-04-26T10:20:35.032 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.032 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug shutdown = true 2024-04-26T10:20:35.032 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug op order = true 2024-04-26T10:20:35.032 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug verify stray on activate = true 2024-04-26T10:20:35.032 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.032 INFO:teuthology.orchestra.run.smithi120.stdout: osd open classes on start = true 2024-04-26T10:20:35.032 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug pg log writeout = true 2024-04-26T10:20:35.033 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.033 INFO:teuthology.orchestra.run.smithi120.stdout: osd deep scrub update digest min age = 30 2024-04-26T10:20:35.033 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.033 INFO:teuthology.orchestra.run.smithi120.stdout: osd map max advance = 10 2024-04-26T10:20:35.033 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.033 INFO:teuthology.orchestra.run.smithi120.stdout: journal zero on create = true 2024-04-26T10:20:35.033 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.033 INFO:teuthology.orchestra.run.smithi120.stdout: filestore ondisk finisher threads = 3 2024-04-26T10:20:35.033 INFO:teuthology.orchestra.run.smithi120.stdout: filestore apply finisher threads = 3 2024-04-26T10:20:35.033 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.033 INFO:teuthology.orchestra.run.smithi120.stdout: bdev debug aio = true 2024-04-26T10:20:35.033 INFO:teuthology.orchestra.run.smithi120.stdout: osd debug misdirected ops = true 2024-04-26T10:20:35.033 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore block size = 96636764160 2024-04-26T10:20:35.033 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore compression algorithm = zstd 2024-04-26T10:20:35.034 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore compression mode = aggressive 2024-04-26T10:20:35.034 INFO:teuthology.orchestra.run.smithi120.stdout: bluestore fsck on mount = True 2024-04-26T10:20:35.034 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluefs = 1/20 2024-04-26T10:20:35.034 INFO:teuthology.orchestra.run.smithi120.stdout: debug bluestore = 1/20 2024-04-26T10:20:35.034 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-04-26T10:20:35.034 INFO:teuthology.orchestra.run.smithi120.stdout: debug osd = 20 2024-04-26T10:20:35.034 INFO:teuthology.orchestra.run.smithi120.stdout: debug rocksdb = 4/10 2024-04-26T10:20:35.034 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T10:20:35.034 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd full ratio = 0.9 2024-04-26T10:20:35.034 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd nearfull ratio = 0.8 2024-04-26T10:20:35.034 INFO:teuthology.orchestra.run.smithi120.stdout: osd blocked scrub grace period = 3600 2024-04-26T10:20:35.034 INFO:teuthology.orchestra.run.smithi120.stdout: osd failsafe full ratio = 0.95 2024-04-26T10:20:35.034 INFO:teuthology.orchestra.run.smithi120.stdout: osd max markdown count = 1000 2024-04-26T10:20:35.035 INFO:teuthology.orchestra.run.smithi120.stdout: osd objectstore = bluestore 2024-04-26T10:20:35.035 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.035 INFO:teuthology.orchestra.run.smithi120.stdout:[mgr] 2024-04-26T10:20:35.035 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-04-26T10:20:35.035 INFO:teuthology.orchestra.run.smithi120.stdout: debug mgr = 20 2024-04-26T10:20:35.035 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-04-26T10:20:35.035 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-04-26T10:20:35.035 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:20:35.035 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:20:35.035 INFO:teuthology.orchestra.run.smithi120.stdout: mgr/telemetry/nag = false 2024-04-26T10:20:35.035 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.035 INFO:teuthology.orchestra.run.smithi120.stdout:[mon] 2024-04-26T10:20:35.035 INFO:teuthology.orchestra.run.smithi120.stdout: debug ms = 1 2024-04-26T10:20:35.035 INFO:teuthology.orchestra.run.smithi120.stdout: debug mon = 20 2024-04-26T10:20:35.035 INFO:teuthology.orchestra.run.smithi120.stdout: debug paxos = 20 2024-04-26T10:20:35.036 INFO:teuthology.orchestra.run.smithi120.stdout: debug auth = 20 2024-04-26T10:20:35.036 INFO:teuthology.orchestra.run.smithi120.stdout: mon data avail warn = 5 2024-04-26T10:20:35.036 INFO:teuthology.orchestra.run.smithi120.stdout: mon mgr mkfs grace = 240 2024-04-26T10:20:35.036 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:20:35.036 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd reporter subtree level = osd 2024-04-26T10:20:35.036 INFO:teuthology.orchestra.run.smithi120.stdout: mon osd prime pg temp = true 2024-04-26T10:20:35.036 INFO:teuthology.orchestra.run.smithi120.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:20:35.036 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.036 INFO:teuthology.orchestra.run.smithi120.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T10:20:35.036 INFO:teuthology.orchestra.run.smithi120.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T10:20:35.036 INFO:teuthology.orchestra.run.smithi120.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T10:20:35.036 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.036 INFO:teuthology.orchestra.run.smithi120.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T10:20:35.036 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T10:20:35.036 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T10:20:35.037 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.037 INFO:teuthology.orchestra.run.smithi120.stdout: # 1m isn't quite enough 2024-04-26T10:20:35.037 INFO:teuthology.orchestra.run.smithi120.stdout: mon_down_mkfs_grace = 2m 2024-04-26T10:20:35.037 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.037 INFO:teuthology.orchestra.run.smithi120.stdout: mon_warn_on_filestore_osds = false 2024-04-26T10:20:35.037 INFO:teuthology.orchestra.run.smithi120.stdout: 2024-04-26T10:20:35.037 INFO:teuthology.orchestra.run.smithi120.stdout:[client] 2024-04-26T10:20:35.037 INFO:teuthology.orchestra.run.smithi120.stdout: rgw cache enabled = true 2024-04-26T10:20:35.037 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable ops log = true 2024-04-26T10:20:35.037 INFO:teuthology.orchestra.run.smithi120.stdout: rgw enable usage log = true 2024-04-26T10:20:35.037 INFO:teuthology.orchestra.run.smithi120.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T10:20:35.037 INFO:teuthology.orchestra.run.smithi120.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T10:20:35.037 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.a] 2024-04-26T10:20:35.037 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.b] 2024-04-26T10:20:35.038 INFO:teuthology.orchestra.run.smithi120.stdout:[mon.c] 2024-04-26T10:20:35.038 INFO:teuthology.orchestra.run.smithi120.stdout:[mds.a] 2024-04-26T10:20:35.038 INFO:teuthology.orchestra.run.smithi120.stdout:[client.0] 2024-04-26T10:20:35.038 INFO:teuthology.orchestra.run.smithi120.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T10:20:35.040 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-04-26T10:20:35.040 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2024-04-26T10:20:35.040 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-26T10:20:35.040 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2024-04-26T10:20:35.040 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.040 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2024-04-26T10:20:35.041 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.041 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2024-04-26T10:20:35.041 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.041 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2024-04-26T10:20:35.041 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2024-04-26T10:20:35.041 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.041 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2024-04-26T10:20:35.041 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2024-04-26T10:20:35.041 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.041 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-26T10:20:35.041 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2024-04-26T10:20:35.041 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.041 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2024-04-26T10:20:35.041 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-26T10:20:35.042 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.042 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2024-04-26T10:20:35.042 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.042 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2024-04-26T10:20:35.042 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2024-04-26T10:20:35.042 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2024-04-26T10:20:35.042 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2024-04-26T10:20:35.042 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2024-04-26T10:20:35.042 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2024-04-26T10:20:35.042 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2024-04-26T10:20:35.042 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-26T10:20:35.042 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-26T10:20:35.042 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2024-04-26T10:20:35.042 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.043 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-26T10:20:35.043 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.043 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2024-04-26T10:20:35.043 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.043 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2024-04-26T10:20:35.043 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.043 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2024-04-26T10:20:35.043 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2024-04-26T10:20:35.043 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2024-04-26T10:20:35.043 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]" 2024-04-26T10:20:35.043 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 485c78cb-ad62-4584-aba6-316dd9c93a12 2024-04-26T10:20:35.043 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.043 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2024-04-26T10:20:35.043 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2024-04-26T10:20:35.043 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.044 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2024-04-26T10:20:35.044 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2024-04-26T10:20:35.044 INFO:teuthology.orchestra.run.smithi164.stdout: osd mclock profile = high_recovery_ops 2024-04-26T10:20:35.044 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.044 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2024-04-26T10:20:35.044 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2024-04-26T10:20:35.044 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.044 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2024-04-26T10:20:35.044 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2024-04-26T10:20:35.044 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2024-04-26T10:20:35.044 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.044 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2024-04-26T10:20:35.044 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2024-04-26T10:20:35.044 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.045 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2024-04-26T10:20:35.045 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.045 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2024-04-26T10:20:35.045 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.045 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2024-04-26T10:20:35.045 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.045 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2024-04-26T10:20:35.045 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2024-04-26T10:20:35.045 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.045 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2024-04-26T10:20:35.045 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2024-04-26T10:20:35.045 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2024-04-26T10:20:35.045 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore compression algorithm = zstd 2024-04-26T10:20:35.045 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore compression mode = aggressive 2024-04-26T10:20:35.045 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2024-04-26T10:20:35.046 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 1/20 2024-04-26T10:20:35.046 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 1/20 2024-04-26T10:20:35.046 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-04-26T10:20:35.046 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2024-04-26T10:20:35.046 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 4/10 2024-04-26T10:20:35.046 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2024-04-26T10:20:35.046 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2024-04-26T10:20:35.046 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2024-04-26T10:20:35.046 INFO:teuthology.orchestra.run.smithi164.stdout: osd blocked scrub grace period = 3600 2024-04-26T10:20:35.046 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2024-04-26T10:20:35.046 INFO:teuthology.orchestra.run.smithi164.stdout: osd max markdown count = 1000 2024-04-26T10:20:35.046 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2024-04-26T10:20:35.046 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.046 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2024-04-26T10:20:35.047 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-04-26T10:20:35.047 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2024-04-26T10:20:35.047 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-04-26T10:20:35.047 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-04-26T10:20:35.047 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:20:35.047 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:20:35.047 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2024-04-26T10:20:35.047 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.047 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2024-04-26T10:20:35.047 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2024-04-26T10:20:35.047 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2024-04-26T10:20:35.047 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2024-04-26T10:20:35.047 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2024-04-26T10:20:35.047 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2024-04-26T10:20:35.047 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2024-04-26T10:20:35.047 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2024-04-26T10:20:35.048 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2024-04-26T10:20:35.048 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2024-04-26T10:20:35.048 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2024-04-26T10:20:35.048 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.048 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-26T10:20:35.048 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2024-04-26T10:20:35.048 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2024-04-26T10:20:35.048 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.048 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2024-04-26T10:20:35.048 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-26T10:20:35.048 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-26T10:20:35.048 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.048 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2024-04-26T10:20:35.048 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2024-04-26T10:20:35.048 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.049 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2024-04-26T10:20:35.049 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-04-26T10:20:35.049 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2024-04-26T10:20:35.049 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2024-04-26T10:20:35.049 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2024-04-26T10:20:35.049 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2024-04-26T10:20:35.049 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-26T10:20:35.049 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-26T10:20:35.049 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2024-04-26T10:20:35.049 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2024-04-26T10:20:35.049 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2024-04-26T10:20:35.049 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2024-04-26T10:20:35.049 INFO:teuthology.orchestra.run.smithi164.stdout:[client.0] 2024-04-26T10:20:35.049 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-26T10:20:35.050 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-26T10:20:35.050 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-26T10:20:35.138 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-26T10:20:35.138 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T10:20:35.139 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-26T10:20:35.146 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T10:20:35.146 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-26T10:20:35.151 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi052.front.sepia.ceph.com 2024-04-26T10:20:35.151 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T10:20:35.151 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T10:20:35.152 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T10:20:35.221 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T10:20:35.221 DEBUG:teuthology.orchestra.run.smithi052:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:20:35.227 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi120.front.sepia.ceph.com 2024-04-26T10:20:35.227 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T10:20:35.227 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T10:20:35.227 DEBUG:teuthology.orchestra.run.smithi120:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T10:20:35.254 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T10:20:35.254 DEBUG:teuthology.orchestra.run.smithi120:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:20:35.304 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2024-04-26T10:20:35.304 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T10:20:35.305 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T10:20:35.305 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T10:20:35.331 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T10:20:35.331 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:20:35.336 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2024-04-26T10:20:35.336 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T10:20:35.336 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-26T10:20:35.336 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-26T10:20:35.362 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T10:20:35.362 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:20:35.411 INFO:tasks.ceph:Setting up mon nodes... 2024-04-26T10:20:35.411 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-26T10:20:35.411 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T10:20:35.463 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-26T10:20:35.466 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T10:20:35.512 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-26T10:20:35.515 INFO:tasks.ceph:Setting up mds nodes... 2024-04-26T10:20:35.515 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T10:20:35.562 INFO:teuthology.orchestra.run.smithi052.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-26T10:20:35.565 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-26T10:20:35.578 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-26T10:20:35.578 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-26T10:20:35.617 INFO:teuthology.orchestra.run.smithi052.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-26T10:20:35.631 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-26T10:20:35.631 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi120.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-26T10:20:35.631 DEBUG:teuthology.orchestra.run.smithi120:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-26T10:20:35.647 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-26T10:20:35.647 INFO:tasks.ceph:role: osd.0 2024-04-26T10:20:35.647 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com 2024-04-26T10:20:35.647 DEBUG:teuthology.orchestra.run.smithi120:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T10:20:36.178 INFO:teuthology.orchestra.run.smithi120.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T10:20:36.178 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T10:20:36.178 INFO:teuthology.orchestra.run.smithi120.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T10:20:36.178 INFO:teuthology.orchestra.run.smithi120.stdout: = reflink=1 2024-04-26T10:20:36.178 INFO:teuthology.orchestra.run.smithi120.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T10:20:36.178 INFO:teuthology.orchestra.run.smithi120.stdout: = sunit=0 swidth=0 blks 2024-04-26T10:20:36.178 INFO:teuthology.orchestra.run.smithi120.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T10:20:36.179 INFO:teuthology.orchestra.run.smithi120.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T10:20:36.179 INFO:teuthology.orchestra.run.smithi120.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T10:20:36.179 INFO:teuthology.orchestra.run.smithi120.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T10:20:36.180 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi120.front.sepia.ceph.com -o noatime 2024-04-26T10:20:36.180 DEBUG:teuthology.orchestra.run.smithi120:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-26T10:20:36.270 DEBUG:teuthology.orchestra.run.smithi120:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-26T10:20:36.282 INFO:teuthology.orchestra.run.smithi120.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T10:20:36.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:20:36.283 DEBUG:teuthology.orchestra.run.smithi120:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:20:36.410 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T10:20:36.403+0000 7fe256f59880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-26T10:20:36.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T10:20:36.407+0000 7fe256f59880 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-26T10:20:36.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T10:20:36.407+0000 7fe256f59880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T10:20:36.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T10:20:36.407+0000 7fe256f59880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T10:20:36.412 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T10:20:36.407+0000 7fe256f59880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-26T10:20:36.419 INFO:teuthology.orchestra.run.smithi120.stderr:2024-04-26T10:20:36.415+0000 7fe256f59880 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-26T10:20:39.434 DEBUG:teuthology.orchestra.run.smithi120:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-26T10:20:39.452 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-26T10:20:39.469 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-26T10:20:39.470 INFO:tasks.ceph:role: osd.1 2024-04-26T10:20:39.470 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-26T10:20:39.470 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T10:20:39.984 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T10:20:39.985 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T10:20:39.985 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T10:20:39.985 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 2024-04-26T10:20:39.985 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T10:20:39.985 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-04-26T10:20:39.985 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T10:20:39.985 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T10:20:39.985 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T10:20:39.985 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T10:20:39.987 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-04-26T10:20:39.987 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-26T10:20:40.062 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-26T10:20:40.073 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:20:40.074 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T10:20:40.074 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:20:40.161 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-26T10:20:40.158+0000 7fb30e7a0880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-26T10:20:40.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-26T10:20:40.162+0000 7fb30e7a0880 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-26T10:20:40.164 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-26T10:20:40.162+0000 7fb30e7a0880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T10:20:40.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-26T10:20:40.162+0000 7fb30e7a0880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T10:20:40.165 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-26T10:20:40.162+0000 7fb30e7a0880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-26T10:20:40.169 INFO:teuthology.orchestra.run.smithi154.stderr:2024-04-26T10:20:40.166+0000 7fb30e7a0880 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-26T10:20:43.163 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-26T10:20:43.180 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-26T10:20:43.196 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-26T10:20:43.197 INFO:tasks.ceph:role: osd.2 2024-04-26T10:20:43.197 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-26T10:20:43.197 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-26T10:20:43.729 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-26T10:20:43.729 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-26T10:20:43.729 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-26T10:20:43.729 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 2024-04-26T10:20:43.729 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-26T10:20:43.729 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2024-04-26T10:20:43.729 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-26T10:20:43.729 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-26T10:20:43.729 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-26T10:20:43.729 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-26T10:20:43.731 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2024-04-26T10:20:43.731 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-26T10:20:43.828 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-26T10:20:43.840 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: /sbin/restorecon: command not found 2024-04-26T10:20:43.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:20:43.841 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:20:43.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-26T10:20:43.929+0000 7f4793217880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-26T10:20:43.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-26T10:20:43.933+0000 7f4793217880 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-26T10:20:43.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-26T10:20:43.933+0000 7f4793217880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T10:20:43.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-26T10:20:43.933+0000 7f4793217880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T10:20:43.936 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-26T10:20:43.933+0000 7f4793217880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-26T10:20:43.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-04-26T10:20:43.941+0000 7f4793217880 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-26T10:20:46.953 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-26T10:20:46.967 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-26T10:20:46.968 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T10:20:46.968 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-26T10:20:46.984 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T10:20:46.984 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-26T10:20:46.995 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T10:20:46.995 DEBUG:teuthology.orchestra.run.smithi052:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-26T10:20:47.011 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T10:20:47.011 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-26T10:20:47.027 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T10:20:47.028 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-26T10:20:47.044 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T10:20:47.044 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-26T10:20:47.060 DEBUG:teuthology.orchestra.run.smithi052:> set -ex 2024-04-26T10:20:47.061 DEBUG:teuthology.orchestra.run.smithi052:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-26T10:20:47.067 INFO:tasks.ceph:Adding keys to all mons... 2024-04-26T10:20:47.068 DEBUG:teuthology.orchestra.run.smithi052:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-26T10:20:47.124 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.x] 2024-04-26T10:20:47.124 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDzfytmTZl6GxAA9oBiyxxqT3FiaHS1Fld1cA== 2024-04-26T10:20:47.125 INFO:teuthology.orchestra.run.smithi052.stdout:[mgr.y] 2024-04-26T10:20:47.125 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDzfytmomBpHhAAifViX7gavghz2qE3NurIAQ== 2024-04-26T10:20:47.125 INFO:teuthology.orchestra.run.smithi052.stdout:[mds.a] 2024-04-26T10:20:47.125 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDzfytmtlFpIRAAjZ+dsaL8PgCP6bHlTDvQIg== 2024-04-26T10:20:47.125 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.0] 2024-04-26T10:20:47.125 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD0fytmP9VlGBAAFShQihHxLdADjX6cDaswQA== 2024-04-26T10:20:47.125 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.1] 2024-04-26T10:20:47.125 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD4fytmdhikCRAA1RwWARBQxjqLZ19Sm7RMgg== 2024-04-26T10:20:47.125 INFO:teuthology.orchestra.run.smithi052.stdout:[osd.2] 2024-04-26T10:20:47.125 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQD7fytmrNSnNxAAu4Wg1KX6MQkh+1Bqf+k0xQ== 2024-04-26T10:20:47.125 INFO:teuthology.orchestra.run.smithi052.stdout:[client.0] 2024-04-26T10:20:47.125 INFO:teuthology.orchestra.run.smithi052.stdout: key = AQDzfytmQ1+qJBAA4RgkjDPayREpjdP/D+Mbhg== 2024-04-26T10:20:47.126 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T10:20:47.172 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-26T10:20:47.217 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-26T10:20:47.263 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T10:20:47.357 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T10:20:47.402 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-26T10:20:47.446 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-26T10:20:47.545 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-26T10:20:47.545 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-26T10:20:47.555 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T10:20:47.668 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-26T10:20:47.685 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-26T10:20:47.695 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T10:20:47.856 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-26T10:20:47.874 DEBUG:teuthology.orchestra.run.smithi052:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-26T10:20:47.884 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-26T10:20:47.964 DEBUG:teuthology.orchestra.run.smithi052:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-26T10:20:47.980 DEBUG:teuthology.orchestra.run.smithi052:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-26T10:20:47.986 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-26T10:20:47.986 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T10:20:47.986 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T10:20:48.032 INFO:tasks.ceph.mon.a:Started 2024-04-26T10:20:48.032 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T10:20:48.032 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T10:20:48.034 INFO:tasks.ceph.mon.b:Started 2024-04-26T10:20:48.034 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T10:20:48.035 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T10:20:48.037 INFO:tasks.ceph.mon.c:Started 2024-04-26T10:20:48.037 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-26T10:20:48.037 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-26T10:20:48.037 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-26T10:20:48.039 INFO:tasks.ceph.mgr.x:Started 2024-04-26T10:20:48.040 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-26T10:20:48.040 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-26T10:20:48.042 INFO:tasks.ceph.mgr.y:Started 2024-04-26T10:20:48.042 INFO:tasks.ceph:Setting crush tunables to default 2024-04-26T10:20:48.042 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd crush tunables default 2024-04-26T10:20:48.579 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:48.573+0000 7fe5d5e682c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T10:20:48.869 INFO:teuthology.orchestra.run.smithi052.stderr:adjusted tunables profile to default 2024-04-26T10:20:48.874 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:48.865+0000 7f18496452c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-26T10:20:48.879 INFO:tasks.ceph:check_enable_crimson: False 2024-04-26T10:20:48.879 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-26T10:20:48.879 DEBUG:teuthology.orchestra.run.smithi120:> set -ex 2024-04-26T10:20:48.879 DEBUG:teuthology.orchestra.run.smithi120:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-26T10:20:48.895 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-04-26T10:20:48.895 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-26T10:20:48.911 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-04-26T10:20:48.911 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-26T10:20:48.927 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new c5e76c47-dfc4-40ca-88d3-2084cac6e35c 0 2024-04-26T10:20:49.139 INFO:teuthology.orchestra.run.smithi164.stdout:0 2024-04-26T10:20:49.159 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 2a8d530c-cf33-4540-9240-6bd7485e06ee 1 2024-04-26T10:20:49.285 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:49.277+0000 7fe5d5e682c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T10:20:49.326 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:49.317+0000 7f18496452c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-26T10:20:49.341 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:49.333+0000 7fe5d5e682c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T10:20:49.365 INFO:teuthology.orchestra.run.smithi164.stdout:1 2024-04-26T10:20:49.379 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 484ab70f-4cad-4ff6-9405-8865ec5ee327 2 2024-04-26T10:20:49.382 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:49.377+0000 7f18496452c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-26T10:20:49.513 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:49.505+0000 7fe5d5e682c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T10:20:49.548 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:49.541+0000 7f18496452c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-26T10:20:49.583 INFO:teuthology.orchestra.run.smithi164.stdout:2 2024-04-26T10:20:49.596 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-26T10:20:49.596 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-26T10:20:49.598 INFO:tasks.ceph.osd.0:Started 2024-04-26T10:20:49.598 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-26T10:20:49.599 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-26T10:20:49.601 INFO:tasks.ceph.osd.1:Started 2024-04-26T10:20:49.601 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T10:20:49.601 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T10:20:49.603 INFO:tasks.ceph.osd.2:Started 2024-04-26T10:20:49.603 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:20:49.744 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:49.737+0000 7fe5d5e682c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T10:20:49.754 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:49.749+0000 7f18496452c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-26T10:20:49.785 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:20:49.785 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","created":"2024-04-26T10:20:48.363934+0000","modified":"2024-04-26T10:20:49.575442+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T10:20:49.575442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c5e76c47-dfc4-40ca-88d3-2084cac6e35c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2a8d530c-cf33-4540-9240-6bd7485e06ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"484ab70f-4cad-4ff6-9405-8865ec5ee327","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:20:49.796 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:49.789+0000 7fe5d5e682c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T10:20:49.800 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-26T10:20:49.801 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-26T10:20:49.806 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:49.797+0000 7f18496452c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-26T10:20:49.996 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:49.989+0000 7f18496452c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T10:20:49.996 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:49.989+0000 7fe5d5e682c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-26T10:20:50.061 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:50.053+0000 7fe5d5e682c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T10:20:50.062 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:50.053+0000 7f18496452c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-26T10:20:50.103 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T10:20:50.126 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:50.117+0000 7f18496452c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T10:20:50.141 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:50.133+0000 7fe5d5e682c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-26T10:20:50.211 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:20:50.209+0000 7f466ae56880 -1 Falling back to public interface 2024-04-26T10:20:50.216 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:20:50.210+0000 7f5cf0bf1880 -1 Falling back to public interface 2024-04-26T10:20:50.225 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:20:50.221+0000 7f00dba37880 -1 Falling back to public interface 2024-04-26T10:20:50.272 INFO:teuthology.misc.health.smithi052.stdout: 2024-04-26T10:20:50.272 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":5,"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","created":"2024-04-26T10:20:48.363934+0000","modified":"2024-04-26T10:20:49.575442+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T10:20:49.575442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c5e76c47-dfc4-40ca-88d3-2084cac6e35c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2a8d530c-cf33-4540-9240-6bd7485e06ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"484ab70f-4cad-4ff6-9405-8865ec5ee327","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:20:50.284 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-26T10:20:50.659 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:50.653+0000 7f18496452c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T10:20:50.660 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:50.653+0000 7fe5d5e682c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-26T10:20:50.783 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:50.777+0000 7f18496452c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T10:20:50.785 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:50.777+0000 7fe5d5e682c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-26T10:20:51.142 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:51.133+0000 7fe5d5e682c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T10:20:51.143 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:51.137+0000 7f18496452c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-26T10:20:51.336 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:51.329+0000 7f18496452c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T10:20:51.336 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:51.329+0000 7fe5d5e682c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-26T10:20:51.404 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:51.397+0000 7f18496452c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T10:20:51.405 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:51.397+0000 7fe5d5e682c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-26T10:20:51.573 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:51.565+0000 7fe5d5e682c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T10:20:51.574 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:51.565+0000 7f18496452c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-26T10:20:52.380 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:52.373+0000 7fe5d5e682c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T10:20:52.380 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:52.373+0000 7f18496452c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-26T10:20:52.453 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:52.445+0000 7f18496452c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T10:20:52.454 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:52.445+0000 7fe5d5e682c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-26T10:20:52.625 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:52.617+0000 7fe5d5e682c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T10:20:52.625 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:52.617+0000 7f18496452c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-26T10:20:52.695 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:52.689+0000 7f18496452c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T10:20:52.695 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:52.689+0000 7fe5d5e682c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-26T10:20:52.774 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:52.765+0000 7f18496452c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T10:20:52.774 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:52.765+0000 7fe5d5e682c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-26T10:20:53.106 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:53.097+0000 7f18496452c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T10:20:53.110 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:53.101+0000 7fe5d5e682c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-26T10:20:53.186 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:53.177+0000 7f18496452c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T10:20:53.186 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:53.177+0000 7fe5d5e682c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-26T10:20:53.715 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:20:53.713+0000 7f466ae56880 -1 osd.2 0 log_to_monitors true 2024-04-26T10:20:53.915 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:20:53.910+0000 7f5cf0bf1880 -1 osd.0 0 log_to_monitors true 2024-04-26T10:20:53.924 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:53.917+0000 7f18496452c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T10:20:53.924 INFO:tasks.ceph.mgr.y.smithi052.stderr:2024-04-26T10:20:53.917+0000 7fe5d5e682c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-26T10:20:53.935 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:20:53.929+0000 7f00dba37880 -1 osd.1 0 log_to_monitors true 2024-04-26T10:20:54.951 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:54.945+0000 7f183020b700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-26T10:20:54.952 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:20:54.945+0000 7f183020b700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-26T10:20:56.055 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:20:56.053+0000 7f4666c95700 -1 osd.2 0 waiting for initial osdmap 2024-04-26T10:20:56.059 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:20:56.057+0000 7f465e744700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T10:20:56.587 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T10:20:56.892 INFO:teuthology.misc.health.smithi052.stdout: 2024-04-26T10:20:56.892 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":8,"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","created":"2024-04-26T10:20:48.363934+0000","modified":"2024-04-26T10:20:55.777521+0000","last_up_change":"0.000000","last_in_change":"2024-04-26T10:20:49.575442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c5e76c47-dfc4-40ca-88d3-2084cac6e35c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2a8d530c-cf33-4540-9240-6bd7485e06ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"484ab70f-4cad-4ff6-9405-8865ec5ee327","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:20:56.904 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-26T10:20:57.073 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:20:57.069+0000 7f00d7876700 -1 osd.1 0 waiting for initial osdmap 2024-04-26T10:20:57.079 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:20:57.073+0000 7f00cf325700 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T10:20:57.098 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:20:57.090+0000 7f5ceca30700 -1 osd.0 0 waiting for initial osdmap 2024-04-26T10:20:57.103 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:20:57.098+0000 7f5ce44df700 -1 osd.0 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T10:21:03.208 DEBUG:teuthology.orchestra.run.smithi052:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-26T10:21:03.508 INFO:teuthology.misc.health.smithi052.stdout: 2024-04-26T10:21:03.508 INFO:teuthology.misc.health.smithi052.stdout:{"epoch":14,"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","created":"2024-04-26T10:20:48.363934+0000","modified":"2024-04-26T10:21:02.827614+0000","last_up_change":"2024-04-26T10:20:58.098141+0000","last_in_change":"2024-04-26T10:20:49.575442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:20:59.994755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5e76c47-dfc4-40ca-88d3-2084cac6e35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":18193},{"type":"v1","addr":"172.21.15.120:6801","nonce":18193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":18193},{"type":"v1","addr":"172.21.15.120:6803","nonce":18193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":18193},{"type":"v1","addr":"172.21.15.120:6807","nonce":18193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":18193},{"type":"v1","addr":"172.21.15.120:6805","nonce":18193}]},"public_addr":"172.21.15.120:6801/18193","cluster_addr":"172.21.15.120:6803/18193","heartbeat_back_addr":"172.21.15.120:6807/18193","heartbeat_front_addr":"172.21.15.120:6805/18193","state":["exists","up"]},{"osd":1,"uuid":"2a8d530c-cf33-4540-9240-6bd7485e06ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":18226},{"type":"v1","addr":"172.21.15.154:6801","nonce":18226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":18226},{"type":"v1","addr":"172.21.15.154:6803","nonce":18226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":18226},{"type":"v1","addr":"172.21.15.154:6807","nonce":18226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":18226},{"type":"v1","addr":"172.21.15.154:6805","nonce":18226}]},"public_addr":"172.21.15.154:6801/18226","cluster_addr":"172.21.15.154:6803/18226","heartbeat_back_addr":"172.21.15.154:6807/18226","heartbeat_front_addr":"172.21.15.154:6805/18226","state":["exists","up"]},{"osd":2,"uuid":"484ab70f-4cad-4ff6-9405-8865ec5ee327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":18269},{"type":"v1","addr":"172.21.15.164:6801","nonce":18269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":18269},{"type":"v1","addr":"172.21.15.164:6803","nonce":18269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":18269},{"type":"v1","addr":"172.21.15.164:6807","nonce":18269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":18269},{"type":"v1","addr":"172.21.15.164:6805","nonce":18269}]},"public_addr":"172.21.15.164:6801/18269","cluster_addr":"172.21.15.164:6803/18269","heartbeat_back_addr":"172.21.15.164:6807/18269","heartbeat_front_addr":"172.21.15.164:6805/18269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.871567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.910527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.761919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:21:03.527 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-26T10:21:03.527 INFO:tasks.ceph:Creating RBD pool 2024-04-26T10:21:03.527 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-26T10:21:03.885 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'rbd' created 2024-04-26T10:21:03.897 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-26T10:21:04.891 INFO:teuthology.orchestra.run.smithi052.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-26T10:21:04.904 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-26T10:21:04.904 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-26T10:21:04.904 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-26T10:21:04.906 INFO:tasks.ceph.mds.a:Started 2024-04-26T10:21:04.906 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-26T10:21:04.907 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:21:04.980 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-04-26T10:21:05.204 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:05.204 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":16,"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","created":"2024-04-26T10:20:48.363934+0000","modified":"2024-04-26T10:21:04.875089+0000","last_up_change":"2024-04-26T10:20:58.098141+0000","last_in_change":"2024-04-26T10:20:49.575442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:20:59.994755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:21:03.866927+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5e76c47-dfc4-40ca-88d3-2084cac6e35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":18193},{"type":"v1","addr":"172.21.15.120:6801","nonce":18193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":18193},{"type":"v1","addr":"172.21.15.120:6803","nonce":18193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":18193},{"type":"v1","addr":"172.21.15.120:6807","nonce":18193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":18193},{"type":"v1","addr":"172.21.15.120:6805","nonce":18193}]},"public_addr":"172.21.15.120:6801/18193","cluster_addr":"172.21.15.120:6803/18193","heartbeat_back_addr":"172.21.15.120:6807/18193","heartbeat_front_addr":"172.21.15.120:6805/18193","state":["exists","up"]},{"osd":1,"uuid":"2a8d530c-cf33-4540-9240-6bd7485e06ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":18226},{"type":"v1","addr":"172.21.15.154:6801","nonce":18226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":18226},{"type":"v1","addr":"172.21.15.154:6803","nonce":18226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":18226},{"type":"v1","addr":"172.21.15.154:6807","nonce":18226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":18226},{"type":"v1","addr":"172.21.15.154:6805","nonce":18226}]},"public_addr":"172.21.15.154:6801/18226","cluster_addr":"172.21.15.154:6803/18226","heartbeat_back_addr":"172.21.15.154:6807/18226","heartbeat_front_addr":"172.21.15.154:6805/18226","state":["exists","up"]},{"osd":2,"uuid":"484ab70f-4cad-4ff6-9405-8865ec5ee327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":18269},{"type":"v1","addr":"172.21.15.164:6801","nonce":18269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":18269},{"type":"v1","addr":"172.21.15.164:6803","nonce":18269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":18269},{"type":"v1","addr":"172.21.15.164:6807","nonce":18269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":18269},{"type":"v1","addr":"172.21.15.164:6805","nonce":18269}]},"public_addr":"172.21.15.164:6801/18269","cluster_addr":"172.21.15.164:6803/18269","heartbeat_back_addr":"172.21.15.164:6807/18269","heartbeat_front_addr":"172.21.15.164:6805/18269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.871567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.910527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.761919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:21:05.219 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:20:59.994755+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:21:03.866927+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T10:21:05.219 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T10:21:05.523 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-26T10:21:05.537 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T10:21:05.842 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2024-04-26T10:21:05.857 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:21:06.196 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:06.196 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.52:6803/2540560872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2540560872},{"type":"v1","addr":"172.21.15.52:6803","nonce":2540560872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-26T10:21:06.201 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 2 2024-04-26T10:21:06.216 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:21:06.516 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:06.516 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":17,"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","created":"2024-04-26T10:20:48.363934+0000","modified":"2024-04-26T10:21:05.883589+0000","last_up_change":"2024-04-26T10:20:58.098141+0000","last_in_change":"2024-04-26T10:20:49.575442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:20:59.994755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:21:03.866927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5e76c47-dfc4-40ca-88d3-2084cac6e35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":18193},{"type":"v1","addr":"172.21.15.120:6801","nonce":18193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":18193},{"type":"v1","addr":"172.21.15.120:6803","nonce":18193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":18193},{"type":"v1","addr":"172.21.15.120:6807","nonce":18193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":18193},{"type":"v1","addr":"172.21.15.120:6805","nonce":18193}]},"public_addr":"172.21.15.120:6801/18193","cluster_addr":"172.21.15.120:6803/18193","heartbeat_back_addr":"172.21.15.120:6807/18193","heartbeat_front_addr":"172.21.15.120:6805/18193","state":["exists","up"]},{"osd":1,"uuid":"2a8d530c-cf33-4540-9240-6bd7485e06ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":18226},{"type":"v1","addr":"172.21.15.154:6801","nonce":18226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":18226},{"type":"v1","addr":"172.21.15.154:6803","nonce":18226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":18226},{"type":"v1","addr":"172.21.15.154:6807","nonce":18226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":18226},{"type":"v1","addr":"172.21.15.154:6805","nonce":18226}]},"public_addr":"172.21.15.154:6801/18226","cluster_addr":"172.21.15.154:6803/18226","heartbeat_back_addr":"172.21.15.154:6807/18226","heartbeat_front_addr":"172.21.15.154:6805/18226","state":["exists","up"]},{"osd":2,"uuid":"484ab70f-4cad-4ff6-9405-8865ec5ee327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":18269},{"type":"v1","addr":"172.21.15.164:6801","nonce":18269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":18269},{"type":"v1","addr":"172.21.15.164:6803","nonce":18269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":18269},{"type":"v1","addr":"172.21.15.164:6807","nonce":18269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":18269},{"type":"v1","addr":"172.21.15.164:6805","nonce":18269}]},"public_addr":"172.21.15.164:6801/18269","cluster_addr":"172.21.15.164:6803/18269","heartbeat_back_addr":"172.21.15.164:6807/18269","heartbeat_front_addr":"172.21.15.164:6805/18269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.871567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.910527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.761919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:21:06.530 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:20:59.994755+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:21:03.866927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T10:21:06.530 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T10:21:06.844 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-26T10:21:06.859 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T10:21:07.171 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2024-04-26T10:21:07.187 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-26T10:21:07.490 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:07.490 INFO:teuthology.orchestra.run.smithi052.stdout:[ 2024-04-26T10:21:07.490 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:07.490 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 1, 2024-04-26T10:21:07.490 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": ".mgr" 2024-04-26T10:21:07.490 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:07.490 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:07.490 INFO:teuthology.orchestra.run.smithi052.stdout: "poolnum": 2, 2024-04-26T10:21:07.490 INFO:teuthology.orchestra.run.smithi052.stdout: "poolname": "rbd" 2024-04-26T10:21:07.491 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:07.491 INFO:teuthology.orchestra.run.smithi052.stdout:] 2024-04-26T10:21:07.503 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-26T10:21:07.503 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-26T10:21:07.915 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' created 2024-04-26T10:21:07.927 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-26T10:21:08.932 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' created 2024-04-26T10:21:08.940 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-26T10:21:09.301 INFO:teuthology.orchestra.run.smithi052.stderr:new fs with metadata pool 3 and data pool 4 2024-04-26T10:21:09.312 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:21:09.621 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:09.621 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":20,"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","created":"2024-04-26T10:20:48.363934+0000","modified":"2024-04-26T10:21:09.284748+0000","last_up_change":"2024-04-26T10:20:58.098141+0000","last_in_change":"2024-04-26T10:20:49.575442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:20:59.994755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:21:03.866927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:21:07.853429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:21:08.285131+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5e76c47-dfc4-40ca-88d3-2084cac6e35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":18193},{"type":"v1","addr":"172.21.15.120:6801","nonce":18193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":18193},{"type":"v1","addr":"172.21.15.120:6803","nonce":18193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":18193},{"type":"v1","addr":"172.21.15.120:6807","nonce":18193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":18193},{"type":"v1","addr":"172.21.15.120:6805","nonce":18193}]},"public_addr":"172.21.15.120:6801/18193","cluster_addr":"172.21.15.120:6803/18193","heartbeat_back_addr":"172.21.15.120:6807/18193","heartbeat_front_addr":"172.21.15.120:6805/18193","state":["exists","up"]},{"osd":1,"uuid":"2a8d530c-cf33-4540-9240-6bd7485e06ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":18226},{"type":"v1","addr":"172.21.15.154:6801","nonce":18226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":18226},{"type":"v1","addr":"172.21.15.154:6803","nonce":18226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":18226},{"type":"v1","addr":"172.21.15.154:6807","nonce":18226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":18226},{"type":"v1","addr":"172.21.15.154:6805","nonce":18226}]},"public_addr":"172.21.15.154:6801/18226","cluster_addr":"172.21.15.154:6803/18226","heartbeat_back_addr":"172.21.15.154:6807/18226","heartbeat_front_addr":"172.21.15.154:6805/18226","state":["exists","up"]},{"osd":2,"uuid":"484ab70f-4cad-4ff6-9405-8865ec5ee327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":18269},{"type":"v1","addr":"172.21.15.164:6801","nonce":18269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":18269},{"type":"v1","addr":"172.21.15.164:6803","nonce":18269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":18269},{"type":"v1","addr":"172.21.15.164:6807","nonce":18269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":18269},{"type":"v1","addr":"172.21.15.164:6805","nonce":18269}]},"public_addr":"172.21.15.164:6801/18269","cluster_addr":"172.21.15.164:6803/18269","heartbeat_back_addr":"172.21.15.164:6807/18269","heartbeat_front_addr":"172.21.15.164:6805/18269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.871567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.910527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.761919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:21:09.636 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:21:09.944 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:09.945 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":20,"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","created":"2024-04-26T10:20:48.363934+0000","modified":"2024-04-26T10:21:09.284748+0000","last_up_change":"2024-04-26T10:20:58.098141+0000","last_in_change":"2024-04-26T10:20:49.575442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:20:59.994755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:21:03.866927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:21:07.853429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:21:08.285131+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5e76c47-dfc4-40ca-88d3-2084cac6e35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":18193},{"type":"v1","addr":"172.21.15.120:6801","nonce":18193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":18193},{"type":"v1","addr":"172.21.15.120:6803","nonce":18193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":18193},{"type":"v1","addr":"172.21.15.120:6807","nonce":18193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":18193},{"type":"v1","addr":"172.21.15.120:6805","nonce":18193}]},"public_addr":"172.21.15.120:6801/18193","cluster_addr":"172.21.15.120:6803/18193","heartbeat_back_addr":"172.21.15.120:6807/18193","heartbeat_front_addr":"172.21.15.120:6805/18193","state":["exists","up"]},{"osd":1,"uuid":"2a8d530c-cf33-4540-9240-6bd7485e06ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":18226},{"type":"v1","addr":"172.21.15.154:6801","nonce":18226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":18226},{"type":"v1","addr":"172.21.15.154:6803","nonce":18226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":18226},{"type":"v1","addr":"172.21.15.154:6807","nonce":18226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":18226},{"type":"v1","addr":"172.21.15.154:6805","nonce":18226}]},"public_addr":"172.21.15.154:6801/18226","cluster_addr":"172.21.15.154:6803/18226","heartbeat_back_addr":"172.21.15.154:6807/18226","heartbeat_front_addr":"172.21.15.154:6805/18226","state":["exists","up"]},{"osd":2,"uuid":"484ab70f-4cad-4ff6-9405-8865ec5ee327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":18269},{"type":"v1","addr":"172.21.15.164:6801","nonce":18269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":18269},{"type":"v1","addr":"172.21.15.164:6803","nonce":18269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":18269},{"type":"v1","addr":"172.21.15.164:6807","nonce":18269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":18269},{"type":"v1","addr":"172.21.15.164:6805","nonce":18269}]},"public_addr":"172.21.15.164:6801/18269","cluster_addr":"172.21.15.164:6803/18269","heartbeat_back_addr":"172.21.15.164:6807/18269","heartbeat_front_addr":"172.21.15.164:6805/18269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.871567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.910527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.761919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:21:09.960 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-26T10:21:11.323 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-26T10:21:11.323 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-26T10:21:12.329 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-26T10:21:12.329 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:21:12.673 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:12.673 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T10:21:09.285446+0000","modified":"2024-04-26T10:21:12.296930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4233":{"gid":4233,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6803/2540560872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2540560872},{"type":"v1","addr":"172.21.15.52:6803","nonce":2540560872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T10:21:12.676 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 6 2024-04-26T10:21:12.687 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:21:12.993 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:12.994 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","created":"2024-04-26T10:20:48.363934+0000","modified":"2024-04-26T10:21:10.288209+0000","last_up_change":"2024-04-26T10:20:58.098141+0000","last_in_change":"2024-04-26T10:20:49.575442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:20:59.994755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:21:03.866927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:21:07.853429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:21:08.285131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5e76c47-dfc4-40ca-88d3-2084cac6e35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":18193},{"type":"v1","addr":"172.21.15.120:6801","nonce":18193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":18193},{"type":"v1","addr":"172.21.15.120:6803","nonce":18193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":18193},{"type":"v1","addr":"172.21.15.120:6807","nonce":18193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":18193},{"type":"v1","addr":"172.21.15.120:6805","nonce":18193}]},"public_addr":"172.21.15.120:6801/18193","cluster_addr":"172.21.15.120:6803/18193","heartbeat_back_addr":"172.21.15.120:6807/18193","heartbeat_front_addr":"172.21.15.120:6805/18193","state":["exists","up"]},{"osd":1,"uuid":"2a8d530c-cf33-4540-9240-6bd7485e06ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":18226},{"type":"v1","addr":"172.21.15.154:6801","nonce":18226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":18226},{"type":"v1","addr":"172.21.15.154:6803","nonce":18226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":18226},{"type":"v1","addr":"172.21.15.154:6807","nonce":18226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":18226},{"type":"v1","addr":"172.21.15.154:6805","nonce":18226}]},"public_addr":"172.21.15.154:6801/18226","cluster_addr":"172.21.15.154:6803/18226","heartbeat_back_addr":"172.21.15.154:6807/18226","heartbeat_front_addr":"172.21.15.154:6805/18226","state":["exists","up"]},{"osd":2,"uuid":"484ab70f-4cad-4ff6-9405-8865ec5ee327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":18269},{"type":"v1","addr":"172.21.15.164:6801","nonce":18269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":18269},{"type":"v1","addr":"172.21.15.164:6803","nonce":18269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":18269},{"type":"v1","addr":"172.21.15.164:6807","nonce":18269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":18269},{"type":"v1","addr":"172.21.15.164:6805","nonce":18269}]},"public_addr":"172.21.15.164:6801/18269","cluster_addr":"172.21.15.164:6803/18269","heartbeat_back_addr":"172.21.15.164:6807/18269","heartbeat_front_addr":"172.21.15.164:6805/18269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.871567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.910527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.761919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:21:13.008 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-26T10:21:13.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:21:13.321 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:13.323 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:21:13.335 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T10:21:11.936933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":93912,"kb_used_data":560,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021608,"statfs":{"total":289910292480,"available":289814126592,"internally_reserved":0,"allocated":573440,"data_stored":1319521,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.033343"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909631+0000","last_change":"2024-04-26T10:21:07.909631+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909631+0000","last_undegraded":"2024-04-26T10:21:07.909631+0000","last_fullsized":"2024-04-26T10:21:07.909631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:28.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.911615+0000","last_change":"2024-04-26T10:21:07.911615+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.911615+0000","last_undegraded":"2024-04-26T10:21:07.911615+0000","last_fullsized":"2024-04-26T10:21:07.911615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:48.449203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.915828+0000","last_change":"2024-04-26T10:21:07.915828+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.915828+0000","last_undegraded":"2024-04-26T10:21:07.915828+0000","last_fullsized":"2024-04-26T10:21:07.915828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:24.501204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.910127+0000","last_change":"2024-04-26T10:21:07.910127+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.910127+0000","last_undegraded":"2024-04-26T10:21:07.910127+0000","last_fullsized":"2024-04-26T10:21:07.910127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:18.272015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909508+0000","last_change":"2024-04-26T10:21:07.909508+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909508+0000","last_undegraded":"2024-04-26T10:21:07.909508+0000","last_fullsized":"2024-04-26T10:21:07.909508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:11.224989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.914156+0000","last_change":"2024-04-26T10:21:07.914156+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.914156+0000","last_undegraded":"2024-04-26T10:21:07.914156+0000","last_fullsized":"2024-04-26T10:21:07.914156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:22.537149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909442+0000","last_change":"2024-04-26T10:21:07.909442+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909442+0000","last_undegraded":"2024-04-26T10:21:07.909442+0000","last_fullsized":"2024-04-26T10:21:07.909442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:25.498249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.908462+0000","last_change":"2024-04-26T10:21:07.908462+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.908462+0000","last_undegraded":"2024-04-26T10:21:07.908462+0000","last_fullsized":"2024-04-26T10:21:07.908462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:01.182611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909143+0000","last_change":"2024-04-26T10:21:07.909143+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909143+0000","last_undegraded":"2024-04-26T10:21:07.909143+0000","last_fullsized":"2024-04-26T10:21:07.909143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:19.270525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.908475+0000","last_change":"2024-04-26T10:21:07.908475+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.908475+0000","last_undegraded":"2024-04-26T10:21:07.908475+0000","last_fullsized":"2024-04-26T10:21:07.908475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:06.598189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.914337+0000","last_change":"2024-04-26T10:21:07.914337+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.914337+0000","last_undegraded":"2024-04-26T10:21:07.914337+0000","last_fullsized":"2024-04-26T10:21:07.914337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:18:07.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.915566+0000","last_change":"2024-04-26T10:21:07.915566+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.915566+0000","last_undegraded":"2024-04-26T10:21:07.915566+0000","last_fullsized":"2024-04-26T10:21:07.915566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:52.241716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":210,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T10:21:06.821705+0000","last_change":"2024-04-26T10:21:01.829140+0000","last_active":"2024-04-26T10:21:06.821705+0000","last_peered":"2024-04-26T10:21:06.821705+0000","last_clean":"2024-04-26T10:21:06.821705+0000","last_became_active":"2024-04-26T10:21:01.827182+0000","last_became_peered":"2024-04-26T10:21:01.827182+0000","last_unstale":"2024-04-26T10:21:06.821705+0000","last_undegraded":"2024-04-26T10:21:06.821705+0000","last_fullsized":"2024-04-26T10:21:06.821705+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:00:51.477222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T10:21:07.907315+0000","last_change":"2024-04-26T10:21:04.893745+0000","last_active":"2024-04-26T10:21:07.907315+0000","last_peered":"2024-04-26T10:21:07.907315+0000","last_clean":"2024-04-26T10:21:07.907315+0000","last_became_active":"2024-04-26T10:21:04.893031+0000","last_became_peered":"2024-04-26T10:21:04.893031+0000","last_unstale":"2024-04-26T10:21:07.907315+0000","last_undegraded":"2024-04-26T10:21:07.907315+0000","last_fullsized":"2024-04-26T10:21:07.907315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:59.771061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909335+0000","last_change":"2024-04-26T10:21:07.909335+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909335+0000","last_undegraded":"2024-04-26T10:21:07.909335+0000","last_fullsized":"2024-04-26T10:21:07.909335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:14.290484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T10:21:07.907323+0000","last_change":"2024-04-26T10:21:04.892156+0000","last_active":"2024-04-26T10:21:07.907323+0000","last_peered":"2024-04-26T10:21:07.907323+0000","last_clean":"2024-04-26T10:21:07.907323+0000","last_became_active":"2024-04-26T10:21:04.891660+0000","last_became_peered":"2024-04-26T10:21:04.891660+0000","last_unstale":"2024-04-26T10:21:07.907323+0000","last_undegraded":"2024-04-26T10:21:07.907323+0000","last_fullsized":"2024-04-26T10:21:07.907323+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:50.568468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909139+0000","last_change":"2024-04-26T10:21:07.909139+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909139+0000","last_undegraded":"2024-04-26T10:21:07.909139+0000","last_fullsized":"2024-04-26T10:21:07.909139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:41.614282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T10:21:07.915351+0000","last_change":"2024-04-26T10:21:04.890860+0000","last_active":"2024-04-26T10:21:07.915351+0000","last_peered":"2024-04-26T10:21:07.915351+0000","last_clean":"2024-04-26T10:21:07.915351+0000","last_became_active":"2024-04-26T10:21:04.890336+0000","last_became_peered":"2024-04-26T10:21:04.890336+0000","last_unstale":"2024-04-26T10:21:07.915351+0000","last_undegraded":"2024-04-26T10:21:07.915351+0000","last_fullsized":"2024-04-26T10:21:07.915351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:13.262120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.914249+0000","last_change":"2024-04-26T10:21:07.914249+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.914249+0000","last_undegraded":"2024-04-26T10:21:07.914249+0000","last_fullsized":"2024-04-26T10:21:07.914249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:11.906094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T10:21:07.907242+0000","last_change":"2024-04-26T10:21:04.893253+0000","last_active":"2024-04-26T10:21:07.907242+0000","last_peered":"2024-04-26T10:21:07.907242+0000","last_clean":"2024-04-26T10:21:07.907242+0000","last_became_active":"2024-04-26T10:21:04.892843+0000","last_became_peered":"2024-04-26T10:21:04.892843+0000","last_unstale":"2024-04-26T10:21:07.907242+0000","last_undegraded":"2024-04-26T10:21:07.907242+0000","last_fullsized":"2024-04-26T10:21:07.907242+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:00.749791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.908027+0000","last_change":"2024-04-26T10:21:07.908027+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.908027+0000","last_undegraded":"2024-04-26T10:21:07.908027+0000","last_fullsized":"2024-04-26T10:21:07.908027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:28.491800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.908113+0000","last_change":"2024-04-26T10:21:07.908113+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.908113+0000","last_undegraded":"2024-04-26T10:21:07.908113+0000","last_fullsized":"2024-04-26T10:21:07.908113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:20.545169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T10:21:07.914974+0000","last_change":"2024-04-26T10:21:04.890548+0000","last_active":"2024-04-26T10:21:07.914974+0000","last_peered":"2024-04-26T10:21:07.914974+0000","last_clean":"2024-04-26T10:21:07.914974+0000","last_became_active":"2024-04-26T10:21:04.890034+0000","last_became_peered":"2024-04-26T10:21:04.890034+0000","last_unstale":"2024-04-26T10:21:07.914974+0000","last_undegraded":"2024-04-26T10:21:07.914974+0000","last_fullsized":"2024-04-26T10:21:07.914974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:55.033455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909168+0000","last_change":"2024-04-26T10:21:07.909168+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909168+0000","last_undegraded":"2024-04-26T10:21:07.909168+0000","last_fullsized":"2024-04-26T10:21:07.909168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:50.230096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T10:21:07.917451+0000","last_change":"2024-04-26T10:21:04.891490+0000","last_active":"2024-04-26T10:21:07.917451+0000","last_peered":"2024-04-26T10:21:07.917451+0000","last_clean":"2024-04-26T10:21:07.917451+0000","last_became_active":"2024-04-26T10:21:04.890777+0000","last_became_peered":"2024-04-26T10:21:04.890777+0000","last_unstale":"2024-04-26T10:21:07.917451+0000","last_undegraded":"2024-04-26T10:21:07.917451+0000","last_fullsized":"2024-04-26T10:21:07.917451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:25.896672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909336+0000","last_change":"2024-04-26T10:21:07.909336+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909336+0000","last_undegraded":"2024-04-26T10:21:07.909336+0000","last_fullsized":"2024-04-26T10:21:07.909336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:57.798830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T10:21:07.915075+0000","last_change":"2024-04-26T10:21:04.890490+0000","last_active":"2024-04-26T10:21:07.915075+0000","last_peered":"2024-04-26T10:21:07.915075+0000","last_clean":"2024-04-26T10:21:07.915075+0000","last_became_active":"2024-04-26T10:21:04.889808+0000","last_became_peered":"2024-04-26T10:21:04.889808+0000","last_unstale":"2024-04-26T10:21:07.915075+0000","last_undegraded":"2024-04-26T10:21:07.915075+0000","last_fullsized":"2024-04-26T10:21:07.915075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:55.711555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909291+0000","last_change":"2024-04-26T10:21:07.909291+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909291+0000","last_undegraded":"2024-04-26T10:21:07.909291+0000","last_fullsized":"2024-04-26T10:21:07.909291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:24.526250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T10:21:07.907310+0000","last_change":"2024-04-26T10:21:04.892401+0000","last_active":"2024-04-26T10:21:07.907310+0000","last_peered":"2024-04-26T10:21:07.907310+0000","last_clean":"2024-04-26T10:21:07.907310+0000","last_became_active":"2024-04-26T10:21:04.891692+0000","last_became_peered":"2024-04-26T10:21:04.891692+0000","last_unstale":"2024-04-26T10:21:07.907310+0000","last_undegraded":"2024-04-26T10:21:07.907310+0000","last_fullsized":"2024-04-26T10:21:07.907310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:37.548728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.910226+0000","last_change":"2024-04-26T10:21:07.910226+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.910226+0000","last_undegraded":"2024-04-26T10:21:07.910226+0000","last_fullsized":"2024-04-26T10:21:07.910226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:50.622715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.914156+0000","last_change":"2024-04-26T10:21:07.914156+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.914156+0000","last_undegraded":"2024-04-26T10:21:07.914156+0000","last_fullsized":"2024-04-26T10:21:07.914156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:57.649639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.910648+0000","last_change":"2024-04-26T10:21:07.910648+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.910648+0000","last_undegraded":"2024-04-26T10:21:07.910648+0000","last_fullsized":"2024-04-26T10:21:07.910648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:17.212235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.911429+0000","last_change":"2024-04-26T10:21:07.911429+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.911429+0000","last_undegraded":"2024-04-26T10:21:07.911429+0000","last_fullsized":"2024-04-26T10:21:07.911429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:29.602825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909141+0000","last_change":"2024-04-26T10:21:07.909141+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909141+0000","last_undegraded":"2024-04-26T10:21:07.909141+0000","last_fullsized":"2024-04-26T10:21:07.909141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:45.671865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.911165+0000","last_change":"2024-04-26T10:21:07.911165+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.911165+0000","last_undegraded":"2024-04-26T10:21:07.911165+0000","last_fullsized":"2024-04-26T10:21:07.911165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:47.721288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.914096+0000","last_change":"2024-04-26T10:21:07.914096+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.914096+0000","last_undegraded":"2024-04-26T10:21:07.914096+0000","last_fullsized":"2024-04-26T10:21:07.914096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:21.306576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.914096+0000","last_change":"2024-04-26T10:21:07.914096+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.914096+0000","last_undegraded":"2024-04-26T10:21:07.914096+0000","last_fullsized":"2024-04-26T10:21:07.914096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:08.369059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.911412+0000","last_change":"2024-04-26T10:21:07.911412+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.911412+0000","last_undegraded":"2024-04-26T10:21:07.911412+0000","last_fullsized":"2024-04-26T10:21:07.911412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:50.856581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.915849+0000","last_change":"2024-04-26T10:21:07.915849+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.915849+0000","last_undegraded":"2024-04-26T10:21:07.915849+0000","last_fullsized":"2024-04-26T10:21:07.915849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:14.145721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.911408+0000","last_change":"2024-04-26T10:21:07.911408+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.911408+0000","last_undegraded":"2024-04-26T10:21:07.911408+0000","last_fullsized":"2024-04-26T10:21:07.911408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:55.394913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.913189+0000","last_change":"2024-04-26T10:21:07.913189+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.913189+0000","last_undegraded":"2024-04-26T10:21:07.913189+0000","last_fullsized":"2024-04-26T10:21:07.913189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:38.881531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":638003,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":0,"up_from":10,"seq":42949672964,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":638003,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31264,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340576,"statfs":{"total":96636764160,"available":96604749824,"internally_reserved":0,"allocated":147456,"data_stored":43515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:21:13.340 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:21:13.659 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:13.662 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:21:13.674 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-04-26T10:21:11.936933+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":93912,"kb_used_data":560,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021608,"statfs":{"total":289910292480,"available":289814126592,"internally_reserved":0,"allocated":573440,"data_stored":1319521,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.033343"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909631+0000","last_change":"2024-04-26T10:21:07.909631+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909631+0000","last_undegraded":"2024-04-26T10:21:07.909631+0000","last_fullsized":"2024-04-26T10:21:07.909631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:28.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.911615+0000","last_change":"2024-04-26T10:21:07.911615+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.911615+0000","last_undegraded":"2024-04-26T10:21:07.911615+0000","last_fullsized":"2024-04-26T10:21:07.911615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:48.449203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.915828+0000","last_change":"2024-04-26T10:21:07.915828+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.915828+0000","last_undegraded":"2024-04-26T10:21:07.915828+0000","last_fullsized":"2024-04-26T10:21:07.915828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:24.501204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.910127+0000","last_change":"2024-04-26T10:21:07.910127+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.910127+0000","last_undegraded":"2024-04-26T10:21:07.910127+0000","last_fullsized":"2024-04-26T10:21:07.910127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:18.272015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909508+0000","last_change":"2024-04-26T10:21:07.909508+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909508+0000","last_undegraded":"2024-04-26T10:21:07.909508+0000","last_fullsized":"2024-04-26T10:21:07.909508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:11.224989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.914156+0000","last_change":"2024-04-26T10:21:07.914156+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.914156+0000","last_undegraded":"2024-04-26T10:21:07.914156+0000","last_fullsized":"2024-04-26T10:21:07.914156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:22.537149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909442+0000","last_change":"2024-04-26T10:21:07.909442+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909442+0000","last_undegraded":"2024-04-26T10:21:07.909442+0000","last_fullsized":"2024-04-26T10:21:07.909442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:25.498249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.908462+0000","last_change":"2024-04-26T10:21:07.908462+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.908462+0000","last_undegraded":"2024-04-26T10:21:07.908462+0000","last_fullsized":"2024-04-26T10:21:07.908462+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:01.182611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909143+0000","last_change":"2024-04-26T10:21:07.909143+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909143+0000","last_undegraded":"2024-04-26T10:21:07.909143+0000","last_fullsized":"2024-04-26T10:21:07.909143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:19.270525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.908475+0000","last_change":"2024-04-26T10:21:07.908475+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.908475+0000","last_undegraded":"2024-04-26T10:21:07.908475+0000","last_fullsized":"2024-04-26T10:21:07.908475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:06.598189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.914337+0000","last_change":"2024-04-26T10:21:07.914337+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.914337+0000","last_undegraded":"2024-04-26T10:21:07.914337+0000","last_fullsized":"2024-04-26T10:21:07.914337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:18:07.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.915566+0000","last_change":"2024-04-26T10:21:07.915566+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.915566+0000","last_undegraded":"2024-04-26T10:21:07.915566+0000","last_fullsized":"2024-04-26T10:21:07.915566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:52.241716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":210,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-26T10:21:06.821705+0000","last_change":"2024-04-26T10:21:01.829140+0000","last_active":"2024-04-26T10:21:06.821705+0000","last_peered":"2024-04-26T10:21:06.821705+0000","last_clean":"2024-04-26T10:21:06.821705+0000","last_became_active":"2024-04-26T10:21:01.827182+0000","last_became_peered":"2024-04-26T10:21:01.827182+0000","last_unstale":"2024-04-26T10:21:06.821705+0000","last_undegraded":"2024-04-26T10:21:06.821705+0000","last_fullsized":"2024-04-26T10:21:06.821705+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:00:51.477222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T10:21:07.907315+0000","last_change":"2024-04-26T10:21:04.893745+0000","last_active":"2024-04-26T10:21:07.907315+0000","last_peered":"2024-04-26T10:21:07.907315+0000","last_clean":"2024-04-26T10:21:07.907315+0000","last_became_active":"2024-04-26T10:21:04.893031+0000","last_became_peered":"2024-04-26T10:21:04.893031+0000","last_unstale":"2024-04-26T10:21:07.907315+0000","last_undegraded":"2024-04-26T10:21:07.907315+0000","last_fullsized":"2024-04-26T10:21:07.907315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:59.771061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909335+0000","last_change":"2024-04-26T10:21:07.909335+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909335+0000","last_undegraded":"2024-04-26T10:21:07.909335+0000","last_fullsized":"2024-04-26T10:21:07.909335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:14.290484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T10:21:07.907323+0000","last_change":"2024-04-26T10:21:04.892156+0000","last_active":"2024-04-26T10:21:07.907323+0000","last_peered":"2024-04-26T10:21:07.907323+0000","last_clean":"2024-04-26T10:21:07.907323+0000","last_became_active":"2024-04-26T10:21:04.891660+0000","last_became_peered":"2024-04-26T10:21:04.891660+0000","last_unstale":"2024-04-26T10:21:07.907323+0000","last_undegraded":"2024-04-26T10:21:07.907323+0000","last_fullsized":"2024-04-26T10:21:07.907323+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:50.568468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909139+0000","last_change":"2024-04-26T10:21:07.909139+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909139+0000","last_undegraded":"2024-04-26T10:21:07.909139+0000","last_fullsized":"2024-04-26T10:21:07.909139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:41.614282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T10:21:07.915351+0000","last_change":"2024-04-26T10:21:04.890860+0000","last_active":"2024-04-26T10:21:07.915351+0000","last_peered":"2024-04-26T10:21:07.915351+0000","last_clean":"2024-04-26T10:21:07.915351+0000","last_became_active":"2024-04-26T10:21:04.890336+0000","last_became_peered":"2024-04-26T10:21:04.890336+0000","last_unstale":"2024-04-26T10:21:07.915351+0000","last_undegraded":"2024-04-26T10:21:07.915351+0000","last_fullsized":"2024-04-26T10:21:07.915351+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:13.262120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.914249+0000","last_change":"2024-04-26T10:21:07.914249+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.914249+0000","last_undegraded":"2024-04-26T10:21:07.914249+0000","last_fullsized":"2024-04-26T10:21:07.914249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:11.906094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T10:21:07.907242+0000","last_change":"2024-04-26T10:21:04.893253+0000","last_active":"2024-04-26T10:21:07.907242+0000","last_peered":"2024-04-26T10:21:07.907242+0000","last_clean":"2024-04-26T10:21:07.907242+0000","last_became_active":"2024-04-26T10:21:04.892843+0000","last_became_peered":"2024-04-26T10:21:04.892843+0000","last_unstale":"2024-04-26T10:21:07.907242+0000","last_undegraded":"2024-04-26T10:21:07.907242+0000","last_fullsized":"2024-04-26T10:21:07.907242+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:00.749791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.908027+0000","last_change":"2024-04-26T10:21:07.908027+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.908027+0000","last_undegraded":"2024-04-26T10:21:07.908027+0000","last_fullsized":"2024-04-26T10:21:07.908027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:28.491800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.908113+0000","last_change":"2024-04-26T10:21:07.908113+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.908113+0000","last_undegraded":"2024-04-26T10:21:07.908113+0000","last_fullsized":"2024-04-26T10:21:07.908113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:20.545169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T10:21:07.914974+0000","last_change":"2024-04-26T10:21:04.890548+0000","last_active":"2024-04-26T10:21:07.914974+0000","last_peered":"2024-04-26T10:21:07.914974+0000","last_clean":"2024-04-26T10:21:07.914974+0000","last_became_active":"2024-04-26T10:21:04.890034+0000","last_became_peered":"2024-04-26T10:21:04.890034+0000","last_unstale":"2024-04-26T10:21:07.914974+0000","last_undegraded":"2024-04-26T10:21:07.914974+0000","last_fullsized":"2024-04-26T10:21:07.914974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:55.033455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909168+0000","last_change":"2024-04-26T10:21:07.909168+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909168+0000","last_undegraded":"2024-04-26T10:21:07.909168+0000","last_fullsized":"2024-04-26T10:21:07.909168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:50.230096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T10:21:07.917451+0000","last_change":"2024-04-26T10:21:04.891490+0000","last_active":"2024-04-26T10:21:07.917451+0000","last_peered":"2024-04-26T10:21:07.917451+0000","last_clean":"2024-04-26T10:21:07.917451+0000","last_became_active":"2024-04-26T10:21:04.890777+0000","last_became_peered":"2024-04-26T10:21:04.890777+0000","last_unstale":"2024-04-26T10:21:07.917451+0000","last_undegraded":"2024-04-26T10:21:07.917451+0000","last_fullsized":"2024-04-26T10:21:07.917451+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:25.896672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909336+0000","last_change":"2024-04-26T10:21:07.909336+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909336+0000","last_undegraded":"2024-04-26T10:21:07.909336+0000","last_fullsized":"2024-04-26T10:21:07.909336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:57.798830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T10:21:07.915075+0000","last_change":"2024-04-26T10:21:04.890490+0000","last_active":"2024-04-26T10:21:07.915075+0000","last_peered":"2024-04-26T10:21:07.915075+0000","last_clean":"2024-04-26T10:21:07.915075+0000","last_became_active":"2024-04-26T10:21:04.889808+0000","last_became_peered":"2024-04-26T10:21:04.889808+0000","last_unstale":"2024-04-26T10:21:07.915075+0000","last_undegraded":"2024-04-26T10:21:07.915075+0000","last_fullsized":"2024-04-26T10:21:07.915075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:55.711555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909291+0000","last_change":"2024-04-26T10:21:07.909291+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909291+0000","last_undegraded":"2024-04-26T10:21:07.909291+0000","last_fullsized":"2024-04-26T10:21:07.909291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:24.526250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-26T10:21:07.907310+0000","last_change":"2024-04-26T10:21:04.892401+0000","last_active":"2024-04-26T10:21:07.907310+0000","last_peered":"2024-04-26T10:21:07.907310+0000","last_clean":"2024-04-26T10:21:07.907310+0000","last_became_active":"2024-04-26T10:21:04.891692+0000","last_became_peered":"2024-04-26T10:21:04.891692+0000","last_unstale":"2024-04-26T10:21:07.907310+0000","last_undegraded":"2024-04-26T10:21:07.907310+0000","last_fullsized":"2024-04-26T10:21:07.907310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:37.548728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.910226+0000","last_change":"2024-04-26T10:21:07.910226+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.910226+0000","last_undegraded":"2024-04-26T10:21:07.910226+0000","last_fullsized":"2024-04-26T10:21:07.910226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:50.622715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.914156+0000","last_change":"2024-04-26T10:21:07.914156+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.914156+0000","last_undegraded":"2024-04-26T10:21:07.914156+0000","last_fullsized":"2024-04-26T10:21:07.914156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:57.649639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.910648+0000","last_change":"2024-04-26T10:21:07.910648+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.910648+0000","last_undegraded":"2024-04-26T10:21:07.910648+0000","last_fullsized":"2024-04-26T10:21:07.910648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:17.212235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.911429+0000","last_change":"2024-04-26T10:21:07.911429+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.911429+0000","last_undegraded":"2024-04-26T10:21:07.911429+0000","last_fullsized":"2024-04-26T10:21:07.911429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:29.602825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.909141+0000","last_change":"2024-04-26T10:21:07.909141+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.909141+0000","last_undegraded":"2024-04-26T10:21:07.909141+0000","last_fullsized":"2024-04-26T10:21:07.909141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:45.671865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.911165+0000","last_change":"2024-04-26T10:21:07.911165+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.911165+0000","last_undegraded":"2024-04-26T10:21:07.911165+0000","last_fullsized":"2024-04-26T10:21:07.911165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:47.721288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.914096+0000","last_change":"2024-04-26T10:21:07.914096+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.914096+0000","last_undegraded":"2024-04-26T10:21:07.914096+0000","last_fullsized":"2024-04-26T10:21:07.914096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:21.306576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.914096+0000","last_change":"2024-04-26T10:21:07.914096+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.914096+0000","last_undegraded":"2024-04-26T10:21:07.914096+0000","last_fullsized":"2024-04-26T10:21:07.914096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:08.369059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.911412+0000","last_change":"2024-04-26T10:21:07.911412+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.911412+0000","last_undegraded":"2024-04-26T10:21:07.911412+0000","last_fullsized":"2024-04-26T10:21:07.911412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:50.856581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.915849+0000","last_change":"2024-04-26T10:21:07.915849+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.915849+0000","last_undegraded":"2024-04-26T10:21:07.915849+0000","last_fullsized":"2024-04-26T10:21:07.915849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:14.145721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.911408+0000","last_change":"2024-04-26T10:21:07.911408+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.911408+0000","last_undegraded":"2024-04-26T10:21:07.911408+0000","last_fullsized":"2024-04-26T10:21:07.911408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:55.394913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-26T10:21:08.902808+0000","last_change":"2024-04-26T10:21:08.902808+0000","last_active":"2024-04-26T10:21:08.902808+0000","last_peered":"2024-04-26T10:21:08.902808+0000","last_clean":"2024-04-26T10:21:08.902808+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:08.902808+0000","last_undegraded":"2024-04-26T10:21:08.902808+0000","last_fullsized":"2024-04-26T10:21:08.902808+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-26T10:21:07.913189+0000","last_change":"2024-04-26T10:21:07.913189+0000","last_active":"2024-04-26T10:21:07.893071+0000","last_peered":"2024-04-26T10:21:07.893071+0000","last_clean":"2024-04-26T10:21:07.893071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-26T10:21:07.913189+0000","last_undegraded":"2024-04-26T10:21:07.913189+0000","last_fullsized":"2024-04-26T10:21:07.913189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:38.881531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":638003,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":0,"up_from":10,"seq":42949672964,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":638003,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31264,"kb_used_data":144,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340576,"statfs":{"total":96636764160,"available":96604749824,"internally_reserved":0,"allocated":147456,"data_stored":43515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:21:13.678 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:21:13.989 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:13.991 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:21:14.005 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-26T10:21:13.937507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94064,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021456,"statfs":{"total":289910292480,"available":289813970944,"internally_reserved":0,"allocated":720896,"data_stored":1370902,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001544"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303606+0000","last_change":"2024-04-26T10:21:09.316096+0000","last_active":"2024-04-26T10:21:10.303606+0000","last_peered":"2024-04-26T10:21:10.303606+0000","last_clean":"2024-04-26T10:21:10.303606+0000","last_became_active":"2024-04-26T10:21:09.315498+0000","last_became_peered":"2024-04-26T10:21:09.315498+0000","last_unstale":"2024-04-26T10:21:10.303606+0000","last_undegraded":"2024-04-26T10:21:10.303606+0000","last_fullsized":"2024-04-26T10:21:10.303606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:14.245434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304046+0000","last_change":"2024-04-26T10:21:09.317241+0000","last_active":"2024-04-26T10:21:10.304046+0000","last_peered":"2024-04-26T10:21:10.304046+0000","last_clean":"2024-04-26T10:21:10.304046+0000","last_became_active":"2024-04-26T10:21:09.316532+0000","last_became_peered":"2024-04-26T10:21:09.316532+0000","last_unstale":"2024-04-26T10:21:10.304046+0000","last_undegraded":"2024-04-26T10:21:10.304046+0000","last_fullsized":"2024-04-26T10:21:10.304046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:00.173638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743004+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:21:10.743004+0000","last_peered":"2024-04-26T10:21:10.743004+0000","last_clean":"2024-04-26T10:21:10.743004+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:21:10.743004+0000","last_undegraded":"2024-04-26T10:21:10.743004+0000","last_fullsized":"2024-04-26T10:21:10.743004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:01.883964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742576+0000","last_change":"2024-04-26T10:21:09.306531+0000","last_active":"2024-04-26T10:21:10.742576+0000","last_peered":"2024-04-26T10:21:10.742576+0000","last_clean":"2024-04-26T10:21:10.742576+0000","last_became_active":"2024-04-26T10:21:09.304885+0000","last_became_peered":"2024-04-26T10:21:09.304885+0000","last_unstale":"2024-04-26T10:21:10.742576+0000","last_undegraded":"2024-04-26T10:21:10.742576+0000","last_fullsized":"2024-04-26T10:21:10.742576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:04.179516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302949+0000","last_change":"2024-04-26T10:21:09.310914+0000","last_active":"2024-04-26T10:21:10.302949+0000","last_peered":"2024-04-26T10:21:10.302949+0000","last_clean":"2024-04-26T10:21:10.302949+0000","last_became_active":"2024-04-26T10:21:09.309981+0000","last_became_peered":"2024-04-26T10:21:09.309981+0000","last_unstale":"2024-04-26T10:21:10.302949+0000","last_undegraded":"2024-04-26T10:21:10.302949+0000","last_fullsized":"2024-04-26T10:21:10.302949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:04.926251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743427+0000","last_change":"2024-04-26T10:21:09.305198+0000","last_active":"2024-04-26T10:21:10.743427+0000","last_peered":"2024-04-26T10:21:10.743427+0000","last_clean":"2024-04-26T10:21:10.743427+0000","last_became_active":"2024-04-26T10:21:09.304716+0000","last_became_peered":"2024-04-26T10:21:09.304716+0000","last_unstale":"2024-04-26T10:21:10.743427+0000","last_undegraded":"2024-04-26T10:21:10.743427+0000","last_fullsized":"2024-04-26T10:21:10.743427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:11.224015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742177+0000","last_change":"2024-04-26T10:21:09.307188+0000","last_active":"2024-04-26T10:21:10.742177+0000","last_peered":"2024-04-26T10:21:10.742177+0000","last_clean":"2024-04-26T10:21:10.742177+0000","last_became_active":"2024-04-26T10:21:09.306548+0000","last_became_peered":"2024-04-26T10:21:09.306548+0000","last_unstale":"2024-04-26T10:21:10.742177+0000","last_undegraded":"2024-04-26T10:21:10.742177+0000","last_fullsized":"2024-04-26T10:21:10.742177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:29.565507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741718+0000","last_change":"2024-04-26T10:21:09.308284+0000","last_active":"2024-04-26T10:21:10.741718+0000","last_peered":"2024-04-26T10:21:10.741718+0000","last_clean":"2024-04-26T10:21:10.741718+0000","last_became_active":"2024-04-26T10:21:09.307504+0000","last_became_peered":"2024-04-26T10:21:09.307504+0000","last_unstale":"2024-04-26T10:21:10.741718+0000","last_undegraded":"2024-04-26T10:21:10.741718+0000","last_fullsized":"2024-04-26T10:21:10.741718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:51.549222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303844+0000","last_change":"2024-04-26T10:21:09.314160+0000","last_active":"2024-04-26T10:21:10.303844+0000","last_peered":"2024-04-26T10:21:10.303844+0000","last_clean":"2024-04-26T10:21:10.303844+0000","last_became_active":"2024-04-26T10:21:09.313221+0000","last_became_peered":"2024-04-26T10:21:09.313221+0000","last_unstale":"2024-04-26T10:21:10.303844+0000","last_undegraded":"2024-04-26T10:21:10.303844+0000","last_fullsized":"2024-04-26T10:21:10.303844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:50.157094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304095+0000","last_change":"2024-04-26T10:21:09.315304+0000","last_active":"2024-04-26T10:21:10.304095+0000","last_peered":"2024-04-26T10:21:10.304095+0000","last_clean":"2024-04-26T10:21:10.304095+0000","last_became_active":"2024-04-26T10:21:09.314619+0000","last_became_peered":"2024-04-26T10:21:09.314619+0000","last_unstale":"2024-04-26T10:21:10.304095+0000","last_undegraded":"2024-04-26T10:21:10.304095+0000","last_fullsized":"2024-04-26T10:21:10.304095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:41.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743482+0000","last_change":"2024-04-26T10:21:09.307173+0000","last_active":"2024-04-26T10:21:10.743482+0000","last_peered":"2024-04-26T10:21:10.743482+0000","last_clean":"2024-04-26T10:21:10.743482+0000","last_became_active":"2024-04-26T10:21:09.306523+0000","last_became_peered":"2024-04-26T10:21:09.306523+0000","last_unstale":"2024-04-26T10:21:10.743482+0000","last_undegraded":"2024-04-26T10:21:10.743482+0000","last_fullsized":"2024-04-26T10:21:10.743482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:15.102637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302828+0000","last_change":"2024-04-26T10:21:09.319057+0000","last_active":"2024-04-26T10:21:10.302828+0000","last_peered":"2024-04-26T10:21:10.302828+0000","last_clean":"2024-04-26T10:21:10.302828+0000","last_became_active":"2024-04-26T10:21:09.318580+0000","last_became_peered":"2024-04-26T10:21:09.318580+0000","last_unstale":"2024-04-26T10:21:10.302828+0000","last_undegraded":"2024-04-26T10:21:10.302828+0000","last_fullsized":"2024-04-26T10:21:10.302828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.335327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302635+0000","last_change":"2024-04-26T10:21:09.310332+0000","last_active":"2024-04-26T10:21:10.302635+0000","last_peered":"2024-04-26T10:21:10.302635+0000","last_clean":"2024-04-26T10:21:10.302635+0000","last_became_active":"2024-04-26T10:21:09.309534+0000","last_became_peered":"2024-04-26T10:21:09.309534+0000","last_unstale":"2024-04-26T10:21:10.302635+0000","last_undegraded":"2024-04-26T10:21:10.302635+0000","last_fullsized":"2024-04-26T10:21:10.302635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:01.594353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742954+0000","last_change":"2024-04-26T10:21:09.316821+0000","last_active":"2024-04-26T10:21:10.742954+0000","last_peered":"2024-04-26T10:21:10.742954+0000","last_clean":"2024-04-26T10:21:10.742954+0000","last_became_active":"2024-04-26T10:21:09.316143+0000","last_became_peered":"2024-04-26T10:21:09.316143+0000","last_unstale":"2024-04-26T10:21:10.742954+0000","last_undegraded":"2024-04-26T10:21:10.742954+0000","last_fullsized":"2024-04-26T10:21:10.742954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:20.271378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742238+0000","last_change":"2024-04-26T10:21:09.314710+0000","last_active":"2024-04-26T10:21:10.742238+0000","last_peered":"2024-04-26T10:21:10.742238+0000","last_clean":"2024-04-26T10:21:10.742238+0000","last_became_active":"2024-04-26T10:21:09.314401+0000","last_became_peered":"2024-04-26T10:21:09.314401+0000","last_unstale":"2024-04-26T10:21:10.742238+0000","last_undegraded":"2024-04-26T10:21:10.742238+0000","last_fullsized":"2024-04-26T10:21:10.742238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:14.245434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741766+0000","last_change":"2024-04-26T10:21:09.306575+0000","last_active":"2024-04-26T10:21:10.741766+0000","last_peered":"2024-04-26T10:21:10.741766+0000","last_clean":"2024-04-26T10:21:10.741766+0000","last_became_active":"2024-04-26T10:21:09.305009+0000","last_became_peered":"2024-04-26T10:21:09.305009+0000","last_unstale":"2024-04-26T10:21:10.741766+0000","last_undegraded":"2024-04-26T10:21:10.741766+0000","last_fullsized":"2024-04-26T10:21:10.741766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:42.965427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304549+0000","last_change":"2024-04-26T10:21:09.317530+0000","last_active":"2024-04-26T10:21:10.304549+0000","last_peered":"2024-04-26T10:21:10.304549+0000","last_clean":"2024-04-26T10:21:10.304549+0000","last_became_active":"2024-04-26T10:21:09.316956+0000","last_became_peered":"2024-04-26T10:21:09.316956+0000","last_unstale":"2024-04-26T10:21:10.304549+0000","last_undegraded":"2024-04-26T10:21:10.304549+0000","last_fullsized":"2024-04-26T10:21:10.304549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:05.112877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304348+0000","last_change":"2024-04-26T10:21:09.316152+0000","last_active":"2024-04-26T10:21:10.304348+0000","last_peered":"2024-04-26T10:21:10.304348+0000","last_clean":"2024-04-26T10:21:10.304348+0000","last_became_active":"2024-04-26T10:21:09.315441+0000","last_became_peered":"2024-04-26T10:21:09.315441+0000","last_unstale":"2024-04-26T10:21:10.304348+0000","last_undegraded":"2024-04-26T10:21:10.304348+0000","last_fullsized":"2024-04-26T10:21:10.304348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:42.904467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303452+0000","last_change":"2024-04-26T10:21:09.316805+0000","last_active":"2024-04-26T10:21:10.303452+0000","last_peered":"2024-04-26T10:21:10.303452+0000","last_clean":"2024-04-26T10:21:10.303452+0000","last_became_active":"2024-04-26T10:21:09.316490+0000","last_became_peered":"2024-04-26T10:21:09.316490+0000","last_unstale":"2024-04-26T10:21:10.303452+0000","last_undegraded":"2024-04-26T10:21:10.303452+0000","last_fullsized":"2024-04-26T10:21:10.303452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:11.814183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742675+0000","last_change":"2024-04-26T10:21:09.314189+0000","last_active":"2024-04-26T10:21:10.742675+0000","last_peered":"2024-04-26T10:21:10.742675+0000","last_clean":"2024-04-26T10:21:10.742675+0000","last_became_active":"2024-04-26T10:21:09.313648+0000","last_became_peered":"2024-04-26T10:21:09.313648+0000","last_unstale":"2024-04-26T10:21:10.742675+0000","last_undegraded":"2024-04-26T10:21:10.742675+0000","last_fullsized":"2024-04-26T10:21:10.742675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:57.658133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743475+0000","last_change":"2024-04-26T10:21:09.316594+0000","last_active":"2024-04-26T10:21:10.743475+0000","last_peered":"2024-04-26T10:21:10.743475+0000","last_clean":"2024-04-26T10:21:10.743475+0000","last_became_active":"2024-04-26T10:21:09.315877+0000","last_became_peered":"2024-04-26T10:21:09.315877+0000","last_unstale":"2024-04-26T10:21:10.743475+0000","last_undegraded":"2024-04-26T10:21:10.743475+0000","last_fullsized":"2024-04-26T10:21:10.743475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:19.943321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302427+0000","last_change":"2024-04-26T10:21:09.318829+0000","last_active":"2024-04-26T10:21:10.302427+0000","last_peered":"2024-04-26T10:21:10.302427+0000","last_clean":"2024-04-26T10:21:10.302427+0000","last_became_active":"2024-04-26T10:21:09.318379+0000","last_became_peered":"2024-04-26T10:21:09.318379+0000","last_unstale":"2024-04-26T10:21:10.302427+0000","last_undegraded":"2024-04-26T10:21:10.302427+0000","last_fullsized":"2024-04-26T10:21:10.302427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:11.224015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302100+0000","last_change":"2024-04-26T10:21:09.309068+0000","last_active":"2024-04-26T10:21:10.302100+0000","last_peered":"2024-04-26T10:21:10.302100+0000","last_clean":"2024-04-26T10:21:10.302100+0000","last_became_active":"2024-04-26T10:21:09.308797+0000","last_became_peered":"2024-04-26T10:21:09.308797+0000","last_unstale":"2024-04-26T10:21:10.302100+0000","last_undegraded":"2024-04-26T10:21:10.302100+0000","last_fullsized":"2024-04-26T10:21:10.302100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:44.761759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.301914+0000","last_change":"2024-04-26T10:21:09.311574+0000","last_active":"2024-04-26T10:21:10.301914+0000","last_peered":"2024-04-26T10:21:10.301914+0000","last_clean":"2024-04-26T10:21:10.301914+0000","last_became_active":"2024-04-26T10:21:09.309285+0000","last_became_peered":"2024-04-26T10:21:09.309285+0000","last_unstale":"2024-04-26T10:21:10.301914+0000","last_undegraded":"2024-04-26T10:21:10.301914+0000","last_fullsized":"2024-04-26T10:21:10.301914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:06.884098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303605+0000","last_change":"2024-04-26T10:21:09.317948+0000","last_active":"2024-04-26T10:21:10.303605+0000","last_peered":"2024-04-26T10:21:10.303605+0000","last_clean":"2024-04-26T10:21:10.303605+0000","last_became_active":"2024-04-26T10:21:09.317571+0000","last_became_peered":"2024-04-26T10:21:09.317571+0000","last_unstale":"2024-04-26T10:21:10.303605+0000","last_undegraded":"2024-04-26T10:21:10.303605+0000","last_fullsized":"2024-04-26T10:21:10.303605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:04.179516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304130+0000","last_change":"2024-04-26T10:21:09.312839+0000","last_active":"2024-04-26T10:21:10.304130+0000","last_peered":"2024-04-26T10:21:10.304130+0000","last_clean":"2024-04-26T10:21:10.304130+0000","last_became_active":"2024-04-26T10:21:09.311898+0000","last_became_peered":"2024-04-26T10:21:09.311898+0000","last_unstale":"2024-04-26T10:21:10.304130+0000","last_undegraded":"2024-04-26T10:21:10.304130+0000","last_fullsized":"2024-04-26T10:21:10.304130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:03.705171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743873+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:21:10.743873+0000","last_peered":"2024-04-26T10:21:10.743873+0000","last_clean":"2024-04-26T10:21:10.743873+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:21:10.743873+0000","last_undegraded":"2024-04-26T10:21:10.743873+0000","last_fullsized":"2024-04-26T10:21:10.743873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:39.394937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303372+0000","last_change":"2024-04-26T10:21:09.312446+0000","last_active":"2024-04-26T10:21:10.303372+0000","last_peered":"2024-04-26T10:21:10.303372+0000","last_clean":"2024-04-26T10:21:10.303372+0000","last_became_active":"2024-04-26T10:21:09.311919+0000","last_became_peered":"2024-04-26T10:21:09.311919+0000","last_unstale":"2024-04-26T10:21:10.303372+0000","last_undegraded":"2024-04-26T10:21:10.303372+0000","last_fullsized":"2024-04-26T10:21:10.303372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:57.658133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303274+0000","last_change":"2024-04-26T10:21:09.316871+0000","last_active":"2024-04-26T10:21:10.303274+0000","last_peered":"2024-04-26T10:21:10.303274+0000","last_clean":"2024-04-26T10:21:10.303274+0000","last_became_active":"2024-04-26T10:21:09.316529+0000","last_became_peered":"2024-04-26T10:21:09.316529+0000","last_unstale":"2024-04-26T10:21:10.303274+0000","last_undegraded":"2024-04-26T10:21:10.303274+0000","last_fullsized":"2024-04-26T10:21:10.303274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:52.614699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303836+0000","last_change":"2024-04-26T10:21:09.313160+0000","last_active":"2024-04-26T10:21:10.303836+0000","last_peered":"2024-04-26T10:21:10.303836+0000","last_clean":"2024-04-26T10:21:10.303836+0000","last_became_active":"2024-04-26T10:21:09.312556+0000","last_became_peered":"2024-04-26T10:21:09.312556+0000","last_unstale":"2024-04-26T10:21:10.303836+0000","last_undegraded":"2024-04-26T10:21:10.303836+0000","last_fullsized":"2024-04-26T10:21:10.303836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:21.698558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302244+0000","last_change":"2024-04-26T10:21:09.314165+0000","last_active":"2024-04-26T10:21:10.302244+0000","last_peered":"2024-04-26T10:21:10.302244+0000","last_clean":"2024-04-26T10:21:10.302244+0000","last_became_active":"2024-04-26T10:21:09.313559+0000","last_became_peered":"2024-04-26T10:21:09.313559+0000","last_unstale":"2024-04-26T10:21:10.302244+0000","last_undegraded":"2024-04-26T10:21:10.302244+0000","last_fullsized":"2024-04-26T10:21:10.302244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:05.857831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741968+0000","last_change":"2024-04-26T10:21:09.309366+0000","last_active":"2024-04-26T10:21:10.741968+0000","last_peered":"2024-04-26T10:21:10.741968+0000","last_clean":"2024-04-26T10:21:10.741968+0000","last_became_active":"2024-04-26T10:21:09.308660+0000","last_became_peered":"2024-04-26T10:21:09.308660+0000","last_unstale":"2024-04-26T10:21:10.741968+0000","last_undegraded":"2024-04-26T10:21:10.741968+0000","last_fullsized":"2024-04-26T10:21:10.741968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.335327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303113+0000","last_change":"2024-04-26T10:21:09.317455+0000","last_active":"2024-04-26T10:21:10.303113+0000","last_peered":"2024-04-26T10:21:10.303113+0000","last_clean":"2024-04-26T10:21:10.303113+0000","last_became_active":"2024-04-26T10:21:09.316994+0000","last_became_peered":"2024-04-26T10:21:09.316994+0000","last_unstale":"2024-04-26T10:21:10.303113+0000","last_undegraded":"2024-04-26T10:21:10.303113+0000","last_fullsized":"2024-04-26T10:21:10.303113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:48.942276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.317124+0000","last_change":"2024-04-26T10:21:08.939370+0000","last_active":"2024-04-26T10:21:09.317124+0000","last_peered":"2024-04-26T10:21:09.317124+0000","last_clean":"2024-04-26T10:21:09.317124+0000","last_became_active":"2024-04-26T10:21:08.937845+0000","last_became_peered":"2024-04-26T10:21:08.937845+0000","last_unstale":"2024-04-26T10:21:09.317124+0000","last_undegraded":"2024-04-26T10:21:09.317124+0000","last_fullsized":"2024-04-26T10:21:09.317124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:28.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304041+0000","last_change":"2024-04-26T10:21:09.316515+0000","last_active":"2024-04-26T10:21:10.304041+0000","last_peered":"2024-04-26T10:21:10.304041+0000","last_clean":"2024-04-26T10:21:10.304041+0000","last_became_active":"2024-04-26T10:21:09.315714+0000","last_became_peered":"2024-04-26T10:21:09.315714+0000","last_unstale":"2024-04-26T10:21:10.304041+0000","last_undegraded":"2024-04-26T10:21:10.304041+0000","last_fullsized":"2024-04-26T10:21:10.304041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.032760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296726+0000","last_change":"2024-04-26T10:21:08.937056+0000","last_active":"2024-04-26T10:21:09.296726+0000","last_peered":"2024-04-26T10:21:09.296726+0000","last_clean":"2024-04-26T10:21:09.296726+0000","last_became_active":"2024-04-26T10:21:08.936545+0000","last_became_peered":"2024-04-26T10:21:08.936545+0000","last_unstale":"2024-04-26T10:21:09.296726+0000","last_undegraded":"2024-04-26T10:21:09.296726+0000","last_fullsized":"2024-04-26T10:21:09.296726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:48.449203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304386+0000","last_change":"2024-04-26T10:21:09.313813+0000","last_active":"2024-04-26T10:21:10.304386+0000","last_peered":"2024-04-26T10:21:10.304386+0000","last_clean":"2024-04-26T10:21:10.304386+0000","last_became_active":"2024-04-26T10:21:09.312562+0000","last_became_peered":"2024-04-26T10:21:09.312562+0000","last_unstale":"2024-04-26T10:21:10.304386+0000","last_undegraded":"2024-04-26T10:21:10.304386+0000","last_fullsized":"2024-04-26T10:21:10.304386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:46.413942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309703+0000","last_change":"2024-04-26T10:21:08.936433+0000","last_active":"2024-04-26T10:21:09.309703+0000","last_peered":"2024-04-26T10:21:09.309703+0000","last_clean":"2024-04-26T10:21:09.309703+0000","last_became_active":"2024-04-26T10:21:08.935875+0000","last_became_peered":"2024-04-26T10:21:08.935875+0000","last_unstale":"2024-04-26T10:21:09.309703+0000","last_undegraded":"2024-04-26T10:21:09.309703+0000","last_fullsized":"2024-04-26T10:21:09.309703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:24.501204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303865+0000","last_change":"2024-04-26T10:21:09.314435+0000","last_active":"2024-04-26T10:21:10.303865+0000","last_peered":"2024-04-26T10:21:10.303865+0000","last_clean":"2024-04-26T10:21:10.303865+0000","last_became_active":"2024-04-26T10:21:09.313684+0000","last_became_peered":"2024-04-26T10:21:09.313684+0000","last_unstale":"2024-04-26T10:21:10.303865+0000","last_undegraded":"2024-04-26T10:21:10.303865+0000","last_fullsized":"2024-04-26T10:21:10.303865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:20.185980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.321258+0000","last_change":"2024-04-26T10:21:08.934971+0000","last_active":"2024-04-26T10:21:09.321258+0000","last_peered":"2024-04-26T10:21:09.321258+0000","last_clean":"2024-04-26T10:21:09.321258+0000","last_became_active":"2024-04-26T10:21:08.934653+0000","last_became_peered":"2024-04-26T10:21:08.934653+0000","last_unstale":"2024-04-26T10:21:09.321258+0000","last_undegraded":"2024-04-26T10:21:09.321258+0000","last_fullsized":"2024-04-26T10:21:09.321258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:18.272015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.315924+0000","last_change":"2024-04-26T10:21:08.934452+0000","last_active":"2024-04-26T10:21:09.315924+0000","last_peered":"2024-04-26T10:21:09.315924+0000","last_clean":"2024-04-26T10:21:09.315924+0000","last_became_active":"2024-04-26T10:21:08.934091+0000","last_became_peered":"2024-04-26T10:21:08.934091+0000","last_unstale":"2024-04-26T10:21:09.315924+0000","last_undegraded":"2024-04-26T10:21:09.315924+0000","last_fullsized":"2024-04-26T10:21:09.315924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:11.224989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.301898+0000","last_change":"2024-04-26T10:21:09.314631+0000","last_active":"2024-04-26T10:21:10.301898+0000","last_peered":"2024-04-26T10:21:10.301898+0000","last_clean":"2024-04-26T10:21:10.301898+0000","last_became_active":"2024-04-26T10:21:09.313044+0000","last_became_peered":"2024-04-26T10:21:09.313044+0000","last_unstale":"2024-04-26T10:21:10.301898+0000","last_undegraded":"2024-04-26T10:21:10.301898+0000","last_fullsized":"2024-04-26T10:21:10.301898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:19.943321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.319848+0000","last_change":"2024-04-26T10:21:08.935870+0000","last_active":"2024-04-26T10:21:09.319848+0000","last_peered":"2024-04-26T10:21:09.319848+0000","last_clean":"2024-04-26T10:21:09.319848+0000","last_became_active":"2024-04-26T10:21:08.935380+0000","last_became_peered":"2024-04-26T10:21:08.935380+0000","last_unstale":"2024-04-26T10:21:09.319848+0000","last_undegraded":"2024-04-26T10:21:09.319848+0000","last_fullsized":"2024-04-26T10:21:09.319848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:22.537149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302131+0000","last_change":"2024-04-26T10:21:09.317032+0000","last_active":"2024-04-26T10:21:10.302131+0000","last_peered":"2024-04-26T10:21:10.302131+0000","last_clean":"2024-04-26T10:21:10.302131+0000","last_became_active":"2024-04-26T10:21:09.316416+0000","last_became_peered":"2024-04-26T10:21:09.316416+0000","last_unstale":"2024-04-26T10:21:10.302131+0000","last_undegraded":"2024-04-26T10:21:10.302131+0000","last_fullsized":"2024-04-26T10:21:10.302131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:56.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320696+0000","last_change":"2024-04-26T10:21:08.935133+0000","last_active":"2024-04-26T10:21:09.320696+0000","last_peered":"2024-04-26T10:21:09.320696+0000","last_clean":"2024-04-26T10:21:09.320696+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:21:09.320696+0000","last_undegraded":"2024-04-26T10:21:09.320696+0000","last_fullsized":"2024-04-26T10:21:09.320696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:25.498249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743681+0000","last_change":"2024-04-26T10:21:09.315201+0000","last_active":"2024-04-26T10:21:10.743681+0000","last_peered":"2024-04-26T10:21:10.743681+0000","last_clean":"2024-04-26T10:21:10.743681+0000","last_became_active":"2024-04-26T10:21:09.314390+0000","last_became_peered":"2024-04-26T10:21:09.314390+0000","last_unstale":"2024-04-26T10:21:10.743681+0000","last_undegraded":"2024-04-26T10:21:10.743681+0000","last_fullsized":"2024-04-26T10:21:10.743681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.998466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.299090+0000","last_change":"2024-04-26T10:21:08.939382+0000","last_active":"2024-04-26T10:21:09.299090+0000","last_peered":"2024-04-26T10:21:09.299090+0000","last_clean":"2024-04-26T10:21:09.299090+0000","last_became_active":"2024-04-26T10:21:08.938193+0000","last_became_peered":"2024-04-26T10:21:08.938193+0000","last_unstale":"2024-04-26T10:21:09.299090+0000","last_undegraded":"2024-04-26T10:21:09.299090+0000","last_fullsized":"2024-04-26T10:21:09.299090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:01.182611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303014+0000","last_change":"2024-04-26T10:21:09.313678+0000","last_active":"2024-04-26T10:21:10.303014+0000","last_peered":"2024-04-26T10:21:10.303014+0000","last_clean":"2024-04-26T10:21:10.303014+0000","last_became_active":"2024-04-26T10:21:09.312906+0000","last_became_peered":"2024-04-26T10:21:09.312906+0000","last_unstale":"2024-04-26T10:21:10.303014+0000","last_undegraded":"2024-04-26T10:21:10.303014+0000","last_fullsized":"2024-04-26T10:21:10.303014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:14.241108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.313678+0000","last_change":"2024-04-26T10:21:08.936904+0000","last_active":"2024-04-26T10:21:09.313678+0000","last_peered":"2024-04-26T10:21:09.313678+0000","last_clean":"2024-04-26T10:21:09.313678+0000","last_became_active":"2024-04-26T10:21:08.936376+0000","last_became_peered":"2024-04-26T10:21:08.936376+0000","last_unstale":"2024-04-26T10:21:09.313678+0000","last_undegraded":"2024-04-26T10:21:09.313678+0000","last_fullsized":"2024-04-26T10:21:09.313678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:19.270525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742850+0000","last_change":"2024-04-26T10:21:09.307911+0000","last_active":"2024-04-26T10:21:10.742850+0000","last_peered":"2024-04-26T10:21:10.742850+0000","last_clean":"2024-04-26T10:21:10.742850+0000","last_became_active":"2024-04-26T10:21:09.307597+0000","last_became_peered":"2024-04-26T10:21:09.307597+0000","last_unstale":"2024-04-26T10:21:10.742850+0000","last_undegraded":"2024-04-26T10:21:10.742850+0000","last_fullsized":"2024-04-26T10:21:10.742850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:21.698558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.300582+0000","last_change":"2024-04-26T10:21:08.939072+0000","last_active":"2024-04-26T10:21:09.300582+0000","last_peered":"2024-04-26T10:21:09.300582+0000","last_clean":"2024-04-26T10:21:09.300582+0000","last_became_active":"2024-04-26T10:21:08.938445+0000","last_became_peered":"2024-04-26T10:21:08.938445+0000","last_unstale":"2024-04-26T10:21:09.300582+0000","last_undegraded":"2024-04-26T10:21:09.300582+0000","last_fullsized":"2024-04-26T10:21:09.300582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:06.598189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743938+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:21:10.743938+0000","last_peered":"2024-04-26T10:21:10.743938+0000","last_clean":"2024-04-26T10:21:10.743938+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:21:10.743938+0000","last_undegraded":"2024-04-26T10:21:10.743938+0000","last_fullsized":"2024-04-26T10:21:10.743938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309935+0000","last_change":"2024-04-26T10:21:08.936533+0000","last_active":"2024-04-26T10:21:09.309935+0000","last_peered":"2024-04-26T10:21:09.309935+0000","last_clean":"2024-04-26T10:21:09.309935+0000","last_became_active":"2024-04-26T10:21:08.936222+0000","last_became_peered":"2024-04-26T10:21:08.936222+0000","last_unstale":"2024-04-26T10:21:09.309935+0000","last_undegraded":"2024-04-26T10:21:09.309935+0000","last_fullsized":"2024-04-26T10:21:09.309935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:18:07.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742771+0000","last_change":"2024-04-26T10:21:09.316361+0000","last_active":"2024-04-26T10:21:10.742771+0000","last_peered":"2024-04-26T10:21:10.742771+0000","last_clean":"2024-04-26T10:21:10.742771+0000","last_became_active":"2024-04-26T10:21:09.315981+0000","last_became_peered":"2024-04-26T10:21:09.315981+0000","last_unstale":"2024-04-26T10:21:10.742771+0000","last_undegraded":"2024-04-26T10:21:10.742771+0000","last_fullsized":"2024-04-26T10:21:10.742771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:00.173638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309815+0000","last_change":"2024-04-26T10:21:08.928590+0000","last_active":"2024-04-26T10:21:09.309815+0000","last_peered":"2024-04-26T10:21:09.309815+0000","last_clean":"2024-04-26T10:21:09.309815+0000","last_became_active":"2024-04-26T10:21:08.928354+0000","last_became_peered":"2024-04-26T10:21:08.928354+0000","last_unstale":"2024-04-26T10:21:09.309815+0000","last_undegraded":"2024-04-26T10:21:09.309815+0000","last_fullsized":"2024-04-26T10:21:09.309815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:52.241716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304119+0000","last_change":"2024-04-26T10:21:09.317282+0000","last_active":"2024-04-26T10:21:10.304119+0000","last_peered":"2024-04-26T10:21:10.304119+0000","last_clean":"2024-04-26T10:21:10.304119+0000","last_became_active":"2024-04-26T10:21:09.316591+0000","last_became_peered":"2024-04-26T10:21:09.316591+0000","last_unstale":"2024-04-26T10:21:10.304119+0000","last_undegraded":"2024-04-26T10:21:10.304119+0000","last_fullsized":"2024-04-26T10:21:10.304119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:28.447361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":213,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297609+0000","last_change":"2024-04-26T10:21:01.829140+0000","last_active":"2024-04-26T10:21:09.297609+0000","last_peered":"2024-04-26T10:21:09.297609+0000","last_clean":"2024-04-26T10:21:09.297609+0000","last_became_active":"2024-04-26T10:21:01.827182+0000","last_became_peered":"2024-04-26T10:21:01.827182+0000","last_unstale":"2024-04-26T10:21:09.297609+0000","last_undegraded":"2024-04-26T10:21:09.297609+0000","last_fullsized":"2024-04-26T10:21:09.297609+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:00:51.477222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298874+0000","last_change":"2024-04-26T10:21:04.893745+0000","last_active":"2024-04-26T10:21:09.298874+0000","last_peered":"2024-04-26T10:21:09.298874+0000","last_clean":"2024-04-26T10:21:09.298874+0000","last_became_active":"2024-04-26T10:21:04.893031+0000","last_became_peered":"2024-04-26T10:21:04.893031+0000","last_unstale":"2024-04-26T10:21:09.298874+0000","last_undegraded":"2024-04-26T10:21:09.298874+0000","last_fullsized":"2024-04-26T10:21:09.298874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:59.771061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297001+0000","last_change":"2024-04-26T10:21:08.933706+0000","last_active":"2024-04-26T10:21:09.297001+0000","last_peered":"2024-04-26T10:21:09.297001+0000","last_clean":"2024-04-26T10:21:09.297001+0000","last_became_active":"2024-04-26T10:21:08.933372+0000","last_became_peered":"2024-04-26T10:21:08.933372+0000","last_unstale":"2024-04-26T10:21:09.297001+0000","last_undegraded":"2024-04-26T10:21:09.297001+0000","last_fullsized":"2024-04-26T10:21:09.297001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:14.290484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.744176+0000","last_change":"2024-04-26T10:21:09.320889+0000","last_active":"2024-04-26T10:21:10.744176+0000","last_peered":"2024-04-26T10:21:10.744176+0000","last_clean":"2024-04-26T10:21:10.744176+0000","last_became_active":"2024-04-26T10:21:09.320355+0000","last_became_peered":"2024-04-26T10:21:09.320355+0000","last_unstale":"2024-04-26T10:21:10.744176+0000","last_undegraded":"2024-04-26T10:21:10.744176+0000","last_fullsized":"2024-04-26T10:21:10.744176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:41.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297382+0000","last_change":"2024-04-26T10:21:04.892156+0000","last_active":"2024-04-26T10:21:09.297382+0000","last_peered":"2024-04-26T10:21:09.297382+0000","last_clean":"2024-04-26T10:21:09.297382+0000","last_became_active":"2024-04-26T10:21:04.891660+0000","last_became_peered":"2024-04-26T10:21:04.891660+0000","last_unstale":"2024-04-26T10:21:09.297382+0000","last_undegraded":"2024-04-26T10:21:09.297382+0000","last_fullsized":"2024-04-26T10:21:09.297382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:50.568468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296858+0000","last_change":"2024-04-26T10:21:08.936815+0000","last_active":"2024-04-26T10:21:09.296858+0000","last_peered":"2024-04-26T10:21:09.296858+0000","last_clean":"2024-04-26T10:21:09.296858+0000","last_became_active":"2024-04-26T10:21:08.936180+0000","last_became_peered":"2024-04-26T10:21:08.936180+0000","last_unstale":"2024-04-26T10:21:09.296858+0000","last_undegraded":"2024-04-26T10:21:09.296858+0000","last_fullsized":"2024-04-26T10:21:09.296858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:41.614282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304366+0000","last_change":"2024-04-26T10:21:09.310050+0000","last_active":"2024-04-26T10:21:10.304366+0000","last_peered":"2024-04-26T10:21:10.304366+0000","last_clean":"2024-04-26T10:21:10.304366+0000","last_became_active":"2024-04-26T10:21:09.309470+0000","last_became_peered":"2024-04-26T10:21:09.309470+0000","last_unstale":"2024-04-26T10:21:10.304366+0000","last_undegraded":"2024-04-26T10:21:10.304366+0000","last_fullsized":"2024-04-26T10:21:10.304366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:32.334144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296330+0000","last_change":"2024-04-26T10:21:04.890860+0000","last_active":"2024-04-26T10:21:09.296330+0000","last_peered":"2024-04-26T10:21:09.296330+0000","last_clean":"2024-04-26T10:21:09.296330+0000","last_became_active":"2024-04-26T10:21:04.890336+0000","last_became_peered":"2024-04-26T10:21:04.890336+0000","last_unstale":"2024-04-26T10:21:09.296330+0000","last_undegraded":"2024-04-26T10:21:09.296330+0000","last_fullsized":"2024-04-26T10:21:09.296330+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:13.262120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.310359+0000","last_change":"2024-04-26T10:21:08.936077+0000","last_active":"2024-04-26T10:21:09.310359+0000","last_peered":"2024-04-26T10:21:09.310359+0000","last_clean":"2024-04-26T10:21:09.310359+0000","last_became_active":"2024-04-26T10:21:08.935621+0000","last_became_peered":"2024-04-26T10:21:08.935621+0000","last_unstale":"2024-04-26T10:21:09.310359+0000","last_undegraded":"2024-04-26T10:21:09.310359+0000","last_fullsized":"2024-04-26T10:21:09.310359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:11.906094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304130+0000","last_change":"2024-04-26T10:21:09.314796+0000","last_active":"2024-04-26T10:21:10.304130+0000","last_peered":"2024-04-26T10:21:10.304130+0000","last_clean":"2024-04-26T10:21:10.304130+0000","last_became_active":"2024-04-26T10:21:09.314574+0000","last_became_peered":"2024-04-26T10:21:09.314574+0000","last_unstale":"2024-04-26T10:21:10.304130+0000","last_undegraded":"2024-04-26T10:21:10.304130+0000","last_fullsized":"2024-04-26T10:21:10.304130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:32.136621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301803+0000","last_change":"2024-04-26T10:21:04.893253+0000","last_active":"2024-04-26T10:21:09.301803+0000","last_peered":"2024-04-26T10:21:09.301803+0000","last_clean":"2024-04-26T10:21:09.301803+0000","last_became_active":"2024-04-26T10:21:04.892843+0000","last_became_peered":"2024-04-26T10:21:04.892843+0000","last_unstale":"2024-04-26T10:21:09.301803+0000","last_undegraded":"2024-04-26T10:21:09.301803+0000","last_fullsized":"2024-04-26T10:21:09.301803+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:00.749791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298626+0000","last_change":"2024-04-26T10:21:08.937153+0000","last_active":"2024-04-26T10:21:09.298626+0000","last_peered":"2024-04-26T10:21:09.298626+0000","last_clean":"2024-04-26T10:21:09.298626+0000","last_became_active":"2024-04-26T10:21:08.936561+0000","last_became_peered":"2024-04-26T10:21:08.936561+0000","last_unstale":"2024-04-26T10:21:09.298626+0000","last_undegraded":"2024-04-26T10:21:09.298626+0000","last_fullsized":"2024-04-26T10:21:09.298626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:28.491800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303941+0000","last_change":"2024-04-26T10:21:09.314218+0000","last_active":"2024-04-26T10:21:10.303941+0000","last_peered":"2024-04-26T10:21:10.303941+0000","last_clean":"2024-04-26T10:21:10.303941+0000","last_became_active":"2024-04-26T10:21:09.313641+0000","last_became_peered":"2024-04-26T10:21:09.313641+0000","last_unstale":"2024-04-26T10:21:10.303941+0000","last_undegraded":"2024-04-26T10:21:10.303941+0000","last_fullsized":"2024-04-26T10:21:10.303941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:08.449512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.300397+0000","last_change":"2024-04-26T10:21:08.937196+0000","last_active":"2024-04-26T10:21:09.300397+0000","last_peered":"2024-04-26T10:21:09.300397+0000","last_clean":"2024-04-26T10:21:09.300397+0000","last_became_active":"2024-04-26T10:21:08.936779+0000","last_became_peered":"2024-04-26T10:21:08.936779+0000","last_unstale":"2024-04-26T10:21:09.300397+0000","last_undegraded":"2024-04-26T10:21:09.300397+0000","last_fullsized":"2024-04-26T10:21:09.300397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:20.545169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295561+0000","last_change":"2024-04-26T10:21:04.890548+0000","last_active":"2024-04-26T10:21:09.295561+0000","last_peered":"2024-04-26T10:21:09.295561+0000","last_clean":"2024-04-26T10:21:09.295561+0000","last_became_active":"2024-04-26T10:21:04.890034+0000","last_became_peered":"2024-04-26T10:21:04.890034+0000","last_unstale":"2024-04-26T10:21:09.295561+0000","last_undegraded":"2024-04-26T10:21:09.295561+0000","last_fullsized":"2024-04-26T10:21:09.295561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:55.033455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302442+0000","last_change":"2024-04-26T10:21:09.318348+0000","last_active":"2024-04-26T10:21:10.302442+0000","last_peered":"2024-04-26T10:21:10.302442+0000","last_clean":"2024-04-26T10:21:10.302442+0000","last_became_active":"2024-04-26T10:21:09.317886+0000","last_became_peered":"2024-04-26T10:21:09.317886+0000","last_unstale":"2024-04-26T10:21:10.302442+0000","last_undegraded":"2024-04-26T10:21:10.302442+0000","last_fullsized":"2024-04-26T10:21:10.302442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:24.624358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295394+0000","last_change":"2024-04-26T10:21:08.933714+0000","last_active":"2024-04-26T10:21:09.295394+0000","last_peered":"2024-04-26T10:21:09.295394+0000","last_clean":"2024-04-26T10:21:09.295394+0000","last_became_active":"2024-04-26T10:21:08.933259+0000","last_became_peered":"2024-04-26T10:21:08.933259+0000","last_unstale":"2024-04-26T10:21:09.295394+0000","last_undegraded":"2024-04-26T10:21:09.295394+0000","last_fullsized":"2024-04-26T10:21:09.295394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:50.230096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.311683+0000","last_change":"2024-04-26T10:21:04.891490+0000","last_active":"2024-04-26T10:21:09.311683+0000","last_peered":"2024-04-26T10:21:09.311683+0000","last_clean":"2024-04-26T10:21:09.311683+0000","last_became_active":"2024-04-26T10:21:04.890777+0000","last_became_peered":"2024-04-26T10:21:04.890777+0000","last_unstale":"2024-04-26T10:21:09.311683+0000","last_undegraded":"2024-04-26T10:21:09.311683+0000","last_fullsized":"2024-04-26T10:21:09.311683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:25.896672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302680+0000","last_change":"2024-04-26T10:21:09.314213+0000","last_active":"2024-04-26T10:21:10.302680+0000","last_peered":"2024-04-26T10:21:10.302680+0000","last_clean":"2024-04-26T10:21:10.302680+0000","last_became_active":"2024-04-26T10:21:09.312975+0000","last_became_peered":"2024-04-26T10:21:09.312975+0000","last_unstale":"2024-04-26T10:21:10.302680+0000","last_undegraded":"2024-04-26T10:21:10.302680+0000","last_fullsized":"2024-04-26T10:21:10.302680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:43.137127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.317699+0000","last_change":"2024-04-26T10:21:08.934216+0000","last_active":"2024-04-26T10:21:09.317699+0000","last_peered":"2024-04-26T10:21:09.317699+0000","last_clean":"2024-04-26T10:21:09.317699+0000","last_became_active":"2024-04-26T10:21:08.933524+0000","last_became_peered":"2024-04-26T10:21:08.933524+0000","last_unstale":"2024-04-26T10:21:09.317699+0000","last_undegraded":"2024-04-26T10:21:09.317699+0000","last_fullsized":"2024-04-26T10:21:09.317699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:57.798830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297318+0000","last_change":"2024-04-26T10:21:04.890490+0000","last_active":"2024-04-26T10:21:09.297318+0000","last_peered":"2024-04-26T10:21:09.297318+0000","last_clean":"2024-04-26T10:21:09.297318+0000","last_became_active":"2024-04-26T10:21:04.889808+0000","last_became_peered":"2024-04-26T10:21:04.889808+0000","last_unstale":"2024-04-26T10:21:09.297318+0000","last_undegraded":"2024-04-26T10:21:09.297318+0000","last_fullsized":"2024-04-26T10:21:09.297318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:55.711555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302374+0000","last_change":"2024-04-26T10:21:09.312260+0000","last_active":"2024-04-26T10:21:10.302374+0000","last_peered":"2024-04-26T10:21:10.302374+0000","last_clean":"2024-04-26T10:21:10.302374+0000","last_became_active":"2024-04-26T10:21:09.311309+0000","last_became_peered":"2024-04-26T10:21:09.311309+0000","last_unstale":"2024-04-26T10:21:10.302374+0000","last_undegraded":"2024-04-26T10:21:10.302374+0000","last_fullsized":"2024-04-26T10:21:10.302374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:30.714581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297093+0000","last_change":"2024-04-26T10:21:08.936623+0000","last_active":"2024-04-26T10:21:09.297093+0000","last_peered":"2024-04-26T10:21:09.297093+0000","last_clean":"2024-04-26T10:21:09.297093+0000","last_became_active":"2024-04-26T10:21:08.936252+0000","last_became_peered":"2024-04-26T10:21:08.936252+0000","last_unstale":"2024-04-26T10:21:09.297093+0000","last_undegraded":"2024-04-26T10:21:09.297093+0000","last_fullsized":"2024-04-26T10:21:09.297093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:24.526250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296848+0000","last_change":"2024-04-26T10:21:04.892401+0000","last_active":"2024-04-26T10:21:09.296848+0000","last_peered":"2024-04-26T10:21:09.296848+0000","last_clean":"2024-04-26T10:21:09.296848+0000","last_became_active":"2024-04-26T10:21:04.891692+0000","last_became_peered":"2024-04-26T10:21:04.891692+0000","last_unstale":"2024-04-26T10:21:09.296848+0000","last_undegraded":"2024-04-26T10:21:09.296848+0000","last_fullsized":"2024-04-26T10:21:09.296848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:37.548728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302178+0000","last_change":"2024-04-26T10:21:09.317981+0000","last_active":"2024-04-26T10:21:10.302178+0000","last_peered":"2024-04-26T10:21:10.302178+0000","last_clean":"2024-04-26T10:21:10.302178+0000","last_became_active":"2024-04-26T10:21:09.317601+0000","last_became_peered":"2024-04-26T10:21:09.317601+0000","last_unstale":"2024-04-26T10:21:10.302178+0000","last_undegraded":"2024-04-26T10:21:10.302178+0000","last_fullsized":"2024-04-26T10:21:10.302178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742909+0000","last_change":"2024-04-26T10:21:09.317120+0000","last_active":"2024-04-26T10:21:10.742909+0000","last_peered":"2024-04-26T10:21:10.742909+0000","last_clean":"2024-04-26T10:21:10.742909+0000","last_became_active":"2024-04-26T10:21:09.316741+0000","last_became_peered":"2024-04-26T10:21:09.316741+0000","last_unstale":"2024-04-26T10:21:10.742909+0000","last_undegraded":"2024-04-26T10:21:10.742909+0000","last_fullsized":"2024-04-26T10:21:10.742909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:43.702714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.326574+0000","last_change":"2024-04-26T10:21:08.934481+0000","last_active":"2024-04-26T10:21:09.326574+0000","last_peered":"2024-04-26T10:21:09.326574+0000","last_clean":"2024-04-26T10:21:09.326574+0000","last_became_active":"2024-04-26T10:21:08.934076+0000","last_became_peered":"2024-04-26T10:21:08.934076+0000","last_unstale":"2024-04-26T10:21:09.326574+0000","last_undegraded":"2024-04-26T10:21:09.326574+0000","last_fullsized":"2024-04-26T10:21:09.326574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:50.622715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302791+0000","last_change":"2024-04-26T10:21:09.314009+0000","last_active":"2024-04-26T10:21:10.302791+0000","last_peered":"2024-04-26T10:21:10.302791+0000","last_clean":"2024-04-26T10:21:10.302791+0000","last_became_active":"2024-04-26T10:21:09.313556+0000","last_became_peered":"2024-04-26T10:21:09.313556+0000","last_unstale":"2024-04-26T10:21:10.302791+0000","last_undegraded":"2024-04-26T10:21:10.302791+0000","last_fullsized":"2024-04-26T10:21:10.302791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:34.862466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320711+0000","last_change":"2024-04-26T10:21:08.936526+0000","last_active":"2024-04-26T10:21:09.320711+0000","last_peered":"2024-04-26T10:21:09.320711+0000","last_clean":"2024-04-26T10:21:09.320711+0000","last_became_active":"2024-04-26T10:21:08.936217+0000","last_became_peered":"2024-04-26T10:21:08.936217+0000","last_unstale":"2024-04-26T10:21:09.320711+0000","last_undegraded":"2024-04-26T10:21:09.320711+0000","last_fullsized":"2024-04-26T10:21:09.320711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:57.649639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301807+0000","last_change":"2024-04-26T10:21:08.937597+0000","last_active":"2024-04-26T10:21:09.301807+0000","last_peered":"2024-04-26T10:21:09.301807+0000","last_clean":"2024-04-26T10:21:09.301807+0000","last_became_active":"2024-04-26T10:21:08.936809+0000","last_became_peered":"2024-04-26T10:21:08.936809+0000","last_unstale":"2024-04-26T10:21:09.301807+0000","last_undegraded":"2024-04-26T10:21:09.301807+0000","last_fullsized":"2024-04-26T10:21:09.301807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:17.212235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302338+0000","last_change":"2024-04-26T10:21:09.312054+0000","last_active":"2024-04-26T10:21:10.302338+0000","last_peered":"2024-04-26T10:21:10.302338+0000","last_clean":"2024-04-26T10:21:10.302338+0000","last_became_active":"2024-04-26T10:21:09.310818+0000","last_became_peered":"2024-04-26T10:21:09.310818+0000","last_unstale":"2024-04-26T10:21:10.302338+0000","last_undegraded":"2024-04-26T10:21:10.302338+0000","last_fullsized":"2024-04-26T10:21:10.302338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:03.431355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301359+0000","last_change":"2024-04-26T10:21:08.937445+0000","last_active":"2024-04-26T10:21:09.301359+0000","last_peered":"2024-04-26T10:21:09.301359+0000","last_clean":"2024-04-26T10:21:09.301359+0000","last_became_active":"2024-04-26T10:21:08.937147+0000","last_became_peered":"2024-04-26T10:21:08.937147+0000","last_unstale":"2024-04-26T10:21:09.301359+0000","last_undegraded":"2024-04-26T10:21:09.301359+0000","last_fullsized":"2024-04-26T10:21:09.301359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:29.602825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302232+0000","last_change":"2024-04-26T10:21:09.318091+0000","last_active":"2024-04-26T10:21:10.302232+0000","last_peered":"2024-04-26T10:21:10.302232+0000","last_clean":"2024-04-26T10:21:10.302232+0000","last_became_active":"2024-04-26T10:21:09.317871+0000","last_became_peered":"2024-04-26T10:21:09.317871+0000","last_unstale":"2024-04-26T10:21:10.302232+0000","last_undegraded":"2024-04-26T10:21:10.302232+0000","last_fullsized":"2024-04-26T10:21:10.302232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:32.442915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303867+0000","last_change":"2024-04-26T10:21:09.312636+0000","last_active":"2024-04-26T10:21:10.303867+0000","last_peered":"2024-04-26T10:21:10.303867+0000","last_clean":"2024-04-26T10:21:10.303867+0000","last_became_active":"2024-04-26T10:21:09.312130+0000","last_became_peered":"2024-04-26T10:21:09.312130+0000","last_unstale":"2024-04-26T10:21:10.303867+0000","last_undegraded":"2024-04-26T10:21:10.303867+0000","last_fullsized":"2024-04-26T10:21:10.303867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:29.565507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298243+0000","last_change":"2024-04-26T10:21:08.934046+0000","last_active":"2024-04-26T10:21:09.298243+0000","last_peered":"2024-04-26T10:21:09.298243+0000","last_clean":"2024-04-26T10:21:09.298243+0000","last_became_active":"2024-04-26T10:21:08.933341+0000","last_became_peered":"2024-04-26T10:21:08.933341+0000","last_unstale":"2024-04-26T10:21:09.298243+0000","last_undegraded":"2024-04-26T10:21:09.298243+0000","last_fullsized":"2024-04-26T10:21:09.298243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:45.671865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303860+0000","last_change":"2024-04-26T10:21:09.312081+0000","last_active":"2024-04-26T10:21:10.303860+0000","last_peered":"2024-04-26T10:21:10.303860+0000","last_clean":"2024-04-26T10:21:10.303860+0000","last_became_active":"2024-04-26T10:21:09.310879+0000","last_became_peered":"2024-04-26T10:21:09.310879+0000","last_unstale":"2024-04-26T10:21:10.303860+0000","last_undegraded":"2024-04-26T10:21:10.303860+0000","last_fullsized":"2024-04-26T10:21:10.303860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:36.358962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295619+0000","last_change":"2024-04-26T10:21:08.936748+0000","last_active":"2024-04-26T10:21:09.295619+0000","last_peered":"2024-04-26T10:21:09.295619+0000","last_clean":"2024-04-26T10:21:09.295619+0000","last_became_active":"2024-04-26T10:21:08.936316+0000","last_became_peered":"2024-04-26T10:21:08.936316+0000","last_unstale":"2024-04-26T10:21:09.295619+0000","last_undegraded":"2024-04-26T10:21:09.295619+0000","last_fullsized":"2024-04-26T10:21:09.295619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:47.721288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303753+0000","last_change":"2024-04-26T10:21:09.320062+0000","last_active":"2024-04-26T10:21:10.303753+0000","last_peered":"2024-04-26T10:21:10.303753+0000","last_clean":"2024-04-26T10:21:10.303753+0000","last_became_active":"2024-04-26T10:21:09.319352+0000","last_became_peered":"2024-04-26T10:21:09.319352+0000","last_unstale":"2024-04-26T10:21:10.303753+0000","last_undegraded":"2024-04-26T10:21:10.303753+0000","last_fullsized":"2024-04-26T10:21:10.303753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.998466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316248+0000","last_change":"2024-04-26T10:21:08.931356+0000","last_active":"2024-04-26T10:21:09.316248+0000","last_peered":"2024-04-26T10:21:09.316248+0000","last_clean":"2024-04-26T10:21:09.316248+0000","last_became_active":"2024-04-26T10:21:08.930016+0000","last_became_peered":"2024-04-26T10:21:08.930016+0000","last_unstale":"2024-04-26T10:21:09.316248+0000","last_undegraded":"2024-04-26T10:21:09.316248+0000","last_fullsized":"2024-04-26T10:21:09.316248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:21.306576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303057+0000","last_change":"2024-04-26T10:21:09.318178+0000","last_active":"2024-04-26T10:21:10.303057+0000","last_peered":"2024-04-26T10:21:10.303057+0000","last_clean":"2024-04-26T10:21:10.303057+0000","last_became_active":"2024-04-26T10:21:09.317697+0000","last_became_peered":"2024-04-26T10:21:09.317697+0000","last_unstale":"2024-04-26T10:21:10.303057+0000","last_undegraded":"2024-04-26T10:21:10.303057+0000","last_fullsized":"2024-04-26T10:21:10.303057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:46.285390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320054+0000","last_change":"2024-04-26T10:21:08.936115+0000","last_active":"2024-04-26T10:21:09.320054+0000","last_peered":"2024-04-26T10:21:09.320054+0000","last_clean":"2024-04-26T10:21:09.320054+0000","last_became_active":"2024-04-26T10:21:08.935740+0000","last_became_peered":"2024-04-26T10:21:08.935740+0000","last_unstale":"2024-04-26T10:21:09.320054+0000","last_undegraded":"2024-04-26T10:21:09.320054+0000","last_fullsized":"2024-04-26T10:21:09.320054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:08.369059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742450+0000","last_change":"2024-04-26T10:21:09.308077+0000","last_active":"2024-04-26T10:21:10.742450+0000","last_peered":"2024-04-26T10:21:10.742450+0000","last_clean":"2024-04-26T10:21:10.742450+0000","last_became_active":"2024-04-26T10:21:09.307543+0000","last_became_peered":"2024-04-26T10:21:09.307543+0000","last_unstale":"2024-04-26T10:21:10.742450+0000","last_undegraded":"2024-04-26T10:21:10.742450+0000","last_fullsized":"2024-04-26T10:21:10.742450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:46.596591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316572+0000","last_change":"2024-04-26T10:21:08.938933+0000","last_active":"2024-04-26T10:21:09.316572+0000","last_peered":"2024-04-26T10:21:09.316572+0000","last_clean":"2024-04-26T10:21:09.316572+0000","last_became_active":"2024-04-26T10:21:08.938281+0000","last_became_peered":"2024-04-26T10:21:08.938281+0000","last_unstale":"2024-04-26T10:21:09.316572+0000","last_undegraded":"2024-04-26T10:21:09.316572+0000","last_fullsized":"2024-04-26T10:21:09.316572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:50.856581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743973+0000","last_change":"2024-04-26T10:21:09.315331+0000","last_active":"2024-04-26T10:21:10.743973+0000","last_peered":"2024-04-26T10:21:10.743973+0000","last_clean":"2024-04-26T10:21:10.743973+0000","last_became_active":"2024-04-26T10:21:09.314523+0000","last_became_peered":"2024-04-26T10:21:09.314523+0000","last_unstale":"2024-04-26T10:21:10.743973+0000","last_undegraded":"2024-04-26T10:21:10.743973+0000","last_fullsized":"2024-04-26T10:21:10.743973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:24.624358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320722+0000","last_change":"2024-04-26T10:21:08.936791+0000","last_active":"2024-04-26T10:21:09.320722+0000","last_peered":"2024-04-26T10:21:09.320722+0000","last_clean":"2024-04-26T10:21:09.320722+0000","last_became_active":"2024-04-26T10:21:08.936469+0000","last_became_peered":"2024-04-26T10:21:08.936469+0000","last_unstale":"2024-04-26T10:21:09.320722+0000","last_undegraded":"2024-04-26T10:21:09.320722+0000","last_fullsized":"2024-04-26T10:21:09.320722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:14.145721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302806+0000","last_change":"2024-04-26T10:21:09.315299+0000","last_active":"2024-04-26T10:21:10.302806+0000","last_peered":"2024-04-26T10:21:10.302806+0000","last_clean":"2024-04-26T10:21:10.302806+0000","last_became_active":"2024-04-26T10:21:09.314896+0000","last_became_peered":"2024-04-26T10:21:09.314896+0000","last_unstale":"2024-04-26T10:21:10.302806+0000","last_undegraded":"2024-04-26T10:21:10.302806+0000","last_fullsized":"2024-04-26T10:21:10.302806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.174824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316992+0000","last_change":"2024-04-26T10:21:08.933424+0000","last_active":"2024-04-26T10:21:09.316992+0000","last_peered":"2024-04-26T10:21:09.316992+0000","last_clean":"2024-04-26T10:21:09.316992+0000","last_became_active":"2024-04-26T10:21:08.933088+0000","last_became_peered":"2024-04-26T10:21:08.933088+0000","last_unstale":"2024-04-26T10:21:09.316992+0000","last_undegraded":"2024-04-26T10:21:09.316992+0000","last_fullsized":"2024-04-26T10:21:09.316992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:55.394913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742760+0000","last_change":"2024-04-26T10:21:09.308831+0000","last_active":"2024-04-26T10:21:10.742760+0000","last_peered":"2024-04-26T10:21:10.742760+0000","last_clean":"2024-04-26T10:21:10.742760+0000","last_became_active":"2024-04-26T10:21:09.308457+0000","last_became_peered":"2024-04-26T10:21:09.308457+0000","last_unstale":"2024-04-26T10:21:10.742760+0000","last_undegraded":"2024-04-26T10:21:10.742760+0000","last_fullsized":"2024-04-26T10:21:10.742760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:43.137127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.314230+0000","last_change":"2024-04-26T10:21:08.937023+0000","last_active":"2024-04-26T10:21:09.314230+0000","last_peered":"2024-04-26T10:21:09.314230+0000","last_clean":"2024-04-26T10:21:09.314230+0000","last_became_active":"2024-04-26T10:21:08.936511+0000","last_became_peered":"2024-04-26T10:21:08.936511+0000","last_unstale":"2024-04-26T10:21:09.314230+0000","last_undegraded":"2024-04-26T10:21:09.314230+0000","last_fullsized":"2024-04-26T10:21:09.314230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:38.881531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":653928,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":0,"up_from":10,"seq":42949672965,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":270336,"data_stored":654544,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":188416,"data_stored":62430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:21:14.009 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T10:21:14.369 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:14.369 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":26,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":21,"num_osds":3,"num_up_osds":3,"osd_up_since":1714126858,"num_in_osds":3,"osd_in_since":1714126849,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592730,"bytes_used":96321536,"bytes_avail":289813970944,"bytes_total":289910292480,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4233}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-26T10:20:48.365185+0000","services":{}},"progress_events":{}} 2024-04-26T10:21:14.383 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-26T10:21:14.383 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:21:14.687 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:14.689 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:21:14.701 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-26T10:21:13.937507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94064,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021456,"statfs":{"total":289910292480,"available":289813970944,"internally_reserved":0,"allocated":720896,"data_stored":1370902,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001544"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303606+0000","last_change":"2024-04-26T10:21:09.316096+0000","last_active":"2024-04-26T10:21:10.303606+0000","last_peered":"2024-04-26T10:21:10.303606+0000","last_clean":"2024-04-26T10:21:10.303606+0000","last_became_active":"2024-04-26T10:21:09.315498+0000","last_became_peered":"2024-04-26T10:21:09.315498+0000","last_unstale":"2024-04-26T10:21:10.303606+0000","last_undegraded":"2024-04-26T10:21:10.303606+0000","last_fullsized":"2024-04-26T10:21:10.303606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:14.245434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304046+0000","last_change":"2024-04-26T10:21:09.317241+0000","last_active":"2024-04-26T10:21:10.304046+0000","last_peered":"2024-04-26T10:21:10.304046+0000","last_clean":"2024-04-26T10:21:10.304046+0000","last_became_active":"2024-04-26T10:21:09.316532+0000","last_became_peered":"2024-04-26T10:21:09.316532+0000","last_unstale":"2024-04-26T10:21:10.304046+0000","last_undegraded":"2024-04-26T10:21:10.304046+0000","last_fullsized":"2024-04-26T10:21:10.304046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:00.173638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743004+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:21:10.743004+0000","last_peered":"2024-04-26T10:21:10.743004+0000","last_clean":"2024-04-26T10:21:10.743004+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:21:10.743004+0000","last_undegraded":"2024-04-26T10:21:10.743004+0000","last_fullsized":"2024-04-26T10:21:10.743004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:01.883964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742576+0000","last_change":"2024-04-26T10:21:09.306531+0000","last_active":"2024-04-26T10:21:10.742576+0000","last_peered":"2024-04-26T10:21:10.742576+0000","last_clean":"2024-04-26T10:21:10.742576+0000","last_became_active":"2024-04-26T10:21:09.304885+0000","last_became_peered":"2024-04-26T10:21:09.304885+0000","last_unstale":"2024-04-26T10:21:10.742576+0000","last_undegraded":"2024-04-26T10:21:10.742576+0000","last_fullsized":"2024-04-26T10:21:10.742576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:04.179516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302949+0000","last_change":"2024-04-26T10:21:09.310914+0000","last_active":"2024-04-26T10:21:10.302949+0000","last_peered":"2024-04-26T10:21:10.302949+0000","last_clean":"2024-04-26T10:21:10.302949+0000","last_became_active":"2024-04-26T10:21:09.309981+0000","last_became_peered":"2024-04-26T10:21:09.309981+0000","last_unstale":"2024-04-26T10:21:10.302949+0000","last_undegraded":"2024-04-26T10:21:10.302949+0000","last_fullsized":"2024-04-26T10:21:10.302949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:04.926251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743427+0000","last_change":"2024-04-26T10:21:09.305198+0000","last_active":"2024-04-26T10:21:10.743427+0000","last_peered":"2024-04-26T10:21:10.743427+0000","last_clean":"2024-04-26T10:21:10.743427+0000","last_became_active":"2024-04-26T10:21:09.304716+0000","last_became_peered":"2024-04-26T10:21:09.304716+0000","last_unstale":"2024-04-26T10:21:10.743427+0000","last_undegraded":"2024-04-26T10:21:10.743427+0000","last_fullsized":"2024-04-26T10:21:10.743427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:11.224015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742177+0000","last_change":"2024-04-26T10:21:09.307188+0000","last_active":"2024-04-26T10:21:10.742177+0000","last_peered":"2024-04-26T10:21:10.742177+0000","last_clean":"2024-04-26T10:21:10.742177+0000","last_became_active":"2024-04-26T10:21:09.306548+0000","last_became_peered":"2024-04-26T10:21:09.306548+0000","last_unstale":"2024-04-26T10:21:10.742177+0000","last_undegraded":"2024-04-26T10:21:10.742177+0000","last_fullsized":"2024-04-26T10:21:10.742177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:29.565507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741718+0000","last_change":"2024-04-26T10:21:09.308284+0000","last_active":"2024-04-26T10:21:10.741718+0000","last_peered":"2024-04-26T10:21:10.741718+0000","last_clean":"2024-04-26T10:21:10.741718+0000","last_became_active":"2024-04-26T10:21:09.307504+0000","last_became_peered":"2024-04-26T10:21:09.307504+0000","last_unstale":"2024-04-26T10:21:10.741718+0000","last_undegraded":"2024-04-26T10:21:10.741718+0000","last_fullsized":"2024-04-26T10:21:10.741718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:51.549222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303844+0000","last_change":"2024-04-26T10:21:09.314160+0000","last_active":"2024-04-26T10:21:10.303844+0000","last_peered":"2024-04-26T10:21:10.303844+0000","last_clean":"2024-04-26T10:21:10.303844+0000","last_became_active":"2024-04-26T10:21:09.313221+0000","last_became_peered":"2024-04-26T10:21:09.313221+0000","last_unstale":"2024-04-26T10:21:10.303844+0000","last_undegraded":"2024-04-26T10:21:10.303844+0000","last_fullsized":"2024-04-26T10:21:10.303844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:50.157094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304095+0000","last_change":"2024-04-26T10:21:09.315304+0000","last_active":"2024-04-26T10:21:10.304095+0000","last_peered":"2024-04-26T10:21:10.304095+0000","last_clean":"2024-04-26T10:21:10.304095+0000","last_became_active":"2024-04-26T10:21:09.314619+0000","last_became_peered":"2024-04-26T10:21:09.314619+0000","last_unstale":"2024-04-26T10:21:10.304095+0000","last_undegraded":"2024-04-26T10:21:10.304095+0000","last_fullsized":"2024-04-26T10:21:10.304095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:41.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743482+0000","last_change":"2024-04-26T10:21:09.307173+0000","last_active":"2024-04-26T10:21:10.743482+0000","last_peered":"2024-04-26T10:21:10.743482+0000","last_clean":"2024-04-26T10:21:10.743482+0000","last_became_active":"2024-04-26T10:21:09.306523+0000","last_became_peered":"2024-04-26T10:21:09.306523+0000","last_unstale":"2024-04-26T10:21:10.743482+0000","last_undegraded":"2024-04-26T10:21:10.743482+0000","last_fullsized":"2024-04-26T10:21:10.743482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:15.102637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302828+0000","last_change":"2024-04-26T10:21:09.319057+0000","last_active":"2024-04-26T10:21:10.302828+0000","last_peered":"2024-04-26T10:21:10.302828+0000","last_clean":"2024-04-26T10:21:10.302828+0000","last_became_active":"2024-04-26T10:21:09.318580+0000","last_became_peered":"2024-04-26T10:21:09.318580+0000","last_unstale":"2024-04-26T10:21:10.302828+0000","last_undegraded":"2024-04-26T10:21:10.302828+0000","last_fullsized":"2024-04-26T10:21:10.302828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.335327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302635+0000","last_change":"2024-04-26T10:21:09.310332+0000","last_active":"2024-04-26T10:21:10.302635+0000","last_peered":"2024-04-26T10:21:10.302635+0000","last_clean":"2024-04-26T10:21:10.302635+0000","last_became_active":"2024-04-26T10:21:09.309534+0000","last_became_peered":"2024-04-26T10:21:09.309534+0000","last_unstale":"2024-04-26T10:21:10.302635+0000","last_undegraded":"2024-04-26T10:21:10.302635+0000","last_fullsized":"2024-04-26T10:21:10.302635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:01.594353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742954+0000","last_change":"2024-04-26T10:21:09.316821+0000","last_active":"2024-04-26T10:21:10.742954+0000","last_peered":"2024-04-26T10:21:10.742954+0000","last_clean":"2024-04-26T10:21:10.742954+0000","last_became_active":"2024-04-26T10:21:09.316143+0000","last_became_peered":"2024-04-26T10:21:09.316143+0000","last_unstale":"2024-04-26T10:21:10.742954+0000","last_undegraded":"2024-04-26T10:21:10.742954+0000","last_fullsized":"2024-04-26T10:21:10.742954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:20.271378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742238+0000","last_change":"2024-04-26T10:21:09.314710+0000","last_active":"2024-04-26T10:21:10.742238+0000","last_peered":"2024-04-26T10:21:10.742238+0000","last_clean":"2024-04-26T10:21:10.742238+0000","last_became_active":"2024-04-26T10:21:09.314401+0000","last_became_peered":"2024-04-26T10:21:09.314401+0000","last_unstale":"2024-04-26T10:21:10.742238+0000","last_undegraded":"2024-04-26T10:21:10.742238+0000","last_fullsized":"2024-04-26T10:21:10.742238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:14.245434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741766+0000","last_change":"2024-04-26T10:21:09.306575+0000","last_active":"2024-04-26T10:21:10.741766+0000","last_peered":"2024-04-26T10:21:10.741766+0000","last_clean":"2024-04-26T10:21:10.741766+0000","last_became_active":"2024-04-26T10:21:09.305009+0000","last_became_peered":"2024-04-26T10:21:09.305009+0000","last_unstale":"2024-04-26T10:21:10.741766+0000","last_undegraded":"2024-04-26T10:21:10.741766+0000","last_fullsized":"2024-04-26T10:21:10.741766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:42.965427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304549+0000","last_change":"2024-04-26T10:21:09.317530+0000","last_active":"2024-04-26T10:21:10.304549+0000","last_peered":"2024-04-26T10:21:10.304549+0000","last_clean":"2024-04-26T10:21:10.304549+0000","last_became_active":"2024-04-26T10:21:09.316956+0000","last_became_peered":"2024-04-26T10:21:09.316956+0000","last_unstale":"2024-04-26T10:21:10.304549+0000","last_undegraded":"2024-04-26T10:21:10.304549+0000","last_fullsized":"2024-04-26T10:21:10.304549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:05.112877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304348+0000","last_change":"2024-04-26T10:21:09.316152+0000","last_active":"2024-04-26T10:21:10.304348+0000","last_peered":"2024-04-26T10:21:10.304348+0000","last_clean":"2024-04-26T10:21:10.304348+0000","last_became_active":"2024-04-26T10:21:09.315441+0000","last_became_peered":"2024-04-26T10:21:09.315441+0000","last_unstale":"2024-04-26T10:21:10.304348+0000","last_undegraded":"2024-04-26T10:21:10.304348+0000","last_fullsized":"2024-04-26T10:21:10.304348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:42.904467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303452+0000","last_change":"2024-04-26T10:21:09.316805+0000","last_active":"2024-04-26T10:21:10.303452+0000","last_peered":"2024-04-26T10:21:10.303452+0000","last_clean":"2024-04-26T10:21:10.303452+0000","last_became_active":"2024-04-26T10:21:09.316490+0000","last_became_peered":"2024-04-26T10:21:09.316490+0000","last_unstale":"2024-04-26T10:21:10.303452+0000","last_undegraded":"2024-04-26T10:21:10.303452+0000","last_fullsized":"2024-04-26T10:21:10.303452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:11.814183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742675+0000","last_change":"2024-04-26T10:21:09.314189+0000","last_active":"2024-04-26T10:21:10.742675+0000","last_peered":"2024-04-26T10:21:10.742675+0000","last_clean":"2024-04-26T10:21:10.742675+0000","last_became_active":"2024-04-26T10:21:09.313648+0000","last_became_peered":"2024-04-26T10:21:09.313648+0000","last_unstale":"2024-04-26T10:21:10.742675+0000","last_undegraded":"2024-04-26T10:21:10.742675+0000","last_fullsized":"2024-04-26T10:21:10.742675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:57.658133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743475+0000","last_change":"2024-04-26T10:21:09.316594+0000","last_active":"2024-04-26T10:21:10.743475+0000","last_peered":"2024-04-26T10:21:10.743475+0000","last_clean":"2024-04-26T10:21:10.743475+0000","last_became_active":"2024-04-26T10:21:09.315877+0000","last_became_peered":"2024-04-26T10:21:09.315877+0000","last_unstale":"2024-04-26T10:21:10.743475+0000","last_undegraded":"2024-04-26T10:21:10.743475+0000","last_fullsized":"2024-04-26T10:21:10.743475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:19.943321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302427+0000","last_change":"2024-04-26T10:21:09.318829+0000","last_active":"2024-04-26T10:21:10.302427+0000","last_peered":"2024-04-26T10:21:10.302427+0000","last_clean":"2024-04-26T10:21:10.302427+0000","last_became_active":"2024-04-26T10:21:09.318379+0000","last_became_peered":"2024-04-26T10:21:09.318379+0000","last_unstale":"2024-04-26T10:21:10.302427+0000","last_undegraded":"2024-04-26T10:21:10.302427+0000","last_fullsized":"2024-04-26T10:21:10.302427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:11.224015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302100+0000","last_change":"2024-04-26T10:21:09.309068+0000","last_active":"2024-04-26T10:21:10.302100+0000","last_peered":"2024-04-26T10:21:10.302100+0000","last_clean":"2024-04-26T10:21:10.302100+0000","last_became_active":"2024-04-26T10:21:09.308797+0000","last_became_peered":"2024-04-26T10:21:09.308797+0000","last_unstale":"2024-04-26T10:21:10.302100+0000","last_undegraded":"2024-04-26T10:21:10.302100+0000","last_fullsized":"2024-04-26T10:21:10.302100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:44.761759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.301914+0000","last_change":"2024-04-26T10:21:09.311574+0000","last_active":"2024-04-26T10:21:10.301914+0000","last_peered":"2024-04-26T10:21:10.301914+0000","last_clean":"2024-04-26T10:21:10.301914+0000","last_became_active":"2024-04-26T10:21:09.309285+0000","last_became_peered":"2024-04-26T10:21:09.309285+0000","last_unstale":"2024-04-26T10:21:10.301914+0000","last_undegraded":"2024-04-26T10:21:10.301914+0000","last_fullsized":"2024-04-26T10:21:10.301914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:06.884098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303605+0000","last_change":"2024-04-26T10:21:09.317948+0000","last_active":"2024-04-26T10:21:10.303605+0000","last_peered":"2024-04-26T10:21:10.303605+0000","last_clean":"2024-04-26T10:21:10.303605+0000","last_became_active":"2024-04-26T10:21:09.317571+0000","last_became_peered":"2024-04-26T10:21:09.317571+0000","last_unstale":"2024-04-26T10:21:10.303605+0000","last_undegraded":"2024-04-26T10:21:10.303605+0000","last_fullsized":"2024-04-26T10:21:10.303605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:04.179516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304130+0000","last_change":"2024-04-26T10:21:09.312839+0000","last_active":"2024-04-26T10:21:10.304130+0000","last_peered":"2024-04-26T10:21:10.304130+0000","last_clean":"2024-04-26T10:21:10.304130+0000","last_became_active":"2024-04-26T10:21:09.311898+0000","last_became_peered":"2024-04-26T10:21:09.311898+0000","last_unstale":"2024-04-26T10:21:10.304130+0000","last_undegraded":"2024-04-26T10:21:10.304130+0000","last_fullsized":"2024-04-26T10:21:10.304130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:03.705171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743873+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:21:10.743873+0000","last_peered":"2024-04-26T10:21:10.743873+0000","last_clean":"2024-04-26T10:21:10.743873+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:21:10.743873+0000","last_undegraded":"2024-04-26T10:21:10.743873+0000","last_fullsized":"2024-04-26T10:21:10.743873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:39.394937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303372+0000","last_change":"2024-04-26T10:21:09.312446+0000","last_active":"2024-04-26T10:21:10.303372+0000","last_peered":"2024-04-26T10:21:10.303372+0000","last_clean":"2024-04-26T10:21:10.303372+0000","last_became_active":"2024-04-26T10:21:09.311919+0000","last_became_peered":"2024-04-26T10:21:09.311919+0000","last_unstale":"2024-04-26T10:21:10.303372+0000","last_undegraded":"2024-04-26T10:21:10.303372+0000","last_fullsized":"2024-04-26T10:21:10.303372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:57.658133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303274+0000","last_change":"2024-04-26T10:21:09.316871+0000","last_active":"2024-04-26T10:21:10.303274+0000","last_peered":"2024-04-26T10:21:10.303274+0000","last_clean":"2024-04-26T10:21:10.303274+0000","last_became_active":"2024-04-26T10:21:09.316529+0000","last_became_peered":"2024-04-26T10:21:09.316529+0000","last_unstale":"2024-04-26T10:21:10.303274+0000","last_undegraded":"2024-04-26T10:21:10.303274+0000","last_fullsized":"2024-04-26T10:21:10.303274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:52.614699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303836+0000","last_change":"2024-04-26T10:21:09.313160+0000","last_active":"2024-04-26T10:21:10.303836+0000","last_peered":"2024-04-26T10:21:10.303836+0000","last_clean":"2024-04-26T10:21:10.303836+0000","last_became_active":"2024-04-26T10:21:09.312556+0000","last_became_peered":"2024-04-26T10:21:09.312556+0000","last_unstale":"2024-04-26T10:21:10.303836+0000","last_undegraded":"2024-04-26T10:21:10.303836+0000","last_fullsized":"2024-04-26T10:21:10.303836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:21.698558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302244+0000","last_change":"2024-04-26T10:21:09.314165+0000","last_active":"2024-04-26T10:21:10.302244+0000","last_peered":"2024-04-26T10:21:10.302244+0000","last_clean":"2024-04-26T10:21:10.302244+0000","last_became_active":"2024-04-26T10:21:09.313559+0000","last_became_peered":"2024-04-26T10:21:09.313559+0000","last_unstale":"2024-04-26T10:21:10.302244+0000","last_undegraded":"2024-04-26T10:21:10.302244+0000","last_fullsized":"2024-04-26T10:21:10.302244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:05.857831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741968+0000","last_change":"2024-04-26T10:21:09.309366+0000","last_active":"2024-04-26T10:21:10.741968+0000","last_peered":"2024-04-26T10:21:10.741968+0000","last_clean":"2024-04-26T10:21:10.741968+0000","last_became_active":"2024-04-26T10:21:09.308660+0000","last_became_peered":"2024-04-26T10:21:09.308660+0000","last_unstale":"2024-04-26T10:21:10.741968+0000","last_undegraded":"2024-04-26T10:21:10.741968+0000","last_fullsized":"2024-04-26T10:21:10.741968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.335327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303113+0000","last_change":"2024-04-26T10:21:09.317455+0000","last_active":"2024-04-26T10:21:10.303113+0000","last_peered":"2024-04-26T10:21:10.303113+0000","last_clean":"2024-04-26T10:21:10.303113+0000","last_became_active":"2024-04-26T10:21:09.316994+0000","last_became_peered":"2024-04-26T10:21:09.316994+0000","last_unstale":"2024-04-26T10:21:10.303113+0000","last_undegraded":"2024-04-26T10:21:10.303113+0000","last_fullsized":"2024-04-26T10:21:10.303113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:48.942276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.317124+0000","last_change":"2024-04-26T10:21:08.939370+0000","last_active":"2024-04-26T10:21:09.317124+0000","last_peered":"2024-04-26T10:21:09.317124+0000","last_clean":"2024-04-26T10:21:09.317124+0000","last_became_active":"2024-04-26T10:21:08.937845+0000","last_became_peered":"2024-04-26T10:21:08.937845+0000","last_unstale":"2024-04-26T10:21:09.317124+0000","last_undegraded":"2024-04-26T10:21:09.317124+0000","last_fullsized":"2024-04-26T10:21:09.317124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:28.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304041+0000","last_change":"2024-04-26T10:21:09.316515+0000","last_active":"2024-04-26T10:21:10.304041+0000","last_peered":"2024-04-26T10:21:10.304041+0000","last_clean":"2024-04-26T10:21:10.304041+0000","last_became_active":"2024-04-26T10:21:09.315714+0000","last_became_peered":"2024-04-26T10:21:09.315714+0000","last_unstale":"2024-04-26T10:21:10.304041+0000","last_undegraded":"2024-04-26T10:21:10.304041+0000","last_fullsized":"2024-04-26T10:21:10.304041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.032760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296726+0000","last_change":"2024-04-26T10:21:08.937056+0000","last_active":"2024-04-26T10:21:09.296726+0000","last_peered":"2024-04-26T10:21:09.296726+0000","last_clean":"2024-04-26T10:21:09.296726+0000","last_became_active":"2024-04-26T10:21:08.936545+0000","last_became_peered":"2024-04-26T10:21:08.936545+0000","last_unstale":"2024-04-26T10:21:09.296726+0000","last_undegraded":"2024-04-26T10:21:09.296726+0000","last_fullsized":"2024-04-26T10:21:09.296726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:48.449203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304386+0000","last_change":"2024-04-26T10:21:09.313813+0000","last_active":"2024-04-26T10:21:10.304386+0000","last_peered":"2024-04-26T10:21:10.304386+0000","last_clean":"2024-04-26T10:21:10.304386+0000","last_became_active":"2024-04-26T10:21:09.312562+0000","last_became_peered":"2024-04-26T10:21:09.312562+0000","last_unstale":"2024-04-26T10:21:10.304386+0000","last_undegraded":"2024-04-26T10:21:10.304386+0000","last_fullsized":"2024-04-26T10:21:10.304386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:46.413942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309703+0000","last_change":"2024-04-26T10:21:08.936433+0000","last_active":"2024-04-26T10:21:09.309703+0000","last_peered":"2024-04-26T10:21:09.309703+0000","last_clean":"2024-04-26T10:21:09.309703+0000","last_became_active":"2024-04-26T10:21:08.935875+0000","last_became_peered":"2024-04-26T10:21:08.935875+0000","last_unstale":"2024-04-26T10:21:09.309703+0000","last_undegraded":"2024-04-26T10:21:09.309703+0000","last_fullsized":"2024-04-26T10:21:09.309703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:24.501204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303865+0000","last_change":"2024-04-26T10:21:09.314435+0000","last_active":"2024-04-26T10:21:10.303865+0000","last_peered":"2024-04-26T10:21:10.303865+0000","last_clean":"2024-04-26T10:21:10.303865+0000","last_became_active":"2024-04-26T10:21:09.313684+0000","last_became_peered":"2024-04-26T10:21:09.313684+0000","last_unstale":"2024-04-26T10:21:10.303865+0000","last_undegraded":"2024-04-26T10:21:10.303865+0000","last_fullsized":"2024-04-26T10:21:10.303865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:20.185980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.321258+0000","last_change":"2024-04-26T10:21:08.934971+0000","last_active":"2024-04-26T10:21:09.321258+0000","last_peered":"2024-04-26T10:21:09.321258+0000","last_clean":"2024-04-26T10:21:09.321258+0000","last_became_active":"2024-04-26T10:21:08.934653+0000","last_became_peered":"2024-04-26T10:21:08.934653+0000","last_unstale":"2024-04-26T10:21:09.321258+0000","last_undegraded":"2024-04-26T10:21:09.321258+0000","last_fullsized":"2024-04-26T10:21:09.321258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:18.272015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.315924+0000","last_change":"2024-04-26T10:21:08.934452+0000","last_active":"2024-04-26T10:21:09.315924+0000","last_peered":"2024-04-26T10:21:09.315924+0000","last_clean":"2024-04-26T10:21:09.315924+0000","last_became_active":"2024-04-26T10:21:08.934091+0000","last_became_peered":"2024-04-26T10:21:08.934091+0000","last_unstale":"2024-04-26T10:21:09.315924+0000","last_undegraded":"2024-04-26T10:21:09.315924+0000","last_fullsized":"2024-04-26T10:21:09.315924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:11.224989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.301898+0000","last_change":"2024-04-26T10:21:09.314631+0000","last_active":"2024-04-26T10:21:10.301898+0000","last_peered":"2024-04-26T10:21:10.301898+0000","last_clean":"2024-04-26T10:21:10.301898+0000","last_became_active":"2024-04-26T10:21:09.313044+0000","last_became_peered":"2024-04-26T10:21:09.313044+0000","last_unstale":"2024-04-26T10:21:10.301898+0000","last_undegraded":"2024-04-26T10:21:10.301898+0000","last_fullsized":"2024-04-26T10:21:10.301898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:19.943321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.319848+0000","last_change":"2024-04-26T10:21:08.935870+0000","last_active":"2024-04-26T10:21:09.319848+0000","last_peered":"2024-04-26T10:21:09.319848+0000","last_clean":"2024-04-26T10:21:09.319848+0000","last_became_active":"2024-04-26T10:21:08.935380+0000","last_became_peered":"2024-04-26T10:21:08.935380+0000","last_unstale":"2024-04-26T10:21:09.319848+0000","last_undegraded":"2024-04-26T10:21:09.319848+0000","last_fullsized":"2024-04-26T10:21:09.319848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:22.537149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302131+0000","last_change":"2024-04-26T10:21:09.317032+0000","last_active":"2024-04-26T10:21:10.302131+0000","last_peered":"2024-04-26T10:21:10.302131+0000","last_clean":"2024-04-26T10:21:10.302131+0000","last_became_active":"2024-04-26T10:21:09.316416+0000","last_became_peered":"2024-04-26T10:21:09.316416+0000","last_unstale":"2024-04-26T10:21:10.302131+0000","last_undegraded":"2024-04-26T10:21:10.302131+0000","last_fullsized":"2024-04-26T10:21:10.302131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:56.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320696+0000","last_change":"2024-04-26T10:21:08.935133+0000","last_active":"2024-04-26T10:21:09.320696+0000","last_peered":"2024-04-26T10:21:09.320696+0000","last_clean":"2024-04-26T10:21:09.320696+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:21:09.320696+0000","last_undegraded":"2024-04-26T10:21:09.320696+0000","last_fullsized":"2024-04-26T10:21:09.320696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:25.498249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743681+0000","last_change":"2024-04-26T10:21:09.315201+0000","last_active":"2024-04-26T10:21:10.743681+0000","last_peered":"2024-04-26T10:21:10.743681+0000","last_clean":"2024-04-26T10:21:10.743681+0000","last_became_active":"2024-04-26T10:21:09.314390+0000","last_became_peered":"2024-04-26T10:21:09.314390+0000","last_unstale":"2024-04-26T10:21:10.743681+0000","last_undegraded":"2024-04-26T10:21:10.743681+0000","last_fullsized":"2024-04-26T10:21:10.743681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.998466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.299090+0000","last_change":"2024-04-26T10:21:08.939382+0000","last_active":"2024-04-26T10:21:09.299090+0000","last_peered":"2024-04-26T10:21:09.299090+0000","last_clean":"2024-04-26T10:21:09.299090+0000","last_became_active":"2024-04-26T10:21:08.938193+0000","last_became_peered":"2024-04-26T10:21:08.938193+0000","last_unstale":"2024-04-26T10:21:09.299090+0000","last_undegraded":"2024-04-26T10:21:09.299090+0000","last_fullsized":"2024-04-26T10:21:09.299090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:01.182611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303014+0000","last_change":"2024-04-26T10:21:09.313678+0000","last_active":"2024-04-26T10:21:10.303014+0000","last_peered":"2024-04-26T10:21:10.303014+0000","last_clean":"2024-04-26T10:21:10.303014+0000","last_became_active":"2024-04-26T10:21:09.312906+0000","last_became_peered":"2024-04-26T10:21:09.312906+0000","last_unstale":"2024-04-26T10:21:10.303014+0000","last_undegraded":"2024-04-26T10:21:10.303014+0000","last_fullsized":"2024-04-26T10:21:10.303014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:14.241108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.313678+0000","last_change":"2024-04-26T10:21:08.936904+0000","last_active":"2024-04-26T10:21:09.313678+0000","last_peered":"2024-04-26T10:21:09.313678+0000","last_clean":"2024-04-26T10:21:09.313678+0000","last_became_active":"2024-04-26T10:21:08.936376+0000","last_became_peered":"2024-04-26T10:21:08.936376+0000","last_unstale":"2024-04-26T10:21:09.313678+0000","last_undegraded":"2024-04-26T10:21:09.313678+0000","last_fullsized":"2024-04-26T10:21:09.313678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:19.270525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742850+0000","last_change":"2024-04-26T10:21:09.307911+0000","last_active":"2024-04-26T10:21:10.742850+0000","last_peered":"2024-04-26T10:21:10.742850+0000","last_clean":"2024-04-26T10:21:10.742850+0000","last_became_active":"2024-04-26T10:21:09.307597+0000","last_became_peered":"2024-04-26T10:21:09.307597+0000","last_unstale":"2024-04-26T10:21:10.742850+0000","last_undegraded":"2024-04-26T10:21:10.742850+0000","last_fullsized":"2024-04-26T10:21:10.742850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:21.698558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.300582+0000","last_change":"2024-04-26T10:21:08.939072+0000","last_active":"2024-04-26T10:21:09.300582+0000","last_peered":"2024-04-26T10:21:09.300582+0000","last_clean":"2024-04-26T10:21:09.300582+0000","last_became_active":"2024-04-26T10:21:08.938445+0000","last_became_peered":"2024-04-26T10:21:08.938445+0000","last_unstale":"2024-04-26T10:21:09.300582+0000","last_undegraded":"2024-04-26T10:21:09.300582+0000","last_fullsized":"2024-04-26T10:21:09.300582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:06.598189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743938+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:21:10.743938+0000","last_peered":"2024-04-26T10:21:10.743938+0000","last_clean":"2024-04-26T10:21:10.743938+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:21:10.743938+0000","last_undegraded":"2024-04-26T10:21:10.743938+0000","last_fullsized":"2024-04-26T10:21:10.743938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309935+0000","last_change":"2024-04-26T10:21:08.936533+0000","last_active":"2024-04-26T10:21:09.309935+0000","last_peered":"2024-04-26T10:21:09.309935+0000","last_clean":"2024-04-26T10:21:09.309935+0000","last_became_active":"2024-04-26T10:21:08.936222+0000","last_became_peered":"2024-04-26T10:21:08.936222+0000","last_unstale":"2024-04-26T10:21:09.309935+0000","last_undegraded":"2024-04-26T10:21:09.309935+0000","last_fullsized":"2024-04-26T10:21:09.309935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:18:07.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742771+0000","last_change":"2024-04-26T10:21:09.316361+0000","last_active":"2024-04-26T10:21:10.742771+0000","last_peered":"2024-04-26T10:21:10.742771+0000","last_clean":"2024-04-26T10:21:10.742771+0000","last_became_active":"2024-04-26T10:21:09.315981+0000","last_became_peered":"2024-04-26T10:21:09.315981+0000","last_unstale":"2024-04-26T10:21:10.742771+0000","last_undegraded":"2024-04-26T10:21:10.742771+0000","last_fullsized":"2024-04-26T10:21:10.742771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:00.173638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309815+0000","last_change":"2024-04-26T10:21:08.928590+0000","last_active":"2024-04-26T10:21:09.309815+0000","last_peered":"2024-04-26T10:21:09.309815+0000","last_clean":"2024-04-26T10:21:09.309815+0000","last_became_active":"2024-04-26T10:21:08.928354+0000","last_became_peered":"2024-04-26T10:21:08.928354+0000","last_unstale":"2024-04-26T10:21:09.309815+0000","last_undegraded":"2024-04-26T10:21:09.309815+0000","last_fullsized":"2024-04-26T10:21:09.309815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:52.241716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304119+0000","last_change":"2024-04-26T10:21:09.317282+0000","last_active":"2024-04-26T10:21:10.304119+0000","last_peered":"2024-04-26T10:21:10.304119+0000","last_clean":"2024-04-26T10:21:10.304119+0000","last_became_active":"2024-04-26T10:21:09.316591+0000","last_became_peered":"2024-04-26T10:21:09.316591+0000","last_unstale":"2024-04-26T10:21:10.304119+0000","last_undegraded":"2024-04-26T10:21:10.304119+0000","last_fullsized":"2024-04-26T10:21:10.304119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:28.447361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":213,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297609+0000","last_change":"2024-04-26T10:21:01.829140+0000","last_active":"2024-04-26T10:21:09.297609+0000","last_peered":"2024-04-26T10:21:09.297609+0000","last_clean":"2024-04-26T10:21:09.297609+0000","last_became_active":"2024-04-26T10:21:01.827182+0000","last_became_peered":"2024-04-26T10:21:01.827182+0000","last_unstale":"2024-04-26T10:21:09.297609+0000","last_undegraded":"2024-04-26T10:21:09.297609+0000","last_fullsized":"2024-04-26T10:21:09.297609+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:00:51.477222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298874+0000","last_change":"2024-04-26T10:21:04.893745+0000","last_active":"2024-04-26T10:21:09.298874+0000","last_peered":"2024-04-26T10:21:09.298874+0000","last_clean":"2024-04-26T10:21:09.298874+0000","last_became_active":"2024-04-26T10:21:04.893031+0000","last_became_peered":"2024-04-26T10:21:04.893031+0000","last_unstale":"2024-04-26T10:21:09.298874+0000","last_undegraded":"2024-04-26T10:21:09.298874+0000","last_fullsized":"2024-04-26T10:21:09.298874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:59.771061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297001+0000","last_change":"2024-04-26T10:21:08.933706+0000","last_active":"2024-04-26T10:21:09.297001+0000","last_peered":"2024-04-26T10:21:09.297001+0000","last_clean":"2024-04-26T10:21:09.297001+0000","last_became_active":"2024-04-26T10:21:08.933372+0000","last_became_peered":"2024-04-26T10:21:08.933372+0000","last_unstale":"2024-04-26T10:21:09.297001+0000","last_undegraded":"2024-04-26T10:21:09.297001+0000","last_fullsized":"2024-04-26T10:21:09.297001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:14.290484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.744176+0000","last_change":"2024-04-26T10:21:09.320889+0000","last_active":"2024-04-26T10:21:10.744176+0000","last_peered":"2024-04-26T10:21:10.744176+0000","last_clean":"2024-04-26T10:21:10.744176+0000","last_became_active":"2024-04-26T10:21:09.320355+0000","last_became_peered":"2024-04-26T10:21:09.320355+0000","last_unstale":"2024-04-26T10:21:10.744176+0000","last_undegraded":"2024-04-26T10:21:10.744176+0000","last_fullsized":"2024-04-26T10:21:10.744176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:41.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297382+0000","last_change":"2024-04-26T10:21:04.892156+0000","last_active":"2024-04-26T10:21:09.297382+0000","last_peered":"2024-04-26T10:21:09.297382+0000","last_clean":"2024-04-26T10:21:09.297382+0000","last_became_active":"2024-04-26T10:21:04.891660+0000","last_became_peered":"2024-04-26T10:21:04.891660+0000","last_unstale":"2024-04-26T10:21:09.297382+0000","last_undegraded":"2024-04-26T10:21:09.297382+0000","last_fullsized":"2024-04-26T10:21:09.297382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:50.568468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296858+0000","last_change":"2024-04-26T10:21:08.936815+0000","last_active":"2024-04-26T10:21:09.296858+0000","last_peered":"2024-04-26T10:21:09.296858+0000","last_clean":"2024-04-26T10:21:09.296858+0000","last_became_active":"2024-04-26T10:21:08.936180+0000","last_became_peered":"2024-04-26T10:21:08.936180+0000","last_unstale":"2024-04-26T10:21:09.296858+0000","last_undegraded":"2024-04-26T10:21:09.296858+0000","last_fullsized":"2024-04-26T10:21:09.296858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:41.614282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304366+0000","last_change":"2024-04-26T10:21:09.310050+0000","last_active":"2024-04-26T10:21:10.304366+0000","last_peered":"2024-04-26T10:21:10.304366+0000","last_clean":"2024-04-26T10:21:10.304366+0000","last_became_active":"2024-04-26T10:21:09.309470+0000","last_became_peered":"2024-04-26T10:21:09.309470+0000","last_unstale":"2024-04-26T10:21:10.304366+0000","last_undegraded":"2024-04-26T10:21:10.304366+0000","last_fullsized":"2024-04-26T10:21:10.304366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:32.334144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296330+0000","last_change":"2024-04-26T10:21:04.890860+0000","last_active":"2024-04-26T10:21:09.296330+0000","last_peered":"2024-04-26T10:21:09.296330+0000","last_clean":"2024-04-26T10:21:09.296330+0000","last_became_active":"2024-04-26T10:21:04.890336+0000","last_became_peered":"2024-04-26T10:21:04.890336+0000","last_unstale":"2024-04-26T10:21:09.296330+0000","last_undegraded":"2024-04-26T10:21:09.296330+0000","last_fullsized":"2024-04-26T10:21:09.296330+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:13.262120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.310359+0000","last_change":"2024-04-26T10:21:08.936077+0000","last_active":"2024-04-26T10:21:09.310359+0000","last_peered":"2024-04-26T10:21:09.310359+0000","last_clean":"2024-04-26T10:21:09.310359+0000","last_became_active":"2024-04-26T10:21:08.935621+0000","last_became_peered":"2024-04-26T10:21:08.935621+0000","last_unstale":"2024-04-26T10:21:09.310359+0000","last_undegraded":"2024-04-26T10:21:09.310359+0000","last_fullsized":"2024-04-26T10:21:09.310359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:11.906094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304130+0000","last_change":"2024-04-26T10:21:09.314796+0000","last_active":"2024-04-26T10:21:10.304130+0000","last_peered":"2024-04-26T10:21:10.304130+0000","last_clean":"2024-04-26T10:21:10.304130+0000","last_became_active":"2024-04-26T10:21:09.314574+0000","last_became_peered":"2024-04-26T10:21:09.314574+0000","last_unstale":"2024-04-26T10:21:10.304130+0000","last_undegraded":"2024-04-26T10:21:10.304130+0000","last_fullsized":"2024-04-26T10:21:10.304130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:32.136621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301803+0000","last_change":"2024-04-26T10:21:04.893253+0000","last_active":"2024-04-26T10:21:09.301803+0000","last_peered":"2024-04-26T10:21:09.301803+0000","last_clean":"2024-04-26T10:21:09.301803+0000","last_became_active":"2024-04-26T10:21:04.892843+0000","last_became_peered":"2024-04-26T10:21:04.892843+0000","last_unstale":"2024-04-26T10:21:09.301803+0000","last_undegraded":"2024-04-26T10:21:09.301803+0000","last_fullsized":"2024-04-26T10:21:09.301803+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:00.749791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298626+0000","last_change":"2024-04-26T10:21:08.937153+0000","last_active":"2024-04-26T10:21:09.298626+0000","last_peered":"2024-04-26T10:21:09.298626+0000","last_clean":"2024-04-26T10:21:09.298626+0000","last_became_active":"2024-04-26T10:21:08.936561+0000","last_became_peered":"2024-04-26T10:21:08.936561+0000","last_unstale":"2024-04-26T10:21:09.298626+0000","last_undegraded":"2024-04-26T10:21:09.298626+0000","last_fullsized":"2024-04-26T10:21:09.298626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:28.491800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303941+0000","last_change":"2024-04-26T10:21:09.314218+0000","last_active":"2024-04-26T10:21:10.303941+0000","last_peered":"2024-04-26T10:21:10.303941+0000","last_clean":"2024-04-26T10:21:10.303941+0000","last_became_active":"2024-04-26T10:21:09.313641+0000","last_became_peered":"2024-04-26T10:21:09.313641+0000","last_unstale":"2024-04-26T10:21:10.303941+0000","last_undegraded":"2024-04-26T10:21:10.303941+0000","last_fullsized":"2024-04-26T10:21:10.303941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:08.449512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.300397+0000","last_change":"2024-04-26T10:21:08.937196+0000","last_active":"2024-04-26T10:21:09.300397+0000","last_peered":"2024-04-26T10:21:09.300397+0000","last_clean":"2024-04-26T10:21:09.300397+0000","last_became_active":"2024-04-26T10:21:08.936779+0000","last_became_peered":"2024-04-26T10:21:08.936779+0000","last_unstale":"2024-04-26T10:21:09.300397+0000","last_undegraded":"2024-04-26T10:21:09.300397+0000","last_fullsized":"2024-04-26T10:21:09.300397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:20.545169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295561+0000","last_change":"2024-04-26T10:21:04.890548+0000","last_active":"2024-04-26T10:21:09.295561+0000","last_peered":"2024-04-26T10:21:09.295561+0000","last_clean":"2024-04-26T10:21:09.295561+0000","last_became_active":"2024-04-26T10:21:04.890034+0000","last_became_peered":"2024-04-26T10:21:04.890034+0000","last_unstale":"2024-04-26T10:21:09.295561+0000","last_undegraded":"2024-04-26T10:21:09.295561+0000","last_fullsized":"2024-04-26T10:21:09.295561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:55.033455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302442+0000","last_change":"2024-04-26T10:21:09.318348+0000","last_active":"2024-04-26T10:21:10.302442+0000","last_peered":"2024-04-26T10:21:10.302442+0000","last_clean":"2024-04-26T10:21:10.302442+0000","last_became_active":"2024-04-26T10:21:09.317886+0000","last_became_peered":"2024-04-26T10:21:09.317886+0000","last_unstale":"2024-04-26T10:21:10.302442+0000","last_undegraded":"2024-04-26T10:21:10.302442+0000","last_fullsized":"2024-04-26T10:21:10.302442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:24.624358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295394+0000","last_change":"2024-04-26T10:21:08.933714+0000","last_active":"2024-04-26T10:21:09.295394+0000","last_peered":"2024-04-26T10:21:09.295394+0000","last_clean":"2024-04-26T10:21:09.295394+0000","last_became_active":"2024-04-26T10:21:08.933259+0000","last_became_peered":"2024-04-26T10:21:08.933259+0000","last_unstale":"2024-04-26T10:21:09.295394+0000","last_undegraded":"2024-04-26T10:21:09.295394+0000","last_fullsized":"2024-04-26T10:21:09.295394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:50.230096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.311683+0000","last_change":"2024-04-26T10:21:04.891490+0000","last_active":"2024-04-26T10:21:09.311683+0000","last_peered":"2024-04-26T10:21:09.311683+0000","last_clean":"2024-04-26T10:21:09.311683+0000","last_became_active":"2024-04-26T10:21:04.890777+0000","last_became_peered":"2024-04-26T10:21:04.890777+0000","last_unstale":"2024-04-26T10:21:09.311683+0000","last_undegraded":"2024-04-26T10:21:09.311683+0000","last_fullsized":"2024-04-26T10:21:09.311683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:25.896672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302680+0000","last_change":"2024-04-26T10:21:09.314213+0000","last_active":"2024-04-26T10:21:10.302680+0000","last_peered":"2024-04-26T10:21:10.302680+0000","last_clean":"2024-04-26T10:21:10.302680+0000","last_became_active":"2024-04-26T10:21:09.312975+0000","last_became_peered":"2024-04-26T10:21:09.312975+0000","last_unstale":"2024-04-26T10:21:10.302680+0000","last_undegraded":"2024-04-26T10:21:10.302680+0000","last_fullsized":"2024-04-26T10:21:10.302680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:43.137127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.317699+0000","last_change":"2024-04-26T10:21:08.934216+0000","last_active":"2024-04-26T10:21:09.317699+0000","last_peered":"2024-04-26T10:21:09.317699+0000","last_clean":"2024-04-26T10:21:09.317699+0000","last_became_active":"2024-04-26T10:21:08.933524+0000","last_became_peered":"2024-04-26T10:21:08.933524+0000","last_unstale":"2024-04-26T10:21:09.317699+0000","last_undegraded":"2024-04-26T10:21:09.317699+0000","last_fullsized":"2024-04-26T10:21:09.317699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:57.798830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297318+0000","last_change":"2024-04-26T10:21:04.890490+0000","last_active":"2024-04-26T10:21:09.297318+0000","last_peered":"2024-04-26T10:21:09.297318+0000","last_clean":"2024-04-26T10:21:09.297318+0000","last_became_active":"2024-04-26T10:21:04.889808+0000","last_became_peered":"2024-04-26T10:21:04.889808+0000","last_unstale":"2024-04-26T10:21:09.297318+0000","last_undegraded":"2024-04-26T10:21:09.297318+0000","last_fullsized":"2024-04-26T10:21:09.297318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:55.711555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302374+0000","last_change":"2024-04-26T10:21:09.312260+0000","last_active":"2024-04-26T10:21:10.302374+0000","last_peered":"2024-04-26T10:21:10.302374+0000","last_clean":"2024-04-26T10:21:10.302374+0000","last_became_active":"2024-04-26T10:21:09.311309+0000","last_became_peered":"2024-04-26T10:21:09.311309+0000","last_unstale":"2024-04-26T10:21:10.302374+0000","last_undegraded":"2024-04-26T10:21:10.302374+0000","last_fullsized":"2024-04-26T10:21:10.302374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:30.714581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297093+0000","last_change":"2024-04-26T10:21:08.936623+0000","last_active":"2024-04-26T10:21:09.297093+0000","last_peered":"2024-04-26T10:21:09.297093+0000","last_clean":"2024-04-26T10:21:09.297093+0000","last_became_active":"2024-04-26T10:21:08.936252+0000","last_became_peered":"2024-04-26T10:21:08.936252+0000","last_unstale":"2024-04-26T10:21:09.297093+0000","last_undegraded":"2024-04-26T10:21:09.297093+0000","last_fullsized":"2024-04-26T10:21:09.297093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:24.526250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296848+0000","last_change":"2024-04-26T10:21:04.892401+0000","last_active":"2024-04-26T10:21:09.296848+0000","last_peered":"2024-04-26T10:21:09.296848+0000","last_clean":"2024-04-26T10:21:09.296848+0000","last_became_active":"2024-04-26T10:21:04.891692+0000","last_became_peered":"2024-04-26T10:21:04.891692+0000","last_unstale":"2024-04-26T10:21:09.296848+0000","last_undegraded":"2024-04-26T10:21:09.296848+0000","last_fullsized":"2024-04-26T10:21:09.296848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:37.548728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302178+0000","last_change":"2024-04-26T10:21:09.317981+0000","last_active":"2024-04-26T10:21:10.302178+0000","last_peered":"2024-04-26T10:21:10.302178+0000","last_clean":"2024-04-26T10:21:10.302178+0000","last_became_active":"2024-04-26T10:21:09.317601+0000","last_became_peered":"2024-04-26T10:21:09.317601+0000","last_unstale":"2024-04-26T10:21:10.302178+0000","last_undegraded":"2024-04-26T10:21:10.302178+0000","last_fullsized":"2024-04-26T10:21:10.302178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742909+0000","last_change":"2024-04-26T10:21:09.317120+0000","last_active":"2024-04-26T10:21:10.742909+0000","last_peered":"2024-04-26T10:21:10.742909+0000","last_clean":"2024-04-26T10:21:10.742909+0000","last_became_active":"2024-04-26T10:21:09.316741+0000","last_became_peered":"2024-04-26T10:21:09.316741+0000","last_unstale":"2024-04-26T10:21:10.742909+0000","last_undegraded":"2024-04-26T10:21:10.742909+0000","last_fullsized":"2024-04-26T10:21:10.742909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:43.702714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.326574+0000","last_change":"2024-04-26T10:21:08.934481+0000","last_active":"2024-04-26T10:21:09.326574+0000","last_peered":"2024-04-26T10:21:09.326574+0000","last_clean":"2024-04-26T10:21:09.326574+0000","last_became_active":"2024-04-26T10:21:08.934076+0000","last_became_peered":"2024-04-26T10:21:08.934076+0000","last_unstale":"2024-04-26T10:21:09.326574+0000","last_undegraded":"2024-04-26T10:21:09.326574+0000","last_fullsized":"2024-04-26T10:21:09.326574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:50.622715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302791+0000","last_change":"2024-04-26T10:21:09.314009+0000","last_active":"2024-04-26T10:21:10.302791+0000","last_peered":"2024-04-26T10:21:10.302791+0000","last_clean":"2024-04-26T10:21:10.302791+0000","last_became_active":"2024-04-26T10:21:09.313556+0000","last_became_peered":"2024-04-26T10:21:09.313556+0000","last_unstale":"2024-04-26T10:21:10.302791+0000","last_undegraded":"2024-04-26T10:21:10.302791+0000","last_fullsized":"2024-04-26T10:21:10.302791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:34.862466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320711+0000","last_change":"2024-04-26T10:21:08.936526+0000","last_active":"2024-04-26T10:21:09.320711+0000","last_peered":"2024-04-26T10:21:09.320711+0000","last_clean":"2024-04-26T10:21:09.320711+0000","last_became_active":"2024-04-26T10:21:08.936217+0000","last_became_peered":"2024-04-26T10:21:08.936217+0000","last_unstale":"2024-04-26T10:21:09.320711+0000","last_undegraded":"2024-04-26T10:21:09.320711+0000","last_fullsized":"2024-04-26T10:21:09.320711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:57.649639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301807+0000","last_change":"2024-04-26T10:21:08.937597+0000","last_active":"2024-04-26T10:21:09.301807+0000","last_peered":"2024-04-26T10:21:09.301807+0000","last_clean":"2024-04-26T10:21:09.301807+0000","last_became_active":"2024-04-26T10:21:08.936809+0000","last_became_peered":"2024-04-26T10:21:08.936809+0000","last_unstale":"2024-04-26T10:21:09.301807+0000","last_undegraded":"2024-04-26T10:21:09.301807+0000","last_fullsized":"2024-04-26T10:21:09.301807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:17.212235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302338+0000","last_change":"2024-04-26T10:21:09.312054+0000","last_active":"2024-04-26T10:21:10.302338+0000","last_peered":"2024-04-26T10:21:10.302338+0000","last_clean":"2024-04-26T10:21:10.302338+0000","last_became_active":"2024-04-26T10:21:09.310818+0000","last_became_peered":"2024-04-26T10:21:09.310818+0000","last_unstale":"2024-04-26T10:21:10.302338+0000","last_undegraded":"2024-04-26T10:21:10.302338+0000","last_fullsized":"2024-04-26T10:21:10.302338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:03.431355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301359+0000","last_change":"2024-04-26T10:21:08.937445+0000","last_active":"2024-04-26T10:21:09.301359+0000","last_peered":"2024-04-26T10:21:09.301359+0000","last_clean":"2024-04-26T10:21:09.301359+0000","last_became_active":"2024-04-26T10:21:08.937147+0000","last_became_peered":"2024-04-26T10:21:08.937147+0000","last_unstale":"2024-04-26T10:21:09.301359+0000","last_undegraded":"2024-04-26T10:21:09.301359+0000","last_fullsized":"2024-04-26T10:21:09.301359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:29.602825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302232+0000","last_change":"2024-04-26T10:21:09.318091+0000","last_active":"2024-04-26T10:21:10.302232+0000","last_peered":"2024-04-26T10:21:10.302232+0000","last_clean":"2024-04-26T10:21:10.302232+0000","last_became_active":"2024-04-26T10:21:09.317871+0000","last_became_peered":"2024-04-26T10:21:09.317871+0000","last_unstale":"2024-04-26T10:21:10.302232+0000","last_undegraded":"2024-04-26T10:21:10.302232+0000","last_fullsized":"2024-04-26T10:21:10.302232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:32.442915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303867+0000","last_change":"2024-04-26T10:21:09.312636+0000","last_active":"2024-04-26T10:21:10.303867+0000","last_peered":"2024-04-26T10:21:10.303867+0000","last_clean":"2024-04-26T10:21:10.303867+0000","last_became_active":"2024-04-26T10:21:09.312130+0000","last_became_peered":"2024-04-26T10:21:09.312130+0000","last_unstale":"2024-04-26T10:21:10.303867+0000","last_undegraded":"2024-04-26T10:21:10.303867+0000","last_fullsized":"2024-04-26T10:21:10.303867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:29.565507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298243+0000","last_change":"2024-04-26T10:21:08.934046+0000","last_active":"2024-04-26T10:21:09.298243+0000","last_peered":"2024-04-26T10:21:09.298243+0000","last_clean":"2024-04-26T10:21:09.298243+0000","last_became_active":"2024-04-26T10:21:08.933341+0000","last_became_peered":"2024-04-26T10:21:08.933341+0000","last_unstale":"2024-04-26T10:21:09.298243+0000","last_undegraded":"2024-04-26T10:21:09.298243+0000","last_fullsized":"2024-04-26T10:21:09.298243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:45.671865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303860+0000","last_change":"2024-04-26T10:21:09.312081+0000","last_active":"2024-04-26T10:21:10.303860+0000","last_peered":"2024-04-26T10:21:10.303860+0000","last_clean":"2024-04-26T10:21:10.303860+0000","last_became_active":"2024-04-26T10:21:09.310879+0000","last_became_peered":"2024-04-26T10:21:09.310879+0000","last_unstale":"2024-04-26T10:21:10.303860+0000","last_undegraded":"2024-04-26T10:21:10.303860+0000","last_fullsized":"2024-04-26T10:21:10.303860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:36.358962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295619+0000","last_change":"2024-04-26T10:21:08.936748+0000","last_active":"2024-04-26T10:21:09.295619+0000","last_peered":"2024-04-26T10:21:09.295619+0000","last_clean":"2024-04-26T10:21:09.295619+0000","last_became_active":"2024-04-26T10:21:08.936316+0000","last_became_peered":"2024-04-26T10:21:08.936316+0000","last_unstale":"2024-04-26T10:21:09.295619+0000","last_undegraded":"2024-04-26T10:21:09.295619+0000","last_fullsized":"2024-04-26T10:21:09.295619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:47.721288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303753+0000","last_change":"2024-04-26T10:21:09.320062+0000","last_active":"2024-04-26T10:21:10.303753+0000","last_peered":"2024-04-26T10:21:10.303753+0000","last_clean":"2024-04-26T10:21:10.303753+0000","last_became_active":"2024-04-26T10:21:09.319352+0000","last_became_peered":"2024-04-26T10:21:09.319352+0000","last_unstale":"2024-04-26T10:21:10.303753+0000","last_undegraded":"2024-04-26T10:21:10.303753+0000","last_fullsized":"2024-04-26T10:21:10.303753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.998466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316248+0000","last_change":"2024-04-26T10:21:08.931356+0000","last_active":"2024-04-26T10:21:09.316248+0000","last_peered":"2024-04-26T10:21:09.316248+0000","last_clean":"2024-04-26T10:21:09.316248+0000","last_became_active":"2024-04-26T10:21:08.930016+0000","last_became_peered":"2024-04-26T10:21:08.930016+0000","last_unstale":"2024-04-26T10:21:09.316248+0000","last_undegraded":"2024-04-26T10:21:09.316248+0000","last_fullsized":"2024-04-26T10:21:09.316248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:21.306576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303057+0000","last_change":"2024-04-26T10:21:09.318178+0000","last_active":"2024-04-26T10:21:10.303057+0000","last_peered":"2024-04-26T10:21:10.303057+0000","last_clean":"2024-04-26T10:21:10.303057+0000","last_became_active":"2024-04-26T10:21:09.317697+0000","last_became_peered":"2024-04-26T10:21:09.317697+0000","last_unstale":"2024-04-26T10:21:10.303057+0000","last_undegraded":"2024-04-26T10:21:10.303057+0000","last_fullsized":"2024-04-26T10:21:10.303057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:46.285390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320054+0000","last_change":"2024-04-26T10:21:08.936115+0000","last_active":"2024-04-26T10:21:09.320054+0000","last_peered":"2024-04-26T10:21:09.320054+0000","last_clean":"2024-04-26T10:21:09.320054+0000","last_became_active":"2024-04-26T10:21:08.935740+0000","last_became_peered":"2024-04-26T10:21:08.935740+0000","last_unstale":"2024-04-26T10:21:09.320054+0000","last_undegraded":"2024-04-26T10:21:09.320054+0000","last_fullsized":"2024-04-26T10:21:09.320054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:08.369059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742450+0000","last_change":"2024-04-26T10:21:09.308077+0000","last_active":"2024-04-26T10:21:10.742450+0000","last_peered":"2024-04-26T10:21:10.742450+0000","last_clean":"2024-04-26T10:21:10.742450+0000","last_became_active":"2024-04-26T10:21:09.307543+0000","last_became_peered":"2024-04-26T10:21:09.307543+0000","last_unstale":"2024-04-26T10:21:10.742450+0000","last_undegraded":"2024-04-26T10:21:10.742450+0000","last_fullsized":"2024-04-26T10:21:10.742450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:46.596591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316572+0000","last_change":"2024-04-26T10:21:08.938933+0000","last_active":"2024-04-26T10:21:09.316572+0000","last_peered":"2024-04-26T10:21:09.316572+0000","last_clean":"2024-04-26T10:21:09.316572+0000","last_became_active":"2024-04-26T10:21:08.938281+0000","last_became_peered":"2024-04-26T10:21:08.938281+0000","last_unstale":"2024-04-26T10:21:09.316572+0000","last_undegraded":"2024-04-26T10:21:09.316572+0000","last_fullsized":"2024-04-26T10:21:09.316572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:50.856581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743973+0000","last_change":"2024-04-26T10:21:09.315331+0000","last_active":"2024-04-26T10:21:10.743973+0000","last_peered":"2024-04-26T10:21:10.743973+0000","last_clean":"2024-04-26T10:21:10.743973+0000","last_became_active":"2024-04-26T10:21:09.314523+0000","last_became_peered":"2024-04-26T10:21:09.314523+0000","last_unstale":"2024-04-26T10:21:10.743973+0000","last_undegraded":"2024-04-26T10:21:10.743973+0000","last_fullsized":"2024-04-26T10:21:10.743973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:24.624358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320722+0000","last_change":"2024-04-26T10:21:08.936791+0000","last_active":"2024-04-26T10:21:09.320722+0000","last_peered":"2024-04-26T10:21:09.320722+0000","last_clean":"2024-04-26T10:21:09.320722+0000","last_became_active":"2024-04-26T10:21:08.936469+0000","last_became_peered":"2024-04-26T10:21:08.936469+0000","last_unstale":"2024-04-26T10:21:09.320722+0000","last_undegraded":"2024-04-26T10:21:09.320722+0000","last_fullsized":"2024-04-26T10:21:09.320722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:14.145721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302806+0000","last_change":"2024-04-26T10:21:09.315299+0000","last_active":"2024-04-26T10:21:10.302806+0000","last_peered":"2024-04-26T10:21:10.302806+0000","last_clean":"2024-04-26T10:21:10.302806+0000","last_became_active":"2024-04-26T10:21:09.314896+0000","last_became_peered":"2024-04-26T10:21:09.314896+0000","last_unstale":"2024-04-26T10:21:10.302806+0000","last_undegraded":"2024-04-26T10:21:10.302806+0000","last_fullsized":"2024-04-26T10:21:10.302806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.174824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316992+0000","last_change":"2024-04-26T10:21:08.933424+0000","last_active":"2024-04-26T10:21:09.316992+0000","last_peered":"2024-04-26T10:21:09.316992+0000","last_clean":"2024-04-26T10:21:09.316992+0000","last_became_active":"2024-04-26T10:21:08.933088+0000","last_became_peered":"2024-04-26T10:21:08.933088+0000","last_unstale":"2024-04-26T10:21:09.316992+0000","last_undegraded":"2024-04-26T10:21:09.316992+0000","last_fullsized":"2024-04-26T10:21:09.316992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:55.394913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742760+0000","last_change":"2024-04-26T10:21:09.308831+0000","last_active":"2024-04-26T10:21:10.742760+0000","last_peered":"2024-04-26T10:21:10.742760+0000","last_clean":"2024-04-26T10:21:10.742760+0000","last_became_active":"2024-04-26T10:21:09.308457+0000","last_became_peered":"2024-04-26T10:21:09.308457+0000","last_unstale":"2024-04-26T10:21:10.742760+0000","last_undegraded":"2024-04-26T10:21:10.742760+0000","last_fullsized":"2024-04-26T10:21:10.742760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:43.137127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.314230+0000","last_change":"2024-04-26T10:21:08.937023+0000","last_active":"2024-04-26T10:21:09.314230+0000","last_peered":"2024-04-26T10:21:09.314230+0000","last_clean":"2024-04-26T10:21:09.314230+0000","last_became_active":"2024-04-26T10:21:08.936511+0000","last_became_peered":"2024-04-26T10:21:08.936511+0000","last_unstale":"2024-04-26T10:21:09.314230+0000","last_undegraded":"2024-04-26T10:21:09.314230+0000","last_fullsized":"2024-04-26T10:21:09.314230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:38.881531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":653928,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":0,"up_from":10,"seq":42949672965,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":270336,"data_stored":654544,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":188416,"data_stored":62430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:21:17.707 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:21:18.032 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:18.034 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:21:18.046 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-04-26T10:21:17.938979+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94064,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021456,"statfs":{"total":289910292480,"available":289813970944,"internally_reserved":0,"allocated":720896,"data_stored":1370902,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.650070"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303606+0000","last_change":"2024-04-26T10:21:09.316096+0000","last_active":"2024-04-26T10:21:10.303606+0000","last_peered":"2024-04-26T10:21:10.303606+0000","last_clean":"2024-04-26T10:21:10.303606+0000","last_became_active":"2024-04-26T10:21:09.315498+0000","last_became_peered":"2024-04-26T10:21:09.315498+0000","last_unstale":"2024-04-26T10:21:10.303606+0000","last_undegraded":"2024-04-26T10:21:10.303606+0000","last_fullsized":"2024-04-26T10:21:10.303606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:14.245434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304046+0000","last_change":"2024-04-26T10:21:09.317241+0000","last_active":"2024-04-26T10:21:10.304046+0000","last_peered":"2024-04-26T10:21:10.304046+0000","last_clean":"2024-04-26T10:21:10.304046+0000","last_became_active":"2024-04-26T10:21:09.316532+0000","last_became_peered":"2024-04-26T10:21:09.316532+0000","last_unstale":"2024-04-26T10:21:10.304046+0000","last_undegraded":"2024-04-26T10:21:10.304046+0000","last_fullsized":"2024-04-26T10:21:10.304046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:00.173638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743004+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:21:10.743004+0000","last_peered":"2024-04-26T10:21:10.743004+0000","last_clean":"2024-04-26T10:21:10.743004+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:21:10.743004+0000","last_undegraded":"2024-04-26T10:21:10.743004+0000","last_fullsized":"2024-04-26T10:21:10.743004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:01.883964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742576+0000","last_change":"2024-04-26T10:21:09.306531+0000","last_active":"2024-04-26T10:21:10.742576+0000","last_peered":"2024-04-26T10:21:10.742576+0000","last_clean":"2024-04-26T10:21:10.742576+0000","last_became_active":"2024-04-26T10:21:09.304885+0000","last_became_peered":"2024-04-26T10:21:09.304885+0000","last_unstale":"2024-04-26T10:21:10.742576+0000","last_undegraded":"2024-04-26T10:21:10.742576+0000","last_fullsized":"2024-04-26T10:21:10.742576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:04.179516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302949+0000","last_change":"2024-04-26T10:21:09.310914+0000","last_active":"2024-04-26T10:21:10.302949+0000","last_peered":"2024-04-26T10:21:10.302949+0000","last_clean":"2024-04-26T10:21:10.302949+0000","last_became_active":"2024-04-26T10:21:09.309981+0000","last_became_peered":"2024-04-26T10:21:09.309981+0000","last_unstale":"2024-04-26T10:21:10.302949+0000","last_undegraded":"2024-04-26T10:21:10.302949+0000","last_fullsized":"2024-04-26T10:21:10.302949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:04.926251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743427+0000","last_change":"2024-04-26T10:21:09.305198+0000","last_active":"2024-04-26T10:21:10.743427+0000","last_peered":"2024-04-26T10:21:10.743427+0000","last_clean":"2024-04-26T10:21:10.743427+0000","last_became_active":"2024-04-26T10:21:09.304716+0000","last_became_peered":"2024-04-26T10:21:09.304716+0000","last_unstale":"2024-04-26T10:21:10.743427+0000","last_undegraded":"2024-04-26T10:21:10.743427+0000","last_fullsized":"2024-04-26T10:21:10.743427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:11.224015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742177+0000","last_change":"2024-04-26T10:21:09.307188+0000","last_active":"2024-04-26T10:21:10.742177+0000","last_peered":"2024-04-26T10:21:10.742177+0000","last_clean":"2024-04-26T10:21:10.742177+0000","last_became_active":"2024-04-26T10:21:09.306548+0000","last_became_peered":"2024-04-26T10:21:09.306548+0000","last_unstale":"2024-04-26T10:21:10.742177+0000","last_undegraded":"2024-04-26T10:21:10.742177+0000","last_fullsized":"2024-04-26T10:21:10.742177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:29.565507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741718+0000","last_change":"2024-04-26T10:21:09.308284+0000","last_active":"2024-04-26T10:21:10.741718+0000","last_peered":"2024-04-26T10:21:10.741718+0000","last_clean":"2024-04-26T10:21:10.741718+0000","last_became_active":"2024-04-26T10:21:09.307504+0000","last_became_peered":"2024-04-26T10:21:09.307504+0000","last_unstale":"2024-04-26T10:21:10.741718+0000","last_undegraded":"2024-04-26T10:21:10.741718+0000","last_fullsized":"2024-04-26T10:21:10.741718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:51.549222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303844+0000","last_change":"2024-04-26T10:21:09.314160+0000","last_active":"2024-04-26T10:21:10.303844+0000","last_peered":"2024-04-26T10:21:10.303844+0000","last_clean":"2024-04-26T10:21:10.303844+0000","last_became_active":"2024-04-26T10:21:09.313221+0000","last_became_peered":"2024-04-26T10:21:09.313221+0000","last_unstale":"2024-04-26T10:21:10.303844+0000","last_undegraded":"2024-04-26T10:21:10.303844+0000","last_fullsized":"2024-04-26T10:21:10.303844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:50.157094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304095+0000","last_change":"2024-04-26T10:21:09.315304+0000","last_active":"2024-04-26T10:21:10.304095+0000","last_peered":"2024-04-26T10:21:10.304095+0000","last_clean":"2024-04-26T10:21:10.304095+0000","last_became_active":"2024-04-26T10:21:09.314619+0000","last_became_peered":"2024-04-26T10:21:09.314619+0000","last_unstale":"2024-04-26T10:21:10.304095+0000","last_undegraded":"2024-04-26T10:21:10.304095+0000","last_fullsized":"2024-04-26T10:21:10.304095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:41.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743482+0000","last_change":"2024-04-26T10:21:09.307173+0000","last_active":"2024-04-26T10:21:10.743482+0000","last_peered":"2024-04-26T10:21:10.743482+0000","last_clean":"2024-04-26T10:21:10.743482+0000","last_became_active":"2024-04-26T10:21:09.306523+0000","last_became_peered":"2024-04-26T10:21:09.306523+0000","last_unstale":"2024-04-26T10:21:10.743482+0000","last_undegraded":"2024-04-26T10:21:10.743482+0000","last_fullsized":"2024-04-26T10:21:10.743482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:15.102637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302828+0000","last_change":"2024-04-26T10:21:09.319057+0000","last_active":"2024-04-26T10:21:10.302828+0000","last_peered":"2024-04-26T10:21:10.302828+0000","last_clean":"2024-04-26T10:21:10.302828+0000","last_became_active":"2024-04-26T10:21:09.318580+0000","last_became_peered":"2024-04-26T10:21:09.318580+0000","last_unstale":"2024-04-26T10:21:10.302828+0000","last_undegraded":"2024-04-26T10:21:10.302828+0000","last_fullsized":"2024-04-26T10:21:10.302828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.335327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302635+0000","last_change":"2024-04-26T10:21:09.310332+0000","last_active":"2024-04-26T10:21:10.302635+0000","last_peered":"2024-04-26T10:21:10.302635+0000","last_clean":"2024-04-26T10:21:10.302635+0000","last_became_active":"2024-04-26T10:21:09.309534+0000","last_became_peered":"2024-04-26T10:21:09.309534+0000","last_unstale":"2024-04-26T10:21:10.302635+0000","last_undegraded":"2024-04-26T10:21:10.302635+0000","last_fullsized":"2024-04-26T10:21:10.302635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:01.594353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742954+0000","last_change":"2024-04-26T10:21:09.316821+0000","last_active":"2024-04-26T10:21:10.742954+0000","last_peered":"2024-04-26T10:21:10.742954+0000","last_clean":"2024-04-26T10:21:10.742954+0000","last_became_active":"2024-04-26T10:21:09.316143+0000","last_became_peered":"2024-04-26T10:21:09.316143+0000","last_unstale":"2024-04-26T10:21:10.742954+0000","last_undegraded":"2024-04-26T10:21:10.742954+0000","last_fullsized":"2024-04-26T10:21:10.742954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:20.271378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742238+0000","last_change":"2024-04-26T10:21:09.314710+0000","last_active":"2024-04-26T10:21:10.742238+0000","last_peered":"2024-04-26T10:21:10.742238+0000","last_clean":"2024-04-26T10:21:10.742238+0000","last_became_active":"2024-04-26T10:21:09.314401+0000","last_became_peered":"2024-04-26T10:21:09.314401+0000","last_unstale":"2024-04-26T10:21:10.742238+0000","last_undegraded":"2024-04-26T10:21:10.742238+0000","last_fullsized":"2024-04-26T10:21:10.742238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:14.245434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741766+0000","last_change":"2024-04-26T10:21:09.306575+0000","last_active":"2024-04-26T10:21:10.741766+0000","last_peered":"2024-04-26T10:21:10.741766+0000","last_clean":"2024-04-26T10:21:10.741766+0000","last_became_active":"2024-04-26T10:21:09.305009+0000","last_became_peered":"2024-04-26T10:21:09.305009+0000","last_unstale":"2024-04-26T10:21:10.741766+0000","last_undegraded":"2024-04-26T10:21:10.741766+0000","last_fullsized":"2024-04-26T10:21:10.741766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:42.965427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304549+0000","last_change":"2024-04-26T10:21:09.317530+0000","last_active":"2024-04-26T10:21:10.304549+0000","last_peered":"2024-04-26T10:21:10.304549+0000","last_clean":"2024-04-26T10:21:10.304549+0000","last_became_active":"2024-04-26T10:21:09.316956+0000","last_became_peered":"2024-04-26T10:21:09.316956+0000","last_unstale":"2024-04-26T10:21:10.304549+0000","last_undegraded":"2024-04-26T10:21:10.304549+0000","last_fullsized":"2024-04-26T10:21:10.304549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:05.112877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304348+0000","last_change":"2024-04-26T10:21:09.316152+0000","last_active":"2024-04-26T10:21:10.304348+0000","last_peered":"2024-04-26T10:21:10.304348+0000","last_clean":"2024-04-26T10:21:10.304348+0000","last_became_active":"2024-04-26T10:21:09.315441+0000","last_became_peered":"2024-04-26T10:21:09.315441+0000","last_unstale":"2024-04-26T10:21:10.304348+0000","last_undegraded":"2024-04-26T10:21:10.304348+0000","last_fullsized":"2024-04-26T10:21:10.304348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:42.904467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303452+0000","last_change":"2024-04-26T10:21:09.316805+0000","last_active":"2024-04-26T10:21:10.303452+0000","last_peered":"2024-04-26T10:21:10.303452+0000","last_clean":"2024-04-26T10:21:10.303452+0000","last_became_active":"2024-04-26T10:21:09.316490+0000","last_became_peered":"2024-04-26T10:21:09.316490+0000","last_unstale":"2024-04-26T10:21:10.303452+0000","last_undegraded":"2024-04-26T10:21:10.303452+0000","last_fullsized":"2024-04-26T10:21:10.303452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:11.814183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742675+0000","last_change":"2024-04-26T10:21:09.314189+0000","last_active":"2024-04-26T10:21:10.742675+0000","last_peered":"2024-04-26T10:21:10.742675+0000","last_clean":"2024-04-26T10:21:10.742675+0000","last_became_active":"2024-04-26T10:21:09.313648+0000","last_became_peered":"2024-04-26T10:21:09.313648+0000","last_unstale":"2024-04-26T10:21:10.742675+0000","last_undegraded":"2024-04-26T10:21:10.742675+0000","last_fullsized":"2024-04-26T10:21:10.742675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:57.658133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743475+0000","last_change":"2024-04-26T10:21:09.316594+0000","last_active":"2024-04-26T10:21:10.743475+0000","last_peered":"2024-04-26T10:21:10.743475+0000","last_clean":"2024-04-26T10:21:10.743475+0000","last_became_active":"2024-04-26T10:21:09.315877+0000","last_became_peered":"2024-04-26T10:21:09.315877+0000","last_unstale":"2024-04-26T10:21:10.743475+0000","last_undegraded":"2024-04-26T10:21:10.743475+0000","last_fullsized":"2024-04-26T10:21:10.743475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:19.943321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302427+0000","last_change":"2024-04-26T10:21:09.318829+0000","last_active":"2024-04-26T10:21:10.302427+0000","last_peered":"2024-04-26T10:21:10.302427+0000","last_clean":"2024-04-26T10:21:10.302427+0000","last_became_active":"2024-04-26T10:21:09.318379+0000","last_became_peered":"2024-04-26T10:21:09.318379+0000","last_unstale":"2024-04-26T10:21:10.302427+0000","last_undegraded":"2024-04-26T10:21:10.302427+0000","last_fullsized":"2024-04-26T10:21:10.302427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:11.224015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302100+0000","last_change":"2024-04-26T10:21:09.309068+0000","last_active":"2024-04-26T10:21:10.302100+0000","last_peered":"2024-04-26T10:21:10.302100+0000","last_clean":"2024-04-26T10:21:10.302100+0000","last_became_active":"2024-04-26T10:21:09.308797+0000","last_became_peered":"2024-04-26T10:21:09.308797+0000","last_unstale":"2024-04-26T10:21:10.302100+0000","last_undegraded":"2024-04-26T10:21:10.302100+0000","last_fullsized":"2024-04-26T10:21:10.302100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:44.761759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.301914+0000","last_change":"2024-04-26T10:21:09.311574+0000","last_active":"2024-04-26T10:21:10.301914+0000","last_peered":"2024-04-26T10:21:10.301914+0000","last_clean":"2024-04-26T10:21:10.301914+0000","last_became_active":"2024-04-26T10:21:09.309285+0000","last_became_peered":"2024-04-26T10:21:09.309285+0000","last_unstale":"2024-04-26T10:21:10.301914+0000","last_undegraded":"2024-04-26T10:21:10.301914+0000","last_fullsized":"2024-04-26T10:21:10.301914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:06.884098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303605+0000","last_change":"2024-04-26T10:21:09.317948+0000","last_active":"2024-04-26T10:21:10.303605+0000","last_peered":"2024-04-26T10:21:10.303605+0000","last_clean":"2024-04-26T10:21:10.303605+0000","last_became_active":"2024-04-26T10:21:09.317571+0000","last_became_peered":"2024-04-26T10:21:09.317571+0000","last_unstale":"2024-04-26T10:21:10.303605+0000","last_undegraded":"2024-04-26T10:21:10.303605+0000","last_fullsized":"2024-04-26T10:21:10.303605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:04.179516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304130+0000","last_change":"2024-04-26T10:21:09.312839+0000","last_active":"2024-04-26T10:21:10.304130+0000","last_peered":"2024-04-26T10:21:10.304130+0000","last_clean":"2024-04-26T10:21:10.304130+0000","last_became_active":"2024-04-26T10:21:09.311898+0000","last_became_peered":"2024-04-26T10:21:09.311898+0000","last_unstale":"2024-04-26T10:21:10.304130+0000","last_undegraded":"2024-04-26T10:21:10.304130+0000","last_fullsized":"2024-04-26T10:21:10.304130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:03.705171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743873+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:21:10.743873+0000","last_peered":"2024-04-26T10:21:10.743873+0000","last_clean":"2024-04-26T10:21:10.743873+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:21:10.743873+0000","last_undegraded":"2024-04-26T10:21:10.743873+0000","last_fullsized":"2024-04-26T10:21:10.743873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:39.394937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303372+0000","last_change":"2024-04-26T10:21:09.312446+0000","last_active":"2024-04-26T10:21:10.303372+0000","last_peered":"2024-04-26T10:21:10.303372+0000","last_clean":"2024-04-26T10:21:10.303372+0000","last_became_active":"2024-04-26T10:21:09.311919+0000","last_became_peered":"2024-04-26T10:21:09.311919+0000","last_unstale":"2024-04-26T10:21:10.303372+0000","last_undegraded":"2024-04-26T10:21:10.303372+0000","last_fullsized":"2024-04-26T10:21:10.303372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:57.658133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303274+0000","last_change":"2024-04-26T10:21:09.316871+0000","last_active":"2024-04-26T10:21:10.303274+0000","last_peered":"2024-04-26T10:21:10.303274+0000","last_clean":"2024-04-26T10:21:10.303274+0000","last_became_active":"2024-04-26T10:21:09.316529+0000","last_became_peered":"2024-04-26T10:21:09.316529+0000","last_unstale":"2024-04-26T10:21:10.303274+0000","last_undegraded":"2024-04-26T10:21:10.303274+0000","last_fullsized":"2024-04-26T10:21:10.303274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:52.614699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303836+0000","last_change":"2024-04-26T10:21:09.313160+0000","last_active":"2024-04-26T10:21:10.303836+0000","last_peered":"2024-04-26T10:21:10.303836+0000","last_clean":"2024-04-26T10:21:10.303836+0000","last_became_active":"2024-04-26T10:21:09.312556+0000","last_became_peered":"2024-04-26T10:21:09.312556+0000","last_unstale":"2024-04-26T10:21:10.303836+0000","last_undegraded":"2024-04-26T10:21:10.303836+0000","last_fullsized":"2024-04-26T10:21:10.303836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:21.698558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302244+0000","last_change":"2024-04-26T10:21:09.314165+0000","last_active":"2024-04-26T10:21:10.302244+0000","last_peered":"2024-04-26T10:21:10.302244+0000","last_clean":"2024-04-26T10:21:10.302244+0000","last_became_active":"2024-04-26T10:21:09.313559+0000","last_became_peered":"2024-04-26T10:21:09.313559+0000","last_unstale":"2024-04-26T10:21:10.302244+0000","last_undegraded":"2024-04-26T10:21:10.302244+0000","last_fullsized":"2024-04-26T10:21:10.302244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:05.857831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741968+0000","last_change":"2024-04-26T10:21:09.309366+0000","last_active":"2024-04-26T10:21:10.741968+0000","last_peered":"2024-04-26T10:21:10.741968+0000","last_clean":"2024-04-26T10:21:10.741968+0000","last_became_active":"2024-04-26T10:21:09.308660+0000","last_became_peered":"2024-04-26T10:21:09.308660+0000","last_unstale":"2024-04-26T10:21:10.741968+0000","last_undegraded":"2024-04-26T10:21:10.741968+0000","last_fullsized":"2024-04-26T10:21:10.741968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.335327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303113+0000","last_change":"2024-04-26T10:21:09.317455+0000","last_active":"2024-04-26T10:21:10.303113+0000","last_peered":"2024-04-26T10:21:10.303113+0000","last_clean":"2024-04-26T10:21:10.303113+0000","last_became_active":"2024-04-26T10:21:09.316994+0000","last_became_peered":"2024-04-26T10:21:09.316994+0000","last_unstale":"2024-04-26T10:21:10.303113+0000","last_undegraded":"2024-04-26T10:21:10.303113+0000","last_fullsized":"2024-04-26T10:21:10.303113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:48.942276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.317124+0000","last_change":"2024-04-26T10:21:08.939370+0000","last_active":"2024-04-26T10:21:09.317124+0000","last_peered":"2024-04-26T10:21:09.317124+0000","last_clean":"2024-04-26T10:21:09.317124+0000","last_became_active":"2024-04-26T10:21:08.937845+0000","last_became_peered":"2024-04-26T10:21:08.937845+0000","last_unstale":"2024-04-26T10:21:09.317124+0000","last_undegraded":"2024-04-26T10:21:09.317124+0000","last_fullsized":"2024-04-26T10:21:09.317124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:28.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304041+0000","last_change":"2024-04-26T10:21:09.316515+0000","last_active":"2024-04-26T10:21:10.304041+0000","last_peered":"2024-04-26T10:21:10.304041+0000","last_clean":"2024-04-26T10:21:10.304041+0000","last_became_active":"2024-04-26T10:21:09.315714+0000","last_became_peered":"2024-04-26T10:21:09.315714+0000","last_unstale":"2024-04-26T10:21:10.304041+0000","last_undegraded":"2024-04-26T10:21:10.304041+0000","last_fullsized":"2024-04-26T10:21:10.304041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.032760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296726+0000","last_change":"2024-04-26T10:21:08.937056+0000","last_active":"2024-04-26T10:21:09.296726+0000","last_peered":"2024-04-26T10:21:09.296726+0000","last_clean":"2024-04-26T10:21:09.296726+0000","last_became_active":"2024-04-26T10:21:08.936545+0000","last_became_peered":"2024-04-26T10:21:08.936545+0000","last_unstale":"2024-04-26T10:21:09.296726+0000","last_undegraded":"2024-04-26T10:21:09.296726+0000","last_fullsized":"2024-04-26T10:21:09.296726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:48.449203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304386+0000","last_change":"2024-04-26T10:21:09.313813+0000","last_active":"2024-04-26T10:21:10.304386+0000","last_peered":"2024-04-26T10:21:10.304386+0000","last_clean":"2024-04-26T10:21:10.304386+0000","last_became_active":"2024-04-26T10:21:09.312562+0000","last_became_peered":"2024-04-26T10:21:09.312562+0000","last_unstale":"2024-04-26T10:21:10.304386+0000","last_undegraded":"2024-04-26T10:21:10.304386+0000","last_fullsized":"2024-04-26T10:21:10.304386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:46.413942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309703+0000","last_change":"2024-04-26T10:21:08.936433+0000","last_active":"2024-04-26T10:21:09.309703+0000","last_peered":"2024-04-26T10:21:09.309703+0000","last_clean":"2024-04-26T10:21:09.309703+0000","last_became_active":"2024-04-26T10:21:08.935875+0000","last_became_peered":"2024-04-26T10:21:08.935875+0000","last_unstale":"2024-04-26T10:21:09.309703+0000","last_undegraded":"2024-04-26T10:21:09.309703+0000","last_fullsized":"2024-04-26T10:21:09.309703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:24.501204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303865+0000","last_change":"2024-04-26T10:21:09.314435+0000","last_active":"2024-04-26T10:21:10.303865+0000","last_peered":"2024-04-26T10:21:10.303865+0000","last_clean":"2024-04-26T10:21:10.303865+0000","last_became_active":"2024-04-26T10:21:09.313684+0000","last_became_peered":"2024-04-26T10:21:09.313684+0000","last_unstale":"2024-04-26T10:21:10.303865+0000","last_undegraded":"2024-04-26T10:21:10.303865+0000","last_fullsized":"2024-04-26T10:21:10.303865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:20.185980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.321258+0000","last_change":"2024-04-26T10:21:08.934971+0000","last_active":"2024-04-26T10:21:09.321258+0000","last_peered":"2024-04-26T10:21:09.321258+0000","last_clean":"2024-04-26T10:21:09.321258+0000","last_became_active":"2024-04-26T10:21:08.934653+0000","last_became_peered":"2024-04-26T10:21:08.934653+0000","last_unstale":"2024-04-26T10:21:09.321258+0000","last_undegraded":"2024-04-26T10:21:09.321258+0000","last_fullsized":"2024-04-26T10:21:09.321258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:18.272015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.315924+0000","last_change":"2024-04-26T10:21:08.934452+0000","last_active":"2024-04-26T10:21:09.315924+0000","last_peered":"2024-04-26T10:21:09.315924+0000","last_clean":"2024-04-26T10:21:09.315924+0000","last_became_active":"2024-04-26T10:21:08.934091+0000","last_became_peered":"2024-04-26T10:21:08.934091+0000","last_unstale":"2024-04-26T10:21:09.315924+0000","last_undegraded":"2024-04-26T10:21:09.315924+0000","last_fullsized":"2024-04-26T10:21:09.315924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:11.224989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.301898+0000","last_change":"2024-04-26T10:21:09.314631+0000","last_active":"2024-04-26T10:21:10.301898+0000","last_peered":"2024-04-26T10:21:10.301898+0000","last_clean":"2024-04-26T10:21:10.301898+0000","last_became_active":"2024-04-26T10:21:09.313044+0000","last_became_peered":"2024-04-26T10:21:09.313044+0000","last_unstale":"2024-04-26T10:21:10.301898+0000","last_undegraded":"2024-04-26T10:21:10.301898+0000","last_fullsized":"2024-04-26T10:21:10.301898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:19.943321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.319848+0000","last_change":"2024-04-26T10:21:08.935870+0000","last_active":"2024-04-26T10:21:09.319848+0000","last_peered":"2024-04-26T10:21:09.319848+0000","last_clean":"2024-04-26T10:21:09.319848+0000","last_became_active":"2024-04-26T10:21:08.935380+0000","last_became_peered":"2024-04-26T10:21:08.935380+0000","last_unstale":"2024-04-26T10:21:09.319848+0000","last_undegraded":"2024-04-26T10:21:09.319848+0000","last_fullsized":"2024-04-26T10:21:09.319848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:22.537149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302131+0000","last_change":"2024-04-26T10:21:09.317032+0000","last_active":"2024-04-26T10:21:10.302131+0000","last_peered":"2024-04-26T10:21:10.302131+0000","last_clean":"2024-04-26T10:21:10.302131+0000","last_became_active":"2024-04-26T10:21:09.316416+0000","last_became_peered":"2024-04-26T10:21:09.316416+0000","last_unstale":"2024-04-26T10:21:10.302131+0000","last_undegraded":"2024-04-26T10:21:10.302131+0000","last_fullsized":"2024-04-26T10:21:10.302131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:56.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320696+0000","last_change":"2024-04-26T10:21:08.935133+0000","last_active":"2024-04-26T10:21:09.320696+0000","last_peered":"2024-04-26T10:21:09.320696+0000","last_clean":"2024-04-26T10:21:09.320696+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:21:09.320696+0000","last_undegraded":"2024-04-26T10:21:09.320696+0000","last_fullsized":"2024-04-26T10:21:09.320696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:25.498249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743681+0000","last_change":"2024-04-26T10:21:09.315201+0000","last_active":"2024-04-26T10:21:10.743681+0000","last_peered":"2024-04-26T10:21:10.743681+0000","last_clean":"2024-04-26T10:21:10.743681+0000","last_became_active":"2024-04-26T10:21:09.314390+0000","last_became_peered":"2024-04-26T10:21:09.314390+0000","last_unstale":"2024-04-26T10:21:10.743681+0000","last_undegraded":"2024-04-26T10:21:10.743681+0000","last_fullsized":"2024-04-26T10:21:10.743681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.998466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.299090+0000","last_change":"2024-04-26T10:21:08.939382+0000","last_active":"2024-04-26T10:21:09.299090+0000","last_peered":"2024-04-26T10:21:09.299090+0000","last_clean":"2024-04-26T10:21:09.299090+0000","last_became_active":"2024-04-26T10:21:08.938193+0000","last_became_peered":"2024-04-26T10:21:08.938193+0000","last_unstale":"2024-04-26T10:21:09.299090+0000","last_undegraded":"2024-04-26T10:21:09.299090+0000","last_fullsized":"2024-04-26T10:21:09.299090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:01.182611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303014+0000","last_change":"2024-04-26T10:21:09.313678+0000","last_active":"2024-04-26T10:21:10.303014+0000","last_peered":"2024-04-26T10:21:10.303014+0000","last_clean":"2024-04-26T10:21:10.303014+0000","last_became_active":"2024-04-26T10:21:09.312906+0000","last_became_peered":"2024-04-26T10:21:09.312906+0000","last_unstale":"2024-04-26T10:21:10.303014+0000","last_undegraded":"2024-04-26T10:21:10.303014+0000","last_fullsized":"2024-04-26T10:21:10.303014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:14.241108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.313678+0000","last_change":"2024-04-26T10:21:08.936904+0000","last_active":"2024-04-26T10:21:09.313678+0000","last_peered":"2024-04-26T10:21:09.313678+0000","last_clean":"2024-04-26T10:21:09.313678+0000","last_became_active":"2024-04-26T10:21:08.936376+0000","last_became_peered":"2024-04-26T10:21:08.936376+0000","last_unstale":"2024-04-26T10:21:09.313678+0000","last_undegraded":"2024-04-26T10:21:09.313678+0000","last_fullsized":"2024-04-26T10:21:09.313678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:19.270525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742850+0000","last_change":"2024-04-26T10:21:09.307911+0000","last_active":"2024-04-26T10:21:10.742850+0000","last_peered":"2024-04-26T10:21:10.742850+0000","last_clean":"2024-04-26T10:21:10.742850+0000","last_became_active":"2024-04-26T10:21:09.307597+0000","last_became_peered":"2024-04-26T10:21:09.307597+0000","last_unstale":"2024-04-26T10:21:10.742850+0000","last_undegraded":"2024-04-26T10:21:10.742850+0000","last_fullsized":"2024-04-26T10:21:10.742850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:21.698558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.300582+0000","last_change":"2024-04-26T10:21:08.939072+0000","last_active":"2024-04-26T10:21:09.300582+0000","last_peered":"2024-04-26T10:21:09.300582+0000","last_clean":"2024-04-26T10:21:09.300582+0000","last_became_active":"2024-04-26T10:21:08.938445+0000","last_became_peered":"2024-04-26T10:21:08.938445+0000","last_unstale":"2024-04-26T10:21:09.300582+0000","last_undegraded":"2024-04-26T10:21:09.300582+0000","last_fullsized":"2024-04-26T10:21:09.300582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:06.598189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743938+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:21:10.743938+0000","last_peered":"2024-04-26T10:21:10.743938+0000","last_clean":"2024-04-26T10:21:10.743938+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:21:10.743938+0000","last_undegraded":"2024-04-26T10:21:10.743938+0000","last_fullsized":"2024-04-26T10:21:10.743938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309935+0000","last_change":"2024-04-26T10:21:08.936533+0000","last_active":"2024-04-26T10:21:09.309935+0000","last_peered":"2024-04-26T10:21:09.309935+0000","last_clean":"2024-04-26T10:21:09.309935+0000","last_became_active":"2024-04-26T10:21:08.936222+0000","last_became_peered":"2024-04-26T10:21:08.936222+0000","last_unstale":"2024-04-26T10:21:09.309935+0000","last_undegraded":"2024-04-26T10:21:09.309935+0000","last_fullsized":"2024-04-26T10:21:09.309935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:18:07.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742771+0000","last_change":"2024-04-26T10:21:09.316361+0000","last_active":"2024-04-26T10:21:10.742771+0000","last_peered":"2024-04-26T10:21:10.742771+0000","last_clean":"2024-04-26T10:21:10.742771+0000","last_became_active":"2024-04-26T10:21:09.315981+0000","last_became_peered":"2024-04-26T10:21:09.315981+0000","last_unstale":"2024-04-26T10:21:10.742771+0000","last_undegraded":"2024-04-26T10:21:10.742771+0000","last_fullsized":"2024-04-26T10:21:10.742771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:00.173638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309815+0000","last_change":"2024-04-26T10:21:08.928590+0000","last_active":"2024-04-26T10:21:09.309815+0000","last_peered":"2024-04-26T10:21:09.309815+0000","last_clean":"2024-04-26T10:21:09.309815+0000","last_became_active":"2024-04-26T10:21:08.928354+0000","last_became_peered":"2024-04-26T10:21:08.928354+0000","last_unstale":"2024-04-26T10:21:09.309815+0000","last_undegraded":"2024-04-26T10:21:09.309815+0000","last_fullsized":"2024-04-26T10:21:09.309815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:52.241716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304119+0000","last_change":"2024-04-26T10:21:09.317282+0000","last_active":"2024-04-26T10:21:10.304119+0000","last_peered":"2024-04-26T10:21:10.304119+0000","last_clean":"2024-04-26T10:21:10.304119+0000","last_became_active":"2024-04-26T10:21:09.316591+0000","last_became_peered":"2024-04-26T10:21:09.316591+0000","last_unstale":"2024-04-26T10:21:10.304119+0000","last_undegraded":"2024-04-26T10:21:10.304119+0000","last_fullsized":"2024-04-26T10:21:10.304119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:28.447361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":213,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297609+0000","last_change":"2024-04-26T10:21:01.829140+0000","last_active":"2024-04-26T10:21:09.297609+0000","last_peered":"2024-04-26T10:21:09.297609+0000","last_clean":"2024-04-26T10:21:09.297609+0000","last_became_active":"2024-04-26T10:21:01.827182+0000","last_became_peered":"2024-04-26T10:21:01.827182+0000","last_unstale":"2024-04-26T10:21:09.297609+0000","last_undegraded":"2024-04-26T10:21:09.297609+0000","last_fullsized":"2024-04-26T10:21:09.297609+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:00:51.477222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298874+0000","last_change":"2024-04-26T10:21:04.893745+0000","last_active":"2024-04-26T10:21:09.298874+0000","last_peered":"2024-04-26T10:21:09.298874+0000","last_clean":"2024-04-26T10:21:09.298874+0000","last_became_active":"2024-04-26T10:21:04.893031+0000","last_became_peered":"2024-04-26T10:21:04.893031+0000","last_unstale":"2024-04-26T10:21:09.298874+0000","last_undegraded":"2024-04-26T10:21:09.298874+0000","last_fullsized":"2024-04-26T10:21:09.298874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:59.771061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297001+0000","last_change":"2024-04-26T10:21:08.933706+0000","last_active":"2024-04-26T10:21:09.297001+0000","last_peered":"2024-04-26T10:21:09.297001+0000","last_clean":"2024-04-26T10:21:09.297001+0000","last_became_active":"2024-04-26T10:21:08.933372+0000","last_became_peered":"2024-04-26T10:21:08.933372+0000","last_unstale":"2024-04-26T10:21:09.297001+0000","last_undegraded":"2024-04-26T10:21:09.297001+0000","last_fullsized":"2024-04-26T10:21:09.297001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:14.290484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.744176+0000","last_change":"2024-04-26T10:21:09.320889+0000","last_active":"2024-04-26T10:21:10.744176+0000","last_peered":"2024-04-26T10:21:10.744176+0000","last_clean":"2024-04-26T10:21:10.744176+0000","last_became_active":"2024-04-26T10:21:09.320355+0000","last_became_peered":"2024-04-26T10:21:09.320355+0000","last_unstale":"2024-04-26T10:21:10.744176+0000","last_undegraded":"2024-04-26T10:21:10.744176+0000","last_fullsized":"2024-04-26T10:21:10.744176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:41.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297382+0000","last_change":"2024-04-26T10:21:04.892156+0000","last_active":"2024-04-26T10:21:09.297382+0000","last_peered":"2024-04-26T10:21:09.297382+0000","last_clean":"2024-04-26T10:21:09.297382+0000","last_became_active":"2024-04-26T10:21:04.891660+0000","last_became_peered":"2024-04-26T10:21:04.891660+0000","last_unstale":"2024-04-26T10:21:09.297382+0000","last_undegraded":"2024-04-26T10:21:09.297382+0000","last_fullsized":"2024-04-26T10:21:09.297382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:50.568468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296858+0000","last_change":"2024-04-26T10:21:08.936815+0000","last_active":"2024-04-26T10:21:09.296858+0000","last_peered":"2024-04-26T10:21:09.296858+0000","last_clean":"2024-04-26T10:21:09.296858+0000","last_became_active":"2024-04-26T10:21:08.936180+0000","last_became_peered":"2024-04-26T10:21:08.936180+0000","last_unstale":"2024-04-26T10:21:09.296858+0000","last_undegraded":"2024-04-26T10:21:09.296858+0000","last_fullsized":"2024-04-26T10:21:09.296858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:41.614282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304366+0000","last_change":"2024-04-26T10:21:09.310050+0000","last_active":"2024-04-26T10:21:10.304366+0000","last_peered":"2024-04-26T10:21:10.304366+0000","last_clean":"2024-04-26T10:21:10.304366+0000","last_became_active":"2024-04-26T10:21:09.309470+0000","last_became_peered":"2024-04-26T10:21:09.309470+0000","last_unstale":"2024-04-26T10:21:10.304366+0000","last_undegraded":"2024-04-26T10:21:10.304366+0000","last_fullsized":"2024-04-26T10:21:10.304366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:32.334144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296330+0000","last_change":"2024-04-26T10:21:04.890860+0000","last_active":"2024-04-26T10:21:09.296330+0000","last_peered":"2024-04-26T10:21:09.296330+0000","last_clean":"2024-04-26T10:21:09.296330+0000","last_became_active":"2024-04-26T10:21:04.890336+0000","last_became_peered":"2024-04-26T10:21:04.890336+0000","last_unstale":"2024-04-26T10:21:09.296330+0000","last_undegraded":"2024-04-26T10:21:09.296330+0000","last_fullsized":"2024-04-26T10:21:09.296330+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:13.262120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.310359+0000","last_change":"2024-04-26T10:21:08.936077+0000","last_active":"2024-04-26T10:21:09.310359+0000","last_peered":"2024-04-26T10:21:09.310359+0000","last_clean":"2024-04-26T10:21:09.310359+0000","last_became_active":"2024-04-26T10:21:08.935621+0000","last_became_peered":"2024-04-26T10:21:08.935621+0000","last_unstale":"2024-04-26T10:21:09.310359+0000","last_undegraded":"2024-04-26T10:21:09.310359+0000","last_fullsized":"2024-04-26T10:21:09.310359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:11.906094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304130+0000","last_change":"2024-04-26T10:21:09.314796+0000","last_active":"2024-04-26T10:21:10.304130+0000","last_peered":"2024-04-26T10:21:10.304130+0000","last_clean":"2024-04-26T10:21:10.304130+0000","last_became_active":"2024-04-26T10:21:09.314574+0000","last_became_peered":"2024-04-26T10:21:09.314574+0000","last_unstale":"2024-04-26T10:21:10.304130+0000","last_undegraded":"2024-04-26T10:21:10.304130+0000","last_fullsized":"2024-04-26T10:21:10.304130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:32.136621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301803+0000","last_change":"2024-04-26T10:21:04.893253+0000","last_active":"2024-04-26T10:21:09.301803+0000","last_peered":"2024-04-26T10:21:09.301803+0000","last_clean":"2024-04-26T10:21:09.301803+0000","last_became_active":"2024-04-26T10:21:04.892843+0000","last_became_peered":"2024-04-26T10:21:04.892843+0000","last_unstale":"2024-04-26T10:21:09.301803+0000","last_undegraded":"2024-04-26T10:21:09.301803+0000","last_fullsized":"2024-04-26T10:21:09.301803+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:00.749791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298626+0000","last_change":"2024-04-26T10:21:08.937153+0000","last_active":"2024-04-26T10:21:09.298626+0000","last_peered":"2024-04-26T10:21:09.298626+0000","last_clean":"2024-04-26T10:21:09.298626+0000","last_became_active":"2024-04-26T10:21:08.936561+0000","last_became_peered":"2024-04-26T10:21:08.936561+0000","last_unstale":"2024-04-26T10:21:09.298626+0000","last_undegraded":"2024-04-26T10:21:09.298626+0000","last_fullsized":"2024-04-26T10:21:09.298626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:28.491800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303941+0000","last_change":"2024-04-26T10:21:09.314218+0000","last_active":"2024-04-26T10:21:10.303941+0000","last_peered":"2024-04-26T10:21:10.303941+0000","last_clean":"2024-04-26T10:21:10.303941+0000","last_became_active":"2024-04-26T10:21:09.313641+0000","last_became_peered":"2024-04-26T10:21:09.313641+0000","last_unstale":"2024-04-26T10:21:10.303941+0000","last_undegraded":"2024-04-26T10:21:10.303941+0000","last_fullsized":"2024-04-26T10:21:10.303941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:08.449512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.300397+0000","last_change":"2024-04-26T10:21:08.937196+0000","last_active":"2024-04-26T10:21:09.300397+0000","last_peered":"2024-04-26T10:21:09.300397+0000","last_clean":"2024-04-26T10:21:09.300397+0000","last_became_active":"2024-04-26T10:21:08.936779+0000","last_became_peered":"2024-04-26T10:21:08.936779+0000","last_unstale":"2024-04-26T10:21:09.300397+0000","last_undegraded":"2024-04-26T10:21:09.300397+0000","last_fullsized":"2024-04-26T10:21:09.300397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:20.545169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295561+0000","last_change":"2024-04-26T10:21:04.890548+0000","last_active":"2024-04-26T10:21:09.295561+0000","last_peered":"2024-04-26T10:21:09.295561+0000","last_clean":"2024-04-26T10:21:09.295561+0000","last_became_active":"2024-04-26T10:21:04.890034+0000","last_became_peered":"2024-04-26T10:21:04.890034+0000","last_unstale":"2024-04-26T10:21:09.295561+0000","last_undegraded":"2024-04-26T10:21:09.295561+0000","last_fullsized":"2024-04-26T10:21:09.295561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:55.033455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302442+0000","last_change":"2024-04-26T10:21:09.318348+0000","last_active":"2024-04-26T10:21:10.302442+0000","last_peered":"2024-04-26T10:21:10.302442+0000","last_clean":"2024-04-26T10:21:10.302442+0000","last_became_active":"2024-04-26T10:21:09.317886+0000","last_became_peered":"2024-04-26T10:21:09.317886+0000","last_unstale":"2024-04-26T10:21:10.302442+0000","last_undegraded":"2024-04-26T10:21:10.302442+0000","last_fullsized":"2024-04-26T10:21:10.302442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:24.624358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295394+0000","last_change":"2024-04-26T10:21:08.933714+0000","last_active":"2024-04-26T10:21:09.295394+0000","last_peered":"2024-04-26T10:21:09.295394+0000","last_clean":"2024-04-26T10:21:09.295394+0000","last_became_active":"2024-04-26T10:21:08.933259+0000","last_became_peered":"2024-04-26T10:21:08.933259+0000","last_unstale":"2024-04-26T10:21:09.295394+0000","last_undegraded":"2024-04-26T10:21:09.295394+0000","last_fullsized":"2024-04-26T10:21:09.295394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:50.230096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.311683+0000","last_change":"2024-04-26T10:21:04.891490+0000","last_active":"2024-04-26T10:21:09.311683+0000","last_peered":"2024-04-26T10:21:09.311683+0000","last_clean":"2024-04-26T10:21:09.311683+0000","last_became_active":"2024-04-26T10:21:04.890777+0000","last_became_peered":"2024-04-26T10:21:04.890777+0000","last_unstale":"2024-04-26T10:21:09.311683+0000","last_undegraded":"2024-04-26T10:21:09.311683+0000","last_fullsized":"2024-04-26T10:21:09.311683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:25.896672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302680+0000","last_change":"2024-04-26T10:21:09.314213+0000","last_active":"2024-04-26T10:21:10.302680+0000","last_peered":"2024-04-26T10:21:10.302680+0000","last_clean":"2024-04-26T10:21:10.302680+0000","last_became_active":"2024-04-26T10:21:09.312975+0000","last_became_peered":"2024-04-26T10:21:09.312975+0000","last_unstale":"2024-04-26T10:21:10.302680+0000","last_undegraded":"2024-04-26T10:21:10.302680+0000","last_fullsized":"2024-04-26T10:21:10.302680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:43.137127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.317699+0000","last_change":"2024-04-26T10:21:08.934216+0000","last_active":"2024-04-26T10:21:09.317699+0000","last_peered":"2024-04-26T10:21:09.317699+0000","last_clean":"2024-04-26T10:21:09.317699+0000","last_became_active":"2024-04-26T10:21:08.933524+0000","last_became_peered":"2024-04-26T10:21:08.933524+0000","last_unstale":"2024-04-26T10:21:09.317699+0000","last_undegraded":"2024-04-26T10:21:09.317699+0000","last_fullsized":"2024-04-26T10:21:09.317699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:57.798830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297318+0000","last_change":"2024-04-26T10:21:04.890490+0000","last_active":"2024-04-26T10:21:09.297318+0000","last_peered":"2024-04-26T10:21:09.297318+0000","last_clean":"2024-04-26T10:21:09.297318+0000","last_became_active":"2024-04-26T10:21:04.889808+0000","last_became_peered":"2024-04-26T10:21:04.889808+0000","last_unstale":"2024-04-26T10:21:09.297318+0000","last_undegraded":"2024-04-26T10:21:09.297318+0000","last_fullsized":"2024-04-26T10:21:09.297318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:55.711555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302374+0000","last_change":"2024-04-26T10:21:09.312260+0000","last_active":"2024-04-26T10:21:10.302374+0000","last_peered":"2024-04-26T10:21:10.302374+0000","last_clean":"2024-04-26T10:21:10.302374+0000","last_became_active":"2024-04-26T10:21:09.311309+0000","last_became_peered":"2024-04-26T10:21:09.311309+0000","last_unstale":"2024-04-26T10:21:10.302374+0000","last_undegraded":"2024-04-26T10:21:10.302374+0000","last_fullsized":"2024-04-26T10:21:10.302374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:30.714581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297093+0000","last_change":"2024-04-26T10:21:08.936623+0000","last_active":"2024-04-26T10:21:09.297093+0000","last_peered":"2024-04-26T10:21:09.297093+0000","last_clean":"2024-04-26T10:21:09.297093+0000","last_became_active":"2024-04-26T10:21:08.936252+0000","last_became_peered":"2024-04-26T10:21:08.936252+0000","last_unstale":"2024-04-26T10:21:09.297093+0000","last_undegraded":"2024-04-26T10:21:09.297093+0000","last_fullsized":"2024-04-26T10:21:09.297093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:24.526250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296848+0000","last_change":"2024-04-26T10:21:04.892401+0000","last_active":"2024-04-26T10:21:09.296848+0000","last_peered":"2024-04-26T10:21:09.296848+0000","last_clean":"2024-04-26T10:21:09.296848+0000","last_became_active":"2024-04-26T10:21:04.891692+0000","last_became_peered":"2024-04-26T10:21:04.891692+0000","last_unstale":"2024-04-26T10:21:09.296848+0000","last_undegraded":"2024-04-26T10:21:09.296848+0000","last_fullsized":"2024-04-26T10:21:09.296848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:37.548728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302178+0000","last_change":"2024-04-26T10:21:09.317981+0000","last_active":"2024-04-26T10:21:10.302178+0000","last_peered":"2024-04-26T10:21:10.302178+0000","last_clean":"2024-04-26T10:21:10.302178+0000","last_became_active":"2024-04-26T10:21:09.317601+0000","last_became_peered":"2024-04-26T10:21:09.317601+0000","last_unstale":"2024-04-26T10:21:10.302178+0000","last_undegraded":"2024-04-26T10:21:10.302178+0000","last_fullsized":"2024-04-26T10:21:10.302178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742909+0000","last_change":"2024-04-26T10:21:09.317120+0000","last_active":"2024-04-26T10:21:10.742909+0000","last_peered":"2024-04-26T10:21:10.742909+0000","last_clean":"2024-04-26T10:21:10.742909+0000","last_became_active":"2024-04-26T10:21:09.316741+0000","last_became_peered":"2024-04-26T10:21:09.316741+0000","last_unstale":"2024-04-26T10:21:10.742909+0000","last_undegraded":"2024-04-26T10:21:10.742909+0000","last_fullsized":"2024-04-26T10:21:10.742909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:43.702714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.326574+0000","last_change":"2024-04-26T10:21:08.934481+0000","last_active":"2024-04-26T10:21:09.326574+0000","last_peered":"2024-04-26T10:21:09.326574+0000","last_clean":"2024-04-26T10:21:09.326574+0000","last_became_active":"2024-04-26T10:21:08.934076+0000","last_became_peered":"2024-04-26T10:21:08.934076+0000","last_unstale":"2024-04-26T10:21:09.326574+0000","last_undegraded":"2024-04-26T10:21:09.326574+0000","last_fullsized":"2024-04-26T10:21:09.326574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:50.622715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302791+0000","last_change":"2024-04-26T10:21:09.314009+0000","last_active":"2024-04-26T10:21:10.302791+0000","last_peered":"2024-04-26T10:21:10.302791+0000","last_clean":"2024-04-26T10:21:10.302791+0000","last_became_active":"2024-04-26T10:21:09.313556+0000","last_became_peered":"2024-04-26T10:21:09.313556+0000","last_unstale":"2024-04-26T10:21:10.302791+0000","last_undegraded":"2024-04-26T10:21:10.302791+0000","last_fullsized":"2024-04-26T10:21:10.302791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:34.862466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320711+0000","last_change":"2024-04-26T10:21:08.936526+0000","last_active":"2024-04-26T10:21:09.320711+0000","last_peered":"2024-04-26T10:21:09.320711+0000","last_clean":"2024-04-26T10:21:09.320711+0000","last_became_active":"2024-04-26T10:21:08.936217+0000","last_became_peered":"2024-04-26T10:21:08.936217+0000","last_unstale":"2024-04-26T10:21:09.320711+0000","last_undegraded":"2024-04-26T10:21:09.320711+0000","last_fullsized":"2024-04-26T10:21:09.320711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:57.649639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301807+0000","last_change":"2024-04-26T10:21:08.937597+0000","last_active":"2024-04-26T10:21:09.301807+0000","last_peered":"2024-04-26T10:21:09.301807+0000","last_clean":"2024-04-26T10:21:09.301807+0000","last_became_active":"2024-04-26T10:21:08.936809+0000","last_became_peered":"2024-04-26T10:21:08.936809+0000","last_unstale":"2024-04-26T10:21:09.301807+0000","last_undegraded":"2024-04-26T10:21:09.301807+0000","last_fullsized":"2024-04-26T10:21:09.301807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:17.212235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302338+0000","last_change":"2024-04-26T10:21:09.312054+0000","last_active":"2024-04-26T10:21:10.302338+0000","last_peered":"2024-04-26T10:21:10.302338+0000","last_clean":"2024-04-26T10:21:10.302338+0000","last_became_active":"2024-04-26T10:21:09.310818+0000","last_became_peered":"2024-04-26T10:21:09.310818+0000","last_unstale":"2024-04-26T10:21:10.302338+0000","last_undegraded":"2024-04-26T10:21:10.302338+0000","last_fullsized":"2024-04-26T10:21:10.302338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:03.431355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301359+0000","last_change":"2024-04-26T10:21:08.937445+0000","last_active":"2024-04-26T10:21:09.301359+0000","last_peered":"2024-04-26T10:21:09.301359+0000","last_clean":"2024-04-26T10:21:09.301359+0000","last_became_active":"2024-04-26T10:21:08.937147+0000","last_became_peered":"2024-04-26T10:21:08.937147+0000","last_unstale":"2024-04-26T10:21:09.301359+0000","last_undegraded":"2024-04-26T10:21:09.301359+0000","last_fullsized":"2024-04-26T10:21:09.301359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:29.602825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302232+0000","last_change":"2024-04-26T10:21:09.318091+0000","last_active":"2024-04-26T10:21:10.302232+0000","last_peered":"2024-04-26T10:21:10.302232+0000","last_clean":"2024-04-26T10:21:10.302232+0000","last_became_active":"2024-04-26T10:21:09.317871+0000","last_became_peered":"2024-04-26T10:21:09.317871+0000","last_unstale":"2024-04-26T10:21:10.302232+0000","last_undegraded":"2024-04-26T10:21:10.302232+0000","last_fullsized":"2024-04-26T10:21:10.302232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:32.442915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303867+0000","last_change":"2024-04-26T10:21:09.312636+0000","last_active":"2024-04-26T10:21:10.303867+0000","last_peered":"2024-04-26T10:21:10.303867+0000","last_clean":"2024-04-26T10:21:10.303867+0000","last_became_active":"2024-04-26T10:21:09.312130+0000","last_became_peered":"2024-04-26T10:21:09.312130+0000","last_unstale":"2024-04-26T10:21:10.303867+0000","last_undegraded":"2024-04-26T10:21:10.303867+0000","last_fullsized":"2024-04-26T10:21:10.303867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:29.565507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298243+0000","last_change":"2024-04-26T10:21:08.934046+0000","last_active":"2024-04-26T10:21:09.298243+0000","last_peered":"2024-04-26T10:21:09.298243+0000","last_clean":"2024-04-26T10:21:09.298243+0000","last_became_active":"2024-04-26T10:21:08.933341+0000","last_became_peered":"2024-04-26T10:21:08.933341+0000","last_unstale":"2024-04-26T10:21:09.298243+0000","last_undegraded":"2024-04-26T10:21:09.298243+0000","last_fullsized":"2024-04-26T10:21:09.298243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:45.671865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303860+0000","last_change":"2024-04-26T10:21:09.312081+0000","last_active":"2024-04-26T10:21:10.303860+0000","last_peered":"2024-04-26T10:21:10.303860+0000","last_clean":"2024-04-26T10:21:10.303860+0000","last_became_active":"2024-04-26T10:21:09.310879+0000","last_became_peered":"2024-04-26T10:21:09.310879+0000","last_unstale":"2024-04-26T10:21:10.303860+0000","last_undegraded":"2024-04-26T10:21:10.303860+0000","last_fullsized":"2024-04-26T10:21:10.303860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:36.358962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295619+0000","last_change":"2024-04-26T10:21:08.936748+0000","last_active":"2024-04-26T10:21:09.295619+0000","last_peered":"2024-04-26T10:21:09.295619+0000","last_clean":"2024-04-26T10:21:09.295619+0000","last_became_active":"2024-04-26T10:21:08.936316+0000","last_became_peered":"2024-04-26T10:21:08.936316+0000","last_unstale":"2024-04-26T10:21:09.295619+0000","last_undegraded":"2024-04-26T10:21:09.295619+0000","last_fullsized":"2024-04-26T10:21:09.295619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:47.721288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303753+0000","last_change":"2024-04-26T10:21:09.320062+0000","last_active":"2024-04-26T10:21:10.303753+0000","last_peered":"2024-04-26T10:21:10.303753+0000","last_clean":"2024-04-26T10:21:10.303753+0000","last_became_active":"2024-04-26T10:21:09.319352+0000","last_became_peered":"2024-04-26T10:21:09.319352+0000","last_unstale":"2024-04-26T10:21:10.303753+0000","last_undegraded":"2024-04-26T10:21:10.303753+0000","last_fullsized":"2024-04-26T10:21:10.303753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.998466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316248+0000","last_change":"2024-04-26T10:21:08.931356+0000","last_active":"2024-04-26T10:21:09.316248+0000","last_peered":"2024-04-26T10:21:09.316248+0000","last_clean":"2024-04-26T10:21:09.316248+0000","last_became_active":"2024-04-26T10:21:08.930016+0000","last_became_peered":"2024-04-26T10:21:08.930016+0000","last_unstale":"2024-04-26T10:21:09.316248+0000","last_undegraded":"2024-04-26T10:21:09.316248+0000","last_fullsized":"2024-04-26T10:21:09.316248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:21.306576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303057+0000","last_change":"2024-04-26T10:21:09.318178+0000","last_active":"2024-04-26T10:21:10.303057+0000","last_peered":"2024-04-26T10:21:10.303057+0000","last_clean":"2024-04-26T10:21:10.303057+0000","last_became_active":"2024-04-26T10:21:09.317697+0000","last_became_peered":"2024-04-26T10:21:09.317697+0000","last_unstale":"2024-04-26T10:21:10.303057+0000","last_undegraded":"2024-04-26T10:21:10.303057+0000","last_fullsized":"2024-04-26T10:21:10.303057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:46.285390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320054+0000","last_change":"2024-04-26T10:21:08.936115+0000","last_active":"2024-04-26T10:21:09.320054+0000","last_peered":"2024-04-26T10:21:09.320054+0000","last_clean":"2024-04-26T10:21:09.320054+0000","last_became_active":"2024-04-26T10:21:08.935740+0000","last_became_peered":"2024-04-26T10:21:08.935740+0000","last_unstale":"2024-04-26T10:21:09.320054+0000","last_undegraded":"2024-04-26T10:21:09.320054+0000","last_fullsized":"2024-04-26T10:21:09.320054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:08.369059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742450+0000","last_change":"2024-04-26T10:21:09.308077+0000","last_active":"2024-04-26T10:21:10.742450+0000","last_peered":"2024-04-26T10:21:10.742450+0000","last_clean":"2024-04-26T10:21:10.742450+0000","last_became_active":"2024-04-26T10:21:09.307543+0000","last_became_peered":"2024-04-26T10:21:09.307543+0000","last_unstale":"2024-04-26T10:21:10.742450+0000","last_undegraded":"2024-04-26T10:21:10.742450+0000","last_fullsized":"2024-04-26T10:21:10.742450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:46.596591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316572+0000","last_change":"2024-04-26T10:21:08.938933+0000","last_active":"2024-04-26T10:21:09.316572+0000","last_peered":"2024-04-26T10:21:09.316572+0000","last_clean":"2024-04-26T10:21:09.316572+0000","last_became_active":"2024-04-26T10:21:08.938281+0000","last_became_peered":"2024-04-26T10:21:08.938281+0000","last_unstale":"2024-04-26T10:21:09.316572+0000","last_undegraded":"2024-04-26T10:21:09.316572+0000","last_fullsized":"2024-04-26T10:21:09.316572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:50.856581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743973+0000","last_change":"2024-04-26T10:21:09.315331+0000","last_active":"2024-04-26T10:21:10.743973+0000","last_peered":"2024-04-26T10:21:10.743973+0000","last_clean":"2024-04-26T10:21:10.743973+0000","last_became_active":"2024-04-26T10:21:09.314523+0000","last_became_peered":"2024-04-26T10:21:09.314523+0000","last_unstale":"2024-04-26T10:21:10.743973+0000","last_undegraded":"2024-04-26T10:21:10.743973+0000","last_fullsized":"2024-04-26T10:21:10.743973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:24.624358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320722+0000","last_change":"2024-04-26T10:21:08.936791+0000","last_active":"2024-04-26T10:21:09.320722+0000","last_peered":"2024-04-26T10:21:09.320722+0000","last_clean":"2024-04-26T10:21:09.320722+0000","last_became_active":"2024-04-26T10:21:08.936469+0000","last_became_peered":"2024-04-26T10:21:08.936469+0000","last_unstale":"2024-04-26T10:21:09.320722+0000","last_undegraded":"2024-04-26T10:21:09.320722+0000","last_fullsized":"2024-04-26T10:21:09.320722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:14.145721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302806+0000","last_change":"2024-04-26T10:21:09.315299+0000","last_active":"2024-04-26T10:21:10.302806+0000","last_peered":"2024-04-26T10:21:10.302806+0000","last_clean":"2024-04-26T10:21:10.302806+0000","last_became_active":"2024-04-26T10:21:09.314896+0000","last_became_peered":"2024-04-26T10:21:09.314896+0000","last_unstale":"2024-04-26T10:21:10.302806+0000","last_undegraded":"2024-04-26T10:21:10.302806+0000","last_fullsized":"2024-04-26T10:21:10.302806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.174824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316992+0000","last_change":"2024-04-26T10:21:08.933424+0000","last_active":"2024-04-26T10:21:09.316992+0000","last_peered":"2024-04-26T10:21:09.316992+0000","last_clean":"2024-04-26T10:21:09.316992+0000","last_became_active":"2024-04-26T10:21:08.933088+0000","last_became_peered":"2024-04-26T10:21:08.933088+0000","last_unstale":"2024-04-26T10:21:09.316992+0000","last_undegraded":"2024-04-26T10:21:09.316992+0000","last_fullsized":"2024-04-26T10:21:09.316992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:55.394913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742760+0000","last_change":"2024-04-26T10:21:09.308831+0000","last_active":"2024-04-26T10:21:10.742760+0000","last_peered":"2024-04-26T10:21:10.742760+0000","last_clean":"2024-04-26T10:21:10.742760+0000","last_became_active":"2024-04-26T10:21:09.308457+0000","last_became_peered":"2024-04-26T10:21:09.308457+0000","last_unstale":"2024-04-26T10:21:10.742760+0000","last_undegraded":"2024-04-26T10:21:10.742760+0000","last_fullsized":"2024-04-26T10:21:10.742760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:43.137127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.314230+0000","last_change":"2024-04-26T10:21:08.937023+0000","last_active":"2024-04-26T10:21:09.314230+0000","last_peered":"2024-04-26T10:21:09.314230+0000","last_clean":"2024-04-26T10:21:09.314230+0000","last_became_active":"2024-04-26T10:21:08.936511+0000","last_became_peered":"2024-04-26T10:21:08.936511+0000","last_unstale":"2024-04-26T10:21:09.314230+0000","last_undegraded":"2024-04-26T10:21:09.314230+0000","last_fullsized":"2024-04-26T10:21:09.314230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:38.881531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":653928,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":0,"up_from":10,"seq":42949672965,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":270336,"data_stored":654544,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":188416,"data_stored":62430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:21:18.050 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-26T10:21:18.050 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-26T10:21:18.051 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-26T10:21:18.051 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-26T10:21:18.051 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-26T10:21:18.412 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:18.428 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":5,"flags":0,"active_gid":4112,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6800","nonce":17092},{"type":"v1","addr":"172.21.15.52:6801","nonce":17092}]},"active_addr":"172.21.15.52:6801/17092","active_change":"2024-04-26T10:20:53.924379+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4099,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":1848067206}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":161330574}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":2401075361}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.52:0","nonce":564629821}]}]} 2024-04-26T10:21:18.432 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-26T10:21:18.432 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T10:21:18.433 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:21:18.736 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:18.736 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","created":"2024-04-26T10:20:48.363934+0000","modified":"2024-04-26T10:21:10.288209+0000","last_up_change":"2024-04-26T10:20:58.098141+0000","last_in_change":"2024-04-26T10:20:49.575442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:20:59.994755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:21:03.866927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:21:07.853429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:21:08.285131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5e76c47-dfc4-40ca-88d3-2084cac6e35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":18193},{"type":"v1","addr":"172.21.15.120:6801","nonce":18193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":18193},{"type":"v1","addr":"172.21.15.120:6803","nonce":18193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":18193},{"type":"v1","addr":"172.21.15.120:6807","nonce":18193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":18193},{"type":"v1","addr":"172.21.15.120:6805","nonce":18193}]},"public_addr":"172.21.15.120:6801/18193","cluster_addr":"172.21.15.120:6803/18193","heartbeat_back_addr":"172.21.15.120:6807/18193","heartbeat_front_addr":"172.21.15.120:6805/18193","state":["exists","up"]},{"osd":1,"uuid":"2a8d530c-cf33-4540-9240-6bd7485e06ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":18226},{"type":"v1","addr":"172.21.15.154:6801","nonce":18226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":18226},{"type":"v1","addr":"172.21.15.154:6803","nonce":18226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":18226},{"type":"v1","addr":"172.21.15.154:6807","nonce":18226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":18226},{"type":"v1","addr":"172.21.15.154:6805","nonce":18226}]},"public_addr":"172.21.15.154:6801/18226","cluster_addr":"172.21.15.154:6803/18226","heartbeat_back_addr":"172.21.15.154:6807/18226","heartbeat_front_addr":"172.21.15.154:6805/18226","state":["exists","up"]},{"osd":2,"uuid":"484ab70f-4cad-4ff6-9405-8865ec5ee327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":18269},{"type":"v1","addr":"172.21.15.164:6801","nonce":18269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":18269},{"type":"v1","addr":"172.21.15.164:6803","nonce":18269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":18269},{"type":"v1","addr":"172.21.15.164:6807","nonce":18269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":18269},{"type":"v1","addr":"172.21.15.164:6805","nonce":18269}]},"public_addr":"172.21.15.164:6801/18269","cluster_addr":"172.21.15.164:6803/18269","heartbeat_back_addr":"172.21.15.164:6807/18269","heartbeat_front_addr":"172.21.15.164:6805/18269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.871567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.910527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.761919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:21:18.751 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T10:21:18.751 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:21:19.052 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:19.053 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","created":"2024-04-26T10:20:48.363934+0000","modified":"2024-04-26T10:21:10.288209+0000","last_up_change":"2024-04-26T10:20:58.098141+0000","last_in_change":"2024-04-26T10:20:49.575442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:20:59.994755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:21:03.866927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:21:07.853429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:21:08.285131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5e76c47-dfc4-40ca-88d3-2084cac6e35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":18193},{"type":"v1","addr":"172.21.15.120:6801","nonce":18193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":18193},{"type":"v1","addr":"172.21.15.120:6803","nonce":18193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":18193},{"type":"v1","addr":"172.21.15.120:6807","nonce":18193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":18193},{"type":"v1","addr":"172.21.15.120:6805","nonce":18193}]},"public_addr":"172.21.15.120:6801/18193","cluster_addr":"172.21.15.120:6803/18193","heartbeat_back_addr":"172.21.15.120:6807/18193","heartbeat_front_addr":"172.21.15.120:6805/18193","state":["exists","up"]},{"osd":1,"uuid":"2a8d530c-cf33-4540-9240-6bd7485e06ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":18226},{"type":"v1","addr":"172.21.15.154:6801","nonce":18226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":18226},{"type":"v1","addr":"172.21.15.154:6803","nonce":18226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":18226},{"type":"v1","addr":"172.21.15.154:6807","nonce":18226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":18226},{"type":"v1","addr":"172.21.15.154:6805","nonce":18226}]},"public_addr":"172.21.15.154:6801/18226","cluster_addr":"172.21.15.154:6803/18226","heartbeat_back_addr":"172.21.15.154:6807/18226","heartbeat_front_addr":"172.21.15.154:6805/18226","state":["exists","up"]},{"osd":2,"uuid":"484ab70f-4cad-4ff6-9405-8865ec5ee327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":18269},{"type":"v1","addr":"172.21.15.164:6801","nonce":18269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":18269},{"type":"v1","addr":"172.21.15.164:6803","nonce":18269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":18269},{"type":"v1","addr":"172.21.15.164:6807","nonce":18269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":18269},{"type":"v1","addr":"172.21.15.164:6805","nonce":18269}]},"public_addr":"172.21.15.164:6801/18269","cluster_addr":"172.21.15.164:6803/18269","heartbeat_back_addr":"172.21.15.164:6807/18269","heartbeat_front_addr":"172.21.15.164:6805/18269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.871567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.910527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.761919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:21:19.073 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T10:21:19.074 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T10:21:19.074 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T10:21:19.224 INFO:teuthology.orchestra.run.smithi052.stdout:38654705673 2024-04-26T10:21:19.224 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T10:21:19.225 INFO:teuthology.orchestra.run.smithi052.stdout:42949672967 2024-04-26T10:21:19.226 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T10:21:19.227 INFO:teuthology.orchestra.run.smithi052.stdout:42949672968 2024-04-26T10:21:19.227 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T10:21:19.512 INFO:teuthology.orchestra.run.smithi052.stdout:42949672965 2024-04-26T10:21:19.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672967 got 42949672965 for osd.0 2024-04-26T10:21:19.527 INFO:teuthology.orchestra.run.smithi052.stdout:38654705671 2024-04-26T10:21:19.540 INFO:teuthology.orchestra.run.smithi052.stdout:42949672966 2024-04-26T10:21:19.542 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705673 got 38654705671 for osd.2 2024-04-26T10:21:19.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672966 for osd.1 2024-04-26T10:21:20.528 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T10:21:20.542 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T10:21:20.555 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T10:21:20.837 INFO:teuthology.orchestra.run.smithi052.stdout:42949672967 2024-04-26T10:21:20.855 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672967 got 42949672967 for osd.0 2024-04-26T10:21:20.855 DEBUG:teuthology.parallel:result is None 2024-04-26T10:21:20.869 INFO:teuthology.orchestra.run.smithi052.stdout:42949672968 2024-04-26T10:21:20.871 INFO:teuthology.orchestra.run.smithi052.stdout:38654705673 2024-04-26T10:21:20.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672968 for osd.1 2024-04-26T10:21:20.884 DEBUG:teuthology.parallel:result is None 2024-04-26T10:21:20.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705673 got 38654705673 for osd.2 2024-04-26T10:21:20.886 DEBUG:teuthology.parallel:result is None 2024-04-26T10:21:20.886 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T10:21:20.886 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:21:21.200 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:21.203 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:21:21.214 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-04-26T10:21:19.939531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94064,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021456,"statfs":{"total":289910292480,"available":289813970944,"internally_reserved":0,"allocated":720896,"data_stored":1370902,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003075"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303606+0000","last_change":"2024-04-26T10:21:09.316096+0000","last_active":"2024-04-26T10:21:10.303606+0000","last_peered":"2024-04-26T10:21:10.303606+0000","last_clean":"2024-04-26T10:21:10.303606+0000","last_became_active":"2024-04-26T10:21:09.315498+0000","last_became_peered":"2024-04-26T10:21:09.315498+0000","last_unstale":"2024-04-26T10:21:10.303606+0000","last_undegraded":"2024-04-26T10:21:10.303606+0000","last_fullsized":"2024-04-26T10:21:10.303606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:14.245434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304046+0000","last_change":"2024-04-26T10:21:09.317241+0000","last_active":"2024-04-26T10:21:10.304046+0000","last_peered":"2024-04-26T10:21:10.304046+0000","last_clean":"2024-04-26T10:21:10.304046+0000","last_became_active":"2024-04-26T10:21:09.316532+0000","last_became_peered":"2024-04-26T10:21:09.316532+0000","last_unstale":"2024-04-26T10:21:10.304046+0000","last_undegraded":"2024-04-26T10:21:10.304046+0000","last_fullsized":"2024-04-26T10:21:10.304046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:00.173638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743004+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:21:10.743004+0000","last_peered":"2024-04-26T10:21:10.743004+0000","last_clean":"2024-04-26T10:21:10.743004+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:21:10.743004+0000","last_undegraded":"2024-04-26T10:21:10.743004+0000","last_fullsized":"2024-04-26T10:21:10.743004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:01.883964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742576+0000","last_change":"2024-04-26T10:21:09.306531+0000","last_active":"2024-04-26T10:21:10.742576+0000","last_peered":"2024-04-26T10:21:10.742576+0000","last_clean":"2024-04-26T10:21:10.742576+0000","last_became_active":"2024-04-26T10:21:09.304885+0000","last_became_peered":"2024-04-26T10:21:09.304885+0000","last_unstale":"2024-04-26T10:21:10.742576+0000","last_undegraded":"2024-04-26T10:21:10.742576+0000","last_fullsized":"2024-04-26T10:21:10.742576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:04.179516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302949+0000","last_change":"2024-04-26T10:21:09.310914+0000","last_active":"2024-04-26T10:21:10.302949+0000","last_peered":"2024-04-26T10:21:10.302949+0000","last_clean":"2024-04-26T10:21:10.302949+0000","last_became_active":"2024-04-26T10:21:09.309981+0000","last_became_peered":"2024-04-26T10:21:09.309981+0000","last_unstale":"2024-04-26T10:21:10.302949+0000","last_undegraded":"2024-04-26T10:21:10.302949+0000","last_fullsized":"2024-04-26T10:21:10.302949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:04.926251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743427+0000","last_change":"2024-04-26T10:21:09.305198+0000","last_active":"2024-04-26T10:21:10.743427+0000","last_peered":"2024-04-26T10:21:10.743427+0000","last_clean":"2024-04-26T10:21:10.743427+0000","last_became_active":"2024-04-26T10:21:09.304716+0000","last_became_peered":"2024-04-26T10:21:09.304716+0000","last_unstale":"2024-04-26T10:21:10.743427+0000","last_undegraded":"2024-04-26T10:21:10.743427+0000","last_fullsized":"2024-04-26T10:21:10.743427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:11.224015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742177+0000","last_change":"2024-04-26T10:21:09.307188+0000","last_active":"2024-04-26T10:21:10.742177+0000","last_peered":"2024-04-26T10:21:10.742177+0000","last_clean":"2024-04-26T10:21:10.742177+0000","last_became_active":"2024-04-26T10:21:09.306548+0000","last_became_peered":"2024-04-26T10:21:09.306548+0000","last_unstale":"2024-04-26T10:21:10.742177+0000","last_undegraded":"2024-04-26T10:21:10.742177+0000","last_fullsized":"2024-04-26T10:21:10.742177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:29.565507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741718+0000","last_change":"2024-04-26T10:21:09.308284+0000","last_active":"2024-04-26T10:21:10.741718+0000","last_peered":"2024-04-26T10:21:10.741718+0000","last_clean":"2024-04-26T10:21:10.741718+0000","last_became_active":"2024-04-26T10:21:09.307504+0000","last_became_peered":"2024-04-26T10:21:09.307504+0000","last_unstale":"2024-04-26T10:21:10.741718+0000","last_undegraded":"2024-04-26T10:21:10.741718+0000","last_fullsized":"2024-04-26T10:21:10.741718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:51.549222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303844+0000","last_change":"2024-04-26T10:21:09.314160+0000","last_active":"2024-04-26T10:21:10.303844+0000","last_peered":"2024-04-26T10:21:10.303844+0000","last_clean":"2024-04-26T10:21:10.303844+0000","last_became_active":"2024-04-26T10:21:09.313221+0000","last_became_peered":"2024-04-26T10:21:09.313221+0000","last_unstale":"2024-04-26T10:21:10.303844+0000","last_undegraded":"2024-04-26T10:21:10.303844+0000","last_fullsized":"2024-04-26T10:21:10.303844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:50.157094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304095+0000","last_change":"2024-04-26T10:21:09.315304+0000","last_active":"2024-04-26T10:21:10.304095+0000","last_peered":"2024-04-26T10:21:10.304095+0000","last_clean":"2024-04-26T10:21:10.304095+0000","last_became_active":"2024-04-26T10:21:09.314619+0000","last_became_peered":"2024-04-26T10:21:09.314619+0000","last_unstale":"2024-04-26T10:21:10.304095+0000","last_undegraded":"2024-04-26T10:21:10.304095+0000","last_fullsized":"2024-04-26T10:21:10.304095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:41.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743482+0000","last_change":"2024-04-26T10:21:09.307173+0000","last_active":"2024-04-26T10:21:10.743482+0000","last_peered":"2024-04-26T10:21:10.743482+0000","last_clean":"2024-04-26T10:21:10.743482+0000","last_became_active":"2024-04-26T10:21:09.306523+0000","last_became_peered":"2024-04-26T10:21:09.306523+0000","last_unstale":"2024-04-26T10:21:10.743482+0000","last_undegraded":"2024-04-26T10:21:10.743482+0000","last_fullsized":"2024-04-26T10:21:10.743482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:15.102637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302828+0000","last_change":"2024-04-26T10:21:09.319057+0000","last_active":"2024-04-26T10:21:10.302828+0000","last_peered":"2024-04-26T10:21:10.302828+0000","last_clean":"2024-04-26T10:21:10.302828+0000","last_became_active":"2024-04-26T10:21:09.318580+0000","last_became_peered":"2024-04-26T10:21:09.318580+0000","last_unstale":"2024-04-26T10:21:10.302828+0000","last_undegraded":"2024-04-26T10:21:10.302828+0000","last_fullsized":"2024-04-26T10:21:10.302828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.335327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302635+0000","last_change":"2024-04-26T10:21:09.310332+0000","last_active":"2024-04-26T10:21:10.302635+0000","last_peered":"2024-04-26T10:21:10.302635+0000","last_clean":"2024-04-26T10:21:10.302635+0000","last_became_active":"2024-04-26T10:21:09.309534+0000","last_became_peered":"2024-04-26T10:21:09.309534+0000","last_unstale":"2024-04-26T10:21:10.302635+0000","last_undegraded":"2024-04-26T10:21:10.302635+0000","last_fullsized":"2024-04-26T10:21:10.302635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:01.594353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742954+0000","last_change":"2024-04-26T10:21:09.316821+0000","last_active":"2024-04-26T10:21:10.742954+0000","last_peered":"2024-04-26T10:21:10.742954+0000","last_clean":"2024-04-26T10:21:10.742954+0000","last_became_active":"2024-04-26T10:21:09.316143+0000","last_became_peered":"2024-04-26T10:21:09.316143+0000","last_unstale":"2024-04-26T10:21:10.742954+0000","last_undegraded":"2024-04-26T10:21:10.742954+0000","last_fullsized":"2024-04-26T10:21:10.742954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:20.271378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742238+0000","last_change":"2024-04-26T10:21:09.314710+0000","last_active":"2024-04-26T10:21:10.742238+0000","last_peered":"2024-04-26T10:21:10.742238+0000","last_clean":"2024-04-26T10:21:10.742238+0000","last_became_active":"2024-04-26T10:21:09.314401+0000","last_became_peered":"2024-04-26T10:21:09.314401+0000","last_unstale":"2024-04-26T10:21:10.742238+0000","last_undegraded":"2024-04-26T10:21:10.742238+0000","last_fullsized":"2024-04-26T10:21:10.742238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:14.245434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741766+0000","last_change":"2024-04-26T10:21:09.306575+0000","last_active":"2024-04-26T10:21:10.741766+0000","last_peered":"2024-04-26T10:21:10.741766+0000","last_clean":"2024-04-26T10:21:10.741766+0000","last_became_active":"2024-04-26T10:21:09.305009+0000","last_became_peered":"2024-04-26T10:21:09.305009+0000","last_unstale":"2024-04-26T10:21:10.741766+0000","last_undegraded":"2024-04-26T10:21:10.741766+0000","last_fullsized":"2024-04-26T10:21:10.741766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:42.965427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304549+0000","last_change":"2024-04-26T10:21:09.317530+0000","last_active":"2024-04-26T10:21:10.304549+0000","last_peered":"2024-04-26T10:21:10.304549+0000","last_clean":"2024-04-26T10:21:10.304549+0000","last_became_active":"2024-04-26T10:21:09.316956+0000","last_became_peered":"2024-04-26T10:21:09.316956+0000","last_unstale":"2024-04-26T10:21:10.304549+0000","last_undegraded":"2024-04-26T10:21:10.304549+0000","last_fullsized":"2024-04-26T10:21:10.304549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:05.112877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304348+0000","last_change":"2024-04-26T10:21:09.316152+0000","last_active":"2024-04-26T10:21:10.304348+0000","last_peered":"2024-04-26T10:21:10.304348+0000","last_clean":"2024-04-26T10:21:10.304348+0000","last_became_active":"2024-04-26T10:21:09.315441+0000","last_became_peered":"2024-04-26T10:21:09.315441+0000","last_unstale":"2024-04-26T10:21:10.304348+0000","last_undegraded":"2024-04-26T10:21:10.304348+0000","last_fullsized":"2024-04-26T10:21:10.304348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:42.904467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303452+0000","last_change":"2024-04-26T10:21:09.316805+0000","last_active":"2024-04-26T10:21:10.303452+0000","last_peered":"2024-04-26T10:21:10.303452+0000","last_clean":"2024-04-26T10:21:10.303452+0000","last_became_active":"2024-04-26T10:21:09.316490+0000","last_became_peered":"2024-04-26T10:21:09.316490+0000","last_unstale":"2024-04-26T10:21:10.303452+0000","last_undegraded":"2024-04-26T10:21:10.303452+0000","last_fullsized":"2024-04-26T10:21:10.303452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:11.814183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742675+0000","last_change":"2024-04-26T10:21:09.314189+0000","last_active":"2024-04-26T10:21:10.742675+0000","last_peered":"2024-04-26T10:21:10.742675+0000","last_clean":"2024-04-26T10:21:10.742675+0000","last_became_active":"2024-04-26T10:21:09.313648+0000","last_became_peered":"2024-04-26T10:21:09.313648+0000","last_unstale":"2024-04-26T10:21:10.742675+0000","last_undegraded":"2024-04-26T10:21:10.742675+0000","last_fullsized":"2024-04-26T10:21:10.742675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:57.658133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743475+0000","last_change":"2024-04-26T10:21:09.316594+0000","last_active":"2024-04-26T10:21:10.743475+0000","last_peered":"2024-04-26T10:21:10.743475+0000","last_clean":"2024-04-26T10:21:10.743475+0000","last_became_active":"2024-04-26T10:21:09.315877+0000","last_became_peered":"2024-04-26T10:21:09.315877+0000","last_unstale":"2024-04-26T10:21:10.743475+0000","last_undegraded":"2024-04-26T10:21:10.743475+0000","last_fullsized":"2024-04-26T10:21:10.743475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:19.943321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302427+0000","last_change":"2024-04-26T10:21:09.318829+0000","last_active":"2024-04-26T10:21:10.302427+0000","last_peered":"2024-04-26T10:21:10.302427+0000","last_clean":"2024-04-26T10:21:10.302427+0000","last_became_active":"2024-04-26T10:21:09.318379+0000","last_became_peered":"2024-04-26T10:21:09.318379+0000","last_unstale":"2024-04-26T10:21:10.302427+0000","last_undegraded":"2024-04-26T10:21:10.302427+0000","last_fullsized":"2024-04-26T10:21:10.302427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:11.224015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302100+0000","last_change":"2024-04-26T10:21:09.309068+0000","last_active":"2024-04-26T10:21:10.302100+0000","last_peered":"2024-04-26T10:21:10.302100+0000","last_clean":"2024-04-26T10:21:10.302100+0000","last_became_active":"2024-04-26T10:21:09.308797+0000","last_became_peered":"2024-04-26T10:21:09.308797+0000","last_unstale":"2024-04-26T10:21:10.302100+0000","last_undegraded":"2024-04-26T10:21:10.302100+0000","last_fullsized":"2024-04-26T10:21:10.302100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:44.761759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.301914+0000","last_change":"2024-04-26T10:21:09.311574+0000","last_active":"2024-04-26T10:21:10.301914+0000","last_peered":"2024-04-26T10:21:10.301914+0000","last_clean":"2024-04-26T10:21:10.301914+0000","last_became_active":"2024-04-26T10:21:09.309285+0000","last_became_peered":"2024-04-26T10:21:09.309285+0000","last_unstale":"2024-04-26T10:21:10.301914+0000","last_undegraded":"2024-04-26T10:21:10.301914+0000","last_fullsized":"2024-04-26T10:21:10.301914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:06.884098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303605+0000","last_change":"2024-04-26T10:21:09.317948+0000","last_active":"2024-04-26T10:21:10.303605+0000","last_peered":"2024-04-26T10:21:10.303605+0000","last_clean":"2024-04-26T10:21:10.303605+0000","last_became_active":"2024-04-26T10:21:09.317571+0000","last_became_peered":"2024-04-26T10:21:09.317571+0000","last_unstale":"2024-04-26T10:21:10.303605+0000","last_undegraded":"2024-04-26T10:21:10.303605+0000","last_fullsized":"2024-04-26T10:21:10.303605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:04.179516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304130+0000","last_change":"2024-04-26T10:21:09.312839+0000","last_active":"2024-04-26T10:21:10.304130+0000","last_peered":"2024-04-26T10:21:10.304130+0000","last_clean":"2024-04-26T10:21:10.304130+0000","last_became_active":"2024-04-26T10:21:09.311898+0000","last_became_peered":"2024-04-26T10:21:09.311898+0000","last_unstale":"2024-04-26T10:21:10.304130+0000","last_undegraded":"2024-04-26T10:21:10.304130+0000","last_fullsized":"2024-04-26T10:21:10.304130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:03.705171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743873+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:21:10.743873+0000","last_peered":"2024-04-26T10:21:10.743873+0000","last_clean":"2024-04-26T10:21:10.743873+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:21:10.743873+0000","last_undegraded":"2024-04-26T10:21:10.743873+0000","last_fullsized":"2024-04-26T10:21:10.743873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:39.394937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303372+0000","last_change":"2024-04-26T10:21:09.312446+0000","last_active":"2024-04-26T10:21:10.303372+0000","last_peered":"2024-04-26T10:21:10.303372+0000","last_clean":"2024-04-26T10:21:10.303372+0000","last_became_active":"2024-04-26T10:21:09.311919+0000","last_became_peered":"2024-04-26T10:21:09.311919+0000","last_unstale":"2024-04-26T10:21:10.303372+0000","last_undegraded":"2024-04-26T10:21:10.303372+0000","last_fullsized":"2024-04-26T10:21:10.303372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:57.658133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303274+0000","last_change":"2024-04-26T10:21:09.316871+0000","last_active":"2024-04-26T10:21:10.303274+0000","last_peered":"2024-04-26T10:21:10.303274+0000","last_clean":"2024-04-26T10:21:10.303274+0000","last_became_active":"2024-04-26T10:21:09.316529+0000","last_became_peered":"2024-04-26T10:21:09.316529+0000","last_unstale":"2024-04-26T10:21:10.303274+0000","last_undegraded":"2024-04-26T10:21:10.303274+0000","last_fullsized":"2024-04-26T10:21:10.303274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:52.614699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303836+0000","last_change":"2024-04-26T10:21:09.313160+0000","last_active":"2024-04-26T10:21:10.303836+0000","last_peered":"2024-04-26T10:21:10.303836+0000","last_clean":"2024-04-26T10:21:10.303836+0000","last_became_active":"2024-04-26T10:21:09.312556+0000","last_became_peered":"2024-04-26T10:21:09.312556+0000","last_unstale":"2024-04-26T10:21:10.303836+0000","last_undegraded":"2024-04-26T10:21:10.303836+0000","last_fullsized":"2024-04-26T10:21:10.303836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:21.698558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302244+0000","last_change":"2024-04-26T10:21:09.314165+0000","last_active":"2024-04-26T10:21:10.302244+0000","last_peered":"2024-04-26T10:21:10.302244+0000","last_clean":"2024-04-26T10:21:10.302244+0000","last_became_active":"2024-04-26T10:21:09.313559+0000","last_became_peered":"2024-04-26T10:21:09.313559+0000","last_unstale":"2024-04-26T10:21:10.302244+0000","last_undegraded":"2024-04-26T10:21:10.302244+0000","last_fullsized":"2024-04-26T10:21:10.302244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:05.857831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741968+0000","last_change":"2024-04-26T10:21:09.309366+0000","last_active":"2024-04-26T10:21:10.741968+0000","last_peered":"2024-04-26T10:21:10.741968+0000","last_clean":"2024-04-26T10:21:10.741968+0000","last_became_active":"2024-04-26T10:21:09.308660+0000","last_became_peered":"2024-04-26T10:21:09.308660+0000","last_unstale":"2024-04-26T10:21:10.741968+0000","last_undegraded":"2024-04-26T10:21:10.741968+0000","last_fullsized":"2024-04-26T10:21:10.741968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.335327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303113+0000","last_change":"2024-04-26T10:21:09.317455+0000","last_active":"2024-04-26T10:21:10.303113+0000","last_peered":"2024-04-26T10:21:10.303113+0000","last_clean":"2024-04-26T10:21:10.303113+0000","last_became_active":"2024-04-26T10:21:09.316994+0000","last_became_peered":"2024-04-26T10:21:09.316994+0000","last_unstale":"2024-04-26T10:21:10.303113+0000","last_undegraded":"2024-04-26T10:21:10.303113+0000","last_fullsized":"2024-04-26T10:21:10.303113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:48.942276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.317124+0000","last_change":"2024-04-26T10:21:08.939370+0000","last_active":"2024-04-26T10:21:09.317124+0000","last_peered":"2024-04-26T10:21:09.317124+0000","last_clean":"2024-04-26T10:21:09.317124+0000","last_became_active":"2024-04-26T10:21:08.937845+0000","last_became_peered":"2024-04-26T10:21:08.937845+0000","last_unstale":"2024-04-26T10:21:09.317124+0000","last_undegraded":"2024-04-26T10:21:09.317124+0000","last_fullsized":"2024-04-26T10:21:09.317124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:28.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304041+0000","last_change":"2024-04-26T10:21:09.316515+0000","last_active":"2024-04-26T10:21:10.304041+0000","last_peered":"2024-04-26T10:21:10.304041+0000","last_clean":"2024-04-26T10:21:10.304041+0000","last_became_active":"2024-04-26T10:21:09.315714+0000","last_became_peered":"2024-04-26T10:21:09.315714+0000","last_unstale":"2024-04-26T10:21:10.304041+0000","last_undegraded":"2024-04-26T10:21:10.304041+0000","last_fullsized":"2024-04-26T10:21:10.304041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.032760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296726+0000","last_change":"2024-04-26T10:21:08.937056+0000","last_active":"2024-04-26T10:21:09.296726+0000","last_peered":"2024-04-26T10:21:09.296726+0000","last_clean":"2024-04-26T10:21:09.296726+0000","last_became_active":"2024-04-26T10:21:08.936545+0000","last_became_peered":"2024-04-26T10:21:08.936545+0000","last_unstale":"2024-04-26T10:21:09.296726+0000","last_undegraded":"2024-04-26T10:21:09.296726+0000","last_fullsized":"2024-04-26T10:21:09.296726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:48.449203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304386+0000","last_change":"2024-04-26T10:21:09.313813+0000","last_active":"2024-04-26T10:21:10.304386+0000","last_peered":"2024-04-26T10:21:10.304386+0000","last_clean":"2024-04-26T10:21:10.304386+0000","last_became_active":"2024-04-26T10:21:09.312562+0000","last_became_peered":"2024-04-26T10:21:09.312562+0000","last_unstale":"2024-04-26T10:21:10.304386+0000","last_undegraded":"2024-04-26T10:21:10.304386+0000","last_fullsized":"2024-04-26T10:21:10.304386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:46.413942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309703+0000","last_change":"2024-04-26T10:21:08.936433+0000","last_active":"2024-04-26T10:21:09.309703+0000","last_peered":"2024-04-26T10:21:09.309703+0000","last_clean":"2024-04-26T10:21:09.309703+0000","last_became_active":"2024-04-26T10:21:08.935875+0000","last_became_peered":"2024-04-26T10:21:08.935875+0000","last_unstale":"2024-04-26T10:21:09.309703+0000","last_undegraded":"2024-04-26T10:21:09.309703+0000","last_fullsized":"2024-04-26T10:21:09.309703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:24.501204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303865+0000","last_change":"2024-04-26T10:21:09.314435+0000","last_active":"2024-04-26T10:21:10.303865+0000","last_peered":"2024-04-26T10:21:10.303865+0000","last_clean":"2024-04-26T10:21:10.303865+0000","last_became_active":"2024-04-26T10:21:09.313684+0000","last_became_peered":"2024-04-26T10:21:09.313684+0000","last_unstale":"2024-04-26T10:21:10.303865+0000","last_undegraded":"2024-04-26T10:21:10.303865+0000","last_fullsized":"2024-04-26T10:21:10.303865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:20.185980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.321258+0000","last_change":"2024-04-26T10:21:08.934971+0000","last_active":"2024-04-26T10:21:09.321258+0000","last_peered":"2024-04-26T10:21:09.321258+0000","last_clean":"2024-04-26T10:21:09.321258+0000","last_became_active":"2024-04-26T10:21:08.934653+0000","last_became_peered":"2024-04-26T10:21:08.934653+0000","last_unstale":"2024-04-26T10:21:09.321258+0000","last_undegraded":"2024-04-26T10:21:09.321258+0000","last_fullsized":"2024-04-26T10:21:09.321258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:18.272015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.315924+0000","last_change":"2024-04-26T10:21:08.934452+0000","last_active":"2024-04-26T10:21:09.315924+0000","last_peered":"2024-04-26T10:21:09.315924+0000","last_clean":"2024-04-26T10:21:09.315924+0000","last_became_active":"2024-04-26T10:21:08.934091+0000","last_became_peered":"2024-04-26T10:21:08.934091+0000","last_unstale":"2024-04-26T10:21:09.315924+0000","last_undegraded":"2024-04-26T10:21:09.315924+0000","last_fullsized":"2024-04-26T10:21:09.315924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:11.224989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.301898+0000","last_change":"2024-04-26T10:21:09.314631+0000","last_active":"2024-04-26T10:21:10.301898+0000","last_peered":"2024-04-26T10:21:10.301898+0000","last_clean":"2024-04-26T10:21:10.301898+0000","last_became_active":"2024-04-26T10:21:09.313044+0000","last_became_peered":"2024-04-26T10:21:09.313044+0000","last_unstale":"2024-04-26T10:21:10.301898+0000","last_undegraded":"2024-04-26T10:21:10.301898+0000","last_fullsized":"2024-04-26T10:21:10.301898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:19.943321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.319848+0000","last_change":"2024-04-26T10:21:08.935870+0000","last_active":"2024-04-26T10:21:09.319848+0000","last_peered":"2024-04-26T10:21:09.319848+0000","last_clean":"2024-04-26T10:21:09.319848+0000","last_became_active":"2024-04-26T10:21:08.935380+0000","last_became_peered":"2024-04-26T10:21:08.935380+0000","last_unstale":"2024-04-26T10:21:09.319848+0000","last_undegraded":"2024-04-26T10:21:09.319848+0000","last_fullsized":"2024-04-26T10:21:09.319848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:22.537149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302131+0000","last_change":"2024-04-26T10:21:09.317032+0000","last_active":"2024-04-26T10:21:10.302131+0000","last_peered":"2024-04-26T10:21:10.302131+0000","last_clean":"2024-04-26T10:21:10.302131+0000","last_became_active":"2024-04-26T10:21:09.316416+0000","last_became_peered":"2024-04-26T10:21:09.316416+0000","last_unstale":"2024-04-26T10:21:10.302131+0000","last_undegraded":"2024-04-26T10:21:10.302131+0000","last_fullsized":"2024-04-26T10:21:10.302131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:56.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320696+0000","last_change":"2024-04-26T10:21:08.935133+0000","last_active":"2024-04-26T10:21:09.320696+0000","last_peered":"2024-04-26T10:21:09.320696+0000","last_clean":"2024-04-26T10:21:09.320696+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:21:09.320696+0000","last_undegraded":"2024-04-26T10:21:09.320696+0000","last_fullsized":"2024-04-26T10:21:09.320696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:25.498249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743681+0000","last_change":"2024-04-26T10:21:09.315201+0000","last_active":"2024-04-26T10:21:10.743681+0000","last_peered":"2024-04-26T10:21:10.743681+0000","last_clean":"2024-04-26T10:21:10.743681+0000","last_became_active":"2024-04-26T10:21:09.314390+0000","last_became_peered":"2024-04-26T10:21:09.314390+0000","last_unstale":"2024-04-26T10:21:10.743681+0000","last_undegraded":"2024-04-26T10:21:10.743681+0000","last_fullsized":"2024-04-26T10:21:10.743681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.998466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.299090+0000","last_change":"2024-04-26T10:21:08.939382+0000","last_active":"2024-04-26T10:21:09.299090+0000","last_peered":"2024-04-26T10:21:09.299090+0000","last_clean":"2024-04-26T10:21:09.299090+0000","last_became_active":"2024-04-26T10:21:08.938193+0000","last_became_peered":"2024-04-26T10:21:08.938193+0000","last_unstale":"2024-04-26T10:21:09.299090+0000","last_undegraded":"2024-04-26T10:21:09.299090+0000","last_fullsized":"2024-04-26T10:21:09.299090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:01.182611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303014+0000","last_change":"2024-04-26T10:21:09.313678+0000","last_active":"2024-04-26T10:21:10.303014+0000","last_peered":"2024-04-26T10:21:10.303014+0000","last_clean":"2024-04-26T10:21:10.303014+0000","last_became_active":"2024-04-26T10:21:09.312906+0000","last_became_peered":"2024-04-26T10:21:09.312906+0000","last_unstale":"2024-04-26T10:21:10.303014+0000","last_undegraded":"2024-04-26T10:21:10.303014+0000","last_fullsized":"2024-04-26T10:21:10.303014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:14.241108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.313678+0000","last_change":"2024-04-26T10:21:08.936904+0000","last_active":"2024-04-26T10:21:09.313678+0000","last_peered":"2024-04-26T10:21:09.313678+0000","last_clean":"2024-04-26T10:21:09.313678+0000","last_became_active":"2024-04-26T10:21:08.936376+0000","last_became_peered":"2024-04-26T10:21:08.936376+0000","last_unstale":"2024-04-26T10:21:09.313678+0000","last_undegraded":"2024-04-26T10:21:09.313678+0000","last_fullsized":"2024-04-26T10:21:09.313678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:19.270525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742850+0000","last_change":"2024-04-26T10:21:09.307911+0000","last_active":"2024-04-26T10:21:10.742850+0000","last_peered":"2024-04-26T10:21:10.742850+0000","last_clean":"2024-04-26T10:21:10.742850+0000","last_became_active":"2024-04-26T10:21:09.307597+0000","last_became_peered":"2024-04-26T10:21:09.307597+0000","last_unstale":"2024-04-26T10:21:10.742850+0000","last_undegraded":"2024-04-26T10:21:10.742850+0000","last_fullsized":"2024-04-26T10:21:10.742850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:21.698558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.300582+0000","last_change":"2024-04-26T10:21:08.939072+0000","last_active":"2024-04-26T10:21:09.300582+0000","last_peered":"2024-04-26T10:21:09.300582+0000","last_clean":"2024-04-26T10:21:09.300582+0000","last_became_active":"2024-04-26T10:21:08.938445+0000","last_became_peered":"2024-04-26T10:21:08.938445+0000","last_unstale":"2024-04-26T10:21:09.300582+0000","last_undegraded":"2024-04-26T10:21:09.300582+0000","last_fullsized":"2024-04-26T10:21:09.300582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:06.598189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743938+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:21:10.743938+0000","last_peered":"2024-04-26T10:21:10.743938+0000","last_clean":"2024-04-26T10:21:10.743938+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:21:10.743938+0000","last_undegraded":"2024-04-26T10:21:10.743938+0000","last_fullsized":"2024-04-26T10:21:10.743938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309935+0000","last_change":"2024-04-26T10:21:08.936533+0000","last_active":"2024-04-26T10:21:09.309935+0000","last_peered":"2024-04-26T10:21:09.309935+0000","last_clean":"2024-04-26T10:21:09.309935+0000","last_became_active":"2024-04-26T10:21:08.936222+0000","last_became_peered":"2024-04-26T10:21:08.936222+0000","last_unstale":"2024-04-26T10:21:09.309935+0000","last_undegraded":"2024-04-26T10:21:09.309935+0000","last_fullsized":"2024-04-26T10:21:09.309935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:18:07.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742771+0000","last_change":"2024-04-26T10:21:09.316361+0000","last_active":"2024-04-26T10:21:10.742771+0000","last_peered":"2024-04-26T10:21:10.742771+0000","last_clean":"2024-04-26T10:21:10.742771+0000","last_became_active":"2024-04-26T10:21:09.315981+0000","last_became_peered":"2024-04-26T10:21:09.315981+0000","last_unstale":"2024-04-26T10:21:10.742771+0000","last_undegraded":"2024-04-26T10:21:10.742771+0000","last_fullsized":"2024-04-26T10:21:10.742771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:00.173638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309815+0000","last_change":"2024-04-26T10:21:08.928590+0000","last_active":"2024-04-26T10:21:09.309815+0000","last_peered":"2024-04-26T10:21:09.309815+0000","last_clean":"2024-04-26T10:21:09.309815+0000","last_became_active":"2024-04-26T10:21:08.928354+0000","last_became_peered":"2024-04-26T10:21:08.928354+0000","last_unstale":"2024-04-26T10:21:09.309815+0000","last_undegraded":"2024-04-26T10:21:09.309815+0000","last_fullsized":"2024-04-26T10:21:09.309815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:52.241716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304119+0000","last_change":"2024-04-26T10:21:09.317282+0000","last_active":"2024-04-26T10:21:10.304119+0000","last_peered":"2024-04-26T10:21:10.304119+0000","last_clean":"2024-04-26T10:21:10.304119+0000","last_became_active":"2024-04-26T10:21:09.316591+0000","last_became_peered":"2024-04-26T10:21:09.316591+0000","last_unstale":"2024-04-26T10:21:10.304119+0000","last_undegraded":"2024-04-26T10:21:10.304119+0000","last_fullsized":"2024-04-26T10:21:10.304119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:28.447361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":213,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297609+0000","last_change":"2024-04-26T10:21:01.829140+0000","last_active":"2024-04-26T10:21:09.297609+0000","last_peered":"2024-04-26T10:21:09.297609+0000","last_clean":"2024-04-26T10:21:09.297609+0000","last_became_active":"2024-04-26T10:21:01.827182+0000","last_became_peered":"2024-04-26T10:21:01.827182+0000","last_unstale":"2024-04-26T10:21:09.297609+0000","last_undegraded":"2024-04-26T10:21:09.297609+0000","last_fullsized":"2024-04-26T10:21:09.297609+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:00:51.477222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298874+0000","last_change":"2024-04-26T10:21:04.893745+0000","last_active":"2024-04-26T10:21:09.298874+0000","last_peered":"2024-04-26T10:21:09.298874+0000","last_clean":"2024-04-26T10:21:09.298874+0000","last_became_active":"2024-04-26T10:21:04.893031+0000","last_became_peered":"2024-04-26T10:21:04.893031+0000","last_unstale":"2024-04-26T10:21:09.298874+0000","last_undegraded":"2024-04-26T10:21:09.298874+0000","last_fullsized":"2024-04-26T10:21:09.298874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:59.771061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297001+0000","last_change":"2024-04-26T10:21:08.933706+0000","last_active":"2024-04-26T10:21:09.297001+0000","last_peered":"2024-04-26T10:21:09.297001+0000","last_clean":"2024-04-26T10:21:09.297001+0000","last_became_active":"2024-04-26T10:21:08.933372+0000","last_became_peered":"2024-04-26T10:21:08.933372+0000","last_unstale":"2024-04-26T10:21:09.297001+0000","last_undegraded":"2024-04-26T10:21:09.297001+0000","last_fullsized":"2024-04-26T10:21:09.297001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:14.290484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.744176+0000","last_change":"2024-04-26T10:21:09.320889+0000","last_active":"2024-04-26T10:21:10.744176+0000","last_peered":"2024-04-26T10:21:10.744176+0000","last_clean":"2024-04-26T10:21:10.744176+0000","last_became_active":"2024-04-26T10:21:09.320355+0000","last_became_peered":"2024-04-26T10:21:09.320355+0000","last_unstale":"2024-04-26T10:21:10.744176+0000","last_undegraded":"2024-04-26T10:21:10.744176+0000","last_fullsized":"2024-04-26T10:21:10.744176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:41.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297382+0000","last_change":"2024-04-26T10:21:04.892156+0000","last_active":"2024-04-26T10:21:09.297382+0000","last_peered":"2024-04-26T10:21:09.297382+0000","last_clean":"2024-04-26T10:21:09.297382+0000","last_became_active":"2024-04-26T10:21:04.891660+0000","last_became_peered":"2024-04-26T10:21:04.891660+0000","last_unstale":"2024-04-26T10:21:09.297382+0000","last_undegraded":"2024-04-26T10:21:09.297382+0000","last_fullsized":"2024-04-26T10:21:09.297382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:50.568468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296858+0000","last_change":"2024-04-26T10:21:08.936815+0000","last_active":"2024-04-26T10:21:09.296858+0000","last_peered":"2024-04-26T10:21:09.296858+0000","last_clean":"2024-04-26T10:21:09.296858+0000","last_became_active":"2024-04-26T10:21:08.936180+0000","last_became_peered":"2024-04-26T10:21:08.936180+0000","last_unstale":"2024-04-26T10:21:09.296858+0000","last_undegraded":"2024-04-26T10:21:09.296858+0000","last_fullsized":"2024-04-26T10:21:09.296858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:41.614282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304366+0000","last_change":"2024-04-26T10:21:09.310050+0000","last_active":"2024-04-26T10:21:10.304366+0000","last_peered":"2024-04-26T10:21:10.304366+0000","last_clean":"2024-04-26T10:21:10.304366+0000","last_became_active":"2024-04-26T10:21:09.309470+0000","last_became_peered":"2024-04-26T10:21:09.309470+0000","last_unstale":"2024-04-26T10:21:10.304366+0000","last_undegraded":"2024-04-26T10:21:10.304366+0000","last_fullsized":"2024-04-26T10:21:10.304366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:32.334144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296330+0000","last_change":"2024-04-26T10:21:04.890860+0000","last_active":"2024-04-26T10:21:09.296330+0000","last_peered":"2024-04-26T10:21:09.296330+0000","last_clean":"2024-04-26T10:21:09.296330+0000","last_became_active":"2024-04-26T10:21:04.890336+0000","last_became_peered":"2024-04-26T10:21:04.890336+0000","last_unstale":"2024-04-26T10:21:09.296330+0000","last_undegraded":"2024-04-26T10:21:09.296330+0000","last_fullsized":"2024-04-26T10:21:09.296330+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:13.262120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.310359+0000","last_change":"2024-04-26T10:21:08.936077+0000","last_active":"2024-04-26T10:21:09.310359+0000","last_peered":"2024-04-26T10:21:09.310359+0000","last_clean":"2024-04-26T10:21:09.310359+0000","last_became_active":"2024-04-26T10:21:08.935621+0000","last_became_peered":"2024-04-26T10:21:08.935621+0000","last_unstale":"2024-04-26T10:21:09.310359+0000","last_undegraded":"2024-04-26T10:21:09.310359+0000","last_fullsized":"2024-04-26T10:21:09.310359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:11.906094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304130+0000","last_change":"2024-04-26T10:21:09.314796+0000","last_active":"2024-04-26T10:21:10.304130+0000","last_peered":"2024-04-26T10:21:10.304130+0000","last_clean":"2024-04-26T10:21:10.304130+0000","last_became_active":"2024-04-26T10:21:09.314574+0000","last_became_peered":"2024-04-26T10:21:09.314574+0000","last_unstale":"2024-04-26T10:21:10.304130+0000","last_undegraded":"2024-04-26T10:21:10.304130+0000","last_fullsized":"2024-04-26T10:21:10.304130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:32.136621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301803+0000","last_change":"2024-04-26T10:21:04.893253+0000","last_active":"2024-04-26T10:21:09.301803+0000","last_peered":"2024-04-26T10:21:09.301803+0000","last_clean":"2024-04-26T10:21:09.301803+0000","last_became_active":"2024-04-26T10:21:04.892843+0000","last_became_peered":"2024-04-26T10:21:04.892843+0000","last_unstale":"2024-04-26T10:21:09.301803+0000","last_undegraded":"2024-04-26T10:21:09.301803+0000","last_fullsized":"2024-04-26T10:21:09.301803+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:00.749791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298626+0000","last_change":"2024-04-26T10:21:08.937153+0000","last_active":"2024-04-26T10:21:09.298626+0000","last_peered":"2024-04-26T10:21:09.298626+0000","last_clean":"2024-04-26T10:21:09.298626+0000","last_became_active":"2024-04-26T10:21:08.936561+0000","last_became_peered":"2024-04-26T10:21:08.936561+0000","last_unstale":"2024-04-26T10:21:09.298626+0000","last_undegraded":"2024-04-26T10:21:09.298626+0000","last_fullsized":"2024-04-26T10:21:09.298626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:28.491800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303941+0000","last_change":"2024-04-26T10:21:09.314218+0000","last_active":"2024-04-26T10:21:10.303941+0000","last_peered":"2024-04-26T10:21:10.303941+0000","last_clean":"2024-04-26T10:21:10.303941+0000","last_became_active":"2024-04-26T10:21:09.313641+0000","last_became_peered":"2024-04-26T10:21:09.313641+0000","last_unstale":"2024-04-26T10:21:10.303941+0000","last_undegraded":"2024-04-26T10:21:10.303941+0000","last_fullsized":"2024-04-26T10:21:10.303941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:08.449512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.300397+0000","last_change":"2024-04-26T10:21:08.937196+0000","last_active":"2024-04-26T10:21:09.300397+0000","last_peered":"2024-04-26T10:21:09.300397+0000","last_clean":"2024-04-26T10:21:09.300397+0000","last_became_active":"2024-04-26T10:21:08.936779+0000","last_became_peered":"2024-04-26T10:21:08.936779+0000","last_unstale":"2024-04-26T10:21:09.300397+0000","last_undegraded":"2024-04-26T10:21:09.300397+0000","last_fullsized":"2024-04-26T10:21:09.300397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:20.545169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295561+0000","last_change":"2024-04-26T10:21:04.890548+0000","last_active":"2024-04-26T10:21:09.295561+0000","last_peered":"2024-04-26T10:21:09.295561+0000","last_clean":"2024-04-26T10:21:09.295561+0000","last_became_active":"2024-04-26T10:21:04.890034+0000","last_became_peered":"2024-04-26T10:21:04.890034+0000","last_unstale":"2024-04-26T10:21:09.295561+0000","last_undegraded":"2024-04-26T10:21:09.295561+0000","last_fullsized":"2024-04-26T10:21:09.295561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:55.033455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302442+0000","last_change":"2024-04-26T10:21:09.318348+0000","last_active":"2024-04-26T10:21:10.302442+0000","last_peered":"2024-04-26T10:21:10.302442+0000","last_clean":"2024-04-26T10:21:10.302442+0000","last_became_active":"2024-04-26T10:21:09.317886+0000","last_became_peered":"2024-04-26T10:21:09.317886+0000","last_unstale":"2024-04-26T10:21:10.302442+0000","last_undegraded":"2024-04-26T10:21:10.302442+0000","last_fullsized":"2024-04-26T10:21:10.302442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:24.624358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295394+0000","last_change":"2024-04-26T10:21:08.933714+0000","last_active":"2024-04-26T10:21:09.295394+0000","last_peered":"2024-04-26T10:21:09.295394+0000","last_clean":"2024-04-26T10:21:09.295394+0000","last_became_active":"2024-04-26T10:21:08.933259+0000","last_became_peered":"2024-04-26T10:21:08.933259+0000","last_unstale":"2024-04-26T10:21:09.295394+0000","last_undegraded":"2024-04-26T10:21:09.295394+0000","last_fullsized":"2024-04-26T10:21:09.295394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:50.230096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.311683+0000","last_change":"2024-04-26T10:21:04.891490+0000","last_active":"2024-04-26T10:21:09.311683+0000","last_peered":"2024-04-26T10:21:09.311683+0000","last_clean":"2024-04-26T10:21:09.311683+0000","last_became_active":"2024-04-26T10:21:04.890777+0000","last_became_peered":"2024-04-26T10:21:04.890777+0000","last_unstale":"2024-04-26T10:21:09.311683+0000","last_undegraded":"2024-04-26T10:21:09.311683+0000","last_fullsized":"2024-04-26T10:21:09.311683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:25.896672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302680+0000","last_change":"2024-04-26T10:21:09.314213+0000","last_active":"2024-04-26T10:21:10.302680+0000","last_peered":"2024-04-26T10:21:10.302680+0000","last_clean":"2024-04-26T10:21:10.302680+0000","last_became_active":"2024-04-26T10:21:09.312975+0000","last_became_peered":"2024-04-26T10:21:09.312975+0000","last_unstale":"2024-04-26T10:21:10.302680+0000","last_undegraded":"2024-04-26T10:21:10.302680+0000","last_fullsized":"2024-04-26T10:21:10.302680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:43.137127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.317699+0000","last_change":"2024-04-26T10:21:08.934216+0000","last_active":"2024-04-26T10:21:09.317699+0000","last_peered":"2024-04-26T10:21:09.317699+0000","last_clean":"2024-04-26T10:21:09.317699+0000","last_became_active":"2024-04-26T10:21:08.933524+0000","last_became_peered":"2024-04-26T10:21:08.933524+0000","last_unstale":"2024-04-26T10:21:09.317699+0000","last_undegraded":"2024-04-26T10:21:09.317699+0000","last_fullsized":"2024-04-26T10:21:09.317699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:57.798830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297318+0000","last_change":"2024-04-26T10:21:04.890490+0000","last_active":"2024-04-26T10:21:09.297318+0000","last_peered":"2024-04-26T10:21:09.297318+0000","last_clean":"2024-04-26T10:21:09.297318+0000","last_became_active":"2024-04-26T10:21:04.889808+0000","last_became_peered":"2024-04-26T10:21:04.889808+0000","last_unstale":"2024-04-26T10:21:09.297318+0000","last_undegraded":"2024-04-26T10:21:09.297318+0000","last_fullsized":"2024-04-26T10:21:09.297318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:55.711555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302374+0000","last_change":"2024-04-26T10:21:09.312260+0000","last_active":"2024-04-26T10:21:10.302374+0000","last_peered":"2024-04-26T10:21:10.302374+0000","last_clean":"2024-04-26T10:21:10.302374+0000","last_became_active":"2024-04-26T10:21:09.311309+0000","last_became_peered":"2024-04-26T10:21:09.311309+0000","last_unstale":"2024-04-26T10:21:10.302374+0000","last_undegraded":"2024-04-26T10:21:10.302374+0000","last_fullsized":"2024-04-26T10:21:10.302374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:30.714581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304472+0000","last_change":"2024-04-26T10:21:08.936623+0000","last_active":"2024-04-26T10:21:10.304472+0000","last_peered":"2024-04-26T10:21:10.304472+0000","last_clean":"2024-04-26T10:21:10.304472+0000","last_became_active":"2024-04-26T10:21:08.936252+0000","last_became_peered":"2024-04-26T10:21:08.936252+0000","last_unstale":"2024-04-26T10:21:10.304472+0000","last_undegraded":"2024-04-26T10:21:10.304472+0000","last_fullsized":"2024-04-26T10:21:10.304472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:24.526250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296848+0000","last_change":"2024-04-26T10:21:04.892401+0000","last_active":"2024-04-26T10:21:09.296848+0000","last_peered":"2024-04-26T10:21:09.296848+0000","last_clean":"2024-04-26T10:21:09.296848+0000","last_became_active":"2024-04-26T10:21:04.891692+0000","last_became_peered":"2024-04-26T10:21:04.891692+0000","last_unstale":"2024-04-26T10:21:09.296848+0000","last_undegraded":"2024-04-26T10:21:09.296848+0000","last_fullsized":"2024-04-26T10:21:09.296848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:37.548728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302178+0000","last_change":"2024-04-26T10:21:09.317981+0000","last_active":"2024-04-26T10:21:10.302178+0000","last_peered":"2024-04-26T10:21:10.302178+0000","last_clean":"2024-04-26T10:21:10.302178+0000","last_became_active":"2024-04-26T10:21:09.317601+0000","last_became_peered":"2024-04-26T10:21:09.317601+0000","last_unstale":"2024-04-26T10:21:10.302178+0000","last_undegraded":"2024-04-26T10:21:10.302178+0000","last_fullsized":"2024-04-26T10:21:10.302178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742909+0000","last_change":"2024-04-26T10:21:09.317120+0000","last_active":"2024-04-26T10:21:10.742909+0000","last_peered":"2024-04-26T10:21:10.742909+0000","last_clean":"2024-04-26T10:21:10.742909+0000","last_became_active":"2024-04-26T10:21:09.316741+0000","last_became_peered":"2024-04-26T10:21:09.316741+0000","last_unstale":"2024-04-26T10:21:10.742909+0000","last_undegraded":"2024-04-26T10:21:10.742909+0000","last_fullsized":"2024-04-26T10:21:10.742909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:43.702714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.326574+0000","last_change":"2024-04-26T10:21:08.934481+0000","last_active":"2024-04-26T10:21:09.326574+0000","last_peered":"2024-04-26T10:21:09.326574+0000","last_clean":"2024-04-26T10:21:09.326574+0000","last_became_active":"2024-04-26T10:21:08.934076+0000","last_became_peered":"2024-04-26T10:21:08.934076+0000","last_unstale":"2024-04-26T10:21:09.326574+0000","last_undegraded":"2024-04-26T10:21:09.326574+0000","last_fullsized":"2024-04-26T10:21:09.326574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:50.622715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302791+0000","last_change":"2024-04-26T10:21:09.314009+0000","last_active":"2024-04-26T10:21:10.302791+0000","last_peered":"2024-04-26T10:21:10.302791+0000","last_clean":"2024-04-26T10:21:10.302791+0000","last_became_active":"2024-04-26T10:21:09.313556+0000","last_became_peered":"2024-04-26T10:21:09.313556+0000","last_unstale":"2024-04-26T10:21:10.302791+0000","last_undegraded":"2024-04-26T10:21:10.302791+0000","last_fullsized":"2024-04-26T10:21:10.302791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:34.862466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320711+0000","last_change":"2024-04-26T10:21:08.936526+0000","last_active":"2024-04-26T10:21:09.320711+0000","last_peered":"2024-04-26T10:21:09.320711+0000","last_clean":"2024-04-26T10:21:09.320711+0000","last_became_active":"2024-04-26T10:21:08.936217+0000","last_became_peered":"2024-04-26T10:21:08.936217+0000","last_unstale":"2024-04-26T10:21:09.320711+0000","last_undegraded":"2024-04-26T10:21:09.320711+0000","last_fullsized":"2024-04-26T10:21:09.320711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:57.649639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301807+0000","last_change":"2024-04-26T10:21:08.937597+0000","last_active":"2024-04-26T10:21:09.301807+0000","last_peered":"2024-04-26T10:21:09.301807+0000","last_clean":"2024-04-26T10:21:09.301807+0000","last_became_active":"2024-04-26T10:21:08.936809+0000","last_became_peered":"2024-04-26T10:21:08.936809+0000","last_unstale":"2024-04-26T10:21:09.301807+0000","last_undegraded":"2024-04-26T10:21:09.301807+0000","last_fullsized":"2024-04-26T10:21:09.301807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:17.212235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302338+0000","last_change":"2024-04-26T10:21:09.312054+0000","last_active":"2024-04-26T10:21:10.302338+0000","last_peered":"2024-04-26T10:21:10.302338+0000","last_clean":"2024-04-26T10:21:10.302338+0000","last_became_active":"2024-04-26T10:21:09.310818+0000","last_became_peered":"2024-04-26T10:21:09.310818+0000","last_unstale":"2024-04-26T10:21:10.302338+0000","last_undegraded":"2024-04-26T10:21:10.302338+0000","last_fullsized":"2024-04-26T10:21:10.302338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:03.431355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301359+0000","last_change":"2024-04-26T10:21:08.937445+0000","last_active":"2024-04-26T10:21:09.301359+0000","last_peered":"2024-04-26T10:21:09.301359+0000","last_clean":"2024-04-26T10:21:09.301359+0000","last_became_active":"2024-04-26T10:21:08.937147+0000","last_became_peered":"2024-04-26T10:21:08.937147+0000","last_unstale":"2024-04-26T10:21:09.301359+0000","last_undegraded":"2024-04-26T10:21:09.301359+0000","last_fullsized":"2024-04-26T10:21:09.301359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:29.602825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302232+0000","last_change":"2024-04-26T10:21:09.318091+0000","last_active":"2024-04-26T10:21:10.302232+0000","last_peered":"2024-04-26T10:21:10.302232+0000","last_clean":"2024-04-26T10:21:10.302232+0000","last_became_active":"2024-04-26T10:21:09.317871+0000","last_became_peered":"2024-04-26T10:21:09.317871+0000","last_unstale":"2024-04-26T10:21:10.302232+0000","last_undegraded":"2024-04-26T10:21:10.302232+0000","last_fullsized":"2024-04-26T10:21:10.302232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:32.442915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303867+0000","last_change":"2024-04-26T10:21:09.312636+0000","last_active":"2024-04-26T10:21:10.303867+0000","last_peered":"2024-04-26T10:21:10.303867+0000","last_clean":"2024-04-26T10:21:10.303867+0000","last_became_active":"2024-04-26T10:21:09.312130+0000","last_became_peered":"2024-04-26T10:21:09.312130+0000","last_unstale":"2024-04-26T10:21:10.303867+0000","last_undegraded":"2024-04-26T10:21:10.303867+0000","last_fullsized":"2024-04-26T10:21:10.303867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:29.565507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298243+0000","last_change":"2024-04-26T10:21:08.934046+0000","last_active":"2024-04-26T10:21:09.298243+0000","last_peered":"2024-04-26T10:21:09.298243+0000","last_clean":"2024-04-26T10:21:09.298243+0000","last_became_active":"2024-04-26T10:21:08.933341+0000","last_became_peered":"2024-04-26T10:21:08.933341+0000","last_unstale":"2024-04-26T10:21:09.298243+0000","last_undegraded":"2024-04-26T10:21:09.298243+0000","last_fullsized":"2024-04-26T10:21:09.298243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:45.671865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303860+0000","last_change":"2024-04-26T10:21:09.312081+0000","last_active":"2024-04-26T10:21:10.303860+0000","last_peered":"2024-04-26T10:21:10.303860+0000","last_clean":"2024-04-26T10:21:10.303860+0000","last_became_active":"2024-04-26T10:21:09.310879+0000","last_became_peered":"2024-04-26T10:21:09.310879+0000","last_unstale":"2024-04-26T10:21:10.303860+0000","last_undegraded":"2024-04-26T10:21:10.303860+0000","last_fullsized":"2024-04-26T10:21:10.303860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:36.358962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295619+0000","last_change":"2024-04-26T10:21:08.936748+0000","last_active":"2024-04-26T10:21:09.295619+0000","last_peered":"2024-04-26T10:21:09.295619+0000","last_clean":"2024-04-26T10:21:09.295619+0000","last_became_active":"2024-04-26T10:21:08.936316+0000","last_became_peered":"2024-04-26T10:21:08.936316+0000","last_unstale":"2024-04-26T10:21:09.295619+0000","last_undegraded":"2024-04-26T10:21:09.295619+0000","last_fullsized":"2024-04-26T10:21:09.295619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:47.721288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303753+0000","last_change":"2024-04-26T10:21:09.320062+0000","last_active":"2024-04-26T10:21:10.303753+0000","last_peered":"2024-04-26T10:21:10.303753+0000","last_clean":"2024-04-26T10:21:10.303753+0000","last_became_active":"2024-04-26T10:21:09.319352+0000","last_became_peered":"2024-04-26T10:21:09.319352+0000","last_unstale":"2024-04-26T10:21:10.303753+0000","last_undegraded":"2024-04-26T10:21:10.303753+0000","last_fullsized":"2024-04-26T10:21:10.303753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.998466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316248+0000","last_change":"2024-04-26T10:21:08.931356+0000","last_active":"2024-04-26T10:21:09.316248+0000","last_peered":"2024-04-26T10:21:09.316248+0000","last_clean":"2024-04-26T10:21:09.316248+0000","last_became_active":"2024-04-26T10:21:08.930016+0000","last_became_peered":"2024-04-26T10:21:08.930016+0000","last_unstale":"2024-04-26T10:21:09.316248+0000","last_undegraded":"2024-04-26T10:21:09.316248+0000","last_fullsized":"2024-04-26T10:21:09.316248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:21.306576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303057+0000","last_change":"2024-04-26T10:21:09.318178+0000","last_active":"2024-04-26T10:21:10.303057+0000","last_peered":"2024-04-26T10:21:10.303057+0000","last_clean":"2024-04-26T10:21:10.303057+0000","last_became_active":"2024-04-26T10:21:09.317697+0000","last_became_peered":"2024-04-26T10:21:09.317697+0000","last_unstale":"2024-04-26T10:21:10.303057+0000","last_undegraded":"2024-04-26T10:21:10.303057+0000","last_fullsized":"2024-04-26T10:21:10.303057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:46.285390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320054+0000","last_change":"2024-04-26T10:21:08.936115+0000","last_active":"2024-04-26T10:21:09.320054+0000","last_peered":"2024-04-26T10:21:09.320054+0000","last_clean":"2024-04-26T10:21:09.320054+0000","last_became_active":"2024-04-26T10:21:08.935740+0000","last_became_peered":"2024-04-26T10:21:08.935740+0000","last_unstale":"2024-04-26T10:21:09.320054+0000","last_undegraded":"2024-04-26T10:21:09.320054+0000","last_fullsized":"2024-04-26T10:21:09.320054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:08.369059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742450+0000","last_change":"2024-04-26T10:21:09.308077+0000","last_active":"2024-04-26T10:21:10.742450+0000","last_peered":"2024-04-26T10:21:10.742450+0000","last_clean":"2024-04-26T10:21:10.742450+0000","last_became_active":"2024-04-26T10:21:09.307543+0000","last_became_peered":"2024-04-26T10:21:09.307543+0000","last_unstale":"2024-04-26T10:21:10.742450+0000","last_undegraded":"2024-04-26T10:21:10.742450+0000","last_fullsized":"2024-04-26T10:21:10.742450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:46.596591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316572+0000","last_change":"2024-04-26T10:21:08.938933+0000","last_active":"2024-04-26T10:21:09.316572+0000","last_peered":"2024-04-26T10:21:09.316572+0000","last_clean":"2024-04-26T10:21:09.316572+0000","last_became_active":"2024-04-26T10:21:08.938281+0000","last_became_peered":"2024-04-26T10:21:08.938281+0000","last_unstale":"2024-04-26T10:21:09.316572+0000","last_undegraded":"2024-04-26T10:21:09.316572+0000","last_fullsized":"2024-04-26T10:21:09.316572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:50.856581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743973+0000","last_change":"2024-04-26T10:21:09.315331+0000","last_active":"2024-04-26T10:21:10.743973+0000","last_peered":"2024-04-26T10:21:10.743973+0000","last_clean":"2024-04-26T10:21:10.743973+0000","last_became_active":"2024-04-26T10:21:09.314523+0000","last_became_peered":"2024-04-26T10:21:09.314523+0000","last_unstale":"2024-04-26T10:21:10.743973+0000","last_undegraded":"2024-04-26T10:21:10.743973+0000","last_fullsized":"2024-04-26T10:21:10.743973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:24.624358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320722+0000","last_change":"2024-04-26T10:21:08.936791+0000","last_active":"2024-04-26T10:21:09.320722+0000","last_peered":"2024-04-26T10:21:09.320722+0000","last_clean":"2024-04-26T10:21:09.320722+0000","last_became_active":"2024-04-26T10:21:08.936469+0000","last_became_peered":"2024-04-26T10:21:08.936469+0000","last_unstale":"2024-04-26T10:21:09.320722+0000","last_undegraded":"2024-04-26T10:21:09.320722+0000","last_fullsized":"2024-04-26T10:21:09.320722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:14.145721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302806+0000","last_change":"2024-04-26T10:21:09.315299+0000","last_active":"2024-04-26T10:21:10.302806+0000","last_peered":"2024-04-26T10:21:10.302806+0000","last_clean":"2024-04-26T10:21:10.302806+0000","last_became_active":"2024-04-26T10:21:09.314896+0000","last_became_peered":"2024-04-26T10:21:09.314896+0000","last_unstale":"2024-04-26T10:21:10.302806+0000","last_undegraded":"2024-04-26T10:21:10.302806+0000","last_fullsized":"2024-04-26T10:21:10.302806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.174824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316992+0000","last_change":"2024-04-26T10:21:08.933424+0000","last_active":"2024-04-26T10:21:09.316992+0000","last_peered":"2024-04-26T10:21:09.316992+0000","last_clean":"2024-04-26T10:21:09.316992+0000","last_became_active":"2024-04-26T10:21:08.933088+0000","last_became_peered":"2024-04-26T10:21:08.933088+0000","last_unstale":"2024-04-26T10:21:09.316992+0000","last_undegraded":"2024-04-26T10:21:09.316992+0000","last_fullsized":"2024-04-26T10:21:09.316992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:55.394913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742760+0000","last_change":"2024-04-26T10:21:09.308831+0000","last_active":"2024-04-26T10:21:10.742760+0000","last_peered":"2024-04-26T10:21:10.742760+0000","last_clean":"2024-04-26T10:21:10.742760+0000","last_became_active":"2024-04-26T10:21:09.308457+0000","last_became_peered":"2024-04-26T10:21:09.308457+0000","last_unstale":"2024-04-26T10:21:10.742760+0000","last_undegraded":"2024-04-26T10:21:10.742760+0000","last_fullsized":"2024-04-26T10:21:10.742760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:43.137127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.314230+0000","last_change":"2024-04-26T10:21:08.937023+0000","last_active":"2024-04-26T10:21:09.314230+0000","last_peered":"2024-04-26T10:21:09.314230+0000","last_clean":"2024-04-26T10:21:09.314230+0000","last_became_active":"2024-04-26T10:21:08.936511+0000","last_became_peered":"2024-04-26T10:21:08.936511+0000","last_unstale":"2024-04-26T10:21:09.314230+0000","last_undegraded":"2024-04-26T10:21:09.314230+0000","last_fullsized":"2024-04-26T10:21:09.314230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:38.881531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":653928,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":0,"up_from":10,"seq":42949672967,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":270336,"data_stored":654544,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":188416,"data_stored":62430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:21:21.222 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:21:21.548 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:21.551 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:21:21.565 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-04-26T10:21:19.939531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94064,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021456,"statfs":{"total":289910292480,"available":289813970944,"internally_reserved":0,"allocated":720896,"data_stored":1370902,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003075"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303606+0000","last_change":"2024-04-26T10:21:09.316096+0000","last_active":"2024-04-26T10:21:10.303606+0000","last_peered":"2024-04-26T10:21:10.303606+0000","last_clean":"2024-04-26T10:21:10.303606+0000","last_became_active":"2024-04-26T10:21:09.315498+0000","last_became_peered":"2024-04-26T10:21:09.315498+0000","last_unstale":"2024-04-26T10:21:10.303606+0000","last_undegraded":"2024-04-26T10:21:10.303606+0000","last_fullsized":"2024-04-26T10:21:10.303606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:14.245434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304046+0000","last_change":"2024-04-26T10:21:09.317241+0000","last_active":"2024-04-26T10:21:10.304046+0000","last_peered":"2024-04-26T10:21:10.304046+0000","last_clean":"2024-04-26T10:21:10.304046+0000","last_became_active":"2024-04-26T10:21:09.316532+0000","last_became_peered":"2024-04-26T10:21:09.316532+0000","last_unstale":"2024-04-26T10:21:10.304046+0000","last_undegraded":"2024-04-26T10:21:10.304046+0000","last_fullsized":"2024-04-26T10:21:10.304046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:00.173638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743004+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:21:10.743004+0000","last_peered":"2024-04-26T10:21:10.743004+0000","last_clean":"2024-04-26T10:21:10.743004+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:21:10.743004+0000","last_undegraded":"2024-04-26T10:21:10.743004+0000","last_fullsized":"2024-04-26T10:21:10.743004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:01.883964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742576+0000","last_change":"2024-04-26T10:21:09.306531+0000","last_active":"2024-04-26T10:21:10.742576+0000","last_peered":"2024-04-26T10:21:10.742576+0000","last_clean":"2024-04-26T10:21:10.742576+0000","last_became_active":"2024-04-26T10:21:09.304885+0000","last_became_peered":"2024-04-26T10:21:09.304885+0000","last_unstale":"2024-04-26T10:21:10.742576+0000","last_undegraded":"2024-04-26T10:21:10.742576+0000","last_fullsized":"2024-04-26T10:21:10.742576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:04.179516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302949+0000","last_change":"2024-04-26T10:21:09.310914+0000","last_active":"2024-04-26T10:21:10.302949+0000","last_peered":"2024-04-26T10:21:10.302949+0000","last_clean":"2024-04-26T10:21:10.302949+0000","last_became_active":"2024-04-26T10:21:09.309981+0000","last_became_peered":"2024-04-26T10:21:09.309981+0000","last_unstale":"2024-04-26T10:21:10.302949+0000","last_undegraded":"2024-04-26T10:21:10.302949+0000","last_fullsized":"2024-04-26T10:21:10.302949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:04.926251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743427+0000","last_change":"2024-04-26T10:21:09.305198+0000","last_active":"2024-04-26T10:21:10.743427+0000","last_peered":"2024-04-26T10:21:10.743427+0000","last_clean":"2024-04-26T10:21:10.743427+0000","last_became_active":"2024-04-26T10:21:09.304716+0000","last_became_peered":"2024-04-26T10:21:09.304716+0000","last_unstale":"2024-04-26T10:21:10.743427+0000","last_undegraded":"2024-04-26T10:21:10.743427+0000","last_fullsized":"2024-04-26T10:21:10.743427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:11.224015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742177+0000","last_change":"2024-04-26T10:21:09.307188+0000","last_active":"2024-04-26T10:21:10.742177+0000","last_peered":"2024-04-26T10:21:10.742177+0000","last_clean":"2024-04-26T10:21:10.742177+0000","last_became_active":"2024-04-26T10:21:09.306548+0000","last_became_peered":"2024-04-26T10:21:09.306548+0000","last_unstale":"2024-04-26T10:21:10.742177+0000","last_undegraded":"2024-04-26T10:21:10.742177+0000","last_fullsized":"2024-04-26T10:21:10.742177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:29.565507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741718+0000","last_change":"2024-04-26T10:21:09.308284+0000","last_active":"2024-04-26T10:21:10.741718+0000","last_peered":"2024-04-26T10:21:10.741718+0000","last_clean":"2024-04-26T10:21:10.741718+0000","last_became_active":"2024-04-26T10:21:09.307504+0000","last_became_peered":"2024-04-26T10:21:09.307504+0000","last_unstale":"2024-04-26T10:21:10.741718+0000","last_undegraded":"2024-04-26T10:21:10.741718+0000","last_fullsized":"2024-04-26T10:21:10.741718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:51.549222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303844+0000","last_change":"2024-04-26T10:21:09.314160+0000","last_active":"2024-04-26T10:21:10.303844+0000","last_peered":"2024-04-26T10:21:10.303844+0000","last_clean":"2024-04-26T10:21:10.303844+0000","last_became_active":"2024-04-26T10:21:09.313221+0000","last_became_peered":"2024-04-26T10:21:09.313221+0000","last_unstale":"2024-04-26T10:21:10.303844+0000","last_undegraded":"2024-04-26T10:21:10.303844+0000","last_fullsized":"2024-04-26T10:21:10.303844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:50.157094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304095+0000","last_change":"2024-04-26T10:21:09.315304+0000","last_active":"2024-04-26T10:21:10.304095+0000","last_peered":"2024-04-26T10:21:10.304095+0000","last_clean":"2024-04-26T10:21:10.304095+0000","last_became_active":"2024-04-26T10:21:09.314619+0000","last_became_peered":"2024-04-26T10:21:09.314619+0000","last_unstale":"2024-04-26T10:21:10.304095+0000","last_undegraded":"2024-04-26T10:21:10.304095+0000","last_fullsized":"2024-04-26T10:21:10.304095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:41.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743482+0000","last_change":"2024-04-26T10:21:09.307173+0000","last_active":"2024-04-26T10:21:10.743482+0000","last_peered":"2024-04-26T10:21:10.743482+0000","last_clean":"2024-04-26T10:21:10.743482+0000","last_became_active":"2024-04-26T10:21:09.306523+0000","last_became_peered":"2024-04-26T10:21:09.306523+0000","last_unstale":"2024-04-26T10:21:10.743482+0000","last_undegraded":"2024-04-26T10:21:10.743482+0000","last_fullsized":"2024-04-26T10:21:10.743482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:15.102637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302828+0000","last_change":"2024-04-26T10:21:09.319057+0000","last_active":"2024-04-26T10:21:10.302828+0000","last_peered":"2024-04-26T10:21:10.302828+0000","last_clean":"2024-04-26T10:21:10.302828+0000","last_became_active":"2024-04-26T10:21:09.318580+0000","last_became_peered":"2024-04-26T10:21:09.318580+0000","last_unstale":"2024-04-26T10:21:10.302828+0000","last_undegraded":"2024-04-26T10:21:10.302828+0000","last_fullsized":"2024-04-26T10:21:10.302828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.335327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302635+0000","last_change":"2024-04-26T10:21:09.310332+0000","last_active":"2024-04-26T10:21:10.302635+0000","last_peered":"2024-04-26T10:21:10.302635+0000","last_clean":"2024-04-26T10:21:10.302635+0000","last_became_active":"2024-04-26T10:21:09.309534+0000","last_became_peered":"2024-04-26T10:21:09.309534+0000","last_unstale":"2024-04-26T10:21:10.302635+0000","last_undegraded":"2024-04-26T10:21:10.302635+0000","last_fullsized":"2024-04-26T10:21:10.302635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:01.594353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742954+0000","last_change":"2024-04-26T10:21:09.316821+0000","last_active":"2024-04-26T10:21:10.742954+0000","last_peered":"2024-04-26T10:21:10.742954+0000","last_clean":"2024-04-26T10:21:10.742954+0000","last_became_active":"2024-04-26T10:21:09.316143+0000","last_became_peered":"2024-04-26T10:21:09.316143+0000","last_unstale":"2024-04-26T10:21:10.742954+0000","last_undegraded":"2024-04-26T10:21:10.742954+0000","last_fullsized":"2024-04-26T10:21:10.742954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:20.271378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742238+0000","last_change":"2024-04-26T10:21:09.314710+0000","last_active":"2024-04-26T10:21:10.742238+0000","last_peered":"2024-04-26T10:21:10.742238+0000","last_clean":"2024-04-26T10:21:10.742238+0000","last_became_active":"2024-04-26T10:21:09.314401+0000","last_became_peered":"2024-04-26T10:21:09.314401+0000","last_unstale":"2024-04-26T10:21:10.742238+0000","last_undegraded":"2024-04-26T10:21:10.742238+0000","last_fullsized":"2024-04-26T10:21:10.742238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:14.245434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741766+0000","last_change":"2024-04-26T10:21:09.306575+0000","last_active":"2024-04-26T10:21:10.741766+0000","last_peered":"2024-04-26T10:21:10.741766+0000","last_clean":"2024-04-26T10:21:10.741766+0000","last_became_active":"2024-04-26T10:21:09.305009+0000","last_became_peered":"2024-04-26T10:21:09.305009+0000","last_unstale":"2024-04-26T10:21:10.741766+0000","last_undegraded":"2024-04-26T10:21:10.741766+0000","last_fullsized":"2024-04-26T10:21:10.741766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:42.965427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304549+0000","last_change":"2024-04-26T10:21:09.317530+0000","last_active":"2024-04-26T10:21:10.304549+0000","last_peered":"2024-04-26T10:21:10.304549+0000","last_clean":"2024-04-26T10:21:10.304549+0000","last_became_active":"2024-04-26T10:21:09.316956+0000","last_became_peered":"2024-04-26T10:21:09.316956+0000","last_unstale":"2024-04-26T10:21:10.304549+0000","last_undegraded":"2024-04-26T10:21:10.304549+0000","last_fullsized":"2024-04-26T10:21:10.304549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:05.112877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304348+0000","last_change":"2024-04-26T10:21:09.316152+0000","last_active":"2024-04-26T10:21:10.304348+0000","last_peered":"2024-04-26T10:21:10.304348+0000","last_clean":"2024-04-26T10:21:10.304348+0000","last_became_active":"2024-04-26T10:21:09.315441+0000","last_became_peered":"2024-04-26T10:21:09.315441+0000","last_unstale":"2024-04-26T10:21:10.304348+0000","last_undegraded":"2024-04-26T10:21:10.304348+0000","last_fullsized":"2024-04-26T10:21:10.304348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:42.904467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303452+0000","last_change":"2024-04-26T10:21:09.316805+0000","last_active":"2024-04-26T10:21:10.303452+0000","last_peered":"2024-04-26T10:21:10.303452+0000","last_clean":"2024-04-26T10:21:10.303452+0000","last_became_active":"2024-04-26T10:21:09.316490+0000","last_became_peered":"2024-04-26T10:21:09.316490+0000","last_unstale":"2024-04-26T10:21:10.303452+0000","last_undegraded":"2024-04-26T10:21:10.303452+0000","last_fullsized":"2024-04-26T10:21:10.303452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:11.814183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742675+0000","last_change":"2024-04-26T10:21:09.314189+0000","last_active":"2024-04-26T10:21:10.742675+0000","last_peered":"2024-04-26T10:21:10.742675+0000","last_clean":"2024-04-26T10:21:10.742675+0000","last_became_active":"2024-04-26T10:21:09.313648+0000","last_became_peered":"2024-04-26T10:21:09.313648+0000","last_unstale":"2024-04-26T10:21:10.742675+0000","last_undegraded":"2024-04-26T10:21:10.742675+0000","last_fullsized":"2024-04-26T10:21:10.742675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:57.658133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743475+0000","last_change":"2024-04-26T10:21:09.316594+0000","last_active":"2024-04-26T10:21:10.743475+0000","last_peered":"2024-04-26T10:21:10.743475+0000","last_clean":"2024-04-26T10:21:10.743475+0000","last_became_active":"2024-04-26T10:21:09.315877+0000","last_became_peered":"2024-04-26T10:21:09.315877+0000","last_unstale":"2024-04-26T10:21:10.743475+0000","last_undegraded":"2024-04-26T10:21:10.743475+0000","last_fullsized":"2024-04-26T10:21:10.743475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:19.943321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302427+0000","last_change":"2024-04-26T10:21:09.318829+0000","last_active":"2024-04-26T10:21:10.302427+0000","last_peered":"2024-04-26T10:21:10.302427+0000","last_clean":"2024-04-26T10:21:10.302427+0000","last_became_active":"2024-04-26T10:21:09.318379+0000","last_became_peered":"2024-04-26T10:21:09.318379+0000","last_unstale":"2024-04-26T10:21:10.302427+0000","last_undegraded":"2024-04-26T10:21:10.302427+0000","last_fullsized":"2024-04-26T10:21:10.302427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:11.224015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302100+0000","last_change":"2024-04-26T10:21:09.309068+0000","last_active":"2024-04-26T10:21:10.302100+0000","last_peered":"2024-04-26T10:21:10.302100+0000","last_clean":"2024-04-26T10:21:10.302100+0000","last_became_active":"2024-04-26T10:21:09.308797+0000","last_became_peered":"2024-04-26T10:21:09.308797+0000","last_unstale":"2024-04-26T10:21:10.302100+0000","last_undegraded":"2024-04-26T10:21:10.302100+0000","last_fullsized":"2024-04-26T10:21:10.302100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:44.761759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.301914+0000","last_change":"2024-04-26T10:21:09.311574+0000","last_active":"2024-04-26T10:21:10.301914+0000","last_peered":"2024-04-26T10:21:10.301914+0000","last_clean":"2024-04-26T10:21:10.301914+0000","last_became_active":"2024-04-26T10:21:09.309285+0000","last_became_peered":"2024-04-26T10:21:09.309285+0000","last_unstale":"2024-04-26T10:21:10.301914+0000","last_undegraded":"2024-04-26T10:21:10.301914+0000","last_fullsized":"2024-04-26T10:21:10.301914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:06.884098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303605+0000","last_change":"2024-04-26T10:21:09.317948+0000","last_active":"2024-04-26T10:21:10.303605+0000","last_peered":"2024-04-26T10:21:10.303605+0000","last_clean":"2024-04-26T10:21:10.303605+0000","last_became_active":"2024-04-26T10:21:09.317571+0000","last_became_peered":"2024-04-26T10:21:09.317571+0000","last_unstale":"2024-04-26T10:21:10.303605+0000","last_undegraded":"2024-04-26T10:21:10.303605+0000","last_fullsized":"2024-04-26T10:21:10.303605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:04.179516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304130+0000","last_change":"2024-04-26T10:21:09.312839+0000","last_active":"2024-04-26T10:21:10.304130+0000","last_peered":"2024-04-26T10:21:10.304130+0000","last_clean":"2024-04-26T10:21:10.304130+0000","last_became_active":"2024-04-26T10:21:09.311898+0000","last_became_peered":"2024-04-26T10:21:09.311898+0000","last_unstale":"2024-04-26T10:21:10.304130+0000","last_undegraded":"2024-04-26T10:21:10.304130+0000","last_fullsized":"2024-04-26T10:21:10.304130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:03.705171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743873+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:21:10.743873+0000","last_peered":"2024-04-26T10:21:10.743873+0000","last_clean":"2024-04-26T10:21:10.743873+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:21:10.743873+0000","last_undegraded":"2024-04-26T10:21:10.743873+0000","last_fullsized":"2024-04-26T10:21:10.743873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:39.394937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303372+0000","last_change":"2024-04-26T10:21:09.312446+0000","last_active":"2024-04-26T10:21:10.303372+0000","last_peered":"2024-04-26T10:21:10.303372+0000","last_clean":"2024-04-26T10:21:10.303372+0000","last_became_active":"2024-04-26T10:21:09.311919+0000","last_became_peered":"2024-04-26T10:21:09.311919+0000","last_unstale":"2024-04-26T10:21:10.303372+0000","last_undegraded":"2024-04-26T10:21:10.303372+0000","last_fullsized":"2024-04-26T10:21:10.303372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:57.658133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303274+0000","last_change":"2024-04-26T10:21:09.316871+0000","last_active":"2024-04-26T10:21:10.303274+0000","last_peered":"2024-04-26T10:21:10.303274+0000","last_clean":"2024-04-26T10:21:10.303274+0000","last_became_active":"2024-04-26T10:21:09.316529+0000","last_became_peered":"2024-04-26T10:21:09.316529+0000","last_unstale":"2024-04-26T10:21:10.303274+0000","last_undegraded":"2024-04-26T10:21:10.303274+0000","last_fullsized":"2024-04-26T10:21:10.303274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:52.614699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303836+0000","last_change":"2024-04-26T10:21:09.313160+0000","last_active":"2024-04-26T10:21:10.303836+0000","last_peered":"2024-04-26T10:21:10.303836+0000","last_clean":"2024-04-26T10:21:10.303836+0000","last_became_active":"2024-04-26T10:21:09.312556+0000","last_became_peered":"2024-04-26T10:21:09.312556+0000","last_unstale":"2024-04-26T10:21:10.303836+0000","last_undegraded":"2024-04-26T10:21:10.303836+0000","last_fullsized":"2024-04-26T10:21:10.303836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:21.698558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302244+0000","last_change":"2024-04-26T10:21:09.314165+0000","last_active":"2024-04-26T10:21:10.302244+0000","last_peered":"2024-04-26T10:21:10.302244+0000","last_clean":"2024-04-26T10:21:10.302244+0000","last_became_active":"2024-04-26T10:21:09.313559+0000","last_became_peered":"2024-04-26T10:21:09.313559+0000","last_unstale":"2024-04-26T10:21:10.302244+0000","last_undegraded":"2024-04-26T10:21:10.302244+0000","last_fullsized":"2024-04-26T10:21:10.302244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:05.857831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741968+0000","last_change":"2024-04-26T10:21:09.309366+0000","last_active":"2024-04-26T10:21:10.741968+0000","last_peered":"2024-04-26T10:21:10.741968+0000","last_clean":"2024-04-26T10:21:10.741968+0000","last_became_active":"2024-04-26T10:21:09.308660+0000","last_became_peered":"2024-04-26T10:21:09.308660+0000","last_unstale":"2024-04-26T10:21:10.741968+0000","last_undegraded":"2024-04-26T10:21:10.741968+0000","last_fullsized":"2024-04-26T10:21:10.741968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.335327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303113+0000","last_change":"2024-04-26T10:21:09.317455+0000","last_active":"2024-04-26T10:21:10.303113+0000","last_peered":"2024-04-26T10:21:10.303113+0000","last_clean":"2024-04-26T10:21:10.303113+0000","last_became_active":"2024-04-26T10:21:09.316994+0000","last_became_peered":"2024-04-26T10:21:09.316994+0000","last_unstale":"2024-04-26T10:21:10.303113+0000","last_undegraded":"2024-04-26T10:21:10.303113+0000","last_fullsized":"2024-04-26T10:21:10.303113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:48.942276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.317124+0000","last_change":"2024-04-26T10:21:08.939370+0000","last_active":"2024-04-26T10:21:09.317124+0000","last_peered":"2024-04-26T10:21:09.317124+0000","last_clean":"2024-04-26T10:21:09.317124+0000","last_became_active":"2024-04-26T10:21:08.937845+0000","last_became_peered":"2024-04-26T10:21:08.937845+0000","last_unstale":"2024-04-26T10:21:09.317124+0000","last_undegraded":"2024-04-26T10:21:09.317124+0000","last_fullsized":"2024-04-26T10:21:09.317124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:28.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304041+0000","last_change":"2024-04-26T10:21:09.316515+0000","last_active":"2024-04-26T10:21:10.304041+0000","last_peered":"2024-04-26T10:21:10.304041+0000","last_clean":"2024-04-26T10:21:10.304041+0000","last_became_active":"2024-04-26T10:21:09.315714+0000","last_became_peered":"2024-04-26T10:21:09.315714+0000","last_unstale":"2024-04-26T10:21:10.304041+0000","last_undegraded":"2024-04-26T10:21:10.304041+0000","last_fullsized":"2024-04-26T10:21:10.304041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.032760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296726+0000","last_change":"2024-04-26T10:21:08.937056+0000","last_active":"2024-04-26T10:21:09.296726+0000","last_peered":"2024-04-26T10:21:09.296726+0000","last_clean":"2024-04-26T10:21:09.296726+0000","last_became_active":"2024-04-26T10:21:08.936545+0000","last_became_peered":"2024-04-26T10:21:08.936545+0000","last_unstale":"2024-04-26T10:21:09.296726+0000","last_undegraded":"2024-04-26T10:21:09.296726+0000","last_fullsized":"2024-04-26T10:21:09.296726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:48.449203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304386+0000","last_change":"2024-04-26T10:21:09.313813+0000","last_active":"2024-04-26T10:21:10.304386+0000","last_peered":"2024-04-26T10:21:10.304386+0000","last_clean":"2024-04-26T10:21:10.304386+0000","last_became_active":"2024-04-26T10:21:09.312562+0000","last_became_peered":"2024-04-26T10:21:09.312562+0000","last_unstale":"2024-04-26T10:21:10.304386+0000","last_undegraded":"2024-04-26T10:21:10.304386+0000","last_fullsized":"2024-04-26T10:21:10.304386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:46.413942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309703+0000","last_change":"2024-04-26T10:21:08.936433+0000","last_active":"2024-04-26T10:21:09.309703+0000","last_peered":"2024-04-26T10:21:09.309703+0000","last_clean":"2024-04-26T10:21:09.309703+0000","last_became_active":"2024-04-26T10:21:08.935875+0000","last_became_peered":"2024-04-26T10:21:08.935875+0000","last_unstale":"2024-04-26T10:21:09.309703+0000","last_undegraded":"2024-04-26T10:21:09.309703+0000","last_fullsized":"2024-04-26T10:21:09.309703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:24.501204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303865+0000","last_change":"2024-04-26T10:21:09.314435+0000","last_active":"2024-04-26T10:21:10.303865+0000","last_peered":"2024-04-26T10:21:10.303865+0000","last_clean":"2024-04-26T10:21:10.303865+0000","last_became_active":"2024-04-26T10:21:09.313684+0000","last_became_peered":"2024-04-26T10:21:09.313684+0000","last_unstale":"2024-04-26T10:21:10.303865+0000","last_undegraded":"2024-04-26T10:21:10.303865+0000","last_fullsized":"2024-04-26T10:21:10.303865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:20.185980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.321258+0000","last_change":"2024-04-26T10:21:08.934971+0000","last_active":"2024-04-26T10:21:09.321258+0000","last_peered":"2024-04-26T10:21:09.321258+0000","last_clean":"2024-04-26T10:21:09.321258+0000","last_became_active":"2024-04-26T10:21:08.934653+0000","last_became_peered":"2024-04-26T10:21:08.934653+0000","last_unstale":"2024-04-26T10:21:09.321258+0000","last_undegraded":"2024-04-26T10:21:09.321258+0000","last_fullsized":"2024-04-26T10:21:09.321258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:18.272015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.315924+0000","last_change":"2024-04-26T10:21:08.934452+0000","last_active":"2024-04-26T10:21:09.315924+0000","last_peered":"2024-04-26T10:21:09.315924+0000","last_clean":"2024-04-26T10:21:09.315924+0000","last_became_active":"2024-04-26T10:21:08.934091+0000","last_became_peered":"2024-04-26T10:21:08.934091+0000","last_unstale":"2024-04-26T10:21:09.315924+0000","last_undegraded":"2024-04-26T10:21:09.315924+0000","last_fullsized":"2024-04-26T10:21:09.315924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:11.224989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.301898+0000","last_change":"2024-04-26T10:21:09.314631+0000","last_active":"2024-04-26T10:21:10.301898+0000","last_peered":"2024-04-26T10:21:10.301898+0000","last_clean":"2024-04-26T10:21:10.301898+0000","last_became_active":"2024-04-26T10:21:09.313044+0000","last_became_peered":"2024-04-26T10:21:09.313044+0000","last_unstale":"2024-04-26T10:21:10.301898+0000","last_undegraded":"2024-04-26T10:21:10.301898+0000","last_fullsized":"2024-04-26T10:21:10.301898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:19.943321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.319848+0000","last_change":"2024-04-26T10:21:08.935870+0000","last_active":"2024-04-26T10:21:09.319848+0000","last_peered":"2024-04-26T10:21:09.319848+0000","last_clean":"2024-04-26T10:21:09.319848+0000","last_became_active":"2024-04-26T10:21:08.935380+0000","last_became_peered":"2024-04-26T10:21:08.935380+0000","last_unstale":"2024-04-26T10:21:09.319848+0000","last_undegraded":"2024-04-26T10:21:09.319848+0000","last_fullsized":"2024-04-26T10:21:09.319848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:22.537149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302131+0000","last_change":"2024-04-26T10:21:09.317032+0000","last_active":"2024-04-26T10:21:10.302131+0000","last_peered":"2024-04-26T10:21:10.302131+0000","last_clean":"2024-04-26T10:21:10.302131+0000","last_became_active":"2024-04-26T10:21:09.316416+0000","last_became_peered":"2024-04-26T10:21:09.316416+0000","last_unstale":"2024-04-26T10:21:10.302131+0000","last_undegraded":"2024-04-26T10:21:10.302131+0000","last_fullsized":"2024-04-26T10:21:10.302131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:56.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320696+0000","last_change":"2024-04-26T10:21:08.935133+0000","last_active":"2024-04-26T10:21:09.320696+0000","last_peered":"2024-04-26T10:21:09.320696+0000","last_clean":"2024-04-26T10:21:09.320696+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:21:09.320696+0000","last_undegraded":"2024-04-26T10:21:09.320696+0000","last_fullsized":"2024-04-26T10:21:09.320696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:25.498249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743681+0000","last_change":"2024-04-26T10:21:09.315201+0000","last_active":"2024-04-26T10:21:10.743681+0000","last_peered":"2024-04-26T10:21:10.743681+0000","last_clean":"2024-04-26T10:21:10.743681+0000","last_became_active":"2024-04-26T10:21:09.314390+0000","last_became_peered":"2024-04-26T10:21:09.314390+0000","last_unstale":"2024-04-26T10:21:10.743681+0000","last_undegraded":"2024-04-26T10:21:10.743681+0000","last_fullsized":"2024-04-26T10:21:10.743681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.998466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.299090+0000","last_change":"2024-04-26T10:21:08.939382+0000","last_active":"2024-04-26T10:21:09.299090+0000","last_peered":"2024-04-26T10:21:09.299090+0000","last_clean":"2024-04-26T10:21:09.299090+0000","last_became_active":"2024-04-26T10:21:08.938193+0000","last_became_peered":"2024-04-26T10:21:08.938193+0000","last_unstale":"2024-04-26T10:21:09.299090+0000","last_undegraded":"2024-04-26T10:21:09.299090+0000","last_fullsized":"2024-04-26T10:21:09.299090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:01.182611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303014+0000","last_change":"2024-04-26T10:21:09.313678+0000","last_active":"2024-04-26T10:21:10.303014+0000","last_peered":"2024-04-26T10:21:10.303014+0000","last_clean":"2024-04-26T10:21:10.303014+0000","last_became_active":"2024-04-26T10:21:09.312906+0000","last_became_peered":"2024-04-26T10:21:09.312906+0000","last_unstale":"2024-04-26T10:21:10.303014+0000","last_undegraded":"2024-04-26T10:21:10.303014+0000","last_fullsized":"2024-04-26T10:21:10.303014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:14.241108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.313678+0000","last_change":"2024-04-26T10:21:08.936904+0000","last_active":"2024-04-26T10:21:09.313678+0000","last_peered":"2024-04-26T10:21:09.313678+0000","last_clean":"2024-04-26T10:21:09.313678+0000","last_became_active":"2024-04-26T10:21:08.936376+0000","last_became_peered":"2024-04-26T10:21:08.936376+0000","last_unstale":"2024-04-26T10:21:09.313678+0000","last_undegraded":"2024-04-26T10:21:09.313678+0000","last_fullsized":"2024-04-26T10:21:09.313678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:19.270525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742850+0000","last_change":"2024-04-26T10:21:09.307911+0000","last_active":"2024-04-26T10:21:10.742850+0000","last_peered":"2024-04-26T10:21:10.742850+0000","last_clean":"2024-04-26T10:21:10.742850+0000","last_became_active":"2024-04-26T10:21:09.307597+0000","last_became_peered":"2024-04-26T10:21:09.307597+0000","last_unstale":"2024-04-26T10:21:10.742850+0000","last_undegraded":"2024-04-26T10:21:10.742850+0000","last_fullsized":"2024-04-26T10:21:10.742850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:21.698558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.300582+0000","last_change":"2024-04-26T10:21:08.939072+0000","last_active":"2024-04-26T10:21:09.300582+0000","last_peered":"2024-04-26T10:21:09.300582+0000","last_clean":"2024-04-26T10:21:09.300582+0000","last_became_active":"2024-04-26T10:21:08.938445+0000","last_became_peered":"2024-04-26T10:21:08.938445+0000","last_unstale":"2024-04-26T10:21:09.300582+0000","last_undegraded":"2024-04-26T10:21:09.300582+0000","last_fullsized":"2024-04-26T10:21:09.300582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:06.598189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743938+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:21:10.743938+0000","last_peered":"2024-04-26T10:21:10.743938+0000","last_clean":"2024-04-26T10:21:10.743938+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:21:10.743938+0000","last_undegraded":"2024-04-26T10:21:10.743938+0000","last_fullsized":"2024-04-26T10:21:10.743938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309935+0000","last_change":"2024-04-26T10:21:08.936533+0000","last_active":"2024-04-26T10:21:09.309935+0000","last_peered":"2024-04-26T10:21:09.309935+0000","last_clean":"2024-04-26T10:21:09.309935+0000","last_became_active":"2024-04-26T10:21:08.936222+0000","last_became_peered":"2024-04-26T10:21:08.936222+0000","last_unstale":"2024-04-26T10:21:09.309935+0000","last_undegraded":"2024-04-26T10:21:09.309935+0000","last_fullsized":"2024-04-26T10:21:09.309935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:18:07.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742771+0000","last_change":"2024-04-26T10:21:09.316361+0000","last_active":"2024-04-26T10:21:10.742771+0000","last_peered":"2024-04-26T10:21:10.742771+0000","last_clean":"2024-04-26T10:21:10.742771+0000","last_became_active":"2024-04-26T10:21:09.315981+0000","last_became_peered":"2024-04-26T10:21:09.315981+0000","last_unstale":"2024-04-26T10:21:10.742771+0000","last_undegraded":"2024-04-26T10:21:10.742771+0000","last_fullsized":"2024-04-26T10:21:10.742771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:00.173638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309815+0000","last_change":"2024-04-26T10:21:08.928590+0000","last_active":"2024-04-26T10:21:09.309815+0000","last_peered":"2024-04-26T10:21:09.309815+0000","last_clean":"2024-04-26T10:21:09.309815+0000","last_became_active":"2024-04-26T10:21:08.928354+0000","last_became_peered":"2024-04-26T10:21:08.928354+0000","last_unstale":"2024-04-26T10:21:09.309815+0000","last_undegraded":"2024-04-26T10:21:09.309815+0000","last_fullsized":"2024-04-26T10:21:09.309815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:52.241716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304119+0000","last_change":"2024-04-26T10:21:09.317282+0000","last_active":"2024-04-26T10:21:10.304119+0000","last_peered":"2024-04-26T10:21:10.304119+0000","last_clean":"2024-04-26T10:21:10.304119+0000","last_became_active":"2024-04-26T10:21:09.316591+0000","last_became_peered":"2024-04-26T10:21:09.316591+0000","last_unstale":"2024-04-26T10:21:10.304119+0000","last_undegraded":"2024-04-26T10:21:10.304119+0000","last_fullsized":"2024-04-26T10:21:10.304119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:28.447361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":213,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297609+0000","last_change":"2024-04-26T10:21:01.829140+0000","last_active":"2024-04-26T10:21:09.297609+0000","last_peered":"2024-04-26T10:21:09.297609+0000","last_clean":"2024-04-26T10:21:09.297609+0000","last_became_active":"2024-04-26T10:21:01.827182+0000","last_became_peered":"2024-04-26T10:21:01.827182+0000","last_unstale":"2024-04-26T10:21:09.297609+0000","last_undegraded":"2024-04-26T10:21:09.297609+0000","last_fullsized":"2024-04-26T10:21:09.297609+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:00:51.477222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298874+0000","last_change":"2024-04-26T10:21:04.893745+0000","last_active":"2024-04-26T10:21:09.298874+0000","last_peered":"2024-04-26T10:21:09.298874+0000","last_clean":"2024-04-26T10:21:09.298874+0000","last_became_active":"2024-04-26T10:21:04.893031+0000","last_became_peered":"2024-04-26T10:21:04.893031+0000","last_unstale":"2024-04-26T10:21:09.298874+0000","last_undegraded":"2024-04-26T10:21:09.298874+0000","last_fullsized":"2024-04-26T10:21:09.298874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:59.771061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297001+0000","last_change":"2024-04-26T10:21:08.933706+0000","last_active":"2024-04-26T10:21:09.297001+0000","last_peered":"2024-04-26T10:21:09.297001+0000","last_clean":"2024-04-26T10:21:09.297001+0000","last_became_active":"2024-04-26T10:21:08.933372+0000","last_became_peered":"2024-04-26T10:21:08.933372+0000","last_unstale":"2024-04-26T10:21:09.297001+0000","last_undegraded":"2024-04-26T10:21:09.297001+0000","last_fullsized":"2024-04-26T10:21:09.297001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:14.290484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.744176+0000","last_change":"2024-04-26T10:21:09.320889+0000","last_active":"2024-04-26T10:21:10.744176+0000","last_peered":"2024-04-26T10:21:10.744176+0000","last_clean":"2024-04-26T10:21:10.744176+0000","last_became_active":"2024-04-26T10:21:09.320355+0000","last_became_peered":"2024-04-26T10:21:09.320355+0000","last_unstale":"2024-04-26T10:21:10.744176+0000","last_undegraded":"2024-04-26T10:21:10.744176+0000","last_fullsized":"2024-04-26T10:21:10.744176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:41.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297382+0000","last_change":"2024-04-26T10:21:04.892156+0000","last_active":"2024-04-26T10:21:09.297382+0000","last_peered":"2024-04-26T10:21:09.297382+0000","last_clean":"2024-04-26T10:21:09.297382+0000","last_became_active":"2024-04-26T10:21:04.891660+0000","last_became_peered":"2024-04-26T10:21:04.891660+0000","last_unstale":"2024-04-26T10:21:09.297382+0000","last_undegraded":"2024-04-26T10:21:09.297382+0000","last_fullsized":"2024-04-26T10:21:09.297382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:50.568468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296858+0000","last_change":"2024-04-26T10:21:08.936815+0000","last_active":"2024-04-26T10:21:09.296858+0000","last_peered":"2024-04-26T10:21:09.296858+0000","last_clean":"2024-04-26T10:21:09.296858+0000","last_became_active":"2024-04-26T10:21:08.936180+0000","last_became_peered":"2024-04-26T10:21:08.936180+0000","last_unstale":"2024-04-26T10:21:09.296858+0000","last_undegraded":"2024-04-26T10:21:09.296858+0000","last_fullsized":"2024-04-26T10:21:09.296858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:41.614282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304366+0000","last_change":"2024-04-26T10:21:09.310050+0000","last_active":"2024-04-26T10:21:10.304366+0000","last_peered":"2024-04-26T10:21:10.304366+0000","last_clean":"2024-04-26T10:21:10.304366+0000","last_became_active":"2024-04-26T10:21:09.309470+0000","last_became_peered":"2024-04-26T10:21:09.309470+0000","last_unstale":"2024-04-26T10:21:10.304366+0000","last_undegraded":"2024-04-26T10:21:10.304366+0000","last_fullsized":"2024-04-26T10:21:10.304366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:32.334144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296330+0000","last_change":"2024-04-26T10:21:04.890860+0000","last_active":"2024-04-26T10:21:09.296330+0000","last_peered":"2024-04-26T10:21:09.296330+0000","last_clean":"2024-04-26T10:21:09.296330+0000","last_became_active":"2024-04-26T10:21:04.890336+0000","last_became_peered":"2024-04-26T10:21:04.890336+0000","last_unstale":"2024-04-26T10:21:09.296330+0000","last_undegraded":"2024-04-26T10:21:09.296330+0000","last_fullsized":"2024-04-26T10:21:09.296330+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:13.262120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.310359+0000","last_change":"2024-04-26T10:21:08.936077+0000","last_active":"2024-04-26T10:21:09.310359+0000","last_peered":"2024-04-26T10:21:09.310359+0000","last_clean":"2024-04-26T10:21:09.310359+0000","last_became_active":"2024-04-26T10:21:08.935621+0000","last_became_peered":"2024-04-26T10:21:08.935621+0000","last_unstale":"2024-04-26T10:21:09.310359+0000","last_undegraded":"2024-04-26T10:21:09.310359+0000","last_fullsized":"2024-04-26T10:21:09.310359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:11.906094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304130+0000","last_change":"2024-04-26T10:21:09.314796+0000","last_active":"2024-04-26T10:21:10.304130+0000","last_peered":"2024-04-26T10:21:10.304130+0000","last_clean":"2024-04-26T10:21:10.304130+0000","last_became_active":"2024-04-26T10:21:09.314574+0000","last_became_peered":"2024-04-26T10:21:09.314574+0000","last_unstale":"2024-04-26T10:21:10.304130+0000","last_undegraded":"2024-04-26T10:21:10.304130+0000","last_fullsized":"2024-04-26T10:21:10.304130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:32.136621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301803+0000","last_change":"2024-04-26T10:21:04.893253+0000","last_active":"2024-04-26T10:21:09.301803+0000","last_peered":"2024-04-26T10:21:09.301803+0000","last_clean":"2024-04-26T10:21:09.301803+0000","last_became_active":"2024-04-26T10:21:04.892843+0000","last_became_peered":"2024-04-26T10:21:04.892843+0000","last_unstale":"2024-04-26T10:21:09.301803+0000","last_undegraded":"2024-04-26T10:21:09.301803+0000","last_fullsized":"2024-04-26T10:21:09.301803+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:00.749791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298626+0000","last_change":"2024-04-26T10:21:08.937153+0000","last_active":"2024-04-26T10:21:09.298626+0000","last_peered":"2024-04-26T10:21:09.298626+0000","last_clean":"2024-04-26T10:21:09.298626+0000","last_became_active":"2024-04-26T10:21:08.936561+0000","last_became_peered":"2024-04-26T10:21:08.936561+0000","last_unstale":"2024-04-26T10:21:09.298626+0000","last_undegraded":"2024-04-26T10:21:09.298626+0000","last_fullsized":"2024-04-26T10:21:09.298626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:28.491800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303941+0000","last_change":"2024-04-26T10:21:09.314218+0000","last_active":"2024-04-26T10:21:10.303941+0000","last_peered":"2024-04-26T10:21:10.303941+0000","last_clean":"2024-04-26T10:21:10.303941+0000","last_became_active":"2024-04-26T10:21:09.313641+0000","last_became_peered":"2024-04-26T10:21:09.313641+0000","last_unstale":"2024-04-26T10:21:10.303941+0000","last_undegraded":"2024-04-26T10:21:10.303941+0000","last_fullsized":"2024-04-26T10:21:10.303941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:08.449512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.300397+0000","last_change":"2024-04-26T10:21:08.937196+0000","last_active":"2024-04-26T10:21:09.300397+0000","last_peered":"2024-04-26T10:21:09.300397+0000","last_clean":"2024-04-26T10:21:09.300397+0000","last_became_active":"2024-04-26T10:21:08.936779+0000","last_became_peered":"2024-04-26T10:21:08.936779+0000","last_unstale":"2024-04-26T10:21:09.300397+0000","last_undegraded":"2024-04-26T10:21:09.300397+0000","last_fullsized":"2024-04-26T10:21:09.300397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:20.545169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295561+0000","last_change":"2024-04-26T10:21:04.890548+0000","last_active":"2024-04-26T10:21:09.295561+0000","last_peered":"2024-04-26T10:21:09.295561+0000","last_clean":"2024-04-26T10:21:09.295561+0000","last_became_active":"2024-04-26T10:21:04.890034+0000","last_became_peered":"2024-04-26T10:21:04.890034+0000","last_unstale":"2024-04-26T10:21:09.295561+0000","last_undegraded":"2024-04-26T10:21:09.295561+0000","last_fullsized":"2024-04-26T10:21:09.295561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:55.033455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302442+0000","last_change":"2024-04-26T10:21:09.318348+0000","last_active":"2024-04-26T10:21:10.302442+0000","last_peered":"2024-04-26T10:21:10.302442+0000","last_clean":"2024-04-26T10:21:10.302442+0000","last_became_active":"2024-04-26T10:21:09.317886+0000","last_became_peered":"2024-04-26T10:21:09.317886+0000","last_unstale":"2024-04-26T10:21:10.302442+0000","last_undegraded":"2024-04-26T10:21:10.302442+0000","last_fullsized":"2024-04-26T10:21:10.302442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:24.624358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295394+0000","last_change":"2024-04-26T10:21:08.933714+0000","last_active":"2024-04-26T10:21:09.295394+0000","last_peered":"2024-04-26T10:21:09.295394+0000","last_clean":"2024-04-26T10:21:09.295394+0000","last_became_active":"2024-04-26T10:21:08.933259+0000","last_became_peered":"2024-04-26T10:21:08.933259+0000","last_unstale":"2024-04-26T10:21:09.295394+0000","last_undegraded":"2024-04-26T10:21:09.295394+0000","last_fullsized":"2024-04-26T10:21:09.295394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:50.230096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.311683+0000","last_change":"2024-04-26T10:21:04.891490+0000","last_active":"2024-04-26T10:21:09.311683+0000","last_peered":"2024-04-26T10:21:09.311683+0000","last_clean":"2024-04-26T10:21:09.311683+0000","last_became_active":"2024-04-26T10:21:04.890777+0000","last_became_peered":"2024-04-26T10:21:04.890777+0000","last_unstale":"2024-04-26T10:21:09.311683+0000","last_undegraded":"2024-04-26T10:21:09.311683+0000","last_fullsized":"2024-04-26T10:21:09.311683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:25.896672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302680+0000","last_change":"2024-04-26T10:21:09.314213+0000","last_active":"2024-04-26T10:21:10.302680+0000","last_peered":"2024-04-26T10:21:10.302680+0000","last_clean":"2024-04-26T10:21:10.302680+0000","last_became_active":"2024-04-26T10:21:09.312975+0000","last_became_peered":"2024-04-26T10:21:09.312975+0000","last_unstale":"2024-04-26T10:21:10.302680+0000","last_undegraded":"2024-04-26T10:21:10.302680+0000","last_fullsized":"2024-04-26T10:21:10.302680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:43.137127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.317699+0000","last_change":"2024-04-26T10:21:08.934216+0000","last_active":"2024-04-26T10:21:09.317699+0000","last_peered":"2024-04-26T10:21:09.317699+0000","last_clean":"2024-04-26T10:21:09.317699+0000","last_became_active":"2024-04-26T10:21:08.933524+0000","last_became_peered":"2024-04-26T10:21:08.933524+0000","last_unstale":"2024-04-26T10:21:09.317699+0000","last_undegraded":"2024-04-26T10:21:09.317699+0000","last_fullsized":"2024-04-26T10:21:09.317699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:57.798830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297318+0000","last_change":"2024-04-26T10:21:04.890490+0000","last_active":"2024-04-26T10:21:09.297318+0000","last_peered":"2024-04-26T10:21:09.297318+0000","last_clean":"2024-04-26T10:21:09.297318+0000","last_became_active":"2024-04-26T10:21:04.889808+0000","last_became_peered":"2024-04-26T10:21:04.889808+0000","last_unstale":"2024-04-26T10:21:09.297318+0000","last_undegraded":"2024-04-26T10:21:09.297318+0000","last_fullsized":"2024-04-26T10:21:09.297318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:55.711555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302374+0000","last_change":"2024-04-26T10:21:09.312260+0000","last_active":"2024-04-26T10:21:10.302374+0000","last_peered":"2024-04-26T10:21:10.302374+0000","last_clean":"2024-04-26T10:21:10.302374+0000","last_became_active":"2024-04-26T10:21:09.311309+0000","last_became_peered":"2024-04-26T10:21:09.311309+0000","last_unstale":"2024-04-26T10:21:10.302374+0000","last_undegraded":"2024-04-26T10:21:10.302374+0000","last_fullsized":"2024-04-26T10:21:10.302374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:30.714581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304472+0000","last_change":"2024-04-26T10:21:08.936623+0000","last_active":"2024-04-26T10:21:10.304472+0000","last_peered":"2024-04-26T10:21:10.304472+0000","last_clean":"2024-04-26T10:21:10.304472+0000","last_became_active":"2024-04-26T10:21:08.936252+0000","last_became_peered":"2024-04-26T10:21:08.936252+0000","last_unstale":"2024-04-26T10:21:10.304472+0000","last_undegraded":"2024-04-26T10:21:10.304472+0000","last_fullsized":"2024-04-26T10:21:10.304472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:24.526250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296848+0000","last_change":"2024-04-26T10:21:04.892401+0000","last_active":"2024-04-26T10:21:09.296848+0000","last_peered":"2024-04-26T10:21:09.296848+0000","last_clean":"2024-04-26T10:21:09.296848+0000","last_became_active":"2024-04-26T10:21:04.891692+0000","last_became_peered":"2024-04-26T10:21:04.891692+0000","last_unstale":"2024-04-26T10:21:09.296848+0000","last_undegraded":"2024-04-26T10:21:09.296848+0000","last_fullsized":"2024-04-26T10:21:09.296848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:37.548728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302178+0000","last_change":"2024-04-26T10:21:09.317981+0000","last_active":"2024-04-26T10:21:10.302178+0000","last_peered":"2024-04-26T10:21:10.302178+0000","last_clean":"2024-04-26T10:21:10.302178+0000","last_became_active":"2024-04-26T10:21:09.317601+0000","last_became_peered":"2024-04-26T10:21:09.317601+0000","last_unstale":"2024-04-26T10:21:10.302178+0000","last_undegraded":"2024-04-26T10:21:10.302178+0000","last_fullsized":"2024-04-26T10:21:10.302178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742909+0000","last_change":"2024-04-26T10:21:09.317120+0000","last_active":"2024-04-26T10:21:10.742909+0000","last_peered":"2024-04-26T10:21:10.742909+0000","last_clean":"2024-04-26T10:21:10.742909+0000","last_became_active":"2024-04-26T10:21:09.316741+0000","last_became_peered":"2024-04-26T10:21:09.316741+0000","last_unstale":"2024-04-26T10:21:10.742909+0000","last_undegraded":"2024-04-26T10:21:10.742909+0000","last_fullsized":"2024-04-26T10:21:10.742909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:43.702714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.326574+0000","last_change":"2024-04-26T10:21:08.934481+0000","last_active":"2024-04-26T10:21:09.326574+0000","last_peered":"2024-04-26T10:21:09.326574+0000","last_clean":"2024-04-26T10:21:09.326574+0000","last_became_active":"2024-04-26T10:21:08.934076+0000","last_became_peered":"2024-04-26T10:21:08.934076+0000","last_unstale":"2024-04-26T10:21:09.326574+0000","last_undegraded":"2024-04-26T10:21:09.326574+0000","last_fullsized":"2024-04-26T10:21:09.326574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:50.622715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302791+0000","last_change":"2024-04-26T10:21:09.314009+0000","last_active":"2024-04-26T10:21:10.302791+0000","last_peered":"2024-04-26T10:21:10.302791+0000","last_clean":"2024-04-26T10:21:10.302791+0000","last_became_active":"2024-04-26T10:21:09.313556+0000","last_became_peered":"2024-04-26T10:21:09.313556+0000","last_unstale":"2024-04-26T10:21:10.302791+0000","last_undegraded":"2024-04-26T10:21:10.302791+0000","last_fullsized":"2024-04-26T10:21:10.302791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:34.862466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320711+0000","last_change":"2024-04-26T10:21:08.936526+0000","last_active":"2024-04-26T10:21:09.320711+0000","last_peered":"2024-04-26T10:21:09.320711+0000","last_clean":"2024-04-26T10:21:09.320711+0000","last_became_active":"2024-04-26T10:21:08.936217+0000","last_became_peered":"2024-04-26T10:21:08.936217+0000","last_unstale":"2024-04-26T10:21:09.320711+0000","last_undegraded":"2024-04-26T10:21:09.320711+0000","last_fullsized":"2024-04-26T10:21:09.320711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:57.649639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301807+0000","last_change":"2024-04-26T10:21:08.937597+0000","last_active":"2024-04-26T10:21:09.301807+0000","last_peered":"2024-04-26T10:21:09.301807+0000","last_clean":"2024-04-26T10:21:09.301807+0000","last_became_active":"2024-04-26T10:21:08.936809+0000","last_became_peered":"2024-04-26T10:21:08.936809+0000","last_unstale":"2024-04-26T10:21:09.301807+0000","last_undegraded":"2024-04-26T10:21:09.301807+0000","last_fullsized":"2024-04-26T10:21:09.301807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:17.212235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302338+0000","last_change":"2024-04-26T10:21:09.312054+0000","last_active":"2024-04-26T10:21:10.302338+0000","last_peered":"2024-04-26T10:21:10.302338+0000","last_clean":"2024-04-26T10:21:10.302338+0000","last_became_active":"2024-04-26T10:21:09.310818+0000","last_became_peered":"2024-04-26T10:21:09.310818+0000","last_unstale":"2024-04-26T10:21:10.302338+0000","last_undegraded":"2024-04-26T10:21:10.302338+0000","last_fullsized":"2024-04-26T10:21:10.302338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:03.431355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301359+0000","last_change":"2024-04-26T10:21:08.937445+0000","last_active":"2024-04-26T10:21:09.301359+0000","last_peered":"2024-04-26T10:21:09.301359+0000","last_clean":"2024-04-26T10:21:09.301359+0000","last_became_active":"2024-04-26T10:21:08.937147+0000","last_became_peered":"2024-04-26T10:21:08.937147+0000","last_unstale":"2024-04-26T10:21:09.301359+0000","last_undegraded":"2024-04-26T10:21:09.301359+0000","last_fullsized":"2024-04-26T10:21:09.301359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:29.602825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302232+0000","last_change":"2024-04-26T10:21:09.318091+0000","last_active":"2024-04-26T10:21:10.302232+0000","last_peered":"2024-04-26T10:21:10.302232+0000","last_clean":"2024-04-26T10:21:10.302232+0000","last_became_active":"2024-04-26T10:21:09.317871+0000","last_became_peered":"2024-04-26T10:21:09.317871+0000","last_unstale":"2024-04-26T10:21:10.302232+0000","last_undegraded":"2024-04-26T10:21:10.302232+0000","last_fullsized":"2024-04-26T10:21:10.302232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:32.442915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303867+0000","last_change":"2024-04-26T10:21:09.312636+0000","last_active":"2024-04-26T10:21:10.303867+0000","last_peered":"2024-04-26T10:21:10.303867+0000","last_clean":"2024-04-26T10:21:10.303867+0000","last_became_active":"2024-04-26T10:21:09.312130+0000","last_became_peered":"2024-04-26T10:21:09.312130+0000","last_unstale":"2024-04-26T10:21:10.303867+0000","last_undegraded":"2024-04-26T10:21:10.303867+0000","last_fullsized":"2024-04-26T10:21:10.303867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:29.565507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298243+0000","last_change":"2024-04-26T10:21:08.934046+0000","last_active":"2024-04-26T10:21:09.298243+0000","last_peered":"2024-04-26T10:21:09.298243+0000","last_clean":"2024-04-26T10:21:09.298243+0000","last_became_active":"2024-04-26T10:21:08.933341+0000","last_became_peered":"2024-04-26T10:21:08.933341+0000","last_unstale":"2024-04-26T10:21:09.298243+0000","last_undegraded":"2024-04-26T10:21:09.298243+0000","last_fullsized":"2024-04-26T10:21:09.298243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:45.671865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303860+0000","last_change":"2024-04-26T10:21:09.312081+0000","last_active":"2024-04-26T10:21:10.303860+0000","last_peered":"2024-04-26T10:21:10.303860+0000","last_clean":"2024-04-26T10:21:10.303860+0000","last_became_active":"2024-04-26T10:21:09.310879+0000","last_became_peered":"2024-04-26T10:21:09.310879+0000","last_unstale":"2024-04-26T10:21:10.303860+0000","last_undegraded":"2024-04-26T10:21:10.303860+0000","last_fullsized":"2024-04-26T10:21:10.303860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:36.358962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295619+0000","last_change":"2024-04-26T10:21:08.936748+0000","last_active":"2024-04-26T10:21:09.295619+0000","last_peered":"2024-04-26T10:21:09.295619+0000","last_clean":"2024-04-26T10:21:09.295619+0000","last_became_active":"2024-04-26T10:21:08.936316+0000","last_became_peered":"2024-04-26T10:21:08.936316+0000","last_unstale":"2024-04-26T10:21:09.295619+0000","last_undegraded":"2024-04-26T10:21:09.295619+0000","last_fullsized":"2024-04-26T10:21:09.295619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:47.721288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303753+0000","last_change":"2024-04-26T10:21:09.320062+0000","last_active":"2024-04-26T10:21:10.303753+0000","last_peered":"2024-04-26T10:21:10.303753+0000","last_clean":"2024-04-26T10:21:10.303753+0000","last_became_active":"2024-04-26T10:21:09.319352+0000","last_became_peered":"2024-04-26T10:21:09.319352+0000","last_unstale":"2024-04-26T10:21:10.303753+0000","last_undegraded":"2024-04-26T10:21:10.303753+0000","last_fullsized":"2024-04-26T10:21:10.303753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.998466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316248+0000","last_change":"2024-04-26T10:21:08.931356+0000","last_active":"2024-04-26T10:21:09.316248+0000","last_peered":"2024-04-26T10:21:09.316248+0000","last_clean":"2024-04-26T10:21:09.316248+0000","last_became_active":"2024-04-26T10:21:08.930016+0000","last_became_peered":"2024-04-26T10:21:08.930016+0000","last_unstale":"2024-04-26T10:21:09.316248+0000","last_undegraded":"2024-04-26T10:21:09.316248+0000","last_fullsized":"2024-04-26T10:21:09.316248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:21.306576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303057+0000","last_change":"2024-04-26T10:21:09.318178+0000","last_active":"2024-04-26T10:21:10.303057+0000","last_peered":"2024-04-26T10:21:10.303057+0000","last_clean":"2024-04-26T10:21:10.303057+0000","last_became_active":"2024-04-26T10:21:09.317697+0000","last_became_peered":"2024-04-26T10:21:09.317697+0000","last_unstale":"2024-04-26T10:21:10.303057+0000","last_undegraded":"2024-04-26T10:21:10.303057+0000","last_fullsized":"2024-04-26T10:21:10.303057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:46.285390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320054+0000","last_change":"2024-04-26T10:21:08.936115+0000","last_active":"2024-04-26T10:21:09.320054+0000","last_peered":"2024-04-26T10:21:09.320054+0000","last_clean":"2024-04-26T10:21:09.320054+0000","last_became_active":"2024-04-26T10:21:08.935740+0000","last_became_peered":"2024-04-26T10:21:08.935740+0000","last_unstale":"2024-04-26T10:21:09.320054+0000","last_undegraded":"2024-04-26T10:21:09.320054+0000","last_fullsized":"2024-04-26T10:21:09.320054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:08.369059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742450+0000","last_change":"2024-04-26T10:21:09.308077+0000","last_active":"2024-04-26T10:21:10.742450+0000","last_peered":"2024-04-26T10:21:10.742450+0000","last_clean":"2024-04-26T10:21:10.742450+0000","last_became_active":"2024-04-26T10:21:09.307543+0000","last_became_peered":"2024-04-26T10:21:09.307543+0000","last_unstale":"2024-04-26T10:21:10.742450+0000","last_undegraded":"2024-04-26T10:21:10.742450+0000","last_fullsized":"2024-04-26T10:21:10.742450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:46.596591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316572+0000","last_change":"2024-04-26T10:21:08.938933+0000","last_active":"2024-04-26T10:21:09.316572+0000","last_peered":"2024-04-26T10:21:09.316572+0000","last_clean":"2024-04-26T10:21:09.316572+0000","last_became_active":"2024-04-26T10:21:08.938281+0000","last_became_peered":"2024-04-26T10:21:08.938281+0000","last_unstale":"2024-04-26T10:21:09.316572+0000","last_undegraded":"2024-04-26T10:21:09.316572+0000","last_fullsized":"2024-04-26T10:21:09.316572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:50.856581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743973+0000","last_change":"2024-04-26T10:21:09.315331+0000","last_active":"2024-04-26T10:21:10.743973+0000","last_peered":"2024-04-26T10:21:10.743973+0000","last_clean":"2024-04-26T10:21:10.743973+0000","last_became_active":"2024-04-26T10:21:09.314523+0000","last_became_peered":"2024-04-26T10:21:09.314523+0000","last_unstale":"2024-04-26T10:21:10.743973+0000","last_undegraded":"2024-04-26T10:21:10.743973+0000","last_fullsized":"2024-04-26T10:21:10.743973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:24.624358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320722+0000","last_change":"2024-04-26T10:21:08.936791+0000","last_active":"2024-04-26T10:21:09.320722+0000","last_peered":"2024-04-26T10:21:09.320722+0000","last_clean":"2024-04-26T10:21:09.320722+0000","last_became_active":"2024-04-26T10:21:08.936469+0000","last_became_peered":"2024-04-26T10:21:08.936469+0000","last_unstale":"2024-04-26T10:21:09.320722+0000","last_undegraded":"2024-04-26T10:21:09.320722+0000","last_fullsized":"2024-04-26T10:21:09.320722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:14.145721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302806+0000","last_change":"2024-04-26T10:21:09.315299+0000","last_active":"2024-04-26T10:21:10.302806+0000","last_peered":"2024-04-26T10:21:10.302806+0000","last_clean":"2024-04-26T10:21:10.302806+0000","last_became_active":"2024-04-26T10:21:09.314896+0000","last_became_peered":"2024-04-26T10:21:09.314896+0000","last_unstale":"2024-04-26T10:21:10.302806+0000","last_undegraded":"2024-04-26T10:21:10.302806+0000","last_fullsized":"2024-04-26T10:21:10.302806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.174824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316992+0000","last_change":"2024-04-26T10:21:08.933424+0000","last_active":"2024-04-26T10:21:09.316992+0000","last_peered":"2024-04-26T10:21:09.316992+0000","last_clean":"2024-04-26T10:21:09.316992+0000","last_became_active":"2024-04-26T10:21:08.933088+0000","last_became_peered":"2024-04-26T10:21:08.933088+0000","last_unstale":"2024-04-26T10:21:09.316992+0000","last_undegraded":"2024-04-26T10:21:09.316992+0000","last_fullsized":"2024-04-26T10:21:09.316992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:55.394913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742760+0000","last_change":"2024-04-26T10:21:09.308831+0000","last_active":"2024-04-26T10:21:10.742760+0000","last_peered":"2024-04-26T10:21:10.742760+0000","last_clean":"2024-04-26T10:21:10.742760+0000","last_became_active":"2024-04-26T10:21:09.308457+0000","last_became_peered":"2024-04-26T10:21:09.308457+0000","last_unstale":"2024-04-26T10:21:10.742760+0000","last_undegraded":"2024-04-26T10:21:10.742760+0000","last_fullsized":"2024-04-26T10:21:10.742760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:43.137127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.314230+0000","last_change":"2024-04-26T10:21:08.937023+0000","last_active":"2024-04-26T10:21:09.314230+0000","last_peered":"2024-04-26T10:21:09.314230+0000","last_clean":"2024-04-26T10:21:09.314230+0000","last_became_active":"2024-04-26T10:21:08.936511+0000","last_became_peered":"2024-04-26T10:21:08.936511+0000","last_unstale":"2024-04-26T10:21:09.314230+0000","last_undegraded":"2024-04-26T10:21:09.314230+0000","last_fullsized":"2024-04-26T10:21:09.314230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:38.881531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":653928,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]}]},{"osd":0,"up_from":10,"seq":42949672967,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":270336,"data_stored":654544,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":188416,"data_stored":62430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:21:21.569 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T10:21:21.569 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-26T10:21:21.569 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-26T10:21:21.569 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-26T10:21:21.904 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:21.904 INFO:teuthology.orchestra.run.smithi052.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-26T10:21:21.926 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-26T10:21:21.926 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:21:22.231 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:22.232 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","created":"2024-04-26T10:20:48.363934+0000","modified":"2024-04-26T10:21:10.288209+0000","last_up_change":"2024-04-26T10:20:58.098141+0000","last_in_change":"2024-04-26T10:20:49.575442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:20:59.994755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:21:03.866927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:21:07.853429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:21:08.285131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5e76c47-dfc4-40ca-88d3-2084cac6e35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":18193},{"type":"v1","addr":"172.21.15.120:6801","nonce":18193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":18193},{"type":"v1","addr":"172.21.15.120:6803","nonce":18193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":18193},{"type":"v1","addr":"172.21.15.120:6807","nonce":18193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":18193},{"type":"v1","addr":"172.21.15.120:6805","nonce":18193}]},"public_addr":"172.21.15.120:6801/18193","cluster_addr":"172.21.15.120:6803/18193","heartbeat_back_addr":"172.21.15.120:6807/18193","heartbeat_front_addr":"172.21.15.120:6805/18193","state":["exists","up"]},{"osd":1,"uuid":"2a8d530c-cf33-4540-9240-6bd7485e06ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":18226},{"type":"v1","addr":"172.21.15.154:6801","nonce":18226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":18226},{"type":"v1","addr":"172.21.15.154:6803","nonce":18226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":18226},{"type":"v1","addr":"172.21.15.154:6807","nonce":18226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":18226},{"type":"v1","addr":"172.21.15.154:6805","nonce":18226}]},"public_addr":"172.21.15.154:6801/18226","cluster_addr":"172.21.15.154:6803/18226","heartbeat_back_addr":"172.21.15.154:6807/18226","heartbeat_front_addr":"172.21.15.154:6805/18226","state":["exists","up"]},{"osd":2,"uuid":"484ab70f-4cad-4ff6-9405-8865ec5ee327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":18269},{"type":"v1","addr":"172.21.15.164:6801","nonce":18269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":18269},{"type":"v1","addr":"172.21.15.164:6803","nonce":18269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":18269},{"type":"v1","addr":"172.21.15.164:6807","nonce":18269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":18269},{"type":"v1","addr":"172.21.15.164:6805","nonce":18269}]},"public_addr":"172.21.15.164:6801/18269","cluster_addr":"172.21.15.164:6803/18269","heartbeat_back_addr":"172.21.15.164:6807/18269","heartbeat_front_addr":"172.21.15.164:6805/18269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.871567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.910527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.761919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:21:22.246 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:20:59.994755+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:21:03.866927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T10:21:07.853429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T10:21:08.285131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T10:21:22.247 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T10:21:22.541 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-26T10:21:22.556 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T10:21:22.866 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2024-04-26T10:21:22.882 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T10:21:23.180 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-26T10:21:23.200 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T10:21:23.506 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-04-26T10:21:23.522 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:21:23.856 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:23.856 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T10:21:09.285446+0000","modified":"2024-04-26T10:21:12.296930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4233":{"gid":4233,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6803/2540560872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2540560872},{"type":"v1","addr":"172.21.15.52:6803","nonce":2540560872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T10:21:23.860 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 6 2024-04-26T10:21:23.871 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:21:24.177 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:24.178 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","created":"2024-04-26T10:20:48.363934+0000","modified":"2024-04-26T10:21:10.288209+0000","last_up_change":"2024-04-26T10:20:58.098141+0000","last_in_change":"2024-04-26T10:20:49.575442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:20:59.994755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:21:03.866927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:21:07.853429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:21:08.285131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5e76c47-dfc4-40ca-88d3-2084cac6e35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":18193},{"type":"v1","addr":"172.21.15.120:6801","nonce":18193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":18193},{"type":"v1","addr":"172.21.15.120:6803","nonce":18193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":18193},{"type":"v1","addr":"172.21.15.120:6807","nonce":18193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":18193},{"type":"v1","addr":"172.21.15.120:6805","nonce":18193}]},"public_addr":"172.21.15.120:6801/18193","cluster_addr":"172.21.15.120:6803/18193","heartbeat_back_addr":"172.21.15.120:6807/18193","heartbeat_front_addr":"172.21.15.120:6805/18193","state":["exists","up"]},{"osd":1,"uuid":"2a8d530c-cf33-4540-9240-6bd7485e06ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":18226},{"type":"v1","addr":"172.21.15.154:6801","nonce":18226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":18226},{"type":"v1","addr":"172.21.15.154:6803","nonce":18226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":18226},{"type":"v1","addr":"172.21.15.154:6807","nonce":18226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":18226},{"type":"v1","addr":"172.21.15.154:6805","nonce":18226}]},"public_addr":"172.21.15.154:6801/18226","cluster_addr":"172.21.15.154:6803/18226","heartbeat_back_addr":"172.21.15.154:6807/18226","heartbeat_front_addr":"172.21.15.154:6805/18226","state":["exists","up"]},{"osd":2,"uuid":"484ab70f-4cad-4ff6-9405-8865ec5ee327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":18269},{"type":"v1","addr":"172.21.15.164:6801","nonce":18269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":18269},{"type":"v1","addr":"172.21.15.164:6803","nonce":18269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":18269},{"type":"v1","addr":"172.21.15.164:6807","nonce":18269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":18269},{"type":"v1","addr":"172.21.15.164:6805","nonce":18269}]},"public_addr":"172.21.15.164:6801/18269","cluster_addr":"172.21.15.164:6803/18269","heartbeat_back_addr":"172.21.15.164:6807/18269","heartbeat_front_addr":"172.21.15.164:6805/18269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.871567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.910527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.761919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:21:24.192 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:20:59.994755+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:21:03.866927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T10:21:07.853429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T10:21:08.285131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-26T10:21:24.193 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-26T10:21:24.501 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 1 2024-04-26T10:21:24.514 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-26T10:21:24.822 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 8 2024-04-26T10:21:24.837 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-26T10:21:25.148 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 32 2024-04-26T10:21:25.168 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-26T10:21:25.478 INFO:teuthology.orchestra.run.smithi052.stdout:pg_num: 64 2024-04-26T10:21:25.501 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:21:25.843 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:25.843 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T10:21:09.285446+0000","modified":"2024-04-26T10:21:12.296930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4233":{"gid":4233,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6803/2540560872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2540560872},{"type":"v1","addr":"172.21.15.52:6803","nonce":2540560872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T10:21:25.846 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 6 2024-04-26T10:21:25.857 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:21:26.158 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:26.158 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":21,"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","created":"2024-04-26T10:20:48.363934+0000","modified":"2024-04-26T10:21:10.288209+0000","last_up_change":"2024-04-26T10:20:58.098141+0000","last_in_change":"2024-04-26T10:20:49.575442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:20:59.994755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:21:03.866927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:21:07.853429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:21:08.285131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5e76c47-dfc4-40ca-88d3-2084cac6e35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":18193},{"type":"v1","addr":"172.21.15.120:6801","nonce":18193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":18193},{"type":"v1","addr":"172.21.15.120:6803","nonce":18193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":18193},{"type":"v1","addr":"172.21.15.120:6807","nonce":18193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":18193},{"type":"v1","addr":"172.21.15.120:6805","nonce":18193}]},"public_addr":"172.21.15.120:6801/18193","cluster_addr":"172.21.15.120:6803/18193","heartbeat_back_addr":"172.21.15.120:6807/18193","heartbeat_front_addr":"172.21.15.120:6805/18193","state":["exists","up"]},{"osd":1,"uuid":"2a8d530c-cf33-4540-9240-6bd7485e06ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":18226},{"type":"v1","addr":"172.21.15.154:6801","nonce":18226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":18226},{"type":"v1","addr":"172.21.15.154:6803","nonce":18226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":18226},{"type":"v1","addr":"172.21.15.154:6807","nonce":18226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":18226},{"type":"v1","addr":"172.21.15.154:6805","nonce":18226}]},"public_addr":"172.21.15.154:6801/18226","cluster_addr":"172.21.15.154:6803/18226","heartbeat_back_addr":"172.21.15.154:6807/18226","heartbeat_front_addr":"172.21.15.154:6805/18226","state":["exists","up"]},{"osd":2,"uuid":"484ab70f-4cad-4ff6-9405-8865ec5ee327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":18269},{"type":"v1","addr":"172.21.15.164:6801","nonce":18269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":18269},{"type":"v1","addr":"172.21.15.164:6803","nonce":18269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":18269},{"type":"v1","addr":"172.21.15.164:6807","nonce":18269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":18269},{"type":"v1","addr":"172.21.15.164:6805","nonce":18269}]},"public_addr":"172.21.15.164:6801/18269","cluster_addr":"172.21.15.164:6803/18269","heartbeat_back_addr":"172.21.15.164:6807/18269","heartbeat_front_addr":"172.21.15.164:6805/18269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.871567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.910527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.761919+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:21:26.172 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:21:26.516 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:26.516 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T10:21:09.285446+0000","modified":"2024-04-26T10:21:12.296930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4233":{"gid":4233,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6803/2540560872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2540560872},{"type":"v1","addr":"172.21.15.52:6803","nonce":2540560872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T10:21:26.519 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 6 2024-04-26T10:21:26.632 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-26T10:21:09.285446+0000', 'modified': '2024-04-26T10:21:12.296930+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4233}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4233': {'gid': 4233, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.52:6803/2540560872', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.52:6802', 'nonce': 2540560872}, {'type': 'v1', 'addr': '172.21.15.52:6803', 'nonce': 2540560872}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-26T10:21:26.632 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-26T10:21:26.632 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-26T10:21:26.771 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-26T10:21:26.766+0000 7f3beb7fe700 0 client.4635 ms_handle_reset on v2:172.21.15.52:6802/2540560872 2024-04-26T10:21:26.801 INFO:teuthology.orchestra.run.smithi052.stderr:2024-04-26T10:21:26.798+0000 7f3beb7fe700 0 client.4490 ms_handle_reset on v2:172.21.15.52:6802/2540560872 2024-04-26T10:21:26.802 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-26T10:21:26.802 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_fsid": "485c78cb-ad62-4584-aba6-316dd9c93a12", 2024-04-26T10:21:26.802 INFO:teuthology.orchestra.run.smithi052.stdout: "whoami": 0, 2024-04-26T10:21:26.802 INFO:teuthology.orchestra.run.smithi052.stdout: "id": 4233, 2024-04-26T10:21:26.802 INFO:teuthology.orchestra.run.smithi052.stdout: "want_state": "up:active", 2024-04-26T10:21:26.802 INFO:teuthology.orchestra.run.smithi052.stdout: "state": "up:active", 2024-04-26T10:21:26.802 INFO:teuthology.orchestra.run.smithi052.stdout: "fs_name": "cephfs", 2024-04-26T10:21:26.802 INFO:teuthology.orchestra.run.smithi052.stdout: "rank_uptime": 17.511499655000001, 2024-04-26T10:21:26.802 INFO:teuthology.orchestra.run.smithi052.stdout: "mdsmap_epoch": 6, 2024-04-26T10:21:26.803 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch": 21, 2024-04-26T10:21:26.803 INFO:teuthology.orchestra.run.smithi052.stdout: "osdmap_epoch_barrier": 21, 2024-04-26T10:21:26.803 INFO:teuthology.orchestra.run.smithi052.stdout: "uptime": 21.822076517999999 2024-04-26T10:21:26.803 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-26T10:21:26.820 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-26T10:21:26.830 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-26T10:21:26.831 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'dc093b5e41f728edab6e0330295fdf9156d31664'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '7d2137f0a666c92a9411c1af5c33e4968be54da6'}} 2024-04-26T10:21:26.831 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-26T10:21:26.831 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-26T10:21:26.831 DEBUG:teuthology.orchestra.run.smithi052:> sync 2024-04-26T10:21:27.034 DEBUG:teuthology.orchestra.run.smithi120:> sync 2024-04-26T10:21:27.185 DEBUG:teuthology.orchestra.run.smithi154:> sync 2024-04-26T10:21:27.282 DEBUG:teuthology.orchestra.run.smithi164:> sync 2024-04-26T10:21:27.430 DEBUG:tasks.thrashosds:checking console status of smithi052 2024-04-26T10:21:27.430 DEBUG:teuthology.orchestra.console.smithi052:Waiting for login prompt 2024-04-26T10:21:27.430 DEBUG:teuthology.orchestra.console.smithi052:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi052 2024-04-26T10:21:27.551 DEBUG:teuthology.orchestra.console.smithi052:expect before: [Enter `^Ec?' for help] 2024-04-26T10:21:27.552 DEBUG:teuthology.orchestra.console.smithi052:expect after: smithi052 login: 2024-04-26T10:21:27.604 DEBUG:teuthology.orchestra.console.smithi052:console disconnect output: [Enter `^Ec?' for help] smithi052 login: [disconnect] 2024-04-26T10:21:27.705 DEBUG:tasks.thrashosds:checking console status of smithi120 2024-04-26T10:21:27.705 DEBUG:teuthology.orchestra.console.smithi120:Waiting for login prompt 2024-04-26T10:21:27.705 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi120 2024-04-26T10:21:27.874 DEBUG:teuthology.orchestra.console.smithi120:expect before: [Enter `^Ec?' for help] 2024-04-26T10:21:27.874 DEBUG:teuthology.orchestra.console.smithi120:expect after: smithi120 login: 2024-04-26T10:21:27.926 DEBUG:teuthology.orchestra.console.smithi120:console disconnect output: [Enter `^Ec?' for help] smithi120 login: [disconnect] 2024-04-26T10:21:28.027 DEBUG:tasks.thrashosds:checking console status of smithi154 2024-04-26T10:21:28.028 DEBUG:teuthology.orchestra.console.smithi154:Waiting for login prompt 2024-04-26T10:21:28.028 DEBUG:teuthology.orchestra.console.smithi154:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi154 2024-04-26T10:21:28.185 DEBUG:teuthology.orchestra.console.smithi154:expect before: [Enter `^Ec?' for help] 2024-04-26T10:21:28.185 DEBUG:teuthology.orchestra.console.smithi154:expect after: smithi154 login: 2024-04-26T10:21:28.237 DEBUG:teuthology.orchestra.console.smithi154:console disconnect output: [Enter `^Ec?' for help] smithi154 login: [disconnect] 2024-04-26T10:21:28.339 DEBUG:tasks.thrashosds:checking console status of smithi164 2024-04-26T10:21:28.339 DEBUG:teuthology.orchestra.console.smithi164:Waiting for login prompt 2024-04-26T10:21:28.339 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi164 2024-04-26T10:21:28.817 DEBUG:teuthology.orchestra.console.smithi164:expect before: [Enter `^Ec?' for help] 2024-04-26T10:21:28.817 DEBUG:teuthology.orchestra.console.smithi164:expect after: smithi164 login: 2024-04-26T10:21:29.076 DEBUG:teuthology.orchestra.console.smithi164:console disconnect output: [Enter `^Ec?' for help] smithi164 login: [disconnect] 2024-04-26T10:21:29.178 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-26T10:21:29.518 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-26T10:21:29.518 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T10:21:29.519 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:21:29.821 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:29.823 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:21:29.839 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-04-26T10:21:27.942495+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94064,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021456,"statfs":{"total":289910292480,"available":289813970944,"internally_reserved":0,"allocated":720896,"data_stored":1370902,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004072"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303606+0000","last_change":"2024-04-26T10:21:09.316096+0000","last_active":"2024-04-26T10:21:10.303606+0000","last_peered":"2024-04-26T10:21:10.303606+0000","last_clean":"2024-04-26T10:21:10.303606+0000","last_became_active":"2024-04-26T10:21:09.315498+0000","last_became_peered":"2024-04-26T10:21:09.315498+0000","last_unstale":"2024-04-26T10:21:10.303606+0000","last_undegraded":"2024-04-26T10:21:10.303606+0000","last_fullsized":"2024-04-26T10:21:10.303606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:14.245434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304046+0000","last_change":"2024-04-26T10:21:09.317241+0000","last_active":"2024-04-26T10:21:10.304046+0000","last_peered":"2024-04-26T10:21:10.304046+0000","last_clean":"2024-04-26T10:21:10.304046+0000","last_became_active":"2024-04-26T10:21:09.316532+0000","last_became_peered":"2024-04-26T10:21:09.316532+0000","last_unstale":"2024-04-26T10:21:10.304046+0000","last_undegraded":"2024-04-26T10:21:10.304046+0000","last_fullsized":"2024-04-26T10:21:10.304046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:00.173638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743004+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:21:10.743004+0000","last_peered":"2024-04-26T10:21:10.743004+0000","last_clean":"2024-04-26T10:21:10.743004+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:21:10.743004+0000","last_undegraded":"2024-04-26T10:21:10.743004+0000","last_fullsized":"2024-04-26T10:21:10.743004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:01.883964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742576+0000","last_change":"2024-04-26T10:21:09.306531+0000","last_active":"2024-04-26T10:21:10.742576+0000","last_peered":"2024-04-26T10:21:10.742576+0000","last_clean":"2024-04-26T10:21:10.742576+0000","last_became_active":"2024-04-26T10:21:09.304885+0000","last_became_peered":"2024-04-26T10:21:09.304885+0000","last_unstale":"2024-04-26T10:21:10.742576+0000","last_undegraded":"2024-04-26T10:21:10.742576+0000","last_fullsized":"2024-04-26T10:21:10.742576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:04.179516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302949+0000","last_change":"2024-04-26T10:21:09.310914+0000","last_active":"2024-04-26T10:21:10.302949+0000","last_peered":"2024-04-26T10:21:10.302949+0000","last_clean":"2024-04-26T10:21:10.302949+0000","last_became_active":"2024-04-26T10:21:09.309981+0000","last_became_peered":"2024-04-26T10:21:09.309981+0000","last_unstale":"2024-04-26T10:21:10.302949+0000","last_undegraded":"2024-04-26T10:21:10.302949+0000","last_fullsized":"2024-04-26T10:21:10.302949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:04.926251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743427+0000","last_change":"2024-04-26T10:21:09.305198+0000","last_active":"2024-04-26T10:21:10.743427+0000","last_peered":"2024-04-26T10:21:10.743427+0000","last_clean":"2024-04-26T10:21:10.743427+0000","last_became_active":"2024-04-26T10:21:09.304716+0000","last_became_peered":"2024-04-26T10:21:09.304716+0000","last_unstale":"2024-04-26T10:21:10.743427+0000","last_undegraded":"2024-04-26T10:21:10.743427+0000","last_fullsized":"2024-04-26T10:21:10.743427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:11.224015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742177+0000","last_change":"2024-04-26T10:21:09.307188+0000","last_active":"2024-04-26T10:21:10.742177+0000","last_peered":"2024-04-26T10:21:10.742177+0000","last_clean":"2024-04-26T10:21:10.742177+0000","last_became_active":"2024-04-26T10:21:09.306548+0000","last_became_peered":"2024-04-26T10:21:09.306548+0000","last_unstale":"2024-04-26T10:21:10.742177+0000","last_undegraded":"2024-04-26T10:21:10.742177+0000","last_fullsized":"2024-04-26T10:21:10.742177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:29.565507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741718+0000","last_change":"2024-04-26T10:21:09.308284+0000","last_active":"2024-04-26T10:21:10.741718+0000","last_peered":"2024-04-26T10:21:10.741718+0000","last_clean":"2024-04-26T10:21:10.741718+0000","last_became_active":"2024-04-26T10:21:09.307504+0000","last_became_peered":"2024-04-26T10:21:09.307504+0000","last_unstale":"2024-04-26T10:21:10.741718+0000","last_undegraded":"2024-04-26T10:21:10.741718+0000","last_fullsized":"2024-04-26T10:21:10.741718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:51.549222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303844+0000","last_change":"2024-04-26T10:21:09.314160+0000","last_active":"2024-04-26T10:21:10.303844+0000","last_peered":"2024-04-26T10:21:10.303844+0000","last_clean":"2024-04-26T10:21:10.303844+0000","last_became_active":"2024-04-26T10:21:09.313221+0000","last_became_peered":"2024-04-26T10:21:09.313221+0000","last_unstale":"2024-04-26T10:21:10.303844+0000","last_undegraded":"2024-04-26T10:21:10.303844+0000","last_fullsized":"2024-04-26T10:21:10.303844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:50.157094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304095+0000","last_change":"2024-04-26T10:21:09.315304+0000","last_active":"2024-04-26T10:21:10.304095+0000","last_peered":"2024-04-26T10:21:10.304095+0000","last_clean":"2024-04-26T10:21:10.304095+0000","last_became_active":"2024-04-26T10:21:09.314619+0000","last_became_peered":"2024-04-26T10:21:09.314619+0000","last_unstale":"2024-04-26T10:21:10.304095+0000","last_undegraded":"2024-04-26T10:21:10.304095+0000","last_fullsized":"2024-04-26T10:21:10.304095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:41.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743482+0000","last_change":"2024-04-26T10:21:09.307173+0000","last_active":"2024-04-26T10:21:10.743482+0000","last_peered":"2024-04-26T10:21:10.743482+0000","last_clean":"2024-04-26T10:21:10.743482+0000","last_became_active":"2024-04-26T10:21:09.306523+0000","last_became_peered":"2024-04-26T10:21:09.306523+0000","last_unstale":"2024-04-26T10:21:10.743482+0000","last_undegraded":"2024-04-26T10:21:10.743482+0000","last_fullsized":"2024-04-26T10:21:10.743482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:15.102637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302828+0000","last_change":"2024-04-26T10:21:09.319057+0000","last_active":"2024-04-26T10:21:10.302828+0000","last_peered":"2024-04-26T10:21:10.302828+0000","last_clean":"2024-04-26T10:21:10.302828+0000","last_became_active":"2024-04-26T10:21:09.318580+0000","last_became_peered":"2024-04-26T10:21:09.318580+0000","last_unstale":"2024-04-26T10:21:10.302828+0000","last_undegraded":"2024-04-26T10:21:10.302828+0000","last_fullsized":"2024-04-26T10:21:10.302828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.335327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302635+0000","last_change":"2024-04-26T10:21:09.310332+0000","last_active":"2024-04-26T10:21:10.302635+0000","last_peered":"2024-04-26T10:21:10.302635+0000","last_clean":"2024-04-26T10:21:10.302635+0000","last_became_active":"2024-04-26T10:21:09.309534+0000","last_became_peered":"2024-04-26T10:21:09.309534+0000","last_unstale":"2024-04-26T10:21:10.302635+0000","last_undegraded":"2024-04-26T10:21:10.302635+0000","last_fullsized":"2024-04-26T10:21:10.302635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:01.594353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742954+0000","last_change":"2024-04-26T10:21:09.316821+0000","last_active":"2024-04-26T10:21:10.742954+0000","last_peered":"2024-04-26T10:21:10.742954+0000","last_clean":"2024-04-26T10:21:10.742954+0000","last_became_active":"2024-04-26T10:21:09.316143+0000","last_became_peered":"2024-04-26T10:21:09.316143+0000","last_unstale":"2024-04-26T10:21:10.742954+0000","last_undegraded":"2024-04-26T10:21:10.742954+0000","last_fullsized":"2024-04-26T10:21:10.742954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:20.271378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742238+0000","last_change":"2024-04-26T10:21:09.314710+0000","last_active":"2024-04-26T10:21:10.742238+0000","last_peered":"2024-04-26T10:21:10.742238+0000","last_clean":"2024-04-26T10:21:10.742238+0000","last_became_active":"2024-04-26T10:21:09.314401+0000","last_became_peered":"2024-04-26T10:21:09.314401+0000","last_unstale":"2024-04-26T10:21:10.742238+0000","last_undegraded":"2024-04-26T10:21:10.742238+0000","last_fullsized":"2024-04-26T10:21:10.742238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:14.245434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741766+0000","last_change":"2024-04-26T10:21:09.306575+0000","last_active":"2024-04-26T10:21:10.741766+0000","last_peered":"2024-04-26T10:21:10.741766+0000","last_clean":"2024-04-26T10:21:10.741766+0000","last_became_active":"2024-04-26T10:21:09.305009+0000","last_became_peered":"2024-04-26T10:21:09.305009+0000","last_unstale":"2024-04-26T10:21:10.741766+0000","last_undegraded":"2024-04-26T10:21:10.741766+0000","last_fullsized":"2024-04-26T10:21:10.741766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:42.965427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304549+0000","last_change":"2024-04-26T10:21:09.317530+0000","last_active":"2024-04-26T10:21:10.304549+0000","last_peered":"2024-04-26T10:21:10.304549+0000","last_clean":"2024-04-26T10:21:10.304549+0000","last_became_active":"2024-04-26T10:21:09.316956+0000","last_became_peered":"2024-04-26T10:21:09.316956+0000","last_unstale":"2024-04-26T10:21:10.304549+0000","last_undegraded":"2024-04-26T10:21:10.304549+0000","last_fullsized":"2024-04-26T10:21:10.304549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:05.112877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304348+0000","last_change":"2024-04-26T10:21:09.316152+0000","last_active":"2024-04-26T10:21:10.304348+0000","last_peered":"2024-04-26T10:21:10.304348+0000","last_clean":"2024-04-26T10:21:10.304348+0000","last_became_active":"2024-04-26T10:21:09.315441+0000","last_became_peered":"2024-04-26T10:21:09.315441+0000","last_unstale":"2024-04-26T10:21:10.304348+0000","last_undegraded":"2024-04-26T10:21:10.304348+0000","last_fullsized":"2024-04-26T10:21:10.304348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:42.904467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303452+0000","last_change":"2024-04-26T10:21:09.316805+0000","last_active":"2024-04-26T10:21:10.303452+0000","last_peered":"2024-04-26T10:21:10.303452+0000","last_clean":"2024-04-26T10:21:10.303452+0000","last_became_active":"2024-04-26T10:21:09.316490+0000","last_became_peered":"2024-04-26T10:21:09.316490+0000","last_unstale":"2024-04-26T10:21:10.303452+0000","last_undegraded":"2024-04-26T10:21:10.303452+0000","last_fullsized":"2024-04-26T10:21:10.303452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:11.814183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742675+0000","last_change":"2024-04-26T10:21:09.314189+0000","last_active":"2024-04-26T10:21:10.742675+0000","last_peered":"2024-04-26T10:21:10.742675+0000","last_clean":"2024-04-26T10:21:10.742675+0000","last_became_active":"2024-04-26T10:21:09.313648+0000","last_became_peered":"2024-04-26T10:21:09.313648+0000","last_unstale":"2024-04-26T10:21:10.742675+0000","last_undegraded":"2024-04-26T10:21:10.742675+0000","last_fullsized":"2024-04-26T10:21:10.742675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:57.658133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743475+0000","last_change":"2024-04-26T10:21:09.316594+0000","last_active":"2024-04-26T10:21:10.743475+0000","last_peered":"2024-04-26T10:21:10.743475+0000","last_clean":"2024-04-26T10:21:10.743475+0000","last_became_active":"2024-04-26T10:21:09.315877+0000","last_became_peered":"2024-04-26T10:21:09.315877+0000","last_unstale":"2024-04-26T10:21:10.743475+0000","last_undegraded":"2024-04-26T10:21:10.743475+0000","last_fullsized":"2024-04-26T10:21:10.743475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:19.943321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302427+0000","last_change":"2024-04-26T10:21:09.318829+0000","last_active":"2024-04-26T10:21:10.302427+0000","last_peered":"2024-04-26T10:21:10.302427+0000","last_clean":"2024-04-26T10:21:10.302427+0000","last_became_active":"2024-04-26T10:21:09.318379+0000","last_became_peered":"2024-04-26T10:21:09.318379+0000","last_unstale":"2024-04-26T10:21:10.302427+0000","last_undegraded":"2024-04-26T10:21:10.302427+0000","last_fullsized":"2024-04-26T10:21:10.302427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:11.224015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302100+0000","last_change":"2024-04-26T10:21:09.309068+0000","last_active":"2024-04-26T10:21:10.302100+0000","last_peered":"2024-04-26T10:21:10.302100+0000","last_clean":"2024-04-26T10:21:10.302100+0000","last_became_active":"2024-04-26T10:21:09.308797+0000","last_became_peered":"2024-04-26T10:21:09.308797+0000","last_unstale":"2024-04-26T10:21:10.302100+0000","last_undegraded":"2024-04-26T10:21:10.302100+0000","last_fullsized":"2024-04-26T10:21:10.302100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:44.761759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.301914+0000","last_change":"2024-04-26T10:21:09.311574+0000","last_active":"2024-04-26T10:21:10.301914+0000","last_peered":"2024-04-26T10:21:10.301914+0000","last_clean":"2024-04-26T10:21:10.301914+0000","last_became_active":"2024-04-26T10:21:09.309285+0000","last_became_peered":"2024-04-26T10:21:09.309285+0000","last_unstale":"2024-04-26T10:21:10.301914+0000","last_undegraded":"2024-04-26T10:21:10.301914+0000","last_fullsized":"2024-04-26T10:21:10.301914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:06.884098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303605+0000","last_change":"2024-04-26T10:21:09.317948+0000","last_active":"2024-04-26T10:21:10.303605+0000","last_peered":"2024-04-26T10:21:10.303605+0000","last_clean":"2024-04-26T10:21:10.303605+0000","last_became_active":"2024-04-26T10:21:09.317571+0000","last_became_peered":"2024-04-26T10:21:09.317571+0000","last_unstale":"2024-04-26T10:21:10.303605+0000","last_undegraded":"2024-04-26T10:21:10.303605+0000","last_fullsized":"2024-04-26T10:21:10.303605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:04.179516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304130+0000","last_change":"2024-04-26T10:21:09.312839+0000","last_active":"2024-04-26T10:21:10.304130+0000","last_peered":"2024-04-26T10:21:10.304130+0000","last_clean":"2024-04-26T10:21:10.304130+0000","last_became_active":"2024-04-26T10:21:09.311898+0000","last_became_peered":"2024-04-26T10:21:09.311898+0000","last_unstale":"2024-04-26T10:21:10.304130+0000","last_undegraded":"2024-04-26T10:21:10.304130+0000","last_fullsized":"2024-04-26T10:21:10.304130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:03.705171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743873+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:21:10.743873+0000","last_peered":"2024-04-26T10:21:10.743873+0000","last_clean":"2024-04-26T10:21:10.743873+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:21:10.743873+0000","last_undegraded":"2024-04-26T10:21:10.743873+0000","last_fullsized":"2024-04-26T10:21:10.743873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:39.394937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303372+0000","last_change":"2024-04-26T10:21:09.312446+0000","last_active":"2024-04-26T10:21:10.303372+0000","last_peered":"2024-04-26T10:21:10.303372+0000","last_clean":"2024-04-26T10:21:10.303372+0000","last_became_active":"2024-04-26T10:21:09.311919+0000","last_became_peered":"2024-04-26T10:21:09.311919+0000","last_unstale":"2024-04-26T10:21:10.303372+0000","last_undegraded":"2024-04-26T10:21:10.303372+0000","last_fullsized":"2024-04-26T10:21:10.303372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:57.658133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303274+0000","last_change":"2024-04-26T10:21:09.316871+0000","last_active":"2024-04-26T10:21:10.303274+0000","last_peered":"2024-04-26T10:21:10.303274+0000","last_clean":"2024-04-26T10:21:10.303274+0000","last_became_active":"2024-04-26T10:21:09.316529+0000","last_became_peered":"2024-04-26T10:21:09.316529+0000","last_unstale":"2024-04-26T10:21:10.303274+0000","last_undegraded":"2024-04-26T10:21:10.303274+0000","last_fullsized":"2024-04-26T10:21:10.303274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:52.614699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303836+0000","last_change":"2024-04-26T10:21:09.313160+0000","last_active":"2024-04-26T10:21:10.303836+0000","last_peered":"2024-04-26T10:21:10.303836+0000","last_clean":"2024-04-26T10:21:10.303836+0000","last_became_active":"2024-04-26T10:21:09.312556+0000","last_became_peered":"2024-04-26T10:21:09.312556+0000","last_unstale":"2024-04-26T10:21:10.303836+0000","last_undegraded":"2024-04-26T10:21:10.303836+0000","last_fullsized":"2024-04-26T10:21:10.303836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:21.698558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302244+0000","last_change":"2024-04-26T10:21:09.314165+0000","last_active":"2024-04-26T10:21:10.302244+0000","last_peered":"2024-04-26T10:21:10.302244+0000","last_clean":"2024-04-26T10:21:10.302244+0000","last_became_active":"2024-04-26T10:21:09.313559+0000","last_became_peered":"2024-04-26T10:21:09.313559+0000","last_unstale":"2024-04-26T10:21:10.302244+0000","last_undegraded":"2024-04-26T10:21:10.302244+0000","last_fullsized":"2024-04-26T10:21:10.302244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:05.857831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741968+0000","last_change":"2024-04-26T10:21:09.309366+0000","last_active":"2024-04-26T10:21:10.741968+0000","last_peered":"2024-04-26T10:21:10.741968+0000","last_clean":"2024-04-26T10:21:10.741968+0000","last_became_active":"2024-04-26T10:21:09.308660+0000","last_became_peered":"2024-04-26T10:21:09.308660+0000","last_unstale":"2024-04-26T10:21:10.741968+0000","last_undegraded":"2024-04-26T10:21:10.741968+0000","last_fullsized":"2024-04-26T10:21:10.741968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.335327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303113+0000","last_change":"2024-04-26T10:21:09.317455+0000","last_active":"2024-04-26T10:21:10.303113+0000","last_peered":"2024-04-26T10:21:10.303113+0000","last_clean":"2024-04-26T10:21:10.303113+0000","last_became_active":"2024-04-26T10:21:09.316994+0000","last_became_peered":"2024-04-26T10:21:09.316994+0000","last_unstale":"2024-04-26T10:21:10.303113+0000","last_undegraded":"2024-04-26T10:21:10.303113+0000","last_fullsized":"2024-04-26T10:21:10.303113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:48.942276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.317124+0000","last_change":"2024-04-26T10:21:08.939370+0000","last_active":"2024-04-26T10:21:09.317124+0000","last_peered":"2024-04-26T10:21:09.317124+0000","last_clean":"2024-04-26T10:21:09.317124+0000","last_became_active":"2024-04-26T10:21:08.937845+0000","last_became_peered":"2024-04-26T10:21:08.937845+0000","last_unstale":"2024-04-26T10:21:09.317124+0000","last_undegraded":"2024-04-26T10:21:09.317124+0000","last_fullsized":"2024-04-26T10:21:09.317124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:28.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304041+0000","last_change":"2024-04-26T10:21:09.316515+0000","last_active":"2024-04-26T10:21:10.304041+0000","last_peered":"2024-04-26T10:21:10.304041+0000","last_clean":"2024-04-26T10:21:10.304041+0000","last_became_active":"2024-04-26T10:21:09.315714+0000","last_became_peered":"2024-04-26T10:21:09.315714+0000","last_unstale":"2024-04-26T10:21:10.304041+0000","last_undegraded":"2024-04-26T10:21:10.304041+0000","last_fullsized":"2024-04-26T10:21:10.304041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.032760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296726+0000","last_change":"2024-04-26T10:21:08.937056+0000","last_active":"2024-04-26T10:21:09.296726+0000","last_peered":"2024-04-26T10:21:09.296726+0000","last_clean":"2024-04-26T10:21:09.296726+0000","last_became_active":"2024-04-26T10:21:08.936545+0000","last_became_peered":"2024-04-26T10:21:08.936545+0000","last_unstale":"2024-04-26T10:21:09.296726+0000","last_undegraded":"2024-04-26T10:21:09.296726+0000","last_fullsized":"2024-04-26T10:21:09.296726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:48.449203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304386+0000","last_change":"2024-04-26T10:21:09.313813+0000","last_active":"2024-04-26T10:21:10.304386+0000","last_peered":"2024-04-26T10:21:10.304386+0000","last_clean":"2024-04-26T10:21:10.304386+0000","last_became_active":"2024-04-26T10:21:09.312562+0000","last_became_peered":"2024-04-26T10:21:09.312562+0000","last_unstale":"2024-04-26T10:21:10.304386+0000","last_undegraded":"2024-04-26T10:21:10.304386+0000","last_fullsized":"2024-04-26T10:21:10.304386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:46.413942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309703+0000","last_change":"2024-04-26T10:21:08.936433+0000","last_active":"2024-04-26T10:21:09.309703+0000","last_peered":"2024-04-26T10:21:09.309703+0000","last_clean":"2024-04-26T10:21:09.309703+0000","last_became_active":"2024-04-26T10:21:08.935875+0000","last_became_peered":"2024-04-26T10:21:08.935875+0000","last_unstale":"2024-04-26T10:21:09.309703+0000","last_undegraded":"2024-04-26T10:21:09.309703+0000","last_fullsized":"2024-04-26T10:21:09.309703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:24.501204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303865+0000","last_change":"2024-04-26T10:21:09.314435+0000","last_active":"2024-04-26T10:21:10.303865+0000","last_peered":"2024-04-26T10:21:10.303865+0000","last_clean":"2024-04-26T10:21:10.303865+0000","last_became_active":"2024-04-26T10:21:09.313684+0000","last_became_peered":"2024-04-26T10:21:09.313684+0000","last_unstale":"2024-04-26T10:21:10.303865+0000","last_undegraded":"2024-04-26T10:21:10.303865+0000","last_fullsized":"2024-04-26T10:21:10.303865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:20.185980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.321258+0000","last_change":"2024-04-26T10:21:08.934971+0000","last_active":"2024-04-26T10:21:09.321258+0000","last_peered":"2024-04-26T10:21:09.321258+0000","last_clean":"2024-04-26T10:21:09.321258+0000","last_became_active":"2024-04-26T10:21:08.934653+0000","last_became_peered":"2024-04-26T10:21:08.934653+0000","last_unstale":"2024-04-26T10:21:09.321258+0000","last_undegraded":"2024-04-26T10:21:09.321258+0000","last_fullsized":"2024-04-26T10:21:09.321258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:18.272015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.315924+0000","last_change":"2024-04-26T10:21:08.934452+0000","last_active":"2024-04-26T10:21:09.315924+0000","last_peered":"2024-04-26T10:21:09.315924+0000","last_clean":"2024-04-26T10:21:09.315924+0000","last_became_active":"2024-04-26T10:21:08.934091+0000","last_became_peered":"2024-04-26T10:21:08.934091+0000","last_unstale":"2024-04-26T10:21:09.315924+0000","last_undegraded":"2024-04-26T10:21:09.315924+0000","last_fullsized":"2024-04-26T10:21:09.315924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:11.224989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.301898+0000","last_change":"2024-04-26T10:21:09.314631+0000","last_active":"2024-04-26T10:21:10.301898+0000","last_peered":"2024-04-26T10:21:10.301898+0000","last_clean":"2024-04-26T10:21:10.301898+0000","last_became_active":"2024-04-26T10:21:09.313044+0000","last_became_peered":"2024-04-26T10:21:09.313044+0000","last_unstale":"2024-04-26T10:21:10.301898+0000","last_undegraded":"2024-04-26T10:21:10.301898+0000","last_fullsized":"2024-04-26T10:21:10.301898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:19.943321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.319848+0000","last_change":"2024-04-26T10:21:08.935870+0000","last_active":"2024-04-26T10:21:09.319848+0000","last_peered":"2024-04-26T10:21:09.319848+0000","last_clean":"2024-04-26T10:21:09.319848+0000","last_became_active":"2024-04-26T10:21:08.935380+0000","last_became_peered":"2024-04-26T10:21:08.935380+0000","last_unstale":"2024-04-26T10:21:09.319848+0000","last_undegraded":"2024-04-26T10:21:09.319848+0000","last_fullsized":"2024-04-26T10:21:09.319848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:22.537149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302131+0000","last_change":"2024-04-26T10:21:09.317032+0000","last_active":"2024-04-26T10:21:10.302131+0000","last_peered":"2024-04-26T10:21:10.302131+0000","last_clean":"2024-04-26T10:21:10.302131+0000","last_became_active":"2024-04-26T10:21:09.316416+0000","last_became_peered":"2024-04-26T10:21:09.316416+0000","last_unstale":"2024-04-26T10:21:10.302131+0000","last_undegraded":"2024-04-26T10:21:10.302131+0000","last_fullsized":"2024-04-26T10:21:10.302131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:56.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320696+0000","last_change":"2024-04-26T10:21:08.935133+0000","last_active":"2024-04-26T10:21:09.320696+0000","last_peered":"2024-04-26T10:21:09.320696+0000","last_clean":"2024-04-26T10:21:09.320696+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:21:09.320696+0000","last_undegraded":"2024-04-26T10:21:09.320696+0000","last_fullsized":"2024-04-26T10:21:09.320696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:25.498249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743681+0000","last_change":"2024-04-26T10:21:09.315201+0000","last_active":"2024-04-26T10:21:10.743681+0000","last_peered":"2024-04-26T10:21:10.743681+0000","last_clean":"2024-04-26T10:21:10.743681+0000","last_became_active":"2024-04-26T10:21:09.314390+0000","last_became_peered":"2024-04-26T10:21:09.314390+0000","last_unstale":"2024-04-26T10:21:10.743681+0000","last_undegraded":"2024-04-26T10:21:10.743681+0000","last_fullsized":"2024-04-26T10:21:10.743681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.998466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.299090+0000","last_change":"2024-04-26T10:21:08.939382+0000","last_active":"2024-04-26T10:21:09.299090+0000","last_peered":"2024-04-26T10:21:09.299090+0000","last_clean":"2024-04-26T10:21:09.299090+0000","last_became_active":"2024-04-26T10:21:08.938193+0000","last_became_peered":"2024-04-26T10:21:08.938193+0000","last_unstale":"2024-04-26T10:21:09.299090+0000","last_undegraded":"2024-04-26T10:21:09.299090+0000","last_fullsized":"2024-04-26T10:21:09.299090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:01.182611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303014+0000","last_change":"2024-04-26T10:21:09.313678+0000","last_active":"2024-04-26T10:21:10.303014+0000","last_peered":"2024-04-26T10:21:10.303014+0000","last_clean":"2024-04-26T10:21:10.303014+0000","last_became_active":"2024-04-26T10:21:09.312906+0000","last_became_peered":"2024-04-26T10:21:09.312906+0000","last_unstale":"2024-04-26T10:21:10.303014+0000","last_undegraded":"2024-04-26T10:21:10.303014+0000","last_fullsized":"2024-04-26T10:21:10.303014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:14.241108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.313678+0000","last_change":"2024-04-26T10:21:08.936904+0000","last_active":"2024-04-26T10:21:09.313678+0000","last_peered":"2024-04-26T10:21:09.313678+0000","last_clean":"2024-04-26T10:21:09.313678+0000","last_became_active":"2024-04-26T10:21:08.936376+0000","last_became_peered":"2024-04-26T10:21:08.936376+0000","last_unstale":"2024-04-26T10:21:09.313678+0000","last_undegraded":"2024-04-26T10:21:09.313678+0000","last_fullsized":"2024-04-26T10:21:09.313678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:19.270525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742850+0000","last_change":"2024-04-26T10:21:09.307911+0000","last_active":"2024-04-26T10:21:10.742850+0000","last_peered":"2024-04-26T10:21:10.742850+0000","last_clean":"2024-04-26T10:21:10.742850+0000","last_became_active":"2024-04-26T10:21:09.307597+0000","last_became_peered":"2024-04-26T10:21:09.307597+0000","last_unstale":"2024-04-26T10:21:10.742850+0000","last_undegraded":"2024-04-26T10:21:10.742850+0000","last_fullsized":"2024-04-26T10:21:10.742850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:21.698558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.300582+0000","last_change":"2024-04-26T10:21:08.939072+0000","last_active":"2024-04-26T10:21:09.300582+0000","last_peered":"2024-04-26T10:21:09.300582+0000","last_clean":"2024-04-26T10:21:09.300582+0000","last_became_active":"2024-04-26T10:21:08.938445+0000","last_became_peered":"2024-04-26T10:21:08.938445+0000","last_unstale":"2024-04-26T10:21:09.300582+0000","last_undegraded":"2024-04-26T10:21:09.300582+0000","last_fullsized":"2024-04-26T10:21:09.300582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:06.598189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743938+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:21:10.743938+0000","last_peered":"2024-04-26T10:21:10.743938+0000","last_clean":"2024-04-26T10:21:10.743938+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:21:10.743938+0000","last_undegraded":"2024-04-26T10:21:10.743938+0000","last_fullsized":"2024-04-26T10:21:10.743938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309935+0000","last_change":"2024-04-26T10:21:08.936533+0000","last_active":"2024-04-26T10:21:09.309935+0000","last_peered":"2024-04-26T10:21:09.309935+0000","last_clean":"2024-04-26T10:21:09.309935+0000","last_became_active":"2024-04-26T10:21:08.936222+0000","last_became_peered":"2024-04-26T10:21:08.936222+0000","last_unstale":"2024-04-26T10:21:09.309935+0000","last_undegraded":"2024-04-26T10:21:09.309935+0000","last_fullsized":"2024-04-26T10:21:09.309935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:18:07.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742771+0000","last_change":"2024-04-26T10:21:09.316361+0000","last_active":"2024-04-26T10:21:10.742771+0000","last_peered":"2024-04-26T10:21:10.742771+0000","last_clean":"2024-04-26T10:21:10.742771+0000","last_became_active":"2024-04-26T10:21:09.315981+0000","last_became_peered":"2024-04-26T10:21:09.315981+0000","last_unstale":"2024-04-26T10:21:10.742771+0000","last_undegraded":"2024-04-26T10:21:10.742771+0000","last_fullsized":"2024-04-26T10:21:10.742771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:00.173638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309815+0000","last_change":"2024-04-26T10:21:08.928590+0000","last_active":"2024-04-26T10:21:09.309815+0000","last_peered":"2024-04-26T10:21:09.309815+0000","last_clean":"2024-04-26T10:21:09.309815+0000","last_became_active":"2024-04-26T10:21:08.928354+0000","last_became_peered":"2024-04-26T10:21:08.928354+0000","last_unstale":"2024-04-26T10:21:09.309815+0000","last_undegraded":"2024-04-26T10:21:09.309815+0000","last_fullsized":"2024-04-26T10:21:09.309815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:52.241716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304119+0000","last_change":"2024-04-26T10:21:09.317282+0000","last_active":"2024-04-26T10:21:10.304119+0000","last_peered":"2024-04-26T10:21:10.304119+0000","last_clean":"2024-04-26T10:21:10.304119+0000","last_became_active":"2024-04-26T10:21:09.316591+0000","last_became_peered":"2024-04-26T10:21:09.316591+0000","last_unstale":"2024-04-26T10:21:10.304119+0000","last_undegraded":"2024-04-26T10:21:10.304119+0000","last_fullsized":"2024-04-26T10:21:10.304119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:28.447361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":213,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297609+0000","last_change":"2024-04-26T10:21:01.829140+0000","last_active":"2024-04-26T10:21:09.297609+0000","last_peered":"2024-04-26T10:21:09.297609+0000","last_clean":"2024-04-26T10:21:09.297609+0000","last_became_active":"2024-04-26T10:21:01.827182+0000","last_became_peered":"2024-04-26T10:21:01.827182+0000","last_unstale":"2024-04-26T10:21:09.297609+0000","last_undegraded":"2024-04-26T10:21:09.297609+0000","last_fullsized":"2024-04-26T10:21:09.297609+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:00:51.477222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298874+0000","last_change":"2024-04-26T10:21:04.893745+0000","last_active":"2024-04-26T10:21:09.298874+0000","last_peered":"2024-04-26T10:21:09.298874+0000","last_clean":"2024-04-26T10:21:09.298874+0000","last_became_active":"2024-04-26T10:21:04.893031+0000","last_became_peered":"2024-04-26T10:21:04.893031+0000","last_unstale":"2024-04-26T10:21:09.298874+0000","last_undegraded":"2024-04-26T10:21:09.298874+0000","last_fullsized":"2024-04-26T10:21:09.298874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:59.771061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297001+0000","last_change":"2024-04-26T10:21:08.933706+0000","last_active":"2024-04-26T10:21:09.297001+0000","last_peered":"2024-04-26T10:21:09.297001+0000","last_clean":"2024-04-26T10:21:09.297001+0000","last_became_active":"2024-04-26T10:21:08.933372+0000","last_became_peered":"2024-04-26T10:21:08.933372+0000","last_unstale":"2024-04-26T10:21:09.297001+0000","last_undegraded":"2024-04-26T10:21:09.297001+0000","last_fullsized":"2024-04-26T10:21:09.297001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:14.290484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.744176+0000","last_change":"2024-04-26T10:21:09.320889+0000","last_active":"2024-04-26T10:21:10.744176+0000","last_peered":"2024-04-26T10:21:10.744176+0000","last_clean":"2024-04-26T10:21:10.744176+0000","last_became_active":"2024-04-26T10:21:09.320355+0000","last_became_peered":"2024-04-26T10:21:09.320355+0000","last_unstale":"2024-04-26T10:21:10.744176+0000","last_undegraded":"2024-04-26T10:21:10.744176+0000","last_fullsized":"2024-04-26T10:21:10.744176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:41.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297382+0000","last_change":"2024-04-26T10:21:04.892156+0000","last_active":"2024-04-26T10:21:09.297382+0000","last_peered":"2024-04-26T10:21:09.297382+0000","last_clean":"2024-04-26T10:21:09.297382+0000","last_became_active":"2024-04-26T10:21:04.891660+0000","last_became_peered":"2024-04-26T10:21:04.891660+0000","last_unstale":"2024-04-26T10:21:09.297382+0000","last_undegraded":"2024-04-26T10:21:09.297382+0000","last_fullsized":"2024-04-26T10:21:09.297382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:50.568468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296858+0000","last_change":"2024-04-26T10:21:08.936815+0000","last_active":"2024-04-26T10:21:09.296858+0000","last_peered":"2024-04-26T10:21:09.296858+0000","last_clean":"2024-04-26T10:21:09.296858+0000","last_became_active":"2024-04-26T10:21:08.936180+0000","last_became_peered":"2024-04-26T10:21:08.936180+0000","last_unstale":"2024-04-26T10:21:09.296858+0000","last_undegraded":"2024-04-26T10:21:09.296858+0000","last_fullsized":"2024-04-26T10:21:09.296858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:41.614282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304366+0000","last_change":"2024-04-26T10:21:09.310050+0000","last_active":"2024-04-26T10:21:10.304366+0000","last_peered":"2024-04-26T10:21:10.304366+0000","last_clean":"2024-04-26T10:21:10.304366+0000","last_became_active":"2024-04-26T10:21:09.309470+0000","last_became_peered":"2024-04-26T10:21:09.309470+0000","last_unstale":"2024-04-26T10:21:10.304366+0000","last_undegraded":"2024-04-26T10:21:10.304366+0000","last_fullsized":"2024-04-26T10:21:10.304366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:32.334144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296330+0000","last_change":"2024-04-26T10:21:04.890860+0000","last_active":"2024-04-26T10:21:09.296330+0000","last_peered":"2024-04-26T10:21:09.296330+0000","last_clean":"2024-04-26T10:21:09.296330+0000","last_became_active":"2024-04-26T10:21:04.890336+0000","last_became_peered":"2024-04-26T10:21:04.890336+0000","last_unstale":"2024-04-26T10:21:09.296330+0000","last_undegraded":"2024-04-26T10:21:09.296330+0000","last_fullsized":"2024-04-26T10:21:09.296330+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:13.262120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.310359+0000","last_change":"2024-04-26T10:21:08.936077+0000","last_active":"2024-04-26T10:21:09.310359+0000","last_peered":"2024-04-26T10:21:09.310359+0000","last_clean":"2024-04-26T10:21:09.310359+0000","last_became_active":"2024-04-26T10:21:08.935621+0000","last_became_peered":"2024-04-26T10:21:08.935621+0000","last_unstale":"2024-04-26T10:21:09.310359+0000","last_undegraded":"2024-04-26T10:21:09.310359+0000","last_fullsized":"2024-04-26T10:21:09.310359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:11.906094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304130+0000","last_change":"2024-04-26T10:21:09.314796+0000","last_active":"2024-04-26T10:21:10.304130+0000","last_peered":"2024-04-26T10:21:10.304130+0000","last_clean":"2024-04-26T10:21:10.304130+0000","last_became_active":"2024-04-26T10:21:09.314574+0000","last_became_peered":"2024-04-26T10:21:09.314574+0000","last_unstale":"2024-04-26T10:21:10.304130+0000","last_undegraded":"2024-04-26T10:21:10.304130+0000","last_fullsized":"2024-04-26T10:21:10.304130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:32.136621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301803+0000","last_change":"2024-04-26T10:21:04.893253+0000","last_active":"2024-04-26T10:21:09.301803+0000","last_peered":"2024-04-26T10:21:09.301803+0000","last_clean":"2024-04-26T10:21:09.301803+0000","last_became_active":"2024-04-26T10:21:04.892843+0000","last_became_peered":"2024-04-26T10:21:04.892843+0000","last_unstale":"2024-04-26T10:21:09.301803+0000","last_undegraded":"2024-04-26T10:21:09.301803+0000","last_fullsized":"2024-04-26T10:21:09.301803+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:00.749791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298626+0000","last_change":"2024-04-26T10:21:08.937153+0000","last_active":"2024-04-26T10:21:09.298626+0000","last_peered":"2024-04-26T10:21:09.298626+0000","last_clean":"2024-04-26T10:21:09.298626+0000","last_became_active":"2024-04-26T10:21:08.936561+0000","last_became_peered":"2024-04-26T10:21:08.936561+0000","last_unstale":"2024-04-26T10:21:09.298626+0000","last_undegraded":"2024-04-26T10:21:09.298626+0000","last_fullsized":"2024-04-26T10:21:09.298626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:28.491800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303941+0000","last_change":"2024-04-26T10:21:09.314218+0000","last_active":"2024-04-26T10:21:10.303941+0000","last_peered":"2024-04-26T10:21:10.303941+0000","last_clean":"2024-04-26T10:21:10.303941+0000","last_became_active":"2024-04-26T10:21:09.313641+0000","last_became_peered":"2024-04-26T10:21:09.313641+0000","last_unstale":"2024-04-26T10:21:10.303941+0000","last_undegraded":"2024-04-26T10:21:10.303941+0000","last_fullsized":"2024-04-26T10:21:10.303941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:08.449512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.300397+0000","last_change":"2024-04-26T10:21:08.937196+0000","last_active":"2024-04-26T10:21:09.300397+0000","last_peered":"2024-04-26T10:21:09.300397+0000","last_clean":"2024-04-26T10:21:09.300397+0000","last_became_active":"2024-04-26T10:21:08.936779+0000","last_became_peered":"2024-04-26T10:21:08.936779+0000","last_unstale":"2024-04-26T10:21:09.300397+0000","last_undegraded":"2024-04-26T10:21:09.300397+0000","last_fullsized":"2024-04-26T10:21:09.300397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:20.545169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295561+0000","last_change":"2024-04-26T10:21:04.890548+0000","last_active":"2024-04-26T10:21:09.295561+0000","last_peered":"2024-04-26T10:21:09.295561+0000","last_clean":"2024-04-26T10:21:09.295561+0000","last_became_active":"2024-04-26T10:21:04.890034+0000","last_became_peered":"2024-04-26T10:21:04.890034+0000","last_unstale":"2024-04-26T10:21:09.295561+0000","last_undegraded":"2024-04-26T10:21:09.295561+0000","last_fullsized":"2024-04-26T10:21:09.295561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:55.033455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302442+0000","last_change":"2024-04-26T10:21:09.318348+0000","last_active":"2024-04-26T10:21:10.302442+0000","last_peered":"2024-04-26T10:21:10.302442+0000","last_clean":"2024-04-26T10:21:10.302442+0000","last_became_active":"2024-04-26T10:21:09.317886+0000","last_became_peered":"2024-04-26T10:21:09.317886+0000","last_unstale":"2024-04-26T10:21:10.302442+0000","last_undegraded":"2024-04-26T10:21:10.302442+0000","last_fullsized":"2024-04-26T10:21:10.302442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:24.624358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295394+0000","last_change":"2024-04-26T10:21:08.933714+0000","last_active":"2024-04-26T10:21:09.295394+0000","last_peered":"2024-04-26T10:21:09.295394+0000","last_clean":"2024-04-26T10:21:09.295394+0000","last_became_active":"2024-04-26T10:21:08.933259+0000","last_became_peered":"2024-04-26T10:21:08.933259+0000","last_unstale":"2024-04-26T10:21:09.295394+0000","last_undegraded":"2024-04-26T10:21:09.295394+0000","last_fullsized":"2024-04-26T10:21:09.295394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:50.230096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.311683+0000","last_change":"2024-04-26T10:21:04.891490+0000","last_active":"2024-04-26T10:21:09.311683+0000","last_peered":"2024-04-26T10:21:09.311683+0000","last_clean":"2024-04-26T10:21:09.311683+0000","last_became_active":"2024-04-26T10:21:04.890777+0000","last_became_peered":"2024-04-26T10:21:04.890777+0000","last_unstale":"2024-04-26T10:21:09.311683+0000","last_undegraded":"2024-04-26T10:21:09.311683+0000","last_fullsized":"2024-04-26T10:21:09.311683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:25.896672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302680+0000","last_change":"2024-04-26T10:21:09.314213+0000","last_active":"2024-04-26T10:21:10.302680+0000","last_peered":"2024-04-26T10:21:10.302680+0000","last_clean":"2024-04-26T10:21:10.302680+0000","last_became_active":"2024-04-26T10:21:09.312975+0000","last_became_peered":"2024-04-26T10:21:09.312975+0000","last_unstale":"2024-04-26T10:21:10.302680+0000","last_undegraded":"2024-04-26T10:21:10.302680+0000","last_fullsized":"2024-04-26T10:21:10.302680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:43.137127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.317699+0000","last_change":"2024-04-26T10:21:08.934216+0000","last_active":"2024-04-26T10:21:09.317699+0000","last_peered":"2024-04-26T10:21:09.317699+0000","last_clean":"2024-04-26T10:21:09.317699+0000","last_became_active":"2024-04-26T10:21:08.933524+0000","last_became_peered":"2024-04-26T10:21:08.933524+0000","last_unstale":"2024-04-26T10:21:09.317699+0000","last_undegraded":"2024-04-26T10:21:09.317699+0000","last_fullsized":"2024-04-26T10:21:09.317699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:57.798830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297318+0000","last_change":"2024-04-26T10:21:04.890490+0000","last_active":"2024-04-26T10:21:09.297318+0000","last_peered":"2024-04-26T10:21:09.297318+0000","last_clean":"2024-04-26T10:21:09.297318+0000","last_became_active":"2024-04-26T10:21:04.889808+0000","last_became_peered":"2024-04-26T10:21:04.889808+0000","last_unstale":"2024-04-26T10:21:09.297318+0000","last_undegraded":"2024-04-26T10:21:09.297318+0000","last_fullsized":"2024-04-26T10:21:09.297318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:55.711555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302374+0000","last_change":"2024-04-26T10:21:09.312260+0000","last_active":"2024-04-26T10:21:10.302374+0000","last_peered":"2024-04-26T10:21:10.302374+0000","last_clean":"2024-04-26T10:21:10.302374+0000","last_became_active":"2024-04-26T10:21:09.311309+0000","last_became_peered":"2024-04-26T10:21:09.311309+0000","last_unstale":"2024-04-26T10:21:10.302374+0000","last_undegraded":"2024-04-26T10:21:10.302374+0000","last_fullsized":"2024-04-26T10:21:10.302374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:30.714581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304472+0000","last_change":"2024-04-26T10:21:08.936623+0000","last_active":"2024-04-26T10:21:10.304472+0000","last_peered":"2024-04-26T10:21:10.304472+0000","last_clean":"2024-04-26T10:21:10.304472+0000","last_became_active":"2024-04-26T10:21:08.936252+0000","last_became_peered":"2024-04-26T10:21:08.936252+0000","last_unstale":"2024-04-26T10:21:10.304472+0000","last_undegraded":"2024-04-26T10:21:10.304472+0000","last_fullsized":"2024-04-26T10:21:10.304472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:24.526250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296848+0000","last_change":"2024-04-26T10:21:04.892401+0000","last_active":"2024-04-26T10:21:09.296848+0000","last_peered":"2024-04-26T10:21:09.296848+0000","last_clean":"2024-04-26T10:21:09.296848+0000","last_became_active":"2024-04-26T10:21:04.891692+0000","last_became_peered":"2024-04-26T10:21:04.891692+0000","last_unstale":"2024-04-26T10:21:09.296848+0000","last_undegraded":"2024-04-26T10:21:09.296848+0000","last_fullsized":"2024-04-26T10:21:09.296848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:37.548728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302178+0000","last_change":"2024-04-26T10:21:09.317981+0000","last_active":"2024-04-26T10:21:10.302178+0000","last_peered":"2024-04-26T10:21:10.302178+0000","last_clean":"2024-04-26T10:21:10.302178+0000","last_became_active":"2024-04-26T10:21:09.317601+0000","last_became_peered":"2024-04-26T10:21:09.317601+0000","last_unstale":"2024-04-26T10:21:10.302178+0000","last_undegraded":"2024-04-26T10:21:10.302178+0000","last_fullsized":"2024-04-26T10:21:10.302178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742909+0000","last_change":"2024-04-26T10:21:09.317120+0000","last_active":"2024-04-26T10:21:10.742909+0000","last_peered":"2024-04-26T10:21:10.742909+0000","last_clean":"2024-04-26T10:21:10.742909+0000","last_became_active":"2024-04-26T10:21:09.316741+0000","last_became_peered":"2024-04-26T10:21:09.316741+0000","last_unstale":"2024-04-26T10:21:10.742909+0000","last_undegraded":"2024-04-26T10:21:10.742909+0000","last_fullsized":"2024-04-26T10:21:10.742909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:43.702714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.326574+0000","last_change":"2024-04-26T10:21:08.934481+0000","last_active":"2024-04-26T10:21:09.326574+0000","last_peered":"2024-04-26T10:21:09.326574+0000","last_clean":"2024-04-26T10:21:09.326574+0000","last_became_active":"2024-04-26T10:21:08.934076+0000","last_became_peered":"2024-04-26T10:21:08.934076+0000","last_unstale":"2024-04-26T10:21:09.326574+0000","last_undegraded":"2024-04-26T10:21:09.326574+0000","last_fullsized":"2024-04-26T10:21:09.326574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:50.622715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302791+0000","last_change":"2024-04-26T10:21:09.314009+0000","last_active":"2024-04-26T10:21:10.302791+0000","last_peered":"2024-04-26T10:21:10.302791+0000","last_clean":"2024-04-26T10:21:10.302791+0000","last_became_active":"2024-04-26T10:21:09.313556+0000","last_became_peered":"2024-04-26T10:21:09.313556+0000","last_unstale":"2024-04-26T10:21:10.302791+0000","last_undegraded":"2024-04-26T10:21:10.302791+0000","last_fullsized":"2024-04-26T10:21:10.302791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:34.862466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320711+0000","last_change":"2024-04-26T10:21:08.936526+0000","last_active":"2024-04-26T10:21:09.320711+0000","last_peered":"2024-04-26T10:21:09.320711+0000","last_clean":"2024-04-26T10:21:09.320711+0000","last_became_active":"2024-04-26T10:21:08.936217+0000","last_became_peered":"2024-04-26T10:21:08.936217+0000","last_unstale":"2024-04-26T10:21:09.320711+0000","last_undegraded":"2024-04-26T10:21:09.320711+0000","last_fullsized":"2024-04-26T10:21:09.320711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:57.649639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301807+0000","last_change":"2024-04-26T10:21:08.937597+0000","last_active":"2024-04-26T10:21:09.301807+0000","last_peered":"2024-04-26T10:21:09.301807+0000","last_clean":"2024-04-26T10:21:09.301807+0000","last_became_active":"2024-04-26T10:21:08.936809+0000","last_became_peered":"2024-04-26T10:21:08.936809+0000","last_unstale":"2024-04-26T10:21:09.301807+0000","last_undegraded":"2024-04-26T10:21:09.301807+0000","last_fullsized":"2024-04-26T10:21:09.301807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:17.212235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302338+0000","last_change":"2024-04-26T10:21:09.312054+0000","last_active":"2024-04-26T10:21:10.302338+0000","last_peered":"2024-04-26T10:21:10.302338+0000","last_clean":"2024-04-26T10:21:10.302338+0000","last_became_active":"2024-04-26T10:21:09.310818+0000","last_became_peered":"2024-04-26T10:21:09.310818+0000","last_unstale":"2024-04-26T10:21:10.302338+0000","last_undegraded":"2024-04-26T10:21:10.302338+0000","last_fullsized":"2024-04-26T10:21:10.302338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:03.431355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301359+0000","last_change":"2024-04-26T10:21:08.937445+0000","last_active":"2024-04-26T10:21:09.301359+0000","last_peered":"2024-04-26T10:21:09.301359+0000","last_clean":"2024-04-26T10:21:09.301359+0000","last_became_active":"2024-04-26T10:21:08.937147+0000","last_became_peered":"2024-04-26T10:21:08.937147+0000","last_unstale":"2024-04-26T10:21:09.301359+0000","last_undegraded":"2024-04-26T10:21:09.301359+0000","last_fullsized":"2024-04-26T10:21:09.301359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:29.602825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302232+0000","last_change":"2024-04-26T10:21:09.318091+0000","last_active":"2024-04-26T10:21:10.302232+0000","last_peered":"2024-04-26T10:21:10.302232+0000","last_clean":"2024-04-26T10:21:10.302232+0000","last_became_active":"2024-04-26T10:21:09.317871+0000","last_became_peered":"2024-04-26T10:21:09.317871+0000","last_unstale":"2024-04-26T10:21:10.302232+0000","last_undegraded":"2024-04-26T10:21:10.302232+0000","last_fullsized":"2024-04-26T10:21:10.302232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:32.442915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303867+0000","last_change":"2024-04-26T10:21:09.312636+0000","last_active":"2024-04-26T10:21:10.303867+0000","last_peered":"2024-04-26T10:21:10.303867+0000","last_clean":"2024-04-26T10:21:10.303867+0000","last_became_active":"2024-04-26T10:21:09.312130+0000","last_became_peered":"2024-04-26T10:21:09.312130+0000","last_unstale":"2024-04-26T10:21:10.303867+0000","last_undegraded":"2024-04-26T10:21:10.303867+0000","last_fullsized":"2024-04-26T10:21:10.303867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:29.565507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298243+0000","last_change":"2024-04-26T10:21:08.934046+0000","last_active":"2024-04-26T10:21:09.298243+0000","last_peered":"2024-04-26T10:21:09.298243+0000","last_clean":"2024-04-26T10:21:09.298243+0000","last_became_active":"2024-04-26T10:21:08.933341+0000","last_became_peered":"2024-04-26T10:21:08.933341+0000","last_unstale":"2024-04-26T10:21:09.298243+0000","last_undegraded":"2024-04-26T10:21:09.298243+0000","last_fullsized":"2024-04-26T10:21:09.298243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:45.671865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303860+0000","last_change":"2024-04-26T10:21:09.312081+0000","last_active":"2024-04-26T10:21:10.303860+0000","last_peered":"2024-04-26T10:21:10.303860+0000","last_clean":"2024-04-26T10:21:10.303860+0000","last_became_active":"2024-04-26T10:21:09.310879+0000","last_became_peered":"2024-04-26T10:21:09.310879+0000","last_unstale":"2024-04-26T10:21:10.303860+0000","last_undegraded":"2024-04-26T10:21:10.303860+0000","last_fullsized":"2024-04-26T10:21:10.303860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:36.358962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295619+0000","last_change":"2024-04-26T10:21:08.936748+0000","last_active":"2024-04-26T10:21:09.295619+0000","last_peered":"2024-04-26T10:21:09.295619+0000","last_clean":"2024-04-26T10:21:09.295619+0000","last_became_active":"2024-04-26T10:21:08.936316+0000","last_became_peered":"2024-04-26T10:21:08.936316+0000","last_unstale":"2024-04-26T10:21:09.295619+0000","last_undegraded":"2024-04-26T10:21:09.295619+0000","last_fullsized":"2024-04-26T10:21:09.295619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:47.721288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303753+0000","last_change":"2024-04-26T10:21:09.320062+0000","last_active":"2024-04-26T10:21:10.303753+0000","last_peered":"2024-04-26T10:21:10.303753+0000","last_clean":"2024-04-26T10:21:10.303753+0000","last_became_active":"2024-04-26T10:21:09.319352+0000","last_became_peered":"2024-04-26T10:21:09.319352+0000","last_unstale":"2024-04-26T10:21:10.303753+0000","last_undegraded":"2024-04-26T10:21:10.303753+0000","last_fullsized":"2024-04-26T10:21:10.303753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.998466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316248+0000","last_change":"2024-04-26T10:21:08.931356+0000","last_active":"2024-04-26T10:21:09.316248+0000","last_peered":"2024-04-26T10:21:09.316248+0000","last_clean":"2024-04-26T10:21:09.316248+0000","last_became_active":"2024-04-26T10:21:08.930016+0000","last_became_peered":"2024-04-26T10:21:08.930016+0000","last_unstale":"2024-04-26T10:21:09.316248+0000","last_undegraded":"2024-04-26T10:21:09.316248+0000","last_fullsized":"2024-04-26T10:21:09.316248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:21.306576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303057+0000","last_change":"2024-04-26T10:21:09.318178+0000","last_active":"2024-04-26T10:21:10.303057+0000","last_peered":"2024-04-26T10:21:10.303057+0000","last_clean":"2024-04-26T10:21:10.303057+0000","last_became_active":"2024-04-26T10:21:09.317697+0000","last_became_peered":"2024-04-26T10:21:09.317697+0000","last_unstale":"2024-04-26T10:21:10.303057+0000","last_undegraded":"2024-04-26T10:21:10.303057+0000","last_fullsized":"2024-04-26T10:21:10.303057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:46.285390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320054+0000","last_change":"2024-04-26T10:21:08.936115+0000","last_active":"2024-04-26T10:21:09.320054+0000","last_peered":"2024-04-26T10:21:09.320054+0000","last_clean":"2024-04-26T10:21:09.320054+0000","last_became_active":"2024-04-26T10:21:08.935740+0000","last_became_peered":"2024-04-26T10:21:08.935740+0000","last_unstale":"2024-04-26T10:21:09.320054+0000","last_undegraded":"2024-04-26T10:21:09.320054+0000","last_fullsized":"2024-04-26T10:21:09.320054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:08.369059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742450+0000","last_change":"2024-04-26T10:21:09.308077+0000","last_active":"2024-04-26T10:21:10.742450+0000","last_peered":"2024-04-26T10:21:10.742450+0000","last_clean":"2024-04-26T10:21:10.742450+0000","last_became_active":"2024-04-26T10:21:09.307543+0000","last_became_peered":"2024-04-26T10:21:09.307543+0000","last_unstale":"2024-04-26T10:21:10.742450+0000","last_undegraded":"2024-04-26T10:21:10.742450+0000","last_fullsized":"2024-04-26T10:21:10.742450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:46.596591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316572+0000","last_change":"2024-04-26T10:21:08.938933+0000","last_active":"2024-04-26T10:21:09.316572+0000","last_peered":"2024-04-26T10:21:09.316572+0000","last_clean":"2024-04-26T10:21:09.316572+0000","last_became_active":"2024-04-26T10:21:08.938281+0000","last_became_peered":"2024-04-26T10:21:08.938281+0000","last_unstale":"2024-04-26T10:21:09.316572+0000","last_undegraded":"2024-04-26T10:21:09.316572+0000","last_fullsized":"2024-04-26T10:21:09.316572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:50.856581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743973+0000","last_change":"2024-04-26T10:21:09.315331+0000","last_active":"2024-04-26T10:21:10.743973+0000","last_peered":"2024-04-26T10:21:10.743973+0000","last_clean":"2024-04-26T10:21:10.743973+0000","last_became_active":"2024-04-26T10:21:09.314523+0000","last_became_peered":"2024-04-26T10:21:09.314523+0000","last_unstale":"2024-04-26T10:21:10.743973+0000","last_undegraded":"2024-04-26T10:21:10.743973+0000","last_fullsized":"2024-04-26T10:21:10.743973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:24.624358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320722+0000","last_change":"2024-04-26T10:21:08.936791+0000","last_active":"2024-04-26T10:21:09.320722+0000","last_peered":"2024-04-26T10:21:09.320722+0000","last_clean":"2024-04-26T10:21:09.320722+0000","last_became_active":"2024-04-26T10:21:08.936469+0000","last_became_peered":"2024-04-26T10:21:08.936469+0000","last_unstale":"2024-04-26T10:21:09.320722+0000","last_undegraded":"2024-04-26T10:21:09.320722+0000","last_fullsized":"2024-04-26T10:21:09.320722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:14.145721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302806+0000","last_change":"2024-04-26T10:21:09.315299+0000","last_active":"2024-04-26T10:21:10.302806+0000","last_peered":"2024-04-26T10:21:10.302806+0000","last_clean":"2024-04-26T10:21:10.302806+0000","last_became_active":"2024-04-26T10:21:09.314896+0000","last_became_peered":"2024-04-26T10:21:09.314896+0000","last_unstale":"2024-04-26T10:21:10.302806+0000","last_undegraded":"2024-04-26T10:21:10.302806+0000","last_fullsized":"2024-04-26T10:21:10.302806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.174824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316992+0000","last_change":"2024-04-26T10:21:08.933424+0000","last_active":"2024-04-26T10:21:09.316992+0000","last_peered":"2024-04-26T10:21:09.316992+0000","last_clean":"2024-04-26T10:21:09.316992+0000","last_became_active":"2024-04-26T10:21:08.933088+0000","last_became_peered":"2024-04-26T10:21:08.933088+0000","last_unstale":"2024-04-26T10:21:09.316992+0000","last_undegraded":"2024-04-26T10:21:09.316992+0000","last_fullsized":"2024-04-26T10:21:09.316992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:55.394913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742760+0000","last_change":"2024-04-26T10:21:09.308831+0000","last_active":"2024-04-26T10:21:10.742760+0000","last_peered":"2024-04-26T10:21:10.742760+0000","last_clean":"2024-04-26T10:21:10.742760+0000","last_became_active":"2024-04-26T10:21:09.308457+0000","last_became_peered":"2024-04-26T10:21:09.308457+0000","last_unstale":"2024-04-26T10:21:10.742760+0000","last_undegraded":"2024-04-26T10:21:10.742760+0000","last_fullsized":"2024-04-26T10:21:10.742760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:43.137127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.314230+0000","last_change":"2024-04-26T10:21:08.937023+0000","last_active":"2024-04-26T10:21:09.314230+0000","last_peered":"2024-04-26T10:21:09.314230+0000","last_clean":"2024-04-26T10:21:09.314230+0000","last_became_active":"2024-04-26T10:21:08.936511+0000","last_became_peered":"2024-04-26T10:21:08.936511+0000","last_unstale":"2024-04-26T10:21:09.314230+0000","last_undegraded":"2024-04-26T10:21:09.314230+0000","last_fullsized":"2024-04-26T10:21:09.314230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:38.881531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672969,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":653928,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":0,"up_from":10,"seq":42949672968,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":270336,"data_stored":654544,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":2,"up_from":9,"seq":38654705674,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":188416,"data_stored":62430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:21:29.846 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:21:30.157 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:30.160 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:21:30.172 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-26T10:21:29.943067+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94064,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021456,"statfs":{"total":289910292480,"available":289813970944,"internally_reserved":0,"allocated":720896,"data_stored":1370902,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004087"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303606+0000","last_change":"2024-04-26T10:21:09.316096+0000","last_active":"2024-04-26T10:21:10.303606+0000","last_peered":"2024-04-26T10:21:10.303606+0000","last_clean":"2024-04-26T10:21:10.303606+0000","last_became_active":"2024-04-26T10:21:09.315498+0000","last_became_peered":"2024-04-26T10:21:09.315498+0000","last_unstale":"2024-04-26T10:21:10.303606+0000","last_undegraded":"2024-04-26T10:21:10.303606+0000","last_fullsized":"2024-04-26T10:21:10.303606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:14.245434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304046+0000","last_change":"2024-04-26T10:21:09.317241+0000","last_active":"2024-04-26T10:21:10.304046+0000","last_peered":"2024-04-26T10:21:10.304046+0000","last_clean":"2024-04-26T10:21:10.304046+0000","last_became_active":"2024-04-26T10:21:09.316532+0000","last_became_peered":"2024-04-26T10:21:09.316532+0000","last_unstale":"2024-04-26T10:21:10.304046+0000","last_undegraded":"2024-04-26T10:21:10.304046+0000","last_fullsized":"2024-04-26T10:21:10.304046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:00.173638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743004+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:21:10.743004+0000","last_peered":"2024-04-26T10:21:10.743004+0000","last_clean":"2024-04-26T10:21:10.743004+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:21:10.743004+0000","last_undegraded":"2024-04-26T10:21:10.743004+0000","last_fullsized":"2024-04-26T10:21:10.743004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:01.883964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742576+0000","last_change":"2024-04-26T10:21:09.306531+0000","last_active":"2024-04-26T10:21:10.742576+0000","last_peered":"2024-04-26T10:21:10.742576+0000","last_clean":"2024-04-26T10:21:10.742576+0000","last_became_active":"2024-04-26T10:21:09.304885+0000","last_became_peered":"2024-04-26T10:21:09.304885+0000","last_unstale":"2024-04-26T10:21:10.742576+0000","last_undegraded":"2024-04-26T10:21:10.742576+0000","last_fullsized":"2024-04-26T10:21:10.742576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:04.179516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302949+0000","last_change":"2024-04-26T10:21:09.310914+0000","last_active":"2024-04-26T10:21:10.302949+0000","last_peered":"2024-04-26T10:21:10.302949+0000","last_clean":"2024-04-26T10:21:10.302949+0000","last_became_active":"2024-04-26T10:21:09.309981+0000","last_became_peered":"2024-04-26T10:21:09.309981+0000","last_unstale":"2024-04-26T10:21:10.302949+0000","last_undegraded":"2024-04-26T10:21:10.302949+0000","last_fullsized":"2024-04-26T10:21:10.302949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:31:04.926251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743427+0000","last_change":"2024-04-26T10:21:09.305198+0000","last_active":"2024-04-26T10:21:10.743427+0000","last_peered":"2024-04-26T10:21:10.743427+0000","last_clean":"2024-04-26T10:21:10.743427+0000","last_became_active":"2024-04-26T10:21:09.304716+0000","last_became_peered":"2024-04-26T10:21:09.304716+0000","last_unstale":"2024-04-26T10:21:10.743427+0000","last_undegraded":"2024-04-26T10:21:10.743427+0000","last_fullsized":"2024-04-26T10:21:10.743427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:11.224015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742177+0000","last_change":"2024-04-26T10:21:09.307188+0000","last_active":"2024-04-26T10:21:10.742177+0000","last_peered":"2024-04-26T10:21:10.742177+0000","last_clean":"2024-04-26T10:21:10.742177+0000","last_became_active":"2024-04-26T10:21:09.306548+0000","last_became_peered":"2024-04-26T10:21:09.306548+0000","last_unstale":"2024-04-26T10:21:10.742177+0000","last_undegraded":"2024-04-26T10:21:10.742177+0000","last_fullsized":"2024-04-26T10:21:10.742177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:29.565507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741718+0000","last_change":"2024-04-26T10:21:09.308284+0000","last_active":"2024-04-26T10:21:10.741718+0000","last_peered":"2024-04-26T10:21:10.741718+0000","last_clean":"2024-04-26T10:21:10.741718+0000","last_became_active":"2024-04-26T10:21:09.307504+0000","last_became_peered":"2024-04-26T10:21:09.307504+0000","last_unstale":"2024-04-26T10:21:10.741718+0000","last_undegraded":"2024-04-26T10:21:10.741718+0000","last_fullsized":"2024-04-26T10:21:10.741718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:51.549222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303844+0000","last_change":"2024-04-26T10:21:09.314160+0000","last_active":"2024-04-26T10:21:10.303844+0000","last_peered":"2024-04-26T10:21:10.303844+0000","last_clean":"2024-04-26T10:21:10.303844+0000","last_became_active":"2024-04-26T10:21:09.313221+0000","last_became_peered":"2024-04-26T10:21:09.313221+0000","last_unstale":"2024-04-26T10:21:10.303844+0000","last_undegraded":"2024-04-26T10:21:10.303844+0000","last_fullsized":"2024-04-26T10:21:10.303844+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:50.157094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304095+0000","last_change":"2024-04-26T10:21:09.315304+0000","last_active":"2024-04-26T10:21:10.304095+0000","last_peered":"2024-04-26T10:21:10.304095+0000","last_clean":"2024-04-26T10:21:10.304095+0000","last_became_active":"2024-04-26T10:21:09.314619+0000","last_became_peered":"2024-04-26T10:21:09.314619+0000","last_unstale":"2024-04-26T10:21:10.304095+0000","last_undegraded":"2024-04-26T10:21:10.304095+0000","last_fullsized":"2024-04-26T10:21:10.304095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:41.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743482+0000","last_change":"2024-04-26T10:21:09.307173+0000","last_active":"2024-04-26T10:21:10.743482+0000","last_peered":"2024-04-26T10:21:10.743482+0000","last_clean":"2024-04-26T10:21:10.743482+0000","last_became_active":"2024-04-26T10:21:09.306523+0000","last_became_peered":"2024-04-26T10:21:09.306523+0000","last_unstale":"2024-04-26T10:21:10.743482+0000","last_undegraded":"2024-04-26T10:21:10.743482+0000","last_fullsized":"2024-04-26T10:21:10.743482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:15.102637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302828+0000","last_change":"2024-04-26T10:21:09.319057+0000","last_active":"2024-04-26T10:21:10.302828+0000","last_peered":"2024-04-26T10:21:10.302828+0000","last_clean":"2024-04-26T10:21:10.302828+0000","last_became_active":"2024-04-26T10:21:09.318580+0000","last_became_peered":"2024-04-26T10:21:09.318580+0000","last_unstale":"2024-04-26T10:21:10.302828+0000","last_undegraded":"2024-04-26T10:21:10.302828+0000","last_fullsized":"2024-04-26T10:21:10.302828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.335327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302635+0000","last_change":"2024-04-26T10:21:09.310332+0000","last_active":"2024-04-26T10:21:10.302635+0000","last_peered":"2024-04-26T10:21:10.302635+0000","last_clean":"2024-04-26T10:21:10.302635+0000","last_became_active":"2024-04-26T10:21:09.309534+0000","last_became_peered":"2024-04-26T10:21:09.309534+0000","last_unstale":"2024-04-26T10:21:10.302635+0000","last_undegraded":"2024-04-26T10:21:10.302635+0000","last_fullsized":"2024-04-26T10:21:10.302635+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:50:01.594353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742954+0000","last_change":"2024-04-26T10:21:09.316821+0000","last_active":"2024-04-26T10:21:10.742954+0000","last_peered":"2024-04-26T10:21:10.742954+0000","last_clean":"2024-04-26T10:21:10.742954+0000","last_became_active":"2024-04-26T10:21:09.316143+0000","last_became_peered":"2024-04-26T10:21:09.316143+0000","last_unstale":"2024-04-26T10:21:10.742954+0000","last_undegraded":"2024-04-26T10:21:10.742954+0000","last_fullsized":"2024-04-26T10:21:10.742954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:20.271378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742238+0000","last_change":"2024-04-26T10:21:09.314710+0000","last_active":"2024-04-26T10:21:10.742238+0000","last_peered":"2024-04-26T10:21:10.742238+0000","last_clean":"2024-04-26T10:21:10.742238+0000","last_became_active":"2024-04-26T10:21:09.314401+0000","last_became_peered":"2024-04-26T10:21:09.314401+0000","last_unstale":"2024-04-26T10:21:10.742238+0000","last_undegraded":"2024-04-26T10:21:10.742238+0000","last_fullsized":"2024-04-26T10:21:10.742238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:14.245434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741766+0000","last_change":"2024-04-26T10:21:09.306575+0000","last_active":"2024-04-26T10:21:10.741766+0000","last_peered":"2024-04-26T10:21:10.741766+0000","last_clean":"2024-04-26T10:21:10.741766+0000","last_became_active":"2024-04-26T10:21:09.305009+0000","last_became_peered":"2024-04-26T10:21:09.305009+0000","last_unstale":"2024-04-26T10:21:10.741766+0000","last_undegraded":"2024-04-26T10:21:10.741766+0000","last_fullsized":"2024-04-26T10:21:10.741766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:42.965427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304549+0000","last_change":"2024-04-26T10:21:09.317530+0000","last_active":"2024-04-26T10:21:10.304549+0000","last_peered":"2024-04-26T10:21:10.304549+0000","last_clean":"2024-04-26T10:21:10.304549+0000","last_became_active":"2024-04-26T10:21:09.316956+0000","last_became_peered":"2024-04-26T10:21:09.316956+0000","last_unstale":"2024-04-26T10:21:10.304549+0000","last_undegraded":"2024-04-26T10:21:10.304549+0000","last_fullsized":"2024-04-26T10:21:10.304549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:05.112877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304348+0000","last_change":"2024-04-26T10:21:09.316152+0000","last_active":"2024-04-26T10:21:10.304348+0000","last_peered":"2024-04-26T10:21:10.304348+0000","last_clean":"2024-04-26T10:21:10.304348+0000","last_became_active":"2024-04-26T10:21:09.315441+0000","last_became_peered":"2024-04-26T10:21:09.315441+0000","last_unstale":"2024-04-26T10:21:10.304348+0000","last_undegraded":"2024-04-26T10:21:10.304348+0000","last_fullsized":"2024-04-26T10:21:10.304348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:42.904467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303452+0000","last_change":"2024-04-26T10:21:09.316805+0000","last_active":"2024-04-26T10:21:10.303452+0000","last_peered":"2024-04-26T10:21:10.303452+0000","last_clean":"2024-04-26T10:21:10.303452+0000","last_became_active":"2024-04-26T10:21:09.316490+0000","last_became_peered":"2024-04-26T10:21:09.316490+0000","last_unstale":"2024-04-26T10:21:10.303452+0000","last_undegraded":"2024-04-26T10:21:10.303452+0000","last_fullsized":"2024-04-26T10:21:10.303452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:11.814183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742675+0000","last_change":"2024-04-26T10:21:09.314189+0000","last_active":"2024-04-26T10:21:10.742675+0000","last_peered":"2024-04-26T10:21:10.742675+0000","last_clean":"2024-04-26T10:21:10.742675+0000","last_became_active":"2024-04-26T10:21:09.313648+0000","last_became_peered":"2024-04-26T10:21:09.313648+0000","last_unstale":"2024-04-26T10:21:10.742675+0000","last_undegraded":"2024-04-26T10:21:10.742675+0000","last_fullsized":"2024-04-26T10:21:10.742675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:57.658133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743475+0000","last_change":"2024-04-26T10:21:09.316594+0000","last_active":"2024-04-26T10:21:10.743475+0000","last_peered":"2024-04-26T10:21:10.743475+0000","last_clean":"2024-04-26T10:21:10.743475+0000","last_became_active":"2024-04-26T10:21:09.315877+0000","last_became_peered":"2024-04-26T10:21:09.315877+0000","last_unstale":"2024-04-26T10:21:10.743475+0000","last_undegraded":"2024-04-26T10:21:10.743475+0000","last_fullsized":"2024-04-26T10:21:10.743475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:19.943321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302427+0000","last_change":"2024-04-26T10:21:09.318829+0000","last_active":"2024-04-26T10:21:10.302427+0000","last_peered":"2024-04-26T10:21:10.302427+0000","last_clean":"2024-04-26T10:21:10.302427+0000","last_became_active":"2024-04-26T10:21:09.318379+0000","last_became_peered":"2024-04-26T10:21:09.318379+0000","last_unstale":"2024-04-26T10:21:10.302427+0000","last_undegraded":"2024-04-26T10:21:10.302427+0000","last_fullsized":"2024-04-26T10:21:10.302427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:11.224015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302100+0000","last_change":"2024-04-26T10:21:09.309068+0000","last_active":"2024-04-26T10:21:10.302100+0000","last_peered":"2024-04-26T10:21:10.302100+0000","last_clean":"2024-04-26T10:21:10.302100+0000","last_became_active":"2024-04-26T10:21:09.308797+0000","last_became_peered":"2024-04-26T10:21:09.308797+0000","last_unstale":"2024-04-26T10:21:10.302100+0000","last_undegraded":"2024-04-26T10:21:10.302100+0000","last_fullsized":"2024-04-26T10:21:10.302100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:44.761759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.301914+0000","last_change":"2024-04-26T10:21:09.311574+0000","last_active":"2024-04-26T10:21:10.301914+0000","last_peered":"2024-04-26T10:21:10.301914+0000","last_clean":"2024-04-26T10:21:10.301914+0000","last_became_active":"2024-04-26T10:21:09.309285+0000","last_became_peered":"2024-04-26T10:21:09.309285+0000","last_unstale":"2024-04-26T10:21:10.301914+0000","last_undegraded":"2024-04-26T10:21:10.301914+0000","last_fullsized":"2024-04-26T10:21:10.301914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:06.884098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303605+0000","last_change":"2024-04-26T10:21:09.317948+0000","last_active":"2024-04-26T10:21:10.303605+0000","last_peered":"2024-04-26T10:21:10.303605+0000","last_clean":"2024-04-26T10:21:10.303605+0000","last_became_active":"2024-04-26T10:21:09.317571+0000","last_became_peered":"2024-04-26T10:21:09.317571+0000","last_unstale":"2024-04-26T10:21:10.303605+0000","last_undegraded":"2024-04-26T10:21:10.303605+0000","last_fullsized":"2024-04-26T10:21:10.303605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:04.179516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304130+0000","last_change":"2024-04-26T10:21:09.312839+0000","last_active":"2024-04-26T10:21:10.304130+0000","last_peered":"2024-04-26T10:21:10.304130+0000","last_clean":"2024-04-26T10:21:10.304130+0000","last_became_active":"2024-04-26T10:21:09.311898+0000","last_became_peered":"2024-04-26T10:21:09.311898+0000","last_unstale":"2024-04-26T10:21:10.304130+0000","last_undegraded":"2024-04-26T10:21:10.304130+0000","last_fullsized":"2024-04-26T10:21:10.304130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:03.705171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743873+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:21:10.743873+0000","last_peered":"2024-04-26T10:21:10.743873+0000","last_clean":"2024-04-26T10:21:10.743873+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:21:10.743873+0000","last_undegraded":"2024-04-26T10:21:10.743873+0000","last_fullsized":"2024-04-26T10:21:10.743873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:39.394937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303372+0000","last_change":"2024-04-26T10:21:09.312446+0000","last_active":"2024-04-26T10:21:10.303372+0000","last_peered":"2024-04-26T10:21:10.303372+0000","last_clean":"2024-04-26T10:21:10.303372+0000","last_became_active":"2024-04-26T10:21:09.311919+0000","last_became_peered":"2024-04-26T10:21:09.311919+0000","last_unstale":"2024-04-26T10:21:10.303372+0000","last_undegraded":"2024-04-26T10:21:10.303372+0000","last_fullsized":"2024-04-26T10:21:10.303372+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:57.658133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303274+0000","last_change":"2024-04-26T10:21:09.316871+0000","last_active":"2024-04-26T10:21:10.303274+0000","last_peered":"2024-04-26T10:21:10.303274+0000","last_clean":"2024-04-26T10:21:10.303274+0000","last_became_active":"2024-04-26T10:21:09.316529+0000","last_became_peered":"2024-04-26T10:21:09.316529+0000","last_unstale":"2024-04-26T10:21:10.303274+0000","last_undegraded":"2024-04-26T10:21:10.303274+0000","last_fullsized":"2024-04-26T10:21:10.303274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:52.614699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303836+0000","last_change":"2024-04-26T10:21:09.313160+0000","last_active":"2024-04-26T10:21:10.303836+0000","last_peered":"2024-04-26T10:21:10.303836+0000","last_clean":"2024-04-26T10:21:10.303836+0000","last_became_active":"2024-04-26T10:21:09.312556+0000","last_became_peered":"2024-04-26T10:21:09.312556+0000","last_unstale":"2024-04-26T10:21:10.303836+0000","last_undegraded":"2024-04-26T10:21:10.303836+0000","last_fullsized":"2024-04-26T10:21:10.303836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:21.698558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302244+0000","last_change":"2024-04-26T10:21:09.314165+0000","last_active":"2024-04-26T10:21:10.302244+0000","last_peered":"2024-04-26T10:21:10.302244+0000","last_clean":"2024-04-26T10:21:10.302244+0000","last_became_active":"2024-04-26T10:21:09.313559+0000","last_became_peered":"2024-04-26T10:21:09.313559+0000","last_unstale":"2024-04-26T10:21:10.302244+0000","last_undegraded":"2024-04-26T10:21:10.302244+0000","last_fullsized":"2024-04-26T10:21:10.302244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:05.857831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.741968+0000","last_change":"2024-04-26T10:21:09.309366+0000","last_active":"2024-04-26T10:21:10.741968+0000","last_peered":"2024-04-26T10:21:10.741968+0000","last_clean":"2024-04-26T10:21:10.741968+0000","last_became_active":"2024-04-26T10:21:09.308660+0000","last_became_peered":"2024-04-26T10:21:09.308660+0000","last_unstale":"2024-04-26T10:21:10.741968+0000","last_undegraded":"2024-04-26T10:21:10.741968+0000","last_fullsized":"2024-04-26T10:21:10.741968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.335327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303113+0000","last_change":"2024-04-26T10:21:09.317455+0000","last_active":"2024-04-26T10:21:10.303113+0000","last_peered":"2024-04-26T10:21:10.303113+0000","last_clean":"2024-04-26T10:21:10.303113+0000","last_became_active":"2024-04-26T10:21:09.316994+0000","last_became_peered":"2024-04-26T10:21:09.316994+0000","last_unstale":"2024-04-26T10:21:10.303113+0000","last_undegraded":"2024-04-26T10:21:10.303113+0000","last_fullsized":"2024-04-26T10:21:10.303113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:48.942276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.317124+0000","last_change":"2024-04-26T10:21:08.939370+0000","last_active":"2024-04-26T10:21:09.317124+0000","last_peered":"2024-04-26T10:21:09.317124+0000","last_clean":"2024-04-26T10:21:09.317124+0000","last_became_active":"2024-04-26T10:21:08.937845+0000","last_became_peered":"2024-04-26T10:21:08.937845+0000","last_unstale":"2024-04-26T10:21:09.317124+0000","last_undegraded":"2024-04-26T10:21:09.317124+0000","last_fullsized":"2024-04-26T10:21:09.317124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:28.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304041+0000","last_change":"2024-04-26T10:21:09.316515+0000","last_active":"2024-04-26T10:21:10.304041+0000","last_peered":"2024-04-26T10:21:10.304041+0000","last_clean":"2024-04-26T10:21:10.304041+0000","last_became_active":"2024-04-26T10:21:09.315714+0000","last_became_peered":"2024-04-26T10:21:09.315714+0000","last_unstale":"2024-04-26T10:21:10.304041+0000","last_undegraded":"2024-04-26T10:21:10.304041+0000","last_fullsized":"2024-04-26T10:21:10.304041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:34:40.032760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296726+0000","last_change":"2024-04-26T10:21:08.937056+0000","last_active":"2024-04-26T10:21:09.296726+0000","last_peered":"2024-04-26T10:21:09.296726+0000","last_clean":"2024-04-26T10:21:09.296726+0000","last_became_active":"2024-04-26T10:21:08.936545+0000","last_became_peered":"2024-04-26T10:21:08.936545+0000","last_unstale":"2024-04-26T10:21:09.296726+0000","last_undegraded":"2024-04-26T10:21:09.296726+0000","last_fullsized":"2024-04-26T10:21:09.296726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:48.449203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304386+0000","last_change":"2024-04-26T10:21:09.313813+0000","last_active":"2024-04-26T10:21:10.304386+0000","last_peered":"2024-04-26T10:21:10.304386+0000","last_clean":"2024-04-26T10:21:10.304386+0000","last_became_active":"2024-04-26T10:21:09.312562+0000","last_became_peered":"2024-04-26T10:21:09.312562+0000","last_unstale":"2024-04-26T10:21:10.304386+0000","last_undegraded":"2024-04-26T10:21:10.304386+0000","last_fullsized":"2024-04-26T10:21:10.304386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:46.413942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309703+0000","last_change":"2024-04-26T10:21:08.936433+0000","last_active":"2024-04-26T10:21:09.309703+0000","last_peered":"2024-04-26T10:21:09.309703+0000","last_clean":"2024-04-26T10:21:09.309703+0000","last_became_active":"2024-04-26T10:21:08.935875+0000","last_became_peered":"2024-04-26T10:21:08.935875+0000","last_unstale":"2024-04-26T10:21:09.309703+0000","last_undegraded":"2024-04-26T10:21:09.309703+0000","last_fullsized":"2024-04-26T10:21:09.309703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:24.501204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303865+0000","last_change":"2024-04-26T10:21:09.314435+0000","last_active":"2024-04-26T10:21:10.303865+0000","last_peered":"2024-04-26T10:21:10.303865+0000","last_clean":"2024-04-26T10:21:10.303865+0000","last_became_active":"2024-04-26T10:21:09.313684+0000","last_became_peered":"2024-04-26T10:21:09.313684+0000","last_unstale":"2024-04-26T10:21:10.303865+0000","last_undegraded":"2024-04-26T10:21:10.303865+0000","last_fullsized":"2024-04-26T10:21:10.303865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:20.185980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.321258+0000","last_change":"2024-04-26T10:21:08.934971+0000","last_active":"2024-04-26T10:21:09.321258+0000","last_peered":"2024-04-26T10:21:09.321258+0000","last_clean":"2024-04-26T10:21:09.321258+0000","last_became_active":"2024-04-26T10:21:08.934653+0000","last_became_peered":"2024-04-26T10:21:08.934653+0000","last_unstale":"2024-04-26T10:21:09.321258+0000","last_undegraded":"2024-04-26T10:21:09.321258+0000","last_fullsized":"2024-04-26T10:21:09.321258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:18.272015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.315924+0000","last_change":"2024-04-26T10:21:08.934452+0000","last_active":"2024-04-26T10:21:09.315924+0000","last_peered":"2024-04-26T10:21:09.315924+0000","last_clean":"2024-04-26T10:21:09.315924+0000","last_became_active":"2024-04-26T10:21:08.934091+0000","last_became_peered":"2024-04-26T10:21:08.934091+0000","last_unstale":"2024-04-26T10:21:09.315924+0000","last_undegraded":"2024-04-26T10:21:09.315924+0000","last_fullsized":"2024-04-26T10:21:09.315924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:11.224989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.301898+0000","last_change":"2024-04-26T10:21:09.314631+0000","last_active":"2024-04-26T10:21:10.301898+0000","last_peered":"2024-04-26T10:21:10.301898+0000","last_clean":"2024-04-26T10:21:10.301898+0000","last_became_active":"2024-04-26T10:21:09.313044+0000","last_became_peered":"2024-04-26T10:21:09.313044+0000","last_unstale":"2024-04-26T10:21:10.301898+0000","last_undegraded":"2024-04-26T10:21:10.301898+0000","last_fullsized":"2024-04-26T10:21:10.301898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:19.943321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.319848+0000","last_change":"2024-04-26T10:21:08.935870+0000","last_active":"2024-04-26T10:21:09.319848+0000","last_peered":"2024-04-26T10:21:09.319848+0000","last_clean":"2024-04-26T10:21:09.319848+0000","last_became_active":"2024-04-26T10:21:08.935380+0000","last_became_peered":"2024-04-26T10:21:08.935380+0000","last_unstale":"2024-04-26T10:21:09.319848+0000","last_undegraded":"2024-04-26T10:21:09.319848+0000","last_fullsized":"2024-04-26T10:21:09.319848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:22.537149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302131+0000","last_change":"2024-04-26T10:21:09.317032+0000","last_active":"2024-04-26T10:21:10.302131+0000","last_peered":"2024-04-26T10:21:10.302131+0000","last_clean":"2024-04-26T10:21:10.302131+0000","last_became_active":"2024-04-26T10:21:09.316416+0000","last_became_peered":"2024-04-26T10:21:09.316416+0000","last_unstale":"2024-04-26T10:21:10.302131+0000","last_undegraded":"2024-04-26T10:21:10.302131+0000","last_fullsized":"2024-04-26T10:21:10.302131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:56.161782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320696+0000","last_change":"2024-04-26T10:21:08.935133+0000","last_active":"2024-04-26T10:21:09.320696+0000","last_peered":"2024-04-26T10:21:09.320696+0000","last_clean":"2024-04-26T10:21:09.320696+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:21:09.320696+0000","last_undegraded":"2024-04-26T10:21:09.320696+0000","last_fullsized":"2024-04-26T10:21:09.320696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:25.498249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743681+0000","last_change":"2024-04-26T10:21:09.315201+0000","last_active":"2024-04-26T10:21:10.743681+0000","last_peered":"2024-04-26T10:21:10.743681+0000","last_clean":"2024-04-26T10:21:10.743681+0000","last_became_active":"2024-04-26T10:21:09.314390+0000","last_became_peered":"2024-04-26T10:21:09.314390+0000","last_unstale":"2024-04-26T10:21:10.743681+0000","last_undegraded":"2024-04-26T10:21:10.743681+0000","last_fullsized":"2024-04-26T10:21:10.743681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.998466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.299090+0000","last_change":"2024-04-26T10:21:08.939382+0000","last_active":"2024-04-26T10:21:09.299090+0000","last_peered":"2024-04-26T10:21:09.299090+0000","last_clean":"2024-04-26T10:21:09.299090+0000","last_became_active":"2024-04-26T10:21:08.938193+0000","last_became_peered":"2024-04-26T10:21:08.938193+0000","last_unstale":"2024-04-26T10:21:09.299090+0000","last_undegraded":"2024-04-26T10:21:09.299090+0000","last_fullsized":"2024-04-26T10:21:09.299090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:01.182611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303014+0000","last_change":"2024-04-26T10:21:09.313678+0000","last_active":"2024-04-26T10:21:10.303014+0000","last_peered":"2024-04-26T10:21:10.303014+0000","last_clean":"2024-04-26T10:21:10.303014+0000","last_became_active":"2024-04-26T10:21:09.312906+0000","last_became_peered":"2024-04-26T10:21:09.312906+0000","last_unstale":"2024-04-26T10:21:10.303014+0000","last_undegraded":"2024-04-26T10:21:10.303014+0000","last_fullsized":"2024-04-26T10:21:10.303014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:14.241108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.313678+0000","last_change":"2024-04-26T10:21:08.936904+0000","last_active":"2024-04-26T10:21:09.313678+0000","last_peered":"2024-04-26T10:21:09.313678+0000","last_clean":"2024-04-26T10:21:09.313678+0000","last_became_active":"2024-04-26T10:21:08.936376+0000","last_became_peered":"2024-04-26T10:21:08.936376+0000","last_unstale":"2024-04-26T10:21:09.313678+0000","last_undegraded":"2024-04-26T10:21:09.313678+0000","last_fullsized":"2024-04-26T10:21:09.313678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:19.270525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742850+0000","last_change":"2024-04-26T10:21:09.307911+0000","last_active":"2024-04-26T10:21:10.742850+0000","last_peered":"2024-04-26T10:21:10.742850+0000","last_clean":"2024-04-26T10:21:10.742850+0000","last_became_active":"2024-04-26T10:21:09.307597+0000","last_became_peered":"2024-04-26T10:21:09.307597+0000","last_unstale":"2024-04-26T10:21:10.742850+0000","last_undegraded":"2024-04-26T10:21:10.742850+0000","last_fullsized":"2024-04-26T10:21:10.742850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:21.698558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.300582+0000","last_change":"2024-04-26T10:21:08.939072+0000","last_active":"2024-04-26T10:21:09.300582+0000","last_peered":"2024-04-26T10:21:09.300582+0000","last_clean":"2024-04-26T10:21:09.300582+0000","last_became_active":"2024-04-26T10:21:08.938445+0000","last_became_peered":"2024-04-26T10:21:08.938445+0000","last_unstale":"2024-04-26T10:21:09.300582+0000","last_undegraded":"2024-04-26T10:21:09.300582+0000","last_fullsized":"2024-04-26T10:21:09.300582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:06.598189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743938+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:21:10.743938+0000","last_peered":"2024-04-26T10:21:10.743938+0000","last_clean":"2024-04-26T10:21:10.743938+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:21:10.743938+0000","last_undegraded":"2024-04-26T10:21:10.743938+0000","last_fullsized":"2024-04-26T10:21:10.743938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309935+0000","last_change":"2024-04-26T10:21:08.936533+0000","last_active":"2024-04-26T10:21:09.309935+0000","last_peered":"2024-04-26T10:21:09.309935+0000","last_clean":"2024-04-26T10:21:09.309935+0000","last_became_active":"2024-04-26T10:21:08.936222+0000","last_became_peered":"2024-04-26T10:21:08.936222+0000","last_unstale":"2024-04-26T10:21:09.309935+0000","last_undegraded":"2024-04-26T10:21:09.309935+0000","last_fullsized":"2024-04-26T10:21:09.309935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:18:07.306351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742771+0000","last_change":"2024-04-26T10:21:09.316361+0000","last_active":"2024-04-26T10:21:10.742771+0000","last_peered":"2024-04-26T10:21:10.742771+0000","last_clean":"2024-04-26T10:21:10.742771+0000","last_became_active":"2024-04-26T10:21:09.315981+0000","last_became_peered":"2024-04-26T10:21:09.315981+0000","last_unstale":"2024-04-26T10:21:10.742771+0000","last_undegraded":"2024-04-26T10:21:10.742771+0000","last_fullsized":"2024-04-26T10:21:10.742771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:00.173638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.309815+0000","last_change":"2024-04-26T10:21:08.928590+0000","last_active":"2024-04-26T10:21:09.309815+0000","last_peered":"2024-04-26T10:21:09.309815+0000","last_clean":"2024-04-26T10:21:09.309815+0000","last_became_active":"2024-04-26T10:21:08.928354+0000","last_became_peered":"2024-04-26T10:21:08.928354+0000","last_unstale":"2024-04-26T10:21:09.309815+0000","last_undegraded":"2024-04-26T10:21:09.309815+0000","last_fullsized":"2024-04-26T10:21:09.309815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:52.241716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304119+0000","last_change":"2024-04-26T10:21:09.317282+0000","last_active":"2024-04-26T10:21:10.304119+0000","last_peered":"2024-04-26T10:21:10.304119+0000","last_clean":"2024-04-26T10:21:10.304119+0000","last_became_active":"2024-04-26T10:21:09.316591+0000","last_became_peered":"2024-04-26T10:21:09.316591+0000","last_unstale":"2024-04-26T10:21:10.304119+0000","last_undegraded":"2024-04-26T10:21:10.304119+0000","last_fullsized":"2024-04-26T10:21:10.304119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:28.447361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":213,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297609+0000","last_change":"2024-04-26T10:21:01.829140+0000","last_active":"2024-04-26T10:21:09.297609+0000","last_peered":"2024-04-26T10:21:09.297609+0000","last_clean":"2024-04-26T10:21:09.297609+0000","last_became_active":"2024-04-26T10:21:01.827182+0000","last_became_peered":"2024-04-26T10:21:01.827182+0000","last_unstale":"2024-04-26T10:21:09.297609+0000","last_undegraded":"2024-04-26T10:21:09.297609+0000","last_fullsized":"2024-04-26T10:21:09.297609+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:00:51.477222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298874+0000","last_change":"2024-04-26T10:21:04.893745+0000","last_active":"2024-04-26T10:21:09.298874+0000","last_peered":"2024-04-26T10:21:09.298874+0000","last_clean":"2024-04-26T10:21:09.298874+0000","last_became_active":"2024-04-26T10:21:04.893031+0000","last_became_peered":"2024-04-26T10:21:04.893031+0000","last_unstale":"2024-04-26T10:21:09.298874+0000","last_undegraded":"2024-04-26T10:21:09.298874+0000","last_fullsized":"2024-04-26T10:21:09.298874+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:59.771061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297001+0000","last_change":"2024-04-26T10:21:08.933706+0000","last_active":"2024-04-26T10:21:09.297001+0000","last_peered":"2024-04-26T10:21:09.297001+0000","last_clean":"2024-04-26T10:21:09.297001+0000","last_became_active":"2024-04-26T10:21:08.933372+0000","last_became_peered":"2024-04-26T10:21:08.933372+0000","last_unstale":"2024-04-26T10:21:09.297001+0000","last_undegraded":"2024-04-26T10:21:09.297001+0000","last_fullsized":"2024-04-26T10:21:09.297001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:14.290484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.744176+0000","last_change":"2024-04-26T10:21:09.320889+0000","last_active":"2024-04-26T10:21:10.744176+0000","last_peered":"2024-04-26T10:21:10.744176+0000","last_clean":"2024-04-26T10:21:10.744176+0000","last_became_active":"2024-04-26T10:21:09.320355+0000","last_became_peered":"2024-04-26T10:21:09.320355+0000","last_unstale":"2024-04-26T10:21:10.744176+0000","last_undegraded":"2024-04-26T10:21:10.744176+0000","last_fullsized":"2024-04-26T10:21:10.744176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:41.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297382+0000","last_change":"2024-04-26T10:21:04.892156+0000","last_active":"2024-04-26T10:21:09.297382+0000","last_peered":"2024-04-26T10:21:09.297382+0000","last_clean":"2024-04-26T10:21:09.297382+0000","last_became_active":"2024-04-26T10:21:04.891660+0000","last_became_peered":"2024-04-26T10:21:04.891660+0000","last_unstale":"2024-04-26T10:21:09.297382+0000","last_undegraded":"2024-04-26T10:21:09.297382+0000","last_fullsized":"2024-04-26T10:21:09.297382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:50.568468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296858+0000","last_change":"2024-04-26T10:21:08.936815+0000","last_active":"2024-04-26T10:21:09.296858+0000","last_peered":"2024-04-26T10:21:09.296858+0000","last_clean":"2024-04-26T10:21:09.296858+0000","last_became_active":"2024-04-26T10:21:08.936180+0000","last_became_peered":"2024-04-26T10:21:08.936180+0000","last_unstale":"2024-04-26T10:21:09.296858+0000","last_undegraded":"2024-04-26T10:21:09.296858+0000","last_fullsized":"2024-04-26T10:21:09.296858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:41.614282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304366+0000","last_change":"2024-04-26T10:21:09.310050+0000","last_active":"2024-04-26T10:21:10.304366+0000","last_peered":"2024-04-26T10:21:10.304366+0000","last_clean":"2024-04-26T10:21:10.304366+0000","last_became_active":"2024-04-26T10:21:09.309470+0000","last_became_peered":"2024-04-26T10:21:09.309470+0000","last_unstale":"2024-04-26T10:21:10.304366+0000","last_undegraded":"2024-04-26T10:21:10.304366+0000","last_fullsized":"2024-04-26T10:21:10.304366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:32.334144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296330+0000","last_change":"2024-04-26T10:21:04.890860+0000","last_active":"2024-04-26T10:21:09.296330+0000","last_peered":"2024-04-26T10:21:09.296330+0000","last_clean":"2024-04-26T10:21:09.296330+0000","last_became_active":"2024-04-26T10:21:04.890336+0000","last_became_peered":"2024-04-26T10:21:04.890336+0000","last_unstale":"2024-04-26T10:21:09.296330+0000","last_undegraded":"2024-04-26T10:21:09.296330+0000","last_fullsized":"2024-04-26T10:21:09.296330+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:13.262120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.310359+0000","last_change":"2024-04-26T10:21:08.936077+0000","last_active":"2024-04-26T10:21:09.310359+0000","last_peered":"2024-04-26T10:21:09.310359+0000","last_clean":"2024-04-26T10:21:09.310359+0000","last_became_active":"2024-04-26T10:21:08.935621+0000","last_became_peered":"2024-04-26T10:21:08.935621+0000","last_unstale":"2024-04-26T10:21:09.310359+0000","last_undegraded":"2024-04-26T10:21:09.310359+0000","last_fullsized":"2024-04-26T10:21:09.310359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:54:11.906094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304130+0000","last_change":"2024-04-26T10:21:09.314796+0000","last_active":"2024-04-26T10:21:10.304130+0000","last_peered":"2024-04-26T10:21:10.304130+0000","last_clean":"2024-04-26T10:21:10.304130+0000","last_became_active":"2024-04-26T10:21:09.314574+0000","last_became_peered":"2024-04-26T10:21:09.314574+0000","last_unstale":"2024-04-26T10:21:10.304130+0000","last_undegraded":"2024-04-26T10:21:10.304130+0000","last_fullsized":"2024-04-26T10:21:10.304130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:32.136621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301803+0000","last_change":"2024-04-26T10:21:04.893253+0000","last_active":"2024-04-26T10:21:09.301803+0000","last_peered":"2024-04-26T10:21:09.301803+0000","last_clean":"2024-04-26T10:21:09.301803+0000","last_became_active":"2024-04-26T10:21:04.892843+0000","last_became_peered":"2024-04-26T10:21:04.892843+0000","last_unstale":"2024-04-26T10:21:09.301803+0000","last_undegraded":"2024-04-26T10:21:09.301803+0000","last_fullsized":"2024-04-26T10:21:09.301803+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:00.749791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298626+0000","last_change":"2024-04-26T10:21:08.937153+0000","last_active":"2024-04-26T10:21:09.298626+0000","last_peered":"2024-04-26T10:21:09.298626+0000","last_clean":"2024-04-26T10:21:09.298626+0000","last_became_active":"2024-04-26T10:21:08.936561+0000","last_became_peered":"2024-04-26T10:21:08.936561+0000","last_unstale":"2024-04-26T10:21:09.298626+0000","last_undegraded":"2024-04-26T10:21:09.298626+0000","last_fullsized":"2024-04-26T10:21:09.298626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:28.491800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303941+0000","last_change":"2024-04-26T10:21:09.314218+0000","last_active":"2024-04-26T10:21:10.303941+0000","last_peered":"2024-04-26T10:21:10.303941+0000","last_clean":"2024-04-26T10:21:10.303941+0000","last_became_active":"2024-04-26T10:21:09.313641+0000","last_became_peered":"2024-04-26T10:21:09.313641+0000","last_unstale":"2024-04-26T10:21:10.303941+0000","last_undegraded":"2024-04-26T10:21:10.303941+0000","last_fullsized":"2024-04-26T10:21:10.303941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:08.449512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.300397+0000","last_change":"2024-04-26T10:21:08.937196+0000","last_active":"2024-04-26T10:21:09.300397+0000","last_peered":"2024-04-26T10:21:09.300397+0000","last_clean":"2024-04-26T10:21:09.300397+0000","last_became_active":"2024-04-26T10:21:08.936779+0000","last_became_peered":"2024-04-26T10:21:08.936779+0000","last_unstale":"2024-04-26T10:21:09.300397+0000","last_undegraded":"2024-04-26T10:21:09.300397+0000","last_fullsized":"2024-04-26T10:21:09.300397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:20.545169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295561+0000","last_change":"2024-04-26T10:21:04.890548+0000","last_active":"2024-04-26T10:21:09.295561+0000","last_peered":"2024-04-26T10:21:09.295561+0000","last_clean":"2024-04-26T10:21:09.295561+0000","last_became_active":"2024-04-26T10:21:04.890034+0000","last_became_peered":"2024-04-26T10:21:04.890034+0000","last_unstale":"2024-04-26T10:21:09.295561+0000","last_undegraded":"2024-04-26T10:21:09.295561+0000","last_fullsized":"2024-04-26T10:21:09.295561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:55.033455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302442+0000","last_change":"2024-04-26T10:21:09.318348+0000","last_active":"2024-04-26T10:21:10.302442+0000","last_peered":"2024-04-26T10:21:10.302442+0000","last_clean":"2024-04-26T10:21:10.302442+0000","last_became_active":"2024-04-26T10:21:09.317886+0000","last_became_peered":"2024-04-26T10:21:09.317886+0000","last_unstale":"2024-04-26T10:21:10.302442+0000","last_undegraded":"2024-04-26T10:21:10.302442+0000","last_fullsized":"2024-04-26T10:21:10.302442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:24.624358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295394+0000","last_change":"2024-04-26T10:21:08.933714+0000","last_active":"2024-04-26T10:21:09.295394+0000","last_peered":"2024-04-26T10:21:09.295394+0000","last_clean":"2024-04-26T10:21:09.295394+0000","last_became_active":"2024-04-26T10:21:08.933259+0000","last_became_peered":"2024-04-26T10:21:08.933259+0000","last_unstale":"2024-04-26T10:21:09.295394+0000","last_undegraded":"2024-04-26T10:21:09.295394+0000","last_fullsized":"2024-04-26T10:21:09.295394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:50.230096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.311683+0000","last_change":"2024-04-26T10:21:04.891490+0000","last_active":"2024-04-26T10:21:09.311683+0000","last_peered":"2024-04-26T10:21:09.311683+0000","last_clean":"2024-04-26T10:21:09.311683+0000","last_became_active":"2024-04-26T10:21:04.890777+0000","last_became_peered":"2024-04-26T10:21:04.890777+0000","last_unstale":"2024-04-26T10:21:09.311683+0000","last_undegraded":"2024-04-26T10:21:09.311683+0000","last_fullsized":"2024-04-26T10:21:09.311683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:25.896672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302680+0000","last_change":"2024-04-26T10:21:09.314213+0000","last_active":"2024-04-26T10:21:10.302680+0000","last_peered":"2024-04-26T10:21:10.302680+0000","last_clean":"2024-04-26T10:21:10.302680+0000","last_became_active":"2024-04-26T10:21:09.312975+0000","last_became_peered":"2024-04-26T10:21:09.312975+0000","last_unstale":"2024-04-26T10:21:10.302680+0000","last_undegraded":"2024-04-26T10:21:10.302680+0000","last_fullsized":"2024-04-26T10:21:10.302680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:43.137127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.317699+0000","last_change":"2024-04-26T10:21:08.934216+0000","last_active":"2024-04-26T10:21:09.317699+0000","last_peered":"2024-04-26T10:21:09.317699+0000","last_clean":"2024-04-26T10:21:09.317699+0000","last_became_active":"2024-04-26T10:21:08.933524+0000","last_became_peered":"2024-04-26T10:21:08.933524+0000","last_unstale":"2024-04-26T10:21:09.317699+0000","last_undegraded":"2024-04-26T10:21:09.317699+0000","last_fullsized":"2024-04-26T10:21:09.317699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:57.798830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.297318+0000","last_change":"2024-04-26T10:21:04.890490+0000","last_active":"2024-04-26T10:21:09.297318+0000","last_peered":"2024-04-26T10:21:09.297318+0000","last_clean":"2024-04-26T10:21:09.297318+0000","last_became_active":"2024-04-26T10:21:04.889808+0000","last_became_peered":"2024-04-26T10:21:04.889808+0000","last_unstale":"2024-04-26T10:21:09.297318+0000","last_undegraded":"2024-04-26T10:21:09.297318+0000","last_fullsized":"2024-04-26T10:21:09.297318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:55.711555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302374+0000","last_change":"2024-04-26T10:21:09.312260+0000","last_active":"2024-04-26T10:21:10.302374+0000","last_peered":"2024-04-26T10:21:10.302374+0000","last_clean":"2024-04-26T10:21:10.302374+0000","last_became_active":"2024-04-26T10:21:09.311309+0000","last_became_peered":"2024-04-26T10:21:09.311309+0000","last_unstale":"2024-04-26T10:21:10.302374+0000","last_undegraded":"2024-04-26T10:21:10.302374+0000","last_fullsized":"2024-04-26T10:21:10.302374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:30.714581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.304472+0000","last_change":"2024-04-26T10:21:08.936623+0000","last_active":"2024-04-26T10:21:10.304472+0000","last_peered":"2024-04-26T10:21:10.304472+0000","last_clean":"2024-04-26T10:21:10.304472+0000","last_became_active":"2024-04-26T10:21:08.936252+0000","last_became_peered":"2024-04-26T10:21:08.936252+0000","last_unstale":"2024-04-26T10:21:10.304472+0000","last_undegraded":"2024-04-26T10:21:10.304472+0000","last_fullsized":"2024-04-26T10:21:10.304472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:24.526250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.296848+0000","last_change":"2024-04-26T10:21:04.892401+0000","last_active":"2024-04-26T10:21:09.296848+0000","last_peered":"2024-04-26T10:21:09.296848+0000","last_clean":"2024-04-26T10:21:09.296848+0000","last_became_active":"2024-04-26T10:21:04.891692+0000","last_became_peered":"2024-04-26T10:21:04.891692+0000","last_unstale":"2024-04-26T10:21:09.296848+0000","last_undegraded":"2024-04-26T10:21:09.296848+0000","last_fullsized":"2024-04-26T10:21:09.296848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:37.548728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302178+0000","last_change":"2024-04-26T10:21:09.317981+0000","last_active":"2024-04-26T10:21:10.302178+0000","last_peered":"2024-04-26T10:21:10.302178+0000","last_clean":"2024-04-26T10:21:10.302178+0000","last_became_active":"2024-04-26T10:21:09.317601+0000","last_became_peered":"2024-04-26T10:21:09.317601+0000","last_unstale":"2024-04-26T10:21:10.302178+0000","last_undegraded":"2024-04-26T10:21:10.302178+0000","last_fullsized":"2024-04-26T10:21:10.302178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742909+0000","last_change":"2024-04-26T10:21:09.317120+0000","last_active":"2024-04-26T10:21:10.742909+0000","last_peered":"2024-04-26T10:21:10.742909+0000","last_clean":"2024-04-26T10:21:10.742909+0000","last_became_active":"2024-04-26T10:21:09.316741+0000","last_became_peered":"2024-04-26T10:21:09.316741+0000","last_unstale":"2024-04-26T10:21:10.742909+0000","last_undegraded":"2024-04-26T10:21:10.742909+0000","last_fullsized":"2024-04-26T10:21:10.742909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:43.702714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.326574+0000","last_change":"2024-04-26T10:21:08.934481+0000","last_active":"2024-04-26T10:21:09.326574+0000","last_peered":"2024-04-26T10:21:09.326574+0000","last_clean":"2024-04-26T10:21:09.326574+0000","last_became_active":"2024-04-26T10:21:08.934076+0000","last_became_peered":"2024-04-26T10:21:08.934076+0000","last_unstale":"2024-04-26T10:21:09.326574+0000","last_undegraded":"2024-04-26T10:21:09.326574+0000","last_fullsized":"2024-04-26T10:21:09.326574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:50.622715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302791+0000","last_change":"2024-04-26T10:21:09.314009+0000","last_active":"2024-04-26T10:21:10.302791+0000","last_peered":"2024-04-26T10:21:10.302791+0000","last_clean":"2024-04-26T10:21:10.302791+0000","last_became_active":"2024-04-26T10:21:09.313556+0000","last_became_peered":"2024-04-26T10:21:09.313556+0000","last_unstale":"2024-04-26T10:21:10.302791+0000","last_undegraded":"2024-04-26T10:21:10.302791+0000","last_fullsized":"2024-04-26T10:21:10.302791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:34.862466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320711+0000","last_change":"2024-04-26T10:21:08.936526+0000","last_active":"2024-04-26T10:21:09.320711+0000","last_peered":"2024-04-26T10:21:09.320711+0000","last_clean":"2024-04-26T10:21:09.320711+0000","last_became_active":"2024-04-26T10:21:08.936217+0000","last_became_peered":"2024-04-26T10:21:08.936217+0000","last_unstale":"2024-04-26T10:21:09.320711+0000","last_undegraded":"2024-04-26T10:21:09.320711+0000","last_fullsized":"2024-04-26T10:21:09.320711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:56:57.649639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301807+0000","last_change":"2024-04-26T10:21:08.937597+0000","last_active":"2024-04-26T10:21:09.301807+0000","last_peered":"2024-04-26T10:21:09.301807+0000","last_clean":"2024-04-26T10:21:09.301807+0000","last_became_active":"2024-04-26T10:21:08.936809+0000","last_became_peered":"2024-04-26T10:21:08.936809+0000","last_unstale":"2024-04-26T10:21:09.301807+0000","last_undegraded":"2024-04-26T10:21:09.301807+0000","last_fullsized":"2024-04-26T10:21:09.301807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:17.212235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302338+0000","last_change":"2024-04-26T10:21:09.312054+0000","last_active":"2024-04-26T10:21:10.302338+0000","last_peered":"2024-04-26T10:21:10.302338+0000","last_clean":"2024-04-26T10:21:10.302338+0000","last_became_active":"2024-04-26T10:21:09.310818+0000","last_became_peered":"2024-04-26T10:21:09.310818+0000","last_unstale":"2024-04-26T10:21:10.302338+0000","last_undegraded":"2024-04-26T10:21:10.302338+0000","last_fullsized":"2024-04-26T10:21:10.302338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:03.431355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.301359+0000","last_change":"2024-04-26T10:21:08.937445+0000","last_active":"2024-04-26T10:21:09.301359+0000","last_peered":"2024-04-26T10:21:09.301359+0000","last_clean":"2024-04-26T10:21:09.301359+0000","last_became_active":"2024-04-26T10:21:08.937147+0000","last_became_peered":"2024-04-26T10:21:08.937147+0000","last_unstale":"2024-04-26T10:21:09.301359+0000","last_undegraded":"2024-04-26T10:21:09.301359+0000","last_fullsized":"2024-04-26T10:21:09.301359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:29.602825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302232+0000","last_change":"2024-04-26T10:21:09.318091+0000","last_active":"2024-04-26T10:21:10.302232+0000","last_peered":"2024-04-26T10:21:10.302232+0000","last_clean":"2024-04-26T10:21:10.302232+0000","last_became_active":"2024-04-26T10:21:09.317871+0000","last_became_peered":"2024-04-26T10:21:09.317871+0000","last_unstale":"2024-04-26T10:21:10.302232+0000","last_undegraded":"2024-04-26T10:21:10.302232+0000","last_fullsized":"2024-04-26T10:21:10.302232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:32.442915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303867+0000","last_change":"2024-04-26T10:21:09.312636+0000","last_active":"2024-04-26T10:21:10.303867+0000","last_peered":"2024-04-26T10:21:10.303867+0000","last_clean":"2024-04-26T10:21:10.303867+0000","last_became_active":"2024-04-26T10:21:09.312130+0000","last_became_peered":"2024-04-26T10:21:09.312130+0000","last_unstale":"2024-04-26T10:21:10.303867+0000","last_undegraded":"2024-04-26T10:21:10.303867+0000","last_fullsized":"2024-04-26T10:21:10.303867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:29.565507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.298243+0000","last_change":"2024-04-26T10:21:08.934046+0000","last_active":"2024-04-26T10:21:09.298243+0000","last_peered":"2024-04-26T10:21:09.298243+0000","last_clean":"2024-04-26T10:21:09.298243+0000","last_became_active":"2024-04-26T10:21:08.933341+0000","last_became_peered":"2024-04-26T10:21:08.933341+0000","last_unstale":"2024-04-26T10:21:09.298243+0000","last_undegraded":"2024-04-26T10:21:09.298243+0000","last_fullsized":"2024-04-26T10:21:09.298243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:45.671865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303860+0000","last_change":"2024-04-26T10:21:09.312081+0000","last_active":"2024-04-26T10:21:10.303860+0000","last_peered":"2024-04-26T10:21:10.303860+0000","last_clean":"2024-04-26T10:21:10.303860+0000","last_became_active":"2024-04-26T10:21:09.310879+0000","last_became_peered":"2024-04-26T10:21:09.310879+0000","last_unstale":"2024-04-26T10:21:10.303860+0000","last_undegraded":"2024-04-26T10:21:10.303860+0000","last_fullsized":"2024-04-26T10:21:10.303860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:36.358962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.295619+0000","last_change":"2024-04-26T10:21:08.936748+0000","last_active":"2024-04-26T10:21:09.295619+0000","last_peered":"2024-04-26T10:21:09.295619+0000","last_clean":"2024-04-26T10:21:09.295619+0000","last_became_active":"2024-04-26T10:21:08.936316+0000","last_became_peered":"2024-04-26T10:21:08.936316+0000","last_unstale":"2024-04-26T10:21:09.295619+0000","last_undegraded":"2024-04-26T10:21:09.295619+0000","last_fullsized":"2024-04-26T10:21:09.295619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:47.721288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303753+0000","last_change":"2024-04-26T10:21:09.320062+0000","last_active":"2024-04-26T10:21:10.303753+0000","last_peered":"2024-04-26T10:21:10.303753+0000","last_clean":"2024-04-26T10:21:10.303753+0000","last_became_active":"2024-04-26T10:21:09.319352+0000","last_became_peered":"2024-04-26T10:21:09.319352+0000","last_unstale":"2024-04-26T10:21:10.303753+0000","last_undegraded":"2024-04-26T10:21:10.303753+0000","last_fullsized":"2024-04-26T10:21:10.303753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.998466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316248+0000","last_change":"2024-04-26T10:21:08.931356+0000","last_active":"2024-04-26T10:21:09.316248+0000","last_peered":"2024-04-26T10:21:09.316248+0000","last_clean":"2024-04-26T10:21:09.316248+0000","last_became_active":"2024-04-26T10:21:08.930016+0000","last_became_peered":"2024-04-26T10:21:08.930016+0000","last_unstale":"2024-04-26T10:21:09.316248+0000","last_undegraded":"2024-04-26T10:21:09.316248+0000","last_fullsized":"2024-04-26T10:21:09.316248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:05:21.306576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.303057+0000","last_change":"2024-04-26T10:21:09.318178+0000","last_active":"2024-04-26T10:21:10.303057+0000","last_peered":"2024-04-26T10:21:10.303057+0000","last_clean":"2024-04-26T10:21:10.303057+0000","last_became_active":"2024-04-26T10:21:09.317697+0000","last_became_peered":"2024-04-26T10:21:09.317697+0000","last_unstale":"2024-04-26T10:21:10.303057+0000","last_undegraded":"2024-04-26T10:21:10.303057+0000","last_fullsized":"2024-04-26T10:21:10.303057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:53:46.285390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320054+0000","last_change":"2024-04-26T10:21:08.936115+0000","last_active":"2024-04-26T10:21:09.320054+0000","last_peered":"2024-04-26T10:21:09.320054+0000","last_clean":"2024-04-26T10:21:09.320054+0000","last_became_active":"2024-04-26T10:21:08.935740+0000","last_became_peered":"2024-04-26T10:21:08.935740+0000","last_unstale":"2024-04-26T10:21:09.320054+0000","last_undegraded":"2024-04-26T10:21:09.320054+0000","last_fullsized":"2024-04-26T10:21:09.320054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:40:08.369059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742450+0000","last_change":"2024-04-26T10:21:09.308077+0000","last_active":"2024-04-26T10:21:10.742450+0000","last_peered":"2024-04-26T10:21:10.742450+0000","last_clean":"2024-04-26T10:21:10.742450+0000","last_became_active":"2024-04-26T10:21:09.307543+0000","last_became_peered":"2024-04-26T10:21:09.307543+0000","last_unstale":"2024-04-26T10:21:10.742450+0000","last_undegraded":"2024-04-26T10:21:10.742450+0000","last_fullsized":"2024-04-26T10:21:10.742450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:46.596591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316572+0000","last_change":"2024-04-26T10:21:08.938933+0000","last_active":"2024-04-26T10:21:09.316572+0000","last_peered":"2024-04-26T10:21:09.316572+0000","last_clean":"2024-04-26T10:21:09.316572+0000","last_became_active":"2024-04-26T10:21:08.938281+0000","last_became_peered":"2024-04-26T10:21:08.938281+0000","last_unstale":"2024-04-26T10:21:09.316572+0000","last_undegraded":"2024-04-26T10:21:09.316572+0000","last_fullsized":"2024-04-26T10:21:09.316572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:50.856581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.743973+0000","last_change":"2024-04-26T10:21:09.315331+0000","last_active":"2024-04-26T10:21:10.743973+0000","last_peered":"2024-04-26T10:21:10.743973+0000","last_clean":"2024-04-26T10:21:10.743973+0000","last_became_active":"2024-04-26T10:21:09.314523+0000","last_became_peered":"2024-04-26T10:21:09.314523+0000","last_unstale":"2024-04-26T10:21:10.743973+0000","last_undegraded":"2024-04-26T10:21:10.743973+0000","last_fullsized":"2024-04-26T10:21:10.743973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:24.624358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.320722+0000","last_change":"2024-04-26T10:21:08.936791+0000","last_active":"2024-04-26T10:21:09.320722+0000","last_peered":"2024-04-26T10:21:09.320722+0000","last_clean":"2024-04-26T10:21:09.320722+0000","last_became_active":"2024-04-26T10:21:08.936469+0000","last_became_peered":"2024-04-26T10:21:08.936469+0000","last_unstale":"2024-04-26T10:21:09.320722+0000","last_undegraded":"2024-04-26T10:21:09.320722+0000","last_fullsized":"2024-04-26T10:21:09.320722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:40:14.145721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.302806+0000","last_change":"2024-04-26T10:21:09.315299+0000","last_active":"2024-04-26T10:21:10.302806+0000","last_peered":"2024-04-26T10:21:10.302806+0000","last_clean":"2024-04-26T10:21:10.302806+0000","last_became_active":"2024-04-26T10:21:09.314896+0000","last_became_peered":"2024-04-26T10:21:09.314896+0000","last_unstale":"2024-04-26T10:21:10.302806+0000","last_undegraded":"2024-04-26T10:21:10.302806+0000","last_fullsized":"2024-04-26T10:21:10.302806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:15:00.174824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.316992+0000","last_change":"2024-04-26T10:21:08.933424+0000","last_active":"2024-04-26T10:21:09.316992+0000","last_peered":"2024-04-26T10:21:09.316992+0000","last_clean":"2024-04-26T10:21:09.316992+0000","last_became_active":"2024-04-26T10:21:08.933088+0000","last_became_peered":"2024-04-26T10:21:08.933088+0000","last_unstale":"2024-04-26T10:21:09.316992+0000","last_undegraded":"2024-04-26T10:21:09.316992+0000","last_fullsized":"2024-04-26T10:21:09.316992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:55.394913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-26T10:21:10.742760+0000","last_change":"2024-04-26T10:21:09.308831+0000","last_active":"2024-04-26T10:21:10.742760+0000","last_peered":"2024-04-26T10:21:10.742760+0000","last_clean":"2024-04-26T10:21:10.742760+0000","last_became_active":"2024-04-26T10:21:09.308457+0000","last_became_peered":"2024-04-26T10:21:09.308457+0000","last_unstale":"2024-04-26T10:21:10.742760+0000","last_undegraded":"2024-04-26T10:21:10.742760+0000","last_fullsized":"2024-04-26T10:21:10.742760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:43.137127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-26T10:21:09.314230+0000","last_change":"2024-04-26T10:21:08.937023+0000","last_active":"2024-04-26T10:21:09.314230+0000","last_peered":"2024-04-26T10:21:09.314230+0000","last_clean":"2024-04-26T10:21:09.314230+0000","last_became_active":"2024-04-26T10:21:08.936511+0000","last_became_peered":"2024-04-26T10:21:08.936511+0000","last_unstale":"2024-04-26T10:21:09.314230+0000","last_undegraded":"2024-04-26T10:21:09.314230+0000","last_fullsized":"2024-04-26T10:21:09.314230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:38.881531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672970,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":653928,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":0,"up_from":10,"seq":42949672969,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":270336,"data_stored":654544,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":2,"up_from":9,"seq":38654705675,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":188416,"data_stored":62430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:21:30.177 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T10:21:30.177 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-26T10:21:30.518 INFO:teuthology.orchestra.run.smithi052.stdout:epoch 21 2024-04-26T10:21:30.518 INFO:teuthology.orchestra.run.smithi052.stdout:fsid 485c78cb-ad62-4584-aba6-316dd9c93a12 2024-04-26T10:21:30.518 INFO:teuthology.orchestra.run.smithi052.stdout:created 2024-04-26T10:20:48.363934+0000 2024-04-26T10:21:30.518 INFO:teuthology.orchestra.run.smithi052.stdout:modified 2024-04-26T10:21:10.288209+0000 2024-04-26T10:21:30.518 INFO:teuthology.orchestra.run.smithi052.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-26T10:21:30.518 INFO:teuthology.orchestra.run.smithi052.stdout:crush_version 5 2024-04-26T10:21:30.519 INFO:teuthology.orchestra.run.smithi052.stdout:full_ratio 0.95 2024-04-26T10:21:30.519 INFO:teuthology.orchestra.run.smithi052.stdout:backfillfull_ratio 0.9 2024-04-26T10:21:30.519 INFO:teuthology.orchestra.run.smithi052.stdout:nearfull_ratio 0.85 2024-04-26T10:21:30.519 INFO:teuthology.orchestra.run.smithi052.stdout:require_min_compat_client luminous 2024-04-26T10:21:30.519 INFO:teuthology.orchestra.run.smithi052.stdout:min_compat_client jewel 2024-04-26T10:21:30.519 INFO:teuthology.orchestra.run.smithi052.stdout:require_osd_release reef 2024-04-26T10:21:30.519 INFO:teuthology.orchestra.run.smithi052.stdout:stretch_mode_enabled false 2024-04-26T10:21:30.519 INFO:teuthology.orchestra.run.smithi052.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-26T10:21:30.519 INFO:teuthology.orchestra.run.smithi052.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-26T10:21:30.519 INFO:teuthology.orchestra.run.smithi052.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-26T10:21:30.519 INFO:teuthology.orchestra.run.smithi052.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-26T10:21:30.519 INFO:teuthology.orchestra.run.smithi052.stdout:max_osd 3 2024-04-26T10:21:30.519 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0 up in weight 1 up_from 10 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6800/18193,v1:172.21.15.120:6801/18193] [v2:172.21.15.120:6802/18193,v1:172.21.15.120:6803/18193] exists,up c5e76c47-dfc4-40ca-88d3-2084cac6e35c 2024-04-26T10:21:30.520 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1 up in weight 1 up_from 10 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/18226,v1:172.21.15.154:6801/18226] [v2:172.21.15.154:6802/18226,v1:172.21.15.154:6803/18226] exists,up 2a8d530c-cf33-4540-9240-6bd7485e06ee 2024-04-26T10:21:30.520 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2 up in weight 1 up_from 9 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.164:6800/18269,v1:172.21.15.164:6801/18269] [v2:172.21.15.164:6802/18269,v1:172.21.15.164:6803/18269] exists,up 484ab70f-4cad-4ff6-9405-8865ec5ee327 2024-04-26T10:21:30.532 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 10 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.120:6800/18193,v1:172.21.15.120:6801/18193] [v2:172.21.15.120:6802/18193,v1:172.21.15.120:6803/18193] exists,up c5e76c47-dfc4-40ca-88d3-2084cac6e35c', 'osd.1 up in weight 1 up_from 10 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.154:6800/18226,v1:172.21.15.154:6801/18226] [v2:172.21.15.154:6802/18226,v1:172.21.15.154:6803/18226] exists,up 2a8d530c-cf33-4540-9240-6bd7485e06ee', 'osd.2 up in weight 1 up_from 9 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.164:6800/18269,v1:172.21.15.164:6801/18269] [v2:172.21.15.164:6802/18269,v1:172.21.15.164:6803/18269] exists,up 484ab70f-4cad-4ff6-9405-8865ec5ee327'] 2024-04-26T10:21:30.532 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-26T10:21:30.631 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-26T10:21:30.631 INFO:teuthology.orchestra.run.smithi052.stdout: "name": "mon.a", 2024-04-26T10:21:30.631 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster": "ceph", 2024-04-26T10:21:30.631 INFO:teuthology.orchestra.run.smithi052.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-26T10:21:30.631 INFO:teuthology.orchestra.run.smithi052.stdout: "admin_socket_mode": "", 2024-04-26T10:21:30.631 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-26T10:21:30.631 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_client_required": "cephx, none", 2024-04-26T10:21:30.631 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_cluster_required": "cephx", 2024-04-26T10:21:30.631 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_debug": "true", 2024-04-26T10:21:30.631 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-26T10:21:30.631 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-26T10:21:30.632 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_service_required": "cephx", 2024-04-26T10:21:30.632 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-26T10:21:30.632 INFO:teuthology.orchestra.run.smithi052.stdout: "auth_supported": "cephx", 2024-04-26T10:21:30.632 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_aio": "true", 2024-04-26T10:21:30.632 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-26T10:21:30.632 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_aio_poll_ms": "250", 2024-04-26T10:21:30.632 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_aio_reap_max": "16", 2024-04-26T10:21:30.632 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_async_discard": "false", 2024-04-26T10:21:30.632 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_block_size": "4096", 2024-04-26T10:21:30.632 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_debug_aio": "false", 2024-04-26T10:21:30.632 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-26T10:21:30.632 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-26T10:21:30.632 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_debug_inflight_ios": "false", 2024-04-26T10:21:30.633 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_enable_discard": "false", 2024-04-26T10:21:30.633 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_flock_retry": "3", 2024-04-26T10:21:30.633 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-26T10:21:30.633 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_inject_crash": "0", 2024-04-26T10:21:30.633 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-26T10:21:30.633 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_ioring": "false", 2024-04-26T10:21:30.633 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_ioring_hipri": "false", 2024-04-26T10:21:30.633 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-26T10:21:30.633 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-26T10:21:30.633 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-26T10:21:30.633 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-26T10:21:30.633 INFO:teuthology.orchestra.run.smithi052.stdout: "bdev_type": "", 2024-04-26T10:21:30.633 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_alloc_size": "1048576", 2024-04-26T10:21:30.634 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_allocator": "hybrid", 2024-04-26T10:21:30.634 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_buffered_io": "true", 2024-04-26T10:21:30.634 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_check_for_zeros": "false", 2024-04-26T10:21:30.634 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-26T10:21:30.634 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-26T10:21:30.634 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_compact_log_sync": "false", 2024-04-26T10:21:30.634 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-26T10:21:30.634 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-26T10:21:30.634 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-26T10:21:30.634 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-26T10:21:30.634 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_max_log_runway": "4194304", 2024-04-26T10:21:30.634 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_max_prefetch": "1048576", 2024-04-26T10:21:30.635 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_min_flush_size": "524288", 2024-04-26T10:21:30.635 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_min_log_runway": "1048576", 2024-04-26T10:21:30.635 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_replay_recovery": "false", 2024-04-26T10:21:30.635 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-26T10:21:30.635 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-26T10:21:30.635 INFO:teuthology.orchestra.run.smithi052.stdout: "bluefs_sync_write": "false", 2024-04-26T10:21:30.635 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-26T10:21:30.635 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-26T10:21:30.635 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-26T10:21:30.635 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_allocation_from_file": "true", 2024-04-26T10:21:30.635 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_allocator": "hybrid", 2024-04-26T10:21:30.635 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-26T10:21:30.635 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-26T10:21:30.635 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-26T10:21:30.636 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-26T10:21:30.636 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-26T10:21:30.636 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-26T10:21:30.636 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-26T10:21:30.636 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_create": "true", 2024-04-26T10:21:30.636 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_db_create": "false", 2024-04-26T10:21:30.636 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_db_path": "", 2024-04-26T10:21:30.636 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_db_size": "0", 2024-04-26T10:21:30.636 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_path": "", 2024-04-26T10:21:30.636 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_preallocate_file": "false", 2024-04-26T10:21:30.636 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_size": "107374182400", 2024-04-26T10:21:30.636 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_wal_create": "false", 2024-04-26T10:21:30.636 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_wal_path": "", 2024-04-26T10:21:30.637 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_block_wal_size": "100663296", 2024-04-26T10:21:30.637 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bluefs": "true", 2024-04-26T10:21:30.637 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-26T10:21:30.637 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-26T10:21:30.637 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-26T10:21:30.637 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-26T10:21:30.637 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T10:21:30.637 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T10:21:30.637 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-26T10:21:30.637 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-26T10:21:30.637 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_autotune": "true", 2024-04-26T10:21:30.637 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-26T10:21:30.637 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-26T10:21:30.637 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-26T10:21:30.638 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-26T10:21:30.638 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_size": "0", 2024-04-26T10:21:30.638 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-26T10:21:30.638 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-26T10:21:30.638 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-26T10:21:30.638 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-26T10:21:30.638 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cache_type": "2q", 2024-04-26T10:21:30.638 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-26T10:21:30.639 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_clone_cow": "true", 2024-04-26T10:21:30.639 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-26T10:21:30.639 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-26T10:21:30.639 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-26T10:21:30.639 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-26T10:21:30.639 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-26T10:21:30.640 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-26T10:21:30.640 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-26T10:21:30.640 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_mode": "none", 2024-04-26T10:21:30.640 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-26T10:21:30.640 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_csum_type": "crc32c", 2024-04-26T10:21:30.640 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-26T10:21:30.640 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_freelist": "false", 2024-04-26T10:21:30.640 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-26T10:21:30.640 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-26T10:21:30.641 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_inject_bug21040": "false", 2024-04-26T10:21:30.641 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-26T10:21:30.642 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-26T10:21:30.642 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-26T10:21:30.642 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-26T10:21:30.643 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-26T10:21:30.643 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-26T10:21:30.643 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-26T10:21:30.643 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-26T10:21:30.643 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-26T10:21:30.643 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-26T10:21:30.643 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-26T10:21:30.643 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_small_allocations": "0", 2024-04-26T10:21:30.643 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-26T10:21:30.643 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_default_buffered_read": "true", 2024-04-26T10:21:30.643 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_default_buffered_write": "false", 2024-04-26T10:21:30.643 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-26T10:21:30.643 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-26T10:21:30.643 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-26T10:21:30.644 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-26T10:21:30.644 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-26T10:21:30.644 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-26T10:21:30.644 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-26T10:21:30.644 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-26T10:21:30.644 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fail_eio": "false", 2024-04-26T10:21:30.644 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-26T10:21:30.644 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-26T10:21:30.644 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-26T10:21:30.644 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-26T10:21:30.644 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-26T10:21:30.644 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-26T10:21:30.644 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_mount": "false", 2024-04-26T10:21:30.644 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-26T10:21:30.645 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_umount": "false", 2024-04-26T10:21:30.645 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-26T10:21:30.645 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-26T10:21:30.645 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-26T10:21:30.645 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-26T10:21:30.645 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-26T10:21:30.645 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-26T10:21:30.645 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-26T10:21:30.645 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-26T10:21:30.645 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_ignore_data_csum": "false", 2024-04-26T10:21:30.645 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-26T10:21:30.645 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-26T10:21:30.645 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-26T10:21:30.645 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-26T10:21:30.646 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_log_op_age": "5.000000", 2024-04-26T10:21:30.646 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_alloc_size": "0", 2024-04-26T10:21:30.646 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_blob_size": "0", 2024-04-26T10:21:30.646 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-26T10:21:30.646 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-26T10:21:30.646 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-26T10:21:30.646 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_max_deferred_txc": "32", 2024-04-26T10:21:30.646 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_min_alloc_size": "0", 2024-04-26T10:21:30.646 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-26T10:21:30.646 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-26T10:21:30.646 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_nid_prealloc": "1024", 2024-04-26T10:21:30.646 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-26T10:21:30.646 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-26T10:21:30.647 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-26T10:21:30.647 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-26T10:21:30.647 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_retry_disk_reads": "3", 2024-04-26T10:21:30.647 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_rocksdb_cf": "true", 2024-04-26T10:21:30.647 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-26T10:21:30.647 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-26T10:21:30.647 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-26T10:21:30.647 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-26T10:21:30.647 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-26T10:21:30.647 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-26T10:21:30.647 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_spdk_mem": "512", 2024-04-26T10:21:30.647 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-26T10:21:30.648 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-26T10:21:30.648 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-26T10:21:30.648 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-26T10:21:30.648 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-26T10:21:30.648 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-26T10:21:30.648 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-26T10:21:30.648 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_tracing": "false", 2024-04-26T10:21:30.648 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-26T10:21:30.648 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-26T10:21:30.648 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-26T10:21:30.649 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-26T10:21:30.649 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-26T10:21:30.649 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-26T10:21:30.649 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-26T10:21:30.649 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-26T10:21:30.649 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-26T10:21:30.649 INFO:teuthology.orchestra.run.smithi052.stdout: "bluestore_zero_block_detection": "false", 2024-04-26T10:21:30.650 INFO:teuthology.orchestra.run.smithi052.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-26T10:21:30.650 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-26T10:21:30.650 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-26T10:21:30.650 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-26T10:21:30.650 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-26T10:21:30.650 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-26T10:21:30.650 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-26T10:21:30.650 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-26T10:21:30.650 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-26T10:21:30.650 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-26T10:21:30.650 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-26T10:21:30.651 INFO:teuthology.orchestra.run.smithi052.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-26T10:21:30.651 INFO:teuthology.orchestra.run.smithi052.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-26T10:21:30.651 INFO:teuthology.orchestra.run.smithi052.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-26T10:21:30.651 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_cluster_require_signatures": "false", 2024-04-26T10:21:30.651 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_cluster_require_version": "2", 2024-04-26T10:21:30.651 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_require_signatures": "false", 2024-04-26T10:21:30.651 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_require_version": "2", 2024-04-26T10:21:30.651 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_service_require_signatures": "false", 2024-04-26T10:21:30.651 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_service_require_version": "2", 2024-04-26T10:21:30.651 INFO:teuthology.orchestra.run.smithi052.stdout: "cephx_sign_messages": "true", 2024-04-26T10:21:30.651 INFO:teuthology.orchestra.run.smithi052.stdout: "chdir": "", 2024-04-26T10:21:30.651 INFO:teuthology.orchestra.run.smithi052.stdout: "client_acl_type": "", 2024-04-26T10:21:30.651 INFO:teuthology.orchestra.run.smithi052.stdout: "client_asio_thread_count": "2", 2024-04-26T10:21:30.651 INFO:teuthology.orchestra.run.smithi052.stdout: "client_cache_mid": "0.750000", 2024-04-26T10:21:30.651 INFO:teuthology.orchestra.run.smithi052.stdout: "client_cache_size": "16384", 2024-04-26T10:21:30.652 INFO:teuthology.orchestra.run.smithi052.stdout: "client_caps_release_delay": "5", 2024-04-26T10:21:30.652 INFO:teuthology.orchestra.run.smithi052.stdout: "client_check_pool_perm": "true", 2024-04-26T10:21:30.652 INFO:teuthology.orchestra.run.smithi052.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-26T10:21:30.652 INFO:teuthology.orchestra.run.smithi052.stdout: "client_debug_force_sync_read": "false", 2024-04-26T10:21:30.652 INFO:teuthology.orchestra.run.smithi052.stdout: "client_debug_getattr_caps": "false", 2024-04-26T10:21:30.652 INFO:teuthology.orchestra.run.smithi052.stdout: "client_debug_inject_tick_delay": "0", 2024-04-26T10:21:30.652 INFO:teuthology.orchestra.run.smithi052.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-26T10:21:30.652 INFO:teuthology.orchestra.run.smithi052.stdout: "client_die_on_failed_remount": "false", 2024-04-26T10:21:30.652 INFO:teuthology.orchestra.run.smithi052.stdout: "client_dirsize_rbytes": "true", 2024-04-26T10:21:30.652 INFO:teuthology.orchestra.run.smithi052.stdout: "client_force_lazyio": "false", 2024-04-26T10:21:30.652 INFO:teuthology.orchestra.run.smithi052.stdout: "client_fs": "", 2024-04-26T10:21:30.652 INFO:teuthology.orchestra.run.smithi052.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-26T10:21:30.652 INFO:teuthology.orchestra.run.smithi052.stdout: "client_inject_release_failure": "false", 2024-04-26T10:21:30.652 INFO:teuthology.orchestra.run.smithi052.stdout: "client_max_inline_size": "4096", 2024-04-26T10:21:30.653 INFO:teuthology.orchestra.run.smithi052.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-26T10:21:30.653 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mds_namespace": "", 2024-04-26T10:21:30.653 INFO:teuthology.orchestra.run.smithi052.stdout: "client_metadata": "", 2024-04-26T10:21:30.653 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mount_gid": "-1", 2024-04-26T10:21:30.653 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mount_timeout": "300", 2024-04-26T10:21:30.653 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mount_uid": "-1", 2024-04-26T10:21:30.653 INFO:teuthology.orchestra.run.smithi052.stdout: "client_mountpoint": "/", 2024-04-26T10:21:30.653 INFO:teuthology.orchestra.run.smithi052.stdout: "client_notify_timeout": "10", 2024-04-26T10:21:30.653 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc": "true", 2024-04-26T10:21:30.653 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_max_dirty": "104857600", 2024-04-26T10:21:30.653 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-26T10:21:30.653 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_max_objects": "1000", 2024-04-26T10:21:30.653 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_size": "209715200", 2024-04-26T10:21:30.653 INFO:teuthology.orchestra.run.smithi052.stdout: "client_oc_target_dirty": "8388608", 2024-04-26T10:21:30.654 INFO:teuthology.orchestra.run.smithi052.stdout: "client_permissions": "true", 2024-04-26T10:21:30.654 INFO:teuthology.orchestra.run.smithi052.stdout: "client_quota": "true", 2024-04-26T10:21:30.654 INFO:teuthology.orchestra.run.smithi052.stdout: "client_quota_df": "true", 2024-04-26T10:21:30.654 INFO:teuthology.orchestra.run.smithi052.stdout: "client_readahead_max_bytes": "0", 2024-04-26T10:21:30.654 INFO:teuthology.orchestra.run.smithi052.stdout: "client_readahead_max_periods": "4", 2024-04-26T10:21:30.654 INFO:teuthology.orchestra.run.smithi052.stdout: "client_readahead_min": "131072", 2024-04-26T10:21:30.654 INFO:teuthology.orchestra.run.smithi052.stdout: "client_reconnect_stale": "false", 2024-04-26T10:21:30.654 INFO:teuthology.orchestra.run.smithi052.stdout: "client_shutdown_timeout": "30", 2024-04-26T10:21:30.654 INFO:teuthology.orchestra.run.smithi052.stdout: "client_snapdir": ".snap", 2024-04-26T10:21:30.654 INFO:teuthology.orchestra.run.smithi052.stdout: "client_tick_interval": "1", 2024-04-26T10:21:30.654 INFO:teuthology.orchestra.run.smithi052.stdout: "client_trace": "", 2024-04-26T10:21:30.654 INFO:teuthology.orchestra.run.smithi052.stdout: "client_try_dentry_invalidate": "false", 2024-04-26T10:21:30.654 INFO:teuthology.orchestra.run.smithi052.stdout: "client_use_faked_inos": "false", 2024-04-26T10:21:30.655 INFO:teuthology.orchestra.run.smithi052.stdout: "client_use_random_mds": "false", 2024-04-26T10:21:30.655 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_graylog": "false", 2024-04-26T10:21:30.655 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-26T10:21:30.655 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_graylog_port": "12201", 2024-04-26T10:21:30.655 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_monitors": "default=true", 2024-04-26T10:21:30.655 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_syslog": "false", 2024-04-26T10:21:30.655 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-26T10:21:30.655 INFO:teuthology.orchestra.run.smithi052.stdout: "clog_to_syslog_level": "info", 2024-04-26T10:21:30.655 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "-", 2024-04-26T10:21:30.655 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_network": "", 2024-04-26T10:21:30.656 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_network_interface": "", 2024-04-26T10:21:30.656 INFO:teuthology.orchestra.run.smithi052.stdout: "compressor_zlib_isal": "false", 2024-04-26T10:21:30.656 INFO:teuthology.orchestra.run.smithi052.stdout: "compressor_zlib_level": "5", 2024-04-26T10:21:30.656 INFO:teuthology.orchestra.run.smithi052.stdout: "compressor_zlib_winsize": "-15", 2024-04-26T10:21:30.656 INFO:teuthology.orchestra.run.smithi052.stdout: "compressor_zstd_level": "1", 2024-04-26T10:21:30.656 INFO:teuthology.orchestra.run.smithi052.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-26T10:21:30.656 INFO:teuthology.orchestra.run.smithi052.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-26T10:21:30.656 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_alien_op_num_threads": "6", 2024-04-26T10:21:30.656 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-26T10:21:30.656 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_osd_obc_lru_size": "10", 2024-04-26T10:21:30.657 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-26T10:21:30.657 INFO:teuthology.orchestra.run.smithi052.stdout: "crimson_seastar_smp": "1", 2024-04-26T10:21:30.657 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_location": "", 2024-04-26T10:21:30.657 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_location_hook": "", 2024-04-26T10:21:30.657 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_location_hook_timeout": "10", 2024-04-26T10:21:30.657 INFO:teuthology.orchestra.run.smithi052.stdout: "daemonize": "false", 2024-04-26T10:21:30.657 INFO:teuthology.orchestra.run.smithi052.stdout: "daos_pool": "tank", 2024-04-26T10:21:30.657 INFO:teuthology.orchestra.run.smithi052.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-26T10:21:30.657 INFO:teuthology.orchestra.run.smithi052.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-26T10:21:30.657 INFO:teuthology.orchestra.run.smithi052.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-26T10:21:30.657 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_alienstore": "0/5", 2024-04-26T10:21:30.657 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_allow_any_pool_priority": "false", 2024-04-26T10:21:30.658 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_asok": "1/5", 2024-04-26T10:21:30.658 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_asok_assert_abort": "false", 2024-04-26T10:21:30.658 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_asserts_on_shutdown": "true", 2024-04-26T10:21:30.658 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_auth": "20/20", 2024-04-26T10:21:30.658 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_bdev": "1/3", 2024-04-26T10:21:30.658 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_bluefs": "1/5", 2024-04-26T10:21:30.658 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_bluestore": "1/5", 2024-04-26T10:21:30.658 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_buffer": "0/1", 2024-04-26T10:21:30.658 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_ceph_exporter": "1/5", 2024-04-26T10:21:30.658 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_cephfs_mirror": "0/5", 2024-04-26T10:21:30.658 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_cephsqlite": "0/5", 2024-04-26T10:21:30.658 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_client": "0/5", 2024-04-26T10:21:30.658 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_compressor": "1/5", 2024-04-26T10:21:30.658 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_context": "0/1", 2024-04-26T10:21:30.659 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_crush": "1/1", 2024-04-26T10:21:30.659 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_crypto": "1/5", 2024-04-26T10:21:30.659 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_cyanstore": "0/5", 2024-04-26T10:21:30.659 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_deliberately_leak_memory": "false", 2024-04-26T10:21:30.659 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_disable_randomized_ping": "false", 2024-04-26T10:21:30.659 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_dpdk": "1/5", 2024-04-26T10:21:30.659 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_eventtrace": "1/5", 2024-04-26T10:21:30.659 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_filer": "0/1", 2024-04-26T10:21:30.659 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_filestore": "1/3", 2024-04-26T10:21:30.659 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_finisher": "1/1", 2024-04-26T10:21:30.660 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_fuse": "1/5", 2024-04-26T10:21:30.660 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_heartbeat_testing_span": "0", 2024-04-26T10:21:30.660 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_heartbeatmap": "1/5", 2024-04-26T10:21:30.660 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-26T10:21:30.660 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_javaclient": "1/5", 2024-04-26T10:21:30.660 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_journal": "1/3", 2024-04-26T10:21:30.660 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_journaler": "0/5", 2024-04-26T10:21:30.660 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_kstore": "1/5", 2024-04-26T10:21:30.660 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_leveldb": "4/5", 2024-04-26T10:21:30.660 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_lockdep": "0/1", 2024-04-26T10:21:30.660 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mclock": "1/5", 2024-04-26T10:21:30.660 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds": "1/5", 2024-04-26T10:21:30.661 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_balancer": "1/5", 2024-04-26T10:21:30.661 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_locker": "1/5", 2024-04-26T10:21:30.661 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_log": "1/5", 2024-04-26T10:21:30.661 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_log_expire": "1/5", 2024-04-26T10:21:30.661 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mds_migrator": "1/5", 2024-04-26T10:21:30.661 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_memstore": "1/5", 2024-04-26T10:21:30.661 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mgr": "2/5", 2024-04-26T10:21:30.661 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mgrc": "1/5", 2024-04-26T10:21:30.661 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_mon": "20/20", 2024-04-26T10:21:30.661 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_monc": "0/10", 2024-04-26T10:21:30.661 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_ms": "1/1", 2024-04-26T10:21:30.661 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_none": "0/5", 2024-04-26T10:21:30.661 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_objclass": "0/5", 2024-04-26T10:21:30.661 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_objectcacher": "0/5", 2024-04-26T10:21:30.662 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_objecter": "0/1", 2024-04-26T10:21:30.662 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_optracker": "0/5", 2024-04-26T10:21:30.662 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_osd": "1/5", 2024-04-26T10:21:30.662 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_paxos": "20/20", 2024-04-26T10:21:30.662 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_perfcounter": "1/5", 2024-04-26T10:21:30.662 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_prioritycache": "1/5", 2024-04-26T10:21:30.662 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rados": "0/5", 2024-04-26T10:21:30.662 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rbd": "0/5", 2024-04-26T10:21:30.662 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rbd_mirror": "0/5", 2024-04-26T10:21:30.662 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rbd_pwl": "0/5", 2024-04-26T10:21:30.662 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rbd_replay": "0/5", 2024-04-26T10:21:30.662 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_refs": "0/0", 2024-04-26T10:21:30.662 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_reserver": "1/1", 2024-04-26T10:21:30.663 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw": "1/5", 2024-04-26T10:21:30.663 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_access": "1/5", 2024-04-26T10:21:30.663 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_datacache": "1/5", 2024-04-26T10:21:30.663 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_dbstore": "1/5", 2024-04-26T10:21:30.663 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_flight": "1/5", 2024-04-26T10:21:30.663 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rgw_sync": "1/5", 2024-04-26T10:21:30.663 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_rocksdb": "4/5", 2024-04-26T10:21:30.663 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore": "0/5", 2024-04-26T10:21:30.663 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_backref": "0/5", 2024-04-26T10:21:30.663 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_cache": "0/5", 2024-04-26T10:21:30.663 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_cleaner": "0/5", 2024-04-26T10:21:30.663 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_device": "0/5", 2024-04-26T10:21:30.663 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_epm": "0/5", 2024-04-26T10:21:30.663 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-26T10:21:30.664 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_journal": "0/5", 2024-04-26T10:21:30.664 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_lba": "0/5", 2024-04-26T10:21:30.664 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_odata": "0/5", 2024-04-26T10:21:30.664 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_omap": "0/5", 2024-04-26T10:21:30.664 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_onode": "0/5", 2024-04-26T10:21:30.664 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_t": "0/5", 2024-04-26T10:21:30.664 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_seastore_tm": "0/5", 2024-04-26T10:21:30.664 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_striper": "0/1", 2024-04-26T10:21:30.664 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_test": "0/5", 2024-04-26T10:21:30.664 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_throttle": "1/1", 2024-04-26T10:21:30.664 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_timer": "0/1", 2024-04-26T10:21:30.664 INFO:teuthology.orchestra.run.smithi052.stdout: "debug_tp": "0/5", 2024-04-26T10:21:30.664 INFO:teuthology.orchestra.run.smithi052.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-26T10:21:30.664 INFO:teuthology.orchestra.run.smithi052.stdout: "device_failure_prediction_mode": "none", 2024-04-26T10:21:30.665 INFO:teuthology.orchestra.run.smithi052.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-26T10:21:30.665 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-26T10:21:30.665 INFO:teuthology.orchestra.run.smithi052.stdout: "err_to_graylog": "false", 2024-04-26T10:21:30.665 INFO:teuthology.orchestra.run.smithi052.stdout: "err_to_journald": "false", 2024-04-26T10:21:30.665 INFO:teuthology.orchestra.run.smithi052.stdout: "err_to_stderr": "true", 2024-04-26T10:21:30.665 INFO:teuthology.orchestra.run.smithi052.stdout: "err_to_syslog": "false", 2024-04-26T10:21:30.665 INFO:teuthology.orchestra.run.smithi052.stdout: "event_tracing": "false", 2024-04-26T10:21:30.665 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_addr": "0.0.0.0", 2024-04-26T10:21:30.665 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_http_port": "9926", 2024-04-26T10:21:30.665 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_prio_limit": "5", 2024-04-26T10:21:30.666 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-26T10:21:30.666 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_sort_metrics": "true", 2024-04-26T10:21:30.666 INFO:teuthology.orchestra.run.smithi052.stdout: "exporter_stats_period": "5", 2024-04-26T10:21:30.666 INFO:teuthology.orchestra.run.smithi052.stdout: "fake_statfs_for_testing": "0", 2024-04-26T10:21:30.666 INFO:teuthology.orchestra.run.smithi052.stdout: "fatal_signal_handlers": "true", 2024-04-26T10:21:30.666 INFO:teuthology.orchestra.run.smithi052.stdout: "filer_max_purge_ops": "10", 2024-04-26T10:21:30.666 INFO:teuthology.orchestra.run.smithi052.stdout: "filer_max_truncate_ops": "128", 2024-04-26T10:21:30.666 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_apply_finisher_threads": "1", 2024-04-26T10:21:30.666 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_blackhole": "false", 2024-04-26T10:21:30.666 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_btrfs_clone_range": "true", 2024-04-26T10:21:30.666 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_btrfs_snap": "true", 2024-04-26T10:21:30.666 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_caller_concurrency": "10", 2024-04-26T10:21:30.667 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_collect_device_partition_information": "true", 2024-04-26T10:21:30.667 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_commit_timeout": "600.000000", 2024-04-26T10:21:30.667 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_debug_inject_read_err": "false", 2024-04-26T10:21:30.667 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_debug_omap_check": "false", 2024-04-26T10:21:30.667 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-26T10:21:30.667 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_debug_verify_split": "false", 2024-04-26T10:21:30.667 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_dump_file": "", 2024-04-26T10:21:30.667 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-26T10:21:30.667 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-26T10:21:30.667 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fadvise": "true", 2024-04-26T10:21:30.667 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fail_eio": "true", 2024-04-26T10:21:30.667 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fd_cache_shards": "16", 2024-04-26T10:21:30.667 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fd_cache_size": "128", 2024-04-26T10:21:30.667 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fiemap": "false", 2024-04-26T10:21:30.668 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fiemap_threshold": "4096", 2024-04-26T10:21:30.668 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-26T10:21:30.668 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-26T10:21:30.668 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_inject_stall": "0", 2024-04-26T10:21:30.668 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_journal_parallel": "false", 2024-04-26T10:21:30.668 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_journal_trailing": "false", 2024-04-26T10:21:30.668 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_journal_writeahead": "false", 2024-04-26T10:21:30.668 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_kill_at": "0", 2024-04-26T10:21:30.668 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-26T10:21:30.668 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-26T10:21:30.668 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-26T10:21:30.668 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-26T10:21:30.668 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-26T10:21:30.668 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattrs": "0", 2024-04-26T10:21:30.669 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-26T10:21:30.669 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-26T10:21:30.669 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-26T10:21:30.669 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-26T10:21:30.669 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_xattr_value_size": "0", 2024-04-26T10:21:30.669 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-26T10:21:30.669 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-26T10:21:30.669 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-26T10:21:30.669 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_merge_threshold": "-10", 2024-04-26T10:21:30.669 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-26T10:21:30.669 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_odsync_write": "false", 2024-04-26T10:21:30.669 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_omap_backend": "rocksdb", 2024-04-26T10:21:30.669 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_omap_backend_path": "", 2024-04-26T10:21:30.669 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-26T10:21:30.670 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-26T10:21:30.670 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-26T10:21:30.670 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_op_thread_timeout": "60", 2024-04-26T10:21:30.670 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_op_threads": "2", 2024-04-26T10:21:30.670 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_punch_hole": "false", 2024-04-26T10:21:30.670 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-26T10:21:30.670 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-26T10:21:30.670 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-26T10:21:30.671 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-26T10:21:30.671 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-26T10:21:30.671 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-26T10:21:30.671 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-26T10:21:30.671 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-26T10:21:30.671 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-26T10:21:30.671 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_queue_max_ops": "50", 2024-04-26T10:21:30.671 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-26T10:21:30.671 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_seek_data_hole": "false", 2024-04-26T10:21:30.671 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_sloppy_crc": "false", 2024-04-26T10:21:30.671 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-26T10:21:30.671 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_splice": "false", 2024-04-26T10:21:30.671 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_split_multiple": "2", 2024-04-26T10:21:30.672 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_split_rand_factor": "20", 2024-04-26T10:21:30.672 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_update_to": "1000", 2024-04-26T10:21:30.672 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-26T10:21:30.672 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-26T10:21:30.672 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-26T10:21:30.672 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-26T10:21:30.672 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-26T10:21:30.672 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-26T10:21:30.672 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_enable": "true", 2024-04-26T10:21:30.672 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-26T10:21:30.672 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-26T10:21:30.672 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-26T10:21:30.672 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-26T10:21:30.673 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-26T10:21:30.673 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-26T10:21:30.673 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_xfs_extsize": "false", 2024-04-26T10:21:30.673 INFO:teuthology.orchestra.run.smithi052.stdout: "filestore_zfs_snap": "false", 2024-04-26T10:21:30.673 INFO:teuthology.orchestra.run.smithi052.stdout: "fio_dir": "/tmp/fio", 2024-04-26T10:21:30.673 INFO:teuthology.orchestra.run.smithi052.stdout: "fsid": "485c78cb-ad62-4584-aba6-316dd9c93a12", 2024-04-26T10:21:30.673 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_allow_other": "true", 2024-04-26T10:21:30.673 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_atomic_o_trunc": "true", 2024-04-26T10:21:30.673 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_big_writes": "true", 2024-04-26T10:21:30.673 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_debug": "false", 2024-04-26T10:21:30.673 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_default_permissions": "false", 2024-04-26T10:21:30.673 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_disable_pagecache": "false", 2024-04-26T10:21:30.674 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_max_write": "0", 2024-04-26T10:21:30.674 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_multithreaded": "true", 2024-04-26T10:21:30.674 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_require_active_mds": "true", 2024-04-26T10:21:30.674 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_set_user_groups": "true", 2024-04-26T10:21:30.674 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_splice_move": "true", 2024-04-26T10:21:30.674 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_splice_read": "true", 2024-04-26T10:21:30.674 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_splice_write": "true", 2024-04-26T10:21:30.674 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-26T10:21:30.674 INFO:teuthology.orchestra.run.smithi052.stdout: "fuse_use_invalidate_cb": "true", 2024-04-26T10:21:30.674 INFO:teuthology.orchestra.run.smithi052.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-26T10:21:30.674 INFO:teuthology.orchestra.run.smithi052.stdout: "gss_target_name": "ceph", 2024-04-26T10:21:30.674 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_file": "", 2024-04-26T10:21:30.674 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_inject_failure": "0", 2024-04-26T10:21:30.675 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_interval": "5", 2024-04-26T10:21:30.675 INFO:teuthology.orchestra.run.smithi052.stdout: "host": "smithi052", 2024-04-26T10:21:30.675 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-26T10:21:30.675 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-26T10:21:30.675 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-26T10:21:30.675 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-26T10:21:30.675 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-26T10:21:30.675 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-26T10:21:30.675 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-26T10:21:30.675 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-26T10:21:30.675 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-26T10:21:30.675 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-26T10:21:30.675 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-26T10:21:30.675 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-26T10:21:30.676 INFO:teuthology.orchestra.run.smithi052.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-26T10:21:30.676 INFO:teuthology.orchestra.run.smithi052.stdout: "inject_early_sigterm": "false", 2024-04-26T10:21:30.676 INFO:teuthology.orchestra.run.smithi052.stdout: "jaeger_agent_port": "6799", 2024-04-26T10:21:30.676 INFO:teuthology.orchestra.run.smithi052.stdout: "jaeger_tracing_enable": "false", 2024-04-26T10:21:30.676 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_aio": "true", 2024-04-26T10:21:30.676 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_align_min_size": "65536", 2024-04-26T10:21:30.676 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_block_align": "true", 2024-04-26T10:21:30.676 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_block_size": "4096", 2024-04-26T10:21:30.677 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_dio": "true", 2024-04-26T10:21:30.677 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_discard": "false", 2024-04-26T10:21:30.677 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_force_aio": "false", 2024-04-26T10:21:30.677 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_ignore_corruption": "false", 2024-04-26T10:21:30.677 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_max_write_bytes": "10485760", 2024-04-26T10:21:30.677 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_max_write_entries": "100", 2024-04-26T10:21:30.677 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_replay_from": "0", 2024-04-26T10:21:30.677 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-26T10:21:30.677 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-26T10:21:30.677 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-26T10:21:30.677 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-26T10:21:30.677 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_write_header_frequency": "0", 2024-04-26T10:21:30.678 INFO:teuthology.orchestra.run.smithi052.stdout: "journal_zero_on_create": "false", 2024-04-26T10:21:30.678 INFO:teuthology.orchestra.run.smithi052.stdout: "journaler_prefetch_periods": "10", 2024-04-26T10:21:30.678 INFO:teuthology.orchestra.run.smithi052.stdout: "journaler_prezero_periods": "5", 2024-04-26T10:21:30.678 INFO:teuthology.orchestra.run.smithi052.stdout: "journaler_write_head_interval": "15", 2024-04-26T10:21:30.678 INFO:teuthology.orchestra.run.smithi052.stdout: "key": "", 2024-04-26T10:21:30.678 INFO:teuthology.orchestra.run.smithi052.stdout: "keyfile": "", 2024-04-26T10:21:30.678 INFO:teuthology.orchestra.run.smithi052.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-26T10:21:30.678 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_backend": "rocksdb", 2024-04-26T10:21:30.678 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_default_stripe_size": "65536", 2024-04-26T10:21:30.678 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_fsck_on_mount": "false", 2024-04-26T10:21:30.678 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-26T10:21:30.678 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_max_bytes": "67108864", 2024-04-26T10:21:30.678 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_max_ops": "512", 2024-04-26T10:21:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_nid_prealloc": "1024", 2024-04-26T10:21:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_onode_map_size": "1024", 2024-04-26T10:21:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-26T10:21:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_sync_submit_transaction": "false", 2024-04-26T10:21:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "kstore_sync_transaction": "false", 2024-04-26T10:21:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_block_size": "65536", 2024-04-26T10:21:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_bloom_size": "0", 2024-04-26T10:21:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_cache_size": "536870912", 2024-04-26T10:21:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_compact_on_mount": "false", 2024-04-26T10:21:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_compression": "false", 2024-04-26T10:21:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_log": "", 2024-04-26T10:21:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_log_to_ceph_log": "true", 2024-04-26T10:21:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_max_open_files": "0", 2024-04-26T10:21:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_paranoid": "false", 2024-04-26T10:21:30.679 INFO:teuthology.orchestra.run.smithi052.stdout: "leveldb_write_buffer_size": "33554432", 2024-04-26T10:21:30.680 INFO:teuthology.orchestra.run.smithi052.stdout: "librados_thread_count": "2", 2024-04-26T10:21:30.680 INFO:teuthology.orchestra.run.smithi052.stdout: "lockdep": "false", 2024-04-26T10:21:30.680 INFO:teuthology.orchestra.run.smithi052.stdout: "lockdep_force_backtrace": "false", 2024-04-26T10:21:30.680 INFO:teuthology.orchestra.run.smithi052.stdout: "log_coarse_timestamps": "true", 2024-04-26T10:21:30.680 INFO:teuthology.orchestra.run.smithi052.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-26T10:21:30.680 INFO:teuthology.orchestra.run.smithi052.stdout: "log_flush_on_exit": "false", 2024-04-26T10:21:30.680 INFO:teuthology.orchestra.run.smithi052.stdout: "log_graylog_host": "127.0.0.1", 2024-04-26T10:21:30.680 INFO:teuthology.orchestra.run.smithi052.stdout: "log_graylog_port": "12201", 2024-04-26T10:21:30.681 INFO:teuthology.orchestra.run.smithi052.stdout: "log_max_new": "1000", 2024-04-26T10:21:30.681 INFO:teuthology.orchestra.run.smithi052.stdout: "log_max_recent": "10000", 2024-04-26T10:21:30.681 INFO:teuthology.orchestra.run.smithi052.stdout: "log_stderr_prefix": "", 2024-04-26T10:21:30.681 INFO:teuthology.orchestra.run.smithi052.stdout: "log_stop_at_utilization": "0.970000", 2024-04-26T10:21:30.681 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_file": "true", 2024-04-26T10:21:30.681 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_graylog": "false", 2024-04-26T10:21:30.681 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_journald": "false", 2024-04-26T10:21:30.681 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_stderr": "false", 2024-04-26T10:21:30.681 INFO:teuthology.orchestra.run.smithi052.stdout: "log_to_syslog": "false", 2024-04-26T10:21:30.681 INFO:teuthology.orchestra.run.smithi052.stdout: "max_rotating_auth_attempts": "10", 2024-04-26T10:21:30.681 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-26T10:21:30.681 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_action_on_write_error": "1", 2024-04-26T10:21:30.681 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_alternate_name_max": "8192", 2024-04-26T10:21:30.682 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_asio_thread_count": "2", 2024-04-26T10:21:30.682 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_export_pin": "true", 2024-04-26T10:21:30.682 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_fragment_dirs": "true", 2024-04-26T10:21:30.682 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-26T10:21:30.682 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_fragment_interval": "5", 2024-04-26T10:21:30.682 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-26T10:21:30.682 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-26T10:21:30.682 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_interval": "10", 2024-04-26T10:21:30.682 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_max": "-1", 2024-04-26T10:21:30.682 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_max_until": "-1", 2024-04-26T10:21:30.682 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_merge_size": "50", 2024-04-26T10:21:30.682 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_midchunk": "0.300000", 2024-04-26T10:21:30.682 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-26T10:21:30.682 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_min_start": "0.200000", 2024-04-26T10:21:30.683 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_minchunk": "0.001000", 2024-04-26T10:21:30.683 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_mode": "0", 2024-04-26T10:21:30.683 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_need_max": "1.200000", 2024-04-26T10:21:30.683 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_need_min": "0.800000", 2024-04-26T10:21:30.683 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-26T10:21:30.683 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-26T10:21:30.683 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_split_bits": "3", 2024-04-26T10:21:30.683 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-26T10:21:30.683 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_split_size": "10000", 2024-04-26T10:21:30.684 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-26T10:21:30.684 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_target_decay": "10.000000", 2024-04-26T10:21:30.684 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-26T10:21:30.684 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_beacon_grace": "15.000000", 2024-04-26T10:21:30.684 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_beacon_interval": "4.000000", 2024-04-26T10:21:30.684 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-26T10:21:30.684 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-26T10:21:30.684 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_mid": "0.700000", 2024-04-26T10:21:30.684 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_release_free_interval": "10", 2024-04-26T10:21:30.684 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_reservation": "0.050000", 2024-04-26T10:21:30.684 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-26T10:21:30.684 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_trim_interval": "1", 2024-04-26T10:21:30.684 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cache_trim_threshold": "262144", 2024-04-26T10:21:30.684 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-26T10:21:30.685 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-26T10:21:30.685 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-26T10:21:30.685 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_client_prealloc_inos": "1000", 2024-04-26T10:21:30.685 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-26T10:21:30.685 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_connect_bootstrapping": "false", 2024-04-26T10:21:30.685 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_damage_table_max_entries": "10000", 2024-04-26T10:21:30.685 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-26T10:21:30.685 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_debug_auth_pins": "false", 2024-04-26T10:21:30.685 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_debug_frag": "false", 2024-04-26T10:21:30.685 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_debug_scatterstat": "false", 2024-04-26T10:21:30.685 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_debug_subtrees": "false", 2024-04-26T10:21:30.685 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_decay_halflife": "5.000000", 2024-04-26T10:21:30.685 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_default_dir_hash": "2", 2024-04-26T10:21:30.686 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_defer_session_stale": "true", 2024-04-26T10:21:30.686 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_deny_all_reconnect": "false", 2024-04-26T10:21:30.686 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dir_keys_per_op": "16384", 2024-04-26T10:21:30.686 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dir_max_commit_size": "10", 2024-04-26T10:21:30.686 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dir_max_entries": "0", 2024-04-26T10:21:30.686 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dir_prefetch": "true", 2024-04-26T10:21:30.686 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-26T10:21:30.686 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-26T10:21:30.686 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dump_cache_on_map": "false", 2024-04-26T10:21:30.686 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-26T10:21:30.687 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-26T10:21:30.687 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_early_reply": "true", 2024-04-26T10:21:30.690 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_enable_op_tracker": "true", 2024-04-26T10:21:30.690 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_enforce_unique_name": "true", 2024-04-26T10:21:30.690 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-26T10:21:30.691 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-26T10:21:30.691 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_export_ephemeral_random": "true", 2024-04-26T10:21:30.691 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-26T10:21:30.691 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-26T10:21:30.691 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-26T10:21:30.692 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-26T10:21:30.692 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-26T10:21:30.692 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-26T10:21:30.692 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-26T10:21:30.692 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-26T10:21:30.692 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_health_summarize_threshold": "10", 2024-04-26T10:21:30.693 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-26T10:21:30.693 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-26T10:21:30.693 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_health_dummy": "false", 2024-04-26T10:21:30.693 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-26T10:21:30.693 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_migrator_session_race": "false", 2024-04-26T10:21:30.693 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-26T10:21:30.694 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-26T10:21:30.694 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-26T10:21:30.694 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_join_fs": "", 2024-04-26T10:21:30.694 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_journal_format": "1", 2024-04-26T10:21:30.694 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_create_at": "0", 2024-04-26T10:21:30.694 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_export_at": "0", 2024-04-26T10:21:30.695 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_import_at": "0", 2024-04-26T10:21:30.695 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_journal_at": "0", 2024-04-26T10:21:30.695 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_journal_expire_at": "0", 2024-04-26T10:21:30.695 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_journal_replay_at": "0", 2024-04-26T10:21:30.696 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_link_at": "0", 2024-04-26T10:21:30.696 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_mdstable_at": "0", 2024-04-26T10:21:30.696 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_openc_at": "0", 2024-04-26T10:21:30.696 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_rename_at": "0", 2024-04-26T10:21:30.696 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-26T10:21:30.696 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_events_per_segment": "1024", 2024-04-26T10:21:30.697 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_max_events": "-1", 2024-04-26T10:21:30.697 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_max_segments": "128", 2024-04-26T10:21:30.697 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_pause": "false", 2024-04-26T10:21:30.697 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_segment_size": "0", 2024-04-26T10:21:30.697 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-26T10:21:30.697 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_log_warn_factor": "2.000000", 2024-04-26T10:21:30.698 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_caps_per_client": "1048576", 2024-04-26T10:21:30.698 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_completed_flushes": "100000", 2024-04-26T10:21:30.698 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_completed_requests": "100000", 2024-04-26T10:21:30.698 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_export_size": "20971520", 2024-04-26T10:21:30.698 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_file_recover": "32", 2024-04-26T10:21:30.699 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_purge_files": "64", 2024-04-26T10:21:30.699 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_purge_ops": "8192", 2024-04-26T10:21:30.699 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-26T10:21:30.699 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-26T10:21:30.699 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_max_snaps_per_dir": "100", 2024-04-26T10:21:30.699 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_metrics_update_interval": "2", 2024-04-26T10:21:30.700 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_min_caps_per_client": "100", 2024-04-26T10:21:30.700 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_min_caps_working_set": "10000", 2024-04-26T10:21:30.700 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-26T10:21:30.700 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_numa_node": "-1", 2024-04-26T10:21:30.700 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-26T10:21:30.700 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_complaint_time": "30.000000", 2024-04-26T10:21:30.700 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_history_duration": "600", 2024-04-26T10:21:30.701 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_history_size": "20", 2024-04-26T10:21:30.701 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_history_slow_op_size": "20", 2024-04-26T10:21:30.701 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-26T10:21:30.701 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_op_log_threshold": "5", 2024-04-26T10:21:30.701 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_ping_grace": "15", 2024-04-26T10:21:30.701 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_ping_interval": "5", 2024-04-26T10:21:30.702 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-26T10:21:30.702 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-26T10:21:30.702 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_max_caps": "30000", 2024-04-26T10:21:30.702 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-26T10:21:30.702 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-26T10:21:30.702 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-26T10:21:30.703 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_recall_warning_threshold": "262144", 2024-04-26T10:21:30.703 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-26T10:21:30.703 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_replay_interval": "1.000000", 2024-04-26T10:21:30.703 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-26T10:21:30.703 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-26T10:21:30.704 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_root_ino_gid": "0", 2024-04-26T10:21:30.704 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_root_ino_uid": "0", 2024-04-26T10:21:30.704 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-26T10:21:30.704 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-26T10:21:30.704 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-26T10:21:30.704 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-26T10:21:30.705 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-26T10:21:30.705 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-26T10:21:30.705 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-26T10:21:30.705 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-26T10:21:30.705 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-26T10:21:30.705 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-26T10:21:30.706 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_shutdown_check": "0", 2024-04-26T10:21:30.706 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_skip_ino": "0", 2024-04-26T10:21:30.706 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-26T10:21:30.706 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_snap_max_uid": "4294967294", 2024-04-26T10:21:30.706 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_snap_min_uid": "0", 2024-04-26T10:21:30.706 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_snap_rstat": "false", 2024-04-26T10:21:30.707 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_standby_replay_damaged": "false", 2024-04-26T10:21:30.707 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_symlink_recovery": "true", 2024-04-26T10:21:30.707 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-26T10:21:30.707 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_thrash_exports": "0", 2024-04-26T10:21:30.707 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_thrash_fragments": "0", 2024-04-26T10:21:30.707 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_tick_interval": "5.000000", 2024-04-26T10:21:30.708 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_valgrind_exit": "false", 2024-04-26T10:21:30.708 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_verify_backtrace": "1", 2024-04-26T10:21:30.708 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_verify_scatter": "false", 2024-04-26T10:21:30.708 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-26T10:21:30.708 INFO:teuthology.orchestra.run.smithi052.stdout: "mds_wipe_sessions": "false", 2024-04-26T10:21:30.708 INFO:teuthology.orchestra.run.smithi052.stdout: "mempool_debug": "false", 2024-04-26T10:21:30.708 INFO:teuthology.orchestra.run.smithi052.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-26T10:21:30.709 INFO:teuthology.orchestra.run.smithi052.stdout: "memstore_device_bytes": "1073741824", 2024-04-26T10:21:30.709 INFO:teuthology.orchestra.run.smithi052.stdout: "memstore_page_set": "false", 2024-04-26T10:21:30.709 INFO:teuthology.orchestra.run.smithi052.stdout: "memstore_page_size": "65536", 2024-04-26T10:21:30.709 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_client_bytes": "134217728", 2024-04-26T10:21:30.709 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_client_messages": "512", 2024-04-26T10:21:30.709 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-26T10:21:30.710 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-26T10:21:30.710 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-26T10:21:30.710 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-26T10:21:30.710 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_disabled_modules": "", 2024-04-26T10:21:30.710 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-26T10:21:30.711 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_max_pg_num_change": "128", 2024-04-26T10:21:30.711 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_mds_bytes": "134217728", 2024-04-26T10:21:30.711 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_mds_messages": "128", 2024-04-26T10:21:30.711 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-26T10:21:30.711 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_mon_bytes": "134217728", 2024-04-26T10:21:30.711 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_mon_messages": "128", 2024-04-26T10:21:30.711 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_osd_bytes": "536870912", 2024-04-26T10:21:30.712 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_osd_messages": "8192", 2024-04-26T10:21:30.712 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_pool": "true", 2024-04-26T10:21:30.712 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-26T10:21:30.712 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_standby_modules": "true", 2024-04-26T10:21:30.712 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_stats_period": "5", 2024-04-26T10:21:30.712 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_stats_threshold": "5", 2024-04-26T10:21:30.712 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_tick_period": "2", 2024-04-26T10:21:30.712 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-26T10:21:30.712 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-26T10:21:30.712 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_allow_pool_delete": "true", 2024-04-26T10:21:30.712 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_allow_pool_size_one": "true", 2024-04-26T10:21:30.713 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_auth_validate_all_caps": "true", 2024-04-26T10:21:30.713 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-26T10:21:30.713 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-26T10:21:30.713 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_bytes": "104857600", 2024-04-26T10:21:30.713 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_directed_command_retry": "2", 2024-04-26T10:21:30.713 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-26T10:21:30.713 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-26T10:21:30.713 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-26T10:21:30.713 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-26T10:21:30.713 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_hunt_parallel": "3", 2024-04-26T10:21:30.713 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_log_interval": "1.000000", 2024-04-26T10:21:30.713 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-26T10:21:30.713 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_ping_interval": "10.000000", 2024-04-26T10:21:30.714 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-26T10:21:30.714 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-26T10:21:30.714 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-26T10:21:30.714 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-26T10:21:30.714 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_file_level": "debug", 2024-04-26T10:21:30.714 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_file": "true", 2024-04-26T10:21:30.714 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-26T10:21:30.714 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-26T10:21:30.714 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-26T10:21:30.714 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_journald": "false", 2024-04-26T10:21:30.714 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-26T10:21:30.714 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-26T10:21:30.714 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-26T10:21:30.714 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-26T10:21:30.715 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_compact_on_bootstrap": "false", 2024-04-26T10:21:30.715 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_compact_on_start": "false", 2024-04-26T10:21:30.715 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_compact_on_trim": "true", 2024-04-26T10:21:30.715 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-26T10:21:30.715 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-26T10:21:30.715 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-26T10:21:30.715 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_cpu_threads": "4", 2024-04-26T10:21:30.715 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_crush_min_required_version": "hammer", 2024-04-26T10:21:30.715 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_daemon_bytes": "419430400", 2024-04-26T10:21:30.715 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-26T10:21:30.715 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_data_avail_crit": "5", 2024-04-26T10:21:30.715 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_data_avail_warn": "5", 2024-04-26T10:21:30.715 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_data_size_warn": "16106127360", 2024-04-26T10:21:30.715 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-26T10:21:30.716 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-26T10:21:30.716 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_dump_json": "false", 2024-04-26T10:21:30.716 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-26T10:21:30.716 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_dump_transactions": "false", 2024-04-26T10:21:30.716 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_extra_checks": "false", 2024-04-26T10:21:30.716 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-26T10:21:30.716 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-26T10:21:30.716 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_no_require_quincy": "false", 2024-04-26T10:21:30.716 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_no_require_reef": "false", 2024-04-26T10:21:30.716 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-26T10:21:30.716 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-26T10:21:30.716 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-26T10:21:30.716 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_down_mkfs_grace": "120", 2024-04-26T10:21:30.717 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_election_default_strategy": "1", 2024-04-26T10:21:30.717 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_election_timeout": "5.000000", 2024-04-26T10:21:30.717 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-26T10:21:30.717 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_elector_ping_divisor": "2", 2024-04-26T10:21:30.717 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-26T10:21:30.717 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_enable_op_tracker": "true", 2024-04-26T10:21:30.717 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_fake_pool_delete": "false", 2024-04-26T10:21:30.717 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_force_quorum_join": "false", 2024-04-26T10:21:30.717 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_globalid_prealloc": "10000", 2024-04-26T10:21:30.717 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_detail_to_clog": "false", 2024-04-26T10:21:30.717 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_log_update_period": "5", 2024-04-26T10:21:30.717 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_max_detail": "50", 2024-04-26T10:21:30.717 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_to_clog": "true", 2024-04-26T10:21:30.717 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_to_clog_interval": "600", 2024-04-26T10:21:30.718 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-26T10:21:30.718 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_host": "172.21.15.52,[v2:172.21.15.52:3301,v1:172.21.15.52:6790],[v2:172.21.15.52:3302,v1:172.21.15.52:6791]", 2024-04-26T10:21:30.718 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_host_override": "", 2024-04-26T10:21:30.718 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_initial_members": "", 2024-04-26T10:21:30.718 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-26T10:21:30.718 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-26T10:21:30.718 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-26T10:21:30.718 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-26T10:21:30.718 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-26T10:21:30.718 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_lease": "5.000000", 2024-04-26T10:21:30.718 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-26T10:21:30.718 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-26T10:21:30.718 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_log_full_interval": "50", 2024-04-26T10:21:30.719 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_log_max": "10000", 2024-04-26T10:21:30.719 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_log_max_summary": "50", 2024-04-26T10:21:30.719 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-26T10:21:30.719 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_log_epochs": "500", 2024-04-26T10:21:30.719 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-26T10:21:30.719 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-26T10:21:30.719 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_osd": "10000", 2024-04-26T10:21:30.719 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_pg_per_osd": "10000", 2024-04-26T10:21:30.719 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_pool_pg_num": "65536", 2024-04-26T10:21:30.719 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-26T10:21:30.719 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-26T10:21:30.719 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mds_force_trim_to": "0", 2024-04-26T10:21:30.719 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mds_skip_sanity": "false", 2024-04-26T10:21:30.720 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_memory_autotune": "true", 2024-04-26T10:21:30.720 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_memory_target": "2147483648", 2024-04-26T10:21:30.720 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_beacon_grace": "30", 2024-04-26T10:21:30.720 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-26T10:21:30.720 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_digest_period": "5", 2024-04-26T10:21:30.720 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_inactive_grace": "60", 2024-04-26T10:21:30.720 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-26T10:21:30.720 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-26T10:21:30.720 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_min_osdmap_epochs": "500", 2024-04-26T10:21:30.720 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_complaint_time": "30", 2024-04-26T10:21:30.720 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_history_duration": "600", 2024-04-26T10:21:30.721 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_history_size": "20", 2024-04-26T10:21:30.721 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_history_slow_op_size": "20", 2024-04-26T10:21:30.721 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-26T10:21:30.721 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_op_log_threshold": "5", 2024-04-26T10:21:30.721 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-26T10:21:30.721 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-26T10:21:30.721 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-26T10:21:30.721 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_auto_mark_in": "false", 2024-04-26T10:21:30.721 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-26T10:21:30.721 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-26T10:21:30.721 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-26T10:21:30.721 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_cache_size": "500", 2024-04-26T10:21:30.721 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-26T10:21:30.722 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-26T10:21:30.722 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-26T10:21:30.722 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_down_out_interval": "600", 2024-04-26T10:21:30.722 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-26T10:21:30.722 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-26T10:21:30.722 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_force_trim_to": "0", 2024-04-26T10:21:30.722 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-26T10:21:30.722 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-26T10:21:30.722 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-26T10:21:30.722 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-26T10:21:30.722 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-26T10:21:30.722 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-26T10:21:30.722 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-26T10:21:30.722 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-26T10:21:30.723 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_min_down_reporters": "2", 2024-04-26T10:21:30.723 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-26T10:21:30.723 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-26T10:21:30.723 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-26T10:21:30.723 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-26T10:21:30.723 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-26T10:21:30.723 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-26T10:21:30.723 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_report_timeout": "900", 2024-04-26T10:21:30.723 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-26T10:21:30.723 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-26T10:21:30.723 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-26T10:21:30.723 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-26T10:21:30.723 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-26T10:21:30.723 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-26T10:21:30.724 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-26T10:21:30.724 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-26T10:21:30.724 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-26T10:21:30.724 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_stuck_threshold": "60", 2024-04-26T10:21:30.724 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-26T10:21:30.724 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-26T10:21:30.724 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-26T10:21:30.724 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-26T10:21:30.724 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-26T10:21:30.724 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-26T10:21:30.724 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_probe_timeout": "2.000000", 2024-04-26T10:21:30.724 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_reweight_max_change": "0.050000", 2024-04-26T10:21:30.724 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_reweight_max_osds": "4", 2024-04-26T10:21:30.724 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-26T10:21:30.725 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-26T10:21:30.725 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-26T10:21:30.725 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-26T10:21:30.725 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-26T10:21:30.725 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_interval": "86400", 2024-04-26T10:21:30.725 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_max_keys": "100", 2024-04-26T10:21:30.725 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_scrub_timeout": "300", 2024-04-26T10:21:30.725 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_session_timeout": "300", 2024-04-26T10:21:30.725 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_smart_report_timeout": "5", 2024-04-26T10:21:30.725 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stat_smooth_intervals": "6", 2024-04-26T10:21:30.725 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-26T10:21:30.725 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stretch_pool_min_size": "2", 2024-04-26T10:21:30.725 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stretch_pool_size": "4", 2024-04-26T10:21:30.725 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-26T10:21:30.726 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-26T10:21:30.726 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_debug": "false", 2024-04-26T10:21:30.726 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-26T10:21:30.726 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-26T10:21:30.726 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_provider_kill_at": "0", 2024-04-26T10:21:30.726 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_requester_kill_at": "0", 2024-04-26T10:21:30.726 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_sync_timeout": "60.000000", 2024-04-26T10:21:30.726 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_target_pg_per_osd": "100", 2024-04-26T10:21:30.726 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_tick_interval": "5", 2024-04-26T10:21:30.726 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_timecheck_interval": "300.000000", 2024-04-26T10:21:30.726 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-26T10:21:30.726 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_use_min_delay_socket": "false", 2024-04-26T10:21:30.726 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_older_version_delay": "604800", 2024-04-26T10:21:30.727 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-26T10:21:30.727 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-26T10:21:30.727 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-26T10:21:30.727 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-26T10:21:30.727 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-26T10:21:30.727 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-26T10:21:30.727 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-26T10:21:30.727 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_misplaced": "false", 2024-04-26T10:21:30.727 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-26T10:21:30.727 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_older_version": "true", 2024-04-26T10:21:30.727 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-26T10:21:30.727 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-26T10:21:30.727 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-26T10:21:30.727 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-26T10:21:30.728 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-26T10:21:30.728 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-26T10:21:30.728 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-26T10:21:30.728 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-26T10:21:30.728 INFO:teuthology.orchestra.run.smithi052.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-26T10:21:30.728 INFO:teuthology.orchestra.run.smithi052.stdout: "monmap": "", 2024-04-26T10:21:30.728 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T10:21:30.728 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-26T10:21:30.728 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-26T10:21:30.728 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-26T10:21:30.728 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-26T10:21:30.728 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-26T10:21:30.728 INFO:teuthology.orchestra.run.smithi052.stdout: "motr_tracing_enabled": "false", 2024-04-26T10:21:30.728 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_op_threads": "3", 2024-04-26T10:21:30.729 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-26T10:21:30.729 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_cm": "false", 2024-04-26T10:21:30.729 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_device_name": "", 2024-04-26T10:21:30.729 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_dscp": "96", 2024-04-26T10:21:30.729 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-26T10:21:30.729 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-26T10:21:30.729 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_local_gid": "", 2024-04-26T10:21:30.729 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-26T10:21:30.729 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_port_num": "1", 2024-04-26T10:21:30.729 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-26T10:21:30.729 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-26T10:21:30.729 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-26T10:21:30.729 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-26T10:21:30.729 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_sl": "3", 2024-04-26T10:21:30.730 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_support_srq": "true", 2024-04-26T10:21:30.730 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_rdma_type": "ib", 2024-04-26T10:21:30.730 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_async_reap_threshold": "5", 2024-04-26T10:21:30.730 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_before_connect": "false", 2024-04-26T10:21:30.730 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_ipv4": "true", 2024-04-26T10:21:30.730 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_ipv6": "false", 2024-04-26T10:21:30.730 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_msgr1": "true", 2024-04-26T10:21:30.730 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_msgr2": "true", 2024-04-26T10:21:30.730 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_port_max": "7568", 2024-04-26T10:21:30.730 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_port_min": "6800", 2024-04-26T10:21:30.730 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-26T10:21:30.730 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_retry_count": "3", 2024-04-26T10:21:30.730 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_bind_retry_delay": "5", 2024-04-26T10:21:30.731 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_client": "false", 2024-04-26T10:21:30.731 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_mds": "false", 2024-04-26T10:21:30.731 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_mgr": "false", 2024-04-26T10:21:30.731 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_mon": "false", 2024-04-26T10:21:30.731 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_blackhole_osd": "false", 2024-04-26T10:21:30.731 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_client_mode": "crc secure", 2024-04-26T10:21:30.731 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_cluster_mode": "crc secure", 2024-04-26T10:21:30.731 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_cluster_type": "", 2024-04-26T10:21:30.731 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_compress_secure": "false", 2024-04-26T10:21:30.731 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_connection_idle_timeout": "900", 2024-04-26T10:21:30.731 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_connection_ready_timeout": "10", 2024-04-26T10:21:30.731 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_crc_data": "true", 2024-04-26T10:21:30.731 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_crc_header": "true", 2024-04-26T10:21:30.732 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_bad_msg": "false", 2024-04-26T10:21:30.732 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_bug": "true", 2024-04-26T10:21:30.732 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_old_message": "true", 2024-04-26T10:21:30.732 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_skipped_message": "false", 2024-04-26T10:21:30.732 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-26T10:21:30.732 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-26T10:21:30.732 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_coremask": "0xF", 2024-04-26T10:21:30.732 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-26T10:21:30.732 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-26T10:21:30.732 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_enable_tso": "true", 2024-04-26T10:21:30.732 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-26T10:21:30.732 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-26T10:21:30.732 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_hugepages": "", 2024-04-26T10:21:30.733 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-26T10:21:30.733 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-26T10:21:30.733 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_lro": "true", 2024-04-26T10:21:30.733 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_memory_channel": "4", 2024-04-26T10:21:30.733 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-26T10:21:30.733 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_pmd": "", 2024-04-26T10:21:30.733 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_port_id": "0", 2024-04-26T10:21:30.733 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-26T10:21:30.733 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-26T10:21:30.733 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_dump_on_send": "false", 2024-04-26T10:21:30.733 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_initial_backoff": "0.200000", 2024-04-26T10:21:30.733 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_delay_max": "1.000000", 2024-04-26T10:21:30.733 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-26T10:21:30.733 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_delay_type": "", 2024-04-26T10:21:30.734 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-26T10:21:30.734 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_network_congestion": "0", 2024-04-26T10:21:30.734 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_inject_socket_failures": "0", 2024-04-26T10:21:30.734 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_learn_addr_from_peer": "true", 2024-04-26T10:21:30.734 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_max_accept_failures": "4", 2024-04-26T10:21:30.734 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_max_backoff": "15.000000", 2024-04-26T10:21:30.734 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_mon_client_mode": "secure crc", 2024-04-26T10:21:30.734 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-26T10:21:30.734 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_mon_service_mode": "secure crc", 2024-04-26T10:21:30.734 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_osd_compress_min_size": "1024", 2024-04-26T10:21:30.734 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_osd_compress_mode": "none", 2024-04-26T10:21:30.734 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-26T10:21:30.735 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-26T10:21:30.735 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_pq_min_cost": "65536", 2024-04-26T10:21:30.735 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_public_type": "", 2024-04-26T10:21:30.735 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_service_mode": "crc secure", 2024-04-26T10:21:30.735 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_tcp_listen_backlog": "512", 2024-04-26T10:21:30.735 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_tcp_nodelay": "true", 2024-04-26T10:21:30.735 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-26T10:21:30.735 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_tcp_rcvbuf": "0", 2024-04-26T10:21:30.735 INFO:teuthology.orchestra.run.smithi052.stdout: "ms_type": "async+posix", 2024-04-26T10:21:30.735 INFO:teuthology.orchestra.run.smithi052.stdout: "no_config_file": "false", 2024-04-26T10:21:30.735 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_completion_locks_per_session": "32", 2024-04-26T10:21:30.735 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-26T10:21:30.735 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-26T10:21:30.735 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_inflight_ops": "1024", 2024-04-26T10:21:30.736 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-26T10:21:30.736 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-26T10:21:30.736 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_tick_interval": "5.000000", 2024-04-26T10:21:30.736 INFO:teuthology.orchestra.run.smithi052.stdout: "objecter_timeout": "10.000000", 2024-04-26T10:21:30.736 INFO:teuthology.orchestra.run.smithi052.stdout: "objectstore_blackhole": "false", 2024-04-26T10:21:30.736 INFO:teuthology.orchestra.run.smithi052.stdout: "openssl_engine_opts": "", 2024-04-26T10:21:30.736 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_delay_time": "5.000000", 2024-04-26T10:21:30.736 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_hist_halflife": "1000", 2024-04-26T10:21:30.736 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_max_low_ops": "2", 2024-04-26T10:21:30.736 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_max_ops": "4", 2024-04-26T10:21:30.736 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-26T10:21:30.736 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-26T10:21:30.736 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_agent_slop": "0.020000", 2024-04-26T10:21:30.736 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-26T10:21:30.737 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-26T10:21:30.737 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_asio_thread_count": "2", 2024-04-26T10:21:30.737 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_async_recovery_min_cost": "100", 2024-04-26T10:21:30.737 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-26T10:21:30.737 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-26T10:21:30.737 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backfill_scan_max": "512", 2024-04-26T10:21:30.737 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backfill_scan_min": "64", 2024-04-26T10:21:30.737 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backoff_on_degraded": "false", 2024-04-26T10:21:30.737 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backoff_on_peering": "false", 2024-04-26T10:21:30.737 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_backoff_on_unfound": "true", 2024-04-26T10:21:30.737 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_beacon_report_interval": "300", 2024-04-26T10:21:30.737 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bench_duration": "30", 2024-04-26T10:21:30.737 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-26T10:21:30.737 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bench_max_block_size": "67108864", 2024-04-26T10:21:30.738 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-26T10:21:30.738 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_blkin_trace_all": "false", 2024-04-26T10:21:30.738 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-26T10:21:30.738 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-26T10:21:30.738 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-26T10:21:30.738 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-26T10:21:30.738 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_check_for_log_corruption": "false", 2024-04-26T10:21:30.738 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-26T10:21:30.738 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T10:21:30.738 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-26T10:21:30.738 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-26T10:21:30.738 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_class_update_on_start": "true", 2024-04-26T10:21:30.739 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_client_message_cap": "256", 2024-04-26T10:21:30.739 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_client_message_size_cap": "524288000", 2024-04-26T10:21:30.739 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_client_op_priority": "63", 2024-04-26T10:21:30.739 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_client_watch_timeout": "30", 2024-04-26T10:21:30.739 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_command_max_records": "256", 2024-04-26T10:21:30.739 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_compact_on_start": "false", 2024-04-26T10:21:30.739 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-26T10:21:30.739 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-26T10:21:30.739 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-26T10:21:30.739 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_crush_update_on_start": "true", 2024-04-26T10:21:30.739 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_crush_update_weight_set": "true", 2024-04-26T10:21:30.739 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-26T10:21:30.739 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-26T10:21:30.739 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-26T10:21:30.740 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-26T10:21:30.740 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-26T10:21:30.740 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_feed_pullee": "-1", 2024-04-26T10:21:30.740 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-26T10:21:30.740 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-26T10:21:30.740 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-26T10:21:30.740 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_misdirected_ops": "false", 2024-04-26T10:21:30.740 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_no_acting_change": "false", 2024-04-26T10:21:30.740 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_no_purge_strays": "false", 2024-04-26T10:21:30.740 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_op_order": "false", 2024-04-26T10:21:30.740 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-26T10:21:30.740 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-26T10:21:30.740 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-26T10:21:30.740 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-26T10:21:30.740 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_shutdown": "false", 2024-04-26T10:21:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-26T10:21:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-26T10:21:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-26T10:21:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-26T10:21:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_verify_snaps": "false", 2024-04-26T10:21:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-26T10:21:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-26T10:21:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_keys": "1024", 2024-04-26T10:21:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-26T10:21:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-26T10:21:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-26T10:21:30.741 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_stride": "524288", 2024-04-26T10:21:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-26T10:21:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-26T10:21:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_default_notify_timeout": "30", 2024-04-26T10:21:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_delete_sleep": "0.000000", 2024-04-26T10:21:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-26T10:21:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-26T10:21:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-26T10:21:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_discard_disconnected_ops": "true", 2024-04-26T10:21:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_enable_op_tracker": "true", 2024-04-26T10:21:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-26T10:21:30.742 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-26T10:21:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-26T10:21:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-26T10:21:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_info": "true", 2024-04-26T10:21:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_shutdown": "true", 2024-04-26T10:21:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-26T10:21:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-26T10:21:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-26T10:21:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-26T10:21:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-26T10:21:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_function_tracing": "false", 2024-04-26T10:21:30.743 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_grace": "20", 2024-04-26T10:21:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_interval": "6", 2024-04-26T10:21:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-26T10:21:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_min_peers": "10", 2024-04-26T10:21:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_min_size": "2000", 2024-04-26T10:21:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_stale": "600", 2024-04-26T10:21:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-26T10:21:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_hit_set_max_size": "100000", 2024-04-26T10:21:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_hit_set_min_size": "1000", 2024-04-26T10:21:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-26T10:21:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-26T10:21:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-26T10:21:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-26T10:21:30.744 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-26T10:21:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-26T10:21:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_journal_size": "5120", 2024-04-26T10:21:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_kill_backfill_at": "0", 2024-04-26T10:21:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-26T10:21:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_cache_size": "50", 2024-04-26T10:21:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_dedup": "true", 2024-04-26T10:21:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_message_max": "40", 2024-04-26T10:21:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-26T10:21:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_map_share_max_epochs": "40", 2024-04-26T10:21:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_attr_name_len": "100", 2024-04-26T10:21:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_attr_size": "0", 2024-04-26T10:21:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_backfills": "1", 2024-04-26T10:21:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_markdown_count": "5", 2024-04-26T10:21:30.745 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_markdown_period": "600", 2024-04-26T10:21:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_object_name_len": "2048", 2024-04-26T10:21:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_object_namespace_len": "256", 2024-04-26T10:21:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_object_size": "134217728", 2024-04-26T10:21:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-26T10:21:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-26T10:21:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_pg_blocked_by": "16", 2024-04-26T10:21:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_pg_log_entries": "10000", 2024-04-26T10:21:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-26T10:21:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_pgls": "1024", 2024-04-26T10:21:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_push_cost": "8388608", 2024-04-26T10:21:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_push_objects": "10", 2024-04-26T10:21:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_scrubs": "3", 2024-04-26T10:21:30.746 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-26T10:21:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_trimming_pgs": "2", 2024-04-26T10:21:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_write_op_reply_len": "64", 2024-04-26T10:21:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_max_write_size": "90", 2024-04-26T10:21:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-26T10:21:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-26T10:21:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-26T10:21:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-26T10:21:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-26T10:21:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-26T10:21:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-26T10:21:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-26T10:21:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_profile": "balanced", 2024-04-26T10:21:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-26T10:21:30.747 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-26T10:21:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-26T10:21:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-26T10:21:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-26T10:21:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-26T10:21:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-26T10:21:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-26T10:21:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-26T10:21:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-26T10:21:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-26T10:21:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_base": "805306368", 2024-04-26T10:21:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_cache_min": "134217728", 2024-04-26T10:21:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-26T10:21:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-26T10:21:30.748 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_target": "4294967296", 2024-04-26T10:21:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_target_autotune": "false", 2024-04-26T10:21:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-26T10:21:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_min_pg_log_entries": "250", 2024-04-26T10:21:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_min_recovery_priority": "0", 2024-04-26T10:21:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-26T10:21:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-26T10:21:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_report_interval": "5", 2024-04-26T10:21:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-26T10:21:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-26T10:21:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_num_cache_shards": "32", 2024-04-26T10:21:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_num_op_tracker_shard": "32", 2024-04-26T10:21:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_numa_auto_affinity": "true", 2024-04-26T10:21:30.749 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_numa_node": "-1", 2024-04-26T10:21:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_numa_prefer_iface": "true", 2024-04-26T10:21:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-26T10:21:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_objecter_finishers": "1", 2024-04-26T10:21:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_objectstore": "bluestore", 2024-04-26T10:21:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_objectstore_fuse": "false", 2024-04-26T10:21:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_objectstore_tracing": "false", 2024-04-26T10:21:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_complaint_time": "30.000000", 2024-04-26T10:21:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_history_duration": "600", 2024-04-26T10:21:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_history_size": "20", 2024-04-26T10:21:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_history_slow_op_size": "20", 2024-04-26T10:21:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-26T10:21:30.750 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_log_threshold": "5", 2024-04-26T10:21:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_shards": "0", 2024-04-26T10:21:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_shards_hdd": "5", 2024-04-26T10:21:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_shards_ssd": "8", 2024-04-26T10:21:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-26T10:21:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-26T10:21:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-26T10:21:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-26T10:21:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_pq_min_cost": "65536", 2024-04-26T10:21:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-26T10:21:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_queue_cut_off": "high", 2024-04-26T10:21:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-26T10:21:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_op_thread_timeout": "15", 2024-04-26T10:21:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_open_classes_on_start": "true", 2024-04-26T10:21:30.751 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_os_flags": "0", 2024-04-26T10:21:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_peering_op_priority": "255", 2024-04-26T10:21:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_delete_cost": "1048576", 2024-04-26T10:21:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_delete_priority": "5", 2024-04-26T10:21:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-26T10:21:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-26T10:21:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-26T10:21:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_log_trim_max": "10000", 2024-04-26T10:21:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_log_trim_min": "100", 2024-04-26T10:21:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-26T10:21:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-26T10:21:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pg_stat_report_interval_max": "500", 2024-04-26T10:21:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-26T10:21:30.752 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-26T10:21:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-26T10:21:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-26T10:21:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-26T10:21:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-26T10:21:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_crimson": "false", 2024-04-26T10:21:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-26T10:21:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-26T10:21:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-26T10:21:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-26T10:21:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-26T10:21:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-26T10:21:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-26T10:21:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-26T10:21:30.753 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_flags": "0", 2024-04-26T10:21:30.754 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-26T10:21:30.754 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_min_size": "0", 2024-04-26T10:21:30.754 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-26T10:21:30.754 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_pg_num": "32", 2024-04-26T10:21:30.754 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_pgp_num": "0", 2024-04-26T10:21:30.754 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-26T10:21:30.754 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_size": "2", 2024-04-26T10:21:30.754 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_default_type": "replicated", 2024-04-26T10:21:30.754 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-26T10:21:30.754 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-26T10:21:30.754 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_push_per_object_cost": "1000", 2024-04-26T10:21:30.754 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-26T10:21:30.754 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recover_clone_overlap": "true", 2024-04-26T10:21:30.755 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-26T10:21:30.755 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_cost": "20971520", 2024-04-26T10:21:30.755 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-26T10:21:30.755 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_active": "0", 2024-04-26T10:21:30.755 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-26T10:21:30.755 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-26T10:21:30.755 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-26T10:21:30.755 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-26T10:21:30.755 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_max_single_start": "1", 2024-04-26T10:21:30.755 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_op_priority": "3", 2024-04-26T10:21:30.755 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-26T10:21:30.755 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_priority": "5", 2024-04-26T10:21:30.755 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-26T10:21:30.755 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_sleep": "0.000000", 2024-04-26T10:21:30.756 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-26T10:21:30.756 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-26T10:21:30.756 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-26T10:21:30.756 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_repair_during_recovery": "false", 2024-04-26T10:21:30.756 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_requested_scrub_priority": "120", 2024-04-26T10:21:30.756 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-26T10:21:30.756 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-26T10:21:30.756 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_auto_repair": "false", 2024-04-26T10:21:30.756 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-26T10:21:30.756 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-26T10:21:30.756 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_begin_hour": "0", 2024-04-26T10:21:30.756 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_begin_week_day": "0", 2024-04-26T10:21:30.756 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_chunk_max": "25", 2024-04-26T10:21:30.756 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_chunk_min": "5", 2024-04-26T10:21:30.757 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_cost": "52428800", 2024-04-26T10:21:30.757 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_during_recovery": "false", 2024-04-26T10:21:30.757 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_end_hour": "0", 2024-04-26T10:21:30.757 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_end_week_day": "0", 2024-04-26T10:21:30.757 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_event_cost": "4096", 2024-04-26T10:21:30.757 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-26T10:21:30.757 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-26T10:21:30.757 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_invalid_stats": "true", 2024-04-26T10:21:30.757 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-26T10:21:30.757 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-26T10:21:30.757 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_max_preemptions": "5", 2024-04-26T10:21:30.757 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-26T10:21:30.757 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_priority": "5", 2024-04-26T10:21:30.758 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_reservation_timeout": "5000", 2024-04-26T10:21:30.758 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_sleep": "0.000000", 2024-04-26T10:21:30.758 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-04-26T10:21:30.758 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-26T10:21:30.758 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-26T10:21:30.758 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-26T10:21:30.758 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_skip_data_digest": "false", 2024-04-26T10:21:30.758 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_smart_report_timeout": "5", 2024-04-26T10:21:30.758 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_cost": "1048576", 2024-04-26T10:21:30.758 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_priority": "5", 2024-04-26T10:21:30.758 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-26T10:21:30.758 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-26T10:21:30.758 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-26T10:21:30.758 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-26T10:21:30.759 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-26T10:21:30.759 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-26T10:21:30.759 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-26T10:21:30.759 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_target_transaction_size": "30", 2024-04-26T10:21:30.759 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-26T10:21:30.759 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-26T10:21:30.759 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-26T10:21:30.759 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-26T10:21:30.759 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-26T10:21:30.759 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-26T10:21:30.759 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-26T10:21:30.759 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-26T10:21:30.759 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-26T10:21:30.760 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-26T10:21:30.760 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_tracing": "false", 2024-04-26T10:21:30.760 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_use_stale_snap": "false", 2024-04-26T10:21:30.760 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-26T10:21:30.760 INFO:teuthology.orchestra.run.smithi052.stdout: "osdc_blkin_trace_all": "false", 2024-04-26T10:21:30.760 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_kill_at": "0", 2024-04-26T10:21:30.760 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_max_join_drift": "10", 2024-04-26T10:21:30.760 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_min": "500", 2024-04-26T10:21:30.760 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_min_wait": "0.050000", 2024-04-26T10:21:30.760 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_propose_interval": "1.000000", 2024-04-26T10:21:30.760 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_service_trim_max": "500", 2024-04-26T10:21:30.760 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-26T10:21:30.760 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_service_trim_min": "250", 2024-04-26T10:21:30.760 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_stash_full_interval": "25", 2024-04-26T10:21:30.761 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_trim_max": "500", 2024-04-26T10:21:30.761 INFO:teuthology.orchestra.run.smithi052.stdout: "paxos_trim_min": "250", 2024-04-26T10:21:30.761 INFO:teuthology.orchestra.run.smithi052.stdout: "perf": "true", 2024-04-26T10:21:30.761 INFO:teuthology.orchestra.run.smithi052.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-26T10:21:30.761 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-26T10:21:30.761 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-26T10:21:30.761 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "-", 2024-04-26T10:21:30.761 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrv": "", 2024-04-26T10:21:30.761 INFO:teuthology.orchestra.run.smithi052.stdout: "public_bind_addr": "-", 2024-04-26T10:21:30.761 INFO:teuthology.orchestra.run.smithi052.stdout: "public_network": "", 2024-04-26T10:21:30.761 INFO:teuthology.orchestra.run.smithi052.stdout: "public_network_interface": "", 2024-04-26T10:21:30.761 INFO:teuthology.orchestra.run.smithi052.stdout: "qat_compressor_enabled": "false", 2024-04-26T10:21:30.761 INFO:teuthology.orchestra.run.smithi052.stdout: "qat_compressor_session_max_number": "256", 2024-04-26T10:21:30.762 INFO:teuthology.orchestra.run.smithi052.stdout: "rados_mon_op_timeout": "0", 2024-04-26T10:21:30.762 INFO:teuthology.orchestra.run.smithi052.stdout: "rados_osd_op_timeout": "0", 2024-04-26T10:21:30.762 INFO:teuthology.orchestra.run.smithi052.stdout: "rados_tracing": "false", 2024-04-26T10:21:30.762 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_atime_update_interval": "60", 2024-04-26T10:21:30.762 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-26T10:21:30.762 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_balance_parent_reads": "false", 2024-04-26T10:21:30.762 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_balance_snap_reads": "false", 2024-04-26T10:21:30.762 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_blkin_trace_all": "false", 2024-04-26T10:21:30.762 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-26T10:21:30.762 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-26T10:21:30.762 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache": "true", 2024-04-26T10:21:30.762 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-26T10:21:30.762 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-26T10:21:30.762 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-26T10:21:30.763 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-26T10:21:30.763 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_policy": "writearound", 2024-04-26T10:21:30.763 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_size": "33554432", 2024-04-26T10:21:30.763 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-26T10:21:30.763 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-26T10:21:30.763 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_clone_copy_on_read": "false", 2024-04-26T10:21:30.763 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_compression_hint": "none", 2024-04-26T10:21:30.763 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_concurrent_management_ops": "10", 2024-04-26T10:21:30.763 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-26T10:21:30.763 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_clone_format": "auto", 2024-04-26T10:21:30.763 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_data_pool": "", 2024-04-26T10:21:30.763 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_features": "61", 2024-04-26T10:21:30.763 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_format": "2", 2024-04-26T10:21:30.764 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_map_options": "", 2024-04-26T10:21:30.764 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_order": "22", 2024-04-26T10:21:30.764 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_pool": "rbd", 2024-04-26T10:21:30.764 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-26T10:21:30.764 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_stripe_count": "0", 2024-04-26T10:21:30.764 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_default_stripe_unit": "0", 2024-04-26T10:21:30.764 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-26T10:21:30.764 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-26T10:21:30.764 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-26T10:21:30.764 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_enable_alloc_hint": "true", 2024-04-26T10:21:30.764 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-26T10:21:30.764 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_io_scheduler": "simple", 2024-04-26T10:21:30.764 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-26T10:21:30.764 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-26T10:21:30.765 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-26T10:21:30.765 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-26T10:21:30.765 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-26T10:21:30.765 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-26T10:21:30.765 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-26T10:21:30.765 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-26T10:21:30.765 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-26T10:21:30.765 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_order": "24", 2024-04-26T10:21:30.765 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_pool": "", 2024-04-26T10:21:30.765 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_journal_splay_width": "4", 2024-04-26T10:21:30.765 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_localize_parent_reads": "false", 2024-04-26T10:21:30.765 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_localize_snap_reads": "false", 2024-04-26T10:21:30.765 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-26T10:21:30.766 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-26T10:21:30.766 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-26T10:21:30.766 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-26T10:21:30.766 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-26T10:21:30.766 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-26T10:21:30.766 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-26T10:21:30.766 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-26T10:21:30.766 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-26T10:21:30.766 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-26T10:21:30.766 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-26T10:21:30.766 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-26T10:21:30.766 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-26T10:21:30.766 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-26T10:21:30.766 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-26T10:21:30.767 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-26T10:21:30.767 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-26T10:21:30.767 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-26T10:21:30.767 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-26T10:21:30.767 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-26T10:21:30.767 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-26T10:21:30.767 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-26T10:21:30.767 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-26T10:21:30.767 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-26T10:21:30.767 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-26T10:21:30.767 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-26T10:21:30.767 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-26T10:21:30.767 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-26T10:21:30.768 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-26T10:21:30.768 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-26T10:21:30.768 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-26T10:21:30.768 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_mtime_update_interval": "60", 2024-04-26T10:21:30.768 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_non_blocking_aio": "true", 2024-04-26T10:21:30.768 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_op_thread_timeout": "60", 2024-04-26T10:21:30.768 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_op_threads": "1", 2024-04-26T10:21:30.768 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_parent_cache_enabled": "false", 2024-04-26T10:21:30.768 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-26T10:21:30.768 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-26T10:21:30.768 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-26T10:21:30.768 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_plugins": "", 2024-04-26T10:21:30.768 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_bps_burst": "0", 2024-04-26T10:21:30.769 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-26T10:21:30.769 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_bps_limit": "0", 2024-04-26T10:21:30.769 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_exclude_ops": "0", 2024-04-26T10:21:30.769 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_iops_burst": "0", 2024-04-26T10:21:30.769 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-26T10:21:30.769 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_iops_limit": "0", 2024-04-26T10:21:30.769 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-26T10:21:30.769 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-26T10:21:30.769 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-26T10:21:30.769 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-26T10:21:30.769 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-26T10:21:30.769 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-26T10:21:30.769 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-26T10:21:30.769 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-26T10:21:30.770 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-26T10:21:30.770 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-26T10:21:30.770 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-26T10:21:30.770 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-26T10:21:30.770 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-26T10:21:30.770 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-26T10:21:30.770 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_read_from_replica_policy": "default", 2024-04-26T10:21:30.770 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-26T10:21:30.770 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-26T10:21:30.770 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-26T10:21:30.770 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-26T10:21:30.770 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_skip_partial_discard": "true", 2024-04-26T10:21:30.770 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-26T10:21:30.771 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_tracing": "false", 2024-04-26T10:21:30.771 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_validate_names": "true", 2024-04-26T10:21:30.771 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd_validate_pool": "true", 2024-04-26T10:21:30.771 INFO:teuthology.orchestra.run.smithi052.stdout: "restapi_base_url": "", 2024-04-26T10:21:30.771 INFO:teuthology.orchestra.run.smithi052.stdout: "restapi_log_level": "", 2024-04-26T10:21:30.771 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_acl_grants_max_num": "100", 2024-04-26T10:21:30.771 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_admin_entry": "admin", 2024-04-26T10:21:30.771 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-26T10:21:30.771 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_backend_store": "rados", 2024-04-26T10:21:30.771 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_barbican_url": "", 2024-04-26T10:21:30.771 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_beast_enable_async": "true", 2024-04-26T10:21:30.771 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-26T10:21:30.771 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-26T10:21:30.771 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-26T10:21:30.772 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-26T10:21:30.772 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-26T10:21:30.772 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-26T10:21:30.772 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-26T10:21:30.772 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cache_enabled": "true", 2024-04-26T10:21:30.772 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cache_expiry_interval": "900", 2024-04-26T10:21:30.772 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cache_lru_size": "10000", 2024-04-26T10:21:30.772 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_config_store": "rados", 2024-04-26T10:21:30.772 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_content_length_compat": "false", 2024-04-26T10:21:30.772 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_copy_obj_progress": "true", 2024-04-26T10:21:30.772 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-26T10:21:30.772 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cors_rules_max_num": "100", 2024-04-26T10:21:30.772 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_cross_domain_policy": "", 2024-04-26T10:21:30.772 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-26T10:21:30.773 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_addr": "", 2024-04-26T10:21:30.773 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-26T10:21:30.773 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-26T10:21:30.773 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-26T10:21:30.773 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-26T10:21:30.773 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_password": "", 2024-04-26T10:21:30.773 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-26T10:21:30.773 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_kmip_username": "", 2024-04-26T10:21:30.773 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_require_ssl": "true", 2024-04-26T10:21:30.773 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-26T10:21:30.773 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-26T10:21:30.773 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-26T10:21:30.773 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-26T10:21:30.773 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-26T10:21:30.774 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-26T10:21:30.774 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-26T10:21:30.774 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-26T10:21:30.774 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-26T10:21:30.774 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-26T10:21:30.774 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-26T10:21:30.774 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-26T10:21:30.774 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-26T10:21:30.774 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-26T10:21:30.774 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-26T10:21:30.774 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_addr": "", 2024-04-26T10:21:30.774 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_auth": "token", 2024-04-26T10:21:30.774 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_namespace": "", 2024-04-26T10:21:30.775 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_prefix": "", 2024-04-26T10:21:30.775 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-26T10:21:30.775 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-26T10:21:30.775 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-26T10:21:30.775 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-26T10:21:30.775 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_token_file": "", 2024-04-26T10:21:30.775 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-26T10:21:30.775 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_buffersize": "524288", 2024-04-26T10:21:30.775 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-26T10:21:30.775 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_low_speed_time": "300", 2024-04-26T10:21:30.775 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-26T10:21:30.775 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-26T10:21:30.775 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-26T10:21:30.776 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-26T10:21:30.776 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-26T10:21:30.776 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-26T10:21:30.776 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-26T10:21:30.776 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-26T10:21:30.776 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-26T10:21:30.776 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-26T10:21:30.776 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-26T10:21:30.776 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_log_changes_size": "1000", 2024-04-26T10:21:30.776 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_log_num_shards": "128", 2024-04-26T10:21:30.776 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-26T10:21:30.776 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_log_window": "30", 2024-04-26T10:21:30.776 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-26T10:21:30.776 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-26T10:21:30.776 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-26T10:21:30.777 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-26T10:21:30.777 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-26T10:21:30.777 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-26T10:21:30.777 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-26T10:21:30.777 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-26T10:21:30.777 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-26T10:21:30.777 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-26T10:21:30.777 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-26T10:21:30.777 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-26T10:21:30.777 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-26T10:21:30.777 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-26T10:21:30.777 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-26T10:21:30.777 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-26T10:21:30.778 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-26T10:21:30.778 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-26T10:21:30.778 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-26T10:21:30.778 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-26T10:21:30.778 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-26T10:21:30.778 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-26T10:21:30.778 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-26T10:21:30.778 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-26T10:21:30.778 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dns_name": "", 2024-04-26T10:21:30.778 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dns_s3website_name": "", 2024-04-26T10:21:30.778 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_dynamic_resharding": "true", 2024-04-26T10:21:30.778 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-26T10:21:30.778 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_gc_threads": "true", 2024-04-26T10:21:30.779 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_lc_threads": "true", 2024-04-26T10:21:30.779 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_ops_log": "false", 2024-04-26T10:21:30.779 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_quota_threads": "true", 2024-04-26T10:21:30.779 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_static_website": "false", 2024-04-26T10:21:30.779 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enable_usage_log": "false", 2024-04-26T10:21:30.779 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_enforce_swift_acls": "true", 2024-04-26T10:21:30.779 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_exit_timeout_secs": "120", 2024-04-26T10:21:30.779 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_expose_bucket": "false", 2024-04-26T10:21:30.779 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_extended_http_attrs": "", 2024-04-26T10:21:30.779 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_filter": "none", 2024-04-26T10:21:30.779 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-26T10:21:30.779 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_frontends": "beast port=7480", 2024-04-26T10:21:30.780 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-26T10:21:30.780 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_deferred": "50", 2024-04-26T10:21:30.780 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-26T10:21:30.780 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_objs": "32", 2024-04-26T10:21:30.780 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-26T10:21:30.780 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-26T10:21:30.780 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-26T10:21:30.780 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-26T10:21:30.780 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_gc_processor_period": "3600", 2024-04-26T10:21:30.780 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-26T10:21:30.780 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-26T10:21:30.780 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-26T10:21:30.780 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-26T10:21:30.780 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_init_timeout": "300", 2024-04-26T10:21:30.781 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-26T10:21:30.781 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-26T10:21:30.781 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-26T10:21:30.781 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-26T10:21:30.781 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_domain": "", 2024-04-26T10:21:30.781 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_password": "", 2024-04-26T10:21:30.781 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_password_path": "", 2024-04-26T10:21:30.781 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_project": "", 2024-04-26T10:21:30.781 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_tenant": "", 2024-04-26T10:21:30.781 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_token": "", 2024-04-26T10:21:30.781 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_token_path": "", 2024-04-26T10:21:30.781 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_admin_user": "", 2024-04-26T10:21:30.781 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_api_version": "2", 2024-04-26T10:21:30.782 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_domain": "", 2024-04-26T10:21:30.782 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_password": "", 2024-04-26T10:21:30.782 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_project": "", 2024-04-26T10:21:30.782 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-26T10:21:30.782 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_barbican_user": "", 2024-04-26T10:21:30.782 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-26T10:21:30.782 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-26T10:21:30.782 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-26T10:21:30.782 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-26T10:21:30.782 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-26T10:21:30.782 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_url": "", 2024-04-26T10:21:30.782 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-26T10:21:30.782 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_debug_interval": "-1", 2024-04-26T10:21:30.782 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_lock_max_time": "90", 2024-04-26T10:21:30.783 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_max_objs": "32", 2024-04-26T10:21:30.783 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_max_rules": "1000", 2024-04-26T10:21:30.783 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_max_worker": "3", 2024-04-26T10:21:30.783 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-26T10:21:30.783 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lc_thread_delay": "0", 2024-04-26T10:21:30.783 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-26T10:21:30.783 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_dnattr": "uid", 2024-04-26T10:21:30.783 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-26T10:21:30.783 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_searchfilter": "", 2024-04-26T10:21:30.783 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-26T10:21:30.783 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-26T10:21:30.783 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-26T10:21:30.783 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-26T10:21:30.783 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-26T10:21:30.784 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_log_http_headers": "", 2024-04-26T10:21:30.784 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-26T10:21:30.784 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-26T10:21:30.784 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_log_object_name_utc": "false", 2024-04-26T10:21:30.784 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-04-26T10:21:30.784 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_attr_name_len": "0", 2024-04-26T10:21:30.784 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_attr_size": "0", 2024-04-26T10:21:30.784 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-26T10:21:30.784 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_chunk_size": "4194304", 2024-04-26T10:21:30.784 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-26T10:21:30.784 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-26T10:21:30.784 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-26T10:21:30.784 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_listing_results": "1000", 2024-04-26T10:21:30.784 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_notify_retries": "10", 2024-04-26T10:21:30.785 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-26T10:21:30.785 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_put_param_size": "1048576", 2024-04-26T10:21:30.785 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_put_size": "5368709120", 2024-04-26T10:21:30.785 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_max_slo_entries": "1000", 2024-04-26T10:21:30.785 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_md_log_max_shards": "64", 2024-04-26T10:21:30.785 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-26T10:21:30.785 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-26T10:21:30.785 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-26T10:21:30.785 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-26T10:21:30.785 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_mp_lock_max_time": "600", 2024-04-26T10:21:30.785 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-26T10:21:30.785 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-26T10:21:30.785 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-26T10:21:30.786 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-26T10:21:30.786 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-26T10:21:30.786 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-26T10:21:30.786 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-26T10:21:30.786 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-26T10:21:30.786 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_max_gc": "300", 2024-04-26T10:21:30.786 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-26T10:21:30.786 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-26T10:21:30.786 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-26T10:21:30.786 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-26T10:21:30.786 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-26T10:21:30.786 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-26T10:21:30.786 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-26T10:21:30.787 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_num_async_rados_threads": "32", 2024-04-26T10:21:30.787 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_num_control_oids": "8", 2024-04-26T10:21:30.787 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_numa_node": "-1", 2024-04-26T10:21:30.787 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-26T10:21:30.787 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-26T10:21:30.787 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_objexp_chunk_size": "100", 2024-04-26T10:21:30.787 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_objexp_gc_interval": "600", 2024-04-26T10:21:30.787 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-26T10:21:30.787 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-26T10:21:30.787 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-26T10:21:30.787 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_op_thread_timeout": "600", 2024-04-26T10:21:30.787 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_op_tracing": "false", 2024-04-26T10:21:30.787 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_opa_token": "", 2024-04-26T10:21:30.788 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_opa_url": "", 2024-04-26T10:21:30.788 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_opa_verify_ssl": "true", 2024-04-26T10:21:30.788 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-26T10:21:30.788 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-26T10:21:30.788 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ops_log_rados": "false", 2024-04-26T10:21:30.788 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_ops_log_socket_path": "", 2024-04-26T10:21:30.788 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-26T10:21:30.788 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-26T10:21:30.788 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-26T10:21:30.788 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_period_push_interval": "2.000000", 2024-04-26T10:21:30.788 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-26T10:21:30.788 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-26T10:21:30.788 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-26T10:21:30.788 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_print_continue": "true", 2024-04-26T10:21:30.788 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-26T10:21:30.789 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-26T10:21:30.789 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-26T10:21:30.789 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-26T10:21:30.789 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-26T10:21:30.789 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_rados_tracing": "false", 2024-04-26T10:21:30.789 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_realm": "", 2024-04-26T10:21:30.789 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_realm_id": "", 2024-04-26T10:21:30.789 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-26T10:21:30.789 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_region": "", 2024-04-26T10:21:30.789 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-26T10:21:30.789 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-26T10:21:30.789 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-26T10:21:30.789 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-26T10:21:30.790 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_request_uri": "", 2024-04-26T10:21:30.790 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_batch_size": "64", 2024-04-26T10:21:30.790 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-26T10:21:30.790 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_max_aio": "128", 2024-04-26T10:21:30.790 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_num_logs": "16", 2024-04-26T10:21:30.790 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_reshard_thread_interval": "600", 2024-04-26T10:21:30.790 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_resolve_cname": "false", 2024-04-26T10:21:30.790 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-26T10:21:30.790 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_run_sync_thread": "true", 2024-04-26T10:21:30.790 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-26T10:21:30.790 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-26T10:21:30.790 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-26T10:21:30.790 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-26T10:21:30.791 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-26T10:21:30.791 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-26T10:21:30.791 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-26T10:21:30.791 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-26T10:21:30.791 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_scheduler_type": "throttler", 2024-04-26T10:21:30.791 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_script_uri": "", 2024-04-26T10:21:30.791 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_service_provider_name": "", 2024-04-26T10:21:30.791 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-26T10:21:30.791 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_client_id": "", 2024-04-26T10:21:30.791 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_client_secret": "", 2024-04-26T10:21:30.791 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_entry": "sts", 2024-04-26T10:21:30.791 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_key": "sts", 2024-04-26T10:21:30.791 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-26T10:21:30.792 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_min_session_duration": "900", 2024-04-26T10:21:30.792 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sts_token_introspection_url": "", 2024-04-26T10:21:30.792 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_account_in_url": "false", 2024-04-26T10:21:30.792 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_auth_entry": "auth", 2024-04-26T10:21:30.792 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_auth_url": "", 2024-04-26T10:21:30.792 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_custom_header": "", 2024-04-26T10:21:30.792 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-26T10:21:30.792 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_need_stats": "true", 2024-04-26T10:21:30.792 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_tenant_name": "", 2024-04-26T10:21:30.792 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_token_expiration": "86400", 2024-04-26T10:21:30.792 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_url": "", 2024-04-26T10:21:30.792 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_url_prefix": "swift", 2024-04-26T10:21:30.792 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-26T10:21:30.792 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-26T10:21:30.793 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-26T10:21:30.793 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_lease_period": "120", 2024-04-26T10:21:30.793 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-26T10:21:30.793 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-26T10:21:30.793 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-26T10:21:30.793 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-26T10:21:30.793 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-26T10:21:30.793 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-26T10:21:30.793 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-26T10:21:30.793 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-26T10:21:30.793 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-26T10:21:30.793 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_thread_pool_size": "512", 2024-04-26T10:21:30.793 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_comment": "", 2024-04-26T10:21:30.794 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_createby": "", 2024-04-26T10:21:30.794 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_encoding": "", 2024-04-26T10:21:30.794 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_flag": "false", 2024-04-26T10:21:30.794 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_origin": "", 2024-04-26T10:21:30.794 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-26T10:21:30.794 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_torrent_tracker": "", 2024-04-26T10:21:30.794 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_trust_forwarded_https": "false", 2024-04-26T10:21:30.794 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-26T10:21:30.794 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-26T10:21:30.794 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_usage_max_shards": "32", 2024-04-26T10:21:30.794 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_usage_max_user_shards": "1", 2024-04-26T10:21:30.794 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_use_opa_authz": "false", 2024-04-26T10:21:30.794 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-26T10:21:30.794 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-26T10:21:30.795 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_max_buckets": "1000", 2024-04-26T10:21:30.795 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_policies_max_num": "100", 2024-04-26T10:21:30.795 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-26T10:21:30.795 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-26T10:21:30.795 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-26T10:21:30.795 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-26T10:21:30.795 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_user_unique_email": "true", 2024-04-26T10:21:30.795 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_verify_ssl": "true", 2024-04-26T10:21:30.795 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-26T10:21:30.795 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zone": "", 2024-04-26T10:21:30.795 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zone_id": "", 2024-04-26T10:21:30.795 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-26T10:21:30.796 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zonegroup": "", 2024-04-26T10:21:30.796 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zonegroup_id": "", 2024-04-26T10:21:30.796 INFO:teuthology.orchestra.run.smithi052.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-26T10:21:30.796 INFO:teuthology.orchestra.run.smithi052.stdout: "rgwlc_auto_session_clear": "true", 2024-04-26T10:21:30.796 INFO:teuthology.orchestra.run.smithi052.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-26T10:21:30.796 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_block_size": "4096", 2024-04-26T10:21:30.796 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-26T10:21:30.796 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-26T10:21:30.796 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-26T10:21:30.796 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-26T10:21:30.796 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-26T10:21:30.796 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_size": "536870912", 2024-04-26T10:21:30.796 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-26T10:21:30.796 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-26T10:21:30.797 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-26T10:21:30.797 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-26T10:21:30.797 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-26T10:21:30.797 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-26T10:21:30.797 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-26T10:21:30.797 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-26T10:21:30.797 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_index_type": "binary_search", 2024-04-26T10:21:30.797 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-26T10:21:30.797 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-26T10:21:30.797 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_partition_filters": "false", 2024-04-26T10:21:30.797 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_perf": "false", 2024-04-26T10:21:30.797 INFO:teuthology.orchestra.run.smithi052.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-26T10:21:30.797 INFO:teuthology.orchestra.run.smithi052.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-26T10:21:30.798 INFO:teuthology.orchestra.run.smithi052.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-26T10:21:30.798 INFO:teuthology.orchestra.run.smithi052.stdout: "run_dir": "/var/run/ceph", 2024-04-26T10:21:30.798 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_block_create": "true", 2024-04-26T10:21:30.798 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_cache_lru_size": "67108864", 2024-04-26T10:21:30.798 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-26T10:21:30.798 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_default_max_object_size": "16777216", 2024-04-26T10:21:30.798 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-26T10:21:30.798 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_device_size": "53687091200", 2024-04-26T10:21:30.798 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_journal_batch_capacity": "16", 2024-04-26T10:21:30.798 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-26T10:21:30.798 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-26T10:21:30.798 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-26T10:21:30.798 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_main_device_type": "SSD", 2024-04-26T10:21:30.798 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-26T10:21:30.799 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-26T10:21:30.799 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-26T10:21:30.799 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-26T10:21:30.799 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-26T10:21:30.799 INFO:teuthology.orchestra.run.smithi052.stdout: "seastore_segment_size": "67108864", 2024-04-26T10:21:30.799 INFO:teuthology.orchestra.run.smithi052.stdout: "set_keepcaps": "false", 2024-04-26T10:21:30.799 INFO:teuthology.orchestra.run.smithi052.stdout: "setgroup": "", 2024-04-26T10:21:30.799 INFO:teuthology.orchestra.run.smithi052.stdout: "setuser": "", 2024-04-26T10:21:30.799 INFO:teuthology.orchestra.run.smithi052.stdout: "setuser_match_path": "", 2024-04-26T10:21:30.799 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-26T10:21:30.799 INFO:teuthology.orchestra.run.smithi052.stdout: "thp": "false", 2024-04-26T10:21:30.799 INFO:teuthology.orchestra.run.smithi052.stdout: "threadpool_default_timeout": "60", 2024-04-26T10:21:30.799 INFO:teuthology.orchestra.run.smithi052.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-26T10:21:30.800 INFO:teuthology.orchestra.run.smithi052.stdout: "throttler_perf_counter": "true" 2024-04-26T10:21:30.800 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-26T10:21:30.802 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-26T10:21:30.942 INFO:teuthology.orchestra.run.smithi052.stdout:mon.a: {} 2024-04-26T10:21:30.954 INFO:teuthology.orchestra.run.smithi052.stdout:mon.b: {} 2024-04-26T10:21:30.967 INFO:teuthology.orchestra.run.smithi052.stdout:mon.c: {} 2024-04-26T10:21:30.969 INFO:teuthology.orchestra.run.smithi052.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T10:21:30.969 INFO:teuthology.orchestra.run.smithi052.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T10:21:30.969 INFO:teuthology.orchestra.run.smithi052.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T10:21:30.980 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-26T10:21:30.981 INFO:teuthology.run_tasks:Running task radosbench... 2024-04-26T10:21:30.992 INFO:tasks.radosbench:Beginning radosbench... 2024-04-26T10:21:30.992 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-04-26T10:21:30.993 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-04-26T10:21:30.993 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-26T10:21:30.994 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:21:30.994 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:21:30.994 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-26T10:21:30.994 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.000000 2024-04-26T10:21:30.994 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0 2024-04-26T10:21:30.995 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-26T10:21:30.995 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-26T10:21:30.995 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:21:30.995 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-26T10:21:30.996 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:30.996 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-26T10:21:30.996 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:21:30.998 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:30.993+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:31.097 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:31.097+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:31.114 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:21:31.114 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-04-26T10:21:31.114 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:31.124 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:31.181 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:21:31.197 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:31.193+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:31.217 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:21:31.238 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:31.238 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:31.246 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T10:21:31.247 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:31.248 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:21:31.248 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:21:31.248 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:21:31.299 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:31.297+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:31.356 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:31.356 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:31.364 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:31.411 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:31.409+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:31.480 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:31.480 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:31.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:31.501 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:31.497+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:31.525 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'unique_pool_0' created 2024-04-26T10:21:31.525 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T10:21:31.527 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.1 primary-affinity to 0 (802) 2024-04-26T10:21:31.538 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-04-26T10:21:31.597 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:31.597 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:31.602 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:31.597+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:31.607 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:31.703 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:31.701+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:31.760 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:31.760 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:31.770 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:21:31.804 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:31.800+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:31.881 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:31.882 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:31.892 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:21:31.905 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:31.901+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:32.002 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:32.002 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:32.006 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:32.005+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:32.012 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:21:32.107 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:32.105+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:32.121 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:32.121 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:32.131 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:32.207 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:32.204+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:32.250 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:32.250 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:32.261 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:32.309 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:32.309+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:32.364 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:32.364 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:32.373 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:32.409 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:32.409+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:32.479 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:32.480 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:32.489 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:32.510 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:32.505+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:32.531 INFO:teuthology.orchestra.run.smithi052.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-04-26T10:21:32.610 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:32.610 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:32.611 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:32.605+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:32.619 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:32.711 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:32.709+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:32.719 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:32.719 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:32.728 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:32.812 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:32.809+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:32.837 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:32.837 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:32.846 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:21:32.914 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:32.909+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:32.963 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:32.964 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:32.974 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:21:33.014 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:33.009+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:33.085 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:33.085 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:33.095 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:21:33.115 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:33.112+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:33.196 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:33.196 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:33.206 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:33.216 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:33.212+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:33.262 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:21:33.317 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:33.312+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:33.324 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:33.324 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:33.335 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:33.418 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:33.413+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:33.418 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:21:33.437 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:33.437 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:21:33.437 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:21:33.437 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:21:33.437 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:33.442 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:21:33.447 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:33.464 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T10:21:33.467 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:21:33.467 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:21:33.467 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:21:33.519 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:33.516+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:33.540 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:21:33.545 DEBUG:teuthology.orchestra.run.smithi052:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 60 write' 2024-04-26T10:21:33.547 INFO:teuthology.run_tasks:Running task admin_socket... 2024-04-26T10:21:33.558 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2024-04-26T10:21:33.558 DEBUG:teuthology.orchestra.run.smithi052:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2024-04-26T10:21:33.563 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:33.563 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:21:33.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:21:33.564 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:33.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.564 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.564 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:33.564 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.319901090999998, 2024-04-26T10:21:33.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015326892, 2024-04-26T10:21:33.564 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.564 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.564 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.564 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.564 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.564 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 112 2024-04-26T10:21:33.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.564 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:33.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:33.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238644+0000", 2024-04-26T10:21:33.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:33.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238792+0000", 2024-04-26T10:21:33.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775699999999999 2024-04-26T10:21:33.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238811+0000", 2024-04-26T10:21:33.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8359000000000002e-05 2024-04-26T10:21:33.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238887+0000", 2024-04-26T10:21:33.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6909000000000005e-05 2024-04-26T10:21:33.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248433+0000", 2024-04-26T10:21:33.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095455650000000006 2024-04-26T10:21:33.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248564+0000", 2024-04-26T10:21:33.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131273 2024-04-26T10:21:33.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248795+0000", 2024-04-26T10:21:33.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023073500000000001 2024-04-26T10:21:33.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251497+0000", 2024-04-26T10:21:33.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002701976 2024-04-26T10:21:33.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253894+0000", 2024-04-26T10:21:33.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023967429999999998 2024-04-26T10:21:33.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253937+0000", 2024-04-26T10:21:33.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3006999999999997e-05 2024-04-26T10:21:33.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253972+0000", 2024-04-26T10:21:33.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5388000000000001e-05 2024-04-26T10:21:33.570 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.570 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.570 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.570 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.570 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:33.570 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.319647193000002, 2024-04-26T10:21:33.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016304328, 2024-04-26T10:21:33.570 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.570 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.570 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.570 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.571 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.571 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113 2024-04-26T10:21:33.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.571 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:33.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:33.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238898+0000", 2024-04-26T10:21:33.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:33.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238920+0000", 2024-04-26T10:21:33.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2056999999999999e-05 2024-04-26T10:21:33.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238937+0000", 2024-04-26T10:21:33.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6415000000000001e-05 2024-04-26T10:21:33.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238948+0000", 2024-04-26T10:21:33.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.11e-05 2024-04-26T10:21:33.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250527+0000", 2024-04-26T10:21:33.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011578662 2024-04-26T10:21:33.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250627+0000", 2024-04-26T10:21:33.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100418 2024-04-26T10:21:33.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250769+0000", 2024-04-26T10:21:33.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142111 2024-04-26T10:21:33.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253884+0000", 2024-04-26T10:21:33.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031148399999999998 2024-04-26T10:21:33.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254994+0000", 2024-04-26T10:21:33.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011095720000000001 2024-04-26T10:21:33.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255094+0000", 2024-04-26T10:21:33.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010092 2024-04-26T10:21:33.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255203+0000", 2024-04-26T10:21:33.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010906 2024-04-26T10:21:33.576 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.576 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.576 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.576 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.576 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:33.577 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.319589658000002, 2024-04-26T10:21:33.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016378984999999999, 2024-04-26T10:21:33.577 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.577 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.577 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 114 2024-04-26T10:21:33.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.577 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:33.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:33.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238956+0000", 2024-04-26T10:21:33.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:33.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238965+0000", 2024-04-26T10:21:33.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9469999999999992e-06 2024-04-26T10:21:33.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238993+0000", 2024-04-26T10:21:33.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8296000000000001e-05 2024-04-26T10:21:33.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239004+0000", 2024-04-26T10:21:33.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0482999999999999e-05 2024-04-26T10:21:33.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251532+0000", 2024-04-26T10:21:33.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01252852 2024-04-26T10:21:33.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251622+0000", 2024-04-26T10:21:33.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0044999999999996e-05 2024-04-26T10:21:33.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251763+0000", 2024-04-26T10:21:33.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140634 2024-04-26T10:21:33.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254035+0000", 2024-04-26T10:21:33.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022721320000000001 2024-04-26T10:21:33.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255220+0000", 2024-04-26T10:21:33.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011853059999999999 2024-04-26T10:21:33.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255301+0000", 2024-04-26T10:21:33.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0253999999999994e-05 2024-04-26T10:21:33.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255336+0000", 2024-04-26T10:21:33.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5098000000000002e-05 2024-04-26T10:21:33.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.582 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.582 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.582 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:33.582 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.319527708999999, 2024-04-26T10:21:33.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018452342, 2024-04-26T10:21:33.583 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.583 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.583 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115 2024-04-26T10:21:33.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.583 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:33.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:33.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239018+0000", 2024-04-26T10:21:33.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:33.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239152+0000", 2024-04-26T10:21:33.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414699999999999 2024-04-26T10:21:33.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239169+0000", 2024-04-26T10:21:33.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7013000000000001e-05 2024-04-26T10:21:33.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239190+0000", 2024-04-26T10:21:33.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1302999999999999e-05 2024-04-26T10:21:33.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252181+0000", 2024-04-26T10:21:33.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012990213 2024-04-26T10:21:33.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252411+0000", 2024-04-26T10:21:33.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023010199999999999 2024-04-26T10:21:33.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252687+0000", 2024-04-26T10:21:33.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000276063 2024-04-26T10:21:33.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254694+0000", 2024-04-26T10:21:33.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020072879999999999 2024-04-26T10:21:33.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257399+0000", 2024-04-26T10:21:33.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027051670000000001 2024-04-26T10:21:33.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257442+0000", 2024-04-26T10:21:33.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-04-26T10:21:33.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257471+0000", 2024-04-26T10:21:33.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.889e-05 2024-04-26T10:21:33.587 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.587 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.588 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.588 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.588 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:33.588 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.319347180000001, 2024-04-26T10:21:33.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018350615000000001, 2024-04-26T10:21:33.588 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.588 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.588 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.588 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.588 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.588 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116 2024-04-26T10:21:33.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.589 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:33.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:33.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239198+0000", 2024-04-26T10:21:33.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:33.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239213+0000", 2024-04-26T10:21:33.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4965e-05 2024-04-26T10:21:33.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239235+0000", 2024-04-26T10:21:33.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.156e-05 2024-04-26T10:21:33.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239243+0000", 2024-04-26T10:21:33.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9470000000000003e-06 2024-04-26T10:21:33.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253284+0000", 2024-04-26T10:21:33.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014041392999999999 2024-04-26T10:21:33.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253376+0000", 2024-04-26T10:21:33.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1198000000000003e-05 2024-04-26T10:21:33.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253508+0000", 2024-04-26T10:21:33.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013220199999999999 2024-04-26T10:21:33.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255474+0000", 2024-04-26T10:21:33.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019665590000000001 2024-04-26T10:21:33.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257480+0000", 2024-04-26T10:21:33.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00200599 2024-04-26T10:21:33.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257515+0000", 2024-04-26T10:21:33.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5126000000000002e-05 2024-04-26T10:21:33.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257550+0000", 2024-04-26T10:21:33.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4394000000000003e-05 2024-04-26T10:21:33.593 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.594 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.594 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.594 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:33.594 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.319293624, 2024-04-26T10:21:33.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018369330999999999, 2024-04-26T10:21:33.594 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.594 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.594 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.595 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117 2024-04-26T10:21:33.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.595 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:33.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:33.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239252+0000", 2024-04-26T10:21:33.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:33.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239267+0000", 2024-04-26T10:21:33.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4562999999999999e-05 2024-04-26T10:21:33.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239281+0000", 2024-04-26T10:21:33.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4e-05 2024-04-26T10:21:33.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239296+0000", 2024-04-26T10:21:33.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5492999999999999e-05 2024-04-26T10:21:33.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254076+0000", 2024-04-26T10:21:33.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014779814 2024-04-26T10:21:33.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254159+0000", 2024-04-26T10:21:33.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2923999999999994e-05 2024-04-26T10:21:33.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254279+0000", 2024-04-26T10:21:33.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011964300000000001 2024-04-26T10:21:33.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.256043+0000", 2024-04-26T10:21:33.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001764353 2024-04-26T10:21:33.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257559+0000", 2024-04-26T10:21:33.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015159189999999999 2024-04-26T10:21:33.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257597+0000", 2024-04-26T10:21:33.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8031999999999998e-05 2024-04-26T10:21:33.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257622+0000", 2024-04-26T10:21:33.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5213999999999999e-05 2024-04-26T10:21:33.600 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.600 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.600 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.600 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.600 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.451165+0000", 2024-04-26T10:21:33.600 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.107381704000002, 2024-04-26T10:21:33.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013622911, 2024-04-26T10:21:33.600 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.601 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.601 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.601 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.601 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.601 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 139 2024-04-26T10:21:33.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.601 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451165+0000", 2024-04-26T10:21:33.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451165+0000", 2024-04-26T10:21:33.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451164+0000", 2024-04-26T10:21:33.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:33.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451170+0000", 2024-04-26T10:21:33.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-04-26T10:21:33.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451178+0000", 2024-04-26T10:21:33.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8499999999999994e-06 2024-04-26T10:21:33.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451185+0000", 2024-04-26T10:21:33.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8889999999999996e-06 2024-04-26T10:21:33.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.462110+0000", 2024-04-26T10:21:33.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01092576 2024-04-26T10:21:33.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.462160+0000", 2024-04-26T10:21:33.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9838e-05 2024-04-26T10:21:33.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.462240+0000", 2024-04-26T10:21:33.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9406999999999994e-05 2024-04-26T10:21:33.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.464319+0000", 2024-04-26T10:21:33.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020796349999999998 2024-04-26T10:21:33.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.464688+0000", 2024-04-26T10:21:33.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036927800000000001 2024-04-26T10:21:33.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.464756+0000", 2024-04-26T10:21:33.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7648e-05 2024-04-26T10:21:33.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.464788+0000", 2024-04-26T10:21:33.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1418999999999999e-05 2024-04-26T10:21:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.451210+0000", 2024-04-26T10:21:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.107336584999999, 2024-04-26T10:21:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014337409000000001, 2024-04-26T10:21:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 140 2024-04-26T10:21:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451210+0000", 2024-04-26T10:21:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451210+0000", 2024-04-26T10:21:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451209+0000", 2024-04-26T10:21:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451330+0000", 2024-04-26T10:21:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012056 2024-04-26T10:21:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451341+0000", 2024-04-26T10:21:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1044e-05 2024-04-26T10:21:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451348+0000", 2024-04-26T10:21:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8630000000000008e-06 2024-04-26T10:21:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.462680+0000", 2024-04-26T10:21:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011331681999999999 2024-04-26T10:21:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.462776+0000", 2024-04-26T10:21:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5997999999999998e-05 2024-04-26T10:21:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.462903+0000", 2024-04-26T10:21:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012640000000000001 2024-04-26T10:21:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.464325+0000", 2024-04-26T10:21:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014219479999999999 2024-04-26T10:21:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.465495+0000", 2024-04-26T10:21:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001170433 2024-04-26T10:21:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.465526+0000", 2024-04-26T10:21:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1279000000000003e-05 2024-04-26T10:21:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.465547+0000", 2024-04-26T10:21:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0945e-05 2024-04-26T10:21:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.107189248000001, 2024-04-26T10:21:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015980181999999999, 2024-04-26T10:21:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 141 2024-04-26T10:21:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451356+0000", 2024-04-26T10:21:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451362+0000", 2024-04-26T10:21:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:21:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451371+0000", 2024-04-26T10:21:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1829999999999994e-06 2024-04-26T10:21:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451377+0000", 2024-04-26T10:21:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7599999999999997e-06 2024-04-26T10:21:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463727+0000", 2024-04-26T10:21:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012349646000000001 2024-04-26T10:21:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463780+0000", 2024-04-26T10:21:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2645999999999997e-05 2024-04-26T10:21:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463874+0000", 2024-04-26T10:21:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4097000000000004e-05 2024-04-26T10:21:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.466138+0000", 2024-04-26T10:21:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022642690000000002 2024-04-26T10:21:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467281+0000", 2024-04-26T10:21:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011428510000000001 2024-04-26T10:21:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467315+0000", 2024-04-26T10:21:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4032999999999998e-05 2024-04-26T10:21:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467337+0000", 2024-04-26T10:21:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2444000000000001e-05 2024-04-26T10:21:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649566+0000", 2024-04-26T10:21:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.908980101000001, 2024-04-26T10:21:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014850079, 2024-04-26T10:21:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 161 2024-04-26T10:21:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649566+0000", 2024-04-26T10:21:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649566+0000", 2024-04-26T10:21:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649565+0000", 2024-04-26T10:21:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649700+0000", 2024-04-26T10:21:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013546399999999999 2024-04-26T10:21:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649733+0000", 2024-04-26T10:21:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2382000000000003e-05 2024-04-26T10:21:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649747+0000", 2024-04-26T10:21:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.472e-05 2024-04-26T10:21:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.659036+0000", 2024-04-26T10:21:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092889830000000007 2024-04-26T10:21:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.659148+0000", 2024-04-26T10:21:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111927 2024-04-26T10:21:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.659336+0000", 2024-04-26T10:21:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187636 2024-04-26T10:21:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664235+0000", 2024-04-26T10:21:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048993919999999998 2024-04-26T10:21:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664324+0000", 2024-04-26T10:21:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9038999999999999e-05 2024-04-26T10:21:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664378+0000", 2024-04-26T10:21:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4008999999999997e-05 2024-04-26T10:21:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664416+0000", 2024-04-26T10:21:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7914000000000003e-05 2024-04-26T10:21:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649768+0000", 2024-04-26T10:21:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.908778799, 2024-04-26T10:21:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014901464999999999, 2024-04-26T10:21:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162 2024-04-26T10:21:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649768+0000", 2024-04-26T10:21:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649768+0000", 2024-04-26T10:21:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649766+0000", 2024-04-26T10:21:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649774+0000", 2024-04-26T10:21:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:21:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649789+0000", 2024-04-26T10:21:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5486e-05 2024-04-26T10:21:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649797+0000", 2024-04-26T10:21:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3200000000000002e-06 2024-04-26T10:21:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.660742+0000", 2024-04-26T10:21:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010945636999999999 2024-04-26T10:21:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.660872+0000", 2024-04-26T10:21:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013026699999999999 2024-04-26T10:21:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.661064+0000", 2024-04-26T10:21:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000191628 2024-04-26T10:21:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664490+0000", 2024-04-26T10:21:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034262369999999999 2024-04-26T10:21:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664503+0000", 2024-04-26T10:21:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2595999999999999e-05 2024-04-26T10:21:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664558+0000", 2024-04-26T10:21:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4985000000000003e-05 2024-04-26T10:21:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664669+0000", 2024-04-26T10:21:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111119 2024-04-26T10:21:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.908740677000001, 2024-04-26T10:21:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015587541, 2024-04-26T10:21:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 163 2024-04-26T10:21:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649805+0000", 2024-04-26T10:21:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649813+0000", 2024-04-26T10:21:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3319999999999992e-06 2024-04-26T10:21:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649851+0000", 2024-04-26T10:21:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7852999999999998e-05 2024-04-26T10:21:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649865+0000", 2024-04-26T10:21:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3626e-05 2024-04-26T10:21:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662071+0000", 2024-04-26T10:21:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01220689 2024-04-26T10:21:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662210+0000", 2024-04-26T10:21:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013893 2024-04-26T10:21:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662397+0000", 2024-04-26T10:21:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018690499999999999 2024-04-26T10:21:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664685+0000", 2024-04-26T10:21:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022876179999999999 2024-04-26T10:21:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665327+0000", 2024-04-26T10:21:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00064178900000000003 2024-04-26T10:21:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665365+0000", 2024-04-26T10:21:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8244999999999997e-05 2024-04-26T10:21:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665393+0000", 2024-04-26T10:21:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8232e-05 2024-04-26T10:21:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.908666030999999, 2024-04-26T10:21:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016970263999999999, 2024-04-26T10:21:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 164 2024-04-26T10:21:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649879+0000", 2024-04-26T10:21:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649963+0000", 2024-04-26T10:21:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4141999999999995e-05 2024-04-26T10:21:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649975+0000", 2024-04-26T10:21:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1416e-05 2024-04-26T10:21:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649983+0000", 2024-04-26T10:21:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8469999999999996e-06 2024-04-26T10:21:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662854+0000", 2024-04-26T10:21:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012871871999999999 2024-04-26T10:21:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662965+0000", 2024-04-26T10:21:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110413 2024-04-26T10:21:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.663109+0000", 2024-04-26T10:21:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144115 2024-04-26T10:21:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665992+0000", 2024-04-26T10:21:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028827340000000001 2024-04-26T10:21:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666784+0000", 2024-04-26T10:21:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00079253799999999997 2024-04-26T10:21:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666824+0000", 2024-04-26T10:21:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0139000000000003e-05 2024-04-26T10:21:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666851+0000", 2024-04-26T10:21:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6171999999999999e-05 2024-04-26T10:21:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.908554950999999, 2024-04-26T10:21:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019547338000000001, 2024-04-26T10:21:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165 2024-04-26T10:21:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649996+0000", 2024-04-26T10:21:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-04-26T10:21:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650021+0000", 2024-04-26T10:21:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5179999999999999e-05 2024-04-26T10:21:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650030+0000", 2024-04-26T10:21:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-04-26T10:21:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664733+0000", 2024-04-26T10:21:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014703097 2024-04-26T10:21:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664821+0000", 2024-04-26T10:21:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7918999999999996e-05 2024-04-26T10:21:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664953+0000", 2024-04-26T10:21:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132662 2024-04-26T10:21:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666776+0000", 2024-04-26T10:21:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018225509999999999 2024-04-26T10:21:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669480+0000", 2024-04-26T10:21:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00270382 2024-04-26T10:21:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669515+0000", 2024-04-26T10:21:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4885000000000002e-05 2024-04-26T10:21:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669539+0000", 2024-04-26T10:21:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4121000000000002e-05 2024-04-26T10:21:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.719060871, 2024-04-26T10:21:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015260631, 2024-04-26T10:21:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 184 2024-04-26T10:21:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839493+0000", 2024-04-26T10:21:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7300000000000005e-06 2024-04-26T10:21:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839501+0000", 2024-04-26T10:21:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2940000000000006e-06 2024-04-26T10:21:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839508+0000", 2024-04-26T10:21:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6660000000000002e-06 2024-04-26T10:21:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.849315+0000", 2024-04-26T10:21:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098072650000000008 2024-04-26T10:21:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.849564+0000", 2024-04-26T10:21:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024928800000000002 2024-04-26T10:21:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.849772+0000", 2024-04-26T10:21:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020795199999999999 2024-04-26T10:21:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853646+0000", 2024-04-26T10:21:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038744090000000001 2024-04-26T10:21:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854530+0000", 2024-04-26T10:21:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00088391200000000004 2024-04-26T10:21:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854623+0000", 2024-04-26T10:21:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2229000000000001e-05 2024-04-26T10:21:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854746+0000", 2024-04-26T10:21:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012354299999999999 2024-04-26T10:21:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.719031842, 2024-04-26T10:21:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017833541000000001, 2024-04-26T10:21:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185 2024-04-26T10:21:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839514+0000", 2024-04-26T10:21:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839612+0000", 2024-04-26T10:21:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7880999999999993e-05 2024-04-26T10:21:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839623+0000", 2024-04-26T10:21:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0917000000000001e-05 2024-04-26T10:21:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839632+0000", 2024-04-26T10:21:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0999999999999993e-06 2024-04-26T10:21:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850382+0000", 2024-04-26T10:21:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010750335 2024-04-26T10:21:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850502+0000", 2024-04-26T10:21:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120183 2024-04-26T10:21:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850685+0000", 2024-04-26T10:21:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000182442 2024-04-26T10:21:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854396+0000", 2024-04-26T10:21:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037114819999999999 2024-04-26T10:21:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857233+0000", 2024-04-26T10:21:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002836514 2024-04-26T10:21:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857300+0000", 2024-04-26T10:21:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6842999999999997e-05 2024-04-26T10:21:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857348+0000", 2024-04-26T10:21:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8504000000000002e-05 2024-04-26T10:21:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.718905491000001, 2024-04-26T10:21:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018757273000000001, 2024-04-26T10:21:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 186 2024-04-26T10:21:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839640+0000", 2024-04-26T10:21:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839646+0000", 2024-04-26T10:21:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:21:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839654+0000", 2024-04-26T10:21:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:21:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839661+0000", 2024-04-26T10:21:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.64e-06 2024-04-26T10:21:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852328+0000", 2024-04-26T10:21:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012667151 2024-04-26T10:21:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852538+0000", 2024-04-26T10:21:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020961100000000001 2024-04-26T10:21:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852945+0000", 2024-04-26T10:21:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040712099999999998 2024-04-26T10:21:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857372+0000", 2024-04-26T10:21:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044268049999999998 2024-04-26T10:21:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858321+0000", 2024-04-26T10:21:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094932999999999997 2024-04-26T10:21:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858367+0000", 2024-04-26T10:21:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5534000000000001e-05 2024-04-26T10:21:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858398+0000", 2024-04-26T10:21:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1562e-05 2024-04-26T10:21:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.718878324999999, 2024-04-26T10:21:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019669504000000001, 2024-04-26T10:21:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187 2024-04-26T10:21:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839667+0000", 2024-04-26T10:21:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839677+0000", 2024-04-26T10:21:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3270000000000007e-06 2024-04-26T10:21:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839685+0000", 2024-04-26T10:21:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2670000000000006e-06 2024-04-26T10:21:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839692+0000", 2024-04-26T10:21:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7129999999999999e-06 2024-04-26T10:21:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853685+0000", 2024-04-26T10:21:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013993716999999999 2024-04-26T10:21:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853876+0000", 2024-04-26T10:21:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019097100000000001 2024-04-26T10:21:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853989+0000", 2024-04-26T10:21:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011275199999999999 2024-04-26T10:21:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857377+0000", 2024-04-26T10:21:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033882489999999999 2024-04-26T10:21:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859222+0000", 2024-04-26T10:21:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001844233 2024-04-26T10:21:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859291+0000", 2024-04-26T10:21:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:21:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859338+0000", 2024-04-26T10:21:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6366000000000003e-05 2024-04-26T10:21:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.718847458999999, 2024-04-26T10:21:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019837468, 2024-04-26T10:21:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 188 2024-04-26T10:21:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839698+0000", 2024-04-26T10:21:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839829+0000", 2024-04-26T10:21:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013061099999999999 2024-04-26T10:21:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839853+0000", 2024-04-26T10:21:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3736000000000001e-05 2024-04-26T10:21:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839863+0000", 2024-04-26T10:21:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854869+0000", 2024-04-26T10:21:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015005978 2024-04-26T10:21:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854959+0000", 2024-04-26T10:21:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9468999999999993e-05 2024-04-26T10:21:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855114+0000", 2024-04-26T10:21:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015563799999999999 2024-04-26T10:21:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857386+0000", 2024-04-26T10:21:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002271852 2024-04-26T10:21:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859406+0000", 2024-04-26T10:21:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002019936 2024-04-26T10:21:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859461+0000", 2024-04-26T10:21:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4826e-05 2024-04-26T10:21:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859536+0000", 2024-04-26T10:21:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5566000000000001e-05 2024-04-26T10:21:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.718673595999999, 2024-04-26T10:21:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019826496999999998, 2024-04-26T10:21:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 189 2024-04-26T10:21:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839872+0000", 2024-04-26T10:21:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839882+0000", 2024-04-26T10:21:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839892+0000", 2024-04-26T10:21:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.217e-06 2024-04-26T10:21:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839900+0000", 2024-04-26T10:21:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5469999999999997e-06 2024-04-26T10:21:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855903+0000", 2024-04-26T10:21:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016002590000000001 2024-04-26T10:21:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856110+0000", 2024-04-26T10:21:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020711199999999999 2024-04-26T10:21:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856421+0000", 2024-04-26T10:21:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031128500000000001 2024-04-26T10:21:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857643+0000", 2024-04-26T10:21:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012215520000000001 2024-04-26T10:21:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859603+0000", 2024-04-26T10:21:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019600350000000002 2024-04-26T10:21:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859660+0000", 2024-04-26T10:21:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6857999999999997e-05 2024-04-26T10:21:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859699+0000", 2024-04-26T10:21:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9641999999999998e-05 2024-04-26T10:21:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:33.684 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:33.686 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:hints = 1 2024-04-26T10:21:33.686 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 60 seconds or 0 objects 2024-04-26T10:21:33.686 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Object prefix: benchmark_data_smithi052_19421 2024-04-26T10:21:33.686 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-26T10:21:33.686 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 0 0 0 0 0 0 - 0 2024-04-26T10:21:33.687 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:33.687 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:33.681+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:33.787 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:33.784+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:33.815 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:33.815 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:21:33.815 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T10:21:33.815 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:33.826 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:33.887 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:33.884+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:33.946 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:33.946 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:21:33.946 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:21:33.946 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:21:33.946 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:33.957 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:33.988 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:33.984+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:34.082 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:34.082 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:21:34.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:21:34.082 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:34.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.082 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:34.082 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:34.082 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.778428418000001, 2024-04-26T10:21:34.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018441564000000001, 2024-04-26T10:21:34.083 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.083 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.083 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:34.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:34.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301372+0000", 2024-04-26T10:21:34.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:34.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301399+0000", 2024-04-26T10:21:34.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7039999999999999e-05 2024-04-26T10:21:34.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301426+0000", 2024-04-26T10:21:34.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6381e-05 2024-04-26T10:21:34.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301480+0000", 2024-04-26T10:21:34.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3681000000000003e-05 2024-04-26T10:21:34.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310584+0000", 2024-04-26T10:21:34.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091042339999999992 2024-04-26T10:21:34.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:34.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310591+0000", 2024-04-26T10:21:34.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8190000000000003e-06 2024-04-26T10:21:34.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311503+0000", 2024-04-26T10:21:34.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000911983 2024-04-26T10:21:34.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311605+0000", 2024-04-26T10:21:34.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102619 2024-04-26T10:21:34.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:34.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311730+0000", 2024-04-26T10:21:34.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012474400000000001 2024-04-26T10:21:34.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:34.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317287+0000", 2024-04-26T10:21:34.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055571140000000002 2024-04-26T10:21:34.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319724+0000", 2024-04-26T10:21:34.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002437294 2024-04-26T10:21:34.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319776+0000", 2024-04-26T10:21:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1992e-05 2024-04-26T10:21:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319816+0000", 2024-04-26T10:21:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9709999999999998e-05 2024-04-26T10:21:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.1e epoch 20/18 rep_tid 1 entries 20'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:21:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306447+0000", 2024-04-26T10:21:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.773356137, 2024-04-26T10:21:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094811170000000007, 2024-04-26T10:21:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T10:21:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306447+0000", 2024-04-26T10:21:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306447+0000", 2024-04-26T10:21:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306446+0000", 2024-04-26T10:21:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306456+0000", 2024-04-26T10:21:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6139999999999998e-06 2024-04-26T10:21:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306471+0000", 2024-04-26T10:21:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5167000000000001e-05 2024-04-26T10:21:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306486+0000", 2024-04-26T10:21:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.521e-05 2024-04-26T10:21:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308601+0000", 2024-04-26T10:21:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021147869999999999 2024-04-26T10:21:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315928+0000", 2024-04-26T10:21:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073266219999999996 2024-04-26T10:21:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.773112552000001, 2024-04-26T10:21:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013786338, 2024-04-26T10:21:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306689+0000", 2024-04-26T10:21:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306697+0000", 2024-04-26T10:21:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2420000000000003e-06 2024-04-26T10:21:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306725+0000", 2024-04-26T10:21:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8209e-05 2024-04-26T10:21:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306750+0000", 2024-04-26T10:21:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5432e-05 2024-04-26T10:21:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310622+0000", 2024-04-26T10:21:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003871738 2024-04-26T10:21:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:21:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310627+0000", 2024-04-26T10:21:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4890000000000003e-06 2024-04-26T10:21:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314030+0000", 2024-04-26T10:21:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003402094 2024-04-26T10:21:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314147+0000", 2024-04-26T10:21:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011776499999999999 2024-04-26T10:21:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314441+0000", 2024-04-26T10:21:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000293543 2024-04-26T10:21:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319422+0000", 2024-04-26T10:21:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004981096 2024-04-26T10:21:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320057+0000", 2024-04-26T10:21:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000635521 2024-04-26T10:21:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320110+0000", 2024-04-26T10:21:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2104999999999997e-05 2024-04-26T10:21:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320477+0000", 2024-04-26T10:21:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036709500000000001 2024-04-26T10:21:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.773019190999999, 2024-04-26T10:21:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013859405999999999, 2024-04-26T10:21:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306783+0000", 2024-04-26T10:21:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306788+0000", 2024-04-26T10:21:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3990000000000003e-06 2024-04-26T10:21:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306796+0000", 2024-04-26T10:21:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8820000000000001e-06 2024-04-26T10:21:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306803+0000", 2024-04-26T10:21:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6649999999999997e-06 2024-04-26T10:21:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314454+0000", 2024-04-26T10:21:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076508349999999999 2024-04-26T10:21:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314930+0000", 2024-04-26T10:21:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047624199999999998 2024-04-26T10:21:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315127+0000", 2024-04-26T10:21:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196751 2024-04-26T10:21:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320496+0000", 2024-04-26T10:21:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053690150000000004 2024-04-26T10:21:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320576+0000", 2024-04-26T10:21:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0327999999999994e-05 2024-04-26T10:21:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320611+0000", 2024-04-26T10:21:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-04-26T10:21:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320643+0000", 2024-04-26T10:21:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2474000000000001e-05 2024-04-26T10:21:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.77294002, 2024-04-26T10:21:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013889195, 2024-04-26T10:21:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306862+0000", 2024-04-26T10:21:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306867+0000", 2024-04-26T10:21:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5390000000000001e-06 2024-04-26T10:21:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306874+0000", 2024-04-26T10:21:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7549999999999997e-06 2024-04-26T10:21:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306887+0000", 2024-04-26T10:21:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.313e-05 2024-04-26T10:21:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315477+0000", 2024-04-26T10:21:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085902489999999995 2024-04-26T10:21:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315607+0000", 2024-04-26T10:21:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129789 2024-04-26T10:21:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315767+0000", 2024-04-26T10:21:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016052699999999999 2024-04-26T10:21:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320502+0000", 2024-04-26T10:21:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00473421 2024-04-26T10:21:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320691+0000", 2024-04-26T10:21:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018938900000000001 2024-04-26T10:21:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320721+0000", 2024-04-26T10:21:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9677000000000001e-05 2024-04-26T10:21:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320752+0000", 2024-04-26T10:21:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1486000000000003e-05 2024-04-26T10:21:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.772902102, 2024-04-26T10:21:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012590871, 2024-04-26T10:21:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306900+0000", 2024-04-26T10:21:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306905+0000", 2024-04-26T10:21:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9010000000000002e-06 2024-04-26T10:21:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306911+0000", 2024-04-26T10:21:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6030000000000004e-06 2024-04-26T10:21:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306916+0000", 2024-04-26T10:21:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8539999999999996e-06 2024-04-26T10:21:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308529+0000", 2024-04-26T10:21:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001613258 2024-04-26T10:21:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308537+0000", 2024-04-26T10:21:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1680000000000004e-06 2024-04-26T10:21:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311962+0000", 2024-04-26T10:21:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034247290000000001 2024-04-26T10:21:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.312092+0000", 2024-04-26T10:21:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013048700000000001 2024-04-26T10:21:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.312438+0000", 2024-04-26T10:21:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00034558700000000001 2024-04-26T10:21:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317984+0000", 2024-04-26T10:21:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005546067 2024-04-26T10:21:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319373+0000", 2024-04-26T10:21:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001389426 2024-04-26T10:21:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319438+0000", 2024-04-26T10:21:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4849000000000002e-05 2024-04-26T10:21:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319492+0000", 2024-04-26T10:21:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3554000000000003e-05 2024-04-26T10:21:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.771231519000001, 2024-04-26T10:21:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011321652999999999, 2024-04-26T10:21:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308576+0000", 2024-04-26T10:21:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2920000000000003e-06 2024-04-26T10:21:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308582+0000", 2024-04-26T10:21:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6540000000000002e-06 2024-04-26T10:21:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308590+0000", 2024-04-26T10:21:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-04-26T10:21:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308958+0000", 2024-04-26T10:21:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036823500000000001 2024-04-26T10:21:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:21:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308963+0000", 2024-04-26T10:21:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6160000000000001e-06 2024-04-26T10:21:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.313758+0000", 2024-04-26T10:21:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004794296 2024-04-26T10:21:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.313848+0000", 2024-04-26T10:21:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0488999999999994e-05 2024-04-26T10:21:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314099+0000", 2024-04-26T10:21:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025094700000000001 2024-04-26T10:21:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.318989+0000", 2024-04-26T10:21:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048896850000000004 2024-04-26T10:21:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319799+0000", 2024-04-26T10:21:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00080979299999999995 2024-04-26T10:21:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319847+0000", 2024-04-26T10:21:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8254999999999998e-05 2024-04-26T10:21:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319893+0000", 2024-04-26T10:21:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6108e-05 2024-04-26T10:21:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.771109670000001, 2024-04-26T10:21:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012032891, 2024-04-26T10:21:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308697+0000", 2024-04-26T10:21:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4449999999999998e-06 2024-04-26T10:21:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308864+0000", 2024-04-26T10:21:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000167045 2024-04-26T10:21:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308886+0000", 2024-04-26T10:21:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1858999999999999e-05 2024-04-26T10:21:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316346+0000", 2024-04-26T10:21:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007460225 2024-04-26T10:21:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316500+0000", 2024-04-26T10:21:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153776 2024-04-26T10:21:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316665+0000", 2024-04-26T10:21:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000164854 2024-04-26T10:21:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320564+0000", 2024-04-26T10:21:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038988339999999999 2024-04-26T10:21:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320680+0000", 2024-04-26T10:21:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011616399999999999 2024-04-26T10:21:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320710+0000", 2024-04-26T10:21:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0182e-05 2024-04-26T10:21:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320726+0000", 2024-04-26T10:21:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6118000000000001e-05 2024-04-26T10:21:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:25 3.7 e20/18 3:e0b41d06:::609.00000000:head v 20'2, mlcod=0'0)", 2024-04-26T10:21:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.308982+0000", 2024-04-26T10:21:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.770821226999999, 2024-04-26T10:21:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007280725, 2024-04-26T10:21:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308982+0000", 2024-04-26T10:21:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308982+0000", 2024-04-26T10:21:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308981+0000", 2024-04-26T10:21:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308987+0000", 2024-04-26T10:21:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5940000000000001e-06 2024-04-26T10:21:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308993+0000", 2024-04-26T10:21:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0229999999999998e-06 2024-04-26T10:21:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308998+0000", 2024-04-26T10:21:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4530000000000001e-06 2024-04-26T10:21:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.309733+0000", 2024-04-26T10:21:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00073446700000000004 2024-04-26T10:21:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.309786+0000", 2024-04-26T10:21:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2766999999999998e-05 2024-04-26T10:21:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316229+0000", 2024-04-26T10:21:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0064430779999999997 2024-04-26T10:21:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316262+0000", 2024-04-26T10:21:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3708999999999999e-05 2024-04-26T10:21:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.310512+0000", 2024-04-26T10:21:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.769290486999999, 2024-04-26T10:21:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009600964, 2024-04-26T10:21:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310512+0000", 2024-04-26T10:21:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310512+0000", 2024-04-26T10:21:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310511+0000", 2024-04-26T10:21:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310518+0000", 2024-04-26T10:21:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1870000000000002e-06 2024-04-26T10:21:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310531+0000", 2024-04-26T10:21:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3325e-05 2024-04-26T10:21:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310541+0000", 2024-04-26T10:21:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6679999999999996e-06 2024-04-26T10:21:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310750+0000", 2024-04-26T10:21:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:21:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311175+0000", 2024-04-26T10:21:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00042555300000000001 2024-04-26T10:21:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320113+0000", 2024-04-26T10:21:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0089382739999999995 2024-04-26T10:21:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(mds.0.3:31 3.d e20/18 3:b50e409b:::mds_snaptable:head v 20'1, mlcod=0'0)", 2024-04-26T10:21:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.311927+0000", 2024-04-26T10:21:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 24.76787581, 2024-04-26T10:21:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079833500000000002, 2024-04-26T10:21:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311927+0000", 2024-04-26T10:21:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311927+0000", 2024-04-26T10:21:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311927+0000", 2024-04-26T10:21:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311933+0000", 2024-04-26T10:21:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0850000000000002e-06 2024-04-26T10:21:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311942+0000", 2024-04-26T10:21:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6560000000000004e-06 2024-04-26T10:21:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311947+0000", 2024-04-26T10:21:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.933e-06 2024-04-26T10:21:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.313313+0000", 2024-04-26T10:21:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00136564 2024-04-26T10:21:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.313336+0000", 2024-04-26T10:21:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3448e-05 2024-04-26T10:21:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319867+0000", 2024-04-26T10:21:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0065308659999999998 2024-04-26T10:21:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319910+0000", 2024-04-26T10:21:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3108999999999997e-05 2024-04-26T10:21:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:313 5.b e24/22 5:de40a7a5:::benchmark_data_smithi052_19421_object312:head v 24'15, mlcod=24'12)", 2024-04-26T10:21:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:33.718506+0000", 2024-04-26T10:21:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.36129647799999998, 2024-04-26T10:21:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073740469999999999, 2024-04-26T10:21:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.718506+0000", 2024-04-26T10:21:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.718506+0000", 2024-04-26T10:21:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.718505+0000", 2024-04-26T10:21:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.718554+0000", 2024-04-26T10:21:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8250000000000001e-05 2024-04-26T10:21:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.718569+0000", 2024-04-26T10:21:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5687000000000001e-05 2024-04-26T10:21:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.718577+0000", 2024-04-26T10:21:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7889999999999995e-06 2024-04-26T10:21:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.718638+0000", 2024-04-26T10:21:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1043999999999994e-05 2024-04-26T10:21:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.718656+0000", 2024-04-26T10:21:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7938999999999999e-05 2024-04-26T10:21:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.725810+0000", 2024-04-26T10:21:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0071541180000000001 2024-04-26T10:21:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.725880+0000", 2024-04-26T10:21:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0190000000000004e-05 2024-04-26T10:21:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:994 5.0 e24/22 5:02897809:::benchmark_data_smithi052_19421_object993:head v 24'73, mlcod=24'69)", 2024-04-26T10:21:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:33.944396+0000", 2024-04-26T10:21:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.13540717599999999, 2024-04-26T10:21:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073148029999999999, 2024-04-26T10:21:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.944396+0000", 2024-04-26T10:21:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.944396+0000", 2024-04-26T10:21:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.944395+0000", 2024-04-26T10:21:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.944458+0000", 2024-04-26T10:21:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3485000000000006e-05 2024-04-26T10:21:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.944479+0000", 2024-04-26T10:21:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0733e-05 2024-04-26T10:21:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.944525+0000", 2024-04-26T10:21:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6281e-05 2024-04-26T10:21:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.944588+0000", 2024-04-26T10:21:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2570999999999994e-05 2024-04-26T10:21:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.944607+0000", 2024-04-26T10:21:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9330999999999998e-05 2024-04-26T10:21:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.951675+0000", 2024-04-26T10:21:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0070681870000000001 2024-04-26T10:21:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.951711+0000", 2024-04-26T10:21:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5147000000000001e-05 2024-04-26T10:21:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:999 5.b e24/22 5:dccf0d03:::benchmark_data_smithi052_19421_object998:head v 24'62, mlcod=24'59)", 2024-04-26T10:21:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:33.945015+0000", 2024-04-26T10:21:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.13478785800000001, 2024-04-26T10:21:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0072819829999999997, 2024-04-26T10:21:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.945015+0000", 2024-04-26T10:21:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.945015+0000", 2024-04-26T10:21:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.945014+0000", 2024-04-26T10:21:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.945101+0000", 2024-04-26T10:21:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6180999999999994e-05 2024-04-26T10:21:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.945189+0000", 2024-04-26T10:21:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8072999999999995e-05 2024-04-26T10:21:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.945197+0000", 2024-04-26T10:21:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7159999999999992e-06 2024-04-26T10:21:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.945321+0000", 2024-04-26T10:21:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000124041 2024-04-26T10:21:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.945368+0000", 2024-04-26T10:21:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7036999999999997e-05 2024-04-26T10:21:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.952223+0000", 2024-04-26T10:21:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0068543650000000003 2024-04-26T10:21:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:33.952297+0000", 2024-04-26T10:21:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4275000000000003e-05 2024-04-26T10:21:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:1241 5.f e24/22 5:f64c5408:::benchmark_data_smithi052_19421_object1240:head v 24'62, mlcod=24'59)", 2024-04-26T10:21:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:34.020367+0000", 2024-04-26T10:21:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.059436107000000002, 2024-04-26T10:21:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090396239999999996, 2024-04-26T10:21:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020367+0000", 2024-04-26T10:21:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020367+0000", 2024-04-26T10:21:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020366+0000", 2024-04-26T10:21:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020406+0000", 2024-04-26T10:21:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9422000000000003e-05 2024-04-26T10:21:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020418+0000", 2024-04-26T10:21:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2456000000000001e-05 2024-04-26T10:21:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020424+0000", 2024-04-26T10:21:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8780000000000003e-06 2024-04-26T10:21:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020490+0000", 2024-04-26T10:21:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6341999999999996e-05 2024-04-26T10:21:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020524+0000", 2024-04-26T10:21:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3479000000000003e-05 2024-04-26T10:21:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.029358+0000", 2024-04-26T10:21:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088343620000000001 2024-04-26T10:21:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.029406+0000", 2024-04-26T10:21:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8386000000000001e-05 2024-04-26T10:21:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:1242 5.4 e24/22 5:289c7627:::benchmark_data_smithi052_19421_object1241:head v 24'81, mlcod=24'79)", 2024-04-26T10:21:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:34.020755+0000", 2024-04-26T10:21:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.059048348000000001, 2024-04-26T10:21:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087876529999999994, 2024-04-26T10:21:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020755+0000", 2024-04-26T10:21:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020755+0000", 2024-04-26T10:21:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020754+0000", 2024-04-26T10:21:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020786+0000", 2024-04-26T10:21:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1646999999999997e-05 2024-04-26T10:21:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020795+0000", 2024-04-26T10:21:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3179999999999996e-06 2024-04-26T10:21:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020801+0000", 2024-04-26T10:21:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2700000000000001e-06 2024-04-26T10:21:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020848+0000", 2024-04-26T10:21:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6409999999999998e-05 2024-04-26T10:21:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020887+0000", 2024-04-26T10:21:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9554000000000001e-05 2024-04-26T10:21:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.029434+0000", 2024-04-26T10:21:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085469410000000006 2024-04-26T10:21:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.029542+0000", 2024-04-26T10:21:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000108075 2024-04-26T10:21:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:1248 5.e e24/22 5:7edeb538:::benchmark_data_smithi052_19421_object1247:head v 24'78, mlcod=24'76)", 2024-04-26T10:21:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:34.022091+0000", 2024-04-26T10:21:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.057711875000000003, 2024-04-26T10:21:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075293749999999996, 2024-04-26T10:21:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.022091+0000", 2024-04-26T10:21:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.022091+0000", 2024-04-26T10:21:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.022090+0000", 2024-04-26T10:21:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.022133+0000", 2024-04-26T10:21:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2290000000000003e-05 2024-04-26T10:21:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.022148+0000", 2024-04-26T10:21:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4983e-05 2024-04-26T10:21:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.022154+0000", 2024-04-26T10:21:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9240000000000004e-06 2024-04-26T10:21:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.022184+0000", 2024-04-26T10:21:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0701000000000003e-05 2024-04-26T10:21:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.022206+0000", 2024-04-26T10:21:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1212999999999998e-05 2024-04-26T10:21:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.029572+0000", 2024-04-26T10:21:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073660349999999999 2024-04-26T10:21:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.029620+0000", 2024-04-26T10:21:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8767000000000003e-05 2024-04-26T10:21:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:1284 5.4 e24/22 5:233871e1:::benchmark_data_smithi052_19421_object1283:head v 24'86, mlcod=24'82)", 2024-04-26T10:21:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:34.036045+0000", 2024-04-26T10:21:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.043758124000000002, 2024-04-26T10:21:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083901170000000008, 2024-04-26T10:21:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036045+0000", 2024-04-26T10:21:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036045+0000", 2024-04-26T10:21:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036044+0000", 2024-04-26T10:21:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036089+0000", 2024-04-26T10:21:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5209e-05 2024-04-26T10:21:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036102+0000", 2024-04-26T10:21:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3098999999999999e-05 2024-04-26T10:21:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036109+0000", 2024-04-26T10:21:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3860000000000004e-06 2024-04-26T10:21:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036149+0000", 2024-04-26T10:21:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0816999999999999e-05 2024-04-26T10:21:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036169+0000", 2024-04-26T10:21:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9984e-05 2024-04-26T10:21:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.044414+0000", 2024-04-26T10:21:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0082441119999999996 2024-04-26T10:21:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.044435+0000", 2024-04-26T10:21:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1350000000000001e-05 2024-04-26T10:21:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:1286 5.e e24/22 5:75aa475c:::benchmark_data_smithi052_19421_object1285:head v 24'81, mlcod=24'78)", 2024-04-26T10:21:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:34.036120+0000", 2024-04-26T10:21:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.043683128000000002, 2024-04-26T10:21:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073919659999999998, 2024-04-26T10:21:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036120+0000", 2024-04-26T10:21:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036120+0000", 2024-04-26T10:21:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036119+0000", 2024-04-26T10:21:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036180+0000", 2024-04-26T10:21:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0918999999999997e-05 2024-04-26T10:21:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036187+0000", 2024-04-26T10:21:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2310000000000001e-06 2024-04-26T10:21:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036191+0000", 2024-04-26T10:21:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2919999999999997e-06 2024-04-26T10:21:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036242+0000", 2024-04-26T10:21:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0838999999999999e-05 2024-04-26T10:21:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036277+0000", 2024-04-26T10:21:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5330999999999998e-05 2024-04-26T10:21:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.043470+0000", 2024-04-26T10:21:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0071932000000000003 2024-04-26T10:21:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.043512+0000", 2024-04-26T10:21:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1545999999999998e-05 2024-04-26T10:21:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:1291 5.4 e24/22 5:281a5ea1:::benchmark_data_smithi052_19421_object1290:head v 24'87, mlcod=24'82)", 2024-04-26T10:21:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:34.036205+0000", 2024-04-26T10:21:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.043597968000000001, 2024-04-26T10:21:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0082410699999999996, 2024-04-26T10:21:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036205+0000", 2024-04-26T10:21:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036205+0000", 2024-04-26T10:21:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036204+0000", 2024-04-26T10:21:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036261+0000", 2024-04-26T10:21:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6116999999999998e-05 2024-04-26T10:21:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036271+0000", 2024-04-26T10:21:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0489000000000001e-05 2024-04-26T10:21:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036279+0000", 2024-04-26T10:21:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9279999999999993e-06 2024-04-26T10:21:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036931+0000", 2024-04-26T10:21:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00065212600000000005 2024-04-26T10:21:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036949+0000", 2024-04-26T10:21:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8258999999999999e-05 2024-04-26T10:21:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.044437+0000", 2024-04-26T10:21:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0074872239999999998 2024-04-26T10:21:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.044446+0000", 2024-04-26T10:21:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4569999999999994e-06 2024-04-26T10:21:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:34.181 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:34.183 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:21:34.183 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:34.176+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:34.284 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:34.280+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:34.320 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T10:21:34.320 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T10:21:34.321 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.321 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:2192 5.c 5:3fd3dd4f:::benchmark_data_smithi052_19421_object2191:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:21:34.321 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.315692+0000", 2024-04-26T10:21:34.321 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0036376300000000002, 2024-04-26T10:21:34.321 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0036570090000000001, 2024-04-26T10:21:34.321 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.321 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:34.321 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:34.321 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:34.321 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.321 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 2192 2024-04-26T10:21:34.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.322 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.315692+0000", 2024-04-26T10:21:34.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.322 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.322 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.315692+0000", 2024-04-26T10:21:34.322 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.322 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.315691+0000", 2024-04-26T10:21:34.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.315838+0000", 2024-04-26T10:21:34.323 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146494 2024-04-26T10:21:34.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.323 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.323 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.323 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.315855+0000", 2024-04-26T10:21:34.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7578e-05 2024-04-26T10:21:34.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.315891+0000", 2024-04-26T10:21:34.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5973000000000003e-05 2024-04-26T10:21:34.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.324 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316340+0000", 2024-04-26T10:21:34.324 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00044891000000000001 2024-04-26T10:21:34.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.324 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.324 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316466+0000", 2024-04-26T10:21:34.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012598500000000001 2024-04-26T10:21:34.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:34.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316717+0000", 2024-04-26T10:21:34.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00025142099999999999 2024-04-26T10:21:34.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.325 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.325 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.325 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.318640+0000", 2024-04-26T10:21:34.325 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0019227350000000001 2024-04-26T10:21:34.325 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.326 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.326 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.326 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.326 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:2193 5.5 5:abd427b0:::benchmark_data_smithi052_19421_object2192:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:21:34.326 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.315901+0000", 2024-04-26T10:21:34.326 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.003429049, 2024-04-26T10:21:34.326 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035012910000000001, 2024-04-26T10:21:34.326 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.326 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:34.326 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:34.326 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:34.327 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.327 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 2193 2024-04-26T10:21:34.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.327 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.327 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.327 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.327 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.315901+0000", 2024-04-26T10:21:34.327 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.315901+0000", 2024-04-26T10:21:34.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.328 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.315900+0000", 2024-04-26T10:21:34.328 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.328 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.328 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.315946+0000", 2024-04-26T10:21:34.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.634e-05 2024-04-26T10:21:34.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.315960+0000", 2024-04-26T10:21:34.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3868e-05 2024-04-26T10:21:34.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.329 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.329 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.329 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.315967+0000", 2024-04-26T10:21:34.329 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3719999999999999e-06 2024-04-26T10:21:34.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316011+0000", 2024-04-26T10:21:34.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3560999999999998e-05 2024-04-26T10:21:34.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.330 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.330 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316117+0000", 2024-04-26T10:21:34.330 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000106424 2024-04-26T10:21:34.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.330 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:34.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316242+0000", 2024-04-26T10:21:34.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012499399999999999 2024-04-26T10:21:34.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.331 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.331 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.318999+0000", 2024-04-26T10:21:34.331 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027563459999999998 2024-04-26T10:21:34.331 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.331 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.331 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.331 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.331 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:2195 5.0 5:026e73df:::benchmark_data_smithi052_19421_object2194:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:21:34.332 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.315982+0000", 2024-04-26T10:21:34.332 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0033475750000000002, 2024-04-26T10:21:34.332 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00346583, 2024-04-26T10:21:34.332 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.332 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:34.332 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:34.332 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:34.332 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.332 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 2195 2024-04-26T10:21:34.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.332 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.332 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.315982+0000", 2024-04-26T10:21:34.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.315982+0000", 2024-04-26T10:21:34.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.333 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.333 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.315981+0000", 2024-04-26T10:21:34.333 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.333 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316023+0000", 2024-04-26T10:21:34.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1510000000000001e-05 2024-04-26T10:21:34.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316033+0000", 2024-04-26T10:21:34.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0342e-05 2024-04-26T10:21:34.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.334 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.334 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.334 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316040+0000", 2024-04-26T10:21:34.334 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.516e-06 2024-04-26T10:21:34.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316115+0000", 2024-04-26T10:21:34.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5718999999999998e-05 2024-04-26T10:21:34.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316232+0000", 2024-04-26T10:21:34.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011661499999999999 2024-04-26T10:21:34.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.335 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.335 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.335 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316366+0000", 2024-04-26T10:21:34.335 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013367199999999999 2024-04-26T10:21:34.336 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.336 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.336 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.336 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.336 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:2196 5.4 5:2be8c03f:::benchmark_data_smithi052_19421_object2195:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:21:34.336 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.316058+0000", 2024-04-26T10:21:34.336 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.003271487, 2024-04-26T10:21:34.336 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003441979, 2024-04-26T10:21:34.336 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.336 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:34.336 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:34.336 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:34.336 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.337 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 2196 2024-04-26T10:21:34.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.337 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316058+0000", 2024-04-26T10:21:34.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.337 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.337 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.337 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316058+0000", 2024-04-26T10:21:34.337 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316057+0000", 2024-04-26T10:21:34.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.338 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316091+0000", 2024-04-26T10:21:34.338 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4153000000000003e-05 2024-04-26T10:21:34.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.338 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.338 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316101+0000", 2024-04-26T10:21:34.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.8609999999999993e-06 2024-04-26T10:21:34.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316108+0000", 2024-04-26T10:21:34.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4520000000000002e-06 2024-04-26T10:21:34.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.339 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.339 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316338+0000", 2024-04-26T10:21:34.339 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000230041 2024-04-26T10:21:34.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.339 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316465+0000", 2024-04-26T10:21:34.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000127434 2024-04-26T10:21:34.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.340 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.340 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316604+0000", 2024-04-26T10:21:34.340 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013926300000000001 2024-04-26T10:21:34.340 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.340 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.340 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.340 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.340 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4722.0:2188 5.7 e24/22 5:ecbab166:::benchmark_data_smithi052_19421_object2187:head v 24'132, mlcod=24'128)", 2024-04-26T10:21:34.341 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.316187+0000", 2024-04-26T10:21:34.341 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0031426710000000001, 2024-04-26T10:21:34.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033536059999999999, 2024-04-26T10:21:34.341 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.341 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T10:21:34.341 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316187+0000", 2024-04-26T10:21:34.341 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.341 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.341 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.341 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316187+0000", 2024-04-26T10:21:34.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316186+0000", 2024-04-26T10:21:34.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.342 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316240+0000", 2024-04-26T10:21:34.342 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3529999999999997e-05 2024-04-26T10:21:34.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.342 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.342 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316246+0000", 2024-04-26T10:21:34.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1029999999999998e-06 2024-04-26T10:21:34.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316250+0000", 2024-04-26T10:21:34.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1139999999999999e-06 2024-04-26T10:21:34.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.343 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.343 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.343 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316295+0000", 2024-04-26T10:21:34.343 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5021999999999997e-05 2024-04-26T10:21:34.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.344 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.344 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316317+0000", 2024-04-26T10:21:34.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2079999999999999e-05 2024-04-26T10:21:34.344 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.344 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.344 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.344 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.344 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4722.0:2190 5.1 e24/22 5:8c6703da:::benchmark_data_smithi052_19421_object2189:head v 24'150, mlcod=24'147)", 2024-04-26T10:21:34.344 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.316265+0000", 2024-04-26T10:21:34.344 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0030643530000000001, 2024-04-26T10:21:34.344 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003307824, 2024-04-26T10:21:34.344 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.345 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T10:21:34.345 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316265+0000", 2024-04-26T10:21:34.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.345 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.345 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.345 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316265+0000", 2024-04-26T10:21:34.345 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316265+0000", 2024-04-26T10:21:34.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316311+0000", 2024-04-26T10:21:34.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6607999999999998e-05 2024-04-26T10:21:34.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.346 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.346 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.346 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316318+0000", 2024-04-26T10:21:34.346 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8950000000000001e-06 2024-04-26T10:21:34.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316324+0000", 2024-04-26T10:21:34.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.5509999999999999e-06 2024-04-26T10:21:34.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.347 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316370+0000", 2024-04-26T10:21:34.347 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6090000000000001e-05 2024-04-26T10:21:34.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.347 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.347 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.348 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.316388+0000", 2024-04-26T10:21:34.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8329999999999999e-05 2024-04-26T10:21:34.348 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.348 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.348 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.348 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.348 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:2197 5.e 5:7b622cc1:::benchmark_data_smithi052_19421_object2196:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:21:34.348 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.317077+0000", 2024-04-26T10:21:34.348 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0022522129999999999, 2024-04-26T10:21:34.348 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0025298360000000002, 2024-04-26T10:21:34.348 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.348 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:34.348 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:34.348 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:34.349 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.349 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 2197 2024-04-26T10:21:34.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.349 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.317077+0000", 2024-04-26T10:21:34.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.349 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.349 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.349 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.317077+0000", 2024-04-26T10:21:34.349 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.317076+0000", 2024-04-26T10:21:34.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.317243+0000", 2024-04-26T10:21:34.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016637299999999999 2024-04-26T10:21:34.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.350 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.350 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.350 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.317258+0000", 2024-04-26T10:21:34.350 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4939e-05 2024-04-26T10:21:34.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.317271+0000", 2024-04-26T10:21:34.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2945000000000001e-05 2024-04-26T10:21:34.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.351 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.317323+0000", 2024-04-26T10:21:34.351 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2278000000000003e-05 2024-04-26T10:21:34.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.351 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.351 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.317424+0000", 2024-04-26T10:21:34.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010097799999999999 2024-04-26T10:21:34.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.352 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.352 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.317539+0000", 2024-04-26T10:21:34.352 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000114777 2024-04-26T10:21:34.352 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.352 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.352 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.352 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.352 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4722.0:2201 5.7 e24/22 5:e66bd497:::benchmark_data_smithi052_19421_object2200:head v 24'133, mlcod=24'130)", 2024-04-26T10:21:34.352 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.319044+0000", 2024-04-26T10:21:34.353 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00028580800000000003, 2024-04-26T10:21:34.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061164499999999996, 2024-04-26T10:21:34.353 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.353 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T10:21:34.353 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.353 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.353 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.353 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.319044+0000", 2024-04-26T10:21:34.353 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.319044+0000", 2024-04-26T10:21:34.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.354 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.354 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.319043+0000", 2024-04-26T10:21:34.354 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.354 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.319112+0000", 2024-04-26T10:21:34.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8867000000000003e-05 2024-04-26T10:21:34.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.319120+0000", 2024-04-26T10:21:34.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5989999999999996e-06 2024-04-26T10:21:34.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.355 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.355 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.355 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.319123+0000", 2024-04-26T10:21:34.355 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7189999999999999e-06 2024-04-26T10:21:34.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.319165+0000", 2024-04-26T10:21:34.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2011000000000001e-05 2024-04-26T10:21:34.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.356 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.356 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.319180+0000", 2024-04-26T10:21:34.356 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4163e-05 2024-04-26T10:21:34.356 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.356 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.356 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.356 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.357 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:2186 5.0 5:07f45867:::benchmark_data_smithi052_19421_object2185:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:21:34.357 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.313181+0000", 2024-04-26T10:21:34.357 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0061490479999999998, 2024-04-26T10:21:34.357 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.006510203, 2024-04-26T10:21:34.357 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.357 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:34.357 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:34.357 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:34.357 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.357 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 2186 2024-04-26T10:21:34.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.357 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.357 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.357 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.357 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.313181+0000", 2024-04-26T10:21:34.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.313181+0000", 2024-04-26T10:21:34.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.358 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.358 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.313180+0000", 2024-04-26T10:21:34.358 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.358 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.313276+0000", 2024-04-26T10:21:34.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.6490999999999995e-05 2024-04-26T10:21:34.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.313285+0000", 2024-04-26T10:21:34.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4159999999999993e-06 2024-04-26T10:21:34.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.359 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.359 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.359 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.313294+0000", 2024-04-26T10:21:34.359 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5939999999999994e-06 2024-04-26T10:21:34.359 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.313370+0000", 2024-04-26T10:21:34.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6161000000000005e-05 2024-04-26T10:21:34.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.313514+0000", 2024-04-26T10:21:34.360 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014410700000000001 2024-04-26T10:21:34.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.360 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.360 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.360 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.313651+0000", 2024-04-26T10:21:34.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000136697 2024-04-26T10:21:34.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.361 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.361 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:34.361 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.314877+0000", 2024-04-26T10:21:34.361 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001225978 2024-04-26T10:21:34.361 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.361 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.361 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.361 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.361 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-04-26T10:21:34.361 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 9 2024-04-26T10:21:34.361 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T10:21:34.363 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:21:34.385 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:34.380+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:34.486 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:34.481+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:34.496 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T10:21:34.497 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T10:21:34.497 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T10:21:34.497 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T10:21:34.497 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T10:21:34.510 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:21:34.543 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T10:21:34.568 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'reef'} 2024-04-26T10:21:34.568 DEBUG:teuthology.orchestra.run.smithi052:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=reef' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-04-26T10:21:34.586 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:34.585+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:34.613 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 1 15 3093 3078 192.361 192.375 0.00481968 0.00517961 2024-04-26T10:21:34.646 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T10:21:34.646 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T10:21:34.646 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T10:21:34.646 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T10:21:34.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.646 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:34.646 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:09.303129+0000", 2024-04-26T10:21:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.339950816999998, 2024-04-26T10:21:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092506729999999992, 2024-04-26T10:21:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303129+0000", 2024-04-26T10:21:34.647 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303129+0000", 2024-04-26T10:21:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303126+0000", 2024-04-26T10:21:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999976 2024-04-26T10:21:34.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303147+0000", 2024-04-26T10:21:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1027e-05 2024-04-26T10:21:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303177+0000", 2024-04-26T10:21:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9558999999999999e-05 2024-04-26T10:21:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.649 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303199+0000", 2024-04-26T10:21:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2832000000000001e-05 2024-04-26T10:21:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303279+0000", 2024-04-26T10:21:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9482999999999998e-05 2024-04-26T10:21:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.650 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303468+0000", 2024-04-26T10:21:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018884899999999999 2024-04-26T10:21:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.304090+0000", 2024-04-26T10:21:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00062259000000000001 2024-04-26T10:21:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.305628+0000", 2024-04-26T10:21:34.651 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015374430000000001 2024-04-26T10:21:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.311982+0000", 2024-04-26T10:21:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0063537730000000001 2024-04-26T10:21:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.312267+0000", 2024-04-26T10:21:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000285421 2024-04-26T10:21:34.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.312379+0000", 2024-04-26T10:21:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000112176 2024-04-26T10:21:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:09.303233+0000", 2024-04-26T10:21:34.653 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.339846565999999, 2024-04-26T10:21:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010631286, 2024-04-26T10:21:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303233+0000", 2024-04-26T10:21:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.654 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303233+0000", 2024-04-26T10:21:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303232+0000", 2024-04-26T10:21:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303239+0000", 2024-04-26T10:21:34.655 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3429999999999998e-06 2024-04-26T10:21:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303250+0000", 2024-04-26T10:21:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.102e-05 2024-04-26T10:21:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303279+0000", 2024-04-26T10:21:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8436e-05 2024-04-26T10:21:34.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.304382+0000", 2024-04-26T10:21:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001103501 2024-04-26T10:21:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.304446+0000", 2024-04-26T10:21:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3528000000000006e-05 2024-04-26T10:21:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.304525+0000", 2024-04-26T10:21:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9259999999999997e-05 2024-04-26T10:21:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.305634+0000", 2024-04-26T10:21:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011095230000000001 2024-04-26T10:21:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.658 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.313691+0000", 2024-04-26T10:21:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0080564750000000004 2024-04-26T10:21:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.313764+0000", 2024-04-26T10:21:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3448999999999994e-05 2024-04-26T10:21:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.659 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.313864+0000", 2024-04-26T10:21:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.9741000000000006e-05 2024-04-26T10:21:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:09.303300+0000", 2024-04-26T10:21:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.339779561, 2024-04-26T10:21:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.01397092, 2024-04-26T10:21:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.660 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303300+0000", 2024-04-26T10:21:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303300+0000", 2024-04-26T10:21:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303298+0000", 2024-04-26T10:21:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303307+0000", 2024-04-26T10:21:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2900000000000008e-06 2024-04-26T10:21:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.662 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303326+0000", 2024-04-26T10:21:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8096000000000001e-05 2024-04-26T10:21:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303339+0000", 2024-04-26T10:21:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3329999999999999e-05 2024-04-26T10:21:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.304366+0000", 2024-04-26T10:21:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0010270800000000001 2024-04-26T10:21:34.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.304502+0000", 2024-04-26T10:21:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013630000000000001 2024-04-26T10:21:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.304641+0000", 2024-04-26T10:21:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013889300000000001 2024-04-26T10:21:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.664 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.305644+0000", 2024-04-26T10:21:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00100256 2024-04-26T10:21:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.316545+0000", 2024-04-26T10:21:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010901574000000001 2024-04-26T10:21:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.316598+0000", 2024-04-26T10:21:34.665 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2648999999999997e-05 2024-04-26T10:21:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.317271+0000", 2024-04-26T10:21:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000672801 2024-04-26T10:21:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:34.666 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:09.303348+0000", 2024-04-26T10:21:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.339731674999999, 2024-04-26T10:21:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014400512000000001, 2024-04-26T10:21:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303348+0000", 2024-04-26T10:21:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.667 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303348+0000", 2024-04-26T10:21:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303347+0000", 2024-04-26T10:21:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303352+0000", 2024-04-26T10:21:34.668 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4870000000000002e-06 2024-04-26T10:21:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303363+0000", 2024-04-26T10:21:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0463e-05 2024-04-26T10:21:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303372+0000", 2024-04-26T10:21:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4660000000000005e-06 2024-04-26T10:21:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.304903+0000", 2024-04-26T10:21:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001530703 2024-04-26T10:21:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.304975+0000", 2024-04-26T10:21:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1520000000000006e-05 2024-04-26T10:21:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.670 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.305065+0000", 2024-04-26T10:21:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0591000000000001e-05 2024-04-26T10:21:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.308231+0000", 2024-04-26T10:21:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0031663160000000002 2024-04-26T10:21:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.671 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.317482+0000", 2024-04-26T10:21:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092504909999999996 2024-04-26T10:21:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.317697+0000", 2024-04-26T10:21:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00021466000000000001 2024-04-26T10:21:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.317748+0000", 2024-04-26T10:21:34.672 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1572e-05 2024-04-26T10:21:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:09.303379+0000", 2024-04-26T10:21:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.339700445999998, 2024-04-26T10:21:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010791360999999999, 2024-04-26T10:21:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.673 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303379+0000", 2024-04-26T10:21:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303379+0000", 2024-04-26T10:21:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303378+0000", 2024-04-26T10:21:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303383+0000", 2024-04-26T10:21:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8729999999999998e-06 2024-04-26T10:21:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.675 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303396+0000", 2024-04-26T10:21:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2597e-05 2024-04-26T10:21:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303408+0000", 2024-04-26T10:21:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.272e-05 2024-04-26T10:21:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.304986+0000", 2024-04-26T10:21:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001578023 2024-04-26T10:21:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.305106+0000", 2024-04-26T10:21:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000119214 2024-04-26T10:21:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.305229+0000", 2024-04-26T10:21:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012362899999999999 2024-04-26T10:21:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:34.677 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.311315+0000", 2024-04-26T10:21:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0060856570000000004 2024-04-26T10:21:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.314061+0000", 2024-04-26T10:21:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002745824 2024-04-26T10:21:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.314128+0000", 2024-04-26T10:21:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7621999999999997e-05 2024-04-26T10:21:34.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.314170+0000", 2024-04-26T10:21:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1822e-05 2024-04-26T10:21:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:34.679 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:09.303477+0000", 2024-04-26T10:21:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.339602315, 2024-04-26T10:21:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010312071000000001, 2024-04-26T10:21:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T10:21:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303477+0000", 2024-04-26T10:21:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.680 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303477+0000", 2024-04-26T10:21:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303476+0000", 2024-04-26T10:21:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303484+0000", 2024-04-26T10:21:34.681 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6599999999999995e-06 2024-04-26T10:21:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303501+0000", 2024-04-26T10:21:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.7506000000000001e-05 2024-04-26T10:21:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303525+0000", 2024-04-26T10:21:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3799e-05 2024-04-26T10:21:34.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.304002+0000", 2024-04-26T10:21:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00047752100000000001 2024-04-26T10:21:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.304095+0000", 2024-04-26T10:21:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2728999999999999e-05 2024-04-26T10:21:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.683 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.313789+0000", 2024-04-26T10:21:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0096939320000000006 2024-04-26T10:21:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:09.303580+0000", 2024-04-26T10:21:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.339498883000001, 2024-04-26T10:21:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010714191, 2024-04-26T10:21:34.684 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T10:21:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303580+0000", 2024-04-26T10:21:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303580+0000", 2024-04-26T10:21:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303580+0000", 2024-04-26T10:21:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303583+0000", 2024-04-26T10:21:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0620000000000001e-06 2024-04-26T10:21:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.686 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303607+0000", 2024-04-26T10:21:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4141000000000001e-05 2024-04-26T10:21:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303617+0000", 2024-04-26T10:21:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7140000000000005e-06 2024-04-26T10:21:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.687 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.305660+0000", 2024-04-26T10:21:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0020427549999999998 2024-04-26T10:21:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.305766+0000", 2024-04-26T10:21:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010637900000000001 2024-04-26T10:21:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.314295+0000", 2024-04-26T10:21:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0085285819999999998 2024-04-26T10:21:34.688 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:09.303624+0000", 2024-04-26T10:21:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 25.339455322999999, 2024-04-26T10:21:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013422959, 2024-04-26T10:21:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T10:21:34.689 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303624+0000", 2024-04-26T10:21:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303624+0000", 2024-04-26T10:21:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303623+0000", 2024-04-26T10:21:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303634+0000", 2024-04-26T10:21:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0372e-05 2024-04-26T10:21:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.691 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303639+0000", 2024-04-26T10:21:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:21:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303650+0000", 2024-04-26T10:21:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0395e-05 2024-04-26T10:21:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303710+0000", 2024-04-26T10:21:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0900999999999998e-05 2024-04-26T10:21:34.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303848+0000", 2024-04-26T10:21:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000137078 2024-04-26T10:21:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.317047+0000", 2024-04-26T10:21:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013199412000000001 2024-04-26T10:21:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.693 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:171 5.6 5:6464d8c5:::benchmark_data_smithi052_19421_object170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:21:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:33.666655+0000", 2024-04-26T10:21:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.97642427399999998, 2024-04-26T10:21:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092150689999999993, 2024-04-26T10:21:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:34.694 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 171 2024-04-26T10:21:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.666655+0000", 2024-04-26T10:21:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.666655+0000", 2024-04-26T10:21:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.666654+0000", 2024-04-26T10:21:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.666784+0000", 2024-04-26T10:21:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000129799 2024-04-26T10:21:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.666798+0000", 2024-04-26T10:21:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3864e-05 2024-04-26T10:21:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.666806+0000", 2024-04-26T10:21:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2179999999999999e-06 2024-04-26T10:21:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.697 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.666848+0000", 2024-04-26T10:21:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2033999999999998e-05 2024-04-26T10:21:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.667003+0000", 2024-04-26T10:21:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015440300000000001 2024-04-26T10:21:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.667159+0000", 2024-04-26T10:21:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015650899999999999 2024-04-26T10:21:34.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.669121+0000", 2024-04-26T10:21:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0019616310000000001 2024-04-26T10:21:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.675793+0000", 2024-04-26T10:21:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0066718159999999997 2024-04-26T10:21:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.699 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.675833+0000", 2024-04-26T10:21:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0654000000000001e-05 2024-04-26T10:21:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.675870+0000", 2024-04-26T10:21:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6973e-05 2024-04-26T10:21:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:303 5.b 5:d66e5482:::benchmark_data_smithi052_19421_object302:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:21:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:33.711763+0000", 2024-04-26T10:21:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.93131606899999997, 2024-04-26T10:21:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094169930000000002, 2024-04-26T10:21:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 303 2024-04-26T10:21:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.701 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.711763+0000", 2024-04-26T10:21:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.711763+0000", 2024-04-26T10:21:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.711762+0000", 2024-04-26T10:21:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.711840+0000", 2024-04-26T10:21:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7527000000000005e-05 2024-04-26T10:21:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.711852+0000", 2024-04-26T10:21:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1875999999999999e-05 2024-04-26T10:21:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.711860+0000", 2024-04-26T10:21:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5990000000000002e-06 2024-04-26T10:21:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.712929+0000", 2024-04-26T10:21:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001068252 2024-04-26T10:21:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.713062+0000", 2024-04-26T10:21:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013339600000000001 2024-04-26T10:21:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.713236+0000", 2024-04-26T10:21:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017420099999999999 2024-04-26T10:21:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:34.705 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.715452+0000", 2024-04-26T10:21:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0022160970000000002 2024-04-26T10:21:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.721109+0000", 2024-04-26T10:21:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0056568699999999996 2024-04-26T10:21:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.721146+0000", 2024-04-26T10:21:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6894000000000003e-05 2024-04-26T10:21:34.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.721180+0000", 2024-04-26T10:21:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4065e-05 2024-04-26T10:21:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:363 5.e 5:74533407:::benchmark_data_smithi052_19421_object362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:21:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:33.735824+0000", 2024-04-26T10:21:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.90725547699999998, 2024-04-26T10:21:34.707 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0095691119999999994, 2024-04-26T10:21:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 363 2024-04-26T10:21:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.735824+0000", 2024-04-26T10:21:34.708 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.735824+0000", 2024-04-26T10:21:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.735823+0000", 2024-04-26T10:21:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.735907+0000", 2024-04-26T10:21:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3839999999999997e-05 2024-04-26T10:21:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.735922+0000", 2024-04-26T10:21:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4656e-05 2024-04-26T10:21:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.735944+0000", 2024-04-26T10:21:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1982000000000001e-05 2024-04-26T10:21:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.738308+0000", 2024-04-26T10:21:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023640850000000001 2024-04-26T10:21:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.711 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.738416+0000", 2024-04-26T10:21:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000108495 2024-04-26T10:21:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.738614+0000", 2024-04-26T10:21:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00019809999999999999 2024-04-26T10:21:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.743773+0000", 2024-04-26T10:21:34.712 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005158569 2024-04-26T10:21:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.745312+0000", 2024-04-26T10:21:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0015389939999999999 2024-04-26T10:21:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.745358+0000", 2024-04-26T10:21:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6270000000000003e-05 2024-04-26T10:21:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.713 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.745393+0000", 2024-04-26T10:21:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4823000000000002e-05 2024-04-26T10:21:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:815 5.8 5:1e062eec:::benchmark_data_smithi052_19421_object814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:21:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:33.886087+0000", 2024-04-26T10:21:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.75699233300000002, 2024-04-26T10:21:34.714 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0094238819999999997, 2024-04-26T10:21:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 815 2024-04-26T10:21:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.886087+0000", 2024-04-26T10:21:34.715 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.886087+0000", 2024-04-26T10:21:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.886086+0000", 2024-04-26T10:21:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.886154+0000", 2024-04-26T10:21:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8058999999999993e-05 2024-04-26T10:21:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.886180+0000", 2024-04-26T10:21:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.6120999999999999e-05 2024-04-26T10:21:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.886192+0000", 2024-04-26T10:21:34.717 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1606999999999999e-05 2024-04-26T10:21:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.887160+0000", 2024-04-26T10:21:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00096791300000000004 2024-04-26T10:21:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.887360+0000", 2024-04-26T10:21:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000200896 2024-04-26T10:21:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.887520+0000", 2024-04-26T10:21:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015958500000000001 2024-04-26T10:21:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.888642+0000", 2024-04-26T10:21:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011217079999999999 2024-04-26T10:21:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.895432+0000", 2024-04-26T10:21:34.719 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0067900520000000004 2024-04-26T10:21:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.895469+0000", 2024-04-26T10:21:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7163999999999999e-05 2024-04-26T10:21:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.895511+0000", 2024-04-26T10:21:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1962000000000002e-05 2024-04-26T10:21:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.720 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:994 5.0 5:02897809:::benchmark_data_smithi052_19421_object993:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:21:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:33.942028+0000", 2024-04-26T10:21:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.70105156899999999, 2024-04-26T10:21:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0093882440000000004, 2024-04-26T10:21:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:34.721 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 994 2024-04-26T10:21:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.942028+0000", 2024-04-26T10:21:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.942028+0000", 2024-04-26T10:21:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.942027+0000", 2024-04-26T10:21:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.942074+0000", 2024-04-26T10:21:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.6893e-05 2024-04-26T10:21:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.725 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.942084+0000", 2024-04-26T10:21:34.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0118999999999999e-05 2024-04-26T10:21:34.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.725 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.725 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.942092+0000", 2024-04-26T10:21:34.725 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.0909999999999993e-06 2024-04-26T10:21:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.943509+0000", 2024-04-26T10:21:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014165619999999999 2024-04-26T10:21:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.943657+0000", 2024-04-26T10:21:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014823399999999999 2024-04-26T10:21:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.943773+0000", 2024-04-26T10:21:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000116345 2024-04-26T10:21:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.948159+0000", 2024-04-26T10:21:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043853190000000004 2024-04-26T10:21:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.727 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.951339+0000", 2024-04-26T10:21:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0031806759999999999 2024-04-26T10:21:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.951388+0000", 2024-04-26T10:21:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8563999999999998e-05 2024-04-26T10:21:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.728 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:33.951416+0000", 2024-04-26T10:21:34.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.8263999999999999e-05 2024-04-26T10:21:34.729 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.729 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.729 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.729 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:1242 5.4 5:289c7627:::benchmark_data_smithi052_19421_object1241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:21:34.729 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.019670+0000", 2024-04-26T10:21:34.729 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.62340907800000001, 2024-04-26T10:21:34.729 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0095871350000000001, 2024-04-26T10:21:34.729 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.729 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 1242 2024-04-26T10:21:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.019670+0000", 2024-04-26T10:21:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.019670+0000", 2024-04-26T10:21:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.019670+0000", 2024-04-26T10:21:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.731 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.019720+0000", 2024-04-26T10:21:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0084999999999999e-05 2024-04-26T10:21:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.019730+0000", 2024-04-26T10:21:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0298e-05 2024-04-26T10:21:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.732 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.019747+0000", 2024-04-26T10:21:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.734e-05 2024-04-26T10:21:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.019789+0000", 2024-04-26T10:21:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1732e-05 2024-04-26T10:21:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.019926+0000", 2024-04-26T10:21:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013694400000000001 2024-04-26T10:21:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.020079+0000", 2024-04-26T10:21:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000153091 2024-04-26T10:21:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.021809+0000", 2024-04-26T10:21:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0017295069999999999 2024-04-26T10:21:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.734 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.029174+0000", 2024-04-26T10:21:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0073656559999999999 2024-04-26T10:21:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.029222+0000", 2024-04-26T10:21:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7336999999999998e-05 2024-04-26T10:21:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.029257+0000", 2024-04-26T10:21:34.735 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5884999999999999e-05 2024-04-26T10:21:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:1284 5.4 5:233871e1:::benchmark_data_smithi052_19421_object1283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:21:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.034069+0000", 2024-04-26T10:21:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.60901020800000005, 2024-04-26T10:21:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010018394999999999, 2024-04-26T10:21:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:34.736 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 1284 2024-04-26T10:21:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.034069+0000", 2024-04-26T10:21:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.737 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.034069+0000", 2024-04-26T10:21:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.034068+0000", 2024-04-26T10:21:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.034121+0000", 2024-04-26T10:21:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2586000000000001e-05 2024-04-26T10:21:34.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.034129+0000", 2024-04-26T10:21:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3639999999999999e-06 2024-04-26T10:21:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.034134+0000", 2024-04-26T10:21:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3529999999999997e-06 2024-04-26T10:21:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.739 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.034271+0000", 2024-04-26T10:21:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013692899999999999 2024-04-26T10:21:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.034409+0000", 2024-04-26T10:21:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013821999999999999 2024-04-26T10:21:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.034555+0000", 2024-04-26T10:21:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000146186 2024-04-26T10:21:34.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.038222+0000", 2024-04-26T10:21:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003666955 2024-04-26T10:21:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.044041+0000", 2024-04-26T10:21:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0058190710000000003 2024-04-26T10:21:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.044068+0000", 2024-04-26T10:21:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.7220999999999999e-05 2024-04-26T10:21:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.044088+0000", 2024-04-26T10:21:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9293999999999999e-05 2024-04-26T10:21:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.742 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:1291 5.4 5:281a5ea1:::benchmark_data_smithi052_19421_object1290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:21:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.034666+0000", 2024-04-26T10:21:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.60841309099999996, 2024-04-26T10:21:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0095118560000000008, 2024-04-26T10:21:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 1291 2024-04-26T10:21:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.743 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.034666+0000", 2024-04-26T10:21:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.034666+0000", 2024-04-26T10:21:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.744 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.034665+0000", 2024-04-26T10:21:34.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.745 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.034710+0000", 2024-04-26T10:21:34.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5046999999999997e-05 2024-04-26T10:21:34.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.745 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.745 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.745 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.034725+0000", 2024-04-26T10:21:34.745 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4936000000000001e-05 2024-04-26T10:21:34.746 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.746 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.034737+0000", 2024-04-26T10:21:34.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1864e-05 2024-04-26T10:21:34.746 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.746 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.746 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.034969+0000", 2024-04-26T10:21:34.746 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00023191999999999999 2024-04-26T10:21:34.746 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.746 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.035095+0000", 2024-04-26T10:21:34.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012566000000000001 2024-04-26T10:21:34.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.035233+0000", 2024-04-26T10:21:34.747 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013817699999999999 2024-04-26T10:21:34.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.747 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:34.747 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.041597+0000", 2024-04-26T10:21:34.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0063637809999999998 2024-04-26T10:21:34.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.044124+0000", 2024-04-26T10:21:34.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0025276510000000001 2024-04-26T10:21:34.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.748 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.748 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:34.748 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.044159+0000", 2024-04-26T10:21:34.748 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4718999999999997e-05 2024-04-26T10:21:34.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.749 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.749 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.749 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.044178+0000", 2024-04-26T10:21:34.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9004999999999998e-05 2024-04-26T10:21:34.749 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.749 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.749 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.749 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.749 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:1939 5.3 5:ca9d2e67:::benchmark_data_smithi052_19421_object1938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:21:34.749 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.242668+0000", 2024-04-26T10:21:34.749 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.40041180799999998, 2024-04-26T10:21:34.749 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010405474, 2024-04-26T10:21:34.750 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.750 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.750 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:34.750 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:34.750 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.750 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 1939 2024-04-26T10:21:34.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.750 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.750 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.750 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.750 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.242668+0000", 2024-04-26T10:21:34.750 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.242668+0000", 2024-04-26T10:21:34.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.751 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.751 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.242667+0000", 2024-04-26T10:21:34.751 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.751 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.242709+0000", 2024-04-26T10:21:34.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1729e-05 2024-04-26T10:21:34.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.242716+0000", 2024-04-26T10:21:34.752 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.3839999999999999e-06 2024-04-26T10:21:34.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.752 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.752 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.752 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.242722+0000", 2024-04-26T10:21:34.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0549999999999996e-06 2024-04-26T10:21:34.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.243667+0000", 2024-04-26T10:21:34.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00094454900000000004 2024-04-26T10:21:34.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.753 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.753 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.753 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.243798+0000", 2024-04-26T10:21:34.753 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013134900000000001 2024-04-26T10:21:34.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:34.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.243926+0000", 2024-04-26T10:21:34.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000127673 2024-04-26T10:21:34.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.754 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.247841+0000", 2024-04-26T10:21:34.754 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0039154819999999996 2024-04-26T10:21:34.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.754 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.754 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:34.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.252991+0000", 2024-04-26T10:21:34.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051498769999999998 2024-04-26T10:21:34.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:34.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.253038+0000", 2024-04-26T10:21:34.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7144999999999997e-05 2024-04-26T10:21:34.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.755 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.755 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.755 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.253073+0000", 2024-04-26T10:21:34.755 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.485e-05 2024-04-26T10:21:34.756 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.756 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.756 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.756 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.756 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:1948 5.3 5:c9cc75a2:::benchmark_data_smithi052_19421_object1947:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-26T10:21:34.756 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.244063+0000", 2024-04-26T10:21:34.756 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.399016072, 2024-04-26T10:21:34.756 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0091880739999999992, 2024-04-26T10:21:34.756 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.756 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.756 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:34.756 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:34.757 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.757 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 1948 2024-04-26T10:21:34.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.757 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.244063+0000", 2024-04-26T10:21:34.757 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.757 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.757 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.757 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.244063+0000", 2024-04-26T10:21:34.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.244063+0000", 2024-04-26T10:21:34.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.758 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.758 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.758 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.244087+0000", 2024-04-26T10:21:34.758 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.4195000000000001e-05 2024-04-26T10:21:34.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.244101+0000", 2024-04-26T10:21:34.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3764000000000001e-05 2024-04-26T10:21:34.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.759 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.244104+0000", 2024-04-26T10:21:34.759 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5779999999999999e-06 2024-04-26T10:21:34.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.759 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.759 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.244507+0000", 2024-04-26T10:21:34.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00040215599999999998 2024-04-26T10:21:34.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.244896+0000", 2024-04-26T10:21:34.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000389591 2024-04-26T10:21:34.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.760 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.760 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:34.760 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.245036+0000", 2024-04-26T10:21:34.760 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013973499999999999 2024-04-26T10:21:34.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.247868+0000", 2024-04-26T10:21:34.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0028323509999999999 2024-04-26T10:21:34.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.761 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:34.761 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.253174+0000", 2024-04-26T10:21:34.761 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0053059719999999999 2024-04-26T10:21:34.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.761 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:34.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.253218+0000", 2024-04-26T10:21:34.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4066000000000001e-05 2024-04-26T10:21:34.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.762 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.762 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.762 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.253251+0000", 2024-04-26T10:21:34.762 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3087999999999999e-05 2024-04-26T10:21:34.762 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.762 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.762 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.763 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.763 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:2910 5.5 5:ab833b43:::benchmark_data_smithi052_19421_object2909:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:21:34.763 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.549396+0000", 2024-04-26T10:21:34.763 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.093683145999999995, 2024-04-26T10:21:34.763 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012137289000000001, 2024-04-26T10:21:34.763 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.763 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.763 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:34.763 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:34.763 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.763 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 2910 2024-04-26T10:21:34.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.764 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549396+0000", 2024-04-26T10:21:34.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.764 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549396+0000", 2024-04-26T10:21:34.764 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.764 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.764 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549395+0000", 2024-04-26T10:21:34.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549517+0000", 2024-04-26T10:21:34.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012146699999999999 2024-04-26T10:21:34.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.765 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.765 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.765 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549523+0000", 2024-04-26T10:21:34.765 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8830000000000003e-06 2024-04-26T10:21:34.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549526+0000", 2024-04-26T10:21:34.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.641e-06 2024-04-26T10:21:34.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.766 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.766 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.766 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549579+0000", 2024-04-26T10:21:34.766 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2583000000000001e-05 2024-04-26T10:21:34.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549722+0000", 2024-04-26T10:21:34.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000143113 2024-04-26T10:21:34.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:34.767 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549836+0000", 2024-04-26T10:21:34.767 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011388899999999999 2024-04-26T10:21:34.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.767 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.767 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:34.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.550998+0000", 2024-04-26T10:21:34.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011616020000000001 2024-04-26T10:21:34.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.561413+0000", 2024-04-26T10:21:34.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010415725000000001 2024-04-26T10:21:34.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.768 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.768 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:34.768 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.561481+0000", 2024-04-26T10:21:34.768 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7753e-05 2024-04-26T10:21:34.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.769 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.769 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.561533+0000", 2024-04-26T10:21:34.769 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2408999999999999e-05 2024-04-26T10:21:34.769 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.769 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.769 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.769 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.769 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:2911 5.5 5:aa4551fc:::benchmark_data_smithi052_19421_object2910:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:21:34.769 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.549548+0000", 2024-04-26T10:21:34.770 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.093530928999999999, 2024-04-26T10:21:34.770 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012127443999999999, 2024-04-26T10:21:34.770 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:34.770 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:34.770 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:34.770 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:34.770 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.770 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 2911 2024-04-26T10:21:34.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.770 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:34.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.770 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:34.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549548+0000", 2024-04-26T10:21:34.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:34.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549548+0000", 2024-04-26T10:21:34.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:34.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:34.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549548+0000", 2024-04-26T10:21:34.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:34.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549658+0000", 2024-04-26T10:21:34.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011038 2024-04-26T10:21:34.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:34.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549666+0000", 2024-04-26T10:21:34.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.503e-06 2024-04-26T10:21:34.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549688+0000", 2024-04-26T10:21:34.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2297999999999999e-05 2024-04-26T10:21:34.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:34.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.550372+0000", 2024-04-26T10:21:34.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00068394899999999999 2024-04-26T10:21:34.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:34.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.550474+0000", 2024-04-26T10:21:34.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000102334 2024-04-26T10:21:34.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:34.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.550583+0000", 2024-04-26T10:21:34.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0001083 2024-04-26T10:21:34.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:34.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.554146+0000", 2024-04-26T10:21:34.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035630969999999999 2024-04-26T10:21:34.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.561599+0000", 2024-04-26T10:21:34.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074533029999999997 2024-04-26T10:21:34.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.775 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:34.775 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.561643+0000", 2024-04-26T10:21:34.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4221000000000002e-05 2024-04-26T10:21:34.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:34.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:34.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:34.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.561676+0000", 2024-04-26T10:21:34.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2598000000000002e-05 2024-04-26T10:21:34.776 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.776 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.776 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.776 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:34.776 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:34.776 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T10:21:34.778 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:34.779 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:34.773+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:34.878 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:34.872+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:34.913 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:34.914 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:34.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.914 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:3942 5.d 5:b47a944f:::benchmark_data_smithi052_19421_object3941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:21:34.914 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:34.905762+0000", 2024-04-26T10:21:34.914 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0061152769999999997, 2024-04-26T10:21:34.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061430340000000003, 2024-04-26T10:21:34.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:34.914 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:34.914 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:34.914 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:34.914 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.915 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 3942 2024-04-26T10:21:34.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.915 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:34.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:34.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.905762+0000", 2024-04-26T10:21:34.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:34.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.905762+0000", 2024-04-26T10:21:34.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:34.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.905761+0000", 2024-04-26T10:21:34.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:34.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.905872+0000", 2024-04-26T10:21:34.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011108 2024-04-26T10:21:34.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:34.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.905885+0000", 2024-04-26T10:21:34.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3212e-05 2024-04-26T10:21:34.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.905890+0000", 2024-04-26T10:21:34.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3480000000000003e-06 2024-04-26T10:21:34.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:34.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.907258+0000", 2024-04-26T10:21:34.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013679689999999999 2024-04-26T10:21:34.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:34.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.907346+0000", 2024-04-26T10:21:34.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8080999999999999e-05 2024-04-26T10:21:34.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.907420+0000", 2024-04-26T10:21:34.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3385000000000003e-05 2024-04-26T10:21:34.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911745+0000", 2024-04-26T10:21:34.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043253789999999999 2024-04-26T10:21:34.918 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.918 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:34.918 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.919 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:3944 5.7 5:e52185bc:::benchmark_data_smithi052_19421_object3943:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:21:34.919 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:34.906300+0000", 2024-04-26T10:21:34.919 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0055769319999999997, 2024-04-26T10:21:34.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056959360000000004, 2024-04-26T10:21:34.919 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:34.919 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:34.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:34.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:34.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.919 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 3944 2024-04-26T10:21:34.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.919 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:34.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:34.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.906300+0000", 2024-04-26T10:21:34.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:34.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.906300+0000", 2024-04-26T10:21:34.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:34.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.906299+0000", 2024-04-26T10:21:34.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:34.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.906358+0000", 2024-04-26T10:21:34.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8729e-05 2024-04-26T10:21:34.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:34.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.906379+0000", 2024-04-26T10:21:34.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1188000000000001e-05 2024-04-26T10:21:34.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.906387+0000", 2024-04-26T10:21:34.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6009999999999997e-06 2024-04-26T10:21:34.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:34.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.906491+0000", 2024-04-26T10:21:34.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104199 2024-04-26T10:21:34.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:34.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.906604+0000", 2024-04-26T10:21:34.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011322100000000001 2024-04-26T10:21:34.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-04-26T10:21:34.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.906761+0000", 2024-04-26T10:21:34.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000157293 2024-04-26T10:21:34.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.908040+0000", 2024-04-26T10:21:34.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012789310000000001 2024-04-26T10:21:34.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:34.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911946+0000", 2024-04-26T10:21:34.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039055280000000001 2024-04-26T10:21:34.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.923 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:34.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.924 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:3945 5.d 5:b2fb39c3:::benchmark_data_smithi052_19421_object3944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:21:34.924 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:34.906401+0000", 2024-04-26T10:21:34.924 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0054761300000000001, 2024-04-26T10:21:34.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056809970000000001, 2024-04-26T10:21:34.924 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:34.924 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:34.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:34.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:34.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.924 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 3945 2024-04-26T10:21:34.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.924 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:34.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:34.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.906401+0000", 2024-04-26T10:21:34.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:34.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.906401+0000", 2024-04-26T10:21:34.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:34.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.906400+0000", 2024-04-26T10:21:34.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:34.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.906438+0000", 2024-04-26T10:21:34.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8179000000000002e-05 2024-04-26T10:21:34.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:34.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.906447+0000", 2024-04-26T10:21:34.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3629999999999994e-06 2024-04-26T10:21:34.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.906454+0000", 2024-04-26T10:21:34.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2810000000000003e-06 2024-04-26T10:21:34.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:34.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.907884+0000", 2024-04-26T10:21:34.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001430286 2024-04-26T10:21:34.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:34.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.907965+0000", 2024-04-26T10:21:34.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1051999999999996e-05 2024-04-26T10:21:34.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.908078+0000", 2024-04-26T10:21:34.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112766 2024-04-26T10:21:34.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911785+0000", 2024-04-26T10:21:34.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037069490000000002 2024-04-26T10:21:34.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.930 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:34.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.930 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:3948 5.d 5:b5933312:::benchmark_data_smithi052_19421_object3947:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:21:34.931 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:34.907015+0000", 2024-04-26T10:21:34.931 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0048621109999999997, 2024-04-26T10:21:34.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051101749999999998, 2024-04-26T10:21:34.931 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:34.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:34.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:34.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:34.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.931 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 3948 2024-04-26T10:21:34.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.931 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:34.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:34.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.907015+0000", 2024-04-26T10:21:34.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:34.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.907015+0000", 2024-04-26T10:21:34.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:34.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.907014+0000", 2024-04-26T10:21:34.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:34.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.907097+0000", 2024-04-26T10:21:34.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3257999999999995e-05 2024-04-26T10:21:34.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:34.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.907113+0000", 2024-04-26T10:21:34.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6132000000000001e-05 2024-04-26T10:21:34.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.907121+0000", 2024-04-26T10:21:34.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7880000000000007e-06 2024-04-26T10:21:34.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:34.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.908587+0000", 2024-04-26T10:21:34.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014662709999999999 2024-04-26T10:21:34.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:34.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.908724+0000", 2024-04-26T10:21:34.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000137052 2024-04-26T10:21:34.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.908884+0000", 2024-04-26T10:21:34.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015930100000000001 2024-04-26T10:21:34.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:34.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911819+0000", 2024-04-26T10:21:34.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029354530000000002 2024-04-26T10:21:34.935 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.935 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:34.935 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.935 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:3950 5.d 5:be435fce:::benchmark_data_smithi052_19421_object3949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:21:34.935 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:34.908279+0000", 2024-04-26T10:21:34.935 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0035975360000000001, 2024-04-26T10:21:34.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038857800000000001, 2024-04-26T10:21:34.935 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:34.935 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:34.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:34.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:34.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.936 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 3950 2024-04-26T10:21:34.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.936 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:34.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:34.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.908279+0000", 2024-04-26T10:21:34.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:34.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.908279+0000", 2024-04-26T10:21:34.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:34.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.908278+0000", 2024-04-26T10:21:34.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:34.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.908311+0000", 2024-04-26T10:21:34.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2867999999999998e-05 2024-04-26T10:21:34.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:34.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.908323+0000", 2024-04-26T10:21:34.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2024999999999999e-05 2024-04-26T10:21:34.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.908344+0000", 2024-04-26T10:21:34.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0344e-05 2024-04-26T10:21:34.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:34.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.909560+0000", 2024-04-26T10:21:34.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012166690000000001 2024-04-26T10:21:34.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:34.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.909695+0000", 2024-04-26T10:21:34.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134554 2024-04-26T10:21:34.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.909851+0000", 2024-04-26T10:21:34.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000156164 2024-04-26T10:21:34.939 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.939 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:34.939 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.939 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:3951 5.9 5:9230ea00:::benchmark_data_smithi052_19421_object3950:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:21:34.940 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:34.909031+0000", 2024-04-26T10:21:34.940 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0028462209999999999, 2024-04-26T10:21:34.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031872160000000001, 2024-04-26T10:21:34.940 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:34.940 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:34.940 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:34.940 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:34.940 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.940 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 3951 2024-04-26T10:21:34.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.940 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:34.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:34.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.909031+0000", 2024-04-26T10:21:34.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:34.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.909031+0000", 2024-04-26T10:21:34.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:34.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.909030+0000", 2024-04-26T10:21:34.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:34.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.909096+0000", 2024-04-26T10:21:34.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6068999999999994e-05 2024-04-26T10:21:34.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:34.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.909108+0000", 2024-04-26T10:21:34.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1894e-05 2024-04-26T10:21:34.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.909116+0000", 2024-04-26T10:21:34.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5210000000000002e-06 2024-04-26T10:21:34.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:34.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.909178+0000", 2024-04-26T10:21:34.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1692000000000005e-05 2024-04-26T10:21:34.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:34.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.909369+0000", 2024-04-26T10:21:34.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019109800000000001 2024-04-26T10:21:34.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.909508+0000", 2024-04-26T10:21:34.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013887900000000001 2024-04-26T10:21:34.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.944 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:34.944 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.944 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:3957 5.f 5:f52256e7:::benchmark_data_smithi052_19421_object3956:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:21:34.944 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:34.910815+0000", 2024-04-26T10:21:34.944 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0010624779999999999, 2024-04-26T10:21:34.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001491126, 2024-04-26T10:21:34.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:34.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:34.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:34.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:34.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:34.944 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 3957 2024-04-26T10:21:34.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.945 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:34.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:34.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.910815+0000", 2024-04-26T10:21:34.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:34.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.910815+0000", 2024-04-26T10:21:34.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:34.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.910813+0000", 2024-04-26T10:21:34.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:34.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.910958+0000", 2024-04-26T10:21:34.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014454 2024-04-26T10:21:34.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:34.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.910972+0000", 2024-04-26T10:21:34.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3937000000000001e-05 2024-04-26T10:21:34.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.910981+0000", 2024-04-26T10:21:34.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0170000000000002e-06 2024-04-26T10:21:34.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:34.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911024+0000", 2024-04-26T10:21:34.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3347999999999999e-05 2024-04-26T10:21:34.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:34.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911121+0000", 2024-04-26T10:21:34.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6686000000000002e-05 2024-04-26T10:21:34.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:34.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911205+0000", 2024-04-26T10:21:34.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3559000000000004e-05 2024-04-26T10:21:34.948 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.948 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:34.948 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.948 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:3955 5.5 e25/22 5:a3bea776:::benchmark_data_smithi052_19421_object3954:head v 25'255, mlcod=25'253)", 2024-04-26T10:21:34.948 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:34.911483+0000", 2024-04-26T10:21:34.948 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00039391799999999999, 2024-04-26T10:21:34.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00089263600000000004, 2024-04-26T10:21:34.949 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:34.949 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:34.949 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:34.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:34.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911483+0000", 2024-04-26T10:21:34.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:34.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911483+0000", 2024-04-26T10:21:34.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:34.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911474+0000", 2024-04-26T10:21:34.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999905 2024-04-26T10:21:34.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:34.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911574+0000", 2024-04-26T10:21:34.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010004400000000001 2024-04-26T10:21:34.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:34.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911589+0000", 2024-04-26T10:21:34.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5284000000000001e-05 2024-04-26T10:21:34.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911597+0000", 2024-04-26T10:21:34.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4669999999999998e-06 2024-04-26T10:21:34.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:34.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911664+0000", 2024-04-26T10:21:34.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7219999999999997e-05 2024-04-26T10:21:34.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:34.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911682+0000", 2024-04-26T10:21:34.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8474e-05 2024-04-26T10:21:34.952 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.952 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:34.952 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.952 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:3954 5.6 e25/22 5:67f59ae7:::benchmark_data_smithi052_19421_object3953:head v 25'245, mlcod=25'243)", 2024-04-26T10:21:34.952 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:34.911753+0000", 2024-04-26T10:21:34.952 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00012410700000000001, 2024-04-26T10:21:34.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00065375999999999997, 2024-04-26T10:21:34.952 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:34.952 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:34.952 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:34.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:34.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911753+0000", 2024-04-26T10:21:34.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:34.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911753+0000", 2024-04-26T10:21:34.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:34.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911752+0000", 2024-04-26T10:21:34.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:34.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:34.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911827+0000", 2024-04-26T10:21:34.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5166000000000005e-05 2024-04-26T10:21:34.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:34.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911849+0000", 2024-04-26T10:21:34.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2135999999999999e-05 2024-04-26T10:21:34.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911857+0000", 2024-04-26T10:21:34.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8590000000000005e-06 2024-04-26T10:21:34.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:34.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911908+0000", 2024-04-26T10:21:34.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0735000000000001e-05 2024-04-26T10:21:34.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:34.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.911929+0000", 2024-04-26T10:21:34.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1305e-05 2024-04-26T10:21:34.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.955 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:34.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.955 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:3958 5.3 e25/22 5:cae4c9d5:::benchmark_data_smithi052_19421_object3957:head v 25'265, mlcod=25'263)", 2024-04-26T10:21:34.956 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:34.912206+0000", 2024-04-26T10:21:34.956 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.999671, 2024-04-26T10:21:34.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023670000000000001, 2024-04-26T10:21:34.956 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:34.956 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:34.956 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:34.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:34.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.912206+0000", 2024-04-26T10:21:34.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:34.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.912206+0000", 2024-04-26T10:21:34.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:34.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:34.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.912205+0000", 2024-04-26T10:21:34.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:34.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:34.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.912302+0000", 2024-04-26T10:21:34.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6871000000000001e-05 2024-04-26T10:21:34.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:34.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.912312+0000", 2024-04-26T10:21:34.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0158e-05 2024-04-26T10:21:34.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:34.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.912326+0000", 2024-04-26T10:21:34.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3635000000000001e-05 2024-04-26T10:21:34.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:34.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.912394+0000", 2024-04-26T10:21:34.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8384000000000001e-05 2024-04-26T10:21:34.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:34.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:34.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:34.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:34.912420+0000", 2024-04-26T10:21:34.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5570000000000001e-05 2024-04-26T10:21:34.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.959 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:34.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:34.959 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:21:34.959 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 10 2024-04-26T10:21:34.959 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:34.960 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:34.980 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:34.977+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:35.081 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:35.077+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:35.084 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:35.084 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:21:35.084 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:21:35.084 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:21:35.084 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:35.095 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2024-04-26T10:21:35.096 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:35.182 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:35.177+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:35.201 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-26T10:21:35.201 INFO:teuthology.orchestra.run.smithi052.stdout: "ops": [ 2024-04-26T10:21:35.201 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:35.201 INFO:teuthology.orchestra.run.smithi052.stdout: "tid": 4791, 2024-04-26T10:21:35.201 INFO:teuthology.orchestra.run.smithi052.stdout: "pg": "5.713f3582", 2024-04-26T10:21:35.201 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T10:21:35.201 INFO:teuthology.orchestra.run.smithi052.stdout: "object_id": "benchmark_data_smithi052_19421_object4790", 2024-04-26T10:21:35.201 INFO:teuthology.orchestra.run.smithi052.stdout: "object_locator": "@5", 2024-04-26T10:21:35.202 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_id": "benchmark_data_smithi052_19421_object4790", 2024-04-26T10:21:35.202 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_locator": "@5", 2024-04-26T10:21:35.202 INFO:teuthology.orchestra.run.smithi052.stdout: "paused": 0, 2024-04-26T10:21:35.202 INFO:teuthology.orchestra.run.smithi052.stdout: "used_replica": 0, 2024-04-26T10:21:35.202 INFO:teuthology.orchestra.run.smithi052.stdout: "precalc_pgid": 0, 2024-04-26T10:21:35.202 INFO:teuthology.orchestra.run.smithi052.stdout: "last_sent": "615.502015s", 2024-04-26T10:21:35.202 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0040000399999999998, 2024-04-26T10:21:35.202 INFO:teuthology.orchestra.run.smithi052.stdout: "attempts": 1, 2024-04-26T10:21:35.202 INFO:teuthology.orchestra.run.smithi052.stdout: "snapid": "head", 2024-04-26T10:21:35.202 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_context": "0=[]", 2024-04-26T10:21:35.202 INFO:teuthology.orchestra.run.smithi052.stdout: "mtime": "2024-04-26T10:21:35.195562+0000", 2024-04-26T10:21:35.202 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ops": [ 2024-04-26T10:21:35.202 INFO:teuthology.orchestra.run.smithi052.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:21:35.203 INFO:teuthology.orchestra.run.smithi052.stdout: "write 0~65536 in=65536b" 2024-04-26T10:21:35.203 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:35.203 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:35.203 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:35.203 INFO:teuthology.orchestra.run.smithi052.stdout: "tid": 4793, 2024-04-26T10:21:35.203 INFO:teuthology.orchestra.run.smithi052.stdout: "pg": "5.6648822f", 2024-04-26T10:21:35.203 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T10:21:35.203 INFO:teuthology.orchestra.run.smithi052.stdout: "object_id": "benchmark_data_smithi052_19421_object4792", 2024-04-26T10:21:35.203 INFO:teuthology.orchestra.run.smithi052.stdout: "object_locator": "@5", 2024-04-26T10:21:35.203 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_id": "benchmark_data_smithi052_19421_object4792", 2024-04-26T10:21:35.203 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_locator": "@5", 2024-04-26T10:21:35.203 INFO:teuthology.orchestra.run.smithi052.stdout: "paused": 0, 2024-04-26T10:21:35.203 INFO:teuthology.orchestra.run.smithi052.stdout: "used_replica": 0, 2024-04-26T10:21:35.204 INFO:teuthology.orchestra.run.smithi052.stdout: "precalc_pgid": 0, 2024-04-26T10:21:35.204 INFO:teuthology.orchestra.run.smithi052.stdout: "last_sent": "615.502015s", 2024-04-26T10:21:35.204 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0040000399999999998, 2024-04-26T10:21:35.204 INFO:teuthology.orchestra.run.smithi052.stdout: "attempts": 1, 2024-04-26T10:21:35.204 INFO:teuthology.orchestra.run.smithi052.stdout: "snapid": "head", 2024-04-26T10:21:35.204 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_context": "0=[]", 2024-04-26T10:21:35.204 INFO:teuthology.orchestra.run.smithi052.stdout: "mtime": "2024-04-26T10:21:35.195759+0000", 2024-04-26T10:21:35.204 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ops": [ 2024-04-26T10:21:35.204 INFO:teuthology.orchestra.run.smithi052.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:21:35.204 INFO:teuthology.orchestra.run.smithi052.stdout: "write 0~65536 in=65536b" 2024-04-26T10:21:35.204 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:35.204 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:35.204 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:35.204 INFO:teuthology.orchestra.run.smithi052.stdout: "tid": 4794, 2024-04-26T10:21:35.205 INFO:teuthology.orchestra.run.smithi052.stdout: "pg": "5.67b78e71", 2024-04-26T10:21:35.205 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T10:21:35.205 INFO:teuthology.orchestra.run.smithi052.stdout: "object_id": "benchmark_data_smithi052_19421_object4793", 2024-04-26T10:21:35.205 INFO:teuthology.orchestra.run.smithi052.stdout: "object_locator": "@5", 2024-04-26T10:21:35.205 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_id": "benchmark_data_smithi052_19421_object4793", 2024-04-26T10:21:35.205 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_locator": "@5", 2024-04-26T10:21:35.205 INFO:teuthology.orchestra.run.smithi052.stdout: "paused": 0, 2024-04-26T10:21:35.205 INFO:teuthology.orchestra.run.smithi052.stdout: "used_replica": 0, 2024-04-26T10:21:35.205 INFO:teuthology.orchestra.run.smithi052.stdout: "precalc_pgid": 0, 2024-04-26T10:21:35.205 INFO:teuthology.orchestra.run.smithi052.stdout: "last_sent": "615.502015s", 2024-04-26T10:21:35.205 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0.0040000399999999998, 2024-04-26T10:21:35.205 INFO:teuthology.orchestra.run.smithi052.stdout: "attempts": 1, 2024-04-26T10:21:35.205 INFO:teuthology.orchestra.run.smithi052.stdout: "snapid": "head", 2024-04-26T10:21:35.206 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_context": "0=[]", 2024-04-26T10:21:35.206 INFO:teuthology.orchestra.run.smithi052.stdout: "mtime": "2024-04-26T10:21:35.195899+0000", 2024-04-26T10:21:35.206 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ops": [ 2024-04-26T10:21:35.206 INFO:teuthology.orchestra.run.smithi052.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:21:35.206 INFO:teuthology.orchestra.run.smithi052.stdout: "write 0~65536 in=65536b" 2024-04-26T10:21:35.206 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:35.206 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:35.206 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:35.206 INFO:teuthology.orchestra.run.smithi052.stdout: "tid": 4795, 2024-04-26T10:21:35.206 INFO:teuthology.orchestra.run.smithi052.stdout: "pg": "5.4f19951f", 2024-04-26T10:21:35.206 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T10:21:35.206 INFO:teuthology.orchestra.run.smithi052.stdout: "object_id": "benchmark_data_smithi052_19421_object4794", 2024-04-26T10:21:35.206 INFO:teuthology.orchestra.run.smithi052.stdout: "object_locator": "@5", 2024-04-26T10:21:35.207 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_id": "benchmark_data_smithi052_19421_object4794", 2024-04-26T10:21:35.207 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_locator": "@5", 2024-04-26T10:21:35.207 INFO:teuthology.orchestra.run.smithi052.stdout: "paused": 0, 2024-04-26T10:21:35.207 INFO:teuthology.orchestra.run.smithi052.stdout: "used_replica": 0, 2024-04-26T10:21:35.207 INFO:teuthology.orchestra.run.smithi052.stdout: "precalc_pgid": 0, 2024-04-26T10:21:35.207 INFO:teuthology.orchestra.run.smithi052.stdout: "last_sent": "615.506015s", 2024-04-26T10:21:35.207 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0, 2024-04-26T10:21:35.207 INFO:teuthology.orchestra.run.smithi052.stdout: "attempts": 1, 2024-04-26T10:21:35.207 INFO:teuthology.orchestra.run.smithi052.stdout: "snapid": "head", 2024-04-26T10:21:35.207 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_context": "0=[]", 2024-04-26T10:21:35.207 INFO:teuthology.orchestra.run.smithi052.stdout: "mtime": "2024-04-26T10:21:35.198222+0000", 2024-04-26T10:21:35.207 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ops": [ 2024-04-26T10:21:35.207 INFO:teuthology.orchestra.run.smithi052.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:21:35.208 INFO:teuthology.orchestra.run.smithi052.stdout: "write 0~65536 in=65536b" 2024-04-26T10:21:35.208 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:35.208 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:35.208 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:35.208 INFO:teuthology.orchestra.run.smithi052.stdout: "tid": 4797, 2024-04-26T10:21:35.208 INFO:teuthology.orchestra.run.smithi052.stdout: "pg": "5.9d1380b1", 2024-04-26T10:21:35.208 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T10:21:35.208 INFO:teuthology.orchestra.run.smithi052.stdout: "object_id": "benchmark_data_smithi052_19421_object4796", 2024-04-26T10:21:35.208 INFO:teuthology.orchestra.run.smithi052.stdout: "object_locator": "@5", 2024-04-26T10:21:35.208 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_id": "benchmark_data_smithi052_19421_object4796", 2024-04-26T10:21:35.208 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_locator": "@5", 2024-04-26T10:21:35.208 INFO:teuthology.orchestra.run.smithi052.stdout: "paused": 0, 2024-04-26T10:21:35.208 INFO:teuthology.orchestra.run.smithi052.stdout: "used_replica": 0, 2024-04-26T10:21:35.209 INFO:teuthology.orchestra.run.smithi052.stdout: "precalc_pgid": 0, 2024-04-26T10:21:35.209 INFO:teuthology.orchestra.run.smithi052.stdout: "last_sent": "615.506015s", 2024-04-26T10:21:35.209 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0, 2024-04-26T10:21:35.209 INFO:teuthology.orchestra.run.smithi052.stdout: "attempts": 1, 2024-04-26T10:21:35.209 INFO:teuthology.orchestra.run.smithi052.stdout: "snapid": "head", 2024-04-26T10:21:35.209 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_context": "0=[]", 2024-04-26T10:21:35.209 INFO:teuthology.orchestra.run.smithi052.stdout: "mtime": "2024-04-26T10:21:35.198293+0000", 2024-04-26T10:21:35.209 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ops": [ 2024-04-26T10:21:35.209 INFO:teuthology.orchestra.run.smithi052.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:21:35.209 INFO:teuthology.orchestra.run.smithi052.stdout: "write 0~65536 in=65536b" 2024-04-26T10:21:35.209 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:35.210 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:35.210 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:35.210 INFO:teuthology.orchestra.run.smithi052.stdout: "tid": 4798, 2024-04-26T10:21:35.210 INFO:teuthology.orchestra.run.smithi052.stdout: "pg": "5.9d2626f1", 2024-04-26T10:21:35.210 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T10:21:35.210 INFO:teuthology.orchestra.run.smithi052.stdout: "object_id": "benchmark_data_smithi052_19421_object4797", 2024-04-26T10:21:35.210 INFO:teuthology.orchestra.run.smithi052.stdout: "object_locator": "@5", 2024-04-26T10:21:35.210 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_id": "benchmark_data_smithi052_19421_object4797", 2024-04-26T10:21:35.210 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_locator": "@5", 2024-04-26T10:21:35.210 INFO:teuthology.orchestra.run.smithi052.stdout: "paused": 0, 2024-04-26T10:21:35.210 INFO:teuthology.orchestra.run.smithi052.stdout: "used_replica": 0, 2024-04-26T10:21:35.210 INFO:teuthology.orchestra.run.smithi052.stdout: "precalc_pgid": 0, 2024-04-26T10:21:35.211 INFO:teuthology.orchestra.run.smithi052.stdout: "last_sent": "615.506015s", 2024-04-26T10:21:35.211 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0, 2024-04-26T10:21:35.211 INFO:teuthology.orchestra.run.smithi052.stdout: "attempts": 1, 2024-04-26T10:21:35.211 INFO:teuthology.orchestra.run.smithi052.stdout: "snapid": "head", 2024-04-26T10:21:35.211 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_context": "0=[]", 2024-04-26T10:21:35.211 INFO:teuthology.orchestra.run.smithi052.stdout: "mtime": "2024-04-26T10:21:35.198307+0000", 2024-04-26T10:21:35.211 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ops": [ 2024-04-26T10:21:35.211 INFO:teuthology.orchestra.run.smithi052.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:21:35.211 INFO:teuthology.orchestra.run.smithi052.stdout: "write 0~65536 in=65536b" 2024-04-26T10:21:35.211 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:35.211 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:35.211 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:35.211 INFO:teuthology.orchestra.run.smithi052.stdout: "tid": 4799, 2024-04-26T10:21:35.212 INFO:teuthology.orchestra.run.smithi052.stdout: "pg": "5.2ef4afaf", 2024-04-26T10:21:35.212 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T10:21:35.212 INFO:teuthology.orchestra.run.smithi052.stdout: "object_id": "benchmark_data_smithi052_19421_object4798", 2024-04-26T10:21:35.212 INFO:teuthology.orchestra.run.smithi052.stdout: "object_locator": "@5", 2024-04-26T10:21:35.212 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_id": "benchmark_data_smithi052_19421_object4798", 2024-04-26T10:21:35.212 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_locator": "@5", 2024-04-26T10:21:35.212 INFO:teuthology.orchestra.run.smithi052.stdout: "paused": 0, 2024-04-26T10:21:35.212 INFO:teuthology.orchestra.run.smithi052.stdout: "used_replica": 0, 2024-04-26T10:21:35.212 INFO:teuthology.orchestra.run.smithi052.stdout: "precalc_pgid": 0, 2024-04-26T10:21:35.212 INFO:teuthology.orchestra.run.smithi052.stdout: "last_sent": "615.506015s", 2024-04-26T10:21:35.212 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0, 2024-04-26T10:21:35.212 INFO:teuthology.orchestra.run.smithi052.stdout: "attempts": 1, 2024-04-26T10:21:35.212 INFO:teuthology.orchestra.run.smithi052.stdout: "snapid": "head", 2024-04-26T10:21:35.213 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_context": "0=[]", 2024-04-26T10:21:35.213 INFO:teuthology.orchestra.run.smithi052.stdout: "mtime": "2024-04-26T10:21:35.198316+0000", 2024-04-26T10:21:35.213 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ops": [ 2024-04-26T10:21:35.213 INFO:teuthology.orchestra.run.smithi052.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:21:35.213 INFO:teuthology.orchestra.run.smithi052.stdout: "write 0~65536 in=65536b" 2024-04-26T10:21:35.213 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:35.213 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:35.213 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:35.213 INFO:teuthology.orchestra.run.smithi052.stdout: "tid": 4800, 2024-04-26T10:21:35.213 INFO:teuthology.orchestra.run.smithi052.stdout: "pg": "5.2f674b2d", 2024-04-26T10:21:35.213 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T10:21:35.213 INFO:teuthology.orchestra.run.smithi052.stdout: "object_id": "benchmark_data_smithi052_19421_object4799", 2024-04-26T10:21:35.213 INFO:teuthology.orchestra.run.smithi052.stdout: "object_locator": "@5", 2024-04-26T10:21:35.214 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_id": "benchmark_data_smithi052_19421_object4799", 2024-04-26T10:21:35.214 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_locator": "@5", 2024-04-26T10:21:35.214 INFO:teuthology.orchestra.run.smithi052.stdout: "paused": 0, 2024-04-26T10:21:35.214 INFO:teuthology.orchestra.run.smithi052.stdout: "used_replica": 0, 2024-04-26T10:21:35.214 INFO:teuthology.orchestra.run.smithi052.stdout: "precalc_pgid": 0, 2024-04-26T10:21:35.214 INFO:teuthology.orchestra.run.smithi052.stdout: "last_sent": "615.506015s", 2024-04-26T10:21:35.214 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0, 2024-04-26T10:21:35.214 INFO:teuthology.orchestra.run.smithi052.stdout: "attempts": 1, 2024-04-26T10:21:35.214 INFO:teuthology.orchestra.run.smithi052.stdout: "snapid": "head", 2024-04-26T10:21:35.214 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_context": "0=[]", 2024-04-26T10:21:35.214 INFO:teuthology.orchestra.run.smithi052.stdout: "mtime": "2024-04-26T10:21:35.198324+0000", 2024-04-26T10:21:35.214 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ops": [ 2024-04-26T10:21:35.215 INFO:teuthology.orchestra.run.smithi052.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:21:35.215 INFO:teuthology.orchestra.run.smithi052.stdout: "write 0~65536 in=65536b" 2024-04-26T10:21:35.215 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:35.215 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:35.215 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:35.215 INFO:teuthology.orchestra.run.smithi052.stdout: "tid": 4803, 2024-04-26T10:21:35.215 INFO:teuthology.orchestra.run.smithi052.stdout: "pg": "5.718ef509", 2024-04-26T10:21:35.215 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T10:21:35.215 INFO:teuthology.orchestra.run.smithi052.stdout: "object_id": "benchmark_data_smithi052_19421_object4802", 2024-04-26T10:21:35.215 INFO:teuthology.orchestra.run.smithi052.stdout: "object_locator": "@5", 2024-04-26T10:21:35.215 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_id": "benchmark_data_smithi052_19421_object4802", 2024-04-26T10:21:35.215 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_locator": "@5", 2024-04-26T10:21:35.216 INFO:teuthology.orchestra.run.smithi052.stdout: "paused": 0, 2024-04-26T10:21:35.216 INFO:teuthology.orchestra.run.smithi052.stdout: "used_replica": 0, 2024-04-26T10:21:35.216 INFO:teuthology.orchestra.run.smithi052.stdout: "precalc_pgid": 0, 2024-04-26T10:21:35.216 INFO:teuthology.orchestra.run.smithi052.stdout: "last_sent": "615.506015s", 2024-04-26T10:21:35.216 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0, 2024-04-26T10:21:35.216 INFO:teuthology.orchestra.run.smithi052.stdout: "attempts": 1, 2024-04-26T10:21:35.216 INFO:teuthology.orchestra.run.smithi052.stdout: "snapid": "head", 2024-04-26T10:21:35.216 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_context": "0=[]", 2024-04-26T10:21:35.216 INFO:teuthology.orchestra.run.smithi052.stdout: "mtime": "2024-04-26T10:21:35.198489+0000", 2024-04-26T10:21:35.216 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ops": [ 2024-04-26T10:21:35.216 INFO:teuthology.orchestra.run.smithi052.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:21:35.216 INFO:teuthology.orchestra.run.smithi052.stdout: "write 0~65536 in=65536b" 2024-04-26T10:21:35.216 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:35.217 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:35.217 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:35.217 INFO:teuthology.orchestra.run.smithi052.stdout: "tid": 4804, 2024-04-26T10:21:35.217 INFO:teuthology.orchestra.run.smithi052.stdout: "pg": "5.6fbbcf49", 2024-04-26T10:21:35.217 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T10:21:35.217 INFO:teuthology.orchestra.run.smithi052.stdout: "object_id": "benchmark_data_smithi052_19421_object4803", 2024-04-26T10:21:35.217 INFO:teuthology.orchestra.run.smithi052.stdout: "object_locator": "@5", 2024-04-26T10:21:35.217 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_id": "benchmark_data_smithi052_19421_object4803", 2024-04-26T10:21:35.217 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_locator": "@5", 2024-04-26T10:21:35.217 INFO:teuthology.orchestra.run.smithi052.stdout: "paused": 0, 2024-04-26T10:21:35.217 INFO:teuthology.orchestra.run.smithi052.stdout: "used_replica": 0, 2024-04-26T10:21:35.217 INFO:teuthology.orchestra.run.smithi052.stdout: "precalc_pgid": 0, 2024-04-26T10:21:35.217 INFO:teuthology.orchestra.run.smithi052.stdout: "last_sent": "615.506015s", 2024-04-26T10:21:35.217 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0, 2024-04-26T10:21:35.218 INFO:teuthology.orchestra.run.smithi052.stdout: "attempts": 1, 2024-04-26T10:21:35.218 INFO:teuthology.orchestra.run.smithi052.stdout: "snapid": "head", 2024-04-26T10:21:35.218 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_context": "0=[]", 2024-04-26T10:21:35.218 INFO:teuthology.orchestra.run.smithi052.stdout: "mtime": "2024-04-26T10:21:35.198685+0000", 2024-04-26T10:21:35.218 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ops": [ 2024-04-26T10:21:35.218 INFO:teuthology.orchestra.run.smithi052.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:21:35.218 INFO:teuthology.orchestra.run.smithi052.stdout: "write 0~65536 in=65536b" 2024-04-26T10:21:35.218 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:35.218 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:35.218 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:35.218 INFO:teuthology.orchestra.run.smithi052.stdout: "tid": 4806, 2024-04-26T10:21:35.218 INFO:teuthology.orchestra.run.smithi052.stdout: "pg": "5.3640f9ef", 2024-04-26T10:21:35.218 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T10:21:35.219 INFO:teuthology.orchestra.run.smithi052.stdout: "object_id": "benchmark_data_smithi052_19421_object4805", 2024-04-26T10:21:35.219 INFO:teuthology.orchestra.run.smithi052.stdout: "object_locator": "@5", 2024-04-26T10:21:35.219 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_id": "benchmark_data_smithi052_19421_object4805", 2024-04-26T10:21:35.219 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_locator": "@5", 2024-04-26T10:21:35.219 INFO:teuthology.orchestra.run.smithi052.stdout: "paused": 0, 2024-04-26T10:21:35.219 INFO:teuthology.orchestra.run.smithi052.stdout: "used_replica": 0, 2024-04-26T10:21:35.219 INFO:teuthology.orchestra.run.smithi052.stdout: "precalc_pgid": 0, 2024-04-26T10:21:35.219 INFO:teuthology.orchestra.run.smithi052.stdout: "last_sent": "615.506015s", 2024-04-26T10:21:35.219 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0, 2024-04-26T10:21:35.219 INFO:teuthology.orchestra.run.smithi052.stdout: "attempts": 1, 2024-04-26T10:21:35.219 INFO:teuthology.orchestra.run.smithi052.stdout: "snapid": "head", 2024-04-26T10:21:35.219 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_context": "0=[]", 2024-04-26T10:21:35.219 INFO:teuthology.orchestra.run.smithi052.stdout: "mtime": "2024-04-26T10:21:35.199262+0000", 2024-04-26T10:21:35.219 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ops": [ 2024-04-26T10:21:35.220 INFO:teuthology.orchestra.run.smithi052.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:21:35.220 INFO:teuthology.orchestra.run.smithi052.stdout: "write 0~65536 in=65536b" 2024-04-26T10:21:35.220 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:35.220 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:35.220 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:35.220 INFO:teuthology.orchestra.run.smithi052.stdout: "tid": 4796, 2024-04-26T10:21:35.220 INFO:teuthology.orchestra.run.smithi052.stdout: "pg": "5.4f257568", 2024-04-26T10:21:35.220 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-04-26T10:21:35.220 INFO:teuthology.orchestra.run.smithi052.stdout: "object_id": "benchmark_data_smithi052_19421_object4795", 2024-04-26T10:21:35.220 INFO:teuthology.orchestra.run.smithi052.stdout: "object_locator": "@5", 2024-04-26T10:21:35.220 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_id": "benchmark_data_smithi052_19421_object4795", 2024-04-26T10:21:35.220 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_locator": "@5", 2024-04-26T10:21:35.220 INFO:teuthology.orchestra.run.smithi052.stdout: "paused": 0, 2024-04-26T10:21:35.220 INFO:teuthology.orchestra.run.smithi052.stdout: "used_replica": 0, 2024-04-26T10:21:35.221 INFO:teuthology.orchestra.run.smithi052.stdout: "precalc_pgid": 0, 2024-04-26T10:21:35.221 INFO:teuthology.orchestra.run.smithi052.stdout: "last_sent": "615.506015s", 2024-04-26T10:21:35.221 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0, 2024-04-26T10:21:35.221 INFO:teuthology.orchestra.run.smithi052.stdout: "attempts": 1, 2024-04-26T10:21:35.221 INFO:teuthology.orchestra.run.smithi052.stdout: "snapid": "head", 2024-04-26T10:21:35.221 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_context": "0=[]", 2024-04-26T10:21:35.221 INFO:teuthology.orchestra.run.smithi052.stdout: "mtime": "2024-04-26T10:21:35.198262+0000", 2024-04-26T10:21:35.221 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ops": [ 2024-04-26T10:21:35.221 INFO:teuthology.orchestra.run.smithi052.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:21:35.221 INFO:teuthology.orchestra.run.smithi052.stdout: "write 0~65536 in=65536b" 2024-04-26T10:21:35.221 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:35.221 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:35.221 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:35.221 INFO:teuthology.orchestra.run.smithi052.stdout: "tid": 4801, 2024-04-26T10:21:35.222 INFO:teuthology.orchestra.run.smithi052.stdout: "pg": "5.79a1ce73", 2024-04-26T10:21:35.222 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-04-26T10:21:35.222 INFO:teuthology.orchestra.run.smithi052.stdout: "object_id": "benchmark_data_smithi052_19421_object4800", 2024-04-26T10:21:35.222 INFO:teuthology.orchestra.run.smithi052.stdout: "object_locator": "@5", 2024-04-26T10:21:35.222 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_id": "benchmark_data_smithi052_19421_object4800", 2024-04-26T10:21:35.222 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_locator": "@5", 2024-04-26T10:21:35.222 INFO:teuthology.orchestra.run.smithi052.stdout: "paused": 0, 2024-04-26T10:21:35.222 INFO:teuthology.orchestra.run.smithi052.stdout: "used_replica": 0, 2024-04-26T10:21:35.222 INFO:teuthology.orchestra.run.smithi052.stdout: "precalc_pgid": 0, 2024-04-26T10:21:35.222 INFO:teuthology.orchestra.run.smithi052.stdout: "last_sent": "615.506015s", 2024-04-26T10:21:35.222 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0, 2024-04-26T10:21:35.222 INFO:teuthology.orchestra.run.smithi052.stdout: "attempts": 1, 2024-04-26T10:21:35.222 INFO:teuthology.orchestra.run.smithi052.stdout: "snapid": "head", 2024-04-26T10:21:35.222 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_context": "0=[]", 2024-04-26T10:21:35.223 INFO:teuthology.orchestra.run.smithi052.stdout: "mtime": "2024-04-26T10:21:35.198453+0000", 2024-04-26T10:21:35.223 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ops": [ 2024-04-26T10:21:35.223 INFO:teuthology.orchestra.run.smithi052.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:21:35.223 INFO:teuthology.orchestra.run.smithi052.stdout: "write 0~65536 in=65536b" 2024-04-26T10:21:35.223 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:35.223 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:35.223 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:35.223 INFO:teuthology.orchestra.run.smithi052.stdout: "tid": 4802, 2024-04-26T10:21:35.223 INFO:teuthology.orchestra.run.smithi052.stdout: "pg": "5.a07209cc", 2024-04-26T10:21:35.223 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-04-26T10:21:35.223 INFO:teuthology.orchestra.run.smithi052.stdout: "object_id": "benchmark_data_smithi052_19421_object4801", 2024-04-26T10:21:35.223 INFO:teuthology.orchestra.run.smithi052.stdout: "object_locator": "@5", 2024-04-26T10:21:35.223 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_id": "benchmark_data_smithi052_19421_object4801", 2024-04-26T10:21:35.223 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_locator": "@5", 2024-04-26T10:21:35.224 INFO:teuthology.orchestra.run.smithi052.stdout: "paused": 0, 2024-04-26T10:21:35.224 INFO:teuthology.orchestra.run.smithi052.stdout: "used_replica": 0, 2024-04-26T10:21:35.224 INFO:teuthology.orchestra.run.smithi052.stdout: "precalc_pgid": 0, 2024-04-26T10:21:35.224 INFO:teuthology.orchestra.run.smithi052.stdout: "last_sent": "615.506015s", 2024-04-26T10:21:35.224 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0, 2024-04-26T10:21:35.224 INFO:teuthology.orchestra.run.smithi052.stdout: "attempts": 1, 2024-04-26T10:21:35.224 INFO:teuthology.orchestra.run.smithi052.stdout: "snapid": "head", 2024-04-26T10:21:35.224 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_context": "0=[]", 2024-04-26T10:21:35.224 INFO:teuthology.orchestra.run.smithi052.stdout: "mtime": "2024-04-26T10:21:35.198476+0000", 2024-04-26T10:21:35.224 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ops": [ 2024-04-26T10:21:35.224 INFO:teuthology.orchestra.run.smithi052.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:21:35.224 INFO:teuthology.orchestra.run.smithi052.stdout: "write 0~65536 in=65536b" 2024-04-26T10:21:35.224 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:35.225 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:35.225 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:35.225 INFO:teuthology.orchestra.run.smithi052.stdout: "tid": 4805, 2024-04-26T10:21:35.225 INFO:teuthology.orchestra.run.smithi052.stdout: "pg": "5.36f347ba", 2024-04-26T10:21:35.225 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-04-26T10:21:35.225 INFO:teuthology.orchestra.run.smithi052.stdout: "object_id": "benchmark_data_smithi052_19421_object4804", 2024-04-26T10:21:35.225 INFO:teuthology.orchestra.run.smithi052.stdout: "object_locator": "@5", 2024-04-26T10:21:35.225 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_id": "benchmark_data_smithi052_19421_object4804", 2024-04-26T10:21:35.225 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_locator": "@5", 2024-04-26T10:21:35.225 INFO:teuthology.orchestra.run.smithi052.stdout: "paused": 0, 2024-04-26T10:21:35.225 INFO:teuthology.orchestra.run.smithi052.stdout: "used_replica": 0, 2024-04-26T10:21:35.225 INFO:teuthology.orchestra.run.smithi052.stdout: "precalc_pgid": 0, 2024-04-26T10:21:35.225 INFO:teuthology.orchestra.run.smithi052.stdout: "last_sent": "615.506015s", 2024-04-26T10:21:35.225 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0, 2024-04-26T10:21:35.226 INFO:teuthology.orchestra.run.smithi052.stdout: "attempts": 1, 2024-04-26T10:21:35.226 INFO:teuthology.orchestra.run.smithi052.stdout: "snapid": "head", 2024-04-26T10:21:35.226 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_context": "0=[]", 2024-04-26T10:21:35.226 INFO:teuthology.orchestra.run.smithi052.stdout: "mtime": "2024-04-26T10:21:35.198810+0000", 2024-04-26T10:21:35.226 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ops": [ 2024-04-26T10:21:35.226 INFO:teuthology.orchestra.run.smithi052.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:21:35.226 INFO:teuthology.orchestra.run.smithi052.stdout: "write 0~65536 in=65536b" 2024-04-26T10:21:35.226 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:35.226 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:35.226 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:35.226 INFO:teuthology.orchestra.run.smithi052.stdout: "tid": 4807, 2024-04-26T10:21:35.226 INFO:teuthology.orchestra.run.smithi052.stdout: "pg": "5.38183ad3", 2024-04-26T10:21:35.226 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-04-26T10:21:35.227 INFO:teuthology.orchestra.run.smithi052.stdout: "object_id": "benchmark_data_smithi052_19421_object4806", 2024-04-26T10:21:35.227 INFO:teuthology.orchestra.run.smithi052.stdout: "object_locator": "@5", 2024-04-26T10:21:35.227 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_id": "benchmark_data_smithi052_19421_object4806", 2024-04-26T10:21:35.227 INFO:teuthology.orchestra.run.smithi052.stdout: "target_object_locator": "@5", 2024-04-26T10:21:35.227 INFO:teuthology.orchestra.run.smithi052.stdout: "paused": 0, 2024-04-26T10:21:35.227 INFO:teuthology.orchestra.run.smithi052.stdout: "used_replica": 0, 2024-04-26T10:21:35.227 INFO:teuthology.orchestra.run.smithi052.stdout: "precalc_pgid": 0, 2024-04-26T10:21:35.227 INFO:teuthology.orchestra.run.smithi052.stdout: "last_sent": "615.506015s", 2024-04-26T10:21:35.227 INFO:teuthology.orchestra.run.smithi052.stdout: "age": 0, 2024-04-26T10:21:35.227 INFO:teuthology.orchestra.run.smithi052.stdout: "attempts": 1, 2024-04-26T10:21:35.227 INFO:teuthology.orchestra.run.smithi052.stdout: "snapid": "head", 2024-04-26T10:21:35.227 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_context": "0=[]", 2024-04-26T10:21:35.227 INFO:teuthology.orchestra.run.smithi052.stdout: "mtime": "2024-04-26T10:21:35.199773+0000", 2024-04-26T10:21:35.227 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_ops": [ 2024-04-26T10:21:35.228 INFO:teuthology.orchestra.run.smithi052.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-26T10:21:35.228 INFO:teuthology.orchestra.run.smithi052.stdout: "write 0~65536 in=65536b" 2024-04-26T10:21:35.228 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:35.228 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:35.228 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-26T10:21:35.228 INFO:teuthology.orchestra.run.smithi052.stdout: "linger_ops": [], 2024-04-26T10:21:35.228 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_ops": [], 2024-04-26T10:21:35.228 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_stat_ops": [], 2024-04-26T10:21:35.228 INFO:teuthology.orchestra.run.smithi052.stdout: "statfs_ops": [], 2024-04-26T10:21:35.228 INFO:teuthology.orchestra.run.smithi052.stdout: "command_ops": [] 2024-04-26T10:21:35.228 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-26T10:21:35.229 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 4791, "pg": "5.713f3582", "osd": 0, "object_id": "benchmark_data_smithi052_19421_object4790", "object_locator": "@5", "target_object_id": "benchmark_data_smithi052_19421_object4790", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "615.502015s", "age": 0.0040000399999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:21:35.195562+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4793, "pg": "5.6648822f", "osd": 0, "object_id": "benchmark_data_smithi052_19421_object4792", "object_locator": "@5", "target_object_id": "benchmark_data_smithi052_19421_object4792", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "615.502015s", "age": 0.0040000399999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:21:35.195759+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4794, "pg": "5.67b78e71", "osd": 0, "object_id": "benchmark_data_smithi052_19421_object4793", "object_locator": "@5", "target_object_id": "benchmark_data_smithi052_19421_object4793", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "615.502015s", "age": 0.0040000399999999998, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:21:35.195899+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4795, "pg": "5.4f19951f", "osd": 0, "object_id": "benchmark_data_smithi052_19421_object4794", "object_locator": "@5", "target_object_id": "benchmark_data_smithi052_19421_object4794", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "615.506015s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:21:35.198222+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4797, "pg": "5.9d1380b1", "osd": 0, "object_id": "benchmark_data_smithi052_19421_object4796", "object_locator": "@5", "target_object_id": "benchmark_data_smithi052_19421_object4796", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "615.506015s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:21:35.198293+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4798, "pg": "5.9d2626f1", "osd": 0, "object_id": "benchmark_data_smithi052_19421_object4797", "object_locator": "@5", "target_object_id": "benchmark_data_smithi052_19421_object4797", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "615.506015s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:21:35.198307+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4799, "pg": "5.2ef4afaf", "osd": 0, "object_id": "benchmark_data_smithi052_19421_object4798", "object_locator": "@5", "target_object_id": "benchmark_data_smithi052_19421_object4798", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "615.506015s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:21:35.198316+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4800, "pg": "5.2f674b2d", "osd": 0, "object_id": "benchmark_data_smithi052_19421_object4799", "object_locator": "@5", "target_object_id": "benchmark_data_smithi052_19421_object4799", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "615.506015s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:21:35.198324+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4803, "pg": "5.718ef509", "osd": 0, "object_id": "benchmark_data_smithi052_19421_object4802", "object_locator": "@5", "target_object_id": "benchmark_data_smithi052_19421_object4802", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "615.506015s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:21:35.198489+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4804, "pg": "5.6fbbcf49", "osd": 0, "object_id": "benchmark_data_smithi052_19421_object4803", "object_locator": "@5", "target_object_id": "benchmark_data_smithi052_19421_object4803", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "615.506015s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:21:35.198685+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4806, "pg": "5.3640f9ef", "osd": 0, "object_id": "benchmark_data_smithi052_19421_object4805", "object_locator": "@5", "target_object_id": "benchmark_data_smithi052_19421_object4805", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "615.506015s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:21:35.199262+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4796, "pg": "5.4f257568", "osd": 2, "object_id": "benchmark_data_smithi052_19421_object4795", "object_locator": "@5", "target_object_id": "benchmark_data_smithi052_19421_object4795", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "615.506015s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:21:35.198262+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4801, "pg": "5.79a1ce73", "osd": 2, "object_id": "benchmark_data_smithi052_19421_object4800", "object_locator": "@5", "target_object_id": "benchmark_data_smithi052_19421_object4800", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "615.506015s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:21:35.198453+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4802, "pg": "5.a07209cc", "osd": 2, "object_id": "benchmark_data_smithi052_19421_object4801", "object_locator": "@5", "target_object_id": "benchmark_data_smithi052_19421_object4801", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "615.506015s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:21:35.198476+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4805, "pg": "5.36f347ba", "osd": 2, "object_id": "benchmark_data_smithi052_19421_object4804", "object_locator": "@5", "target_object_id": "benchmark_data_smithi052_19421_object4804", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "615.506015s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:21:35.198810+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4807, "pg": "5.38183ad3", "osd": 2, "object_id": "benchmark_data_smithi052_19421_object4806", "object_locator": "@5", "target_object_id": "benchmark_data_smithi052_19421_object4806", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "615.506015s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-26T10:21:35.199773+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2024-04-26T10:21:35.230 DEBUG:teuthology.orchestra.run.smithi052:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-04-26T10:21:35.264 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2024-04-26T10:21:35.266 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:35.266 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:21:35.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:21:35.266 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:35.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.267 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.267 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:35.267 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.024594018000002, 2024-04-26T10:21:35.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015326892, 2024-04-26T10:21:35.267 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.267 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.267 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 112 2024-04-26T10:21:35.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.267 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:35.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:35.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238644+0000", 2024-04-26T10:21:35.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:35.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238792+0000", 2024-04-26T10:21:35.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775699999999999 2024-04-26T10:21:35.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238811+0000", 2024-04-26T10:21:35.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8359000000000002e-05 2024-04-26T10:21:35.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238887+0000", 2024-04-26T10:21:35.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6909000000000005e-05 2024-04-26T10:21:35.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248433+0000", 2024-04-26T10:21:35.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095455650000000006 2024-04-26T10:21:35.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248564+0000", 2024-04-26T10:21:35.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131273 2024-04-26T10:21:35.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248795+0000", 2024-04-26T10:21:35.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023073500000000001 2024-04-26T10:21:35.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251497+0000", 2024-04-26T10:21:35.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002701976 2024-04-26T10:21:35.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253894+0000", 2024-04-26T10:21:35.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023967429999999998 2024-04-26T10:21:35.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253937+0000", 2024-04-26T10:21:35.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3006999999999997e-05 2024-04-26T10:21:35.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253972+0000", 2024-04-26T10:21:35.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5388000000000001e-05 2024-04-26T10:21:35.272 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.272 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.272 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.273 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.273 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:35.273 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.024340119999998, 2024-04-26T10:21:35.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016304328, 2024-04-26T10:21:35.273 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.273 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.273 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113 2024-04-26T10:21:35.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.274 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:35.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:35.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238898+0000", 2024-04-26T10:21:35.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:35.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238920+0000", 2024-04-26T10:21:35.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2056999999999999e-05 2024-04-26T10:21:35.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238937+0000", 2024-04-26T10:21:35.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6415000000000001e-05 2024-04-26T10:21:35.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238948+0000", 2024-04-26T10:21:35.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.11e-05 2024-04-26T10:21:35.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250527+0000", 2024-04-26T10:21:35.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011578662 2024-04-26T10:21:35.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250627+0000", 2024-04-26T10:21:35.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100418 2024-04-26T10:21:35.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250769+0000", 2024-04-26T10:21:35.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142111 2024-04-26T10:21:35.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253884+0000", 2024-04-26T10:21:35.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031148399999999998 2024-04-26T10:21:35.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254994+0000", 2024-04-26T10:21:35.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011095720000000001 2024-04-26T10:21:35.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255094+0000", 2024-04-26T10:21:35.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010092 2024-04-26T10:21:35.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255203+0000", 2024-04-26T10:21:35.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010906 2024-04-26T10:21:35.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.278 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.279 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.279 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:35.279 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.024282585000002, 2024-04-26T10:21:35.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016378984999999999, 2024-04-26T10:21:35.279 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.279 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.279 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 114 2024-04-26T10:21:35.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.279 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:35.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:35.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238956+0000", 2024-04-26T10:21:35.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:35.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238965+0000", 2024-04-26T10:21:35.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9469999999999992e-06 2024-04-26T10:21:35.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238993+0000", 2024-04-26T10:21:35.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8296000000000001e-05 2024-04-26T10:21:35.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239004+0000", 2024-04-26T10:21:35.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0482999999999999e-05 2024-04-26T10:21:35.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251532+0000", 2024-04-26T10:21:35.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01252852 2024-04-26T10:21:35.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251622+0000", 2024-04-26T10:21:35.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0044999999999996e-05 2024-04-26T10:21:35.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251763+0000", 2024-04-26T10:21:35.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140634 2024-04-26T10:21:35.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254035+0000", 2024-04-26T10:21:35.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022721320000000001 2024-04-26T10:21:35.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255220+0000", 2024-04-26T10:21:35.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011853059999999999 2024-04-26T10:21:35.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255301+0000", 2024-04-26T10:21:35.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0253999999999994e-05 2024-04-26T10:21:35.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255336+0000", 2024-04-26T10:21:35.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5098000000000002e-05 2024-04-26T10:21:35.284 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.285 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.285 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.285 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:35.285 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.024220636000003, 2024-04-26T10:21:35.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018452342, 2024-04-26T10:21:35.285 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.285 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.285 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.285 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.286 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115 2024-04-26T10:21:35.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.286 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:35.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:35.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239018+0000", 2024-04-26T10:21:35.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:35.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239152+0000", 2024-04-26T10:21:35.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414699999999999 2024-04-26T10:21:35.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239169+0000", 2024-04-26T10:21:35.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7013000000000001e-05 2024-04-26T10:21:35.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239190+0000", 2024-04-26T10:21:35.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1302999999999999e-05 2024-04-26T10:21:35.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252181+0000", 2024-04-26T10:21:35.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012990213 2024-04-26T10:21:35.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252411+0000", 2024-04-26T10:21:35.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023010199999999999 2024-04-26T10:21:35.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252687+0000", 2024-04-26T10:21:35.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000276063 2024-04-26T10:21:35.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254694+0000", 2024-04-26T10:21:35.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020072879999999999 2024-04-26T10:21:35.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257399+0000", 2024-04-26T10:21:35.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027051670000000001 2024-04-26T10:21:35.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257442+0000", 2024-04-26T10:21:35.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-04-26T10:21:35.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257471+0000", 2024-04-26T10:21:35.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.889e-05 2024-04-26T10:21:35.291 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.291 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.291 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.291 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.292 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:35.292 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.024040106999998, 2024-04-26T10:21:35.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018350615000000001, 2024-04-26T10:21:35.292 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.292 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.292 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.292 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.292 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.292 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116 2024-04-26T10:21:35.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.292 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:35.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:35.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239198+0000", 2024-04-26T10:21:35.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:35.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239213+0000", 2024-04-26T10:21:35.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4965e-05 2024-04-26T10:21:35.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239235+0000", 2024-04-26T10:21:35.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.156e-05 2024-04-26T10:21:35.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239243+0000", 2024-04-26T10:21:35.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9470000000000003e-06 2024-04-26T10:21:35.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253284+0000", 2024-04-26T10:21:35.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014041392999999999 2024-04-26T10:21:35.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253376+0000", 2024-04-26T10:21:35.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1198000000000003e-05 2024-04-26T10:21:35.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253508+0000", 2024-04-26T10:21:35.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013220199999999999 2024-04-26T10:21:35.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255474+0000", 2024-04-26T10:21:35.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019665590000000001 2024-04-26T10:21:35.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257480+0000", 2024-04-26T10:21:35.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00200599 2024-04-26T10:21:35.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257515+0000", 2024-04-26T10:21:35.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5126000000000002e-05 2024-04-26T10:21:35.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257550+0000", 2024-04-26T10:21:35.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4394000000000003e-05 2024-04-26T10:21:35.297 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.297 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.297 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.298 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.298 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:35.298 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.023986551, 2024-04-26T10:21:35.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018369330999999999, 2024-04-26T10:21:35.298 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.298 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.298 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.298 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117 2024-04-26T10:21:35.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.299 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:35.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:35.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239252+0000", 2024-04-26T10:21:35.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:35.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239267+0000", 2024-04-26T10:21:35.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4562999999999999e-05 2024-04-26T10:21:35.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239281+0000", 2024-04-26T10:21:35.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4e-05 2024-04-26T10:21:35.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239296+0000", 2024-04-26T10:21:35.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5492999999999999e-05 2024-04-26T10:21:35.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254076+0000", 2024-04-26T10:21:35.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014779814 2024-04-26T10:21:35.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254159+0000", 2024-04-26T10:21:35.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2923999999999994e-05 2024-04-26T10:21:35.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254279+0000", 2024-04-26T10:21:35.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011964300000000001 2024-04-26T10:21:35.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.256043+0000", 2024-04-26T10:21:35.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001764353 2024-04-26T10:21:35.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257559+0000", 2024-04-26T10:21:35.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015159189999999999 2024-04-26T10:21:35.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257597+0000", 2024-04-26T10:21:35.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8031999999999998e-05 2024-04-26T10:21:35.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257622+0000", 2024-04-26T10:21:35.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5213999999999999e-05 2024-04-26T10:21:35.303 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.303 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.304 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.304 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.304 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.451165+0000", 2024-04-26T10:21:35.304 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.812074631000002, 2024-04-26T10:21:35.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013622911, 2024-04-26T10:21:35.304 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.304 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.304 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.304 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.304 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.304 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 139 2024-04-26T10:21:35.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.305 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451165+0000", 2024-04-26T10:21:35.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451165+0000", 2024-04-26T10:21:35.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451164+0000", 2024-04-26T10:21:35.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:35.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451170+0000", 2024-04-26T10:21:35.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-04-26T10:21:35.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451178+0000", 2024-04-26T10:21:35.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8499999999999994e-06 2024-04-26T10:21:35.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451185+0000", 2024-04-26T10:21:35.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8889999999999996e-06 2024-04-26T10:21:35.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.462110+0000", 2024-04-26T10:21:35.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01092576 2024-04-26T10:21:35.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.462160+0000", 2024-04-26T10:21:35.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9838e-05 2024-04-26T10:21:35.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.462240+0000", 2024-04-26T10:21:35.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9406999999999994e-05 2024-04-26T10:21:35.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.464319+0000", 2024-04-26T10:21:35.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020796349999999998 2024-04-26T10:21:35.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.464688+0000", 2024-04-26T10:21:35.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036927800000000001 2024-04-26T10:21:35.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.464756+0000", 2024-04-26T10:21:35.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7648e-05 2024-04-26T10:21:35.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.464788+0000", 2024-04-26T10:21:35.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1418999999999999e-05 2024-04-26T10:21:35.309 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.309 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.309 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.310 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.310 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.451210+0000", 2024-04-26T10:21:35.310 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.812029512000002, 2024-04-26T10:21:35.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014337409000000001, 2024-04-26T10:21:35.310 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.310 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.310 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 140 2024-04-26T10:21:35.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.310 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451210+0000", 2024-04-26T10:21:35.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451210+0000", 2024-04-26T10:21:35.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451209+0000", 2024-04-26T10:21:35.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:35.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451330+0000", 2024-04-26T10:21:35.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012056 2024-04-26T10:21:35.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451341+0000", 2024-04-26T10:21:35.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1044e-05 2024-04-26T10:21:35.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451348+0000", 2024-04-26T10:21:35.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8630000000000008e-06 2024-04-26T10:21:35.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.462680+0000", 2024-04-26T10:21:35.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011331681999999999 2024-04-26T10:21:35.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.462776+0000", 2024-04-26T10:21:35.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5997999999999998e-05 2024-04-26T10:21:35.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.462903+0000", 2024-04-26T10:21:35.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012640000000000001 2024-04-26T10:21:35.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.464325+0000", 2024-04-26T10:21:35.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014219479999999999 2024-04-26T10:21:35.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.465495+0000", 2024-04-26T10:21:35.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001170433 2024-04-26T10:21:35.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.465526+0000", 2024-04-26T10:21:35.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1279000000000003e-05 2024-04-26T10:21:35.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.465547+0000", 2024-04-26T10:21:35.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0945e-05 2024-04-26T10:21:35.315 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.315 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.315 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.316 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.316 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:35.316 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.811882175000001, 2024-04-26T10:21:35.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015980181999999999, 2024-04-26T10:21:35.316 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.316 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.316 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 141 2024-04-26T10:21:35.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.317 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:35.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:35.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451356+0000", 2024-04-26T10:21:35.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:35.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451362+0000", 2024-04-26T10:21:35.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:21:35.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451371+0000", 2024-04-26T10:21:35.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1829999999999994e-06 2024-04-26T10:21:35.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451377+0000", 2024-04-26T10:21:35.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7599999999999997e-06 2024-04-26T10:21:35.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463727+0000", 2024-04-26T10:21:35.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012349646000000001 2024-04-26T10:21:35.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463780+0000", 2024-04-26T10:21:35.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2645999999999997e-05 2024-04-26T10:21:35.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463874+0000", 2024-04-26T10:21:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4097000000000004e-05 2024-04-26T10:21:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.466138+0000", 2024-04-26T10:21:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022642690000000002 2024-04-26T10:21:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467281+0000", 2024-04-26T10:21:35.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011428510000000001 2024-04-26T10:21:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467315+0000", 2024-04-26T10:21:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4032999999999998e-05 2024-04-26T10:21:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467337+0000", 2024-04-26T10:21:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2444000000000001e-05 2024-04-26T10:21:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649566+0000", 2024-04-26T10:21:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.613673028000001, 2024-04-26T10:21:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014850079, 2024-04-26T10:21:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 161 2024-04-26T10:21:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649566+0000", 2024-04-26T10:21:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649566+0000", 2024-04-26T10:21:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649565+0000", 2024-04-26T10:21:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:35.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649700+0000", 2024-04-26T10:21:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013546399999999999 2024-04-26T10:21:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649733+0000", 2024-04-26T10:21:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2382000000000003e-05 2024-04-26T10:21:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649747+0000", 2024-04-26T10:21:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.472e-05 2024-04-26T10:21:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.659036+0000", 2024-04-26T10:21:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092889830000000007 2024-04-26T10:21:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.659148+0000", 2024-04-26T10:21:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111927 2024-04-26T10:21:35.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.659336+0000", 2024-04-26T10:21:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187636 2024-04-26T10:21:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664235+0000", 2024-04-26T10:21:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048993919999999998 2024-04-26T10:21:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664324+0000", 2024-04-26T10:21:35.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9038999999999999e-05 2024-04-26T10:21:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664378+0000", 2024-04-26T10:21:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4008999999999997e-05 2024-04-26T10:21:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664416+0000", 2024-04-26T10:21:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7914000000000003e-05 2024-04-26T10:21:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649768+0000", 2024-04-26T10:21:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.613471726, 2024-04-26T10:21:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014901464999999999, 2024-04-26T10:21:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162 2024-04-26T10:21:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649768+0000", 2024-04-26T10:21:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649768+0000", 2024-04-26T10:21:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649766+0000", 2024-04-26T10:21:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:35.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649774+0000", 2024-04-26T10:21:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:21:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649789+0000", 2024-04-26T10:21:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5486e-05 2024-04-26T10:21:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649797+0000", 2024-04-26T10:21:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3200000000000002e-06 2024-04-26T10:21:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.660742+0000", 2024-04-26T10:21:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010945636999999999 2024-04-26T10:21:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.660872+0000", 2024-04-26T10:21:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013026699999999999 2024-04-26T10:21:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.661064+0000", 2024-04-26T10:21:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000191628 2024-04-26T10:21:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664490+0000", 2024-04-26T10:21:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034262369999999999 2024-04-26T10:21:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664503+0000", 2024-04-26T10:21:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2595999999999999e-05 2024-04-26T10:21:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664558+0000", 2024-04-26T10:21:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4985000000000003e-05 2024-04-26T10:21:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664669+0000", 2024-04-26T10:21:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111119 2024-04-26T10:21:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.333 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.613433604000001, 2024-04-26T10:21:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015587541, 2024-04-26T10:21:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 163 2024-04-26T10:21:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:35.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649805+0000", 2024-04-26T10:21:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649813+0000", 2024-04-26T10:21:35.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3319999999999992e-06 2024-04-26T10:21:35.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649851+0000", 2024-04-26T10:21:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7852999999999998e-05 2024-04-26T10:21:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649865+0000", 2024-04-26T10:21:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3626e-05 2024-04-26T10:21:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662071+0000", 2024-04-26T10:21:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01220689 2024-04-26T10:21:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662210+0000", 2024-04-26T10:21:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013893 2024-04-26T10:21:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662397+0000", 2024-04-26T10:21:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018690499999999999 2024-04-26T10:21:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664685+0000", 2024-04-26T10:21:35.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022876179999999999 2024-04-26T10:21:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665327+0000", 2024-04-26T10:21:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00064178900000000003 2024-04-26T10:21:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665365+0000", 2024-04-26T10:21:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8244999999999997e-05 2024-04-26T10:21:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665393+0000", 2024-04-26T10:21:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8232e-05 2024-04-26T10:21:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.613358957999999, 2024-04-26T10:21:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016970263999999999, 2024-04-26T10:21:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 164 2024-04-26T10:21:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649879+0000", 2024-04-26T10:21:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649963+0000", 2024-04-26T10:21:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4141999999999995e-05 2024-04-26T10:21:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649975+0000", 2024-04-26T10:21:35.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1416e-05 2024-04-26T10:21:35.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649983+0000", 2024-04-26T10:21:35.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8469999999999996e-06 2024-04-26T10:21:35.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662854+0000", 2024-04-26T10:21:35.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012871871999999999 2024-04-26T10:21:35.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662965+0000", 2024-04-26T10:21:35.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110413 2024-04-26T10:21:35.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.663109+0000", 2024-04-26T10:21:35.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144115 2024-04-26T10:21:35.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665992+0000", 2024-04-26T10:21:35.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028827340000000001 2024-04-26T10:21:35.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666784+0000", 2024-04-26T10:21:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00079253799999999997 2024-04-26T10:21:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666824+0000", 2024-04-26T10:21:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0139000000000003e-05 2024-04-26T10:21:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666851+0000", 2024-04-26T10:21:35.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6171999999999999e-05 2024-04-26T10:21:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.613247878000003, 2024-04-26T10:21:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019547338000000001, 2024-04-26T10:21:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.347 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165 2024-04-26T10:21:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649996+0000", 2024-04-26T10:21:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-04-26T10:21:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650021+0000", 2024-04-26T10:21:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5179999999999999e-05 2024-04-26T10:21:35.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650030+0000", 2024-04-26T10:21:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-04-26T10:21:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664733+0000", 2024-04-26T10:21:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014703097 2024-04-26T10:21:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664821+0000", 2024-04-26T10:21:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7918999999999996e-05 2024-04-26T10:21:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664953+0000", 2024-04-26T10:21:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132662 2024-04-26T10:21:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666776+0000", 2024-04-26T10:21:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018225509999999999 2024-04-26T10:21:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669480+0000", 2024-04-26T10:21:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00270382 2024-04-26T10:21:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669515+0000", 2024-04-26T10:21:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4885000000000002e-05 2024-04-26T10:21:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669539+0000", 2024-04-26T10:21:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4121000000000002e-05 2024-04-26T10:21:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.352 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.423753798, 2024-04-26T10:21:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015260631, 2024-04-26T10:21:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 184 2024-04-26T10:21:35.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839493+0000", 2024-04-26T10:21:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7300000000000005e-06 2024-04-26T10:21:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839501+0000", 2024-04-26T10:21:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2940000000000006e-06 2024-04-26T10:21:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839508+0000", 2024-04-26T10:21:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6660000000000002e-06 2024-04-26T10:21:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.849315+0000", 2024-04-26T10:21:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098072650000000008 2024-04-26T10:21:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.849564+0000", 2024-04-26T10:21:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024928800000000002 2024-04-26T10:21:35.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.849772+0000", 2024-04-26T10:21:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020795199999999999 2024-04-26T10:21:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853646+0000", 2024-04-26T10:21:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038744090000000001 2024-04-26T10:21:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854530+0000", 2024-04-26T10:21:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00088391200000000004 2024-04-26T10:21:35.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854623+0000", 2024-04-26T10:21:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2229000000000001e-05 2024-04-26T10:21:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854746+0000", 2024-04-26T10:21:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012354299999999999 2024-04-26T10:21:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.423724769000003, 2024-04-26T10:21:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017833541000000001, 2024-04-26T10:21:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185 2024-04-26T10:21:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839514+0000", 2024-04-26T10:21:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:35.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839612+0000", 2024-04-26T10:21:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7880999999999993e-05 2024-04-26T10:21:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839623+0000", 2024-04-26T10:21:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0917000000000001e-05 2024-04-26T10:21:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839632+0000", 2024-04-26T10:21:35.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0999999999999993e-06 2024-04-26T10:21:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850382+0000", 2024-04-26T10:21:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010750335 2024-04-26T10:21:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850502+0000", 2024-04-26T10:21:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120183 2024-04-26T10:21:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850685+0000", 2024-04-26T10:21:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000182442 2024-04-26T10:21:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854396+0000", 2024-04-26T10:21:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037114819999999999 2024-04-26T10:21:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857233+0000", 2024-04-26T10:21:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002836514 2024-04-26T10:21:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857300+0000", 2024-04-26T10:21:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6842999999999997e-05 2024-04-26T10:21:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857348+0000", 2024-04-26T10:21:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8504000000000002e-05 2024-04-26T10:21:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.364 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.423598417999997, 2024-04-26T10:21:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018757273000000001, 2024-04-26T10:21:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 186 2024-04-26T10:21:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:35.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:35.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839640+0000", 2024-04-26T10:21:35.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:35.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839646+0000", 2024-04-26T10:21:35.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:21:35.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839654+0000", 2024-04-26T10:21:35.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:21:35.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839661+0000", 2024-04-26T10:21:35.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.64e-06 2024-04-26T10:21:35.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852328+0000", 2024-04-26T10:21:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012667151 2024-04-26T10:21:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852538+0000", 2024-04-26T10:21:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020961100000000001 2024-04-26T10:21:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852945+0000", 2024-04-26T10:21:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040712099999999998 2024-04-26T10:21:35.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857372+0000", 2024-04-26T10:21:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044268049999999998 2024-04-26T10:21:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858321+0000", 2024-04-26T10:21:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094932999999999997 2024-04-26T10:21:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858367+0000", 2024-04-26T10:21:35.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5534000000000001e-05 2024-04-26T10:21:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858398+0000", 2024-04-26T10:21:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1562e-05 2024-04-26T10:21:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.370 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.423571252000002, 2024-04-26T10:21:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019669504000000001, 2024-04-26T10:21:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187 2024-04-26T10:21:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:35.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839667+0000", 2024-04-26T10:21:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839677+0000", 2024-04-26T10:21:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3270000000000007e-06 2024-04-26T10:21:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839685+0000", 2024-04-26T10:21:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2670000000000006e-06 2024-04-26T10:21:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839692+0000", 2024-04-26T10:21:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7129999999999999e-06 2024-04-26T10:21:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853685+0000", 2024-04-26T10:21:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013993716999999999 2024-04-26T10:21:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853876+0000", 2024-04-26T10:21:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019097100000000001 2024-04-26T10:21:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853989+0000", 2024-04-26T10:21:35.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011275199999999999 2024-04-26T10:21:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857377+0000", 2024-04-26T10:21:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033882489999999999 2024-04-26T10:21:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859222+0000", 2024-04-26T10:21:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001844233 2024-04-26T10:21:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859291+0000", 2024-04-26T10:21:35.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:21:35.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859338+0000", 2024-04-26T10:21:35.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6366000000000003e-05 2024-04-26T10:21:35.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.376 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.376 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.376 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:35.376 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.423540385999999, 2024-04-26T10:21:35.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019837468, 2024-04-26T10:21:35.377 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.377 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.377 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 188 2024-04-26T10:21:35.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.377 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:35.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:35.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839698+0000", 2024-04-26T10:21:35.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:35.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839829+0000", 2024-04-26T10:21:35.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013061099999999999 2024-04-26T10:21:35.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839853+0000", 2024-04-26T10:21:35.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3736000000000001e-05 2024-04-26T10:21:35.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839863+0000", 2024-04-26T10:21:35.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:35.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854869+0000", 2024-04-26T10:21:35.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015005978 2024-04-26T10:21:35.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854959+0000", 2024-04-26T10:21:35.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9468999999999993e-05 2024-04-26T10:21:35.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855114+0000", 2024-04-26T10:21:35.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015563799999999999 2024-04-26T10:21:35.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857386+0000", 2024-04-26T10:21:35.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002271852 2024-04-26T10:21:35.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859406+0000", 2024-04-26T10:21:35.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002019936 2024-04-26T10:21:35.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859461+0000", 2024-04-26T10:21:35.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4826e-05 2024-04-26T10:21:35.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859536+0000", 2024-04-26T10:21:35.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5566000000000001e-05 2024-04-26T10:21:35.382 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.382 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.382 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.382 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:35.382 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:35.383 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.423366522999999, 2024-04-26T10:21:35.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019826496999999998, 2024-04-26T10:21:35.383 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:35.383 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:35.383 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:35.383 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:35.383 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:35.383 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 189 2024-04-26T10:21:35.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.383 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:35.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:35.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:35.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:35.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:35.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:35.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:35.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839872+0000", 2024-04-26T10:21:35.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:35.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:35.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839882+0000", 2024-04-26T10:21:35.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:35.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:35.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839892+0000", 2024-04-26T10:21:35.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.217e-06 2024-04-26T10:21:35.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839900+0000", 2024-04-26T10:21:35.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5469999999999997e-06 2024-04-26T10:21:35.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:35.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855903+0000", 2024-04-26T10:21:35.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016002590000000001 2024-04-26T10:21:35.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:35.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856110+0000", 2024-04-26T10:21:35.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020711199999999999 2024-04-26T10:21:35.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:35.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856421+0000", 2024-04-26T10:21:35.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031128500000000001 2024-04-26T10:21:35.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:35.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857643+0000", 2024-04-26T10:21:35.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012215520000000001 2024-04-26T10:21:35.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:35.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859603+0000", 2024-04-26T10:21:35.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019600350000000002 2024-04-26T10:21:35.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:35.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859660+0000", 2024-04-26T10:21:35.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6857999999999997e-05 2024-04-26T10:21:35.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:35.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:35.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:35.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859699+0000", 2024-04-26T10:21:35.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9641999999999998e-05 2024-04-26T10:21:35.388 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.388 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.388 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.388 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:35.388 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:35.388 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:35.390 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:35.388+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:35.391 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:35.396 DEBUG:teuthology.parallel:result is None 2024-04-26T10:21:35.396 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2024-04-26T10:21:35.406 INFO:tasks.radosbench:joining radosbench (timing out after 2100s) 2024-04-26T10:21:35.406 INFO:teuthology.orchestra.run:waiting for 2100 2024-04-26T10:21:35.480 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:21:35.491 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:35.488+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:35.521 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:35.521 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:35.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.521 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:5740 5.9 e25/22 5:95aafff0:::benchmark_data_smithi052_19421_object5739:head v 25'355, mlcod=25'352)", 2024-04-26T10:21:35.521 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:35.515985+0000", 2024-04-26T10:21:35.521 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0045347989999999999, 2024-04-26T10:21:35.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045697960000000001, 2024-04-26T10:21:35.522 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:35.522 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:35.522 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:35.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:35.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515985+0000", 2024-04-26T10:21:35.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:35.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:35.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515985+0000", 2024-04-26T10:21:35.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:35.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:35.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515984+0000", 2024-04-26T10:21:35.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:35.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:35.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.516030+0000", 2024-04-26T10:21:35.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5791999999999998e-05 2024-04-26T10:21:35.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:35.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.516053+0000", 2024-04-26T10:21:35.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2976000000000002e-05 2024-04-26T10:21:35.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.516059+0000", 2024-04-26T10:21:35.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7620000000000001e-06 2024-04-26T10:21:35.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:35.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.516131+0000", 2024-04-26T10:21:35.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2910000000000005e-05 2024-04-26T10:21:35.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:35.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.516191+0000", 2024-04-26T10:21:35.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9790000000000002e-05 2024-04-26T10:21:35.525 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:35.525 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:35.525 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:35.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.525 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:5742 5.9 e25/22 5:99d1bb80:::benchmark_data_smithi052_19421_object5741:head v 25'356, mlcod=25'352)", 2024-04-26T10:21:35.525 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:35.517409+0000", 2024-04-26T10:21:35.525 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.003110949, 2024-04-26T10:21:35.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0032321479999999998, 2024-04-26T10:21:35.526 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:35.526 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:35.526 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:35.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:35.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.517409+0000", 2024-04-26T10:21:35.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:35.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:35.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.517409+0000", 2024-04-26T10:21:35.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:35.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:35.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.517408+0000", 2024-04-26T10:21:35.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:35.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:35.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.517500+0000", 2024-04-26T10:21:35.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2273000000000002e-05 2024-04-26T10:21:35.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:35.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.517515+0000", 2024-04-26T10:21:35.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5427999999999999e-05 2024-04-26T10:21:35.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.517523+0000", 2024-04-26T10:21:35.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.114e-06 2024-04-26T10:21:35.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:35.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.517577+0000", 2024-04-26T10:21:35.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4446e-05 2024-04-26T10:21:35.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:35.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.517602+0000", 2024-04-26T10:21:35.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5069999999999999e-05 2024-04-26T10:21:35.529 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:35.529 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:35.529 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:35.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.529 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:5744 5.e e25/22 5:7c02bb91:::benchmark_data_smithi052_19421_object5743:head v 25'348, mlcod=25'346)", 2024-04-26T10:21:35.529 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:35.519830+0000", 2024-04-26T10:21:35.529 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00068953999999999999, 2024-04-26T10:21:35.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00086451400000000004, 2024-04-26T10:21:35.529 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:35.530 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:35.530 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:35.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:35.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.519830+0000", 2024-04-26T10:21:35.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:35.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:35.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.519830+0000", 2024-04-26T10:21:35.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:35.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:35.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.519829+0000", 2024-04-26T10:21:35.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:35.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:35.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.519889+0000", 2024-04-26T10:21:35.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0535000000000002e-05 2024-04-26T10:21:35.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:35.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.519904+0000", 2024-04-26T10:21:35.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4861000000000001e-05 2024-04-26T10:21:35.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.519911+0000", 2024-04-26T10:21:35.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2180000000000002e-06 2024-04-26T10:21:35.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:35.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.519958+0000", 2024-04-26T10:21:35.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6820999999999998e-05 2024-04-26T10:21:35.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:35.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.519981+0000", 2024-04-26T10:21:35.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2787999999999999e-05 2024-04-26T10:21:35.533 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:35.533 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:35.533 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:35.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.533 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:5746 5.d e25/22 5:b5d3ec91:::benchmark_data_smithi052_19421_object5745:head v 25'374, mlcod=25'372)", 2024-04-26T10:21:35.533 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:35.519996+0000", 2024-04-26T10:21:35.533 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00052386200000000005, 2024-04-26T10:21:35.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00075092699999999997, 2024-04-26T10:21:35.533 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:35.534 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:35.534 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:35.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:35.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.519996+0000", 2024-04-26T10:21:35.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:35.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:35.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.519996+0000", 2024-04-26T10:21:35.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:35.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:35.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.519995+0000", 2024-04-26T10:21:35.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:35.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:35.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.520034+0000", 2024-04-26T10:21:35.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9835000000000001e-05 2024-04-26T10:21:35.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:35.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.520046+0000", 2024-04-26T10:21:35.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1362000000000001e-05 2024-04-26T10:21:35.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.520057+0000", 2024-04-26T10:21:35.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1626e-05 2024-04-26T10:21:35.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:35.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.520109+0000", 2024-04-26T10:21:35.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1523000000000001e-05 2024-04-26T10:21:35.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:35.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.520127+0000", 2024-04-26T10:21:35.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7691000000000001e-05 2024-04-26T10:21:35.537 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:35.537 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:35.537 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:35.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.537 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:5747 5.8 e25/22 5:1b270a0d:::benchmark_data_smithi052_19421_object5746:head v 25'371, mlcod=25'369)", 2024-04-26T10:21:35.537 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:35.520021+0000", 2024-04-26T10:21:35.537 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00049824600000000004, 2024-04-26T10:21:35.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00078558899999999995, 2024-04-26T10:21:35.537 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:35.537 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:35.537 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:35.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:35.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.520021+0000", 2024-04-26T10:21:35.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:35.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:35.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.520021+0000", 2024-04-26T10:21:35.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:35.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:35.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.520020+0000", 2024-04-26T10:21:35.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.520084+0000", 2024-04-26T10:21:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3452000000000002e-05 2024-04-26T10:21:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.520096+0000", 2024-04-26T10:21:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2478e-05 2024-04-26T10:21:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.520105+0000", 2024-04-26T10:21:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9400000000000008e-06 2024-04-26T10:21:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.520150+0000", 2024-04-26T10:21:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4637e-05 2024-04-26T10:21:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.520169+0000", 2024-04-26T10:21:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8561000000000001e-05 2024-04-26T10:21:35.540 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:5735 5.b e25/22 5:d73acde2:::benchmark_data_smithi052_19421_object5734:head v 25'385, mlcod=25'381)", 2024-04-26T10:21:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:35.514843+0000", 2024-04-26T10:21:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0056765100000000001, 2024-04-26T10:21:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0060193579999999998, 2024-04-26T10:21:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:35.541 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.514843+0000", 2024-04-26T10:21:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.514843+0000", 2024-04-26T10:21:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.514842+0000", 2024-04-26T10:21:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.514909+0000", 2024-04-26T10:21:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7211000000000004e-05 2024-04-26T10:21:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.514924+0000", 2024-04-26T10:21:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4902999999999999e-05 2024-04-26T10:21:35.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.514931+0000", 2024-04-26T10:21:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4330000000000001e-06 2024-04-26T10:21:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515344+0000", 2024-04-26T10:21:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041282200000000003 2024-04-26T10:21:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515366+0000", 2024-04-26T10:21:35.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2209999999999999e-05 2024-04-26T10:21:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:5741 5.a e25/22 5:53f1904c:::benchmark_data_smithi052_19421_object5740:head v 25'342, mlcod=25'340)", 2024-04-26T10:21:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:35.515534+0000", 2024-04-26T10:21:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0049858890000000003, 2024-04-26T10:21:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005396975, 2024-04-26T10:21:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:35.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515534+0000", 2024-04-26T10:21:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515534+0000", 2024-04-26T10:21:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:35.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515533+0000", 2024-04-26T10:21:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515588+0000", 2024-04-26T10:21:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4735999999999999e-05 2024-04-26T10:21:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515598+0000", 2024-04-26T10:21:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000008e-06 2024-04-26T10:21:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515602+0000", 2024-04-26T10:21:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.459e-06 2024-04-26T10:21:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515686+0000", 2024-04-26T10:21:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4075999999999999e-05 2024-04-26T10:21:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515779+0000", 2024-04-26T10:21:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2621999999999995e-05 2024-04-26T10:21:35.548 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:5739 5.b e25/22 5:d5b84808:::benchmark_data_smithi052_19421_object5738:head v 25'386, mlcod=25'381)", 2024-04-26T10:21:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:35.515638+0000", 2024-04-26T10:21:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0048814640000000003, 2024-04-26T10:21:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053446989999999996, 2024-04-26T10:21:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515638+0000", 2024-04-26T10:21:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515638+0000", 2024-04-26T10:21:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515638+0000", 2024-04-26T10:21:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:35.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515691+0000", 2024-04-26T10:21:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3761999999999998e-05 2024-04-26T10:21:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515701+0000", 2024-04-26T10:21:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0113e-05 2024-04-26T10:21:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.515707+0000", 2024-04-26T10:21:35.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5629999999999999e-06 2024-04-26T10:21:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.516237+0000", 2024-04-26T10:21:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00052979000000000004 2024-04-26T10:21:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:35.516266+0000", 2024-04-26T10:21:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8707000000000001e-05 2024-04-26T10:21:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:35.552 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:35.553 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:21:35.553 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 8 2024-04-26T10:21:35.553 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:35.554 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:35.591 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:35.588+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:35.613 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 2 16 6047 6031 188.451 184.562 0.0031786 0.00529328 2024-04-26T10:21:35.645 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:21:35.668 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:21:35.675 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:35.675 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:35.686 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:35.690 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T10:21:35.692 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:21:35.693 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:21:35.693 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:21:35.731 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:35.728+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:35.793 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:35.788+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:35.806 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:35.806 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:35.820 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:21:35.894 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:35.893+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:35.949 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:35.949 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:35.961 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:21:35.995 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:35.992+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:36.091 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:36.091 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:36.096 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:36.093+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:36.104 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:21:36.197 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:36.192+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:36.232 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:36.232 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:36.245 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:36.298 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:36.293+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:36.372 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:36.372 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:36.385 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:36.398 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:36.396+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:36.499 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:36.496+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:36.506 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:36.506 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:36.519 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:36.541 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:21:36.541 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:21:36.541 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-26T10:21:36.541 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-26T10:21:36.556 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:21:36.601 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:36.596+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:36.613 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 3 16 8926 8910 185.607 179.938 0.00452173 0.00537894 2024-04-26T10:21:36.645 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:36.645 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:36.657 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:36.707 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:36.704+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:36.790 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:36.790 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:36.803 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:36.803 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:36.796+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:36.855 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:36.855 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-26T10:21:36.856 INFO:teuthology.orchestra.run.smithi052.stdout: "epoch": 25, 2024-04-26T10:21:36.856 INFO:teuthology.orchestra.run.smithi052.stdout: "fsid": "485c78cb-ad62-4584-aba6-316dd9c93a12", 2024-04-26T10:21:36.856 INFO:teuthology.orchestra.run.smithi052.stdout: "created": "2024-04-26T10:20:48.363934+0000", 2024-04-26T10:21:36.856 INFO:teuthology.orchestra.run.smithi052.stdout: "modified": "2024-04-26T10:21:34.524943+0000", 2024-04-26T10:21:36.856 INFO:teuthology.orchestra.run.smithi052.stdout: "last_up_change": "2024-04-26T10:20:58.098141+0000", 2024-04-26T10:21:36.856 INFO:teuthology.orchestra.run.smithi052.stdout: "last_in_change": "2024-04-26T10:20:49.575442+0000", 2024-04-26T10:21:36.856 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-26T10:21:36.856 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_num": 5806080, 2024-04-26T10:21:36.856 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_set": [ 2024-04-26T10:21:36.856 INFO:teuthology.orchestra.run.smithi052.stdout: "nodeep-scrub", 2024-04-26T10:21:36.856 INFO:teuthology.orchestra.run.smithi052.stdout: "noscrub", 2024-04-26T10:21:36.856 INFO:teuthology.orchestra.run.smithi052.stdout: "pglog_hardlimit", 2024-04-26T10:21:36.856 INFO:teuthology.orchestra.run.smithi052.stdout: "purged_snapdirs", 2024-04-26T10:21:36.857 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_deletes", 2024-04-26T10:21:36.857 INFO:teuthology.orchestra.run.smithi052.stdout: "sortbitwise" 2024-04-26T10:21:36.857 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-26T10:21:36.857 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_version": 5, 2024-04-26T10:21:36.857 INFO:teuthology.orchestra.run.smithi052.stdout: "full_ratio": 0.94999998807907104, 2024-04-26T10:21:36.857 INFO:teuthology.orchestra.run.smithi052.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-26T10:21:36.857 INFO:teuthology.orchestra.run.smithi052.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-26T10:21:36.857 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_snapshot": "", 2024-04-26T10:21:36.857 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_max": 5, 2024-04-26T10:21:36.857 INFO:teuthology.orchestra.run.smithi052.stdout: "max_osd": 3, 2024-04-26T10:21:36.857 INFO:teuthology.orchestra.run.smithi052.stdout: "require_min_compat_client": "luminous", 2024-04-26T10:21:36.857 INFO:teuthology.orchestra.run.smithi052.stdout: "min_compat_client": "jewel", 2024-04-26T10:21:36.857 INFO:teuthology.orchestra.run.smithi052.stdout: "require_osd_release": "reef", 2024-04-26T10:21:36.857 INFO:teuthology.orchestra.run.smithi052.stdout: "allow_crimson": false, 2024-04-26T10:21:36.858 INFO:teuthology.orchestra.run.smithi052.stdout: "pools": [ 2024-04-26T10:21:36.858 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.858 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 1, 2024-04-26T10:21:36.858 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": ".mgr", 2024-04-26T10:21:36.858 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-26T10:20:59.994755+0000", 2024-04-26T10:21:36.858 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-26T10:21:36.858 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-26T10:21:36.858 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-26T10:21:36.858 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-26T10:21:36.858 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-26T10:21:36.858 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-26T10:21:36.858 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:21:36.858 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:21:36.859 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:21:36.859 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:21:36.859 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-26T10:21:36.859 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:21:36.859 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 1, 2024-04-26T10:21:36.859 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 1, 2024-04-26T10:21:36.859 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 1, 2024-04-26T10:21:36.859 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 1, 2024-04-26T10:21:36.859 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 1, 2024-04-26T10:21:36.859 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-26T10:21:36.859 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-26T10:21:36.860 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-26T10:21:36.860 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-26T10:21:36.860 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-26T10:21:36.860 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-26T10:21:36.860 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-26T10:21:36.860 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.860 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "14", 2024-04-26T10:21:36.860 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-26T10:21:36.860 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:21:36.860 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:21:36.861 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-26T10:21:36.861 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:21:36.862 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-26T10:21:36.862 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-26T10:21:36.862 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-26T10:21:36.862 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-26T10:21:36.862 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-26T10:21:36.862 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-26T10:21:36.862 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-26T10:21:36.862 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-26T10:21:36.862 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-26T10:21:36.863 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-26T10:21:36.863 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-26T10:21:36.863 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-26T10:21:36.863 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-26T10:21:36.863 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:21:36.863 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:21:36.863 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:21:36.863 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-26T10:21:36.863 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-26T10:21:36.863 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-26T10:21:36.863 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-26T10:21:36.863 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-26T10:21:36.864 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.864 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-26T10:21:36.864 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-26T10:21:36.864 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-26T10:21:36.864 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:21:36.864 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:21:36.864 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:21:36.864 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:21:36.864 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-26T10:21:36.864 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-26T10:21:36.864 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-26T10:21:36.864 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-26T10:21:36.864 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-04-26T10:21:36.865 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_max": 32, 2024-04-26T10:21:36.865 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 1 2024-04-26T10:21:36.865 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.865 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-26T10:21:36.865 INFO:teuthology.orchestra.run.smithi052.stdout: "mgr": {} 2024-04-26T10:21:36.865 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.865 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-26T10:21:36.865 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 2, 2024-04-26T10:21:36.865 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 2, 2024-04-26T10:21:36.865 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1, 2024-04-26T10:21:36.865 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 2, 2024-04-26T10:21:36.865 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 2, 2024-04-26T10:21:36.865 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-04-26T10:21:36.865 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-26T10:21:36.866 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-26T10:21:36.866 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.866 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.866 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.866 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 2, 2024-04-26T10:21:36.866 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "rbd", 2024-04-26T10:21:36.866 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-26T10:21:03.866927+0000", 2024-04-26T10:21:36.866 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-26T10:21:36.866 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-26T10:21:36.866 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-26T10:21:36.866 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-26T10:21:36.866 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-26T10:21:36.867 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-26T10:21:36.867 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:21:36.867 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:21:36.867 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:21:36.867 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:21:36.867 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-26T10:21:36.867 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:21:36.867 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 8, 2024-04-26T10:21:36.867 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 8, 2024-04-26T10:21:36.867 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 8, 2024-04-26T10:21:36.867 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 8, 2024-04-26T10:21:36.867 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 8, 2024-04-26T10:21:36.867 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-26T10:21:36.867 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-26T10:21:36.868 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-26T10:21:36.868 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-26T10:21:36.868 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-26T10:21:36.868 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-26T10:21:36.868 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-26T10:21:36.868 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.868 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "17", 2024-04-26T10:21:36.868 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-26T10:21:36.868 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:21:36.868 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:21:36.868 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-26T10:21:36.868 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:21:36.868 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-26T10:21:36.868 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-26T10:21:36.869 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-26T10:21:36.869 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-26T10:21:36.869 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-26T10:21:36.869 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-26T10:21:36.869 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-26T10:21:36.869 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-26T10:21:36.869 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-26T10:21:36.869 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-26T10:21:36.869 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-26T10:21:36.869 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-26T10:21:36.869 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-26T10:21:36.869 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:21:36.869 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:21:36.869 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:21:36.870 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-26T10:21:36.870 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-26T10:21:36.870 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-26T10:21:36.870 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-26T10:21:36.870 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-26T10:21:36.870 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.870 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-26T10:21:36.870 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-26T10:21:36.870 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-26T10:21:36.870 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:21:36.870 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:21:36.870 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:21:36.870 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:21:36.871 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-26T10:21:36.871 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-26T10:21:36.871 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-26T10:21:36.871 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-26T10:21:36.871 INFO:teuthology.orchestra.run.smithi052.stdout: "options": {}, 2024-04-26T10:21:36.871 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-26T10:21:36.871 INFO:teuthology.orchestra.run.smithi052.stdout: "rbd": {} 2024-04-26T10:21:36.871 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.871 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-26T10:21:36.872 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1, 2024-04-26T10:21:36.872 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1, 2024-04-26T10:21:36.872 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1.5, 2024-04-26T10:21:36.872 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.5, 2024-04-26T10:21:36.872 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.5, 2024-04-26T10:21:36.872 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-04-26T10:21:36.873 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-26T10:21:36.873 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-26T10:21:36.873 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.873 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.873 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.873 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 3, 2024-04-26T10:21:36.873 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_metadata", 2024-04-26T10:21:36.873 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-26T10:21:07.853429+0000", 2024-04-26T10:21:36.873 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-26T10:21:36.873 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-26T10:21:36.874 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-26T10:21:36.874 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-26T10:21:36.874 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-26T10:21:36.874 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-26T10:21:36.875 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:21:36.875 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:21:36.875 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:21:36.875 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:21:36.875 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-26T10:21:36.875 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:21:36.875 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 32, 2024-04-26T10:21:36.875 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 32, 2024-04-26T10:21:36.875 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 32, 2024-04-26T10:21:36.875 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 32, 2024-04-26T10:21:36.876 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 32, 2024-04-26T10:21:36.876 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-26T10:21:36.876 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-26T10:21:36.876 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-26T10:21:36.876 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-26T10:21:36.876 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-26T10:21:36.876 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-26T10:21:36.876 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-26T10:21:36.876 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.876 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "20", 2024-04-26T10:21:36.876 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-26T10:21:36.876 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:21:36.876 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:21:36.876 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-26T10:21:36.877 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:21:36.877 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-26T10:21:36.877 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-26T10:21:36.877 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-26T10:21:36.877 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-26T10:21:36.877 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-26T10:21:36.877 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-26T10:21:36.877 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-26T10:21:36.877 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-26T10:21:36.877 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-26T10:21:36.877 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-26T10:21:36.877 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-26T10:21:36.877 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-26T10:21:36.878 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-26T10:21:36.878 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:21:36.878 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:21:36.878 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:21:36.878 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-26T10:21:36.878 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-26T10:21:36.878 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-26T10:21:36.878 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-26T10:21:36.878 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-26T10:21:36.878 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.879 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-26T10:21:36.879 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-26T10:21:36.879 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-26T10:21:36.879 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:21:36.879 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:21:36.879 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:21:36.879 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:21:36.879 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-26T10:21:36.879 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-26T10:21:36.879 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-26T10:21:36.879 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-26T10:21:36.880 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-04-26T10:21:36.880 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_bias": 4, 2024-04-26T10:21:36.880 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 16, 2024-04-26T10:21:36.880 INFO:teuthology.orchestra.run.smithi052.stdout: "recovery_priority": 5 2024-04-26T10:21:36.880 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.880 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-26T10:21:36.880 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-04-26T10:21:36.880 INFO:teuthology.orchestra.run.smithi052.stdout: "metadata": "cephfs" 2024-04-26T10:21:36.880 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.880 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.880 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-26T10:21:36.881 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.1299999952316284, 2024-04-26T10:21:36.881 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.1299999952316284, 2024-04-26T10:21:36.881 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1.5, 2024-04-26T10:21:36.881 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.690000057220459, 2024-04-26T10:21:36.881 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.690000057220459, 2024-04-26T10:21:36.881 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-04-26T10:21:36.881 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-26T10:21:36.881 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-26T10:21:36.881 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.881 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.881 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.882 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 4, 2024-04-26T10:21:36.882 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "cephfs_data", 2024-04-26T10:21:36.882 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-26T10:21:08.285131+0000", 2024-04-26T10:21:36.883 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-26T10:21:36.883 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-26T10:21:36.883 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-26T10:21:36.883 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-26T10:21:36.883 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-26T10:21:36.883 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-26T10:21:36.883 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:21:36.883 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:21:36.883 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:21:36.883 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:21:36.883 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-26T10:21:36.883 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:21:36.883 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 64, 2024-04-26T10:21:36.884 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 64, 2024-04-26T10:21:36.884 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 64, 2024-04-26T10:21:36.884 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 64, 2024-04-26T10:21:36.884 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 64, 2024-04-26T10:21:36.884 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-26T10:21:36.884 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-26T10:21:36.884 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-26T10:21:36.884 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-26T10:21:36.884 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-26T10:21:36.884 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-26T10:21:36.884 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-26T10:21:36.884 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.884 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "21", 2024-04-26T10:21:36.885 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-26T10:21:36.885 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:21:36.885 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:21:36.885 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-26T10:21:36.885 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:21:36.885 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-26T10:21:36.885 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-26T10:21:36.885 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-26T10:21:36.885 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-26T10:21:36.885 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-26T10:21:36.885 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-26T10:21:36.885 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-26T10:21:36.885 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-26T10:21:36.885 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-26T10:21:36.886 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-26T10:21:36.886 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-26T10:21:36.886 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-26T10:21:36.886 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-26T10:21:36.886 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:21:36.886 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:21:36.886 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:21:36.886 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-26T10:21:36.886 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-26T10:21:36.886 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-26T10:21:36.887 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-26T10:21:36.887 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-26T10:21:36.887 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.887 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-26T10:21:36.887 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-26T10:21:36.887 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-26T10:21:36.887 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:21:36.888 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:21:36.888 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:21:36.888 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:21:36.888 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-26T10:21:36.888 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-26T10:21:36.888 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-26T10:21:36.889 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-26T10:21:36.889 INFO:teuthology.orchestra.run.smithi052.stdout: "options": { 2024-04-26T10:21:36.889 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_min": 64, 2024-04-26T10:21:36.889 INFO:teuthology.orchestra.run.smithi052.stdout: "target_size_ratio": 0.89999997615814209 2024-04-26T10:21:36.889 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.889 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-26T10:21:36.889 INFO:teuthology.orchestra.run.smithi052.stdout: "cephfs": { 2024-04-26T10:21:36.890 INFO:teuthology.orchestra.run.smithi052.stdout: "data": "cephfs" 2024-04-26T10:21:36.890 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.890 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.890 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-26T10:21:36.890 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.0299999713897705, 2024-04-26T10:21:36.891 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.0299999713897705, 2024-04-26T10:21:36.891 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1.5, 2024-04-26T10:21:36.891 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.5499999523162842, 2024-04-26T10:21:36.891 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.5499999523162842, 2024-04-26T10:21:36.891 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-04-26T10:21:36.891 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-26T10:21:36.891 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-26T10:21:36.892 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.892 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.892 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.892 INFO:teuthology.orchestra.run.smithi052.stdout: "pool": 5, 2024-04-26T10:21:36.892 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_name": "unique_pool_0", 2024-04-26T10:21:36.892 INFO:teuthology.orchestra.run.smithi052.stdout: "create_time": "2024-04-26T10:21:31.363128+0000", 2024-04-26T10:21:36.893 INFO:teuthology.orchestra.run.smithi052.stdout: "flags": 1, 2024-04-26T10:21:36.893 INFO:teuthology.orchestra.run.smithi052.stdout: "flags_names": "hashpspool", 2024-04-26T10:21:36.894 INFO:teuthology.orchestra.run.smithi052.stdout: "type": 1, 2024-04-26T10:21:36.894 INFO:teuthology.orchestra.run.smithi052.stdout: "size": 2, 2024-04-26T10:21:36.894 INFO:teuthology.orchestra.run.smithi052.stdout: "min_size": 1, 2024-04-26T10:21:36.894 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_rule": 0, 2024-04-26T10:21:36.894 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_count": 0, 2024-04-26T10:21:36.895 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_target": 0, 2024-04-26T10:21:36.895 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_barrier": 0, 2024-04-26T10:21:36.895 INFO:teuthology.orchestra.run.smithi052.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-26T10:21:36.895 INFO:teuthology.orchestra.run.smithi052.stdout: "object_hash": 2, 2024-04-26T10:21:36.895 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_autoscale_mode": "off", 2024-04-26T10:21:36.895 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num": 16, 2024-04-26T10:21:36.896 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num": 16, 2024-04-26T10:21:36.896 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_placement_num_target": 16, 2024-04-26T10:21:36.896 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_target": 16, 2024-04-26T10:21:36.897 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_num_pending": 16, 2024-04-26T10:21:36.897 INFO:teuthology.orchestra.run.smithi052.stdout: "last_pg_merge_meta": { 2024-04-26T10:21:36.897 INFO:teuthology.orchestra.run.smithi052.stdout: "source_pgid": "0.0", 2024-04-26T10:21:36.897 INFO:teuthology.orchestra.run.smithi052.stdout: "ready_epoch": 0, 2024-04-26T10:21:36.897 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_started": 0, 2024-04-26T10:21:36.897 INFO:teuthology.orchestra.run.smithi052.stdout: "last_epoch_clean": 0, 2024-04-26T10:21:36.897 INFO:teuthology.orchestra.run.smithi052.stdout: "source_version": "0'0", 2024-04-26T10:21:36.897 INFO:teuthology.orchestra.run.smithi052.stdout: "target_version": "0'0" 2024-04-26T10:21:36.897 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.898 INFO:teuthology.orchestra.run.smithi052.stdout: "last_change": "24", 2024-04-26T10:21:36.898 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend": "0", 2024-04-26T10:21:36.898 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-26T10:21:36.898 INFO:teuthology.orchestra.run.smithi052.stdout: "last_force_op_resend_preluminous": "0", 2024-04-26T10:21:36.898 INFO:teuthology.orchestra.run.smithi052.stdout: "auid": 0, 2024-04-26T10:21:36.898 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_mode": "selfmanaged", 2024-04-26T10:21:36.898 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_seq": 0, 2024-04-26T10:21:36.898 INFO:teuthology.orchestra.run.smithi052.stdout: "snap_epoch": 0, 2024-04-26T10:21:36.898 INFO:teuthology.orchestra.run.smithi052.stdout: "pool_snaps": [], 2024-04-26T10:21:36.898 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps": "[]", 2024-04-26T10:21:36.898 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_bytes": 0, 2024-04-26T10:21:36.898 INFO:teuthology.orchestra.run.smithi052.stdout: "quota_max_objects": 0, 2024-04-26T10:21:36.898 INFO:teuthology.orchestra.run.smithi052.stdout: "tiers": [], 2024-04-26T10:21:36.899 INFO:teuthology.orchestra.run.smithi052.stdout: "tier_of": -1, 2024-04-26T10:21:36.899 INFO:teuthology.orchestra.run.smithi052.stdout: "read_tier": -1, 2024-04-26T10:21:36.899 INFO:teuthology.orchestra.run.smithi052.stdout: "write_tier": -1, 2024-04-26T10:21:36.899 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_mode": "none", 2024-04-26T10:21:36.899 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_bytes": 0, 2024-04-26T10:21:36.899 INFO:teuthology.orchestra.run.smithi052.stdout: "target_max_objects": 0, 2024-04-26T10:21:36.899 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-26T10:21:36.899 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-26T10:21:36.899 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-26T10:21:36.899 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_flush_age": 0, 2024-04-26T10:21:36.899 INFO:teuthology.orchestra.run.smithi052.stdout: "cache_min_evict_age": 0, 2024-04-26T10:21:36.899 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profile": "", 2024-04-26T10:21:36.899 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_params": { 2024-04-26T10:21:36.899 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "none" 2024-04-26T10:21:36.900 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.900 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_period": 0, 2024-04-26T10:21:36.900 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_count": 0, 2024-04-26T10:21:36.900 INFO:teuthology.orchestra.run.smithi052.stdout: "use_gmt_hitset": true, 2024-04-26T10:21:36.900 INFO:teuthology.orchestra.run.smithi052.stdout: "min_read_recency_for_promote": 0, 2024-04-26T10:21:36.900 INFO:teuthology.orchestra.run.smithi052.stdout: "min_write_recency_for_promote": 0, 2024-04-26T10:21:36.900 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_grade_decay_rate": 0, 2024-04-26T10:21:36.900 INFO:teuthology.orchestra.run.smithi052.stdout: "hit_set_search_last_n": 0, 2024-04-26T10:21:36.900 INFO:teuthology.orchestra.run.smithi052.stdout: "grade_table": [], 2024-04-26T10:21:36.900 INFO:teuthology.orchestra.run.smithi052.stdout: "stripe_width": 0, 2024-04-26T10:21:36.900 INFO:teuthology.orchestra.run.smithi052.stdout: "expected_num_objects": 0, 2024-04-26T10:21:36.901 INFO:teuthology.orchestra.run.smithi052.stdout: "fast_read": false, 2024-04-26T10:21:36.901 INFO:teuthology.orchestra.run.smithi052.stdout: "options": {}, 2024-04-26T10:21:36.901 INFO:teuthology.orchestra.run.smithi052.stdout: "application_metadata": { 2024-04-26T10:21:36.901 INFO:teuthology.orchestra.run.smithi052.stdout: "rados": {} 2024-04-26T10:21:36.901 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.901 INFO:teuthology.orchestra.run.smithi052.stdout: "read_balance": { 2024-04-26T10:21:36.901 INFO:teuthology.orchestra.run.smithi052.stdout: "score_acting": 1.25, 2024-04-26T10:21:36.901 INFO:teuthology.orchestra.run.smithi052.stdout: "score_stable": 1.25, 2024-04-26T10:21:36.901 INFO:teuthology.orchestra.run.smithi052.stdout: "optimal_score": 1.5, 2024-04-26T10:21:36.901 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_acting": 1.8799999952316284, 2024-04-26T10:21:36.901 INFO:teuthology.orchestra.run.smithi052.stdout: "raw_score_stable": 1.8799999952316284, 2024-04-26T10:21:36.901 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity_weighted": 0.66666668653488159, 2024-04-26T10:21:36.901 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity": 1, 2024-04-26T10:21:36.901 INFO:teuthology.orchestra.run.smithi052.stdout: "average_primary_affinity_weighted": 0.67000001668930054 2024-04-26T10:21:36.902 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.902 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.902 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-26T10:21:36.902 INFO:teuthology.orchestra.run.smithi052.stdout: "osds": [ 2024-04-26T10:21:36.902 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.902 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T10:21:36.902 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "c5e76c47-dfc4-40ca-88d3-2084cac6e35c", 2024-04-26T10:21:36.902 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-04-26T10:21:36.902 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-04-26T10:21:36.902 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-04-26T10:21:36.902 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-04-26T10:21:36.902 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-04-26T10:21:36.902 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-04-26T10:21:36.903 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 10, 2024-04-26T10:21:36.903 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 22, 2024-04-26T10:21:36.903 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-04-26T10:21:36.903 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-04-26T10:21:36.903 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-04-26T10:21:36.903 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T10:21:36.903 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.904 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T10:21:36.904 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.120:6800", 2024-04-26T10:21:36.904 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18193 2024-04-26T10:21:36.904 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.904 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.904 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T10:21:36.904 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.120:6801", 2024-04-26T10:21:36.904 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18193 2024-04-26T10:21:36.904 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.904 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:36.904 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.905 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-04-26T10:21:36.905 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T10:21:36.905 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.905 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T10:21:36.905 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.120:6802", 2024-04-26T10:21:36.905 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18193 2024-04-26T10:21:36.905 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.905 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.905 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T10:21:36.905 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.120:6803", 2024-04-26T10:21:36.905 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18193 2024-04-26T10:21:36.905 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.905 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:36.905 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-04-26T10:21:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T10:21:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T10:21:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.120:6806", 2024-04-26T10:21:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18193 2024-04-26T10:21:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T10:21:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.120:6807", 2024-04-26T10:21:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18193 2024-04-26T10:21:36.906 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.907 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:36.907 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.907 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-04-26T10:21:36.907 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T10:21:36.907 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.907 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T10:21:36.907 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.120:6804", 2024-04-26T10:21:36.907 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18193 2024-04-26T10:21:36.907 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.907 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.907 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T10:21:36.907 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.120:6805", 2024-04-26T10:21:36.907 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18193 2024-04-26T10:21:36.907 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.908 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:36.908 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.908 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.120:6801/18193", 2024-04-26T10:21:36.908 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.120:6803/18193", 2024-04-26T10:21:36.908 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.120:6807/18193", 2024-04-26T10:21:36.908 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.120:6805/18193", 2024-04-26T10:21:36.908 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-04-26T10:21:36.908 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-04-26T10:21:36.908 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-04-26T10:21:36.908 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:36.908 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.908 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.908 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-04-26T10:21:36.908 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "2a8d530c-cf33-4540-9240-6bd7485e06ee", 2024-04-26T10:21:36.909 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-04-26T10:21:36.909 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-04-26T10:21:36.909 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-04-26T10:21:36.909 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 0, 2024-04-26T10:21:36.909 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-04-26T10:21:36.909 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-04-26T10:21:36.909 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 10, 2024-04-26T10:21:36.909 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 19, 2024-04-26T10:21:36.909 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-04-26T10:21:36.909 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-04-26T10:21:36.909 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-04-26T10:21:36.909 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T10:21:36.909 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T10:21:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6800", 2024-04-26T10:21:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18226 2024-04-26T10:21:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T10:21:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6801", 2024-04-26T10:21:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18226 2024-04-26T10:21:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-04-26T10:21:36.910 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T10:21:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T10:21:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6802", 2024-04-26T10:21:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18226 2024-04-26T10:21:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T10:21:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6803", 2024-04-26T10:21:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18226 2024-04-26T10:21:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-04-26T10:21:36.911 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T10:21:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T10:21:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6806", 2024-04-26T10:21:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18226 2024-04-26T10:21:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T10:21:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6807", 2024-04-26T10:21:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18226 2024-04-26T10:21:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-04-26T10:21:36.912 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T10:21:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T10:21:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6804", 2024-04-26T10:21:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18226 2024-04-26T10:21:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T10:21:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.154:6805", 2024-04-26T10:21:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18226 2024-04-26T10:21:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.154:6801/18226", 2024-04-26T10:21:36.913 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.154:6803/18226", 2024-04-26T10:21:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.154:6807/18226", 2024-04-26T10:21:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.154:6805/18226", 2024-04-26T10:21:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-04-26T10:21:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-04-26T10:21:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-04-26T10:21:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-04-26T10:21:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: "uuid": "484ab70f-4cad-4ff6-9405-8865ec5ee327", 2024-04-26T10:21:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: "up": 1, 2024-04-26T10:21:36.914 INFO:teuthology.orchestra.run.smithi052.stdout: "in": 1, 2024-04-26T10:21:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: "weight": 1, 2024-04-26T10:21:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_affinity": 1, 2024-04-26T10:21:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_begin": 0, 2024-04-26T10:21:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: "last_clean_end": 0, 2024-04-26T10:21:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: "up_from": 9, 2024-04-26T10:21:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: "up_thru": 22, 2024-04-26T10:21:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: "down_at": 0, 2024-04-26T10:21:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: "lost_at": 0, 2024-04-26T10:21:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addrs": { 2024-04-26T10:21:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T10:21:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T10:21:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6800", 2024-04-26T10:21:36.915 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18269 2024-04-26T10:21:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T10:21:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6801", 2024-04-26T10:21:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18269 2024-04-26T10:21:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addrs": { 2024-04-26T10:21:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T10:21:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T10:21:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6802", 2024-04-26T10:21:36.916 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18269 2024-04-26T10:21:36.917 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.917 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.917 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T10:21:36.917 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6803", 2024-04-26T10:21:36.917 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18269 2024-04-26T10:21:36.917 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.917 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:36.917 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.917 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addrs": { 2024-04-26T10:21:36.918 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T10:21:36.918 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.918 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T10:21:36.918 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6806", 2024-04-26T10:21:36.918 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18269 2024-04-26T10:21:36.918 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.918 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.919 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T10:21:36.919 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6807", 2024-04-26T10:21:36.919 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18269 2024-04-26T10:21:36.919 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.919 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:36.919 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.920 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addrs": { 2024-04-26T10:21:36.920 INFO:teuthology.orchestra.run.smithi052.stdout: "addrvec": [ 2024-04-26T10:21:36.920 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.920 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v2", 2024-04-26T10:21:36.920 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6804", 2024-04-26T10:21:36.920 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18269 2024-04-26T10:21:36.921 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.921 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.921 INFO:teuthology.orchestra.run.smithi052.stdout: "type": "v1", 2024-04-26T10:21:36.921 INFO:teuthology.orchestra.run.smithi052.stdout: "addr": "172.21.15.164:6805", 2024-04-26T10:21:36.921 INFO:teuthology.orchestra.run.smithi052.stdout: "nonce": 18269 2024-04-26T10:21:36.921 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.922 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:36.922 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.922 INFO:teuthology.orchestra.run.smithi052.stdout: "public_addr": "172.21.15.164:6801/18269", 2024-04-26T10:21:36.922 INFO:teuthology.orchestra.run.smithi052.stdout: "cluster_addr": "172.21.15.164:6803/18269", 2024-04-26T10:21:36.922 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_back_addr": "172.21.15.164:6807/18269", 2024-04-26T10:21:36.922 INFO:teuthology.orchestra.run.smithi052.stdout: "heartbeat_front_addr": "172.21.15.164:6805/18269", 2024-04-26T10:21:36.922 INFO:teuthology.orchestra.run.smithi052.stdout: "state": [ 2024-04-26T10:21:36.922 INFO:teuthology.orchestra.run.smithi052.stdout: "exists", 2024-04-26T10:21:36.923 INFO:teuthology.orchestra.run.smithi052.stdout: "up" 2024-04-26T10:21:36.923 INFO:teuthology.orchestra.run.smithi052.stdout: ] 2024-04-26T10:21:36.923 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.923 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-26T10:21:36.923 INFO:teuthology.orchestra.run.smithi052.stdout: "osd_xinfo": [ 2024-04-26T10:21:36.923 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.923 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 0, 2024-04-26T10:21:36.924 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-04-26T10:21:36.924 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-04-26T10:21:36.924 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-04-26T10:21:36.924 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540138322906710015, 2024-04-26T10:21:36.924 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-04-26T10:21:36.924 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-04-26T10:20:54.871567+0000", 2024-04-26T10:21:36.924 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-04-26T10:21:36.924 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.925 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.925 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 1, 2024-04-26T10:21:36.925 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-04-26T10:21:36.925 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-04-26T10:21:36.925 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-04-26T10:21:36.925 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540138322906710015, 2024-04-26T10:21:36.925 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-04-26T10:21:36.925 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-04-26T10:20:54.910527+0000", 2024-04-26T10:21:36.926 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-04-26T10:21:36.926 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.926 INFO:teuthology.orchestra.run.smithi052.stdout: { 2024-04-26T10:21:36.926 INFO:teuthology.orchestra.run.smithi052.stdout: "osd": 2, 2024-04-26T10:21:36.926 INFO:teuthology.orchestra.run.smithi052.stdout: "down_stamp": "0.000000", 2024-04-26T10:21:36.926 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_probability": 0, 2024-04-26T10:21:36.926 INFO:teuthology.orchestra.run.smithi052.stdout: "laggy_interval": 0, 2024-04-26T10:21:36.926 INFO:teuthology.orchestra.run.smithi052.stdout: "features": 4540138322906710015, 2024-04-26T10:21:36.927 INFO:teuthology.orchestra.run.smithi052.stdout: "old_weight": 0, 2024-04-26T10:21:36.927 INFO:teuthology.orchestra.run.smithi052.stdout: "last_purged_snaps_scrub": "2024-04-26T10:20:54.761919+0000", 2024-04-26T10:21:36.927 INFO:teuthology.orchestra.run.smithi052.stdout: "dead_epoch": 0 2024-04-26T10:21:36.927 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.927 INFO:teuthology.orchestra.run.smithi052.stdout: ], 2024-04-26T10:21:36.927 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap": [], 2024-04-26T10:21:36.927 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_items": [], 2024-04-26T10:21:36.927 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_upmap_primaries": [], 2024-04-26T10:21:36.928 INFO:teuthology.orchestra.run.smithi052.stdout: "pg_temp": [], 2024-04-26T10:21:36.928 INFO:teuthology.orchestra.run.smithi052.stdout: "primary_temp": [], 2024-04-26T10:21:36.928 INFO:teuthology.orchestra.run.smithi052.stdout: "blocklist": {}, 2024-04-26T10:21:36.928 INFO:teuthology.orchestra.run.smithi052.stdout: "range_blocklist": {}, 2024-04-26T10:21:36.928 INFO:teuthology.orchestra.run.smithi052.stdout: "erasure_code_profiles": { 2024-04-26T10:21:36.928 INFO:teuthology.orchestra.run.smithi052.stdout: "default": { 2024-04-26T10:21:36.928 INFO:teuthology.orchestra.run.smithi052.stdout: "crush-failure-domain": "osd", 2024-04-26T10:21:36.928 INFO:teuthology.orchestra.run.smithi052.stdout: "k": "2", 2024-04-26T10:21:36.929 INFO:teuthology.orchestra.run.smithi052.stdout: "m": "1", 2024-04-26T10:21:36.929 INFO:teuthology.orchestra.run.smithi052.stdout: "plugin": "jerasure", 2024-04-26T10:21:36.929 INFO:teuthology.orchestra.run.smithi052.stdout: "technique": "reed_sol_van" 2024-04-26T10:21:36.929 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.929 INFO:teuthology.orchestra.run.smithi052.stdout: }, 2024-04-26T10:21:36.929 INFO:teuthology.orchestra.run.smithi052.stdout: "removed_snaps_queue": [], 2024-04-26T10:21:36.929 INFO:teuthology.orchestra.run.smithi052.stdout: "new_removed_snaps": [], 2024-04-26T10:21:36.929 INFO:teuthology.orchestra.run.smithi052.stdout: "new_purged_snaps": [], 2024-04-26T10:21:36.929 INFO:teuthology.orchestra.run.smithi052.stdout: "crush_node_flags": {}, 2024-04-26T10:21:36.929 INFO:teuthology.orchestra.run.smithi052.stdout: "device_class_flags": {}, 2024-04-26T10:21:36.929 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode": { 2024-04-26T10:21:36.929 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_enabled": false, 2024-04-26T10:21:36.929 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_bucket_count": 0, 2024-04-26T10:21:36.929 INFO:teuthology.orchestra.run.smithi052.stdout: "degraded_stretch_mode": 0, 2024-04-26T10:21:36.930 INFO:teuthology.orchestra.run.smithi052.stdout: "recovering_stretch_mode": 0, 2024-04-26T10:21:36.930 INFO:teuthology.orchestra.run.smithi052.stdout: "stretch_mode_bucket": 0 2024-04-26T10:21:36.930 INFO:teuthology.orchestra.run.smithi052.stdout: } 2024-04-26T10:21:36.930 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-26T10:21:36.931 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:36.931 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:36.932 INFO:tasks.thrashosds.thrasher:j is {'epoch': 25, 'fsid': '485c78cb-ad62-4584-aba6-316dd9c93a12', 'created': '2024-04-26T10:20:48.363934+0000', 'modified': '2024-04-26T10:21:34.524943+0000', 'last_up_change': '2024-04-26T10:20:58.098141+0000', 'last_in_change': '2024-04-26T10:20:49.575442+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-26T10:20:59.994755+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-26T10:21:03.866927+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1, 'score_stable': 1, 'optimal_score': 1.5, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-26T10:21:07.853429+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1.5, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-26T10:21:08.285131+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.0299999713897705, 'score_stable': 1.0299999713897705, 'optimal_score': 1.5, 'raw_score_acting': 1.5499999523162842, 'raw_score_stable': 1.5499999523162842, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-26T10:21:31.363128+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1.5, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.6666666865348816, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.6700000166893005}}], 'osds': [{'osd': 0, 'uuid': 'c5e76c47-dfc4-40ca-88d3-2084cac6e35c', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 10, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6800', 'nonce': 18193}, {'type': 'v1', 'addr': '172.21.15.120:6801', 'nonce': 18193}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6802', 'nonce': 18193}, {'type': 'v1', 'addr': '172.21.15.120:6803', 'nonce': 18193}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6806', 'nonce': 18193}, {'type': 'v1', 'addr': '172.21.15.120:6807', 'nonce': 18193}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.120:6804', 'nonce': 18193}, {'type': 'v1', 'addr': '172.21.15.120:6805', 'nonce': 18193}]}, 'public_addr': '172.21.15.120:6801/18193', 'cluster_addr': '172.21.15.120:6803/18193', 'heartbeat_back_addr': '172.21.15.120:6807/18193', 'heartbeat_front_addr': '172.21.15.120:6805/18193', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '2a8d530c-cf33-4540-9240-6bd7485e06ee', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 10, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6800', 'nonce': 18226}, {'type': 'v1', 'addr': '172.21.15.154:6801', 'nonce': 18226}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6802', 'nonce': 18226}, {'type': 'v1', 'addr': '172.21.15.154:6803', 'nonce': 18226}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6806', 'nonce': 18226}, {'type': 'v1', 'addr': '172.21.15.154:6807', 'nonce': 18226}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6804', 'nonce': 18226}, {'type': 'v1', 'addr': '172.21.15.154:6805', 'nonce': 18226}]}, 'public_addr': '172.21.15.154:6801/18226', 'cluster_addr': '172.21.15.154:6803/18226', 'heartbeat_back_addr': '172.21.15.154:6807/18226', 'heartbeat_front_addr': '172.21.15.154:6805/18226', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '484ab70f-4cad-4ff6-9405-8865ec5ee327', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6800', 'nonce': 18269}, {'type': 'v1', 'addr': '172.21.15.164:6801', 'nonce': 18269}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6802', 'nonce': 18269}, {'type': 'v1', 'addr': '172.21.15.164:6803', 'nonce': 18269}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6806', 'nonce': 18269}, {'type': 'v1', 'addr': '172.21.15.164:6807', 'nonce': 18269}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6804', 'nonce': 18269}, {'type': 'v1', 'addr': '172.21.15.164:6805', 'nonce': 18269}]}, 'public_addr': '172.21.15.164:6801/18269', 'cluster_addr': '172.21.15.164:6803/18269', 'heartbeat_back_addr': '172.21.15.164:6807/18269', 'heartbeat_front_addr': '172.21.15.164:6805/18269', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:20:54.871567+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:20:54.910527+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-26T10:20:54.761919+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-26T10:21:36.932 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:21:36.933 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:36.928+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:36.934 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:37.032 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:37.029+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:37.092 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:37.092 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:37.104 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:21:37.133 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:37.129+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:37.232 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:37.233 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:37.234 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:37.229+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:37.247 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:21:37.268 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:21:37.270 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:21:37.282 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-26T10:21:35.945147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":14289754,"num_objects":233,"num_object_clones":0,"num_object_copies":466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":457,"num_write_kb":16850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":405,"ondisk_log_size":405,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":230,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94916,"kb_used_data":1552,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283020604,"statfs":{"total":289910292480,"available":289813098496,"internally_reserved":0,"allocated":1589248,"data_stored":13922910,"data_compressed":23654,"data_compressed_allocated":856064,"data_compressed_original":13664256,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13697024,"num_objects":209,"num_object_clones":0,"num_object_copies":418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":13376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.428506"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.545279+0000","last_change":"2024-04-26T10:21:32.543855+0000","last_active":"2024-04-26T10:21:32.545279+0000","last_peered":"2024-04-26T10:21:32.545279+0000","last_clean":"2024-04-26T10:21:32.545279+0000","last_became_active":"2024-04-26T10:21:32.543308+0000","last_became_peered":"2024-04-26T10:21:32.543308+0000","last_unstale":"2024-04-26T10:21:32.545279+0000","last_undegraded":"2024-04-26T10:21:32.545279+0000","last_fullsized":"2024-04-26T10:21:32.545279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:08:53.782736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.546025+0000","last_change":"2024-04-26T10:21:32.545088+0000","last_active":"2024-04-26T10:21:32.546025+0000","last_peered":"2024-04-26T10:21:32.546025+0000","last_clean":"2024-04-26T10:21:32.546025+0000","last_became_active":"2024-04-26T10:21:32.544355+0000","last_became_peered":"2024-04-26T10:21:32.544355+0000","last_unstale":"2024-04-26T10:21:32.546025+0000","last_undegraded":"2024-04-26T10:21:32.546025+0000","last_fullsized":"2024-04-26T10:21:32.546025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:37.625231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.532976+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:21:32.532976+0000","last_peered":"2024-04-26T10:21:32.532976+0000","last_clean":"2024-04-26T10:21:32.532976+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:21:32.532976+0000","last_undegraded":"2024-04-26T10:21:32.532976+0000","last_fullsized":"2024-04-26T10:21:32.532976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:01.883964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.529031+0000","last_change":"2024-04-26T10:21:09.306531+0000","last_active":"2024-04-26T10:21:32.529031+0000","last_peered":"2024-04-26T10:21:32.529031+0000","last_clean":"2024-04-26T10:21:32.529031+0000","last_became_active":"2024-04-26T10:21:09.304885+0000","last_became_peered":"2024-04-26T10:21:09.304885+0000","last_unstale":"2024-04-26T10:21:32.529031+0000","last_undegraded":"2024-04-26T10:21:32.529031+0000","last_fullsized":"2024-04-26T10:21:32.529031+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:02:04.179516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.545678+0000","last_change":"2024-04-26T10:21:32.544572+0000","last_active":"2024-04-26T10:21:32.545678+0000","last_peered":"2024-04-26T10:21:32.545678+0000","last_clean":"2024-04-26T10:21:32.545678+0000","last_became_active":"2024-04-26T10:21:32.543224+0000","last_became_peered":"2024-04-26T10:21:32.543224+0000","last_unstale":"2024-04-26T10:21:32.545678+0000","last_undegraded":"2024-04-26T10:21:32.545678+0000","last_fullsized":"2024-04-26T10:21:32.545678+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:03:24.147031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.530475+0000","last_change":"2024-04-26T10:21:09.305198+0000","last_active":"2024-04-26T10:21:32.530475+0000","last_peered":"2024-04-26T10:21:32.530475+0000","last_clean":"2024-04-26T10:21:32.530475+0000","last_became_active":"2024-04-26T10:21:09.304716+0000","last_became_peered":"2024-04-26T10:21:09.304716+0000","last_unstale":"2024-04-26T10:21:32.530475+0000","last_undegraded":"2024-04-26T10:21:32.530475+0000","last_fullsized":"2024-04-26T10:21:32.530475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:59:11.224015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.532593+0000","last_change":"2024-04-26T10:21:09.307188+0000","last_active":"2024-04-26T10:21:32.532593+0000","last_peered":"2024-04-26T10:21:32.532593+0000","last_clean":"2024-04-26T10:21:32.532593+0000","last_became_active":"2024-04-26T10:21:09.306548+0000","last_became_peered":"2024-04-26T10:21:09.306548+0000","last_unstale":"2024-04-26T10:21:32.532593+0000","last_undegraded":"2024-04-26T10:21:32.532593+0000","last_fullsized":"2024-04-26T10:21:32.532593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:29.565507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.527356+0000","last_change":"2024-04-26T10:21:09.308284+0000","last_active":"2024-04-26T10:21:32.527356+0000","last_peered":"2024-04-26T10:21:32.527356+0000","last_clean":"2024-04-26T10:21:32.527356+0000","last_became_active":"2024-04-26T10:21:09.307504+0000","last_became_peered":"2024-04-26T10:21:09.307504+0000","last_unstale":"2024-04-26T10:21:32.527356+0000","last_undegraded":"2024-04-26T10:21:32.527356+0000","last_fullsized":"2024-04-26T10:21:32.527356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:51.549222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.529695+0000","last_change":"2024-04-26T10:21:09.314160+0000","last_active":"2024-04-26T10:21:31.529695+0000","last_peered":"2024-04-26T10:21:31.529695+0000","last_clean":"2024-04-26T10:21:31.529695+0000","last_became_active":"2024-04-26T10:21:09.313221+0000","last_became_peered":"2024-04-26T10:21:09.313221+0000","last_unstale":"2024-04-26T10:21:31.529695+0000","last_undegraded":"2024-04-26T10:21:31.529695+0000","last_fullsized":"2024-04-26T10:21:31.529695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:22:50.157094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.545308+0000","last_change":"2024-04-26T10:21:32.543815+0000","last_active":"2024-04-26T10:21:32.545308+0000","last_peered":"2024-04-26T10:21:32.545308+0000","last_clean":"2024-04-26T10:21:32.545308+0000","last_became_active":"2024-04-26T10:21:32.543176+0000","last_became_peered":"2024-04-26T10:21:32.543176+0000","last_unstale":"2024-04-26T10:21:32.545308+0000","last_undegraded":"2024-04-26T10:21:32.545308+0000","last_fullsized":"2024-04-26T10:21:32.545308+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:54.248895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.533152+0000","last_change":"2024-04-26T10:21:09.307173+0000","last_active":"2024-04-26T10:21:32.533152+0000","last_peered":"2024-04-26T10:21:32.533152+0000","last_clean":"2024-04-26T10:21:32.533152+0000","last_became_active":"2024-04-26T10:21:09.306523+0000","last_became_peered":"2024-04-26T10:21:09.306523+0000","last_unstale":"2024-04-26T10:21:32.533152+0000","last_undegraded":"2024-04-26T10:21:32.533152+0000","last_fullsized":"2024-04-26T10:21:32.533152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:15.102637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.529004+0000","last_change":"2024-04-26T10:21:32.541146+0000","last_active":"2024-04-26T10:21:33.529004+0000","last_peered":"2024-04-26T10:21:33.529004+0000","last_clean":"2024-04-26T10:21:33.529004+0000","last_became_active":"2024-04-26T10:21:32.540875+0000","last_became_peered":"2024-04-26T10:21:32.540875+0000","last_unstale":"2024-04-26T10:21:33.529004+0000","last_undegraded":"2024-04-26T10:21:33.529004+0000","last_fullsized":"2024-04-26T10:21:33.529004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:07:59.198545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.545615+0000","last_change":"2024-04-26T10:21:32.544511+0000","last_active":"2024-04-26T10:21:32.545615+0000","last_peered":"2024-04-26T10:21:32.545615+0000","last_clean":"2024-04-26T10:21:32.545615+0000","last_became_active":"2024-04-26T10:21:32.543519+0000","last_became_peered":"2024-04-26T10:21:32.543519+0000","last_unstale":"2024-04-26T10:21:32.545615+0000","last_undegraded":"2024-04-26T10:21:32.545615+0000","last_fullsized":"2024-04-26T10:21:32.545615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:00:19.494449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.530707+0000","last_change":"2024-04-26T10:21:09.316821+0000","last_active":"2024-04-26T10:21:32.530707+0000","last_peered":"2024-04-26T10:21:32.530707+0000","last_clean":"2024-04-26T10:21:32.530707+0000","last_became_active":"2024-04-26T10:21:09.316143+0000","last_became_peered":"2024-04-26T10:21:09.316143+0000","last_unstale":"2024-04-26T10:21:32.530707+0000","last_undegraded":"2024-04-26T10:21:32.530707+0000","last_fullsized":"2024-04-26T10:21:32.530707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:12:20.271378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.532707+0000","last_change":"2024-04-26T10:21:09.314710+0000","last_active":"2024-04-26T10:21:32.532707+0000","last_peered":"2024-04-26T10:21:32.532707+0000","last_clean":"2024-04-26T10:21:32.532707+0000","last_became_active":"2024-04-26T10:21:09.314401+0000","last_became_peered":"2024-04-26T10:21:09.314401+0000","last_unstale":"2024-04-26T10:21:32.532707+0000","last_undegraded":"2024-04-26T10:21:32.532707+0000","last_fullsized":"2024-04-26T10:21:32.532707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:08:14.245434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.527576+0000","last_change":"2024-04-26T10:21:09.306575+0000","last_active":"2024-04-26T10:21:32.527576+0000","last_peered":"2024-04-26T10:21:32.527576+0000","last_clean":"2024-04-26T10:21:32.527576+0000","last_became_active":"2024-04-26T10:21:09.305009+0000","last_became_peered":"2024-04-26T10:21:09.305009+0000","last_unstale":"2024-04-26T10:21:32.527576+0000","last_undegraded":"2024-04-26T10:21:32.527576+0000","last_fullsized":"2024-04-26T10:21:32.527576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:45:42.965427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.531339+0000","last_change":"2024-04-26T10:21:09.317530+0000","last_active":"2024-04-26T10:21:31.531339+0000","last_peered":"2024-04-26T10:21:31.531339+0000","last_clean":"2024-04-26T10:21:31.531339+0000","last_became_active":"2024-04-26T10:21:09.316956+0000","last_became_peered":"2024-04-26T10:21:09.316956+0000","last_unstale":"2024-04-26T10:21:31.531339+0000","last_undegraded":"2024-04-26T10:21:31.531339+0000","last_fullsized":"2024-04-26T10:21:31.531339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:38:05.112877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.546035+0000","last_change":"2024-04-26T10:21:32.545204+0000","last_active":"2024-04-26T10:21:32.546035+0000","last_peered":"2024-04-26T10:21:32.546035+0000","last_clean":"2024-04-26T10:21:32.546035+0000","last_became_active":"2024-04-26T10:21:32.544832+0000","last_became_peered":"2024-04-26T10:21:32.544832+0000","last_unstale":"2024-04-26T10:21:32.546035+0000","last_undegraded":"2024-04-26T10:21:32.546035+0000","last_fullsized":"2024-04-26T10:21:32.546035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:18.644866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.527226+0000","last_change":"2024-04-26T10:21:09.316805+0000","last_active":"2024-04-26T10:21:31.527226+0000","last_peered":"2024-04-26T10:21:31.527226+0000","last_clean":"2024-04-26T10:21:31.527226+0000","last_became_active":"2024-04-26T10:21:09.316490+0000","last_became_peered":"2024-04-26T10:21:09.316490+0000","last_unstale":"2024-04-26T10:21:31.527226+0000","last_undegraded":"2024-04-26T10:21:31.527226+0000","last_fullsized":"2024-04-26T10:21:31.527226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:25:11.814183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.530584+0000","last_change":"2024-04-26T10:21:09.314189+0000","last_active":"2024-04-26T10:21:32.530584+0000","last_peered":"2024-04-26T10:21:32.530584+0000","last_clean":"2024-04-26T10:21:32.530584+0000","last_became_active":"2024-04-26T10:21:09.313648+0000","last_became_peered":"2024-04-26T10:21:09.313648+0000","last_unstale":"2024-04-26T10:21:32.530584+0000","last_undegraded":"2024-04-26T10:21:32.530584+0000","last_fullsized":"2024-04-26T10:21:32.530584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:12:57.658133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.532194+0000","last_change":"2024-04-26T10:21:09.316594+0000","last_active":"2024-04-26T10:21:32.532194+0000","last_peered":"2024-04-26T10:21:32.532194+0000","last_clean":"2024-04-26T10:21:32.532194+0000","last_became_active":"2024-04-26T10:21:09.315877+0000","last_became_peered":"2024-04-26T10:21:09.315877+0000","last_unstale":"2024-04-26T10:21:32.532194+0000","last_undegraded":"2024-04-26T10:21:32.532194+0000","last_fullsized":"2024-04-26T10:21:32.532194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:19.943321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.528876+0000","last_change":"2024-04-26T10:21:32.541586+0000","last_active":"2024-04-26T10:21:33.528876+0000","last_peered":"2024-04-26T10:21:33.528876+0000","last_clean":"2024-04-26T10:21:33.528876+0000","last_became_active":"2024-04-26T10:21:32.541327+0000","last_became_peered":"2024-04-26T10:21:32.541327+0000","last_unstale":"2024-04-26T10:21:33.528876+0000","last_undegraded":"2024-04-26T10:21:33.528876+0000","last_fullsized":"2024-04-26T10:21:33.528876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:16:23.914498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.524260+0000","last_change":"2024-04-26T10:21:09.309068+0000","last_active":"2024-04-26T10:21:31.524260+0000","last_peered":"2024-04-26T10:21:31.524260+0000","last_clean":"2024-04-26T10:21:31.524260+0000","last_became_active":"2024-04-26T10:21:09.308797+0000","last_became_peered":"2024-04-26T10:21:09.308797+0000","last_unstale":"2024-04-26T10:21:31.524260+0000","last_undegraded":"2024-04-26T10:21:31.524260+0000","last_fullsized":"2024-04-26T10:21:31.524260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:10:44.761759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.542689+0000","last_change":"2024-04-26T10:21:32.541721+0000","last_active":"2024-04-26T10:21:32.542689+0000","last_peered":"2024-04-26T10:21:32.542689+0000","last_clean":"2024-04-26T10:21:32.542689+0000","last_became_active":"2024-04-26T10:21:32.541393+0000","last_became_peered":"2024-04-26T10:21:32.541393+0000","last_unstale":"2024-04-26T10:21:32.542689+0000","last_undegraded":"2024-04-26T10:21:32.542689+0000","last_fullsized":"2024-04-26T10:21:32.542689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:58:19.030113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.530540+0000","last_change":"2024-04-26T10:21:32.543391+0000","last_active":"2024-04-26T10:21:33.530540+0000","last_peered":"2024-04-26T10:21:33.530540+0000","last_clean":"2024-04-26T10:21:33.530540+0000","last_became_active":"2024-04-26T10:21:32.542927+0000","last_became_peered":"2024-04-26T10:21:32.542927+0000","last_unstale":"2024-04-26T10:21:33.530540+0000","last_undegraded":"2024-04-26T10:21:33.530540+0000","last_fullsized":"2024-04-26T10:21:33.530540+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:08.107400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.531941+0000","last_change":"2024-04-26T10:21:09.312839+0000","last_active":"2024-04-26T10:21:31.531941+0000","last_peered":"2024-04-26T10:21:31.531941+0000","last_clean":"2024-04-26T10:21:31.531941+0000","last_became_active":"2024-04-26T10:21:09.311898+0000","last_became_peered":"2024-04-26T10:21:09.311898+0000","last_unstale":"2024-04-26T10:21:31.531941+0000","last_undegraded":"2024-04-26T10:21:31.531941+0000","last_fullsized":"2024-04-26T10:21:31.531941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:02:03.705171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.533385+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:21:32.533385+0000","last_peered":"2024-04-26T10:21:32.533385+0000","last_clean":"2024-04-26T10:21:32.533385+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:21:32.533385+0000","last_undegraded":"2024-04-26T10:21:32.533385+0000","last_fullsized":"2024-04-26T10:21:32.533385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:39.394937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.529099+0000","last_change":"2024-04-26T10:21:32.540975+0000","last_active":"2024-04-26T10:21:33.529099+0000","last_peered":"2024-04-26T10:21:33.529099+0000","last_clean":"2024-04-26T10:21:33.529099+0000","last_became_active":"2024-04-26T10:21:32.540675+0000","last_became_peered":"2024-04-26T10:21:32.540675+0000","last_unstale":"2024-04-26T10:21:33.529099+0000","last_undegraded":"2024-04-26T10:21:33.529099+0000","last_fullsized":"2024-04-26T10:21:33.529099+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:18.214022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.527501+0000","last_change":"2024-04-26T10:21:09.316871+0000","last_active":"2024-04-26T10:21:31.527501+0000","last_peered":"2024-04-26T10:21:31.527501+0000","last_clean":"2024-04-26T10:21:31.527501+0000","last_became_active":"2024-04-26T10:21:09.316529+0000","last_became_peered":"2024-04-26T10:21:09.316529+0000","last_unstale":"2024-04-26T10:21:31.527501+0000","last_undegraded":"2024-04-26T10:21:31.527501+0000","last_fullsized":"2024-04-26T10:21:31.527501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:52.614699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.529205+0000","last_change":"2024-04-26T10:21:32.541226+0000","last_active":"2024-04-26T10:21:33.529205+0000","last_peered":"2024-04-26T10:21:33.529205+0000","last_clean":"2024-04-26T10:21:33.529205+0000","last_became_active":"2024-04-26T10:21:32.540416+0000","last_became_peered":"2024-04-26T10:21:32.540416+0000","last_unstale":"2024-04-26T10:21:33.529205+0000","last_undegraded":"2024-04-26T10:21:33.529205+0000","last_fullsized":"2024-04-26T10:21:33.529205+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:43:55.139484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.524394+0000","last_change":"2024-04-26T10:21:09.314165+0000","last_active":"2024-04-26T10:21:31.524394+0000","last_peered":"2024-04-26T10:21:31.524394+0000","last_clean":"2024-04-26T10:21:31.524394+0000","last_became_active":"2024-04-26T10:21:09.313559+0000","last_became_peered":"2024-04-26T10:21:09.313559+0000","last_unstale":"2024-04-26T10:21:31.524394+0000","last_undegraded":"2024-04-26T10:21:31.524394+0000","last_fullsized":"2024-04-26T10:21:31.524394+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:03:05.857831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.527782+0000","last_change":"2024-04-26T10:21:09.309366+0000","last_active":"2024-04-26T10:21:32.527782+0000","last_peered":"2024-04-26T10:21:32.527782+0000","last_clean":"2024-04-26T10:21:32.527782+0000","last_became_active":"2024-04-26T10:21:09.308660+0000","last_became_peered":"2024-04-26T10:21:09.308660+0000","last_unstale":"2024-04-26T10:21:32.527782+0000","last_undegraded":"2024-04-26T10:21:32.527782+0000","last_fullsized":"2024-04-26T10:21:32.527782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:26.335327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.542692+0000","last_change":"2024-04-26T10:21:32.541726+0000","last_active":"2024-04-26T10:21:32.542692+0000","last_peered":"2024-04-26T10:21:32.542692+0000","last_clean":"2024-04-26T10:21:32.542692+0000","last_became_active":"2024-04-26T10:21:32.541205+0000","last_became_peered":"2024-04-26T10:21:32.541205+0000","last_unstale":"2024-04-26T10:21:32.542692+0000","last_undegraded":"2024-04-26T10:21:32.542692+0000","last_fullsized":"2024-04-26T10:21:32.542692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:04.166665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.532190+0000","last_change":"2024-04-26T10:21:08.939370+0000","last_active":"2024-04-26T10:21:32.532190+0000","last_peered":"2024-04-26T10:21:32.532190+0000","last_clean":"2024-04-26T10:21:32.532190+0000","last_became_active":"2024-04-26T10:21:08.937845+0000","last_became_peered":"2024-04-26T10:21:08.937845+0000","last_unstale":"2024-04-26T10:21:32.532190+0000","last_undegraded":"2024-04-26T10:21:32.532190+0000","last_fullsized":"2024-04-26T10:21:32.532190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:16:28.621650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.545546+0000","last_change":"2024-04-26T10:21:32.543859+0000","last_active":"2024-04-26T10:21:32.545546+0000","last_peered":"2024-04-26T10:21:32.545546+0000","last_clean":"2024-04-26T10:21:32.545546+0000","last_became_active":"2024-04-26T10:21:32.543220+0000","last_became_peered":"2024-04-26T10:21:32.543220+0000","last_unstale":"2024-04-26T10:21:32.545546+0000","last_undegraded":"2024-04-26T10:21:32.545546+0000","last_fullsized":"2024-04-26T10:21:32.545546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:17:48.957254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.526620+0000","last_change":"2024-04-26T10:21:08.937056+0000","last_active":"2024-04-26T10:21:31.526620+0000","last_peered":"2024-04-26T10:21:31.526620+0000","last_clean":"2024-04-26T10:21:31.526620+0000","last_became_active":"2024-04-26T10:21:08.936545+0000","last_became_peered":"2024-04-26T10:21:08.936545+0000","last_unstale":"2024-04-26T10:21:31.526620+0000","last_undegraded":"2024-04-26T10:21:31.526620+0000","last_fullsized":"2024-04-26T10:21:31.526620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:48.449203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.532173+0000","last_change":"2024-04-26T10:21:09.313813+0000","last_active":"2024-04-26T10:21:31.532173+0000","last_peered":"2024-04-26T10:21:31.532173+0000","last_clean":"2024-04-26T10:21:31.532173+0000","last_became_active":"2024-04-26T10:21:09.312562+0000","last_became_peered":"2024-04-26T10:21:09.312562+0000","last_unstale":"2024-04-26T10:21:31.532173+0000","last_undegraded":"2024-04-26T10:21:31.532173+0000","last_fullsized":"2024-04-26T10:21:31.532173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:23:46.413942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.529869+0000","last_change":"2024-04-26T10:21:32.544340+0000","last_active":"2024-04-26T10:21:33.529869+0000","last_peered":"2024-04-26T10:21:33.529869+0000","last_clean":"2024-04-26T10:21:33.529869+0000","last_became_active":"2024-04-26T10:21:32.543870+0000","last_became_peered":"2024-04-26T10:21:32.543870+0000","last_unstale":"2024-04-26T10:21:33.529869+0000","last_undegraded":"2024-04-26T10:21:33.529869+0000","last_fullsized":"2024-04-26T10:21:33.529869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:30:22.052371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.529912+0000","last_change":"2024-04-26T10:21:09.314435+0000","last_active":"2024-04-26T10:21:31.529912+0000","last_peered":"2024-04-26T10:21:31.529912+0000","last_clean":"2024-04-26T10:21:31.529912+0000","last_became_active":"2024-04-26T10:21:09.313684+0000","last_became_peered":"2024-04-26T10:21:09.313684+0000","last_unstale":"2024-04-26T10:21:31.529912+0000","last_undegraded":"2024-04-26T10:21:31.529912+0000","last_fullsized":"2024-04-26T10:21:31.529912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:20.185980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":22,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.530128+0000","last_change":"2024-04-26T10:21:08.934971+0000","last_active":"2024-04-26T10:21:32.530128+0000","last_peered":"2024-04-26T10:21:32.530128+0000","last_clean":"2024-04-26T10:21:32.530128+0000","last_became_active":"2024-04-26T10:21:08.934653+0000","last_became_peered":"2024-04-26T10:21:08.934653+0000","last_unstale":"2024-04-26T10:21:32.530128+0000","last_undegraded":"2024-04-26T10:21:32.530128+0000","last_fullsized":"2024-04-26T10:21:32.530128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:19:18.272015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"24'34","reported_seq":42,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.803167+0000","last_change":"2024-04-26T10:21:32.541171+0000","last_active":"2024-04-26T10:21:33.803167+0000","last_peered":"2024-04-26T10:21:33.803167+0000","last_clean":"2024-04-26T10:21:33.803167+0000","last_became_active":"2024-04-26T10:21:32.540797+0000","last_became_peered":"2024-04-26T10:21:32.540797+0000","last_unstale":"2024-04-26T10:21:33.803167+0000","last_undegraded":"2024-04-26T10:21:33.803167+0000","last_fullsized":"2024-04-26T10:21:33.803167+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_clean_scrub_stamp":"2024-04-26T10:21:31.505401+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:37:59.463791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2228224,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":2176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.530806+0000","last_change":"2024-04-26T10:21:08.934452+0000","last_active":"2024-04-26T10:21:32.530806+0000","last_peered":"2024-04-26T10:21:32.530806+0000","last_clean":"2024-04-26T10:21:32.530806+0000","last_became_active":"2024-04-26T10:21:08.934091+0000","last_became_peered":"2024-04-26T10:21:08.934091+0000","last_unstale":"2024-04-26T10:21:32.530806+0000","last_undegraded":"2024-04-26T10:21:32.530806+0000","last_fullsized":"2024-04-26T10:21:32.530806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:02:11.224989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.528286+0000","last_change":"2024-04-26T10:21:32.540822+0000","last_active":"2024-04-26T10:21:33.528286+0000","last_peered":"2024-04-26T10:21:33.528286+0000","last_clean":"2024-04-26T10:21:33.528286+0000","last_became_active":"2024-04-26T10:21:32.540426+0000","last_became_peered":"2024-04-26T10:21:32.540426+0000","last_unstale":"2024-04-26T10:21:33.528286+0000","last_undegraded":"2024-04-26T10:21:33.528286+0000","last_fullsized":"2024-04-26T10:21:33.528286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:18.846523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.545590+0000","last_change":"2024-04-26T10:21:32.544248+0000","last_active":"2024-04-26T10:21:32.545590+0000","last_peered":"2024-04-26T10:21:32.545590+0000","last_clean":"2024-04-26T10:21:32.545590+0000","last_became_active":"2024-04-26T10:21:32.543840+0000","last_became_peered":"2024-04-26T10:21:32.543840+0000","last_unstale":"2024-04-26T10:21:32.545590+0000","last_undegraded":"2024-04-26T10:21:32.545590+0000","last_fullsized":"2024-04-26T10:21:32.545590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_clean_scrub_stamp":"2024-04-26T10:21:31.505401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:05.917636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.530133+0000","last_change":"2024-04-26T10:21:32.543124+0000","last_active":"2024-04-26T10:21:33.530133+0000","last_peered":"2024-04-26T10:21:33.530133+0000","last_clean":"2024-04-26T10:21:33.530133+0000","last_became_active":"2024-04-26T10:21:32.542809+0000","last_became_peered":"2024-04-26T10:21:32.542809+0000","last_unstale":"2024-04-26T10:21:33.530133+0000","last_undegraded":"2024-04-26T10:21:33.530133+0000","last_fullsized":"2024-04-26T10:21:33.530133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:31.391083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.542479+0000","last_change":"2024-04-26T10:21:32.541261+0000","last_active":"2024-04-26T10:21:32.542479+0000","last_peered":"2024-04-26T10:21:32.542479+0000","last_clean":"2024-04-26T10:21:32.542479+0000","last_became_active":"2024-04-26T10:21:32.540696+0000","last_became_peered":"2024-04-26T10:21:32.540696+0000","last_unstale":"2024-04-26T10:21:32.542479+0000","last_undegraded":"2024-04-26T10:21:32.542479+0000","last_fullsized":"2024-04-26T10:21:32.542479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:10.452475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.545700+0000","last_change":"2024-04-26T10:21:32.544718+0000","last_active":"2024-04-26T10:21:32.545700+0000","last_peered":"2024-04-26T10:21:32.545700+0000","last_clean":"2024-04-26T10:21:32.545700+0000","last_became_active":"2024-04-26T10:21:32.544117+0000","last_became_peered":"2024-04-26T10:21:32.544117+0000","last_unstale":"2024-04-26T10:21:32.545700+0000","last_undegraded":"2024-04-26T10:21:32.545700+0000","last_fullsized":"2024-04-26T10:21:32.545700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_clean_scrub_stamp":"2024-04-26T10:21:31.505401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:53:29.296599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.534880+0000","last_change":"2024-04-26T10:21:08.935133+0000","last_active":"2024-04-26T10:21:32.534880+0000","last_peered":"2024-04-26T10:21:32.534880+0000","last_clean":"2024-04-26T10:21:32.534880+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:21:32.534880+0000","last_undegraded":"2024-04-26T10:21:32.534880+0000","last_fullsized":"2024-04-26T10:21:32.534880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:25.498249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.531080+0000","last_change":"2024-04-26T10:21:09.315201+0000","last_active":"2024-04-26T10:21:32.531080+0000","last_peered":"2024-04-26T10:21:32.531080+0000","last_clean":"2024-04-26T10:21:32.531080+0000","last_became_active":"2024-04-26T10:21:09.314390+0000","last_became_peered":"2024-04-26T10:21:09.314390+0000","last_unstale":"2024-04-26T10:21:32.531080+0000","last_undegraded":"2024-04-26T10:21:32.531080+0000","last_fullsized":"2024-04-26T10:21:32.531080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:56:21.998466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.542663+0000","last_change":"2024-04-26T10:21:32.541608+0000","last_active":"2024-04-26T10:21:32.542663+0000","last_peered":"2024-04-26T10:21:32.542663+0000","last_clean":"2024-04-26T10:21:32.542663+0000","last_became_active":"2024-04-26T10:21:32.541263+0000","last_became_peered":"2024-04-26T10:21:32.541263+0000","last_unstale":"2024-04-26T10:21:32.542663+0000","last_undegraded":"2024-04-26T10:21:32.542663+0000","last_fullsized":"2024-04-26T10:21:32.542663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_clean_scrub_stamp":"2024-04-26T10:21:31.505401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:16.295990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.530683+0000","last_change":"2024-04-26T10:21:08.939382+0000","last_active":"2024-04-26T10:21:32.530683+0000","last_peered":"2024-04-26T10:21:32.530683+0000","last_clean":"2024-04-26T10:21:32.530683+0000","last_became_active":"2024-04-26T10:21:08.938193+0000","last_became_peered":"2024-04-26T10:21:08.938193+0000","last_unstale":"2024-04-26T10:21:32.530683+0000","last_undegraded":"2024-04-26T10:21:32.530683+0000","last_fullsized":"2024-04-26T10:21:32.530683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:07:01.182611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.526140+0000","last_change":"2024-04-26T10:21:09.313678+0000","last_active":"2024-04-26T10:21:31.526140+0000","last_peered":"2024-04-26T10:21:31.526140+0000","last_clean":"2024-04-26T10:21:31.526140+0000","last_became_active":"2024-04-26T10:21:09.312906+0000","last_became_peered":"2024-04-26T10:21:09.312906+0000","last_unstale":"2024-04-26T10:21:31.526140+0000","last_undegraded":"2024-04-26T10:21:31.526140+0000","last_fullsized":"2024-04-26T10:21:31.526140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:25:14.241108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"24'37","reported_seq":46,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.800833+0000","last_change":"2024-04-26T10:21:32.542958+0000","last_active":"2024-04-26T10:21:33.800833+0000","last_peered":"2024-04-26T10:21:33.800833+0000","last_clean":"2024-04-26T10:21:33.800833+0000","last_became_active":"2024-04-26T10:21:32.542724+0000","last_became_peered":"2024-04-26T10:21:32.542724+0000","last_unstale":"2024-04-26T10:21:33.800833+0000","last_undegraded":"2024-04-26T10:21:33.800833+0000","last_fullsized":"2024-04-26T10:21:33.800833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_clean_scrub_stamp":"2024-04-26T10:21:31.505401+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:51:29.126693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.529183+0000","last_change":"2024-04-26T10:21:08.936904+0000","last_active":"2024-04-26T10:21:31.529183+0000","last_peered":"2024-04-26T10:21:31.529183+0000","last_clean":"2024-04-26T10:21:31.529183+0000","last_became_active":"2024-04-26T10:21:08.936376+0000","last_became_peered":"2024-04-26T10:21:08.936376+0000","last_unstale":"2024-04-26T10:21:31.529183+0000","last_undegraded":"2024-04-26T10:21:31.529183+0000","last_fullsized":"2024-04-26T10:21:31.529183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:19.270525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.529957+0000","last_change":"2024-04-26T10:21:09.307911+0000","last_active":"2024-04-26T10:21:32.529957+0000","last_peered":"2024-04-26T10:21:32.529957+0000","last_clean":"2024-04-26T10:21:32.529957+0000","last_became_active":"2024-04-26T10:21:09.307597+0000","last_became_peered":"2024-04-26T10:21:09.307597+0000","last_unstale":"2024-04-26T10:21:32.529957+0000","last_undegraded":"2024-04-26T10:21:32.529957+0000","last_fullsized":"2024-04-26T10:21:32.529957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:47:21.698558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.539148+0000","last_change":"2024-04-26T10:21:32.538235+0000","last_active":"2024-04-26T10:21:32.539148+0000","last_peered":"2024-04-26T10:21:32.539148+0000","last_clean":"2024-04-26T10:21:32.539148+0000","last_became_active":"2024-04-26T10:21:32.537938+0000","last_became_peered":"2024-04-26T10:21:32.537938+0000","last_unstale":"2024-04-26T10:21:32.539148+0000","last_undegraded":"2024-04-26T10:21:32.539148+0000","last_fullsized":"2024-04-26T10:21:32.539148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_clean_scrub_stamp":"2024-04-26T10:21:31.505401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:18:02.159537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.532312+0000","last_change":"2024-04-26T10:21:08.939072+0000","last_active":"2024-04-26T10:21:32.532312+0000","last_peered":"2024-04-26T10:21:32.532312+0000","last_clean":"2024-04-26T10:21:32.532312+0000","last_became_active":"2024-04-26T10:21:08.938445+0000","last_became_peered":"2024-04-26T10:21:08.938445+0000","last_unstale":"2024-04-26T10:21:32.532312+0000","last_undegraded":"2024-04-26T10:21:32.532312+0000","last_fullsized":"2024-04-26T10:21:32.532312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:06.598189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.533597+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:21:32.533597+0000","last_peered":"2024-04-26T10:21:32.533597+0000","last_clean":"2024-04-26T10:21:32.533597+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:21:32.533597+0000","last_undegraded":"2024-04-26T10:21:32.533597+0000","last_fullsized":"2024-04-26T10:21:32.533597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.f","version":"24'30","reported_seq":39,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.803079+0000","last_change":"2024-04-26T10:21:32.543416+0000","last_active":"2024-04-26T10:21:33.803079+0000","last_peered":"2024-04-26T10:21:33.803079+0000","last_clean":"2024-04-26T10:21:33.803079+0000","last_became_active":"2024-04-26T10:21:32.543074+0000","last_became_peered":"2024-04-26T10:21:32.543074+0000","last_unstale":"2024-04-26T10:21:33.803079+0000","last_undegraded":"2024-04-26T10:21:33.803079+0000","last_fullsized":"2024-04-26T10:21:33.803079+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_clean_scrub_stamp":"2024-04-26T10:21:31.505401+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:42:54.984809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1966080,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":1920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.530119+0000","last_change":"2024-04-26T10:21:32.544376+0000","last_active":"2024-04-26T10:21:33.530119+0000","last_peered":"2024-04-26T10:21:33.530119+0000","last_clean":"2024-04-26T10:21:33.530119+0000","last_became_active":"2024-04-26T10:21:32.544143+0000","last_became_peered":"2024-04-26T10:21:32.544143+0000","last_unstale":"2024-04-26T10:21:33.530119+0000","last_undegraded":"2024-04-26T10:21:33.530119+0000","last_fullsized":"2024-04-26T10:21:33.530119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:27:23.648053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.528264+0000","last_change":"2024-04-26T10:21:09.316361+0000","last_active":"2024-04-26T10:21:32.528264+0000","last_peered":"2024-04-26T10:21:32.528264+0000","last_clean":"2024-04-26T10:21:32.528264+0000","last_became_active":"2024-04-26T10:21:09.315981+0000","last_became_peered":"2024-04-26T10:21:09.315981+0000","last_unstale":"2024-04-26T10:21:32.528264+0000","last_undegraded":"2024-04-26T10:21:32.528264+0000","last_fullsized":"2024-04-26T10:21:32.528264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:00.173638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.546012+0000","last_change":"2024-04-26T10:21:32.544994+0000","last_active":"2024-04-26T10:21:32.546012+0000","last_peered":"2024-04-26T10:21:32.546012+0000","last_clean":"2024-04-26T10:21:32.546012+0000","last_became_active":"2024-04-26T10:21:32.544153+0000","last_became_peered":"2024-04-26T10:21:32.544153+0000","last_unstale":"2024-04-26T10:21:32.546012+0000","last_undegraded":"2024-04-26T10:21:32.546012+0000","last_fullsized":"2024-04-26T10:21:32.546012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_clean_scrub_stamp":"2024-04-26T10:21:31.505401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:58:13.567082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.544474+0000","last_change":"2024-04-26T10:21:32.541856+0000","last_active":"2024-04-26T10:21:32.544474+0000","last_peered":"2024-04-26T10:21:32.544474+0000","last_clean":"2024-04-26T10:21:32.544474+0000","last_became_active":"2024-04-26T10:21:32.541159+0000","last_became_peered":"2024-04-26T10:21:32.541159+0000","last_unstale":"2024-04-26T10:21:32.544474+0000","last_undegraded":"2024-04-26T10:21:32.544474+0000","last_fullsized":"2024-04-26T10:21:32.544474+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:09:26.504438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.530457+0000","last_change":"2024-04-26T10:21:09.317282+0000","last_active":"2024-04-26T10:21:31.530457+0000","last_peered":"2024-04-26T10:21:31.530457+0000","last_clean":"2024-04-26T10:21:31.530457+0000","last_became_active":"2024-04-26T10:21:09.316591+0000","last_became_peered":"2024-04-26T10:21:09.316591+0000","last_unstale":"2024-04-26T10:21:31.530457+0000","last_undegraded":"2024-04-26T10:21:31.530457+0000","last_fullsized":"2024-04-26T10:21:31.530457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:49:28.447361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.544992+0000","last_change":"2024-04-26T10:21:32.543442+0000","last_active":"2024-04-26T10:21:32.544992+0000","last_peered":"2024-04-26T10:21:32.544992+0000","last_clean":"2024-04-26T10:21:32.544992+0000","last_became_active":"2024-04-26T10:21:32.543014+0000","last_became_peered":"2024-04-26T10:21:32.543014+0000","last_unstale":"2024-04-26T10:21:32.544992+0000","last_undegraded":"2024-04-26T10:21:32.544992+0000","last_fullsized":"2024-04-26T10:21:32.544992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_clean_scrub_stamp":"2024-04-26T10:21:31.505401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:44:19.658577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":216,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.530485+0000","last_change":"2024-04-26T10:21:01.829140+0000","last_active":"2024-04-26T10:21:32.530485+0000","last_peered":"2024-04-26T10:21:32.530485+0000","last_clean":"2024-04-26T10:21:32.530485+0000","last_became_active":"2024-04-26T10:21:01.827182+0000","last_became_peered":"2024-04-26T10:21:01.827182+0000","last_unstale":"2024-04-26T10:21:32.530485+0000","last_undegraded":"2024-04-26T10:21:32.530485+0000","last_fullsized":"2024-04-26T10:21:32.530485+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:00:51.477222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.532589+0000","last_change":"2024-04-26T10:21:04.893745+0000","last_active":"2024-04-26T10:21:32.532589+0000","last_peered":"2024-04-26T10:21:32.532589+0000","last_clean":"2024-04-26T10:21:32.532589+0000","last_became_active":"2024-04-26T10:21:04.893031+0000","last_became_peered":"2024-04-26T10:21:04.893031+0000","last_unstale":"2024-04-26T10:21:32.532589+0000","last_undegraded":"2024-04-26T10:21:32.532589+0000","last_fullsized":"2024-04-26T10:21:32.532589+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:02:59.771061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.527602+0000","last_change":"2024-04-26T10:21:08.933706+0000","last_active":"2024-04-26T10:21:31.527602+0000","last_peered":"2024-04-26T10:21:31.527602+0000","last_clean":"2024-04-26T10:21:31.527602+0000","last_became_active":"2024-04-26T10:21:08.933372+0000","last_became_peered":"2024-04-26T10:21:08.933372+0000","last_unstale":"2024-04-26T10:21:31.527602+0000","last_undegraded":"2024-04-26T10:21:31.527602+0000","last_fullsized":"2024-04-26T10:21:31.527602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:30:14.290484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.534690+0000","last_change":"2024-04-26T10:21:09.320889+0000","last_active":"2024-04-26T10:21:32.534690+0000","last_peered":"2024-04-26T10:21:32.534690+0000","last_clean":"2024-04-26T10:21:32.534690+0000","last_became_active":"2024-04-26T10:21:09.320355+0000","last_became_peered":"2024-04-26T10:21:09.320355+0000","last_unstale":"2024-04-26T10:21:32.534690+0000","last_undegraded":"2024-04-26T10:21:32.534690+0000","last_fullsized":"2024-04-26T10:21:32.534690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:26:41.609606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"24'37","reported_seq":47,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.800511+0000","last_change":"2024-04-26T10:21:32.538444+0000","last_active":"2024-04-26T10:21:33.800511+0000","last_peered":"2024-04-26T10:21:33.800511+0000","last_clean":"2024-04-26T10:21:33.800511+0000","last_became_active":"2024-04-26T10:21:32.538093+0000","last_became_peered":"2024-04-26T10:21:32.538093+0000","last_unstale":"2024-04-26T10:21:33.800511+0000","last_undegraded":"2024-04-26T10:21:33.800511+0000","last_fullsized":"2024-04-26T10:21:33.800511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_clean_scrub_stamp":"2024-04-26T10:21:31.505401+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:37.210613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2424832,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":2368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.530354+0000","last_change":"2024-04-26T10:21:04.892156+0000","last_active":"2024-04-26T10:21:32.530354+0000","last_peered":"2024-04-26T10:21:32.530354+0000","last_clean":"2024-04-26T10:21:32.530354+0000","last_became_active":"2024-04-26T10:21:04.891660+0000","last_became_peered":"2024-04-26T10:21:04.891660+0000","last_unstale":"2024-04-26T10:21:32.530354+0000","last_undegraded":"2024-04-26T10:21:32.530354+0000","last_fullsized":"2024-04-26T10:21:32.530354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:03:50.568468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.526980+0000","last_change":"2024-04-26T10:21:08.936815+0000","last_active":"2024-04-26T10:21:31.526980+0000","last_peered":"2024-04-26T10:21:31.526980+0000","last_clean":"2024-04-26T10:21:31.526980+0000","last_became_active":"2024-04-26T10:21:08.936180+0000","last_became_peered":"2024-04-26T10:21:08.936180+0000","last_unstale":"2024-04-26T10:21:31.526980+0000","last_undegraded":"2024-04-26T10:21:31.526980+0000","last_fullsized":"2024-04-26T10:21:31.526980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:41.614282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.546046+0000","last_change":"2024-04-26T10:21:32.545201+0000","last_active":"2024-04-26T10:21:32.546046+0000","last_peered":"2024-04-26T10:21:32.546046+0000","last_clean":"2024-04-26T10:21:32.546046+0000","last_became_active":"2024-04-26T10:21:32.544650+0000","last_became_peered":"2024-04-26T10:21:32.544650+0000","last_unstale":"2024-04-26T10:21:32.546046+0000","last_undegraded":"2024-04-26T10:21:32.546046+0000","last_fullsized":"2024-04-26T10:21:32.546046+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:59:32.588596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.542440+0000","last_change":"2024-04-26T10:21:32.541057+0000","last_active":"2024-04-26T10:21:32.542440+0000","last_peered":"2024-04-26T10:21:32.542440+0000","last_clean":"2024-04-26T10:21:32.542440+0000","last_became_active":"2024-04-26T10:21:32.540739+0000","last_became_peered":"2024-04-26T10:21:32.540739+0000","last_unstale":"2024-04-26T10:21:32.542440+0000","last_undegraded":"2024-04-26T10:21:32.542440+0000","last_fullsized":"2024-04-26T10:21:32.542440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_clean_scrub_stamp":"2024-04-26T10:21:31.505401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:19:48.298913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.529327+0000","last_change":"2024-04-26T10:21:04.890860+0000","last_active":"2024-04-26T10:21:31.529327+0000","last_peered":"2024-04-26T10:21:31.529327+0000","last_clean":"2024-04-26T10:21:31.529327+0000","last_became_active":"2024-04-26T10:21:04.890336+0000","last_became_peered":"2024-04-26T10:21:04.890336+0000","last_unstale":"2024-04-26T10:21:31.529327+0000","last_undegraded":"2024-04-26T10:21:31.529327+0000","last_fullsized":"2024-04-26T10:21:31.529327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:45:13.262120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.528481+0000","last_change":"2024-04-26T10:21:32.540144+0000","last_active":"2024-04-26T10:21:33.528481+0000","last_peered":"2024-04-26T10:21:33.528481+0000","last_clean":"2024-04-26T10:21:33.528481+0000","last_became_active":"2024-04-26T10:21:32.539908+0000","last_became_peered":"2024-04-26T10:21:32.539908+0000","last_unstale":"2024-04-26T10:21:33.528481+0000","last_undegraded":"2024-04-26T10:21:33.528481+0000","last_fullsized":"2024-04-26T10:21:33.528481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:49:40.533900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.530568+0000","last_change":"2024-04-26T10:21:09.314796+0000","last_active":"2024-04-26T10:21:31.530568+0000","last_peered":"2024-04-26T10:21:31.530568+0000","last_clean":"2024-04-26T10:21:31.530568+0000","last_became_active":"2024-04-26T10:21:09.314574+0000","last_became_peered":"2024-04-26T10:21:09.314574+0000","last_unstale":"2024-04-26T10:21:31.530568+0000","last_undegraded":"2024-04-26T10:21:31.530568+0000","last_fullsized":"2024-04-26T10:21:31.530568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:32.136621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.541432+0000","last_change":"2024-04-26T10:21:32.540210+0000","last_active":"2024-04-26T10:21:32.541432+0000","last_peered":"2024-04-26T10:21:32.541432+0000","last_clean":"2024-04-26T10:21:32.541432+0000","last_became_active":"2024-04-26T10:21:32.539957+0000","last_became_peered":"2024-04-26T10:21:32.539957+0000","last_unstale":"2024-04-26T10:21:32.541432+0000","last_undegraded":"2024-04-26T10:21:32.541432+0000","last_fullsized":"2024-04-26T10:21:32.541432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_clean_scrub_stamp":"2024-04-26T10:21:31.505401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:50.914385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.532516+0000","last_change":"2024-04-26T10:21:04.893253+0000","last_active":"2024-04-26T10:21:32.532516+0000","last_peered":"2024-04-26T10:21:32.532516+0000","last_clean":"2024-04-26T10:21:32.532516+0000","last_became_active":"2024-04-26T10:21:04.892843+0000","last_became_peered":"2024-04-26T10:21:04.892843+0000","last_unstale":"2024-04-26T10:21:32.532516+0000","last_undegraded":"2024-04-26T10:21:32.532516+0000","last_fullsized":"2024-04-26T10:21:32.532516+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:23:00.749791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.532411+0000","last_change":"2024-04-26T10:21:08.937153+0000","last_active":"2024-04-26T10:21:32.532411+0000","last_peered":"2024-04-26T10:21:32.532411+0000","last_clean":"2024-04-26T10:21:32.532411+0000","last_became_active":"2024-04-26T10:21:08.936561+0000","last_became_peered":"2024-04-26T10:21:08.936561+0000","last_unstale":"2024-04-26T10:21:32.532411+0000","last_undegraded":"2024-04-26T10:21:32.532411+0000","last_fullsized":"2024-04-26T10:21:32.532411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:28.491800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.529813+0000","last_change":"2024-04-26T10:21:09.314218+0000","last_active":"2024-04-26T10:21:31.529813+0000","last_peered":"2024-04-26T10:21:31.529813+0000","last_clean":"2024-04-26T10:21:31.529813+0000","last_became_active":"2024-04-26T10:21:09.313641+0000","last_became_peered":"2024-04-26T10:21:09.313641+0000","last_unstale":"2024-04-26T10:21:31.529813+0000","last_undegraded":"2024-04-26T10:21:31.529813+0000","last_fullsized":"2024-04-26T10:21:31.529813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:08.449512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.539202+0000","last_change":"2024-04-26T10:21:32.538440+0000","last_active":"2024-04-26T10:21:32.539202+0000","last_peered":"2024-04-26T10:21:32.539202+0000","last_clean":"2024-04-26T10:21:32.539202+0000","last_became_active":"2024-04-26T10:21:32.538185+0000","last_became_peered":"2024-04-26T10:21:32.538185+0000","last_unstale":"2024-04-26T10:21:32.539202+0000","last_undegraded":"2024-04-26T10:21:32.539202+0000","last_fullsized":"2024-04-26T10:21:32.539202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_clean_scrub_stamp":"2024-04-26T10:21:31.505401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:34.530489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.534904+0000","last_change":"2024-04-26T10:21:08.937196+0000","last_active":"2024-04-26T10:21:32.534904+0000","last_peered":"2024-04-26T10:21:32.534904+0000","last_clean":"2024-04-26T10:21:32.534904+0000","last_became_active":"2024-04-26T10:21:08.936779+0000","last_became_peered":"2024-04-26T10:21:08.936779+0000","last_unstale":"2024-04-26T10:21:32.534904+0000","last_undegraded":"2024-04-26T10:21:32.534904+0000","last_fullsized":"2024-04-26T10:21:32.534904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:20.545169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.530751+0000","last_change":"2024-04-26T10:21:04.890548+0000","last_active":"2024-04-26T10:21:31.530751+0000","last_peered":"2024-04-26T10:21:31.530751+0000","last_clean":"2024-04-26T10:21:31.530751+0000","last_became_active":"2024-04-26T10:21:04.890034+0000","last_became_peered":"2024-04-26T10:21:04.890034+0000","last_unstale":"2024-04-26T10:21:31.530751+0000","last_undegraded":"2024-04-26T10:21:31.530751+0000","last_fullsized":"2024-04-26T10:21:31.530751+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:55.033455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.528845+0000","last_change":"2024-04-26T10:21:32.541423+0000","last_active":"2024-04-26T10:21:33.528845+0000","last_peered":"2024-04-26T10:21:33.528845+0000","last_clean":"2024-04-26T10:21:33.528845+0000","last_became_active":"2024-04-26T10:21:32.540908+0000","last_became_peered":"2024-04-26T10:21:32.540908+0000","last_unstale":"2024-04-26T10:21:33.528845+0000","last_undegraded":"2024-04-26T10:21:33.528845+0000","last_fullsized":"2024-04-26T10:21:33.528845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:43.337217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"24'36","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.797883+0000","last_change":"2024-04-26T10:21:32.537965+0000","last_active":"2024-04-26T10:21:33.797883+0000","last_peered":"2024-04-26T10:21:33.797883+0000","last_clean":"2024-04-26T10:21:33.797883+0000","last_became_active":"2024-04-26T10:21:32.537601+0000","last_became_peered":"2024-04-26T10:21:32.537601+0000","last_unstale":"2024-04-26T10:21:33.797883+0000","last_undegraded":"2024-04-26T10:21:33.797883+0000","last_fullsized":"2024-04-26T10:21:33.797883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_clean_scrub_stamp":"2024-04-26T10:21:31.505401+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:52.059503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2359296,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":2304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.530506+0000","last_change":"2024-04-26T10:21:08.933714+0000","last_active":"2024-04-26T10:21:31.530506+0000","last_peered":"2024-04-26T10:21:31.530506+0000","last_clean":"2024-04-26T10:21:31.530506+0000","last_became_active":"2024-04-26T10:21:08.933259+0000","last_became_peered":"2024-04-26T10:21:08.933259+0000","last_unstale":"2024-04-26T10:21:31.530506+0000","last_undegraded":"2024-04-26T10:21:31.530506+0000","last_fullsized":"2024-04-26T10:21:31.530506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:50.230096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.542635+0000","last_change":"2024-04-26T10:21:32.541588+0000","last_active":"2024-04-26T10:21:32.542635+0000","last_peered":"2024-04-26T10:21:32.542635+0000","last_clean":"2024-04-26T10:21:32.542635+0000","last_became_active":"2024-04-26T10:21:32.541074+0000","last_became_peered":"2024-04-26T10:21:32.541074+0000","last_unstale":"2024-04-26T10:21:32.542635+0000","last_undegraded":"2024-04-26T10:21:32.542635+0000","last_fullsized":"2024-04-26T10:21:32.542635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:08.819920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.529256+0000","last_change":"2024-04-26T10:21:32.543754+0000","last_active":"2024-04-26T10:21:33.529256+0000","last_peered":"2024-04-26T10:21:33.529256+0000","last_clean":"2024-04-26T10:21:33.529256+0000","last_became_active":"2024-04-26T10:21:32.543491+0000","last_became_peered":"2024-04-26T10:21:32.543491+0000","last_unstale":"2024-04-26T10:21:33.529256+0000","last_undegraded":"2024-04-26T10:21:33.529256+0000","last_fullsized":"2024-04-26T10:21:33.529256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:25.935811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"24'35","reported_seq":44,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.800628+0000","last_change":"2024-04-26T10:21:32.537982+0000","last_active":"2024-04-26T10:21:33.800628+0000","last_peered":"2024-04-26T10:21:33.800628+0000","last_clean":"2024-04-26T10:21:33.800628+0000","last_became_active":"2024-04-26T10:21:32.537788+0000","last_became_peered":"2024-04-26T10:21:32.537788+0000","last_unstale":"2024-04-26T10:21:33.800628+0000","last_undegraded":"2024-04-26T10:21:33.800628+0000","last_fullsized":"2024-04-26T10:21:33.800628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_clean_scrub_stamp":"2024-04-26T10:21:31.505401+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:10.359454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2293760,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":2240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.531689+0000","last_change":"2024-04-26T10:21:08.934216+0000","last_active":"2024-04-26T10:21:31.531689+0000","last_peered":"2024-04-26T10:21:31.531689+0000","last_clean":"2024-04-26T10:21:31.531689+0000","last_became_active":"2024-04-26T10:21:08.933524+0000","last_became_peered":"2024-04-26T10:21:08.933524+0000","last_unstale":"2024-04-26T10:21:31.531689+0000","last_undegraded":"2024-04-26T10:21:31.531689+0000","last_fullsized":"2024-04-26T10:21:31.531689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:57.798830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.532361+0000","last_change":"2024-04-26T10:21:04.890490+0000","last_active":"2024-04-26T10:21:31.532361+0000","last_peered":"2024-04-26T10:21:31.532361+0000","last_clean":"2024-04-26T10:21:31.532361+0000","last_became_active":"2024-04-26T10:21:04.889808+0000","last_became_peered":"2024-04-26T10:21:04.889808+0000","last_unstale":"2024-04-26T10:21:31.532361+0000","last_undegraded":"2024-04-26T10:21:31.532361+0000","last_fullsized":"2024-04-26T10:21:31.532361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:26:55.711555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.525923+0000","last_change":"2024-04-26T10:21:09.312260+0000","last_active":"2024-04-26T10:21:31.525923+0000","last_peered":"2024-04-26T10:21:31.525923+0000","last_clean":"2024-04-26T10:21:31.525923+0000","last_became_active":"2024-04-26T10:21:09.311309+0000","last_became_peered":"2024-04-26T10:21:09.311309+0000","last_unstale":"2024-04-26T10:21:31.525923+0000","last_undegraded":"2024-04-26T10:21:31.525923+0000","last_fullsized":"2024-04-26T10:21:31.525923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:30.714581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.545663+0000","last_change":"2024-04-26T10:21:32.544660+0000","last_active":"2024-04-26T10:21:32.545663+0000","last_peered":"2024-04-26T10:21:32.545663+0000","last_clean":"2024-04-26T10:21:32.545663+0000","last_became_active":"2024-04-26T10:21:32.544088+0000","last_became_peered":"2024-04-26T10:21:32.544088+0000","last_unstale":"2024-04-26T10:21:32.545663+0000","last_undegraded":"2024-04-26T10:21:32.545663+0000","last_fullsized":"2024-04-26T10:21:32.545663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:31.505401+0000","last_clean_scrub_stamp":"2024-04-26T10:21:31.505401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:05:14.380235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.532274+0000","last_change":"2024-04-26T10:21:08.936623+0000","last_active":"2024-04-26T10:21:31.532274+0000","last_peered":"2024-04-26T10:21:31.532274+0000","last_clean":"2024-04-26T10:21:31.532274+0000","last_became_active":"2024-04-26T10:21:08.936252+0000","last_became_peered":"2024-04-26T10:21:08.936252+0000","last_unstale":"2024-04-26T10:21:31.532274+0000","last_undegraded":"2024-04-26T10:21:31.532274+0000","last_fullsized":"2024-04-26T10:21:31.532274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:24.526250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.532266+0000","last_change":"2024-04-26T10:21:04.892401+0000","last_active":"2024-04-26T10:21:32.532266+0000","last_peered":"2024-04-26T10:21:32.532266+0000","last_clean":"2024-04-26T10:21:32.532266+0000","last_became_active":"2024-04-26T10:21:04.891692+0000","last_became_peered":"2024-04-26T10:21:04.891692+0000","last_unstale":"2024-04-26T10:21:32.532266+0000","last_undegraded":"2024-04-26T10:21:32.532266+0000","last_fullsized":"2024-04-26T10:21:32.532266+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:03:37.548728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.529615+0000","last_change":"2024-04-26T10:21:32.544224+0000","last_active":"2024-04-26T10:21:33.529615+0000","last_peered":"2024-04-26T10:21:33.529615+0000","last_clean":"2024-04-26T10:21:33.529615+0000","last_became_active":"2024-04-26T10:21:32.543788+0000","last_became_peered":"2024-04-26T10:21:32.543788+0000","last_unstale":"2024-04-26T10:21:33.529615+0000","last_undegraded":"2024-04-26T10:21:33.529615+0000","last_fullsized":"2024-04-26T10:21:33.529615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:16:18.827920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.530950+0000","last_change":"2024-04-26T10:21:09.317120+0000","last_active":"2024-04-26T10:21:32.530950+0000","last_peered":"2024-04-26T10:21:32.530950+0000","last_clean":"2024-04-26T10:21:32.530950+0000","last_became_active":"2024-04-26T10:21:09.316741+0000","last_became_peered":"2024-04-26T10:21:09.316741+0000","last_unstale":"2024-04-26T10:21:32.530950+0000","last_undegraded":"2024-04-26T10:21:32.530950+0000","last_fullsized":"2024-04-26T10:21:32.530950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:28:43.702714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.530465+0000","last_change":"2024-04-26T10:21:08.934481+0000","last_active":"2024-04-26T10:21:32.530465+0000","last_peered":"2024-04-26T10:21:32.530465+0000","last_clean":"2024-04-26T10:21:32.530465+0000","last_became_active":"2024-04-26T10:21:08.934076+0000","last_became_peered":"2024-04-26T10:21:08.934076+0000","last_unstale":"2024-04-26T10:21:32.530465+0000","last_undegraded":"2024-04-26T10:21:32.530465+0000","last_fullsized":"2024-04-26T10:21:32.530465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:13:50.622715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.525695+0000","last_change":"2024-04-26T10:21:09.314009+0000","last_active":"2024-04-26T10:21:31.525695+0000","last_peered":"2024-04-26T10:21:31.525695+0000","last_clean":"2024-04-26T10:21:31.525695+0000","last_became_active":"2024-04-26T10:21:09.313556+0000","last_became_peered":"2024-04-26T10:21:09.313556+0000","last_unstale":"2024-04-26T10:21:31.525695+0000","last_undegraded":"2024-04-26T10:21:31.525695+0000","last_fullsized":"2024-04-26T10:21:31.525695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:34.862466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.529838+0000","last_change":"2024-04-26T10:21:32.544029+0000","last_active":"2024-04-26T10:21:33.529838+0000","last_peered":"2024-04-26T10:21:33.529838+0000","last_clean":"2024-04-26T10:21:33.529838+0000","last_became_active":"2024-04-26T10:21:32.543484+0000","last_became_peered":"2024-04-26T10:21:32.543484+0000","last_unstale":"2024-04-26T10:21:33.529838+0000","last_undegraded":"2024-04-26T10:21:33.529838+0000","last_fullsized":"2024-04-26T10:21:33.529838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:09:49.977983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.530327+0000","last_change":"2024-04-26T10:21:08.937597+0000","last_active":"2024-04-26T10:21:32.530327+0000","last_peered":"2024-04-26T10:21:32.530327+0000","last_clean":"2024-04-26T10:21:32.530327+0000","last_became_active":"2024-04-26T10:21:08.936809+0000","last_became_peered":"2024-04-26T10:21:08.936809+0000","last_unstale":"2024-04-26T10:21:32.530327+0000","last_undegraded":"2024-04-26T10:21:32.530327+0000","last_fullsized":"2024-04-26T10:21:32.530327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:58:17.212235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.524523+0000","last_change":"2024-04-26T10:21:09.312054+0000","last_active":"2024-04-26T10:21:31.524523+0000","last_peered":"2024-04-26T10:21:31.524523+0000","last_clean":"2024-04-26T10:21:31.524523+0000","last_became_active":"2024-04-26T10:21:09.310818+0000","last_became_peered":"2024-04-26T10:21:09.310818+0000","last_unstale":"2024-04-26T10:21:31.524523+0000","last_undegraded":"2024-04-26T10:21:31.524523+0000","last_fullsized":"2024-04-26T10:21:31.524523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:05:03.431355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.531163+0000","last_change":"2024-04-26T10:21:08.937445+0000","last_active":"2024-04-26T10:21:31.531163+0000","last_peered":"2024-04-26T10:21:31.531163+0000","last_clean":"2024-04-26T10:21:31.531163+0000","last_became_active":"2024-04-26T10:21:08.937147+0000","last_became_peered":"2024-04-26T10:21:08.937147+0000","last_unstale":"2024-04-26T10:21:31.531163+0000","last_undegraded":"2024-04-26T10:21:31.531163+0000","last_fullsized":"2024-04-26T10:21:31.531163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:54:29.602825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.525792+0000","last_change":"2024-04-26T10:21:09.318091+0000","last_active":"2024-04-26T10:21:31.525792+0000","last_peered":"2024-04-26T10:21:31.525792+0000","last_clean":"2024-04-26T10:21:31.525792+0000","last_became_active":"2024-04-26T10:21:09.317871+0000","last_became_peered":"2024-04-26T10:21:09.317871+0000","last_unstale":"2024-04-26T10:21:31.525792+0000","last_undegraded":"2024-04-26T10:21:31.525792+0000","last_fullsized":"2024-04-26T10:21:31.525792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:32.442915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.530620+0000","last_change":"2024-04-26T10:21:32.540563+0000","last_active":"2024-04-26T10:21:33.530620+0000","last_peered":"2024-04-26T10:21:33.530620+0000","last_clean":"2024-04-26T10:21:33.530620+0000","last_became_active":"2024-04-26T10:21:32.540280+0000","last_became_peered":"2024-04-26T10:21:32.540280+0000","last_unstale":"2024-04-26T10:21:33.530620+0000","last_undegraded":"2024-04-26T10:21:33.530620+0000","last_fullsized":"2024-04-26T10:21:33.530620+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:35:28.862330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.527495+0000","last_change":"2024-04-26T10:21:08.934046+0000","last_active":"2024-04-26T10:21:31.527495+0000","last_peered":"2024-04-26T10:21:31.527495+0000","last_clean":"2024-04-26T10:21:31.527495+0000","last_became_active":"2024-04-26T10:21:08.933341+0000","last_became_peered":"2024-04-26T10:21:08.933341+0000","last_unstale":"2024-04-26T10:21:31.527495+0000","last_undegraded":"2024-04-26T10:21:31.527495+0000","last_fullsized":"2024-04-26T10:21:31.527495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:45.671865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.531743+0000","last_change":"2024-04-26T10:21:09.312081+0000","last_active":"2024-04-26T10:21:31.531743+0000","last_peered":"2024-04-26T10:21:31.531743+0000","last_clean":"2024-04-26T10:21:31.531743+0000","last_became_active":"2024-04-26T10:21:09.310879+0000","last_became_peered":"2024-04-26T10:21:09.310879+0000","last_unstale":"2024-04-26T10:21:31.531743+0000","last_undegraded":"2024-04-26T10:21:31.531743+0000","last_fullsized":"2024-04-26T10:21:31.531743+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:36.358962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.526820+0000","last_change":"2024-04-26T10:21:08.936748+0000","last_active":"2024-04-26T10:21:31.526820+0000","last_peered":"2024-04-26T10:21:31.526820+0000","last_clean":"2024-04-26T10:21:31.526820+0000","last_became_active":"2024-04-26T10:21:08.936316+0000","last_became_peered":"2024-04-26T10:21:08.936316+0000","last_unstale":"2024-04-26T10:21:31.526820+0000","last_undegraded":"2024-04-26T10:21:31.526820+0000","last_fullsized":"2024-04-26T10:21:31.526820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:33:47.721288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.529279+0000","last_change":"2024-04-26T10:21:32.543804+0000","last_active":"2024-04-26T10:21:33.529279+0000","last_peered":"2024-04-26T10:21:33.529279+0000","last_clean":"2024-04-26T10:21:33.529279+0000","last_became_active":"2024-04-26T10:21:32.543216+0000","last_became_peered":"2024-04-26T10:21:32.543216+0000","last_unstale":"2024-04-26T10:21:33.529279+0000","last_undegraded":"2024-04-26T10:21:33.529279+0000","last_fullsized":"2024-04-26T10:21:33.529279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:15:37.568784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.542615+0000","last_change":"2024-04-26T10:21:32.541555+0000","last_active":"2024-04-26T10:21:32.542615+0000","last_peered":"2024-04-26T10:21:32.542615+0000","last_clean":"2024-04-26T10:21:32.542615+0000","last_became_active":"2024-04-26T10:21:32.541111+0000","last_became_peered":"2024-04-26T10:21:32.541111+0000","last_unstale":"2024-04-26T10:21:32.542615+0000","last_undegraded":"2024-04-26T10:21:32.542615+0000","last_fullsized":"2024-04-26T10:21:32.542615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:55:32.156896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.545656+0000","last_change":"2024-04-26T10:21:32.544515+0000","last_active":"2024-04-26T10:21:32.545656+0000","last_peered":"2024-04-26T10:21:32.545656+0000","last_clean":"2024-04-26T10:21:32.545656+0000","last_became_active":"2024-04-26T10:21:32.543847+0000","last_became_peered":"2024-04-26T10:21:32.543847+0000","last_unstale":"2024-04-26T10:21:32.545656+0000","last_undegraded":"2024-04-26T10:21:32.545656+0000","last_fullsized":"2024-04-26T10:21:32.545656+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:29:56.145416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.529598+0000","last_change":"2024-04-26T10:21:32.543659+0000","last_active":"2024-04-26T10:21:33.529598+0000","last_peered":"2024-04-26T10:21:33.529598+0000","last_clean":"2024-04-26T10:21:33.529598+0000","last_became_active":"2024-04-26T10:21:32.542949+0000","last_became_peered":"2024-04-26T10:21:32.542949+0000","last_unstale":"2024-04-26T10:21:33.529598+0000","last_undegraded":"2024-04-26T10:21:33.529598+0000","last_fullsized":"2024-04-26T10:21:33.529598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:31:48.570752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.527804+0000","last_change":"2024-04-26T10:21:09.308077+0000","last_active":"2024-04-26T10:21:32.527804+0000","last_peered":"2024-04-26T10:21:32.527804+0000","last_clean":"2024-04-26T10:21:32.527804+0000","last_became_active":"2024-04-26T10:21:09.307543+0000","last_became_peered":"2024-04-26T10:21:09.307543+0000","last_unstale":"2024-04-26T10:21:32.527804+0000","last_undegraded":"2024-04-26T10:21:32.527804+0000","last_fullsized":"2024-04-26T10:21:32.527804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:31:46.596591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.530245+0000","last_change":"2024-04-26T10:21:08.938933+0000","last_active":"2024-04-26T10:21:32.530245+0000","last_peered":"2024-04-26T10:21:32.530245+0000","last_clean":"2024-04-26T10:21:32.530245+0000","last_became_active":"2024-04-26T10:21:08.938281+0000","last_became_peered":"2024-04-26T10:21:08.938281+0000","last_unstale":"2024-04-26T10:21:32.530245+0000","last_undegraded":"2024-04-26T10:21:32.530245+0000","last_fullsized":"2024-04-26T10:21:32.530245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:50.856581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.531285+0000","last_change":"2024-04-26T10:21:09.315331+0000","last_active":"2024-04-26T10:21:32.531285+0000","last_peered":"2024-04-26T10:21:32.531285+0000","last_clean":"2024-04-26T10:21:32.531285+0000","last_became_active":"2024-04-26T10:21:09.314523+0000","last_became_peered":"2024-04-26T10:21:09.314523+0000","last_unstale":"2024-04-26T10:21:32.531285+0000","last_undegraded":"2024-04-26T10:21:32.531285+0000","last_fullsized":"2024-04-26T10:21:32.531285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:06:24.624358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-26T10:21:33.529688+0000","last_change":"2024-04-26T10:21:32.544033+0000","last_active":"2024-04-26T10:21:33.529688+0000","last_peered":"2024-04-26T10:21:33.529688+0000","last_clean":"2024-04-26T10:21:33.529688+0000","last_became_active":"2024-04-26T10:21:32.543656+0000","last_became_peered":"2024-04-26T10:21:32.543656+0000","last_unstale":"2024-04-26T10:21:33.529688+0000","last_undegraded":"2024-04-26T10:21:33.529688+0000","last_fullsized":"2024-04-26T10:21:33.529688+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:29:46.047319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.539143+0000","last_change":"2024-04-26T10:21:32.537810+0000","last_active":"2024-04-26T10:21:32.539143+0000","last_peered":"2024-04-26T10:21:32.539143+0000","last_clean":"2024-04-26T10:21:32.539143+0000","last_became_active":"2024-04-26T10:21:32.537367+0000","last_became_peered":"2024-04-26T10:21:32.537367+0000","last_unstale":"2024-04-26T10:21:32.539143+0000","last_undegraded":"2024-04-26T10:21:32.539143+0000","last_fullsized":"2024-04-26T10:21:32.539143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:29:26.532732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.532072+0000","last_change":"2024-04-26T10:21:08.933424+0000","last_active":"2024-04-26T10:21:31.532072+0000","last_peered":"2024-04-26T10:21:31.532072+0000","last_clean":"2024-04-26T10:21:31.532072+0000","last_became_active":"2024-04-26T10:21:08.933088+0000","last_became_peered":"2024-04-26T10:21:08.933088+0000","last_unstale":"2024-04-26T10:21:31.532072+0000","last_undegraded":"2024-04-26T10:21:31.532072+0000","last_fullsized":"2024-04-26T10:21:31.532072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:11:55.394913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-04-26T10:21:32.530277+0000","last_change":"2024-04-26T10:21:09.308831+0000","last_active":"2024-04-26T10:21:32.530277+0000","last_peered":"2024-04-26T10:21:32.530277+0000","last_clean":"2024-04-26T10:21:32.530277+0000","last_became_active":"2024-04-26T10:21:09.308457+0000","last_became_peered":"2024-04-26T10:21:09.308457+0000","last_unstale":"2024-04-26T10:21:32.530277+0000","last_undegraded":"2024-04-26T10:21:32.530277+0000","last_fullsized":"2024-04-26T10:21:32.530277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:43:43.137127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-04-26T10:21:31.530677+0000","last_change":"2024-04-26T10:21:08.937023+0000","last_active":"2024-04-26T10:21:31.530677+0000","last_peered":"2024-04-26T10:21:31.530677+0000","last_clean":"2024-04-26T10:21:31.530677+0000","last_became_active":"2024-04-26T10:21:08.936511+0000","last_became_peered":"2024-04-26T10:21:08.936511+0000","last_unstale":"2024-04-26T10:21:31.530677+0000","last_undegraded":"2024-04-26T10:21:31.530677+0000","last_fullsized":"2024-04-26T10:21:31.530677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:44:38.881531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":13697024,"num_objects":209,"num_object_clones":0,"num_object_copies":418,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":13376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2699264,"data_stored":43188224,"data_compressed":36113,"data_compressed_allocated":2699264,"data_compressed_original":43188224,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":13218,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949672971,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":286720,"data_stored":663829,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":0,"up_from":10,"seq":42949672970,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1089536,"data_stored":13186750,"data_compressed":17045,"data_compressed_allocated":819200,"data_compressed_original":13090816,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":2,"up_from":9,"seq":38654705676,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":72331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1376256,"data_stored":22020096,"data_compressed":18411,"data_compressed_allocated":1376256,"data_compressed_original":22020096,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1323008,"data_stored":21168128,"data_compressed":17702,"data_compressed_allocated":1323008,"data_compressed_original":21168128,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:21:37.287 INFO:tasks.thrashosds.thrasher:Setting 4.34 to [2, 1, 0] 2024-04-26T10:21:37.287 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '4.34', '2', '1', '0'] 2024-04-26T10:21:37.287 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 4.34 2 1 0 2024-04-26T10:21:37.335 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:37.333+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:37.378 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:37.378 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:37.392 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:21:37.435 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:37.433+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:37.519 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:37.519 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:37.532 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:37.536 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:37.532+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:37.558 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T10:21:37.613 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 4 16 11806 11790 184.199 180 0.00561679 0.00542117 2024-04-26T10:21:37.629 INFO:teuthology.orchestra.run.smithi052.stderr:Error EINVAL: you must specify pairs of osd ids to be remapped 2024-04-26T10:21:37.634 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T10:21:37.635 INFO:tasks.thrashosds.thrasher:Failed to rm-pg-upmap-items, ignoring 2024-04-26T10:21:37.637 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:37.632+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:37.653 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:37.654 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:37.670 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:37.706 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:21:37.738 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:37.736+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:37.792 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:37.793 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:37.804 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:37.838 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:37.837+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:37.871 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:21:37.899 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:21:37.920 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T10:21:37.923 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:21:37.923 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:21:37.923 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:21:37.933 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:37.933 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:21:37.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:21:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.691665575999998, 2024-04-26T10:21:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015326892, 2024-04-26T10:21:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 112 2024-04-26T10:21:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238644+0000", 2024-04-26T10:21:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238792+0000", 2024-04-26T10:21:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775699999999999 2024-04-26T10:21:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238811+0000", 2024-04-26T10:21:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8359000000000002e-05 2024-04-26T10:21:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238887+0000", 2024-04-26T10:21:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6909000000000005e-05 2024-04-26T10:21:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248433+0000", 2024-04-26T10:21:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095455650000000006 2024-04-26T10:21:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248564+0000", 2024-04-26T10:21:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131273 2024-04-26T10:21:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248795+0000", 2024-04-26T10:21:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023073500000000001 2024-04-26T10:21:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251497+0000", 2024-04-26T10:21:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002701976 2024-04-26T10:21:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253894+0000", 2024-04-26T10:21:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023967429999999998 2024-04-26T10:21:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253937+0000", 2024-04-26T10:21:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3006999999999997e-05 2024-04-26T10:21:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253972+0000", 2024-04-26T10:21:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5388000000000001e-05 2024-04-26T10:21:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.691411678000001, 2024-04-26T10:21:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016304328, 2024-04-26T10:21:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113 2024-04-26T10:21:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238898+0000", 2024-04-26T10:21:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238920+0000", 2024-04-26T10:21:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2056999999999999e-05 2024-04-26T10:21:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238937+0000", 2024-04-26T10:21:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6415000000000001e-05 2024-04-26T10:21:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238948+0000", 2024-04-26T10:21:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.11e-05 2024-04-26T10:21:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250527+0000", 2024-04-26T10:21:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011578662 2024-04-26T10:21:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250627+0000", 2024-04-26T10:21:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100418 2024-04-26T10:21:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250769+0000", 2024-04-26T10:21:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142111 2024-04-26T10:21:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253884+0000", 2024-04-26T10:21:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031148399999999998 2024-04-26T10:21:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254994+0000", 2024-04-26T10:21:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011095720000000001 2024-04-26T10:21:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255094+0000", 2024-04-26T10:21:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010092 2024-04-26T10:21:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255203+0000", 2024-04-26T10:21:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010906 2024-04-26T10:21:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.691354142999998, 2024-04-26T10:21:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016378984999999999, 2024-04-26T10:21:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 114 2024-04-26T10:21:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238956+0000", 2024-04-26T10:21:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238965+0000", 2024-04-26T10:21:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9469999999999992e-06 2024-04-26T10:21:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238993+0000", 2024-04-26T10:21:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8296000000000001e-05 2024-04-26T10:21:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239004+0000", 2024-04-26T10:21:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0482999999999999e-05 2024-04-26T10:21:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251532+0000", 2024-04-26T10:21:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01252852 2024-04-26T10:21:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251622+0000", 2024-04-26T10:21:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0044999999999996e-05 2024-04-26T10:21:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251763+0000", 2024-04-26T10:21:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140634 2024-04-26T10:21:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254035+0000", 2024-04-26T10:21:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022721320000000001 2024-04-26T10:21:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255220+0000", 2024-04-26T10:21:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011853059999999999 2024-04-26T10:21:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255301+0000", 2024-04-26T10:21:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0253999999999994e-05 2024-04-26T10:21:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255336+0000", 2024-04-26T10:21:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5098000000000002e-05 2024-04-26T10:21:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.691292193999999, 2024-04-26T10:21:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018452342, 2024-04-26T10:21:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115 2024-04-26T10:21:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239018+0000", 2024-04-26T10:21:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239152+0000", 2024-04-26T10:21:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414699999999999 2024-04-26T10:21:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239169+0000", 2024-04-26T10:21:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7013000000000001e-05 2024-04-26T10:21:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239190+0000", 2024-04-26T10:21:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1302999999999999e-05 2024-04-26T10:21:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252181+0000", 2024-04-26T10:21:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012990213 2024-04-26T10:21:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252411+0000", 2024-04-26T10:21:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023010199999999999 2024-04-26T10:21:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252687+0000", 2024-04-26T10:21:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000276063 2024-04-26T10:21:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254694+0000", 2024-04-26T10:21:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020072879999999999 2024-04-26T10:21:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257399+0000", 2024-04-26T10:21:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027051670000000001 2024-04-26T10:21:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257442+0000", 2024-04-26T10:21:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-04-26T10:21:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257471+0000", 2024-04-26T10:21:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.889e-05 2024-04-26T10:21:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.691111665000001, 2024-04-26T10:21:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018350615000000001, 2024-04-26T10:21:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116 2024-04-26T10:21:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239198+0000", 2024-04-26T10:21:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239213+0000", 2024-04-26T10:21:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4965e-05 2024-04-26T10:21:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239235+0000", 2024-04-26T10:21:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.156e-05 2024-04-26T10:21:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239243+0000", 2024-04-26T10:21:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9470000000000003e-06 2024-04-26T10:21:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253284+0000", 2024-04-26T10:21:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014041392999999999 2024-04-26T10:21:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253376+0000", 2024-04-26T10:21:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1198000000000003e-05 2024-04-26T10:21:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253508+0000", 2024-04-26T10:21:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013220199999999999 2024-04-26T10:21:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255474+0000", 2024-04-26T10:21:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019665590000000001 2024-04-26T10:21:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257480+0000", 2024-04-26T10:21:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00200599 2024-04-26T10:21:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257515+0000", 2024-04-26T10:21:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5126000000000002e-05 2024-04-26T10:21:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257550+0000", 2024-04-26T10:21:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4394000000000003e-05 2024-04-26T10:21:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.691058108999997, 2024-04-26T10:21:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018369330999999999, 2024-04-26T10:21:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117 2024-04-26T10:21:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239252+0000", 2024-04-26T10:21:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239267+0000", 2024-04-26T10:21:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4562999999999999e-05 2024-04-26T10:21:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239281+0000", 2024-04-26T10:21:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4e-05 2024-04-26T10:21:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239296+0000", 2024-04-26T10:21:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5492999999999999e-05 2024-04-26T10:21:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254076+0000", 2024-04-26T10:21:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014779814 2024-04-26T10:21:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254159+0000", 2024-04-26T10:21:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2923999999999994e-05 2024-04-26T10:21:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254279+0000", 2024-04-26T10:21:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011964300000000001 2024-04-26T10:21:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.256043+0000", 2024-04-26T10:21:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001764353 2024-04-26T10:21:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257559+0000", 2024-04-26T10:21:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015159189999999999 2024-04-26T10:21:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257597+0000", 2024-04-26T10:21:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8031999999999998e-05 2024-04-26T10:21:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257622+0000", 2024-04-26T10:21:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5213999999999999e-05 2024-04-26T10:21:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.451165+0000", 2024-04-26T10:21:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.479146188999998, 2024-04-26T10:21:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013622911, 2024-04-26T10:21:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 139 2024-04-26T10:21:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451165+0000", 2024-04-26T10:21:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451165+0000", 2024-04-26T10:21:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451164+0000", 2024-04-26T10:21:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451170+0000", 2024-04-26T10:21:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7899999999999996e-06 2024-04-26T10:21:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451178+0000", 2024-04-26T10:21:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8499999999999994e-06 2024-04-26T10:21:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451185+0000", 2024-04-26T10:21:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8889999999999996e-06 2024-04-26T10:21:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.462110+0000", 2024-04-26T10:21:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01092576 2024-04-26T10:21:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.462160+0000", 2024-04-26T10:21:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9838e-05 2024-04-26T10:21:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.462240+0000", 2024-04-26T10:21:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9406999999999994e-05 2024-04-26T10:21:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.464319+0000", 2024-04-26T10:21:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020796349999999998 2024-04-26T10:21:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.464688+0000", 2024-04-26T10:21:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036927800000000001 2024-04-26T10:21:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.464756+0000", 2024-04-26T10:21:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7648e-05 2024-04-26T10:21:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.464788+0000", 2024-04-26T10:21:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1418999999999999e-05 2024-04-26T10:21:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.451210+0000", 2024-04-26T10:21:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.479101069999999, 2024-04-26T10:21:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014337409000000001, 2024-04-26T10:21:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 140 2024-04-26T10:21:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451210+0000", 2024-04-26T10:21:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451210+0000", 2024-04-26T10:21:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451209+0000", 2024-04-26T10:21:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451330+0000", 2024-04-26T10:21:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012056 2024-04-26T10:21:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451341+0000", 2024-04-26T10:21:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1044e-05 2024-04-26T10:21:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451348+0000", 2024-04-26T10:21:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8630000000000008e-06 2024-04-26T10:21:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.462680+0000", 2024-04-26T10:21:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011331681999999999 2024-04-26T10:21:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.462776+0000", 2024-04-26T10:21:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5997999999999998e-05 2024-04-26T10:21:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.462903+0000", 2024-04-26T10:21:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012640000000000001 2024-04-26T10:21:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.464325+0000", 2024-04-26T10:21:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014219479999999999 2024-04-26T10:21:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.465495+0000", 2024-04-26T10:21:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001170433 2024-04-26T10:21:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.465526+0000", 2024-04-26T10:21:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1279000000000003e-05 2024-04-26T10:21:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.465547+0000", 2024-04-26T10:21:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0945e-05 2024-04-26T10:21:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.478953732999997, 2024-04-26T10:21:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015980181999999999, 2024-04-26T10:21:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 141 2024-04-26T10:21:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451356+0000", 2024-04-26T10:21:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451362+0000", 2024-04-26T10:21:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:21:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451371+0000", 2024-04-26T10:21:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1829999999999994e-06 2024-04-26T10:21:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451377+0000", 2024-04-26T10:21:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7599999999999997e-06 2024-04-26T10:21:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463727+0000", 2024-04-26T10:21:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012349646000000001 2024-04-26T10:21:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463780+0000", 2024-04-26T10:21:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2645999999999997e-05 2024-04-26T10:21:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463874+0000", 2024-04-26T10:21:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4097000000000004e-05 2024-04-26T10:21:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.466138+0000", 2024-04-26T10:21:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022642690000000002 2024-04-26T10:21:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467281+0000", 2024-04-26T10:21:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011428510000000001 2024-04-26T10:21:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467315+0000", 2024-04-26T10:21:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4032999999999998e-05 2024-04-26T10:21:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467337+0000", 2024-04-26T10:21:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2444000000000001e-05 2024-04-26T10:21:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:161 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649566+0000", 2024-04-26T10:21:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.280744585999997, 2024-04-26T10:21:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014850079, 2024-04-26T10:21:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 161 2024-04-26T10:21:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649566+0000", 2024-04-26T10:21:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649566+0000", 2024-04-26T10:21:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649565+0000", 2024-04-26T10:21:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649700+0000", 2024-04-26T10:21:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013546399999999999 2024-04-26T10:21:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649733+0000", 2024-04-26T10:21:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2382000000000003e-05 2024-04-26T10:21:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649747+0000", 2024-04-26T10:21:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.472e-05 2024-04-26T10:21:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.659036+0000", 2024-04-26T10:21:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092889830000000007 2024-04-26T10:21:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.659148+0000", 2024-04-26T10:21:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111927 2024-04-26T10:21:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.659336+0000", 2024-04-26T10:21:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187636 2024-04-26T10:21:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664235+0000", 2024-04-26T10:21:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048993919999999998 2024-04-26T10:21:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664324+0000", 2024-04-26T10:21:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9038999999999999e-05 2024-04-26T10:21:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664378+0000", 2024-04-26T10:21:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4008999999999997e-05 2024-04-26T10:21:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664416+0000", 2024-04-26T10:21:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7914000000000003e-05 2024-04-26T10:21:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:162 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649768+0000", 2024-04-26T10:21:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.280543283999997, 2024-04-26T10:21:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014901464999999999, 2024-04-26T10:21:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 162 2024-04-26T10:21:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649768+0000", 2024-04-26T10:21:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649768+0000", 2024-04-26T10:21:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649766+0000", 2024-04-26T10:21:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649774+0000", 2024-04-26T10:21:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7400000000000004e-06 2024-04-26T10:21:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649789+0000", 2024-04-26T10:21:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5486e-05 2024-04-26T10:21:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649797+0000", 2024-04-26T10:21:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3200000000000002e-06 2024-04-26T10:21:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.660742+0000", 2024-04-26T10:21:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010945636999999999 2024-04-26T10:21:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.660872+0000", 2024-04-26T10:21:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013026699999999999 2024-04-26T10:21:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.661064+0000", 2024-04-26T10:21:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000191628 2024-04-26T10:21:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664490+0000", 2024-04-26T10:21:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034262369999999999 2024-04-26T10:21:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664503+0000", 2024-04-26T10:21:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2595999999999999e-05 2024-04-26T10:21:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664558+0000", 2024-04-26T10:21:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4985000000000003e-05 2024-04-26T10:21:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664669+0000", 2024-04-26T10:21:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111119 2024-04-26T10:21:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.280505161999997, 2024-04-26T10:21:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015587541, 2024-04-26T10:21:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 163 2024-04-26T10:21:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649805+0000", 2024-04-26T10:21:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649813+0000", 2024-04-26T10:21:38.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3319999999999992e-06 2024-04-26T10:21:38.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:38.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649851+0000", 2024-04-26T10:21:38.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7852999999999998e-05 2024-04-26T10:21:38.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649865+0000", 2024-04-26T10:21:38.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3626e-05 2024-04-26T10:21:38.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:38.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662071+0000", 2024-04-26T10:21:38.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01220689 2024-04-26T10:21:38.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:38.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662210+0000", 2024-04-26T10:21:38.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013893 2024-04-26T10:21:38.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:38.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662397+0000", 2024-04-26T10:21:38.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018690499999999999 2024-04-26T10:21:38.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:38.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664685+0000", 2024-04-26T10:21:38.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022876179999999999 2024-04-26T10:21:38.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665327+0000", 2024-04-26T10:21:38.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00064178900000000003 2024-04-26T10:21:38.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:38.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665365+0000", 2024-04-26T10:21:38.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8244999999999997e-05 2024-04-26T10:21:38.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:38.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665393+0000", 2024-04-26T10:21:38.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8232e-05 2024-04-26T10:21:38.022 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.022 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:38.022 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.022 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:38.022 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:38.022 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.280430516000003, 2024-04-26T10:21:38.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016970263999999999, 2024-04-26T10:21:38.022 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:38.023 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:38.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:38.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:38.023 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 164 2024-04-26T10:21:38.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.023 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:38.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:38.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:38.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:38.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:38.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:38.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649879+0000", 2024-04-26T10:21:38.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:38.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649963+0000", 2024-04-26T10:21:38.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4141999999999995e-05 2024-04-26T10:21:38.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:38.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649975+0000", 2024-04-26T10:21:38.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1416e-05 2024-04-26T10:21:38.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649983+0000", 2024-04-26T10:21:38.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8469999999999996e-06 2024-04-26T10:21:38.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:38.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662854+0000", 2024-04-26T10:21:38.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012871871999999999 2024-04-26T10:21:38.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:38.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662965+0000", 2024-04-26T10:21:38.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110413 2024-04-26T10:21:38.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:38.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.663109+0000", 2024-04-26T10:21:38.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144115 2024-04-26T10:21:38.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665992+0000", 2024-04-26T10:21:38.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028827340000000001 2024-04-26T10:21:38.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:38.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666784+0000", 2024-04-26T10:21:38.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00079253799999999997 2024-04-26T10:21:38.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:38.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666824+0000", 2024-04-26T10:21:38.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0139000000000003e-05 2024-04-26T10:21:38.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:38.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666851+0000", 2024-04-26T10:21:38.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6171999999999999e-05 2024-04-26T10:21:38.029 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.029 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:38.029 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.029 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:38.029 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:38.029 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.280319435999999, 2024-04-26T10:21:38.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019547338000000001, 2024-04-26T10:21:38.029 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:38.030 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:38.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:38.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:38.030 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165 2024-04-26T10:21:38.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.030 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:38.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:38.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:38.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:38.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:38.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:38.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:38.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:38.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649996+0000", 2024-04-26T10:21:38.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-04-26T10:21:38.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:38.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650021+0000", 2024-04-26T10:21:38.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5179999999999999e-05 2024-04-26T10:21:38.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650030+0000", 2024-04-26T10:21:38.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-04-26T10:21:38.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:38.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664733+0000", 2024-04-26T10:21:38.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014703097 2024-04-26T10:21:38.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:38.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664821+0000", 2024-04-26T10:21:38.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7918999999999996e-05 2024-04-26T10:21:38.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:38.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664953+0000", 2024-04-26T10:21:38.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132662 2024-04-26T10:21:38.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666776+0000", 2024-04-26T10:21:38.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018225509999999999 2024-04-26T10:21:38.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:38.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669480+0000", 2024-04-26T10:21:38.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00270382 2024-04-26T10:21:38.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:38.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669515+0000", 2024-04-26T10:21:38.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4885000000000002e-05 2024-04-26T10:21:38.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:38.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669539+0000", 2024-04-26T10:21:38.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4121000000000002e-05 2024-04-26T10:21:38.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.036 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:38.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.036 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:38.036 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:38.036 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.090825356000003, 2024-04-26T10:21:38.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015260631, 2024-04-26T10:21:38.037 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:38.037 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:38.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:38.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:38.037 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 184 2024-04-26T10:21:38.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.037 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:38.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:38.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:38.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:38.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:38.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:38.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:38.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:38.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839493+0000", 2024-04-26T10:21:38.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7300000000000005e-06 2024-04-26T10:21:38.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:38.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839501+0000", 2024-04-26T10:21:38.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2940000000000006e-06 2024-04-26T10:21:38.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839508+0000", 2024-04-26T10:21:38.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6660000000000002e-06 2024-04-26T10:21:38.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:38.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.849315+0000", 2024-04-26T10:21:38.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098072650000000008 2024-04-26T10:21:38.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:38.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.849564+0000", 2024-04-26T10:21:38.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024928800000000002 2024-04-26T10:21:38.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:38.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.849772+0000", 2024-04-26T10:21:38.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020795199999999999 2024-04-26T10:21:38.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:38.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853646+0000", 2024-04-26T10:21:38.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038744090000000001 2024-04-26T10:21:38.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854530+0000", 2024-04-26T10:21:38.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00088391200000000004 2024-04-26T10:21:38.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:38.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854623+0000", 2024-04-26T10:21:38.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2229000000000001e-05 2024-04-26T10:21:38.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:38.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854746+0000", 2024-04-26T10:21:38.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012354299999999999 2024-04-26T10:21:38.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.043 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:38.043 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.043 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:38.043 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:38.043 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.090796327, 2024-04-26T10:21:38.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017833541000000001, 2024-04-26T10:21:38.043 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:38.043 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:38.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:38.044 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:38.044 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185 2024-04-26T10:21:38.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.044 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:38.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:38.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:38.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:38.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:38.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:38.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839514+0000", 2024-04-26T10:21:38.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:38.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839612+0000", 2024-04-26T10:21:38.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7880999999999993e-05 2024-04-26T10:21:38.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:38.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839623+0000", 2024-04-26T10:21:38.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0917000000000001e-05 2024-04-26T10:21:38.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839632+0000", 2024-04-26T10:21:38.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0999999999999993e-06 2024-04-26T10:21:38.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:38.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850382+0000", 2024-04-26T10:21:38.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010750335 2024-04-26T10:21:38.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:38.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850502+0000", 2024-04-26T10:21:38.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120183 2024-04-26T10:21:38.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:38.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850685+0000", 2024-04-26T10:21:38.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000182442 2024-04-26T10:21:38.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:38.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854396+0000", 2024-04-26T10:21:38.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037114819999999999 2024-04-26T10:21:38.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857233+0000", 2024-04-26T10:21:38.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002836514 2024-04-26T10:21:38.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:38.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857300+0000", 2024-04-26T10:21:38.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6842999999999997e-05 2024-04-26T10:21:38.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:38.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857348+0000", 2024-04-26T10:21:38.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8504000000000002e-05 2024-04-26T10:21:38.049 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.049 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:38.049 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.050 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:38.050 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:38.050 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.090669976000001, 2024-04-26T10:21:38.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018757273000000001, 2024-04-26T10:21:38.050 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:38.050 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:38.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:38.053 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:38.053 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 186 2024-04-26T10:21:38.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.053 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:38.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:38.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:38.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:38.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:38.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:38.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839640+0000", 2024-04-26T10:21:38.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:38.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839646+0000", 2024-04-26T10:21:38.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:21:38.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:38.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839654+0000", 2024-04-26T10:21:38.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:21:38.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839661+0000", 2024-04-26T10:21:38.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.64e-06 2024-04-26T10:21:38.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:38.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852328+0000", 2024-04-26T10:21:38.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012667151 2024-04-26T10:21:38.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:38.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852538+0000", 2024-04-26T10:21:38.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020961100000000001 2024-04-26T10:21:38.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:38.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852945+0000", 2024-04-26T10:21:38.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040712099999999998 2024-04-26T10:21:38.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:38.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857372+0000", 2024-04-26T10:21:38.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044268049999999998 2024-04-26T10:21:38.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858321+0000", 2024-04-26T10:21:38.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094932999999999997 2024-04-26T10:21:38.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:38.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858367+0000", 2024-04-26T10:21:38.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5534000000000001e-05 2024-04-26T10:21:38.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:38.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858398+0000", 2024-04-26T10:21:38.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1562e-05 2024-04-26T10:21:38.059 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.059 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:38.059 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.059 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:38.059 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:38.059 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.090642809999999, 2024-04-26T10:21:38.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019669504000000001, 2024-04-26T10:21:38.059 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:38.060 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.060 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:38.060 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:38.060 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:38.060 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187 2024-04-26T10:21:38.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.060 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:38.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:38.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:38.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:38.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:38.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:38.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839667+0000", 2024-04-26T10:21:38.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:38.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839677+0000", 2024-04-26T10:21:38.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3270000000000007e-06 2024-04-26T10:21:38.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:38.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839685+0000", 2024-04-26T10:21:38.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2670000000000006e-06 2024-04-26T10:21:38.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839692+0000", 2024-04-26T10:21:38.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7129999999999999e-06 2024-04-26T10:21:38.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:38.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853685+0000", 2024-04-26T10:21:38.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013993716999999999 2024-04-26T10:21:38.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:38.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853876+0000", 2024-04-26T10:21:38.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019097100000000001 2024-04-26T10:21:38.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:38.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853989+0000", 2024-04-26T10:21:38.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011275199999999999 2024-04-26T10:21:38.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:38.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857377+0000", 2024-04-26T10:21:38.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033882489999999999 2024-04-26T10:21:38.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859222+0000", 2024-04-26T10:21:38.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001844233 2024-04-26T10:21:38.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:38.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859291+0000", 2024-04-26T10:21:38.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:21:38.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:38.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859338+0000", 2024-04-26T10:21:38.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6366000000000003e-05 2024-04-26T10:21:38.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.065 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:38.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.066 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:38.066 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:38.066 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.090611944000003, 2024-04-26T10:21:38.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019837468, 2024-04-26T10:21:38.066 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:38.066 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:38.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:38.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:38.067 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 188 2024-04-26T10:21:38.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.067 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:38.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:38.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:38.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:38.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:38.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:38.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839698+0000", 2024-04-26T10:21:38.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:38.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839829+0000", 2024-04-26T10:21:38.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013061099999999999 2024-04-26T10:21:38.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:38.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839853+0000", 2024-04-26T10:21:38.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3736000000000001e-05 2024-04-26T10:21:38.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839863+0000", 2024-04-26T10:21:38.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:38.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:38.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854869+0000", 2024-04-26T10:21:38.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015005978 2024-04-26T10:21:38.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:38.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854959+0000", 2024-04-26T10:21:38.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9468999999999993e-05 2024-04-26T10:21:38.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:38.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855114+0000", 2024-04-26T10:21:38.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015563799999999999 2024-04-26T10:21:38.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:38.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857386+0000", 2024-04-26T10:21:38.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002271852 2024-04-26T10:21:38.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859406+0000", 2024-04-26T10:21:38.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002019936 2024-04-26T10:21:38.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:38.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859461+0000", 2024-04-26T10:21:38.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4826e-05 2024-04-26T10:21:38.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:38.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859536+0000", 2024-04-26T10:21:38.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5566000000000001e-05 2024-04-26T10:21:38.073 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.073 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:38.073 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.073 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:38.073 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:38.073 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.090438081000002, 2024-04-26T10:21:38.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019826496999999998, 2024-04-26T10:21:38.074 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:38.074 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:38.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:38.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:38.074 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 189 2024-04-26T10:21:38.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.074 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:38.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:38.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:38.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:38.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:38.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:38.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:38.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839872+0000", 2024-04-26T10:21:38.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:38.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839882+0000", 2024-04-26T10:21:38.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:38.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:38.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839892+0000", 2024-04-26T10:21:38.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.217e-06 2024-04-26T10:21:38.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839900+0000", 2024-04-26T10:21:38.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5469999999999997e-06 2024-04-26T10:21:38.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:38.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855903+0000", 2024-04-26T10:21:38.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016002590000000001 2024-04-26T10:21:38.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:38.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856110+0000", 2024-04-26T10:21:38.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020711199999999999 2024-04-26T10:21:38.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:38.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856421+0000", 2024-04-26T10:21:38.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031128500000000001 2024-04-26T10:21:38.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:38.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857643+0000", 2024-04-26T10:21:38.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012215520000000001 2024-04-26T10:21:38.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859603+0000", 2024-04-26T10:21:38.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019600350000000002 2024-04-26T10:21:38.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:38.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859660+0000", 2024-04-26T10:21:38.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6857999999999997e-05 2024-04-26T10:21:38.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:38.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:38.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:38.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859699+0000", 2024-04-26T10:21:38.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9641999999999998e-05 2024-04-26T10:21:38.080 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.080 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:38.080 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.080 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:38.080 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:38.081 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:38.083 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:38.084 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:38.077+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:38.183 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:38.180+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:38.213 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:38.213 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:38.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.214 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:13418 5.e e26/22 5:74006031:::benchmark_data_smithi052_19421_object13417:head v 26'847, mlcod=26'842)", 2024-04-26T10:21:38.214 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:38.211696+0000", 2024-04-26T10:21:38.214 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0017083630000000001, 2024-04-26T10:21:38.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001728446, 2024-04-26T10:21:38.214 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.214 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:38.214 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.211696+0000", 2024-04-26T10:21:38.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.211696+0000", 2024-04-26T10:21:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.211695+0000", 2024-04-26T10:21:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.211753+0000", 2024-04-26T10:21:38.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8012e-05 2024-04-26T10:21:38.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.211767+0000", 2024-04-26T10:21:38.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.434e-05 2024-04-26T10:21:38.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.211775+0000", 2024-04-26T10:21:38.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8099999999999998e-06 2024-04-26T10:21:38.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.211849+0000", 2024-04-26T10:21:38.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3369999999999997e-05 2024-04-26T10:21:38.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.211878+0000", 2024-04-26T10:21:38.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9198000000000001e-05 2024-04-26T10:21:38.217 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.217 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.217 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.217 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:13422 5.0 e26/22 5:002329d3:::benchmark_data_smithi052_19421_object13421:head v 26'795, mlcod=26'793)", 2024-04-26T10:21:38.218 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:38.212725+0000", 2024-04-26T10:21:38.218 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00067915300000000005, 2024-04-26T10:21:38.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00075776700000000001, 2024-04-26T10:21:38.218 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.218 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:38.218 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.212725+0000", 2024-04-26T10:21:38.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.212725+0000", 2024-04-26T10:21:38.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.212724+0000", 2024-04-26T10:21:38.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.212773+0000", 2024-04-26T10:21:38.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8204999999999997e-05 2024-04-26T10:21:38.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.212787+0000", 2024-04-26T10:21:38.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4379000000000001e-05 2024-04-26T10:21:38.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.212794+0000", 2024-04-26T10:21:38.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5400000000000001e-06 2024-04-26T10:21:38.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.212833+0000", 2024-04-26T10:21:38.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9242000000000001e-05 2024-04-26T10:21:38.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.212852+0000", 2024-04-26T10:21:38.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8839999999999999e-05 2024-04-26T10:21:38.222 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.222 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.222 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.222 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:13415 5.e e26/22 5:7b837a34:::benchmark_data_smithi052_19421_object13414:head v 26'845, mlcod=26'842)", 2024-04-26T10:21:38.222 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:38.208187+0000", 2024-04-26T10:21:38.222 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0052174609999999996, 2024-04-26T10:21:38.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053423469999999999, 2024-04-26T10:21:38.222 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.222 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:38.222 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.208187+0000", 2024-04-26T10:21:38.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.208187+0000", 2024-04-26T10:21:38.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.208186+0000", 2024-04-26T10:21:38.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.208275+0000", 2024-04-26T10:21:38.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8708999999999994e-05 2024-04-26T10:21:38.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.208286+0000", 2024-04-26T10:21:38.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0949e-05 2024-04-26T10:21:38.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.208293+0000", 2024-04-26T10:21:38.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3599999999999998e-06 2024-04-26T10:21:38.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.208374+0000", 2024-04-26T10:21:38.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0735999999999994e-05 2024-04-26T10:21:38.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.208404+0000", 2024-04-26T10:21:38.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0190999999999999e-05 2024-04-26T10:21:38.226 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.226 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.226 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.226 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:13416 5.e e26/22 5:784c9149:::benchmark_data_smithi052_19421_object13415:head v 26'846, mlcod=26'842)", 2024-04-26T10:21:38.226 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:38.210600+0000", 2024-04-26T10:21:38.226 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0028046310000000001, 2024-04-26T10:21:38.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029734150000000001, 2024-04-26T10:21:38.226 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.227 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:38.227 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.210600+0000", 2024-04-26T10:21:38.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.210600+0000", 2024-04-26T10:21:38.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.210599+0000", 2024-04-26T10:21:38.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.210664+0000", 2024-04-26T10:21:38.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4636999999999998e-05 2024-04-26T10:21:38.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.210676+0000", 2024-04-26T10:21:38.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2014999999999999e-05 2024-04-26T10:21:38.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.210685+0000", 2024-04-26T10:21:38.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9460000000000004e-06 2024-04-26T10:21:38.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.210731+0000", 2024-04-26T10:21:38.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6935999999999999e-05 2024-04-26T10:21:38.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.210757+0000", 2024-04-26T10:21:38.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5333e-05 2024-04-26T10:21:38.231 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.231 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.231 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.232 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:13417 5.b e26/22 5:d3a31602:::benchmark_data_smithi052_19421_object13416:head v 26'858, mlcod=26'854)", 2024-04-26T10:21:38.232 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:38.210700+0000", 2024-04-26T10:21:38.232 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0027043150000000001, 2024-04-26T10:21:38.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029626219999999998, 2024-04-26T10:21:38.232 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.232 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:38.233 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.210700+0000", 2024-04-26T10:21:38.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.210700+0000", 2024-04-26T10:21:38.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.210699+0000", 2024-04-26T10:21:38.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.210742+0000", 2024-04-26T10:21:38.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2233e-05 2024-04-26T10:21:38.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.210756+0000", 2024-04-26T10:21:38.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4175000000000001e-05 2024-04-26T10:21:38.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.210764+0000", 2024-04-26T10:21:38.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8429999999999993e-06 2024-04-26T10:21:38.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.210808+0000", 2024-04-26T10:21:38.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4530000000000002e-05 2024-04-26T10:21:38.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.210820+0000", 2024-04-26T10:21:38.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2196e-05 2024-04-26T10:21:38.237 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.237 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.237 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.238 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.238 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:21:38.238 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 5 2024-04-26T10:21:38.238 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:38.240 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:38.284 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:38.280+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:38.356 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:38.356 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:21:38.356 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:21:38.356 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:21:38.356 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:38.366 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:38.385 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:38.381+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:38.485 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:38.484+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:38.533 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:38.533 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:21:38.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:21:38.533 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:38.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.533 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:38.533 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:38.533 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.229793547, 2024-04-26T10:21:38.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018441564000000001, 2024-04-26T10:21:38.534 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.534 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.534 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:38.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:38.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301372+0000", 2024-04-26T10:21:38.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:38.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301399+0000", 2024-04-26T10:21:38.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7039999999999999e-05 2024-04-26T10:21:38.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301426+0000", 2024-04-26T10:21:38.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6381e-05 2024-04-26T10:21:38.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301480+0000", 2024-04-26T10:21:38.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3681000000000003e-05 2024-04-26T10:21:38.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310584+0000", 2024-04-26T10:21:38.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091042339999999992 2024-04-26T10:21:38.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:38.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310591+0000", 2024-04-26T10:21:38.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8190000000000003e-06 2024-04-26T10:21:38.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311503+0000", 2024-04-26T10:21:38.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000911983 2024-04-26T10:21:38.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311605+0000", 2024-04-26T10:21:38.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102619 2024-04-26T10:21:38.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:38.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311730+0000", 2024-04-26T10:21:38.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012474400000000001 2024-04-26T10:21:38.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:38.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317287+0000", 2024-04-26T10:21:38.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055571140000000002 2024-04-26T10:21:38.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319724+0000", 2024-04-26T10:21:38.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002437294 2024-04-26T10:21:38.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:38.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319776+0000", 2024-04-26T10:21:38.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1992e-05 2024-04-26T10:21:38.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319816+0000", 2024-04-26T10:21:38.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9709999999999998e-05 2024-04-26T10:21:38.540 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.540 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.540 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.540 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.1e epoch 20/18 rep_tid 1 entries 20'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:21:38.540 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306447+0000", 2024-04-26T10:21:38.540 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.224721266, 2024-04-26T10:21:38.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094811170000000007, 2024-04-26T10:21:38.540 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.540 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T10:21:38.540 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306447+0000", 2024-04-26T10:21:38.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306447+0000", 2024-04-26T10:21:38.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306446+0000", 2024-04-26T10:21:38.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306456+0000", 2024-04-26T10:21:38.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6139999999999998e-06 2024-04-26T10:21:38.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306471+0000", 2024-04-26T10:21:38.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5167000000000001e-05 2024-04-26T10:21:38.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306486+0000", 2024-04-26T10:21:38.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.521e-05 2024-04-26T10:21:38.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308601+0000", 2024-04-26T10:21:38.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021147869999999999 2024-04-26T10:21:38.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315928+0000", 2024-04-26T10:21:38.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073266219999999996 2024-04-26T10:21:38.543 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.543 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.544 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.544 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:38.544 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:38.544 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.224477681, 2024-04-26T10:21:38.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013786338, 2024-04-26T10:21:38.544 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.544 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.544 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:38.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:38.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306689+0000", 2024-04-26T10:21:38.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306697+0000", 2024-04-26T10:21:38.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2420000000000003e-06 2024-04-26T10:21:38.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306725+0000", 2024-04-26T10:21:38.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8209e-05 2024-04-26T10:21:38.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306750+0000", 2024-04-26T10:21:38.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5432e-05 2024-04-26T10:21:38.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310622+0000", 2024-04-26T10:21:38.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003871738 2024-04-26T10:21:38.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:21:38.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310627+0000", 2024-04-26T10:21:38.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4890000000000003e-06 2024-04-26T10:21:38.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314030+0000", 2024-04-26T10:21:38.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003402094 2024-04-26T10:21:38.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314147+0000", 2024-04-26T10:21:38.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011776499999999999 2024-04-26T10:21:38.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:38.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314441+0000", 2024-04-26T10:21:38.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000293543 2024-04-26T10:21:38.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:38.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319422+0000", 2024-04-26T10:21:38.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004981096 2024-04-26T10:21:38.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320057+0000", 2024-04-26T10:21:38.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000635521 2024-04-26T10:21:38.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:38.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320110+0000", 2024-04-26T10:21:38.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2104999999999997e-05 2024-04-26T10:21:38.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320477+0000", 2024-04-26T10:21:38.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036709500000000001 2024-04-26T10:21:38.549 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.549 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.550 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.550 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:38.550 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:38.550 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.224384319999999, 2024-04-26T10:21:38.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013859405999999999, 2024-04-26T10:21:38.550 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.550 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.550 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:38.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:38.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306783+0000", 2024-04-26T10:21:38.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306788+0000", 2024-04-26T10:21:38.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3990000000000003e-06 2024-04-26T10:21:38.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306796+0000", 2024-04-26T10:21:38.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8820000000000001e-06 2024-04-26T10:21:38.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306803+0000", 2024-04-26T10:21:38.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6649999999999997e-06 2024-04-26T10:21:38.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314454+0000", 2024-04-26T10:21:38.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076508349999999999 2024-04-26T10:21:38.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314930+0000", 2024-04-26T10:21:38.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047624199999999998 2024-04-26T10:21:38.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:38.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315127+0000", 2024-04-26T10:21:38.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196751 2024-04-26T10:21:38.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:38.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320496+0000", 2024-04-26T10:21:38.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053690150000000004 2024-04-26T10:21:38.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320576+0000", 2024-04-26T10:21:38.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0327999999999994e-05 2024-04-26T10:21:38.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:38.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320611+0000", 2024-04-26T10:21:38.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-04-26T10:21:38.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320643+0000", 2024-04-26T10:21:38.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2474000000000001e-05 2024-04-26T10:21:38.555 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.555 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.555 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.555 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:38.555 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:38.555 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.224305148999999, 2024-04-26T10:21:38.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013889195, 2024-04-26T10:21:38.555 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.555 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.556 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:38.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:38.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306862+0000", 2024-04-26T10:21:38.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306867+0000", 2024-04-26T10:21:38.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5390000000000001e-06 2024-04-26T10:21:38.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306874+0000", 2024-04-26T10:21:38.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7549999999999997e-06 2024-04-26T10:21:38.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306887+0000", 2024-04-26T10:21:38.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.313e-05 2024-04-26T10:21:38.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315477+0000", 2024-04-26T10:21:38.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085902489999999995 2024-04-26T10:21:38.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315607+0000", 2024-04-26T10:21:38.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129789 2024-04-26T10:21:38.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:38.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315767+0000", 2024-04-26T10:21:38.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016052699999999999 2024-04-26T10:21:38.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:38.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320502+0000", 2024-04-26T10:21:38.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00473421 2024-04-26T10:21:38.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320691+0000", 2024-04-26T10:21:38.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018938900000000001 2024-04-26T10:21:38.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:38.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320721+0000", 2024-04-26T10:21:38.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9677000000000001e-05 2024-04-26T10:21:38.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320752+0000", 2024-04-26T10:21:38.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1486000000000003e-05 2024-04-26T10:21:38.560 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.560 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.560 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.560 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:38.560 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:38.560 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.224267230999999, 2024-04-26T10:21:38.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012590871, 2024-04-26T10:21:38.560 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.561 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.561 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:38.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:38.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306900+0000", 2024-04-26T10:21:38.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306905+0000", 2024-04-26T10:21:38.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9010000000000002e-06 2024-04-26T10:21:38.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306911+0000", 2024-04-26T10:21:38.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6030000000000004e-06 2024-04-26T10:21:38.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306916+0000", 2024-04-26T10:21:38.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8539999999999996e-06 2024-04-26T10:21:38.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308529+0000", 2024-04-26T10:21:38.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001613258 2024-04-26T10:21:38.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:38.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308537+0000", 2024-04-26T10:21:38.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1680000000000004e-06 2024-04-26T10:21:38.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311962+0000", 2024-04-26T10:21:38.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034247290000000001 2024-04-26T10:21:38.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.312092+0000", 2024-04-26T10:21:38.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013048700000000001 2024-04-26T10:21:38.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:38.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.312438+0000", 2024-04-26T10:21:38.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00034558700000000001 2024-04-26T10:21:38.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:38.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317984+0000", 2024-04-26T10:21:38.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005546067 2024-04-26T10:21:38.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319373+0000", 2024-04-26T10:21:38.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001389426 2024-04-26T10:21:38.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:38.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319438+0000", 2024-04-26T10:21:38.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4849000000000002e-05 2024-04-26T10:21:38.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319492+0000", 2024-04-26T10:21:38.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3554000000000003e-05 2024-04-26T10:21:38.566 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.566 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.566 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.566 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:38.566 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:38.566 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.222596648, 2024-04-26T10:21:38.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011321652999999999, 2024-04-26T10:21:38.567 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.567 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.567 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:38.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:38.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:38.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308576+0000", 2024-04-26T10:21:38.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2920000000000003e-06 2024-04-26T10:21:38.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308582+0000", 2024-04-26T10:21:38.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6540000000000002e-06 2024-04-26T10:21:38.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308590+0000", 2024-04-26T10:21:38.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-04-26T10:21:38.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308958+0000", 2024-04-26T10:21:38.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036823500000000001 2024-04-26T10:21:38.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:21:38.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308963+0000", 2024-04-26T10:21:38.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6160000000000001e-06 2024-04-26T10:21:38.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.313758+0000", 2024-04-26T10:21:38.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004794296 2024-04-26T10:21:38.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.313848+0000", 2024-04-26T10:21:38.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0488999999999994e-05 2024-04-26T10:21:38.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:38.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314099+0000", 2024-04-26T10:21:38.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025094700000000001 2024-04-26T10:21:38.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:38.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.318989+0000", 2024-04-26T10:21:38.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048896850000000004 2024-04-26T10:21:38.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319799+0000", 2024-04-26T10:21:38.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00080979299999999995 2024-04-26T10:21:38.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:38.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319847+0000", 2024-04-26T10:21:38.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8254999999999998e-05 2024-04-26T10:21:38.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319893+0000", 2024-04-26T10:21:38.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6108e-05 2024-04-26T10:21:38.572 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.572 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.572 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.572 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:38.572 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:38.572 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.222474799, 2024-04-26T10:21:38.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012032891, 2024-04-26T10:21:38.573 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.573 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.573 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:38.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:38.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:38.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308697+0000", 2024-04-26T10:21:38.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4449999999999998e-06 2024-04-26T10:21:38.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308864+0000", 2024-04-26T10:21:38.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000167045 2024-04-26T10:21:38.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308886+0000", 2024-04-26T10:21:38.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1858999999999999e-05 2024-04-26T10:21:38.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316346+0000", 2024-04-26T10:21:38.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007460225 2024-04-26T10:21:38.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316500+0000", 2024-04-26T10:21:38.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153776 2024-04-26T10:21:38.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:38.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316665+0000", 2024-04-26T10:21:38.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000164854 2024-04-26T10:21:38.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:38.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320564+0000", 2024-04-26T10:21:38.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038988339999999999 2024-04-26T10:21:38.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320680+0000", 2024-04-26T10:21:38.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011616399999999999 2024-04-26T10:21:38.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:38.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320710+0000", 2024-04-26T10:21:38.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0182e-05 2024-04-26T10:21:38.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320726+0000", 2024-04-26T10:21:38.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6118000000000001e-05 2024-04-26T10:21:38.577 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.577 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.577 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.578 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:38.578 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.310512+0000", 2024-04-26T10:21:38.578 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.220655615999998, 2024-04-26T10:21:38.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009600964, 2024-04-26T10:21:38.578 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.578 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:38.578 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310512+0000", 2024-04-26T10:21:38.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310512+0000", 2024-04-26T10:21:38.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310511+0000", 2024-04-26T10:21:38.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310518+0000", 2024-04-26T10:21:38.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1870000000000002e-06 2024-04-26T10:21:38.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310531+0000", 2024-04-26T10:21:38.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3325e-05 2024-04-26T10:21:38.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310541+0000", 2024-04-26T10:21:38.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6679999999999996e-06 2024-04-26T10:21:38.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310750+0000", 2024-04-26T10:21:38.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:21:38.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311175+0000", 2024-04-26T10:21:38.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00042555300000000001 2024-04-26T10:21:38.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320113+0000", 2024-04-26T10:21:38.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0089382739999999995 2024-04-26T10:21:38.581 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.581 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.581 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.582 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:1241 5.f e24/22 5:f64c5408:::benchmark_data_smithi052_19421_object1240:head v 24'62, mlcod=24'59)", 2024-04-26T10:21:38.582 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:34.020367+0000", 2024-04-26T10:21:38.582 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.5108012359999998, 2024-04-26T10:21:38.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090396239999999996, 2024-04-26T10:21:38.582 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.582 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.582 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020367+0000", 2024-04-26T10:21:38.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020367+0000", 2024-04-26T10:21:38.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020366+0000", 2024-04-26T10:21:38.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020406+0000", 2024-04-26T10:21:38.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9422000000000003e-05 2024-04-26T10:21:38.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020418+0000", 2024-04-26T10:21:38.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2456000000000001e-05 2024-04-26T10:21:38.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020424+0000", 2024-04-26T10:21:38.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8780000000000003e-06 2024-04-26T10:21:38.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020490+0000", 2024-04-26T10:21:38.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6341999999999996e-05 2024-04-26T10:21:38.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020524+0000", 2024-04-26T10:21:38.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3479000000000003e-05 2024-04-26T10:21:38.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:38.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.029358+0000", 2024-04-26T10:21:38.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088343620000000001 2024-04-26T10:21:38.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.029406+0000", 2024-04-26T10:21:38.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8386000000000001e-05 2024-04-26T10:21:38.586 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.586 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.586 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.586 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:1242 5.4 e24/22 5:289c7627:::benchmark_data_smithi052_19421_object1241:head v 24'81, mlcod=24'79)", 2024-04-26T10:21:38.586 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:34.020755+0000", 2024-04-26T10:21:38.586 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.5104134770000002, 2024-04-26T10:21:38.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087876529999999994, 2024-04-26T10:21:38.586 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.586 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.586 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020755+0000", 2024-04-26T10:21:38.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020755+0000", 2024-04-26T10:21:38.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020754+0000", 2024-04-26T10:21:38.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020786+0000", 2024-04-26T10:21:38.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1646999999999997e-05 2024-04-26T10:21:38.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020795+0000", 2024-04-26T10:21:38.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3179999999999996e-06 2024-04-26T10:21:38.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020801+0000", 2024-04-26T10:21:38.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2700000000000001e-06 2024-04-26T10:21:38.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020848+0000", 2024-04-26T10:21:38.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6409999999999998e-05 2024-04-26T10:21:38.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.020887+0000", 2024-04-26T10:21:38.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9554000000000001e-05 2024-04-26T10:21:38.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:38.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.029434+0000", 2024-04-26T10:21:38.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085469410000000006 2024-04-26T10:21:38.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.029542+0000", 2024-04-26T10:21:38.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000108075 2024-04-26T10:21:38.590 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.590 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.590 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.591 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:1284 5.4 e24/22 5:233871e1:::benchmark_data_smithi052_19421_object1283:head v 24'86, mlcod=24'82)", 2024-04-26T10:21:38.591 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:34.036045+0000", 2024-04-26T10:21:38.591 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.495123253, 2024-04-26T10:21:38.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083901170000000008, 2024-04-26T10:21:38.591 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.591 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.591 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036045+0000", 2024-04-26T10:21:38.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036045+0000", 2024-04-26T10:21:38.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036044+0000", 2024-04-26T10:21:38.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036089+0000", 2024-04-26T10:21:38.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5209e-05 2024-04-26T10:21:38.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036102+0000", 2024-04-26T10:21:38.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3098999999999999e-05 2024-04-26T10:21:38.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036109+0000", 2024-04-26T10:21:38.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3860000000000004e-06 2024-04-26T10:21:38.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036149+0000", 2024-04-26T10:21:38.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0816999999999999e-05 2024-04-26T10:21:38.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036169+0000", 2024-04-26T10:21:38.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9984e-05 2024-04-26T10:21:38.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:38.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.044414+0000", 2024-04-26T10:21:38.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0082441119999999996 2024-04-26T10:21:38.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.044435+0000", 2024-04-26T10:21:38.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1350000000000001e-05 2024-04-26T10:21:38.594 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.594 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.594 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.595 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:1291 5.4 e24/22 5:281a5ea1:::benchmark_data_smithi052_19421_object1290:head v 24'87, mlcod=24'82)", 2024-04-26T10:21:38.595 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:34.036205+0000", 2024-04-26T10:21:38.595 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4949630970000003, 2024-04-26T10:21:38.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0082410699999999996, 2024-04-26T10:21:38.595 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.595 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.595 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036205+0000", 2024-04-26T10:21:38.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036205+0000", 2024-04-26T10:21:38.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036204+0000", 2024-04-26T10:21:38.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036261+0000", 2024-04-26T10:21:38.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6116999999999998e-05 2024-04-26T10:21:38.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036271+0000", 2024-04-26T10:21:38.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0489000000000001e-05 2024-04-26T10:21:38.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036279+0000", 2024-04-26T10:21:38.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9279999999999993e-06 2024-04-26T10:21:38.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036931+0000", 2024-04-26T10:21:38.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00065212600000000005 2024-04-26T10:21:38.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.036949+0000", 2024-04-26T10:21:38.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8258999999999999e-05 2024-04-26T10:21:38.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:38.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.044437+0000", 2024-04-26T10:21:38.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0074872239999999998 2024-04-26T10:21:38.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.044446+0000", 2024-04-26T10:21:38.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4569999999999994e-06 2024-04-26T10:21:38.599 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.599 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.599 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.599 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:2187 5.9 e24/22 5:9696c366:::benchmark_data_smithi052_19421_object2186:head v 24'128, mlcod=24'126)", 2024-04-26T10:21:38.599 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:34.315350+0000", 2024-04-26T10:21:38.599 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.2158178370000003, 2024-04-26T10:21:38.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086340689999999994, 2024-04-26T10:21:38.599 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.599 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.599 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.315350+0000", 2024-04-26T10:21:38.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.315350+0000", 2024-04-26T10:21:38.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.315349+0000", 2024-04-26T10:21:38.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:38.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.315410+0000", 2024-04-26T10:21:38.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1356e-05 2024-04-26T10:21:38.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.315425+0000", 2024-04-26T10:21:38.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4577e-05 2024-04-26T10:21:38.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.315435+0000", 2024-04-26T10:21:38.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8649999999999996e-06 2024-04-26T10:21:38.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.315551+0000", 2024-04-26T10:21:38.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011586699999999999 2024-04-26T10:21:38.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.315579+0000", 2024-04-26T10:21:38.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7970000000000002e-05 2024-04-26T10:21:38.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:38.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.323935+0000", 2024-04-26T10:21:38.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083561629999999998 2024-04-26T10:21:38.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.323984+0000", 2024-04-26T10:21:38.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9478999999999998e-05 2024-04-26T10:21:38.603 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.603 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.603 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.603 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:3391 5.b e25/22 5:d7215b9c:::benchmark_data_smithi052_19421_object3390:head v 25'212, mlcod=25'209)", 2024-04-26T10:21:38.603 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:34.710706+0000", 2024-04-26T10:21:38.603 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.8204615770000001, 2024-04-26T10:21:38.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0082081359999999996, 2024-04-26T10:21:38.604 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.604 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.604 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.710706+0000", 2024-04-26T10:21:38.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.710706+0000", 2024-04-26T10:21:38.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.710706+0000", 2024-04-26T10:21:38.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.710760+0000", 2024-04-26T10:21:38.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4277000000000002e-05 2024-04-26T10:21:38.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.710766+0000", 2024-04-26T10:21:38.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1070000000000001e-06 2024-04-26T10:21:38.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.710773+0000", 2024-04-26T10:21:38.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4559999999999997e-06 2024-04-26T10:21:38.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.712675+0000", 2024-04-26T10:21:38.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001902251 2024-04-26T10:21:38.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.712697+0000", 2024-04-26T10:21:38.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2228000000000001e-05 2024-04-26T10:21:38.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:38.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.718867+0000", 2024-04-26T10:21:38.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061697690000000003 2024-04-26T10:21:38.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.718915+0000", 2024-04-26T10:21:38.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7516999999999999e-05 2024-04-26T10:21:38.607 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.607 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.607 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.607 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:3395 5.0 e25/22 5:0b71aca9:::benchmark_data_smithi052_19421_object3394:head v 25'223, mlcod=25'219)", 2024-04-26T10:21:38.608 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:34.711005+0000", 2024-04-26T10:21:38.608 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.8201633839999998, 2024-04-26T10:21:38.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0082084979999999998, 2024-04-26T10:21:38.608 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.608 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.608 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.711005+0000", 2024-04-26T10:21:38.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.711005+0000", 2024-04-26T10:21:38.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.711004+0000", 2024-04-26T10:21:38.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.711083+0000", 2024-04-26T10:21:38.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8559999999999993e-05 2024-04-26T10:21:38.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.711090+0000", 2024-04-26T10:21:38.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8539999999999999e-06 2024-04-26T10:21:38.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.711097+0000", 2024-04-26T10:21:38.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4710000000000001e-06 2024-04-26T10:21:38.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.712440+0000", 2024-04-26T10:21:38.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001343332 2024-04-26T10:21:38.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.712465+0000", 2024-04-26T10:21:38.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5049999999999999e-05 2024-04-26T10:21:38.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:38.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.719149+0000", 2024-04-26T10:21:38.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0066837720000000002 2024-04-26T10:21:38.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.719213+0000", 2024-04-26T10:21:38.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3917000000000005e-05 2024-04-26T10:21:38.611 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.612 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.612 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.612 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:3587 5.e e25/22 5:7d6742f5:::benchmark_data_smithi052_19421_object3586:head v 25'214, mlcod=25'210)", 2024-04-26T10:21:38.612 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:34.781786+0000", 2024-04-26T10:21:38.612 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.7493824839999998, 2024-04-26T10:21:38.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008818981, 2024-04-26T10:21:38.612 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.612 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.612 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.781786+0000", 2024-04-26T10:21:38.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.781786+0000", 2024-04-26T10:21:38.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.781785+0000", 2024-04-26T10:21:38.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.781832+0000", 2024-04-26T10:21:38.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7327999999999998e-05 2024-04-26T10:21:38.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.781858+0000", 2024-04-26T10:21:38.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5522000000000001e-05 2024-04-26T10:21:38.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.781866+0000", 2024-04-26T10:21:38.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0420000000000003e-06 2024-04-26T10:21:38.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.781956+0000", 2024-04-26T10:21:38.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0607999999999997e-05 2024-04-26T10:21:38.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.781987+0000", 2024-04-26T10:21:38.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.027e-05 2024-04-26T10:21:38.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:38.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.790548+0000", 2024-04-26T10:21:38.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085609610000000006 2024-04-26T10:21:38.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.790605+0000", 2024-04-26T10:21:38.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6981000000000002e-05 2024-04-26T10:21:38.616 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.616 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.616 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.616 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:3977 5.9 e25/22 5:9d58c7a3:::benchmark_data_smithi052_19421_object3976:head v 25'243, mlcod=25'241)", 2024-04-26T10:21:38.616 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:34.921412+0000", 2024-04-26T10:21:38.616 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.609755662, 2024-04-26T10:21:38.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0080421669999999994, 2024-04-26T10:21:38.616 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.617 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.617 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.921412+0000", 2024-04-26T10:21:38.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.921412+0000", 2024-04-26T10:21:38.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.921411+0000", 2024-04-26T10:21:38.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:38.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.921481+0000", 2024-04-26T10:21:38.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9658000000000003e-05 2024-04-26T10:21:38.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.921495+0000", 2024-04-26T10:21:38.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4571e-05 2024-04-26T10:21:38.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.921508+0000", 2024-04-26T10:21:38.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2986000000000001e-05 2024-04-26T10:21:38.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.921555+0000", 2024-04-26T10:21:38.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6335999999999998e-05 2024-04-26T10:21:38.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.921584+0000", 2024-04-26T10:21:38.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9286999999999999e-05 2024-04-26T10:21:38.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:38.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.929381+0000", 2024-04-26T10:21:38.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0077972730000000004 2024-04-26T10:21:38.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:34.929455+0000", 2024-04-26T10:21:38.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3362999999999995e-05 2024-04-26T10:21:38.623 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.623 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.623 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.623 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:13785 5.8 e26/22 5:1674e66f:::benchmark_data_smithi052_19421_object13784:head v 26'881, mlcod=26'878)", 2024-04-26T10:21:38.623 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:38.346767+0000", 2024-04-26T10:21:38.623 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.18440142500000001, 2024-04-26T10:21:38.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0081746059999999992, 2024-04-26T10:21:38.623 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.624 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.624 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.346767+0000", 2024-04-26T10:21:38.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.346767+0000", 2024-04-26T10:21:38.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.346766+0000", 2024-04-26T10:21:38.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.346834+0000", 2024-04-26T10:21:38.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7776999999999998e-05 2024-04-26T10:21:38.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.346847+0000", 2024-04-26T10:21:38.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3953e-05 2024-04-26T10:21:38.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.346854+0000", 2024-04-26T10:21:38.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1920000000000002e-06 2024-04-26T10:21:38.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.346904+0000", 2024-04-26T10:21:38.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0074999999999997e-05 2024-04-26T10:21:38.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.346942+0000", 2024-04-26T10:21:38.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8172e-05 2024-04-26T10:21:38.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:38.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.354908+0000", 2024-04-26T10:21:38.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0079657259999999994 2024-04-26T10:21:38.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.354941+0000", 2024-04-26T10:21:38.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3569000000000003e-05 2024-04-26T10:21:38.627 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.627 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.627 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.628 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:13797 5.8 e26/22 5:1ca4a31d:::benchmark_data_smithi052_19421_object13796:head v 26'884, mlcod=26'879)", 2024-04-26T10:21:38.628 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:38.352401+0000", 2024-04-26T10:21:38.628 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.17876710900000001, 2024-04-26T10:21:38.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0082944839999999995, 2024-04-26T10:21:38.628 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:38.628 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:38.628 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:38.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:38.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.352401+0000", 2024-04-26T10:21:38.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:38.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.352401+0000", 2024-04-26T10:21:38.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:38.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:38.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.352400+0000", 2024-04-26T10:21:38.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:38.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.352460+0000", 2024-04-26T10:21:38.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9626999999999997e-05 2024-04-26T10:21:38.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:38.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.352471+0000", 2024-04-26T10:21:38.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1542999999999999e-05 2024-04-26T10:21:38.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.352480+0000", 2024-04-26T10:21:38.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8119999999999997e-06 2024-04-26T10:21:38.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:38.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.354139+0000", 2024-04-26T10:21:38.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016583189999999999 2024-04-26T10:21:38.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:38.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.354155+0000", 2024-04-26T10:21:38.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6744000000000001e-05 2024-04-26T10:21:38.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:38.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.360637+0000", 2024-04-26T10:21:38.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0064819939999999996 2024-04-26T10:21:38.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:38.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:38.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:38.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.360695+0000", 2024-04-26T10:21:38.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8109000000000002e-05 2024-04-26T10:21:38.632 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.632 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.632 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.632 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:38.632 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:38.632 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:38.633 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 5 16 14546 14530 181.606 171.25 0.00294593 0.00549729 2024-04-26T10:21:38.634 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:21:38.634 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:38.628+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:38.734 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:38.728+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:38.770 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T10:21:38.770 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T10:21:38.770 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.770 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:14950 5.b 5:def82200:::benchmark_data_smithi052_19421_object14949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:38.770 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:38.767829+0000", 2024-04-26T10:21:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0013081519999999999, 2024-04-26T10:21:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0013333399999999999, 2024-04-26T10:21:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 14950 2024-04-26T10:21:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767829+0000", 2024-04-26T10:21:38.771 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767829+0000", 2024-04-26T10:21:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767828+0000", 2024-04-26T10:21:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:38.772 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767906+0000", 2024-04-26T10:21:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7962999999999999e-05 2024-04-26T10:21:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767916+0000", 2024-04-26T10:21:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4320000000000005e-06 2024-04-26T10:21:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767922+0000", 2024-04-26T10:21:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.8519999999999998e-06 2024-04-26T10:21:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.773 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768414+0000", 2024-04-26T10:21:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00049165299999999999 2024-04-26T10:21:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768501+0000", 2024-04-26T10:21:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7113000000000004e-05 2024-04-26T10:21:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768596+0000", 2024-04-26T10:21:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5144999999999998e-05 2024-04-26T10:21:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.774 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:14951 5.6 5:65e6ca25:::benchmark_data_smithi052_19421_object14950:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:38.768036+0000", 2024-04-26T10:21:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0011007079999999999, 2024-04-26T10:21:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011715110000000001, 2024-04-26T10:21:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 14951 2024-04-26T10:21:38.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768036+0000", 2024-04-26T10:21:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768036+0000", 2024-04-26T10:21:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:38.776 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768036+0000", 2024-04-26T10:21:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768103+0000", 2024-04-26T10:21:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6977999999999995e-05 2024-04-26T10:21:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768134+0000", 2024-04-26T10:21:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.1749999999999999e-05 2024-04-26T10:21:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.777 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768140+0000", 2024-04-26T10:21:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7620000000000001e-06 2024-04-26T10:21:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768241+0000", 2024-04-26T10:21:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010128000000000001 2024-04-26T10:21:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768379+0000", 2024-04-26T10:21:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013722699999999999 2024-04-26T10:21:38.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768495+0000", 2024-04-26T10:21:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000116657 2024-04-26T10:21:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4722.0:14952 5.7 e26/22 5:e836729b:::benchmark_data_smithi052_19421_object14951:head v 26'935, mlcod=26'933)", 2024-04-26T10:21:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:38.768773+0000", 2024-04-26T10:21:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.00036372999999999999, 2024-04-26T10:21:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00047092999999999999, 2024-04-26T10:21:38.779 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T10:21:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768773+0000", 2024-04-26T10:21:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768773+0000", 2024-04-26T10:21:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.780 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768773+0000", 2024-04-26T10:21:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768840+0000", 2024-04-26T10:21:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7654e-05 2024-04-26T10:21:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768849+0000", 2024-04-26T10:21:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.636e-06 2024-04-26T10:21:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.781 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768855+0000", 2024-04-26T10:21:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9839999999999998e-06 2024-04-26T10:21:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768913+0000", 2024-04-26T10:21:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.7914000000000002e-05 2024-04-26T10:21:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768936+0000", 2024-04-26T10:21:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3101000000000001e-05 2024-04-26T10:21:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4722.0:14937 5.2 e26/22 5:4f5ea572:::benchmark_data_smithi052_19421_object14936:head v 26'932, mlcod=26'929)", 2024-04-26T10:21:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:38.764746+0000", 2024-04-26T10:21:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0043908640000000004, 2024-04-26T10:21:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004527232, 2024-04-26T10:21:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T10:21:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:38.783 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.764746+0000", 2024-04-26T10:21:38.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:38.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.764746+0000", 2024-04-26T10:21:38.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:38.784 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.764745+0000", 2024-04-26T10:21:38.784 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.784 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.784 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.764806+0000", 2024-04-26T10:21:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0118999999999998e-05 2024-04-26T10:21:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.764821+0000", 2024-04-26T10:21:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.5583e-05 2024-04-26T10:21:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.764828+0000", 2024-04-26T10:21:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7340000000000002e-06 2024-04-26T10:21:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.785 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.764869+0000", 2024-04-26T10:21:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0967999999999998e-05 2024-04-26T10:21:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.764907+0000", 2024-04-26T10:21:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8222000000000001e-05 2024-04-26T10:21:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.786 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:14939 5.3 5:c80110d6:::benchmark_data_smithi052_19421_object14938:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:38.765193+0000", 2024-04-26T10:21:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0039442849999999996, 2024-04-26T10:21:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0041127799999999999, 2024-04-26T10:21:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 14939 2024-04-26T10:21:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.787 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.765193+0000", 2024-04-26T10:21:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.765193+0000", 2024-04-26T10:21:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.765192+0000", 2024-04-26T10:21:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.788 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.765240+0000", 2024-04-26T10:21:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8303000000000002e-05 2024-04-26T10:21:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.765263+0000", 2024-04-26T10:21:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3028999999999999e-05 2024-04-26T10:21:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.765277+0000", 2024-04-26T10:21:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4164e-05 2024-04-26T10:21:38.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.765321+0000", 2024-04-26T10:21:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4011999999999998e-05 2024-04-26T10:21:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.765457+0000", 2024-04-26T10:21:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013536200000000001 2024-04-26T10:21:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.765594+0000", 2024-04-26T10:21:38.790 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013771500000000001 2024-04-26T10:21:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767324+0000", 2024-04-26T10:21:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0017290750000000001 2024-04-26T10:21:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:14940 5.4 5:2f345a16:::benchmark_data_smithi052_19421_object14939:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:38.765820+0000", 2024-04-26T10:21:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.003317436, 2024-04-26T10:21:38.791 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035257130000000002, 2024-04-26T10:21:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 14940 2024-04-26T10:21:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.765820+0000", 2024-04-26T10:21:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.792 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.765820+0000", 2024-04-26T10:21:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.765818+0000", 2024-04-26T10:21:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.765879+0000", 2024-04-26T10:21:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0640999999999998e-05 2024-04-26T10:21:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.793 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.765894+0000", 2024-04-26T10:21:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.4497e-05 2024-04-26T10:21:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.765901+0000", 2024-04-26T10:21:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.7729999999999999e-06 2024-04-26T10:21:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.765949+0000", 2024-04-26T10:21:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.7636999999999998e-05 2024-04-26T10:21:38.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766104+0000", 2024-04-26T10:21:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015485600000000001 2024-04-26T10:21:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766268+0000", 2024-04-26T10:21:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000163876 2024-04-26T10:21:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.795 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:14942 5.0 5:03f3c1f2:::benchmark_data_smithi052_19421_object14941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:38.766052+0000", 2024-04-26T10:21:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0030852100000000001, 2024-04-26T10:21:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0033311830000000001, 2024-04-26T10:21:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 14942 2024-04-26T10:21:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:38.796 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766052+0000", 2024-04-26T10:21:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766052+0000", 2024-04-26T10:21:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766051+0000", 2024-04-26T10:21:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.797 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766172+0000", 2024-04-26T10:21:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000120989 2024-04-26T10:21:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766185+0000", 2024-04-26T10:21:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3111e-05 2024-04-26T10:21:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766189+0000", 2024-04-26T10:21:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1370000000000004e-06 2024-04-26T10:21:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766227+0000", 2024-04-26T10:21:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7484000000000002e-05 2024-04-26T10:21:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766343+0000", 2024-04-26T10:21:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000116039 2024-04-26T10:21:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766435+0000", 2024-04-26T10:21:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1871000000000002e-05 2024-04-26T10:21:38.799 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_repop(client.4722.0:14941 5.1 e26/22 5:844eac9a:::benchmark_data_smithi052_19421_object14940:head v 26'899, mlcod=26'897)", 2024-04-26T10:21:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:38.766680+0000", 2024-04-26T10:21:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0024569010000000001, 2024-04-26T10:21:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0027394659999999999, 2024-04-26T10:21:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T10:21:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:38.800 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766680+0000", 2024-04-26T10:21:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766680+0000", 2024-04-26T10:21:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766679+0000", 2024-04-26T10:21:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:38.801 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766728+0000", 2024-04-26T10:21:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8940000000000002e-05 2024-04-26T10:21:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766751+0000", 2024-04-26T10:21:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2490999999999999e-05 2024-04-26T10:21:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766757+0000", 2024-04-26T10:21:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:21:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.802 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766795+0000", 2024-04-26T10:21:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7996e-05 2024-04-26T10:21:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766819+0000", 2024-04-26T10:21:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3830999999999999e-05 2024-04-26T10:21:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:14943 5.a 5:5c164c40:::benchmark_data_smithi052_19421_object14942:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:38.803 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:38.766915+0000", 2024-04-26T10:21:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0022217909999999999, 2024-04-26T10:21:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002534686, 2024-04-26T10:21:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 14943 2024-04-26T10:21:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766915+0000", 2024-04-26T10:21:38.804 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766915+0000", 2024-04-26T10:21:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766914+0000", 2024-04-26T10:21:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.766991+0000", 2024-04-26T10:21:38.805 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6485999999999999e-05 2024-04-26T10:21:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767000+0000", 2024-04-26T10:21:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5219999999999996e-06 2024-04-26T10:21:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767008+0000", 2024-04-26T10:21:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.977e-06 2024-04-26T10:21:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.806 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767041+0000", 2024-04-26T10:21:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3079e-05 2024-04-26T10:21:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767187+0000", 2024-04-26T10:21:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000145589 2024-04-26T10:21:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767354+0000", 2024-04-26T10:21:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00016738699999999999 2024-04-26T10:21:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:38.807 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:14945 5.0 5:00477bf4:::benchmark_data_smithi052_19421_object14944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:38.767154+0000", 2024-04-26T10:21:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0019834119999999999, 2024-04-26T10:21:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0023326179999999998, 2024-04-26T10:21:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 14945 2024-04-26T10:21:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.808 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767154+0000", 2024-04-26T10:21:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.809 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767154+0000", 2024-04-26T10:21:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767135+0000", 2024-04-26T10:21:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999814 2024-04-26T10:21:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767206+0000", 2024-04-26T10:21:38.810 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1083999999999999e-05 2024-04-26T10:21:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767216+0000", 2024-04-26T10:21:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.5740000000000002e-06 2024-04-26T10:21:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767222+0000", 2024-04-26T10:21:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3409999999999999e-06 2024-04-26T10:21:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.811 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767267+0000", 2024-04-26T10:21:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.5300000000000003e-05 2024-04-26T10:21:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767391+0000", 2024-04-26T10:21:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000123428 2024-04-26T10:21:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767531+0000", 2024-04-26T10:21:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014071799999999999 2024-04-26T10:21:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.812 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:14947 5.3 5:cdca3345:::benchmark_data_smithi052_19421_object14946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:38.767358+0000", 2024-04-26T10:21:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.001779018, 2024-04-26T10:21:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021803840000000001, 2024-04-26T10:21:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:38.813 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 14947 2024-04-26T10:21:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767358+0000", 2024-04-26T10:21:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767358+0000", 2024-04-26T10:21:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.814 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767357+0000", 2024-04-26T10:21:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767517+0000", 2024-04-26T10:21:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015930999999999999 2024-04-26T10:21:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767522+0000", 2024-04-26T10:21:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3109999999999996e-06 2024-04-26T10:21:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.815 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767526+0000", 2024-04-26T10:21:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8530000000000002e-06 2024-04-26T10:21:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767555+0000", 2024-04-26T10:21:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9573e-05 2024-04-26T10:21:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767639+0000", 2024-04-26T10:21:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3771999999999997e-05 2024-04-26T10:21:38.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767782+0000", 2024-04-26T10:21:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014309699999999999 2024-04-26T10:21:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:14948 5.5 5:a7059c3b:::benchmark_data_smithi052_19421_object14947:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:38.767685+0000", 2024-04-26T10:21:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0014520760000000001, 2024-04-26T10:21:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018953450000000001, 2024-04-26T10:21:38.817 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 14948 2024-04-26T10:21:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767685+0000", 2024-04-26T10:21:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.818 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767685+0000", 2024-04-26T10:21:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767684+0000", 2024-04-26T10:21:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767733+0000", 2024-04-26T10:21:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8829000000000003e-05 2024-04-26T10:21:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.819 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767741+0000", 2024-04-26T10:21:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.3960000000000006e-06 2024-04-26T10:21:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767748+0000", 2024-04-26T10:21:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5699999999999998e-06 2024-04-26T10:21:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767806+0000", 2024-04-26T10:21:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8198000000000001e-05 2024-04-26T10:21:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.820 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767983+0000", 2024-04-26T10:21:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000177317 2024-04-26T10:21:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768202+0000", 2024-04-26T10:21:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00021824799999999999 2024-04-26T10:21:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:38.821 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:14949 5.3 5:caac122e:::benchmark_data_smithi052_19421_object14948:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:38.767770+0000", 2024-04-26T10:21:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.0013669680000000001, 2024-04-26T10:21:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018585679999999999, 2024-04-26T10:21:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 14949 2024-04-26T10:21:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.822 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767770+0000", 2024-04-26T10:21:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767770+0000", 2024-04-26T10:21:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767769+0000", 2024-04-26T10:21:38.823 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767806+0000", 2024-04-26T10:21:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6937000000000002e-05 2024-04-26T10:21:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767813+0000", 2024-04-26T10:21:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9569999999999996e-06 2024-04-26T10:21:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:38.824 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.767819+0000", 2024-04-26T10:21:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4450000000000004e-06 2024-04-26T10:21:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768433+0000", 2024-04-26T10:21:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00061383300000000004 2024-04-26T10:21:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768559+0000", 2024-04-26T10:21:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012661000000000001 2024-04-26T10:21:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:38.825 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.768691+0000", 2024-04-26T10:21:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000132192 2024-04-26T10:21:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-04-26T10:21:38.826 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 13 2024-04-26T10:21:38.826 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T10:21:38.827 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:21:38.835 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:38.832+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:38.937 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:38.932+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:38.955 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T10:21:38.955 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T10:21:38.955 INFO:teuthology.orchestra.run.smithi164.stdout: "complaint_time": 30, 2024-04-26T10:21:38.955 INFO:teuthology.orchestra.run.smithi164.stdout: "num_blocked_ops": 0 2024-04-26T10:21:38.955 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T10:21:38.969 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:21:39.037 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:39.032+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:39.104 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T10:21:39.104 INFO:teuthology.orchestra.run.smithi164.stdout: "size": 20, 2024-04-26T10:21:39.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 600, 2024-04-26T10:21:39.105 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [ 2024-04-26T10:21:39.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.105 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:39.105 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:09.303300+0000", 2024-04-26T10:21:39.105 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.797556758999999, 2024-04-26T10:21:39.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.01397092, 2024-04-26T10:21:39.105 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.105 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.105 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.105 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.105 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303300+0000", 2024-04-26T10:21:39.105 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303300+0000", 2024-04-26T10:21:39.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.106 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303298+0000", 2024-04-26T10:21:39.106 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:39.106 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.106 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.106 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303307+0000", 2024-04-26T10:21:39.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.2900000000000008e-06 2024-04-26T10:21:39.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303326+0000", 2024-04-26T10:21:39.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.8096000000000001e-05 2024-04-26T10:21:39.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.107 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.107 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.107 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303339+0000", 2024-04-26T10:21:39.107 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.3329999999999999e-05 2024-04-26T10:21:39.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.304366+0000", 2024-04-26T10:21:39.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0010270800000000001 2024-04-26T10:21:39.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.304502+0000", 2024-04-26T10:21:39.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013630000000000001 2024-04-26T10:21:39.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.108 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.108 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.108 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.304641+0000", 2024-04-26T10:21:39.108 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00013889300000000001 2024-04-26T10:21:39.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.305644+0000", 2024-04-26T10:21:39.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00100256 2024-04-26T10:21:39.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.316545+0000", 2024-04-26T10:21:39.109 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010901574000000001 2024-04-26T10:21:39.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.109 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.109 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.109 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.316598+0000", 2024-04-26T10:21:39.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2648999999999997e-05 2024-04-26T10:21:39.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.110 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.110 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.317271+0000", 2024-04-26T10:21:39.110 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000672801 2024-04-26T10:21:39.110 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.110 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.110 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.110 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.110 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:25 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:39.110 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:09.303348+0000", 2024-04-26T10:21:39.110 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.797508872999998, 2024-04-26T10:21:39.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.014400512000000001, 2024-04-26T10:21:39.111 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.111 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.111 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303348+0000", 2024-04-26T10:21:39.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.111 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.111 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.111 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303348+0000", 2024-04-26T10:21:39.111 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303347+0000", 2024-04-26T10:21:39.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303352+0000", 2024-04-26T10:21:39.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4870000000000002e-06 2024-04-26T10:21:39.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.112 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.112 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.112 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303363+0000", 2024-04-26T10:21:39.112 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0463e-05 2024-04-26T10:21:39.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303372+0000", 2024-04-26T10:21:39.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.4660000000000005e-06 2024-04-26T10:21:39.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.304903+0000", 2024-04-26T10:21:39.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001530703 2024-04-26T10:21:39.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.113 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.113 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.113 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.304975+0000", 2024-04-26T10:21:39.113 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.1520000000000006e-05 2024-04-26T10:21:39.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.305065+0000", 2024-04-26T10:21:39.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0591000000000001e-05 2024-04-26T10:21:39.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.308231+0000", 2024-04-26T10:21:39.114 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0031663160000000002 2024-04-26T10:21:39.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.114 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.114 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.114 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.317482+0000", 2024-04-26T10:21:39.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0092504909999999996 2024-04-26T10:21:39.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.317697+0000", 2024-04-26T10:21:39.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00021466000000000001 2024-04-26T10:21:39.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.115 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.115 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.115 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.317748+0000", 2024-04-26T10:21:39.115 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1572e-05 2024-04-26T10:21:39.115 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.115 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.115 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.116 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:39.116 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:09.303624+0000", 2024-04-26T10:21:39.116 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 29.797232521000002, 2024-04-26T10:21:39.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013422959, 2024-04-26T10:21:39.116 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.116 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "started", 2024-04-26T10:21:39.116 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.116 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303624+0000", 2024-04-26T10:21:39.116 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.116 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.116 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.117 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303624+0000", 2024-04-26T10:21:39.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.117 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.117 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303623+0000", 2024-04-26T10:21:39.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.117 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.117 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303634+0000", 2024-04-26T10:21:39.117 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0372e-05 2024-04-26T10:21:39.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.117 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.117 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303639+0000", 2024-04-26T10:21:39.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:21:39.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303650+0000", 2024-04-26T10:21:39.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0395e-05 2024-04-26T10:21:39.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.118 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.118 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.118 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303710+0000", 2024-04-26T10:21:39.118 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.0900999999999998e-05 2024-04-26T10:21:39.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.303848+0000", 2024-04-26T10:21:39.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000137078 2024-04-26T10:21:39.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.119 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.119 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:09.317047+0000", 2024-04-26T10:21:39.119 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013199412000000001 2024-04-26T10:21:39.119 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.119 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.119 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.119 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.120 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:2910 5.5 5:ab833b43:::benchmark_data_smithi052_19421_object2909:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:21:39.120 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.549396+0000", 2024-04-26T10:21:39.120 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.5514603439999997, 2024-04-26T10:21:39.120 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012137289000000001, 2024-04-26T10:21:39.120 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.120 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.120 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:39.120 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:39.120 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.120 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 2910 2024-04-26T10:21:39.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.120 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.120 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.120 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549396+0000", 2024-04-26T10:21:39.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549396+0000", 2024-04-26T10:21:39.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549395+0000", 2024-04-26T10:21:39.121 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.121 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.121 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.121 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549517+0000", 2024-04-26T10:21:39.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012146699999999999 2024-04-26T10:21:39.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549523+0000", 2024-04-26T10:21:39.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.8830000000000003e-06 2024-04-26T10:21:39.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.122 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549526+0000", 2024-04-26T10:21:39.122 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.641e-06 2024-04-26T10:21:39.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.122 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549579+0000", 2024-04-26T10:21:39.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2583000000000001e-05 2024-04-26T10:21:39.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549722+0000", 2024-04-26T10:21:39.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000143113 2024-04-26T10:21:39.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:39.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549836+0000", 2024-04-26T10:21:39.123 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011388899999999999 2024-04-26T10:21:39.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.123 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.123 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.123 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.550998+0000", 2024-04-26T10:21:39.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0011616020000000001 2024-04-26T10:21:39.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.561413+0000", 2024-04-26T10:21:39.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010415725000000001 2024-04-26T10:21:39.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.561481+0000", 2024-04-26T10:21:39.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7753e-05 2024-04-26T10:21:39.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.124 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.124 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.124 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.561533+0000", 2024-04-26T10:21:39.124 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2408999999999999e-05 2024-04-26T10:21:39.125 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.125 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.125 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.125 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.125 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:2911 5.5 5:aa4551fc:::benchmark_data_smithi052_19421_object2910:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:21:39.125 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.549548+0000", 2024-04-26T10:21:39.125 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.5513081270000004, 2024-04-26T10:21:39.125 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012127443999999999, 2024-04-26T10:21:39.125 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.125 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.125 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:39.125 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:39.125 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.125 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 2911 2024-04-26T10:21:39.125 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.126 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549548+0000", 2024-04-26T10:21:39.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549548+0000", 2024-04-26T10:21:39.126 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.126 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.126 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.126 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549548+0000", 2024-04-26T10:21:39.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549658+0000", 2024-04-26T10:21:39.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00011038 2024-04-26T10:21:39.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.127 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.127 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549666+0000", 2024-04-26T10:21:39.127 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.503e-06 2024-04-26T10:21:39.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.127 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.549688+0000", 2024-04-26T10:21:39.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.2297999999999999e-05 2024-04-26T10:21:39.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.550372+0000", 2024-04-26T10:21:39.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00068394899999999999 2024-04-26T10:21:39.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.128 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.128 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.128 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.550474+0000", 2024-04-26T10:21:39.128 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000102334 2024-04-26T10:21:39.129 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.129 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:39.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.550583+0000", 2024-04-26T10:21:39.129 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0001083 2024-04-26T10:21:39.129 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.129 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.554146+0000", 2024-04-26T10:21:39.129 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0035630969999999999 2024-04-26T10:21:39.129 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.129 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.129 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.129 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.561599+0000", 2024-04-26T10:21:39.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0074533029999999997 2024-04-26T10:21:39.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.130 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.561643+0000", 2024-04-26T10:21:39.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.4221000000000002e-05 2024-04-26T10:21:39.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.130 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.130 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.561676+0000", 2024-04-26T10:21:39.130 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2598000000000002e-05 2024-04-26T10:21:39.130 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.130 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.130 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.131 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.131 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.131 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:4163 5.b 5:d1efcc34:::benchmark_data_smithi052_19421_object4162:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-26T10:21:39.131 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:34.981959+0000", 2024-04-26T10:21:39.131 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 4.1188977830000004, 2024-04-26T10:21:39.131 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.011502333, 2024-04-26T10:21:39.131 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.131 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.131 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:39.131 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:39.131 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.131 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 4163 2024-04-26T10:21:39.131 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.131 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.981959+0000", 2024-04-26T10:21:39.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.132 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.981959+0000", 2024-04-26T10:21:39.132 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.132 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.132 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.132 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.132 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.981958+0000", 2024-04-26T10:21:39.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.982011+0000", 2024-04-26T10:21:39.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2677999999999999e-05 2024-04-26T10:21:39.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.133 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.982020+0000", 2024-04-26T10:21:39.133 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.3219999999999999e-06 2024-04-26T10:21:39.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.133 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.133 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.134 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.982032+0000", 2024-04-26T10:21:39.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1725e-05 2024-04-26T10:21:39.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.134 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.134 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.983054+0000", 2024-04-26T10:21:39.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001022778 2024-04-26T10:21:39.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.134 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.134 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.983214+0000", 2024-04-26T10:21:39.134 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015969000000000001 2024-04-26T10:21:39.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.134 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.135 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.135 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.983349+0000", 2024-04-26T10:21:39.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000135177 2024-04-26T10:21:39.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.135 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.135 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.985533+0000", 2024-04-26T10:21:39.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0021832790000000002 2024-04-26T10:21:39.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.135 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.135 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.993369+0000", 2024-04-26T10:21:39.135 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0078365989999999996 2024-04-26T10:21:39.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.993432+0000", 2024-04-26T10:21:39.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2430999999999999e-05 2024-04-26T10:21:39.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.136 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.136 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.136 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:34.993461+0000", 2024-04-26T10:21:39.136 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9502999999999999e-05 2024-04-26T10:21:39.136 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.136 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.136 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.136 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.136 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.137 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:12761 5.0 5:044f7604:::benchmark_data_smithi052_19421_object12760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.137 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:37.966309+0000", 2024-04-26T10:21:39.137 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.1345479510000001, 2024-04-26T10:21:39.137 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.011252913999999999, 2024-04-26T10:21:39.137 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.137 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.137 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:39.137 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:39.137 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.137 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12761 2024-04-26T10:21:39.137 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.137 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.137 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.137 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.966309+0000", 2024-04-26T10:21:39.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.966309+0000", 2024-04-26T10:21:39.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.138 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.138 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.138 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.966308+0000", 2024-04-26T10:21:39.138 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.139 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.139 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.966367+0000", 2024-04-26T10:21:39.139 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.9095999999999998e-05 2024-04-26T10:21:39.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.139 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.139 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.966375+0000", 2024-04-26T10:21:39.139 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.9079999999999995e-06 2024-04-26T10:21:39.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.139 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.139 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.139 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.966380+0000", 2024-04-26T10:21:39.139 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.0719999999999999e-06 2024-04-26T10:21:39.139 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.969664+0000", 2024-04-26T10:21:39.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0032839549999999999 2024-04-26T10:21:39.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.969845+0000", 2024-04-26T10:21:39.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00018113999999999999 2024-04-26T10:21:39.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.140 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.140 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.140 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.969936+0000", 2024-04-26T10:21:39.140 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.0823999999999996e-05 2024-04-26T10:21:39.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.972573+0000", 2024-04-26T10:21:39.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0026368659999999999 2024-04-26T10:21:39.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.977472+0000", 2024-04-26T10:21:39.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.004898927 2024-04-26T10:21:39.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.141 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.141 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.977526+0000", 2024-04-26T10:21:39.141 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.3701e-05 2024-04-26T10:21:39.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.142 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.142 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.977561+0000", 2024-04-26T10:21:39.142 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.5834999999999998e-05 2024-04-26T10:21:39.142 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.142 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.142 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.142 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.142 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:12762 5.0 5:0fc6ba18:::benchmark_data_smithi052_19421_object12761:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.142 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:37.966385+0000", 2024-04-26T10:21:39.142 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.134471362, 2024-04-26T10:21:39.143 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.011293543, 2024-04-26T10:21:39.143 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.143 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.143 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:39.143 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:39.143 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.143 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12762 2024-04-26T10:21:39.143 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.143 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.143 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.143 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.143 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.966385+0000", 2024-04-26T10:21:39.143 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.143 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.143 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.144 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.144 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.966385+0000", 2024-04-26T10:21:39.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.144 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.144 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.144 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.144 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.966385+0000", 2024-04-26T10:21:39.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.144 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.144 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.144 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.144 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.966434+0000", 2024-04-26T10:21:39.144 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9614999999999998e-05 2024-04-26T10:21:39.144 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.145 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.966441+0000", 2024-04-26T10:21:39.145 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.6229999999999999e-06 2024-04-26T10:21:39.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.145 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.966447+0000", 2024-04-26T10:21:39.145 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.5380000000000002e-06 2024-04-26T10:21:39.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.145 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.145 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.145 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.970783+0000", 2024-04-26T10:21:39.145 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0043360050000000004 2024-04-26T10:21:39.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.970928+0000", 2024-04-26T10:21:39.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014540399999999999 2024-04-26T10:21:39.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.971082+0000", 2024-04-26T10:21:39.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015374799999999999 2024-04-26T10:21:39.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.146 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.146 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.146 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.972904+0000", 2024-04-26T10:21:39.146 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018221069999999999 2024-04-26T10:21:39.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.977636+0000", 2024-04-26T10:21:39.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0047317660000000001 2024-04-26T10:21:39.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.977657+0000", 2024-04-26T10:21:39.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1739e-05 2024-04-26T10:21:39.147 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.147 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.147 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.147 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.977679+0000", 2024-04-26T10:21:39.147 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1344000000000001e-05 2024-04-26T10:21:39.147 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.148 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.148 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.148 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.148 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:12765 5.8 5:1ff9dc4d:::benchmark_data_smithi052_19421_object12764:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.148 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:37.966827+0000", 2024-04-26T10:21:39.148 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 1.134029325, 2024-04-26T10:21:39.148 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010804101999999999, 2024-04-26T10:21:39.148 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.148 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.148 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:39.148 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:39.148 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.149 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 12765 2024-04-26T10:21:39.149 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.149 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.149 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.149 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.149 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.966827+0000", 2024-04-26T10:21:39.149 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.149 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.149 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.149 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.149 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.966827+0000", 2024-04-26T10:21:39.149 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.149 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.149 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.150 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.150 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.966826+0000", 2024-04-26T10:21:39.150 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.150 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.150 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.150 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.150 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.966896+0000", 2024-04-26T10:21:39.150 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.0104000000000005e-05 2024-04-26T10:21:39.150 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.150 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.150 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.150 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.966906+0000", 2024-04-26T10:21:39.150 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7380000000000006e-06 2024-04-26T10:21:39.150 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.966925+0000", 2024-04-26T10:21:39.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9249000000000002e-05 2024-04-26T10:21:39.151 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.970894+0000", 2024-04-26T10:21:39.151 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0039682679999999996 2024-04-26T10:21:39.151 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.151 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.151 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.151 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.971022+0000", 2024-04-26T10:21:39.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012832100000000001 2024-04-26T10:21:39.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.971173+0000", 2024-04-26T10:21:39.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015060900000000001 2024-04-26T10:21:39.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.152 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.974243+0000", 2024-04-26T10:21:39.152 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0030703940000000002 2024-04-26T10:21:39.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.152 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.152 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.977569+0000", 2024-04-26T10:21:39.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003325644 2024-04-26T10:21:39.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.977598+0000", 2024-04-26T10:21:39.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9110000000000001e-05 2024-04-26T10:21:39.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.153 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.153 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.153 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:37.977631+0000", 2024-04-26T10:21:39.153 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.3528000000000002e-05 2024-04-26T10:21:39.153 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.153 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.153 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.154 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.154 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:14603 5.e 5:79cf94ec:::benchmark_data_smithi052_19421_object14602:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.154 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:38.636759+0000", 2024-04-26T10:21:39.154 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.46409797200000003, 2024-04-26T10:21:39.154 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010979707, 2024-04-26T10:21:39.154 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.154 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.154 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:39.154 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:39.154 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.154 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 14603 2024-04-26T10:21:39.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.154 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.155 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.155 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.636759+0000", 2024-04-26T10:21:39.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.155 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.155 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.636759+0000", 2024-04-26T10:21:39.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.155 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.155 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.155 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.636758+0000", 2024-04-26T10:21:39.155 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.636806+0000", 2024-04-26T10:21:39.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8374999999999997e-05 2024-04-26T10:21:39.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.636813+0000", 2024-04-26T10:21:39.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2570000000000004e-06 2024-04-26T10:21:39.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.156 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.156 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.636819+0000", 2024-04-26T10:21:39.156 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.1580000000000002e-06 2024-04-26T10:21:39.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.156 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.641061+0000", 2024-04-26T10:21:39.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0042421280000000004 2024-04-26T10:21:39.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.641221+0000", 2024-04-26T10:21:39.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000160178 2024-04-26T10:21:39.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.157 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.641322+0000", 2024-04-26T10:21:39.157 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00010105199999999999 2024-04-26T10:21:39.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.157 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.157 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.158 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.646406+0000", 2024-04-26T10:21:39.158 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0050836479999999996 2024-04-26T10:21:39.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.158 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.158 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.647650+0000", 2024-04-26T10:21:39.158 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001243947 2024-04-26T10:21:39.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.158 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.158 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.158 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.647702+0000", 2024-04-26T10:21:39.158 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2046999999999998e-05 2024-04-26T10:21:39.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.159 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.159 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.647738+0000", 2024-04-26T10:21:39.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6560999999999998e-05 2024-04-26T10:21:39.159 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.159 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.159 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.159 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.159 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:14611 5.e 5:79786934:::benchmark_data_smithi052_19421_object14610:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.159 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:38.638351+0000", 2024-04-26T10:21:39.159 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.46250592600000001, 2024-04-26T10:21:39.159 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013091362, 2024-04-26T10:21:39.159 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.160 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.160 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:39.160 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:39.160 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.160 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 14611 2024-04-26T10:21:39.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.160 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.160 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.638351+0000", 2024-04-26T10:21:39.160 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.160 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.160 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.161 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.638351+0000", 2024-04-26T10:21:39.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.161 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.161 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.161 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.638349+0000", 2024-04-26T10:21:39.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:39.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.161 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.161 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.161 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.638414+0000", 2024-04-26T10:21:39.161 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.4523000000000005e-05 2024-04-26T10:21:39.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.162 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.162 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.638426+0000", 2024-04-26T10:21:39.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2330999999999999e-05 2024-04-26T10:21:39.162 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.162 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.162 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.638435+0000", 2024-04-26T10:21:39.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.8140000000000007e-06 2024-04-26T10:21:39.162 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.162 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.162 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.162 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.643943+0000", 2024-04-26T10:21:39.162 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0055083770000000001 2024-04-26T10:21:39.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.163 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.163 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.644118+0000", 2024-04-26T10:21:39.163 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017508700000000001 2024-04-26T10:21:39.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.163 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.163 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.644289+0000", 2024-04-26T10:21:39.163 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00017081900000000001 2024-04-26T10:21:39.163 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.163 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.163 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.163 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.647445+0000", 2024-04-26T10:21:39.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0031558659999999998 2024-04-26T10:21:39.164 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.164 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.164 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.651328+0000", 2024-04-26T10:21:39.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003882576 2024-04-26T10:21:39.164 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.164 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.164 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.651403+0000", 2024-04-26T10:21:39.164 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.5258000000000003e-05 2024-04-26T10:21:39.164 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.164 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.164 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.165 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.651442+0000", 2024-04-26T10:21:39.165 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.9079000000000003e-05 2024-04-26T10:21:39.165 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.165 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.165 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.165 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.165 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:15145 5.5 5:ac1b8087:::benchmark_data_smithi052_19421_object15144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.165 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:38.836190+0000", 2024-04-26T10:21:39.165 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.26466671899999999, 2024-04-26T10:21:39.165 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013354595, 2024-04-26T10:21:39.165 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.165 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.165 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:39.165 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:39.166 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.166 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 15145 2024-04-26T10:21:39.166 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.166 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.166 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.166 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.166 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.836190+0000", 2024-04-26T10:21:39.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.166 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.166 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.166 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.166 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.836190+0000", 2024-04-26T10:21:39.166 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.166 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.167 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.167 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.836189+0000", 2024-04-26T10:21:39.167 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:39.167 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.167 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.167 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.836244+0000", 2024-04-26T10:21:39.167 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.5760000000000001e-05 2024-04-26T10:21:39.167 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.167 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.167 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.167 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.836256+0000", 2024-04-26T10:21:39.167 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.1813e-05 2024-04-26T10:21:39.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.836265+0000", 2024-04-26T10:21:39.168 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.5390000000000007e-06 2024-04-26T10:21:39.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.836308+0000", 2024-04-26T10:21:39.168 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3791999999999997e-05 2024-04-26T10:21:39.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.168 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.168 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.168 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.836434+0000", 2024-04-26T10:21:39.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00012519899999999999 2024-04-26T10:21:39.169 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.169 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.169 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:39.169 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.836586+0000", 2024-04-26T10:21:39.169 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000152297 2024-04-26T10:21:39.169 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.169 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.169 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.169 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.837731+0000", 2024-04-26T10:21:39.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001145068 2024-04-26T10:21:39.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.170 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.849458+0000", 2024-04-26T10:21:39.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.011726871999999999 2024-04-26T10:21:39.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.170 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.170 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.170 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.849505+0000", 2024-04-26T10:21:39.170 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.761e-05 2024-04-26T10:21:39.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.171 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.171 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.849544+0000", 2024-04-26T10:21:39.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8945000000000001e-05 2024-04-26T10:21:39.171 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.171 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.171 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.171 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.171 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:15194 5.4 5:27f19d29:::benchmark_data_smithi052_19421_object15193:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.171 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:38.859436+0000", 2024-04-26T10:21:39.171 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.24142023700000001, 2024-04-26T10:21:39.171 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012472585, 2024-04-26T10:21:39.172 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.172 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.172 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:39.172 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:39.172 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.172 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 15194 2024-04-26T10:21:39.172 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.172 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.172 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.172 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.172 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.859436+0000", 2024-04-26T10:21:39.172 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.172 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.172 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.172 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.859436+0000", 2024-04-26T10:21:39.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.859436+0000", 2024-04-26T10:21:39.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.173 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.173 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.859465+0000", 2024-04-26T10:21:39.173 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9192000000000001e-05 2024-04-26T10:21:39.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.173 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.174 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.174 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.859472+0000", 2024-04-26T10:21:39.174 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9720000000000003e-06 2024-04-26T10:21:39.174 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.174 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.174 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.174 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.859477+0000", 2024-04-26T10:21:39.174 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.5620000000000003e-06 2024-04-26T10:21:39.174 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.174 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.174 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.174 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.860893+0000", 2024-04-26T10:21:39.174 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0014150499999999999 2024-04-26T10:21:39.174 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.175 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.175 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.175 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.860982+0000", 2024-04-26T10:21:39.175 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9980000000000002e-05 2024-04-26T10:21:39.175 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.175 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.175 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.175 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.861070+0000", 2024-04-26T10:21:39.175 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.7459000000000004e-05 2024-04-26T10:21:39.175 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.175 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.175 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.175 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.864066+0000", 2024-04-26T10:21:39.175 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.002995752 2024-04-26T10:21:39.175 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.176 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.176 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.871794+0000", 2024-04-26T10:21:39.176 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0077281989999999998 2024-04-26T10:21:39.176 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.176 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.176 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.871857+0000", 2024-04-26T10:21:39.176 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3194999999999994e-05 2024-04-26T10:21:39.176 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.176 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.177 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.871909+0000", 2024-04-26T10:21:39.177 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.1792999999999997e-05 2024-04-26T10:21:39.177 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.177 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.177 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.177 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.177 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.177 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:15202 5.c 5:37da2158:::benchmark_data_smithi052_19421_object15201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.177 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:38.859817+0000", 2024-04-26T10:21:39.177 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.241039595, 2024-04-26T10:21:39.177 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.010852175, 2024-04-26T10:21:39.177 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.177 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.177 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:39.178 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:39.178 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.178 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 15202 2024-04-26T10:21:39.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.178 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.859817+0000", 2024-04-26T10:21:39.178 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.178 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.178 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.178 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.859817+0000", 2024-04-26T10:21:39.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.859817+0000", 2024-04-26T10:21:39.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.859859+0000", 2024-04-26T10:21:39.179 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2018999999999999e-05 2024-04-26T10:21:39.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.179 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.179 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.179 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.859865+0000", 2024-04-26T10:21:39.180 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.7320000000000001e-06 2024-04-26T10:21:39.180 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.180 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.180 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.180 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.859872+0000", 2024-04-26T10:21:39.180 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.2580000000000001e-06 2024-04-26T10:21:39.180 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.180 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.180 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.180 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.860884+0000", 2024-04-26T10:21:39.180 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.001012857 2024-04-26T10:21:39.180 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.180 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.180 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.181 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.861009+0000", 2024-04-26T10:21:39.181 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000124986 2024-04-26T10:21:39.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.181 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:39.181 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.861267+0000", 2024-04-26T10:21:39.181 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00025724999999999999 2024-04-26T10:21:39.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.181 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.181 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.864169+0000", 2024-04-26T10:21:39.181 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0029019639999999999 2024-04-26T10:21:39.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.181 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.182 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.182 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.870580+0000", 2024-04-26T10:21:39.182 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064114139999999998 2024-04-26T10:21:39.182 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.182 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.182 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.182 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.870629+0000", 2024-04-26T10:21:39.182 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.8791000000000001e-05 2024-04-26T10:21:39.182 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.182 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.182 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.182 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:38.870669+0000", 2024-04-26T10:21:39.182 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0312999999999998e-05 2024-04-26T10:21:39.183 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.183 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.183 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.183 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.183 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.183 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:15580 5.8 5:11326ed0:::benchmark_data_smithi052_19421_object15579:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.183 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:39.004906+0000", 2024-04-26T10:21:39.183 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.095951007000000005, 2024-04-26T10:21:39.183 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.01204566, 2024-04-26T10:21:39.183 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.183 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.183 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:39.183 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:39.184 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.184 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 15580 2024-04-26T10:21:39.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.184 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.184 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.184 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.184 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.004906+0000", 2024-04-26T10:21:39.184 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.184 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.184 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.184 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.004906+0000", 2024-04-26T10:21:39.184 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.004905+0000", 2024-04-26T10:21:39.185 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.004938+0000", 2024-04-26T10:21:39.185 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.2539000000000001e-05 2024-04-26T10:21:39.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.185 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.185 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.185 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.004948+0000", 2024-04-26T10:21:39.185 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.0501e-05 2024-04-26T10:21:39.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.186 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.186 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.004952+0000", 2024-04-26T10:21:39.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.6669999999999998e-06 2024-04-26T10:21:39.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.186 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.186 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.004983+0000", 2024-04-26T10:21:39.186 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0874999999999998e-05 2024-04-26T10:21:39.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.186 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.187 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.005059+0000", 2024-04-26T10:21:39.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6155000000000005e-05 2024-04-26T10:21:39.187 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.187 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.005134+0000", 2024-04-26T10:21:39.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4742999999999999e-05 2024-04-26T10:21:39.187 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.187 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.187 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.006943+0000", 2024-04-26T10:21:39.187 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00180977 2024-04-26T10:21:39.187 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.187 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.016828+0000", 2024-04-26T10:21:39.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.009884571 2024-04-26T10:21:39.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.016910+0000", 2024-04-26T10:21:39.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.1588000000000006e-05 2024-04-26T10:21:39.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.188 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.188 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.188 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.016951+0000", 2024-04-26T10:21:39.188 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1650999999999998e-05 2024-04-26T10:21:39.188 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.188 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.189 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.189 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.189 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:15718 5.e 5:74de8e9a:::benchmark_data_smithi052_19421_object15717:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.189 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:39.059957+0000", 2024-04-26T10:21:39.189 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.040899554999999997, 2024-04-26T10:21:39.189 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.013253984, 2024-04-26T10:21:39.189 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.189 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.189 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:39.189 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:39.189 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.190 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 15718 2024-04-26T10:21:39.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.190 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.059957+0000", 2024-04-26T10:21:39.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.190 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.190 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.190 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.059957+0000", 2024-04-26T10:21:39.190 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.190 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.191 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.059956+0000", 2024-04-26T10:21:39.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.191 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.059991+0000", 2024-04-26T10:21:39.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.4272e-05 2024-04-26T10:21:39.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.191 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.191 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.191 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.060003+0000", 2024-04-26T10:21:39.191 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.2044e-05 2024-04-26T10:21:39.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.192 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.060008+0000", 2024-04-26T10:21:39.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.4500000000000003e-06 2024-04-26T10:21:39.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.192 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.062566+0000", 2024-04-26T10:21:39.192 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0025574299999999999 2024-04-26T10:21:39.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.192 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.192 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.192 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.062716+0000", 2024-04-26T10:21:39.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015014999999999999 2024-04-26T10:21:39.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.062895+0000", 2024-04-26T10:21:39.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000179166 2024-04-26T10:21:39.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.068156+0000", 2024-04-26T10:21:39.193 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0052614430000000002 2024-04-26T10:21:39.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.193 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.193 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.193 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.073121+0000", 2024-04-26T10:21:39.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0049648979999999997 2024-04-26T10:21:39.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.194 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.073170+0000", 2024-04-26T10:21:39.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.9082999999999997e-05 2024-04-26T10:21:39.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.194 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.194 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.194 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.073211+0000", 2024-04-26T10:21:39.194 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0626e-05 2024-04-26T10:21:39.194 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.194 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.194 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.195 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.195 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.195 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:15719 5.e 5:7137bc0e:::benchmark_data_smithi052_19421_object15718:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.195 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:39.060660+0000", 2024-04-26T10:21:39.195 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.040196039000000003, 2024-04-26T10:21:39.195 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012608607000000001, 2024-04-26T10:21:39.195 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.195 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.195 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:39.195 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:39.195 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.195 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 15719 2024-04-26T10:21:39.195 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.195 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.196 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.060660+0000", 2024-04-26T10:21:39.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.196 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.060660+0000", 2024-04-26T10:21:39.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.196 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.196 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.196 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.060660+0000", 2024-04-26T10:21:39.196 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.197 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.197 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.197 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.060787+0000", 2024-04-26T10:21:39.197 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000126802 2024-04-26T10:21:39.197 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.197 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.197 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.197 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.060806+0000", 2024-04-26T10:21:39.197 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 1.9079000000000001e-05 2024-04-26T10:21:39.197 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.197 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.197 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.197 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.060811+0000", 2024-04-26T10:21:39.197 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.6459999999999998e-06 2024-04-26T10:21:39.198 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.198 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.198 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.198 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.063807+0000", 2024-04-26T10:21:39.198 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0029961100000000002 2024-04-26T10:21:39.198 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.198 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.198 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.198 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.063958+0000", 2024-04-26T10:21:39.198 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00015013099999999999 2024-04-26T10:21:39.198 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.198 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.198 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.198 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.064097+0000", 2024-04-26T10:21:39.199 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000138949 2024-04-26T10:21:39.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.199 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.068192+0000", 2024-04-26T10:21:39.199 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0040951970000000001 2024-04-26T10:21:39.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.199 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.199 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.073217+0000", 2024-04-26T10:21:39.199 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.005025023 2024-04-26T10:21:39.199 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.199 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.199 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.073248+0000", 2024-04-26T10:21:39.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.0787000000000002e-05 2024-04-26T10:21:39.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.200 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.200 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.073269+0000", 2024-04-26T10:21:39.200 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.1594999999999999e-05 2024-04-26T10:21:39.200 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.200 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.200 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.200 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.200 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:15723 5.e 5:7d126c18:::benchmark_data_smithi052_19421_object15722:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.200 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:39.061747+0000", 2024-04-26T10:21:39.201 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.039109790999999998, 2024-04-26T10:21:39.201 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.011593166, 2024-04-26T10:21:39.201 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.201 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.201 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:39.201 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:39.201 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.201 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 15723 2024-04-26T10:21:39.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.201 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.201 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.201 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.201 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.061747+0000", 2024-04-26T10:21:39.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.202 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.202 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.061747+0000", 2024-04-26T10:21:39.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.202 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.202 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.202 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.061746+0000", 2024-04-26T10:21:39.202 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.061787+0000", 2024-04-26T10:21:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.1257999999999997e-05 2024-04-26T10:21:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.061796+0000", 2024-04-26T10:21:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.1260000000000004e-06 2024-04-26T10:21:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.061803+0000", 2024-04-26T10:21:39.203 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.5039999999999999e-06 2024-04-26T10:21:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.064809+0000", 2024-04-26T10:21:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003006253 2024-04-26T10:21:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.064883+0000", 2024-04-26T10:21:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.4214000000000005e-05 2024-04-26T10:21:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.064953+0000", 2024-04-26T10:21:39.204 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.9303999999999999e-05 2024-04-26T10:21:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.071997+0000", 2024-04-26T10:21:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0070447929999999997 2024-04-26T10:21:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.073274+0000", 2024-04-26T10:21:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0012760339999999999 2024-04-26T10:21:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.205 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.073303+0000", 2024-04-26T10:21:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.9232000000000001e-05 2024-04-26T10:21:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.073340+0000", 2024-04-26T10:21:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.7168000000000001e-05 2024-04-26T10:21:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:15724 5.e 5:7c235a0f:::benchmark_data_smithi052_19421_object15723:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.206 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:39.061807+0000", 2024-04-26T10:21:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.039049604000000002, 2024-04-26T10:21:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.012234243000000001, 2024-04-26T10:21:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 15724 2024-04-26T10:21:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.061807+0000", 2024-04-26T10:21:39.207 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.061807+0000", 2024-04-26T10:21:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.061807+0000", 2024-04-26T10:21:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.208 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.061830+0000", 2024-04-26T10:21:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 2.3842e-05 2024-04-26T10:21:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.061835+0000", 2024-04-26T10:21:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.3660000000000002e-06 2024-04-26T10:21:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.061839+0000", 2024-04-26T10:21:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 3.8290000000000001e-06 2024-04-26T10:21:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.068286+0000", 2024-04-26T10:21:39.209 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0064472310000000003 2024-04-26T10:21:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.068383+0000", 2024-04-26T10:21:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 9.7479000000000006e-05 2024-04-26T10:21:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.068473+0000", 2024-04-26T10:21:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.9418000000000003e-05 2024-04-26T10:21:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.210 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.072039+0000", 2024-04-26T10:21:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.003566119 2024-04-26T10:21:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.073924+0000", 2024-04-26T10:21:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018855059999999999 2024-04-26T10:21:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.073988+0000", 2024-04-26T10:21:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.3928000000000002e-05 2024-04-26T10:21:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.211 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.074041+0000", 2024-04-26T10:21:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 5.2899000000000003e-05 2024-04-26T10:21:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: "description": "osd_op(client.4722.0:15753 5.5 5:a7a165f1:::benchmark_data_smithi052_19421_object15752:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: "initiated_at": "2024-04-26T10:21:39.075616+0000", 2024-04-26T10:21:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: "age": 0.025240326, 2024-04-26T10:21:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.01083483, 2024-04-26T10:21:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: "type_data": { 2024-04-26T10:21:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.212 INFO:teuthology.orchestra.run.smithi164.stdout: "client_info": { 2024-04-26T10:21:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "client": "client.4722", 2024-04-26T10:21:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "tid": 15753 2024-04-26T10:21:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "events": [ 2024-04-26T10:21:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "initiated", 2024-04-26T10:21:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.075616+0000", 2024-04-26T10:21:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "throttled", 2024-04-26T10:21:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.075616+0000", 2024-04-26T10:21:39.213 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0 2024-04-26T10:21:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "header_read", 2024-04-26T10:21:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.075616+0000", 2024-04-26T10:21:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "all_read", 2024-04-26T10:21:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.075656+0000", 2024-04-26T10:21:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.0618000000000003e-05 2024-04-26T10:21:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "dispatched", 2024-04-26T10:21:39.214 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.075664+0000", 2024-04-26T10:21:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 8.2090000000000005e-06 2024-04-26T10:21:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.075671+0000", 2024-04-26T10:21:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 6.516e-06 2024-04-26T10:21:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "reached_pg", 2024-04-26T10:21:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.077545+0000", 2024-04-26T10:21:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0018736899999999999 2024-04-26T10:21:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.215 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "started", 2024-04-26T10:21:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.077687+0000", 2024-04-26T10:21:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.00014259599999999999 2024-04-26T10:21:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.077962+0000", 2024-04-26T10:21:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.000274448 2024-04-26T10:21:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "op_commit", 2024-04-26T10:21:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.081141+0000", 2024-04-26T10:21:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0031796580000000001 2024-04-26T10:21:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.216 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.086332+0000", 2024-04-26T10:21:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 0.0051904940000000004 2024-04-26T10:21:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "commit_sent", 2024-04-26T10:21:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.086409+0000", 2024-04-26T10:21:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 7.6933000000000004e-05 2024-04-26T10:21:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-04-26T10:21:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-04-26T10:21:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: "event": "done", 2024-04-26T10:21:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: "time": "2024-04-26T10:21:39.086451+0000", 2024-04-26T10:21:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: "duration": 4.2299999999999998e-05 2024-04-26T10:21:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.217 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.218 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-04-26T10:21:39.218 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-04-26T10:21:39.218 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T10:21:39.219 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:39.220 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:39.216+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:39.320 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:39.316+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:39.351 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:16494 5.d 5:bc40efd8:::benchmark_data_smithi052_19421_object16493:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:39.346058+0000", 2024-04-26T10:21:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0038770279999999998, 2024-04-26T10:21:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039036959999999999, 2024-04-26T10:21:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:39.351 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 16494 2024-04-26T10:21:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.346058+0000", 2024-04-26T10:21:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.346058+0000", 2024-04-26T10:21:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.346056+0000", 2024-04-26T10:21:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.346157+0000", 2024-04-26T10:21:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100183 2024-04-26T10:21:39.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.346178+0000", 2024-04-26T10:21:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1781999999999999e-05 2024-04-26T10:21:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.346196+0000", 2024-04-26T10:21:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7343999999999999e-05 2024-04-26T10:21:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.346251+0000", 2024-04-26T10:21:39.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5509e-05 2024-04-26T10:21:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.346493+0000", 2024-04-26T10:21:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000241425 2024-04-26T10:21:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.346676+0000", 2024-04-26T10:21:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018358099999999999 2024-04-26T10:21:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.347988+0000", 2024-04-26T10:21:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013119200000000001 2024-04-26T10:21:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:16490 5.3 e26/22 5:c44543bf:::benchmark_data_smithi052_19421_object16489:head v 26'1028, mlcod=26'1024)", 2024-04-26T10:21:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:39.348325+0000", 2024-04-26T10:21:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001609559, 2024-04-26T10:21:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017232899999999999, 2024-04-26T10:21:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:39.356 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.348325+0000", 2024-04-26T10:21:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.348325+0000", 2024-04-26T10:21:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.348325+0000", 2024-04-26T10:21:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.348393+0000", 2024-04-26T10:21:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8703999999999998e-05 2024-04-26T10:21:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.348399+0000", 2024-04-26T10:21:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6400000000000002e-06 2024-04-26T10:21:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.348403+0000", 2024-04-26T10:21:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6480000000000001e-06 2024-04-26T10:21:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.348442+0000", 2024-04-26T10:21:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9008999999999999e-05 2024-04-26T10:21:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.348459+0000", 2024-04-26T10:21:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7708999999999999e-05 2024-04-26T10:21:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.359 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.360 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:21:39.360 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 2 2024-04-26T10:21:39.360 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:39.363 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:39.421 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:39.417+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:39.490 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:39.491 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:21:39.491 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:21:39.491 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:21:39.491 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:39.503 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:39.521 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:39.517+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:39.572 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:21:39.613 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 6 16 17225 17209 179.242 167.438 0.00506858 0.00557156 2024-04-26T10:21:39.622 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:39.616+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:39.632 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:39.632 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:21:39.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:21:39.632 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:39.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.632 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:39.632 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:39.632 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 37.390421998000001, 2024-04-26T10:21:39.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015326892, 2024-04-26T10:21:39.632 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.633 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:39.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:39.633 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 112 2024-04-26T10:21:39.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.633 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:39.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:39.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238644+0000", 2024-04-26T10:21:39.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238792+0000", 2024-04-26T10:21:39.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775699999999999 2024-04-26T10:21:39.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238811+0000", 2024-04-26T10:21:39.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8359000000000002e-05 2024-04-26T10:21:39.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238887+0000", 2024-04-26T10:21:39.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6909000000000005e-05 2024-04-26T10:21:39.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248433+0000", 2024-04-26T10:21:39.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095455650000000006 2024-04-26T10:21:39.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248564+0000", 2024-04-26T10:21:39.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131273 2024-04-26T10:21:39.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248795+0000", 2024-04-26T10:21:39.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023073500000000001 2024-04-26T10:21:39.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251497+0000", 2024-04-26T10:21:39.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002701976 2024-04-26T10:21:39.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253894+0000", 2024-04-26T10:21:39.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023967429999999998 2024-04-26T10:21:39.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253937+0000", 2024-04-26T10:21:39.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3006999999999997e-05 2024-04-26T10:21:39.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253972+0000", 2024-04-26T10:21:39.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5388000000000001e-05 2024-04-26T10:21:39.638 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.638 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.638 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.638 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:39.638 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:39.638 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 37.390168099999997, 2024-04-26T10:21:39.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016304328, 2024-04-26T10:21:39.639 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.639 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:39.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:39.639 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113 2024-04-26T10:21:39.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.639 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:39.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:39.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238898+0000", 2024-04-26T10:21:39.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238920+0000", 2024-04-26T10:21:39.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2056999999999999e-05 2024-04-26T10:21:39.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238937+0000", 2024-04-26T10:21:39.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6415000000000001e-05 2024-04-26T10:21:39.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238948+0000", 2024-04-26T10:21:39.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.11e-05 2024-04-26T10:21:39.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250527+0000", 2024-04-26T10:21:39.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011578662 2024-04-26T10:21:39.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250627+0000", 2024-04-26T10:21:39.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100418 2024-04-26T10:21:39.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250769+0000", 2024-04-26T10:21:39.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142111 2024-04-26T10:21:39.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253884+0000", 2024-04-26T10:21:39.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031148399999999998 2024-04-26T10:21:39.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254994+0000", 2024-04-26T10:21:39.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011095720000000001 2024-04-26T10:21:39.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255094+0000", 2024-04-26T10:21:39.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010092 2024-04-26T10:21:39.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255203+0000", 2024-04-26T10:21:39.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010906 2024-04-26T10:21:39.646 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.646 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.647 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.647 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:39.647 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:39.647 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 37.390110565000001, 2024-04-26T10:21:39.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016378984999999999, 2024-04-26T10:21:39.647 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.647 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:39.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:39.647 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 114 2024-04-26T10:21:39.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.648 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:39.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:39.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238956+0000", 2024-04-26T10:21:39.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238965+0000", 2024-04-26T10:21:39.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9469999999999992e-06 2024-04-26T10:21:39.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238993+0000", 2024-04-26T10:21:39.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8296000000000001e-05 2024-04-26T10:21:39.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239004+0000", 2024-04-26T10:21:39.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0482999999999999e-05 2024-04-26T10:21:39.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251532+0000", 2024-04-26T10:21:39.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01252852 2024-04-26T10:21:39.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251622+0000", 2024-04-26T10:21:39.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0044999999999996e-05 2024-04-26T10:21:39.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251763+0000", 2024-04-26T10:21:39.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140634 2024-04-26T10:21:39.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254035+0000", 2024-04-26T10:21:39.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022721320000000001 2024-04-26T10:21:39.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255220+0000", 2024-04-26T10:21:39.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011853059999999999 2024-04-26T10:21:39.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255301+0000", 2024-04-26T10:21:39.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0253999999999994e-05 2024-04-26T10:21:39.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255336+0000", 2024-04-26T10:21:39.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5098000000000002e-05 2024-04-26T10:21:39.653 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.653 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.653 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.653 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:39.654 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:39.654 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 37.390048616000001, 2024-04-26T10:21:39.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018452342, 2024-04-26T10:21:39.654 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.654 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.654 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.654 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:39.654 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:39.654 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115 2024-04-26T10:21:39.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.655 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:39.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:39.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239018+0000", 2024-04-26T10:21:39.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239152+0000", 2024-04-26T10:21:39.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414699999999999 2024-04-26T10:21:39.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239169+0000", 2024-04-26T10:21:39.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7013000000000001e-05 2024-04-26T10:21:39.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239190+0000", 2024-04-26T10:21:39.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1302999999999999e-05 2024-04-26T10:21:39.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252181+0000", 2024-04-26T10:21:39.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012990213 2024-04-26T10:21:39.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252411+0000", 2024-04-26T10:21:39.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023010199999999999 2024-04-26T10:21:39.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252687+0000", 2024-04-26T10:21:39.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000276063 2024-04-26T10:21:39.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254694+0000", 2024-04-26T10:21:39.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020072879999999999 2024-04-26T10:21:39.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257399+0000", 2024-04-26T10:21:39.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027051670000000001 2024-04-26T10:21:39.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257442+0000", 2024-04-26T10:21:39.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-04-26T10:21:39.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257471+0000", 2024-04-26T10:21:39.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.889e-05 2024-04-26T10:21:39.659 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.659 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.659 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.660 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:39.660 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:39.660 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 37.389868086999996, 2024-04-26T10:21:39.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018350615000000001, 2024-04-26T10:21:39.660 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.660 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.660 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.660 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:39.660 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:39.660 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116 2024-04-26T10:21:39.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.661 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:39.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:39.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239198+0000", 2024-04-26T10:21:39.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239213+0000", 2024-04-26T10:21:39.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4965e-05 2024-04-26T10:21:39.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239235+0000", 2024-04-26T10:21:39.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.156e-05 2024-04-26T10:21:39.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239243+0000", 2024-04-26T10:21:39.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9470000000000003e-06 2024-04-26T10:21:39.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253284+0000", 2024-04-26T10:21:39.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014041392999999999 2024-04-26T10:21:39.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253376+0000", 2024-04-26T10:21:39.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1198000000000003e-05 2024-04-26T10:21:39.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253508+0000", 2024-04-26T10:21:39.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013220199999999999 2024-04-26T10:21:39.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255474+0000", 2024-04-26T10:21:39.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019665590000000001 2024-04-26T10:21:39.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257480+0000", 2024-04-26T10:21:39.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00200599 2024-04-26T10:21:39.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257515+0000", 2024-04-26T10:21:39.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5126000000000002e-05 2024-04-26T10:21:39.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257550+0000", 2024-04-26T10:21:39.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4394000000000003e-05 2024-04-26T10:21:39.665 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.665 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.665 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.666 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:39.666 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:39.666 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 37.389814530999999, 2024-04-26T10:21:39.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018369330999999999, 2024-04-26T10:21:39.666 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.666 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.666 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.666 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:39.666 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:39.666 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117 2024-04-26T10:21:39.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.666 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:39.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:39.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239252+0000", 2024-04-26T10:21:39.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239267+0000", 2024-04-26T10:21:39.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4562999999999999e-05 2024-04-26T10:21:39.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239281+0000", 2024-04-26T10:21:39.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4e-05 2024-04-26T10:21:39.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239296+0000", 2024-04-26T10:21:39.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5492999999999999e-05 2024-04-26T10:21:39.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254076+0000", 2024-04-26T10:21:39.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014779814 2024-04-26T10:21:39.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254159+0000", 2024-04-26T10:21:39.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2923999999999994e-05 2024-04-26T10:21:39.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254279+0000", 2024-04-26T10:21:39.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011964300000000001 2024-04-26T10:21:39.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.256043+0000", 2024-04-26T10:21:39.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001764353 2024-04-26T10:21:39.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257559+0000", 2024-04-26T10:21:39.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015159189999999999 2024-04-26T10:21:39.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257597+0000", 2024-04-26T10:21:39.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8031999999999998e-05 2024-04-26T10:21:39.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257622+0000", 2024-04-26T10:21:39.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5213999999999999e-05 2024-04-26T10:21:39.671 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.671 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.671 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.672 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:39.672 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:39.672 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 37.177710155, 2024-04-26T10:21:39.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015980181999999999, 2024-04-26T10:21:39.672 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.672 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:39.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:39.672 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 141 2024-04-26T10:21:39.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.672 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:39.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:39.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451356+0000", 2024-04-26T10:21:39.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451362+0000", 2024-04-26T10:21:39.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:21:39.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451371+0000", 2024-04-26T10:21:39.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1829999999999994e-06 2024-04-26T10:21:39.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451377+0000", 2024-04-26T10:21:39.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7599999999999997e-06 2024-04-26T10:21:39.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463727+0000", 2024-04-26T10:21:39.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012349646000000001 2024-04-26T10:21:39.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463780+0000", 2024-04-26T10:21:39.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2645999999999997e-05 2024-04-26T10:21:39.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463874+0000", 2024-04-26T10:21:39.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4097000000000004e-05 2024-04-26T10:21:39.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.466138+0000", 2024-04-26T10:21:39.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022642690000000002 2024-04-26T10:21:39.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467281+0000", 2024-04-26T10:21:39.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011428510000000001 2024-04-26T10:21:39.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467315+0000", 2024-04-26T10:21:39.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4032999999999998e-05 2024-04-26T10:21:39.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467337+0000", 2024-04-26T10:21:39.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2444000000000001e-05 2024-04-26T10:21:39.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.677 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.677 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:39.678 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:39.678 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.979261584, 2024-04-26T10:21:39.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015587541, 2024-04-26T10:21:39.678 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.678 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.678 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.678 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:39.678 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:39.678 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 163 2024-04-26T10:21:39.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.678 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:39.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:39.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649805+0000", 2024-04-26T10:21:39.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649813+0000", 2024-04-26T10:21:39.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3319999999999992e-06 2024-04-26T10:21:39.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649851+0000", 2024-04-26T10:21:39.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7852999999999998e-05 2024-04-26T10:21:39.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649865+0000", 2024-04-26T10:21:39.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3626e-05 2024-04-26T10:21:39.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662071+0000", 2024-04-26T10:21:39.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01220689 2024-04-26T10:21:39.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662210+0000", 2024-04-26T10:21:39.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013893 2024-04-26T10:21:39.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662397+0000", 2024-04-26T10:21:39.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018690499999999999 2024-04-26T10:21:39.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664685+0000", 2024-04-26T10:21:39.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022876179999999999 2024-04-26T10:21:39.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665327+0000", 2024-04-26T10:21:39.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00064178900000000003 2024-04-26T10:21:39.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665365+0000", 2024-04-26T10:21:39.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8244999999999997e-05 2024-04-26T10:21:39.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665393+0000", 2024-04-26T10:21:39.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8232e-05 2024-04-26T10:21:39.683 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.683 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.683 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.683 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:39.684 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:39.684 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.979186937999998, 2024-04-26T10:21:39.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016970263999999999, 2024-04-26T10:21:39.684 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.684 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.684 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.684 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:39.684 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:39.684 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 164 2024-04-26T10:21:39.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.684 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:39.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:39.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649879+0000", 2024-04-26T10:21:39.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649963+0000", 2024-04-26T10:21:39.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4141999999999995e-05 2024-04-26T10:21:39.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649975+0000", 2024-04-26T10:21:39.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1416e-05 2024-04-26T10:21:39.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649983+0000", 2024-04-26T10:21:39.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8469999999999996e-06 2024-04-26T10:21:39.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662854+0000", 2024-04-26T10:21:39.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012871871999999999 2024-04-26T10:21:39.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662965+0000", 2024-04-26T10:21:39.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110413 2024-04-26T10:21:39.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.663109+0000", 2024-04-26T10:21:39.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144115 2024-04-26T10:21:39.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665992+0000", 2024-04-26T10:21:39.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028827340000000001 2024-04-26T10:21:39.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666784+0000", 2024-04-26T10:21:39.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00079253799999999997 2024-04-26T10:21:39.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666824+0000", 2024-04-26T10:21:39.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0139000000000003e-05 2024-04-26T10:21:39.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666851+0000", 2024-04-26T10:21:39.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6171999999999999e-05 2024-04-26T10:21:39.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.689 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.689 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:39.689 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:39.690 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.979075858000002, 2024-04-26T10:21:39.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019547338000000001, 2024-04-26T10:21:39.690 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.690 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:39.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:39.690 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165 2024-04-26T10:21:39.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.690 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:39.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:39.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:39.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649996+0000", 2024-04-26T10:21:39.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-04-26T10:21:39.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650021+0000", 2024-04-26T10:21:39.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5179999999999999e-05 2024-04-26T10:21:39.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650030+0000", 2024-04-26T10:21:39.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-04-26T10:21:39.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664733+0000", 2024-04-26T10:21:39.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014703097 2024-04-26T10:21:39.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664821+0000", 2024-04-26T10:21:39.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7918999999999996e-05 2024-04-26T10:21:39.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664953+0000", 2024-04-26T10:21:39.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132662 2024-04-26T10:21:39.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666776+0000", 2024-04-26T10:21:39.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018225509999999999 2024-04-26T10:21:39.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669480+0000", 2024-04-26T10:21:39.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00270382 2024-04-26T10:21:39.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669515+0000", 2024-04-26T10:21:39.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4885000000000002e-05 2024-04-26T10:21:39.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669539+0000", 2024-04-26T10:21:39.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4121000000000002e-05 2024-04-26T10:21:39.695 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.695 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.695 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.695 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:39.695 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:39.695 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.789581777999999, 2024-04-26T10:21:39.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015260631, 2024-04-26T10:21:39.696 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.696 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:39.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:39.696 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 184 2024-04-26T10:21:39.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.696 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:39.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:39.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:39.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839493+0000", 2024-04-26T10:21:39.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7300000000000005e-06 2024-04-26T10:21:39.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839501+0000", 2024-04-26T10:21:39.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2940000000000006e-06 2024-04-26T10:21:39.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839508+0000", 2024-04-26T10:21:39.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6660000000000002e-06 2024-04-26T10:21:39.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.849315+0000", 2024-04-26T10:21:39.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098072650000000008 2024-04-26T10:21:39.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.849564+0000", 2024-04-26T10:21:39.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024928800000000002 2024-04-26T10:21:39.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.849772+0000", 2024-04-26T10:21:39.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020795199999999999 2024-04-26T10:21:39.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853646+0000", 2024-04-26T10:21:39.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038744090000000001 2024-04-26T10:21:39.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854530+0000", 2024-04-26T10:21:39.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00088391200000000004 2024-04-26T10:21:39.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854623+0000", 2024-04-26T10:21:39.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2229000000000001e-05 2024-04-26T10:21:39.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854746+0000", 2024-04-26T10:21:39.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012354299999999999 2024-04-26T10:21:39.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.701 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.702 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:39.702 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:39.702 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.789552749000002, 2024-04-26T10:21:39.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017833541000000001, 2024-04-26T10:21:39.702 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.702 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:39.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:39.702 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185 2024-04-26T10:21:39.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.703 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:39.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:39.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839514+0000", 2024-04-26T10:21:39.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839612+0000", 2024-04-26T10:21:39.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7880999999999993e-05 2024-04-26T10:21:39.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839623+0000", 2024-04-26T10:21:39.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0917000000000001e-05 2024-04-26T10:21:39.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839632+0000", 2024-04-26T10:21:39.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0999999999999993e-06 2024-04-26T10:21:39.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850382+0000", 2024-04-26T10:21:39.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010750335 2024-04-26T10:21:39.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850502+0000", 2024-04-26T10:21:39.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120183 2024-04-26T10:21:39.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850685+0000", 2024-04-26T10:21:39.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000182442 2024-04-26T10:21:39.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854396+0000", 2024-04-26T10:21:39.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037114819999999999 2024-04-26T10:21:39.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857233+0000", 2024-04-26T10:21:39.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002836514 2024-04-26T10:21:39.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857300+0000", 2024-04-26T10:21:39.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6842999999999997e-05 2024-04-26T10:21:39.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857348+0000", 2024-04-26T10:21:39.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8504000000000002e-05 2024-04-26T10:21:39.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.707 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.708 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:39.708 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:39.708 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.789426398000003, 2024-04-26T10:21:39.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018757273000000001, 2024-04-26T10:21:39.708 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.708 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:39.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:39.708 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 186 2024-04-26T10:21:39.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.708 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:39.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:39.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839640+0000", 2024-04-26T10:21:39.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839646+0000", 2024-04-26T10:21:39.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:21:39.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839654+0000", 2024-04-26T10:21:39.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:21:39.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839661+0000", 2024-04-26T10:21:39.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.64e-06 2024-04-26T10:21:39.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852328+0000", 2024-04-26T10:21:39.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012667151 2024-04-26T10:21:39.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852538+0000", 2024-04-26T10:21:39.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020961100000000001 2024-04-26T10:21:39.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852945+0000", 2024-04-26T10:21:39.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040712099999999998 2024-04-26T10:21:39.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857372+0000", 2024-04-26T10:21:39.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044268049999999998 2024-04-26T10:21:39.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858321+0000", 2024-04-26T10:21:39.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094932999999999997 2024-04-26T10:21:39.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858367+0000", 2024-04-26T10:21:39.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5534000000000001e-05 2024-04-26T10:21:39.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858398+0000", 2024-04-26T10:21:39.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1562e-05 2024-04-26T10:21:39.713 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.713 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.713 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.714 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:39.714 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:39.714 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.789399232000001, 2024-04-26T10:21:39.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019669504000000001, 2024-04-26T10:21:39.714 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.714 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.714 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.714 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:39.714 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:39.714 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187 2024-04-26T10:21:39.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.714 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:39.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:39.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839667+0000", 2024-04-26T10:21:39.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839677+0000", 2024-04-26T10:21:39.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3270000000000007e-06 2024-04-26T10:21:39.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839685+0000", 2024-04-26T10:21:39.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2670000000000006e-06 2024-04-26T10:21:39.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839692+0000", 2024-04-26T10:21:39.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7129999999999999e-06 2024-04-26T10:21:39.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853685+0000", 2024-04-26T10:21:39.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013993716999999999 2024-04-26T10:21:39.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853876+0000", 2024-04-26T10:21:39.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019097100000000001 2024-04-26T10:21:39.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853989+0000", 2024-04-26T10:21:39.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011275199999999999 2024-04-26T10:21:39.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857377+0000", 2024-04-26T10:21:39.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033882489999999999 2024-04-26T10:21:39.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859222+0000", 2024-04-26T10:21:39.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001844233 2024-04-26T10:21:39.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859291+0000", 2024-04-26T10:21:39.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:21:39.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859338+0000", 2024-04-26T10:21:39.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6366000000000003e-05 2024-04-26T10:21:39.719 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.719 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.719 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.720 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:39.720 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:39.720 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.789368365999998, 2024-04-26T10:21:39.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019837468, 2024-04-26T10:21:39.720 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.720 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:39.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:39.720 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 188 2024-04-26T10:21:39.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.720 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:39.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:39.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839698+0000", 2024-04-26T10:21:39.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839829+0000", 2024-04-26T10:21:39.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013061099999999999 2024-04-26T10:21:39.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839853+0000", 2024-04-26T10:21:39.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3736000000000001e-05 2024-04-26T10:21:39.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839863+0000", 2024-04-26T10:21:39.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:39.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854869+0000", 2024-04-26T10:21:39.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015005978 2024-04-26T10:21:39.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854959+0000", 2024-04-26T10:21:39.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9468999999999993e-05 2024-04-26T10:21:39.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855114+0000", 2024-04-26T10:21:39.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015563799999999999 2024-04-26T10:21:39.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857386+0000", 2024-04-26T10:21:39.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002271852 2024-04-26T10:21:39.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859406+0000", 2024-04-26T10:21:39.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002019936 2024-04-26T10:21:39.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859461+0000", 2024-04-26T10:21:39.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4826e-05 2024-04-26T10:21:39.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859536+0000", 2024-04-26T10:21:39.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5566000000000001e-05 2024-04-26T10:21:39.725 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.725 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.725 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.726 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:39.726 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:39.726 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.789194502999997, 2024-04-26T10:21:39.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019826496999999998, 2024-04-26T10:21:39.726 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.726 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.726 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.726 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:39.726 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:39.726 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 189 2024-04-26T10:21:39.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.726 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:39.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:39.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839872+0000", 2024-04-26T10:21:39.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839882+0000", 2024-04-26T10:21:39.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:39.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839892+0000", 2024-04-26T10:21:39.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.217e-06 2024-04-26T10:21:39.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839900+0000", 2024-04-26T10:21:39.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5469999999999997e-06 2024-04-26T10:21:39.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855903+0000", 2024-04-26T10:21:39.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016002590000000001 2024-04-26T10:21:39.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856110+0000", 2024-04-26T10:21:39.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020711199999999999 2024-04-26T10:21:39.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856421+0000", 2024-04-26T10:21:39.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031128500000000001 2024-04-26T10:21:39.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857643+0000", 2024-04-26T10:21:39.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012215520000000001 2024-04-26T10:21:39.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859603+0000", 2024-04-26T10:21:39.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019600350000000002 2024-04-26T10:21:39.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859660+0000", 2024-04-26T10:21:39.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6857999999999997e-05 2024-04-26T10:21:39.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859699+0000", 2024-04-26T10:21:39.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9641999999999998e-05 2024-04-26T10:21:39.731 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.731 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.731 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.731 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15562 5.f 5:f08fe41e:::benchmark_data_smithi052_19421_object15561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.732 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:39.732 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.63617887299999998, 2024-04-26T10:21:39.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015831088, 2024-04-26T10:21:39.732 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.732 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:39.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.732 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15562 2024-04-26T10:21:39.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.732 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:39.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:39.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:39.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992927+0000", 2024-04-26T10:21:39.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9285000000000001e-05 2024-04-26T10:21:39.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992940+0000", 2024-04-26T10:21:39.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3040999999999999e-05 2024-04-26T10:21:39.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992948+0000", 2024-04-26T10:21:39.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5850000000000002e-06 2024-04-26T10:21:39.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.997631+0000", 2024-04-26T10:21:39.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046834160000000001 2024-04-26T10:21:39.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.997851+0000", 2024-04-26T10:21:39.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000220416 2024-04-26T10:21:39.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.998105+0000", 2024-04-26T10:21:39.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025348599999999998 2024-04-26T10:21:39.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.004264+0000", 2024-04-26T10:21:39.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061588499999999996 2024-04-26T10:21:39.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008560+0000", 2024-04-26T10:21:39.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042958579999999996 2024-04-26T10:21:39.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008647+0000", 2024-04-26T10:21:39.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7609999999999996e-05 2024-04-26T10:21:39.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008719+0000", 2024-04-26T10:21:39.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2336000000000007e-05 2024-04-26T10:21:39.737 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.738 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.738 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.738 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15563 5.f 5:f98d3bb0:::benchmark_data_smithi052_19421_object15562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.738 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.993442+0000", 2024-04-26T10:21:39.738 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.63562488100000003, 2024-04-26T10:21:39.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015592195999999999, 2024-04-26T10:21:39.738 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.738 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.738 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.738 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:39.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.739 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15563 2024-04-26T10:21:39.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.739 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993442+0000", 2024-04-26T10:21:39.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993442+0000", 2024-04-26T10:21:39.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993441+0000", 2024-04-26T10:21:39.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993494+0000", 2024-04-26T10:21:39.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2369e-05 2024-04-26T10:21:39.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993515+0000", 2024-04-26T10:21:39.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1274e-05 2024-04-26T10:21:39.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993528+0000", 2024-04-26T10:21:39.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2858e-05 2024-04-26T10:21:39.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.000547+0000", 2024-04-26T10:21:39.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070196010000000003 2024-04-26T10:21:39.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.000660+0000", 2024-04-26T10:21:39.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112273 2024-04-26T10:21:39.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.000757+0000", 2024-04-26T10:21:39.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6965000000000004e-05 2024-04-26T10:21:39.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.006425+0000", 2024-04-26T10:21:39.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056687639999999997 2024-04-26T10:21:39.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008907+0000", 2024-04-26T10:21:39.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024819289999999999 2024-04-26T10:21:39.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008993+0000", 2024-04-26T10:21:39.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5426999999999994e-05 2024-04-26T10:21:39.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.009035+0000", 2024-04-26T10:21:39.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1912000000000001e-05 2024-04-26T10:21:39.744 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.744 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.744 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.744 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15564 5.f 5:f61b0088:::benchmark_data_smithi052_19421_object15563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.744 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:39.744 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.63467685200000001, 2024-04-26T10:21:39.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017729826000000001, 2024-04-26T10:21:39.745 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.745 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.745 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.745 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:39.745 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.745 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15564 2024-04-26T10:21:39.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.745 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:39.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:39.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994389+0000", 2024-04-26T10:21:39.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994451+0000", 2024-04-26T10:21:39.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2032999999999994e-05 2024-04-26T10:21:39.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994477+0000", 2024-04-26T10:21:39.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5267999999999999e-05 2024-04-26T10:21:39.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994486+0000", 2024-04-26T10:21:39.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9420000000000001e-06 2024-04-26T10:21:39.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001578+0000", 2024-04-26T10:21:39.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070928110000000001 2024-04-26T10:21:39.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001748+0000", 2024-04-26T10:21:39.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016944099999999999 2024-04-26T10:21:39.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001914+0000", 2024-04-26T10:21:39.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000166546 2024-04-26T10:21:39.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.006488+0000", 2024-04-26T10:21:39.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045735460000000004 2024-04-26T10:21:39.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012034+0000", 2024-04-26T10:21:39.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055461449999999997 2024-04-26T10:21:39.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012085+0000", 2024-04-26T10:21:39.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1319000000000001e-05 2024-04-26T10:21:39.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012120+0000", 2024-04-26T10:21:39.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4904999999999999e-05 2024-04-26T10:21:39.750 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.750 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.750 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.751 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15567 5.f 5:f5b92a5d:::benchmark_data_smithi052_19421_object15566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:39.751 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.996077+0000", 2024-04-26T10:21:39.751 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.632990414, 2024-04-26T10:21:39.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016208895000000001, 2024-04-26T10:21:39.751 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:39.751 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:39.751 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:39.751 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:39.751 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:39.751 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15567 2024-04-26T10:21:39.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.751 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:39.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:39.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996077+0000", 2024-04-26T10:21:39.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:39.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996077+0000", 2024-04-26T10:21:39.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:39.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:39.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996076+0000", 2024-04-26T10:21:39.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:39.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:39.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996139+0000", 2024-04-26T10:21:39.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2929999999999995e-05 2024-04-26T10:21:39.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:39.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996155+0000", 2024-04-26T10:21:39.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6076e-05 2024-04-26T10:21:39.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996163+0000", 2024-04-26T10:21:39.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0320000000000003e-06 2024-04-26T10:21:39.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:39.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.002727+0000", 2024-04-26T10:21:39.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065644240000000001 2024-04-26T10:21:39.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:39.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.002901+0000", 2024-04-26T10:21:39.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017414899999999999 2024-04-26T10:21:39.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:39.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.003080+0000", 2024-04-26T10:21:39.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017905199999999999 2024-04-26T10:21:39.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:39.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.009066+0000", 2024-04-26T10:21:39.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059855309999999997 2024-04-26T10:21:39.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:39.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012182+0000", 2024-04-26T10:21:39.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003116462 2024-04-26T10:21:39.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:39.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012230+0000", 2024-04-26T10:21:39.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7681e-05 2024-04-26T10:21:39.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:39.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:39.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:39.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012286+0000", 2024-04-26T10:21:39.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5763999999999997e-05 2024-04-26T10:21:39.756 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.756 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.756 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.757 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:39.757 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:39.757 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:39.758 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:39.756+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:39.759 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:39.860 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:39.857+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:39.882 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:39.883 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:39.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.883 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17901 5.a e26/22 5:595786d7:::benchmark_data_smithi052_19421_object17900:head v 26'1166, mlcod=26'1162)", 2024-04-26T10:21:39.883 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.880193+0000", 2024-04-26T10:21:39.883 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0020394089999999998, 2024-04-26T10:21:39.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020592589999999999, 2024-04-26T10:21:39.883 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:39.883 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:39.883 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:39.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:39.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.880193+0000", 2024-04-26T10:21:39.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:39.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:39.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.880193+0000", 2024-04-26T10:21:39.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:39.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:39.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.880193+0000", 2024-04-26T10:21:39.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:39.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.880271+0000", 2024-04-26T10:21:39.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8498999999999995e-05 2024-04-26T10:21:39.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:39.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.880287+0000", 2024-04-26T10:21:39.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6121e-05 2024-04-26T10:21:39.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.880294+0000", 2024-04-26T10:21:39.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2200000000000003e-06 2024-04-26T10:21:39.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:39.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.880341+0000", 2024-04-26T10:21:39.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6842999999999999e-05 2024-04-26T10:21:39.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.887 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:39.887 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.880360+0000", 2024-04-26T10:21:39.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8751000000000001e-05 2024-04-26T10:21:39.887 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:39.887 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:39.887 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:39.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.888 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17903 5.8 e26/22 5:159568f3:::benchmark_data_smithi052_19421_object17902:head v 26'1143, mlcod=26'1139)", 2024-04-26T10:21:39.888 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.881800+0000", 2024-04-26T10:21:39.888 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00043304699999999999, 2024-04-26T10:21:39.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050842599999999997, 2024-04-26T10:21:39.888 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:39.888 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:39.888 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:39.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:39.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.881800+0000", 2024-04-26T10:21:39.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:39.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:39.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.881800+0000", 2024-04-26T10:21:39.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:39.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:39.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.881799+0000", 2024-04-26T10:21:39.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:39.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.881860+0000", 2024-04-26T10:21:39.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0770999999999998e-05 2024-04-26T10:21:39.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:39.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.881870+0000", 2024-04-26T10:21:39.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0565e-05 2024-04-26T10:21:39.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.881876+0000", 2024-04-26T10:21:39.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1479999999999997e-06 2024-04-26T10:21:39.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:39.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.881929+0000", 2024-04-26T10:21:39.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3159999999999999e-05 2024-04-26T10:21:39.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:39.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.881958+0000", 2024-04-26T10:21:39.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8975e-05 2024-04-26T10:21:39.893 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:39.893 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:39.893 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:39.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.894 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17904 5.a e26/22 5:5f579d58:::benchmark_data_smithi052_19421_object17903:head v 26'1167, mlcod=26'1163)", 2024-04-26T10:21:39.894 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.881930+0000", 2024-04-26T10:21:39.894 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00030257299999999999, 2024-04-26T10:21:39.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00044481700000000002, 2024-04-26T10:21:39.894 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:39.894 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:39.894 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:39.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:39.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.881930+0000", 2024-04-26T10:21:39.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:39.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:39.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.881930+0000", 2024-04-26T10:21:39.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:39.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:39.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.881930+0000", 2024-04-26T10:21:39.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:39.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.882003+0000", 2024-04-26T10:21:39.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2947000000000005e-05 2024-04-26T10:21:39.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:39.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.882026+0000", 2024-04-26T10:21:39.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3400999999999998e-05 2024-04-26T10:21:39.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.882034+0000", 2024-04-26T10:21:39.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2430000000000005e-06 2024-04-26T10:21:39.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:39.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.882080+0000", 2024-04-26T10:21:39.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6251000000000002e-05 2024-04-26T10:21:39.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:39.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.882100+0000", 2024-04-26T10:21:39.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9150000000000001e-05 2024-04-26T10:21:39.897 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:39.897 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:39.898 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:39.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.898 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17893 5.a e26/22 5:59d4cba1:::benchmark_data_smithi052_19421_object17892:head v 26'1165, mlcod=26'1162)", 2024-04-26T10:21:39.898 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.878823+0000", 2024-04-26T10:21:39.898 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0034096270000000001, 2024-04-26T10:21:39.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036166589999999999, 2024-04-26T10:21:39.898 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:39.898 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:39.898 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:39.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:39.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.878823+0000", 2024-04-26T10:21:39.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:39.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:39.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.878823+0000", 2024-04-26T10:21:39.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:39.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:39.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.878822+0000", 2024-04-26T10:21:39.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:39.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.878868+0000", 2024-04-26T10:21:39.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5772999999999997e-05 2024-04-26T10:21:39.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:39.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.878883+0000", 2024-04-26T10:21:39.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4999e-05 2024-04-26T10:21:39.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.878889+0000", 2024-04-26T10:21:39.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5760000000000002e-06 2024-04-26T10:21:39.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:39.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.878929+0000", 2024-04-26T10:21:39.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9211000000000001e-05 2024-04-26T10:21:39.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:39.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.878949+0000", 2024-04-26T10:21:39.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0356999999999998e-05 2024-04-26T10:21:39.902 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:39.902 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:39.902 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:39.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.902 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17895 5.8 e26/22 5:182b455f:::benchmark_data_smithi052_19421_object17894:head v 26'1141, mlcod=26'1139)", 2024-04-26T10:21:39.902 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.878969+0000", 2024-04-26T10:21:39.902 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0032633800000000002, 2024-04-26T10:21:39.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003536202, 2024-04-26T10:21:39.903 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:39.903 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:39.903 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:39.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:39.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.878969+0000", 2024-04-26T10:21:39.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:39.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:39.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.878969+0000", 2024-04-26T10:21:39.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:39.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:39.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.878969+0000", 2024-04-26T10:21:39.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:39.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:39.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.878999+0000", 2024-04-26T10:21:39.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0218000000000001e-05 2024-04-26T10:21:39.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:39.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.879004+0000", 2024-04-26T10:21:39.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7879999999999997e-06 2024-04-26T10:21:39.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.879008+0000", 2024-04-26T10:21:39.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6449999999999998e-06 2024-04-26T10:21:39.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:39.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.879050+0000", 2024-04-26T10:21:39.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2743000000000001e-05 2024-04-26T10:21:39.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:39.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.879073+0000", 2024-04-26T10:21:39.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2765e-05 2024-04-26T10:21:39.906 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:39.906 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:39.906 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:39.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.907 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17898 5.8 e26/22 5:1d9430a2:::benchmark_data_smithi052_19421_object17897:head v 26'1142, mlcod=26'1139)", 2024-04-26T10:21:39.907 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.879429+0000", 2024-04-26T10:21:39.907 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0028034290000000001, 2024-04-26T10:21:39.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031385139999999998, 2024-04-26T10:21:39.907 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:39.907 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:39.907 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:39.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:39.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.879429+0000", 2024-04-26T10:21:39.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:39.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:39.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.879429+0000", 2024-04-26T10:21:39.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:39.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:39.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.879428+0000", 2024-04-26T10:21:39.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:39.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.879495+0000", 2024-04-26T10:21:39.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6780999999999996e-05 2024-04-26T10:21:39.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:39.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.879508+0000", 2024-04-26T10:21:39.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2509e-05 2024-04-26T10:21:39.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.879516+0000", 2024-04-26T10:21:39.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0819999999999999e-06 2024-04-26T10:21:39.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:39.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.880002+0000", 2024-04-26T10:21:39.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00048572200000000001 2024-04-26T10:21:39.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:39.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.880014+0000", 2024-04-26T10:21:39.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2771e-05 2024-04-26T10:21:39.911 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:39.911 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:39.911 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:39.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.911 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17897 5.d e26/22 5:bbcb31c9:::benchmark_data_smithi052_19421_object17896:head v 26'1132, mlcod=26'1129)", 2024-04-26T10:21:39.911 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.880151+0000", 2024-04-26T10:21:39.911 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.002081416, 2024-04-26T10:21:39.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024596449999999999, 2024-04-26T10:21:39.911 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:39.912 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:39.912 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:39.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:39.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.880151+0000", 2024-04-26T10:21:39.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:39.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:39.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.880151+0000", 2024-04-26T10:21:39.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:39.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:39.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.880150+0000", 2024-04-26T10:21:39.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:39.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:39.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.880237+0000", 2024-04-26T10:21:39.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6312999999999998e-05 2024-04-26T10:21:39.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.880253+0000", 2024-04-26T10:21:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5795999999999999e-05 2024-04-26T10:21:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.880262+0000", 2024-04-26T10:21:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0340000000000002e-06 2024-04-26T10:21:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.880318+0000", 2024-04-26T10:21:39.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6761000000000001e-05 2024-04-26T10:21:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.880339+0000", 2024-04-26T10:21:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0993999999999999e-05 2024-04-26T10:21:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:21:39.915 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 7 2024-04-26T10:21:39.915 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:39.917 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:39.960 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:39.957+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:40.040 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:40.040 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:21:40.041 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:21:40.041 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:21:40.041 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:40.052 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:40.061 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:40.056+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:40.084 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:21:40.162 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:40.156+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:40.174 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:40.174 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:21:40.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:21:40.174 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:40.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.175 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:40.175 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:40.175 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.871693126, 2024-04-26T10:21:40.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018441564000000001, 2024-04-26T10:21:40.175 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.175 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:40.175 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:40.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:40.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301372+0000", 2024-04-26T10:21:40.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:40.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301399+0000", 2024-04-26T10:21:40.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7039999999999999e-05 2024-04-26T10:21:40.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301426+0000", 2024-04-26T10:21:40.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6381e-05 2024-04-26T10:21:40.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301480+0000", 2024-04-26T10:21:40.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3681000000000003e-05 2024-04-26T10:21:40.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310584+0000", 2024-04-26T10:21:40.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091042339999999992 2024-04-26T10:21:40.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:40.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310591+0000", 2024-04-26T10:21:40.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8190000000000003e-06 2024-04-26T10:21:40.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311503+0000", 2024-04-26T10:21:40.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000911983 2024-04-26T10:21:40.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311605+0000", 2024-04-26T10:21:40.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102619 2024-04-26T10:21:40.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:40.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311730+0000", 2024-04-26T10:21:40.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012474400000000001 2024-04-26T10:21:40.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:40.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317287+0000", 2024-04-26T10:21:40.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055571140000000002 2024-04-26T10:21:40.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:40.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319724+0000", 2024-04-26T10:21:40.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002437294 2024-04-26T10:21:40.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:40.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319776+0000", 2024-04-26T10:21:40.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1992e-05 2024-04-26T10:21:40.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319816+0000", 2024-04-26T10:21:40.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9709999999999998e-05 2024-04-26T10:21:40.180 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.181 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.181 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.181 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "pg_update_log_missing(3.1e epoch 20/18 rep_tid 1 entries 20'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-26T10:21:40.181 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306447+0000", 2024-04-26T10:21:40.181 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.866620845, 2024-04-26T10:21:40.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094811170000000007, 2024-04-26T10:21:40.181 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.181 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T10:21:40.181 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306447+0000", 2024-04-26T10:21:40.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306447+0000", 2024-04-26T10:21:40.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306446+0000", 2024-04-26T10:21:40.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:40.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306456+0000", 2024-04-26T10:21:40.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6139999999999998e-06 2024-04-26T10:21:40.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306471+0000", 2024-04-26T10:21:40.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5167000000000001e-05 2024-04-26T10:21:40.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306486+0000", 2024-04-26T10:21:40.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.521e-05 2024-04-26T10:21:40.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308601+0000", 2024-04-26T10:21:40.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021147869999999999 2024-04-26T10:21:40.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315928+0000", 2024-04-26T10:21:40.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073266219999999996 2024-04-26T10:21:40.184 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.184 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.184 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.185 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:40.185 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:40.185 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.86637726, 2024-04-26T10:21:40.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013786338, 2024-04-26T10:21:40.185 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.185 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:40.185 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:40.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:40.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306689+0000", 2024-04-26T10:21:40.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:40.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306697+0000", 2024-04-26T10:21:40.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2420000000000003e-06 2024-04-26T10:21:40.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306725+0000", 2024-04-26T10:21:40.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8209e-05 2024-04-26T10:21:40.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306750+0000", 2024-04-26T10:21:40.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5432e-05 2024-04-26T10:21:40.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310622+0000", 2024-04-26T10:21:40.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003871738 2024-04-26T10:21:40.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:21:40.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310627+0000", 2024-04-26T10:21:40.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4890000000000003e-06 2024-04-26T10:21:40.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314030+0000", 2024-04-26T10:21:40.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003402094 2024-04-26T10:21:40.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314147+0000", 2024-04-26T10:21:40.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011776499999999999 2024-04-26T10:21:40.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:40.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314441+0000", 2024-04-26T10:21:40.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000293543 2024-04-26T10:21:40.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:40.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319422+0000", 2024-04-26T10:21:40.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004981096 2024-04-26T10:21:40.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:40.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320057+0000", 2024-04-26T10:21:40.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000635521 2024-04-26T10:21:40.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:40.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320110+0000", 2024-04-26T10:21:40.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2104999999999997e-05 2024-04-26T10:21:40.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320477+0000", 2024-04-26T10:21:40.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036709500000000001 2024-04-26T10:21:40.191 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.191 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.191 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.191 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:40.191 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:40.191 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.866283898999999, 2024-04-26T10:21:40.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013859405999999999, 2024-04-26T10:21:40.191 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.191 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:40.191 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:40.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:40.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306783+0000", 2024-04-26T10:21:40.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:40.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306788+0000", 2024-04-26T10:21:40.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3990000000000003e-06 2024-04-26T10:21:40.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306796+0000", 2024-04-26T10:21:40.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8820000000000001e-06 2024-04-26T10:21:40.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306803+0000", 2024-04-26T10:21:40.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6649999999999997e-06 2024-04-26T10:21:40.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314454+0000", 2024-04-26T10:21:40.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076508349999999999 2024-04-26T10:21:40.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314930+0000", 2024-04-26T10:21:40.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047624199999999998 2024-04-26T10:21:40.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:40.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315127+0000", 2024-04-26T10:21:40.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196751 2024-04-26T10:21:40.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:40.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320496+0000", 2024-04-26T10:21:40.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053690150000000004 2024-04-26T10:21:40.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:40.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320576+0000", 2024-04-26T10:21:40.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0327999999999994e-05 2024-04-26T10:21:40.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:40.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320611+0000", 2024-04-26T10:21:40.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-04-26T10:21:40.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320643+0000", 2024-04-26T10:21:40.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2474000000000001e-05 2024-04-26T10:21:40.197 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.197 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.197 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.197 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:40.197 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:40.198 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.866204728, 2024-04-26T10:21:40.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013889195, 2024-04-26T10:21:40.198 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.198 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:40.198 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:40.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:40.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306862+0000", 2024-04-26T10:21:40.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:40.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306867+0000", 2024-04-26T10:21:40.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5390000000000001e-06 2024-04-26T10:21:40.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306874+0000", 2024-04-26T10:21:40.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7549999999999997e-06 2024-04-26T10:21:40.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306887+0000", 2024-04-26T10:21:40.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.313e-05 2024-04-26T10:21:40.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315477+0000", 2024-04-26T10:21:40.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085902489999999995 2024-04-26T10:21:40.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315607+0000", 2024-04-26T10:21:40.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129789 2024-04-26T10:21:40.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:40.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315767+0000", 2024-04-26T10:21:40.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016052699999999999 2024-04-26T10:21:40.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:40.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320502+0000", 2024-04-26T10:21:40.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00473421 2024-04-26T10:21:40.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:40.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320691+0000", 2024-04-26T10:21:40.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018938900000000001 2024-04-26T10:21:40.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:40.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320721+0000", 2024-04-26T10:21:40.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9677000000000001e-05 2024-04-26T10:21:40.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320752+0000", 2024-04-26T10:21:40.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1486000000000003e-05 2024-04-26T10:21:40.203 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.203 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.203 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.203 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:40.203 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:40.203 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.866166809999999, 2024-04-26T10:21:40.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012590871, 2024-04-26T10:21:40.203 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.203 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:40.203 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:40.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:40.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306900+0000", 2024-04-26T10:21:40.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:40.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306905+0000", 2024-04-26T10:21:40.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9010000000000002e-06 2024-04-26T10:21:40.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306911+0000", 2024-04-26T10:21:40.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6030000000000004e-06 2024-04-26T10:21:40.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306916+0000", 2024-04-26T10:21:40.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8539999999999996e-06 2024-04-26T10:21:40.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308529+0000", 2024-04-26T10:21:40.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001613258 2024-04-26T10:21:40.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:40.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308537+0000", 2024-04-26T10:21:40.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1680000000000004e-06 2024-04-26T10:21:40.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311962+0000", 2024-04-26T10:21:40.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034247290000000001 2024-04-26T10:21:40.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.312092+0000", 2024-04-26T10:21:40.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013048700000000001 2024-04-26T10:21:40.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:40.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.312438+0000", 2024-04-26T10:21:40.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00034558700000000001 2024-04-26T10:21:40.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:40.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317984+0000", 2024-04-26T10:21:40.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005546067 2024-04-26T10:21:40.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:40.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319373+0000", 2024-04-26T10:21:40.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001389426 2024-04-26T10:21:40.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:40.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319438+0000", 2024-04-26T10:21:40.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4849000000000002e-05 2024-04-26T10:21:40.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319492+0000", 2024-04-26T10:21:40.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3554000000000003e-05 2024-04-26T10:21:40.209 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.209 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.209 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.209 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:40.209 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:40.209 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.864496227, 2024-04-26T10:21:40.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011321652999999999, 2024-04-26T10:21:40.209 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.209 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:40.210 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:40.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:40.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:40.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:40.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308576+0000", 2024-04-26T10:21:40.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2920000000000003e-06 2024-04-26T10:21:40.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308582+0000", 2024-04-26T10:21:40.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6540000000000002e-06 2024-04-26T10:21:40.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308590+0000", 2024-04-26T10:21:40.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-04-26T10:21:40.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308958+0000", 2024-04-26T10:21:40.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036823500000000001 2024-04-26T10:21:40.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:21:40.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308963+0000", 2024-04-26T10:21:40.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6160000000000001e-06 2024-04-26T10:21:40.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.313758+0000", 2024-04-26T10:21:40.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004794296 2024-04-26T10:21:40.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.313848+0000", 2024-04-26T10:21:40.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0488999999999994e-05 2024-04-26T10:21:40.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:40.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314099+0000", 2024-04-26T10:21:40.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025094700000000001 2024-04-26T10:21:40.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:40.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.318989+0000", 2024-04-26T10:21:40.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048896850000000004 2024-04-26T10:21:40.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:40.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319799+0000", 2024-04-26T10:21:40.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00080979299999999995 2024-04-26T10:21:40.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:40.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319847+0000", 2024-04-26T10:21:40.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8254999999999998e-05 2024-04-26T10:21:40.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319893+0000", 2024-04-26T10:21:40.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6108e-05 2024-04-26T10:21:40.215 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.215 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.215 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.215 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:40.215 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:40.215 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.864374378000001, 2024-04-26T10:21:40.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012032891, 2024-04-26T10:21:40.216 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.216 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:40.216 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:40.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:40.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:40.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:40.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308697+0000", 2024-04-26T10:21:40.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4449999999999998e-06 2024-04-26T10:21:40.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308864+0000", 2024-04-26T10:21:40.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000167045 2024-04-26T10:21:40.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308886+0000", 2024-04-26T10:21:40.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1858999999999999e-05 2024-04-26T10:21:40.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316346+0000", 2024-04-26T10:21:40.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007460225 2024-04-26T10:21:40.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316500+0000", 2024-04-26T10:21:40.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153776 2024-04-26T10:21:40.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:40.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316665+0000", 2024-04-26T10:21:40.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000164854 2024-04-26T10:21:40.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:40.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320564+0000", 2024-04-26T10:21:40.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038988339999999999 2024-04-26T10:21:40.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:40.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320680+0000", 2024-04-26T10:21:40.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011616399999999999 2024-04-26T10:21:40.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:40.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320710+0000", 2024-04-26T10:21:40.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0182e-05 2024-04-26T10:21:40.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320726+0000", 2024-04-26T10:21:40.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6118000000000001e-05 2024-04-26T10:21:40.220 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.220 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.221 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.221 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:40.221 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.310512+0000", 2024-04-26T10:21:40.221 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.862555194999999, 2024-04-26T10:21:40.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009600964, 2024-04-26T10:21:40.221 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.221 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:40.221 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310512+0000", 2024-04-26T10:21:40.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310512+0000", 2024-04-26T10:21:40.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310511+0000", 2024-04-26T10:21:40.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:40.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310518+0000", 2024-04-26T10:21:40.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1870000000000002e-06 2024-04-26T10:21:40.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310531+0000", 2024-04-26T10:21:40.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3325e-05 2024-04-26T10:21:40.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310541+0000", 2024-04-26T10:21:40.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6679999999999996e-06 2024-04-26T10:21:40.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310750+0000", 2024-04-26T10:21:40.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:21:40.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311175+0000", 2024-04-26T10:21:40.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00042555300000000001 2024-04-26T10:21:40.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320113+0000", 2024-04-26T10:21:40.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0089382739999999995 2024-04-26T10:21:40.224 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.225 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.225 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.225 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:15337 5.f e26/22 5:f5ac1cde:::benchmark_data_smithi052_19421_object15336:head v 26'982, mlcod=26'978)", 2024-04-26T10:21:40.225 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:38.915955+0000", 2024-04-26T10:21:40.225 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.257113092, 2024-04-26T10:21:40.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095362669999999993, 2024-04-26T10:21:40.225 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.225 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:40.225 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.915955+0000", 2024-04-26T10:21:40.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.915955+0000", 2024-04-26T10:21:40.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.915953+0000", 2024-04-26T10:21:40.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:40.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.916030+0000", 2024-04-26T10:21:40.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6421999999999994e-05 2024-04-26T10:21:40.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.916044+0000", 2024-04-26T10:21:40.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3798000000000001e-05 2024-04-26T10:21:40.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.916051+0000", 2024-04-26T10:21:40.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8650000000000003e-06 2024-04-26T10:21:40.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.916116+0000", 2024-04-26T10:21:40.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5228000000000006e-05 2024-04-26T10:21:40.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.916149+0000", 2024-04-26T10:21:40.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3170999999999998e-05 2024-04-26T10:21:40.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:40.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.925443+0000", 2024-04-26T10:21:40.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00929373 2024-04-26T10:21:40.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.925491+0000", 2024-04-26T10:21:40.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.808e-05 2024-04-26T10:21:40.229 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.229 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.229 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.229 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:15343 5.4 e26/22 5:258111f7:::benchmark_data_smithi052_19421_object15342:head v 26'969, mlcod=26'967)", 2024-04-26T10:21:40.229 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:38.916080+0000", 2024-04-26T10:21:40.229 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.2569880170000001, 2024-04-26T10:21:40.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094843219999999999, 2024-04-26T10:21:40.229 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.229 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:40.230 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.916080+0000", 2024-04-26T10:21:40.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.916080+0000", 2024-04-26T10:21:40.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.916063+0000", 2024-04-26T10:21:40.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999828 2024-04-26T10:21:40.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.916159+0000", 2024-04-26T10:21:40.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5872999999999995e-05 2024-04-26T10:21:40.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.916183+0000", 2024-04-26T10:21:40.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4331000000000001e-05 2024-04-26T10:21:40.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.916193+0000", 2024-04-26T10:21:40.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9660000000000008e-06 2024-04-26T10:21:40.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.916245+0000", 2024-04-26T10:21:40.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1842000000000003e-05 2024-04-26T10:21:40.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.916269+0000", 2024-04-26T10:21:40.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4343999999999999e-05 2024-04-26T10:21:40.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:40.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.925501+0000", 2024-04-26T10:21:40.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0092317560000000007 2024-04-26T10:21:40.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.925564+0000", 2024-04-26T10:21:40.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3151999999999994e-05 2024-04-26T10:21:40.233 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.233 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.233 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.234 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:15562 5.f e26/22 5:f08fe41e:::benchmark_data_smithi052_19421_object15561:head v 26'996, mlcod=26'994)", 2024-04-26T10:21:40.234 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:38.999553+0000", 2024-04-26T10:21:40.234 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.1735148660000001, 2024-04-26T10:21:40.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010040301, 2024-04-26T10:21:40.234 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.234 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:40.234 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999553+0000", 2024-04-26T10:21:40.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999553+0000", 2024-04-26T10:21:40.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999551+0000", 2024-04-26T10:21:40.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:40.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999614+0000", 2024-04-26T10:21:40.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2706999999999994e-05 2024-04-26T10:21:40.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999634+0000", 2024-04-26T10:21:40.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9760999999999999e-05 2024-04-26T10:21:40.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999644+0000", 2024-04-26T10:21:40.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0756e-05 2024-04-26T10:21:40.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999719+0000", 2024-04-26T10:21:40.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4643999999999999e-05 2024-04-26T10:21:40.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999757+0000", 2024-04-26T10:21:40.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.858e-05 2024-04-26T10:21:40.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:40.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.009553+0000", 2024-04-26T10:21:40.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097958790000000004 2024-04-26T10:21:40.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.009593+0000", 2024-04-26T10:21:40.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9677e-05 2024-04-26T10:21:40.238 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.238 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.238 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.238 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:15564 5.f e26/22 5:f61b0088:::benchmark_data_smithi052_19421_object15563:head v 26'998, mlcod=26'994)", 2024-04-26T10:21:40.238 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.003307+0000", 2024-04-26T10:21:40.238 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.1697608909999999, 2024-04-26T10:21:40.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009663006, 2024-04-26T10:21:40.238 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.238 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:40.238 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.003307+0000", 2024-04-26T10:21:40.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.003307+0000", 2024-04-26T10:21:40.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.003306+0000", 2024-04-26T10:21:40.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:40.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.003346+0000", 2024-04-26T10:21:40.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0043999999999998e-05 2024-04-26T10:21:40.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.003365+0000", 2024-04-26T10:21:40.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9273999999999999e-05 2024-04-26T10:21:40.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.003376+0000", 2024-04-26T10:21:40.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1584e-05 2024-04-26T10:21:40.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.003445+0000", 2024-04-26T10:21:40.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8627000000000005e-05 2024-04-26T10:21:40.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.003466+0000", 2024-04-26T10:21:40.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0808000000000001e-05 2024-04-26T10:21:40.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:40.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.012885+0000", 2024-04-26T10:21:40.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094191850000000001 2024-04-26T10:21:40.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.012970+0000", 2024-04-26T10:21:40.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4662999999999999e-05 2024-04-26T10:21:40.242 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.242 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.242 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.242 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:15776 5.d e26/22 5:b9043162:::benchmark_data_smithi052_19421_object15775:head v 26'993, mlcod=26'987)", 2024-04-26T10:21:40.242 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.091139+0000", 2024-04-26T10:21:40.242 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.081928811, 2024-04-26T10:21:40.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098124079999999999, 2024-04-26T10:21:40.242 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.242 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:40.243 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.091139+0000", 2024-04-26T10:21:40.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.091139+0000", 2024-04-26T10:21:40.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.091137+0000", 2024-04-26T10:21:40.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:40.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.091223+0000", 2024-04-26T10:21:40.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5687999999999997e-05 2024-04-26T10:21:40.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.091240+0000", 2024-04-26T10:21:40.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6460000000000002e-05 2024-04-26T10:21:40.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.091249+0000", 2024-04-26T10:21:40.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6220000000000004e-06 2024-04-26T10:21:40.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.094310+0000", 2024-04-26T10:21:40.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030610839999999999 2024-04-26T10:21:40.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.094346+0000", 2024-04-26T10:21:40.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5472999999999997e-05 2024-04-26T10:21:40.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:40.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.100849+0000", 2024-04-26T10:21:40.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006502921 2024-04-26T10:21:40.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.100951+0000", 2024-04-26T10:21:40.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102562 2024-04-26T10:21:40.246 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.246 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.246 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.246 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:16220 5.4 e26/22 5:2095c316:::benchmark_data_smithi052_19421_object16219:head v 26'1028, mlcod=26'1025)", 2024-04-26T10:21:40.247 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.253527+0000", 2024-04-26T10:21:40.247 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.91954053899999999, 2024-04-26T10:21:40.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095494289999999999, 2024-04-26T10:21:40.247 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.247 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:40.247 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.253527+0000", 2024-04-26T10:21:40.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.253527+0000", 2024-04-26T10:21:40.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.253526+0000", 2024-04-26T10:21:40.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:40.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.253576+0000", 2024-04-26T10:21:40.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9971e-05 2024-04-26T10:21:40.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.253604+0000", 2024-04-26T10:21:40.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8408999999999999e-05 2024-04-26T10:21:40.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.253620+0000", 2024-04-26T10:21:40.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5943999999999998e-05 2024-04-26T10:21:40.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.253681+0000", 2024-04-26T10:21:40.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0643999999999997e-05 2024-04-26T10:21:40.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.253708+0000", 2024-04-26T10:21:40.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6545000000000001e-05 2024-04-26T10:21:40.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:40.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.263044+0000", 2024-04-26T10:21:40.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093360019999999995 2024-04-26T10:21:40.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.263076+0000", 2024-04-26T10:21:40.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2863e-05 2024-04-26T10:21:40.250 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.251 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.251 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.251 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17046 5.8 e26/22 5:18ede56e:::benchmark_data_smithi052_19421_object17045:head v 26'1090, mlcod=26'1088)", 2024-04-26T10:21:40.251 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.548338+0000", 2024-04-26T10:21:40.251 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.62472929799999999, 2024-04-26T10:21:40.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010012109999999999, 2024-04-26T10:21:40.251 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.251 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:40.251 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548338+0000", 2024-04-26T10:21:40.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548338+0000", 2024-04-26T10:21:40.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548337+0000", 2024-04-26T10:21:40.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:40.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548399+0000", 2024-04-26T10:21:40.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1179000000000005e-05 2024-04-26T10:21:40.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548411+0000", 2024-04-26T10:21:40.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2191999999999999e-05 2024-04-26T10:21:40.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548419+0000", 2024-04-26T10:21:40.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8960000000000003e-06 2024-04-26T10:21:40.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548465+0000", 2024-04-26T10:21:40.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6251999999999997e-05 2024-04-26T10:21:40.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548534+0000", 2024-04-26T10:21:40.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9241999999999999e-05 2024-04-26T10:21:40.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:40.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.558299+0000", 2024-04-26T10:21:40.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097651000000000005 2024-04-26T10:21:40.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.558350+0000", 2024-04-26T10:21:40.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1119999999999998e-05 2024-04-26T10:21:40.255 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.255 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.255 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.255 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17045 5.0 e26/22 5:03aa7fc4:::benchmark_data_smithi052_19421_object17044:head v 26'998, mlcod=26'995)", 2024-04-26T10:21:40.255 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.548440+0000", 2024-04-26T10:21:40.255 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.62462767799999996, 2024-04-26T10:21:40.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099462109999999999, 2024-04-26T10:21:40.255 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.255 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:40.256 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548440+0000", 2024-04-26T10:21:40.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548440+0000", 2024-04-26T10:21:40.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548439+0000", 2024-04-26T10:21:40.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:40.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548504+0000", 2024-04-26T10:21:40.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4417000000000003e-05 2024-04-26T10:21:40.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548514+0000", 2024-04-26T10:21:40.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7459999999999995e-06 2024-04-26T10:21:40.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548520+0000", 2024-04-26T10:21:40.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5350000000000001e-06 2024-04-26T10:21:40.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548565+0000", 2024-04-26T10:21:40.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5235000000000003e-05 2024-04-26T10:21:40.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548661+0000", 2024-04-26T10:21:40.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5359000000000006e-05 2024-04-26T10:21:40.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:40.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.558355+0000", 2024-04-26T10:21:40.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096945269999999997 2024-04-26T10:21:40.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.558386+0000", 2024-04-26T10:21:40.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0910000000000001e-05 2024-04-26T10:21:40.259 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.259 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.259 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.259 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17047 5.9 e26/22 5:9051b83a:::benchmark_data_smithi052_19421_object17046:head v 26'1065, mlcod=26'1062)", 2024-04-26T10:21:40.260 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.548653+0000", 2024-04-26T10:21:40.260 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.62441505500000005, 2024-04-26T10:21:40.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096651910000000001, 2024-04-26T10:21:40.260 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.260 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:40.260 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548653+0000", 2024-04-26T10:21:40.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548653+0000", 2024-04-26T10:21:40.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548652+0000", 2024-04-26T10:21:40.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:40.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548722+0000", 2024-04-26T10:21:40.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0788000000000001e-05 2024-04-26T10:21:40.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548737+0000", 2024-04-26T10:21:40.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4541e-05 2024-04-26T10:21:40.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548748+0000", 2024-04-26T10:21:40.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1015999999999999e-05 2024-04-26T10:21:40.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548820+0000", 2024-04-26T10:21:40.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1830999999999997e-05 2024-04-26T10:21:40.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548861+0000", 2024-04-26T10:21:40.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1768999999999999e-05 2024-04-26T10:21:40.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:40.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.558280+0000", 2024-04-26T10:21:40.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094187999999999997 2024-04-26T10:21:40.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.558318+0000", 2024-04-26T10:21:40.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7441999999999998e-05 2024-04-26T10:21:40.263 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.265 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.265 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.266 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17337 5.a e26/22 5:554ab27b:::benchmark_data_smithi052_19421_object17336:head v 26'1116, mlcod=26'1113)", 2024-04-26T10:21:40.266 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.658815+0000", 2024-04-26T10:21:40.266 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.51425242800000004, 2024-04-26T10:21:40.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0095061099999999999, 2024-04-26T10:21:40.266 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.266 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:40.266 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.658815+0000", 2024-04-26T10:21:40.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.658815+0000", 2024-04-26T10:21:40.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.658814+0000", 2024-04-26T10:21:40.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:40.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.658892+0000", 2024-04-26T10:21:40.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7905999999999996e-05 2024-04-26T10:21:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.658903+0000", 2024-04-26T10:21:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0586e-05 2024-04-26T10:21:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.658912+0000", 2024-04-26T10:21:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1479999999999995e-06 2024-04-26T10:21:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.658976+0000", 2024-04-26T10:21:40.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3948000000000005e-05 2024-04-26T10:21:40.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.659033+0000", 2024-04-26T10:21:40.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7049999999999998e-05 2024-04-26T10:21:40.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:40.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.668253+0000", 2024-04-26T10:21:40.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009219741 2024-04-26T10:21:40.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.668321+0000", 2024-04-26T10:21:40.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8473999999999995e-05 2024-04-26T10:21:40.270 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.270 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.270 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.270 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17339 5.e e26/22 5:72e2fe32:::benchmark_data_smithi052_19421_object17338:head v 26'1109, mlcod=26'1106)", 2024-04-26T10:21:40.270 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.661438+0000", 2024-04-26T10:21:40.270 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.51162988600000003, 2024-04-26T10:21:40.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010169489, 2024-04-26T10:21:40.270 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:40.271 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:40.271 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:40.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:40.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661438+0000", 2024-04-26T10:21:40.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:40.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661438+0000", 2024-04-26T10:21:40.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:40.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:40.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661436+0000", 2024-04-26T10:21:40.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:40.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:40.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661484+0000", 2024-04-26T10:21:40.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7521999999999997e-05 2024-04-26T10:21:40.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:40.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661496+0000", 2024-04-26T10:21:40.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2368000000000001e-05 2024-04-26T10:21:40.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:40.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661505+0000", 2024-04-26T10:21:40.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3760000000000008e-06 2024-04-26T10:21:40.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:40.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661565+0000", 2024-04-26T10:21:40.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0384000000000003e-05 2024-04-26T10:21:40.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:40.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661598+0000", 2024-04-26T10:21:40.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2802999999999997e-05 2024-04-26T10:21:40.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:40.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.671560+0000", 2024-04-26T10:21:40.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099624180000000007 2024-04-26T10:21:40.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:40.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:40.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:40.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.671607+0000", 2024-04-26T10:21:40.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6931000000000002e-05 2024-04-26T10:21:40.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.274 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.275 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:40.275 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:40.275 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:40.276 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:21:40.276 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:21:40.277 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:21:40.277 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:40.272+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:40.291 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T10:21:40.293 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:21:40.293 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:21:40.293 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:21:40.377 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:40.372+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:40.409 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:40.409 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:40.422 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:21:40.479 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:40.476+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:40.552 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:40.553 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:40.566 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:21:40.579 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:40.576+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:40.586 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T10:21:40.613 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 7 16 19938 19922 177.855 169.562 0.00574492 0.00561567 2024-04-26T10:21:40.680 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:40.676+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:40.696 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:40.696 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:40.709 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:40.781 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:40.777+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:40.843 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:40.844 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:40.856 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:40.883 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:40.880+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:40.982 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:40.982 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:40.983 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:40.980+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:40.996 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:41.084 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:41.080+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:41.121 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:41.122 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:41.133 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:41.185 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:41.181+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:41.260 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:41.260 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:41.271 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:41.286 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:41.284+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:41.387 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:41.384+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:41.393 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:41.394 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:41.404 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:41.489 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:41.485+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:41.519 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:41.520 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:41.530 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:21:41.589 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:41.588+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:41.613 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 8 16 22519 22503 175.785 161.312 0.00737431 0.00568132 2024-04-26T10:21:41.655 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:41.655 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:41.666 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-26T10:21:41.691 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:41.688+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:41.792 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:41.788+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:41.803 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:41.803 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:41.818 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-26T10:21:41.892 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:41.888+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:41.950 INFO:teuthology.orchestra.run.smithi164.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:41.950 INFO:teuthology.orchestra.run.smithi164.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:41.963 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:42.006 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:42.004+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:42.086 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:42.086 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:42.094 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:42.093+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:42.096 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:42.196 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:42.192+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:42.222 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:42.222 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:42.235 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:42.296 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:42.293+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:42.311 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:21:42.358 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:42.358 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:42.372 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:42.419 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:42.416+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:42.465 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:21:42.487 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:21:42.493 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:42.493 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:42.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.493 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24727 5.e e27/22 5:76240acf:::benchmark_data_smithi052_19421_object24726:head v 27'1564, mlcod=27'1562)", 2024-04-26T10:21:42.493 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.488798+0000", 2024-04-26T10:21:42.493 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0043400469999999997, 2024-04-26T10:21:42.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004371659, 2024-04-26T10:21:42.494 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.494 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.494 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.488798+0000", 2024-04-26T10:21:42.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.488798+0000", 2024-04-26T10:21:42.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.488797+0000", 2024-04-26T10:21:42.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:42.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.488850+0000", 2024-04-26T10:21:42.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3056000000000002e-05 2024-04-26T10:21:42.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.488868+0000", 2024-04-26T10:21:42.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8388000000000001e-05 2024-04-26T10:21:42.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.488875+0000", 2024-04-26T10:21:42.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8349999999999998e-06 2024-04-26T10:21:42.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.488921+0000", 2024-04-26T10:21:42.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6128999999999998e-05 2024-04-26T10:21:42.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.488942+0000", 2024-04-26T10:21:42.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0720000000000002e-05 2024-04-26T10:21:42.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.493135+0000", 2024-04-26T10:21:42.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041926610000000003 2024-04-26T10:21:42.497 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.498 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.498 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.498 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24728 5.a e27/22 5:5e0325ee:::benchmark_data_smithi052_19421_object24727:head v 27'1587, mlcod=27'1583)", 2024-04-26T10:21:42.498 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.490216+0000", 2024-04-26T10:21:42.498 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0029215199999999999, 2024-04-26T10:21:42.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030366080000000001, 2024-04-26T10:21:42.498 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.498 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:42.498 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.490216+0000", 2024-04-26T10:21:42.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.490216+0000", 2024-04-26T10:21:42.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.490216+0000", 2024-04-26T10:21:42.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:42.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.490304+0000", 2024-04-26T10:21:42.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8005999999999997e-05 2024-04-26T10:21:42.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.490316+0000", 2024-04-26T10:21:42.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2269000000000001e-05 2024-04-26T10:21:42.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.490323+0000", 2024-04-26T10:21:42.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3379999999999999e-06 2024-04-26T10:21:42.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.490399+0000", 2024-04-26T10:21:42.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6093999999999993e-05 2024-04-26T10:21:42.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.490436+0000", 2024-04-26T10:21:42.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6140999999999998e-05 2024-04-26T10:21:42.501 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.501 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.501 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.502 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24729 5.8 e27/22 5:19c29702:::benchmark_data_smithi052_19421_object24728:head v 27'1576, mlcod=27'1573)", 2024-04-26T10:21:42.502 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.490881+0000", 2024-04-26T10:21:42.502 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0022564450000000002, 2024-04-26T10:21:42.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024223030000000002, 2024-04-26T10:21:42.502 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.502 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:42.502 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.490881+0000", 2024-04-26T10:21:42.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.490881+0000", 2024-04-26T10:21:42.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.490881+0000", 2024-04-26T10:21:42.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:42.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.490999+0000", 2024-04-26T10:21:42.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118328 2024-04-26T10:21:42.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491025+0000", 2024-04-26T10:21:42.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.637e-05 2024-04-26T10:21:42.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491034+0000", 2024-04-26T10:21:42.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1530000000000003e-06 2024-04-26T10:21:42.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491090+0000", 2024-04-26T10:21:42.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5303000000000002e-05 2024-04-26T10:21:42.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491107+0000", 2024-04-26T10:21:42.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7394e-05 2024-04-26T10:21:42.505 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.505 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.506 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.506 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24730 5.e e27/22 5:73f40354:::benchmark_data_smithi052_19421_object24729:head v 27'1565, mlcod=27'1562)", 2024-04-26T10:21:42.506 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.491051+0000", 2024-04-26T10:21:42.506 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0020865189999999998, 2024-04-26T10:21:42.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0023006490000000001, 2024-04-26T10:21:42.506 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.506 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:42.506 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491051+0000", 2024-04-26T10:21:42.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491051+0000", 2024-04-26T10:21:42.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491051+0000", 2024-04-26T10:21:42.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:42.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491102+0000", 2024-04-26T10:21:42.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0991e-05 2024-04-26T10:21:42.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491112+0000", 2024-04-26T10:21:42.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0468e-05 2024-04-26T10:21:42.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491120+0000", 2024-04-26T10:21:42.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7649999999999993e-06 2024-04-26T10:21:42.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491174+0000", 2024-04-26T10:21:42.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4323999999999997e-05 2024-04-26T10:21:42.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491213+0000", 2024-04-26T10:21:42.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8724999999999999e-05 2024-04-26T10:21:42.509 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.509 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.509 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.510 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24733 5.9 e27/22 5:90461b2d:::benchmark_data_smithi052_19421_object24732:head v 27'1537, mlcod=27'1535)", 2024-04-26T10:21:42.510 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.491597+0000", 2024-04-26T10:21:42.510 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0015405639999999999, 2024-04-26T10:21:42.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001803259, 2024-04-26T10:21:42.510 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.510 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:42.510 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491597+0000", 2024-04-26T10:21:42.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491597+0000", 2024-04-26T10:21:42.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491596+0000", 2024-04-26T10:21:42.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:42.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491709+0000", 2024-04-26T10:21:42.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011244299999999999 2024-04-26T10:21:42.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491722+0000", 2024-04-26T10:21:42.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3545e-05 2024-04-26T10:21:42.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491728+0000", 2024-04-26T10:21:42.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3619999999999997e-06 2024-04-26T10:21:42.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491781+0000", 2024-04-26T10:21:42.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3702999999999997e-05 2024-04-26T10:21:42.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491811+0000", 2024-04-26T10:21:42.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9342000000000001e-05 2024-04-26T10:21:42.513 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.513 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.513 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.513 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24734 5.d e27/22 5:b3775de6:::benchmark_data_smithi052_19421_object24733:head v 27'1596, mlcod=27'1594)", 2024-04-26T10:21:42.513 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.491746+0000", 2024-04-26T10:21:42.513 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0013919679999999999, 2024-04-26T10:21:42.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0017017340000000001, 2024-04-26T10:21:42.514 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.514 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:42.514 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491746+0000", 2024-04-26T10:21:42.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491746+0000", 2024-04-26T10:21:42.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491745+0000", 2024-04-26T10:21:42.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:42.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491779+0000", 2024-04-26T10:21:42.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3658000000000002e-05 2024-04-26T10:21:42.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491785+0000", 2024-04-26T10:21:42.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0560000000000001e-06 2024-04-26T10:21:42.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491789+0000", 2024-04-26T10:21:42.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5719999999999999e-06 2024-04-26T10:21:42.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491835+0000", 2024-04-26T10:21:42.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6081999999999997e-05 2024-04-26T10:21:42.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.491851+0000", 2024-04-26T10:21:42.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6381000000000001e-05 2024-04-26T10:21:42.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.517 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.517 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:21:42.517 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 6 2024-04-26T10:21:42.517 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:42.518 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T10:21:42.519 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:21:42.519 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:21:42.519 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:21:42.520 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:42.520 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:42.517+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:42.601 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:21:42.613 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 9 16 25011 24995 173.557 155.75 0.00985978 0.00575426 2024-04-26T10:21:42.619 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:21:42.616+0000 7f4667e1d700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18267) UID: 0 2024-04-26T10:21:42.633 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:42.634 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:21:42.634 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:21:42.634 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:21:42.634 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:42.636 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-26T10:21:42.636 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:21:42.636 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2] 2024-04-26T10:21:42.637 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi164.front.sepia.ceph.com 2024-04-26T10:21:42.637 INFO:teuthology.orchestra.console.smithi164:Power off 2024-04-26T10:21:42.637 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-26T10:21:42.648 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:42.661 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2024-04-26T10:21:42.661 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T10:21:42.685 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-04-26T10:21:42.722 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:42.716+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:42.771 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:42.771 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:21:42.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:21:42.771 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:42.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.771 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:42.771 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:42.771 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.467324065, 2024-04-26T10:21:42.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018441564000000001, 2024-04-26T10:21:42.771 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.772 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.772 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:42.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:42.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301372+0000", 2024-04-26T10:21:42.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:42.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301399+0000", 2024-04-26T10:21:42.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7039999999999999e-05 2024-04-26T10:21:42.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301426+0000", 2024-04-26T10:21:42.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6381e-05 2024-04-26T10:21:42.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301480+0000", 2024-04-26T10:21:42.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3681000000000003e-05 2024-04-26T10:21:42.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310584+0000", 2024-04-26T10:21:42.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091042339999999992 2024-04-26T10:21:42.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:42.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310591+0000", 2024-04-26T10:21:42.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8190000000000003e-06 2024-04-26T10:21:42.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311503+0000", 2024-04-26T10:21:42.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000911983 2024-04-26T10:21:42.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311605+0000", 2024-04-26T10:21:42.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102619 2024-04-26T10:21:42.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:42.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311730+0000", 2024-04-26T10:21:42.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012474400000000001 2024-04-26T10:21:42.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:42.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317287+0000", 2024-04-26T10:21:42.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055571140000000002 2024-04-26T10:21:42.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:42.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319724+0000", 2024-04-26T10:21:42.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002437294 2024-04-26T10:21:42.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319776+0000", 2024-04-26T10:21:42.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1992e-05 2024-04-26T10:21:42.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319816+0000", 2024-04-26T10:21:42.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9709999999999998e-05 2024-04-26T10:21:42.778 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.778 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.778 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.778 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:42.778 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:42.778 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.462008199000003, 2024-04-26T10:21:42.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013786338, 2024-04-26T10:21:42.778 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.778 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.778 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:42.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:42.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306689+0000", 2024-04-26T10:21:42.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:42.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306697+0000", 2024-04-26T10:21:42.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2420000000000003e-06 2024-04-26T10:21:42.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306725+0000", 2024-04-26T10:21:42.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8209e-05 2024-04-26T10:21:42.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306750+0000", 2024-04-26T10:21:42.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5432e-05 2024-04-26T10:21:42.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310622+0000", 2024-04-26T10:21:42.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003871738 2024-04-26T10:21:42.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:21:42.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310627+0000", 2024-04-26T10:21:42.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4890000000000003e-06 2024-04-26T10:21:42.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314030+0000", 2024-04-26T10:21:42.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003402094 2024-04-26T10:21:42.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314147+0000", 2024-04-26T10:21:42.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011776499999999999 2024-04-26T10:21:42.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:42.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314441+0000", 2024-04-26T10:21:42.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000293543 2024-04-26T10:21:42.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:42.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319422+0000", 2024-04-26T10:21:42.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004981096 2024-04-26T10:21:42.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:42.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320057+0000", 2024-04-26T10:21:42.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000635521 2024-04-26T10:21:42.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320110+0000", 2024-04-26T10:21:42.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2104999999999997e-05 2024-04-26T10:21:42.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320477+0000", 2024-04-26T10:21:42.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036709500000000001 2024-04-26T10:21:42.784 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.784 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.784 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.784 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:42.784 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:42.784 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.461914837999998, 2024-04-26T10:21:42.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013859405999999999, 2024-04-26T10:21:42.785 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.785 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.785 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:42.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:42.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306783+0000", 2024-04-26T10:21:42.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:42.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306788+0000", 2024-04-26T10:21:42.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3990000000000003e-06 2024-04-26T10:21:42.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306796+0000", 2024-04-26T10:21:42.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8820000000000001e-06 2024-04-26T10:21:42.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306803+0000", 2024-04-26T10:21:42.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6649999999999997e-06 2024-04-26T10:21:42.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314454+0000", 2024-04-26T10:21:42.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076508349999999999 2024-04-26T10:21:42.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314930+0000", 2024-04-26T10:21:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047624199999999998 2024-04-26T10:21:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315127+0000", 2024-04-26T10:21:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196751 2024-04-26T10:21:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320496+0000", 2024-04-26T10:21:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053690150000000004 2024-04-26T10:21:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:42.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320576+0000", 2024-04-26T10:21:42.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0327999999999994e-05 2024-04-26T10:21:42.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320611+0000", 2024-04-26T10:21:42.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-04-26T10:21:42.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320643+0000", 2024-04-26T10:21:42.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2474000000000001e-05 2024-04-26T10:21:42.789 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.789 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.790 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.790 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:42.790 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:42.790 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.461835667000003, 2024-04-26T10:21:42.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013889195, 2024-04-26T10:21:42.790 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.790 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.790 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:42.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:42.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306862+0000", 2024-04-26T10:21:42.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:42.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306867+0000", 2024-04-26T10:21:42.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5390000000000001e-06 2024-04-26T10:21:42.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306874+0000", 2024-04-26T10:21:42.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7549999999999997e-06 2024-04-26T10:21:42.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306887+0000", 2024-04-26T10:21:42.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.313e-05 2024-04-26T10:21:42.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315477+0000", 2024-04-26T10:21:42.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085902489999999995 2024-04-26T10:21:42.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315607+0000", 2024-04-26T10:21:42.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129789 2024-04-26T10:21:42.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:42.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315767+0000", 2024-04-26T10:21:42.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016052699999999999 2024-04-26T10:21:42.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:42.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320502+0000", 2024-04-26T10:21:42.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00473421 2024-04-26T10:21:42.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:42.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320691+0000", 2024-04-26T10:21:42.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018938900000000001 2024-04-26T10:21:42.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320721+0000", 2024-04-26T10:21:42.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9677000000000001e-05 2024-04-26T10:21:42.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320752+0000", 2024-04-26T10:21:42.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1486000000000003e-05 2024-04-26T10:21:42.795 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.795 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.795 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.795 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:42.795 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:42.796 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.461797748999999, 2024-04-26T10:21:42.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012590871, 2024-04-26T10:21:42.796 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.796 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.796 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:42.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:42.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306900+0000", 2024-04-26T10:21:42.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:42.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306905+0000", 2024-04-26T10:21:42.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9010000000000002e-06 2024-04-26T10:21:42.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306911+0000", 2024-04-26T10:21:42.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6030000000000004e-06 2024-04-26T10:21:42.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306916+0000", 2024-04-26T10:21:42.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8539999999999996e-06 2024-04-26T10:21:42.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308529+0000", 2024-04-26T10:21:42.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001613258 2024-04-26T10:21:42.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:42.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308537+0000", 2024-04-26T10:21:42.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1680000000000004e-06 2024-04-26T10:21:42.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311962+0000", 2024-04-26T10:21:42.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034247290000000001 2024-04-26T10:21:42.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.312092+0000", 2024-04-26T10:21:42.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013048700000000001 2024-04-26T10:21:42.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:42.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.312438+0000", 2024-04-26T10:21:42.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00034558700000000001 2024-04-26T10:21:42.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:42.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317984+0000", 2024-04-26T10:21:42.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005546067 2024-04-26T10:21:42.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:42.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319373+0000", 2024-04-26T10:21:42.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001389426 2024-04-26T10:21:42.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319438+0000", 2024-04-26T10:21:42.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4849000000000002e-05 2024-04-26T10:21:42.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319492+0000", 2024-04-26T10:21:42.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3554000000000003e-05 2024-04-26T10:21:42.801 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.801 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.801 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.802 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:42.802 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:42.802 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.460127165999999, 2024-04-26T10:21:42.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011321652999999999, 2024-04-26T10:21:42.802 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.802 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.802 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:42.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:42.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:42.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:42.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308576+0000", 2024-04-26T10:21:42.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2920000000000003e-06 2024-04-26T10:21:42.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308582+0000", 2024-04-26T10:21:42.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6540000000000002e-06 2024-04-26T10:21:42.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308590+0000", 2024-04-26T10:21:42.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-04-26T10:21:42.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308958+0000", 2024-04-26T10:21:42.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036823500000000001 2024-04-26T10:21:42.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:21:42.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308963+0000", 2024-04-26T10:21:42.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6160000000000001e-06 2024-04-26T10:21:42.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.313758+0000", 2024-04-26T10:21:42.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004794296 2024-04-26T10:21:42.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.313848+0000", 2024-04-26T10:21:42.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0488999999999994e-05 2024-04-26T10:21:42.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:42.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314099+0000", 2024-04-26T10:21:42.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025094700000000001 2024-04-26T10:21:42.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:42.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.318989+0000", 2024-04-26T10:21:42.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048896850000000004 2024-04-26T10:21:42.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:42.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319799+0000", 2024-04-26T10:21:42.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00080979299999999995 2024-04-26T10:21:42.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319847+0000", 2024-04-26T10:21:42.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8254999999999998e-05 2024-04-26T10:21:42.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319893+0000", 2024-04-26T10:21:42.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6108e-05 2024-04-26T10:21:42.808 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.808 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.808 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.808 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:42.808 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:42.808 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 33.460005316999997, 2024-04-26T10:21:42.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012032891, 2024-04-26T10:21:42.808 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.808 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.808 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:42.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:42.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:42.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:42.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308697+0000", 2024-04-26T10:21:42.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4449999999999998e-06 2024-04-26T10:21:42.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308864+0000", 2024-04-26T10:21:42.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000167045 2024-04-26T10:21:42.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308886+0000", 2024-04-26T10:21:42.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1858999999999999e-05 2024-04-26T10:21:42.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316346+0000", 2024-04-26T10:21:42.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007460225 2024-04-26T10:21:42.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316500+0000", 2024-04-26T10:21:42.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153776 2024-04-26T10:21:42.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:42.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316665+0000", 2024-04-26T10:21:42.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000164854 2024-04-26T10:21:42.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:42.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320564+0000", 2024-04-26T10:21:42.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038988339999999999 2024-04-26T10:21:42.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:42.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320680+0000", 2024-04-26T10:21:42.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011616399999999999 2024-04-26T10:21:42.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320710+0000", 2024-04-26T10:21:42.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0182e-05 2024-04-26T10:21:42.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320726+0000", 2024-04-26T10:21:42.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6118000000000001e-05 2024-04-26T10:21:42.813 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.813 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.813 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.813 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:15562 5.f e26/22 5:f08fe41e:::benchmark_data_smithi052_19421_object15561:head v 26'996, mlcod=26'994)", 2024-04-26T10:21:42.813 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:38.999553+0000", 2024-04-26T10:21:42.813 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.769145805, 2024-04-26T10:21:42.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010040301, 2024-04-26T10:21:42.814 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.814 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.814 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999553+0000", 2024-04-26T10:21:42.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999553+0000", 2024-04-26T10:21:42.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999551+0000", 2024-04-26T10:21:42.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:42.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999614+0000", 2024-04-26T10:21:42.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2706999999999994e-05 2024-04-26T10:21:42.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999634+0000", 2024-04-26T10:21:42.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9760999999999999e-05 2024-04-26T10:21:42.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999644+0000", 2024-04-26T10:21:42.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0756e-05 2024-04-26T10:21:42.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999719+0000", 2024-04-26T10:21:42.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4643999999999999e-05 2024-04-26T10:21:42.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999757+0000", 2024-04-26T10:21:42.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.858e-05 2024-04-26T10:21:42.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.009553+0000", 2024-04-26T10:21:42.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097958790000000004 2024-04-26T10:21:42.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.009593+0000", 2024-04-26T10:21:42.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9677e-05 2024-04-26T10:21:42.817 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.817 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.818 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.818 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:15564 5.f e26/22 5:f61b0088:::benchmark_data_smithi052_19421_object15563:head v 26'998, mlcod=26'994)", 2024-04-26T10:21:42.818 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.003307+0000", 2024-04-26T10:21:42.818 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.76539183, 2024-04-26T10:21:42.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009663006, 2024-04-26T10:21:42.818 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.818 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.818 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.003307+0000", 2024-04-26T10:21:42.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.003307+0000", 2024-04-26T10:21:42.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.003306+0000", 2024-04-26T10:21:42.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:42.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.003346+0000", 2024-04-26T10:21:42.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0043999999999998e-05 2024-04-26T10:21:42.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.003365+0000", 2024-04-26T10:21:42.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9273999999999999e-05 2024-04-26T10:21:42.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.003376+0000", 2024-04-26T10:21:42.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1584e-05 2024-04-26T10:21:42.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.003445+0000", 2024-04-26T10:21:42.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8627000000000005e-05 2024-04-26T10:21:42.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.821 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.003466+0000", 2024-04-26T10:21:42.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0808000000000001e-05 2024-04-26T10:21:42.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.821 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.012885+0000", 2024-04-26T10:21:42.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094191850000000001 2024-04-26T10:21:42.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.012970+0000", 2024-04-26T10:21:42.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4662999999999999e-05 2024-04-26T10:21:42.822 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.822 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.822 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.822 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:15776 5.d e26/22 5:b9043162:::benchmark_data_smithi052_19421_object15775:head v 26'993, mlcod=26'987)", 2024-04-26T10:21:42.822 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.091139+0000", 2024-04-26T10:21:42.822 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.6775597499999999, 2024-04-26T10:21:42.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098124079999999999, 2024-04-26T10:21:42.822 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.823 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.823 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.091139+0000", 2024-04-26T10:21:42.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.091139+0000", 2024-04-26T10:21:42.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.091137+0000", 2024-04-26T10:21:42.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:42.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.091223+0000", 2024-04-26T10:21:42.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5687999999999997e-05 2024-04-26T10:21:42.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.091240+0000", 2024-04-26T10:21:42.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6460000000000002e-05 2024-04-26T10:21:42.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.091249+0000", 2024-04-26T10:21:42.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6220000000000004e-06 2024-04-26T10:21:42.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.094310+0000", 2024-04-26T10:21:42.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030610839999999999 2024-04-26T10:21:42.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.094346+0000", 2024-04-26T10:21:42.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5472999999999997e-05 2024-04-26T10:21:42.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.826 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.826 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.100849+0000", 2024-04-26T10:21:42.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006502921 2024-04-26T10:21:42.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.826 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.826 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.100951+0000", 2024-04-26T10:21:42.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102562 2024-04-26T10:21:42.826 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.826 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.826 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.827 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17046 5.8 e26/22 5:18ede56e:::benchmark_data_smithi052_19421_object17045:head v 26'1090, mlcod=26'1088)", 2024-04-26T10:21:42.827 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.548338+0000", 2024-04-26T10:21:42.827 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.220360237, 2024-04-26T10:21:42.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010012109999999999, 2024-04-26T10:21:42.827 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.827 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.827 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548338+0000", 2024-04-26T10:21:42.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548338+0000", 2024-04-26T10:21:42.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548337+0000", 2024-04-26T10:21:42.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:42.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548399+0000", 2024-04-26T10:21:42.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1179000000000005e-05 2024-04-26T10:21:42.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548411+0000", 2024-04-26T10:21:42.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2191999999999999e-05 2024-04-26T10:21:42.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548419+0000", 2024-04-26T10:21:42.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8960000000000003e-06 2024-04-26T10:21:42.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548465+0000", 2024-04-26T10:21:42.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6251999999999997e-05 2024-04-26T10:21:42.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548534+0000", 2024-04-26T10:21:42.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9241999999999999e-05 2024-04-26T10:21:42.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.558299+0000", 2024-04-26T10:21:42.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097651000000000005 2024-04-26T10:21:42.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.558350+0000", 2024-04-26T10:21:42.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1119999999999998e-05 2024-04-26T10:21:42.831 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.831 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.831 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.831 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17045 5.0 e26/22 5:03aa7fc4:::benchmark_data_smithi052_19421_object17044:head v 26'998, mlcod=26'995)", 2024-04-26T10:21:42.831 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.548440+0000", 2024-04-26T10:21:42.831 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.2202586169999998, 2024-04-26T10:21:42.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099462109999999999, 2024-04-26T10:21:42.831 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.831 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.832 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548440+0000", 2024-04-26T10:21:42.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548440+0000", 2024-04-26T10:21:42.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548439+0000", 2024-04-26T10:21:42.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:42.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548504+0000", 2024-04-26T10:21:42.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4417000000000003e-05 2024-04-26T10:21:42.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548514+0000", 2024-04-26T10:21:42.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7459999999999995e-06 2024-04-26T10:21:42.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548520+0000", 2024-04-26T10:21:42.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5350000000000001e-06 2024-04-26T10:21:42.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548565+0000", 2024-04-26T10:21:42.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5235000000000003e-05 2024-04-26T10:21:42.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548661+0000", 2024-04-26T10:21:42.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5359000000000006e-05 2024-04-26T10:21:42.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.558355+0000", 2024-04-26T10:21:42.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096945269999999997 2024-04-26T10:21:42.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.558386+0000", 2024-04-26T10:21:42.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0910000000000001e-05 2024-04-26T10:21:42.835 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.835 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.835 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.835 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17047 5.9 e26/22 5:9051b83a:::benchmark_data_smithi052_19421_object17046:head v 26'1065, mlcod=26'1062)", 2024-04-26T10:21:42.836 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.548653+0000", 2024-04-26T10:21:42.836 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.2200459939999999, 2024-04-26T10:21:42.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096651910000000001, 2024-04-26T10:21:42.836 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.836 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.836 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548653+0000", 2024-04-26T10:21:42.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548653+0000", 2024-04-26T10:21:42.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548652+0000", 2024-04-26T10:21:42.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:42.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548722+0000", 2024-04-26T10:21:42.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0788000000000001e-05 2024-04-26T10:21:42.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548737+0000", 2024-04-26T10:21:42.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4541e-05 2024-04-26T10:21:42.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548748+0000", 2024-04-26T10:21:42.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1015999999999999e-05 2024-04-26T10:21:42.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548820+0000", 2024-04-26T10:21:42.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1830999999999997e-05 2024-04-26T10:21:42.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548861+0000", 2024-04-26T10:21:42.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1768999999999999e-05 2024-04-26T10:21:42.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.558280+0000", 2024-04-26T10:21:42.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094187999999999997 2024-04-26T10:21:42.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.558318+0000", 2024-04-26T10:21:42.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7441999999999998e-05 2024-04-26T10:21:42.840 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.840 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.840 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.840 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17339 5.e e26/22 5:72e2fe32:::benchmark_data_smithi052_19421_object17338:head v 26'1109, mlcod=26'1106)", 2024-04-26T10:21:42.840 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.661438+0000", 2024-04-26T10:21:42.840 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.107260825, 2024-04-26T10:21:42.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010169489, 2024-04-26T10:21:42.840 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.840 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.840 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661438+0000", 2024-04-26T10:21:42.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661438+0000", 2024-04-26T10:21:42.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661436+0000", 2024-04-26T10:21:42.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:42.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661484+0000", 2024-04-26T10:21:42.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7521999999999997e-05 2024-04-26T10:21:42.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661496+0000", 2024-04-26T10:21:42.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2368000000000001e-05 2024-04-26T10:21:42.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661505+0000", 2024-04-26T10:21:42.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3760000000000008e-06 2024-04-26T10:21:42.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661565+0000", 2024-04-26T10:21:42.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0384000000000003e-05 2024-04-26T10:21:42.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661598+0000", 2024-04-26T10:21:42.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2802999999999997e-05 2024-04-26T10:21:42.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.671560+0000", 2024-04-26T10:21:42.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099624180000000007 2024-04-26T10:21:42.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.671607+0000", 2024-04-26T10:21:42.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6931000000000002e-05 2024-04-26T10:21:42.844 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.844 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.844 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.844 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24842 5.0 e27/22 5:0a88cb3c:::benchmark_data_smithi052_19421_object24841:head v 27'1472, mlcod=27'1470)", 2024-04-26T10:21:42.844 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.545356+0000", 2024-04-26T10:21:42.845 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.223342718, 2024-04-26T10:21:42.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010303537, 2024-04-26T10:21:42.845 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.845 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.845 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545356+0000", 2024-04-26T10:21:42.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545356+0000", 2024-04-26T10:21:42.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545355+0000", 2024-04-26T10:21:42.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:42.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545413+0000", 2024-04-26T10:21:42.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8519e-05 2024-04-26T10:21:42.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545425+0000", 2024-04-26T10:21:42.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1844999999999999e-05 2024-04-26T10:21:42.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545433+0000", 2024-04-26T10:21:42.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6279999999999996e-06 2024-04-26T10:21:42.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545487+0000", 2024-04-26T10:21:42.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4523e-05 2024-04-26T10:21:42.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545524+0000", 2024-04-26T10:21:42.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6656000000000003e-05 2024-04-26T10:21:42.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555637+0000", 2024-04-26T10:21:42.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010113074999999999 2024-04-26T10:21:42.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555659+0000", 2024-04-26T10:21:42.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2379999999999999e-05 2024-04-26T10:21:42.848 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.849 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.849 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.849 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24843 5.8 e27/22 5:12cddf7e:::benchmark_data_smithi052_19421_object24842:head v 27'1588, mlcod=27'1586)", 2024-04-26T10:21:42.849 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.545451+0000", 2024-04-26T10:21:42.849 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.22324740400000001, 2024-04-26T10:21:42.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010159789000000001, 2024-04-26T10:21:42.849 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.849 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.849 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545451+0000", 2024-04-26T10:21:42.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545451+0000", 2024-04-26T10:21:42.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545451+0000", 2024-04-26T10:21:42.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:42.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545506+0000", 2024-04-26T10:21:42.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5708999999999998e-05 2024-04-26T10:21:42.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545527+0000", 2024-04-26T10:21:42.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0927000000000001e-05 2024-04-26T10:21:42.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545541+0000", 2024-04-26T10:21:42.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4008999999999999e-05 2024-04-26T10:21:42.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545600+0000", 2024-04-26T10:21:42.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8885999999999998e-05 2024-04-26T10:21:42.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545638+0000", 2024-04-26T10:21:42.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7546999999999998e-05 2024-04-26T10:21:42.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555568+0000", 2024-04-26T10:21:42.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099299090000000007 2024-04-26T10:21:42.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555611+0000", 2024-04-26T10:21:42.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3302e-05 2024-04-26T10:21:42.853 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.853 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.853 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.853 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24847 5.a e27/22 5:5eaae0d2:::benchmark_data_smithi052_19421_object24846:head v 27'1596, mlcod=27'1594)", 2024-04-26T10:21:42.853 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.545555+0000", 2024-04-26T10:21:42.853 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.223143813, 2024-04-26T10:21:42.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010033293, 2024-04-26T10:21:42.853 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.854 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.854 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545555+0000", 2024-04-26T10:21:42.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545555+0000", 2024-04-26T10:21:42.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545554+0000", 2024-04-26T10:21:42.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:42.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545596+0000", 2024-04-26T10:21:42.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1668999999999997e-05 2024-04-26T10:21:42.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545604+0000", 2024-04-26T10:21:42.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.473e-06 2024-04-26T10:21:42.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545611+0000", 2024-04-26T10:21:42.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5300000000000002e-06 2024-04-26T10:21:42.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545670+0000", 2024-04-26T10:21:42.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8653000000000002e-05 2024-04-26T10:21:42.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545724+0000", 2024-04-26T10:21:42.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4435999999999999e-05 2024-04-26T10:21:42.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555526+0000", 2024-04-26T10:21:42.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098015180000000004 2024-04-26T10:21:42.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555588+0000", 2024-04-26T10:21:42.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2440000000000005e-05 2024-04-26T10:21:42.857 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.857 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.857 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.858 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24855 5.d e27/22 5:ba6d2780:::benchmark_data_smithi052_19421_object24854:head v 27'1602, mlcod=27'1600)", 2024-04-26T10:21:42.858 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.545589+0000", 2024-04-26T10:21:42.858 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.223109856, 2024-04-26T10:21:42.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010064831, 2024-04-26T10:21:42.858 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.858 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.858 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545589+0000", 2024-04-26T10:21:42.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545589+0000", 2024-04-26T10:21:42.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545588+0000", 2024-04-26T10:21:42.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:42.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545644+0000", 2024-04-26T10:21:42.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6289000000000003e-05 2024-04-26T10:21:42.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545657+0000", 2024-04-26T10:21:42.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2826000000000001e-05 2024-04-26T10:21:42.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545666+0000", 2024-04-26T10:21:42.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1439999999999992e-06 2024-04-26T10:21:42.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545712+0000", 2024-04-26T10:21:42.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6105e-05 2024-04-26T10:21:42.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545726+0000", 2024-04-26T10:21:42.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3988000000000001e-05 2024-04-26T10:21:42.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555601+0000", 2024-04-26T10:21:42.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098745399999999994 2024-04-26T10:21:42.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555654+0000", 2024-04-26T10:21:42.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2850999999999999e-05 2024-04-26T10:21:42.862 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.862 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.862 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.862 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24852 5.9 e27/22 5:9011d5ec:::benchmark_data_smithi052_19421_object24851:head v 27'1544, mlcod=27'1541)", 2024-04-26T10:21:42.862 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.545686+0000", 2024-04-26T10:21:42.862 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.22301299599999999, 2024-04-26T10:21:42.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009855328, 2024-04-26T10:21:42.862 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.862 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.863 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.863 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.863 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545686+0000", 2024-04-26T10:21:42.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.863 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.863 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545686+0000", 2024-04-26T10:21:42.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.863 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.863 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545685+0000", 2024-04-26T10:21:42.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:42.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545732+0000", 2024-04-26T10:21:42.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7026e-05 2024-04-26T10:21:42.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545742+0000", 2024-04-26T10:21:42.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5899999999999997e-06 2024-04-26T10:21:42.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545748+0000", 2024-04-26T10:21:42.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7510000000000002e-06 2024-04-26T10:21:42.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545797+0000", 2024-04-26T10:21:42.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8201999999999997e-05 2024-04-26T10:21:42.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545817+0000", 2024-04-26T10:21:42.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0154000000000001e-05 2024-04-26T10:21:42.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555485+0000", 2024-04-26T10:21:42.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096682480000000008 2024-04-26T10:21:42.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555541+0000", 2024-04-26T10:21:42.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5855e-05 2024-04-26T10:21:42.866 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.866 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.866 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.866 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24863 5.e e27/22 5:70815639:::benchmark_data_smithi052_19421_object24862:head v 27'1571, mlcod=27'1569)", 2024-04-26T10:21:42.866 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:42.866 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.21539312399999999, 2024-04-26T10:21:42.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014429724999999999, 2024-04-26T10:21:42.867 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:42.867 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:42.867 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:42.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:42.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:42.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:42.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:42.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:42.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:42.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553304+0000", 2024-04-26T10:21:42.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:42.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:42.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553377+0000", 2024-04-26T10:21:42.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3206000000000003e-05 2024-04-26T10:21:42.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:42.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553397+0000", 2024-04-26T10:21:42.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9366000000000001e-05 2024-04-26T10:21:42.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:42.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553407+0000", 2024-04-26T10:21:42.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0676000000000001e-05 2024-04-26T10:21:42.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:42.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553467+0000", 2024-04-26T10:21:42.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9735999999999999e-05 2024-04-26T10:21:42.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:42.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553486+0000", 2024-04-26T10:21:42.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8842e-05 2024-04-26T10:21:42.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:42.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.567649+0000", 2024-04-26T10:21:42.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01416272 2024-04-26T10:21:42.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:42.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:42.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:42.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.567735+0000", 2024-04-26T10:21:42.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6363e-05 2024-04-26T10:21:42.870 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.870 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.871 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.871 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:42.871 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:42.871 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:42.872 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:42.868+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:42.873 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:42.973 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:42.969+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:43.004 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:43.004 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:43.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:25974 5.1 5:8d13366b:::benchmark_data_smithi052_19421_object25973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:21:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:42.999791+0000", 2024-04-26T10:21:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001850284, 2024-04-26T10:21:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018771840000000001, 2024-04-26T10:21:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 25974 2024-04-26T10:21:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.999791+0000", 2024-04-26T10:21:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.999791+0000", 2024-04-26T10:21:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.999790+0000", 2024-04-26T10:21:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.999880+0000", 2024-04-26T10:21:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9530999999999994e-05 2024-04-26T10:21:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.999938+0000", 2024-04-26T10:21:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7661999999999998e-05 2024-04-26T10:21:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.999948+0000", 2024-04-26T10:21:43.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0451999999999999e-05 2024-04-26T10:21:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.999996+0000", 2024-04-26T10:21:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7519999999999999e-05 2024-04-26T10:21:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000149+0000", 2024-04-26T10:21:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015304199999999999 2024-04-26T10:21:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-04-26T10:21:43.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000322+0000", 2024-04-26T10:21:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017348299999999999 2024-04-26T10:21:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:25973 5.c e27/22 5:3f0069b5:::benchmark_data_smithi052_19421_object25972:head v 27'1616, mlcod=27'1613)", 2024-04-26T10:21:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:42.999934+0000", 2024-04-26T10:21:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001707994, 2024-04-26T10:21:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001811977, 2024-04-26T10:21:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.999934+0000", 2024-04-26T10:21:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.999934+0000", 2024-04-26T10:21:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.999933+0000", 2024-04-26T10:21:43.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000062+0000", 2024-04-26T10:21:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012907700000000001 2024-04-26T10:21:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000071+0000", 2024-04-26T10:21:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8370000000000003e-06 2024-04-26T10:21:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000079+0000", 2024-04-26T10:21:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6040000000000004e-06 2024-04-26T10:21:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000189+0000", 2024-04-26T10:21:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011055799999999999 2024-04-26T10:21:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000209+0000", 2024-04-26T10:21:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0108000000000001e-05 2024-04-26T10:21:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.012 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:25975 5.f 5:f4375312:::benchmark_data_smithi052_19421_object25974:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:21:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:42.999979+0000", 2024-04-26T10:21:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00166315, 2024-04-26T10:21:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018301019999999999, 2024-04-26T10:21:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 25975 2024-04-26T10:21:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.013 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.999979+0000", 2024-04-26T10:21:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.999979+0000", 2024-04-26T10:21:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.999978+0000", 2024-04-26T10:21:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000069+0000", 2024-04-26T10:21:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1613999999999994e-05 2024-04-26T10:21:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000089+0000", 2024-04-26T10:21:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0115e-05 2024-04-26T10:21:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000104+0000", 2024-04-26T10:21:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4773999999999999e-05 2024-04-26T10:21:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000159+0000", 2024-04-26T10:21:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4766999999999999e-05 2024-04-26T10:21:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000296+0000", 2024-04-26T10:21:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013683900000000001 2024-04-26T10:21:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000431+0000", 2024-04-26T10:21:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135177 2024-04-26T10:21:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:25972 5.5 e27/22 5:a29c5466:::benchmark_data_smithi052_19421_object25971:head v 27'1670, mlcod=27'1668)", 2024-04-26T10:21:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:43.000093+0000", 2024-04-26T10:21:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001548965, 2024-04-26T10:21:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001784917, 2024-04-26T10:21:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:43.017 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000093+0000", 2024-04-26T10:21:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000093+0000", 2024-04-26T10:21:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000092+0000", 2024-04-26T10:21:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000166+0000", 2024-04-26T10:21:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3524999999999998e-05 2024-04-26T10:21:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000175+0000", 2024-04-26T10:21:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2050000000000008e-06 2024-04-26T10:21:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000182+0000", 2024-04-26T10:21:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5339999999999996e-06 2024-04-26T10:21:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000240+0000", 2024-04-26T10:21:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8702999999999997e-05 2024-04-26T10:21:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000265+0000", 2024-04-26T10:21:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4800999999999999e-05 2024-04-26T10:21:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:25976 5.7 5:e73f20c9:::benchmark_data_smithi052_19421_object25975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:21:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:43.000130+0000", 2024-04-26T10:21:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001511369, 2024-04-26T10:21:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001821303, 2024-04-26T10:21:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 25976 2024-04-26T10:21:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.021 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000130+0000", 2024-04-26T10:21:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000130+0000", 2024-04-26T10:21:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000130+0000", 2024-04-26T10:21:43.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000212+0000", 2024-04-26T10:21:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2433000000000002e-05 2024-04-26T10:21:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000222+0000", 2024-04-26T10:21:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0222e-05 2024-04-26T10:21:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000229+0000", 2024-04-26T10:21:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4139999999999999e-06 2024-04-26T10:21:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000385+0000", 2024-04-26T10:21:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000156028 2024-04-26T10:21:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000601+0000", 2024-04-26T10:21:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021578799999999999 2024-04-26T10:21:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-04-26T10:21:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000738+0000", 2024-04-26T10:21:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000137749 2024-04-26T10:21:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:25977 5.7 5:e8a40408:::benchmark_data_smithi052_19421_object25976:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:21:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:43.000241+0000", 2024-04-26T10:21:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0014008250000000001, 2024-04-26T10:21:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018504999999999999, 2024-04-26T10:21:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.025 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 25977 2024-04-26T10:21:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000241+0000", 2024-04-26T10:21:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000241+0000", 2024-04-26T10:21:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000240+0000", 2024-04-26T10:21:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000276+0000", 2024-04-26T10:21:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6225e-05 2024-04-26T10:21:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000284+0000", 2024-04-26T10:21:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.807e-06 2024-04-26T10:21:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000290+0000", 2024-04-26T10:21:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.434e-06 2024-04-26T10:21:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.001861+0000", 2024-04-26T10:21:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001571387 2024-04-26T10:21:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.001985+0000", 2024-04-26T10:21:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000124325 2024-04-26T10:21:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:25978 5.f 5:fb8884f7:::benchmark_data_smithi052_19421_object25977:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:21:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:43.000444+0000", 2024-04-26T10:21:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0011974539999999999, 2024-04-26T10:21:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00174581, 2024-04-26T10:21:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:43.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 25978 2024-04-26T10:21:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000444+0000", 2024-04-26T10:21:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000444+0000", 2024-04-26T10:21:43.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000443+0000", 2024-04-26T10:21:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000500+0000", 2024-04-26T10:21:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7048e-05 2024-04-26T10:21:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000516+0000", 2024-04-26T10:21:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6290000000000002e-05 2024-04-26T10:21:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000530+0000", 2024-04-26T10:21:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3901e-05 2024-04-26T10:21:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.001857+0000", 2024-04-26T10:21:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013270249999999999 2024-04-26T10:21:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.001972+0000", 2024-04-26T10:21:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011446999999999999 2024-04-26T10:21:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.002065+0000", 2024-04-26T10:21:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3553000000000004e-05 2024-04-26T10:21:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:25979 5.2 5:4de549d2:::benchmark_data_smithi052_19421_object25978:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:21:43.033 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:43.000541+0000", 2024-04-26T10:21:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001100583, 2024-04-26T10:21:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001748896, 2024-04-26T10:21:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 25979 2024-04-26T10:21:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000541+0000", 2024-04-26T10:21:43.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000541+0000", 2024-04-26T10:21:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000540+0000", 2024-04-26T10:21:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000610+0000", 2024-04-26T10:21:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9375999999999994e-05 2024-04-26T10:21:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000621+0000", 2024-04-26T10:21:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1082e-05 2024-04-26T10:21:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000630+0000", 2024-04-26T10:21:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8899999999999996e-06 2024-04-26T10:21:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000934+0000", 2024-04-26T10:21:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030457999999999999 2024-04-26T10:21:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.001218+0000", 2024-04-26T10:21:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00028393299999999999 2024-04-26T10:21:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-04-26T10:21:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.001477+0000", 2024-04-26T10:21:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025887799999999998 2024-04-26T10:21:43.037 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:25981 5.1 5:8b0e16d7:::benchmark_data_smithi052_19421_object25980:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:21:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:43.000653+0000", 2024-04-26T10:21:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000988919, 2024-04-26T10:21:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001731317, 2024-04-26T10:21:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:43.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 25981 2024-04-26T10:21:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000653+0000", 2024-04-26T10:21:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000653+0000", 2024-04-26T10:21:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000652+0000", 2024-04-26T10:21:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000701+0000", 2024-04-26T10:21:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9064999999999999e-05 2024-04-26T10:21:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000712+0000", 2024-04-26T10:21:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0949e-05 2024-04-26T10:21:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.000721+0000", 2024-04-26T10:21:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9360000000000005e-06 2024-04-26T10:21:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.001603+0000", 2024-04-26T10:21:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00088278499999999997 2024-04-26T10:21:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.001798+0000", 2024-04-26T10:21:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019454499999999999 2024-04-26T10:21:43.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-04-26T10:21:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.002000+0000", 2024-04-26T10:21:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020194899999999999 2024-04-26T10:21:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:25982 5.7 5.db31dc57 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:21:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:43.001904+0000", 2024-04-26T10:21:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9997373, 2024-04-26T10:21:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00057065399999999997, 2024-04-26T10:21:43.042 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:21:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 25982 2024-04-26T10:21:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.001904+0000", 2024-04-26T10:21:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.001904+0000", 2024-04-26T10:21:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.001903+0000", 2024-04-26T10:21:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.001999+0000", 2024-04-26T10:21:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5648000000000003e-05 2024-04-26T10:21:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.002018+0000", 2024-04-26T10:21:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9341e-05 2024-04-26T10:21:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.002027+0000", 2024-04-26T10:21:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.422e-06 2024-04-26T10:21:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:25984 5.1 5.6c0538a1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:21:43.045 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:43.002326+0000", 2024-04-26T10:21:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9993157, 2024-04-26T10:21:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000215274, 2024-04-26T10:21:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:21:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 25984 2024-04-26T10:21:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.002326+0000", 2024-04-26T10:21:43.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.002326+0000", 2024-04-26T10:21:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.002325+0000", 2024-04-26T10:21:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.002387+0000", 2024-04-26T10:21:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1657999999999998e-05 2024-04-26T10:21:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.002398+0000", 2024-04-26T10:21:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0795000000000001e-05 2024-04-26T10:21:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.002405+0000", 2024-04-26T10:21:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8490000000000006e-06 2024-04-26T10:21:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:25966 5.1 5:831c9297:::benchmark_data_smithi052_19421_object25965:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:21:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:42.995282+0000", 2024-04-26T10:21:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0063592939999999997, 2024-04-26T10:21:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0073326420000000003, 2024-04-26T10:21:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 25966 2024-04-26T10:21:43.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.995282+0000", 2024-04-26T10:21:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.995282+0000", 2024-04-26T10:21:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.995282+0000", 2024-04-26T10:21:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.995316+0000", 2024-04-26T10:21:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4350999999999997e-05 2024-04-26T10:21:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.995322+0000", 2024-04-26T10:21:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9329999999999998e-06 2024-04-26T10:21:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.995326+0000", 2024-04-26T10:21:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0820000000000001e-06 2024-04-26T10:21:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.996837+0000", 2024-04-26T10:21:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001510862 2024-04-26T10:21:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.997017+0000", 2024-04-26T10:21:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017988800000000001 2024-04-26T10:21:43.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-04-26T10:21:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.997201+0000", 2024-04-26T10:21:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018367200000000001 2024-04-26T10:21:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.999015+0000", 2024-04-26T10:21:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001814509 2024-04-26T10:21:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:25971 5.d 5:bb1b89d7:::benchmark_data_smithi052_19421_object25970:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-26T10:21:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:42.997614+0000", 2024-04-26T10:21:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0040281689999999998, 2024-04-26T10:21:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051030520000000003, 2024-04-26T10:21:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 25971 2024-04-26T10:21:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.997614+0000", 2024-04-26T10:21:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.997614+0000", 2024-04-26T10:21:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.997612+0000", 2024-04-26T10:21:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.997717+0000", 2024-04-26T10:21:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104851 2024-04-26T10:21:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.997728+0000", 2024-04-26T10:21:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0307e-05 2024-04-26T10:21:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.997733+0000", 2024-04-26T10:21:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8239999999999996e-06 2024-04-26T10:21:43.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.997786+0000", 2024-04-26T10:21:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2383000000000003e-05 2024-04-26T10:21:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.998014+0000", 2024-04-26T10:21:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022792600000000001 2024-04-26T10:21:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.998215+0000", 2024-04-26T10:21:43.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020171300000000001 2024-04-26T10:21:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.001705+0000", 2024-04-26T10:21:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034894359999999998 2024-04-26T10:21:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:25968 5.3 e27/22 5:cbdc1372:::benchmark_data_smithi052_19421_object25967:head v 27'1634, mlcod=27'1630)", 2024-04-26T10:21:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:42.998016+0000", 2024-04-26T10:21:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0036255100000000002, 2024-04-26T10:21:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047966780000000004, 2024-04-26T10:21:43.058 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.998016+0000", 2024-04-26T10:21:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.998016+0000", 2024-04-26T10:21:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.998016+0000", 2024-04-26T10:21:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.998150+0000", 2024-04-26T10:21:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134461 2024-04-26T10:21:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.998156+0000", 2024-04-26T10:21:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4180000000000002e-06 2024-04-26T10:21:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.998161+0000", 2024-04-26T10:21:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.194e-06 2024-04-26T10:21:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.998204+0000", 2024-04-26T10:21:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3662999999999999e-05 2024-04-26T10:21:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:42.998228+0000", 2024-04-26T10:21:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4158000000000001e-05 2024-04-26T10:21:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.061 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.062 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.062 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.062 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:21:43.062 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 14 2024-04-26T10:21:43.062 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:43.063 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:43.074 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:43.068+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:43.175 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:43.172+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:43.190 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:43.191 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:21:43.191 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:21:43.191 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:21:43.191 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:43.204 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:43.276 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:43.273+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:43.327 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:43.327 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:21:43.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:21:43.327 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:43.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.327 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:43.327 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:43.327 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.085263437000002, 2024-04-26T10:21:43.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015326892, 2024-04-26T10:21:43.328 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.328 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:43.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:43.328 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 112 2024-04-26T10:21:43.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.328 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:43.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:43.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238644+0000", 2024-04-26T10:21:43.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238792+0000", 2024-04-26T10:21:43.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775699999999999 2024-04-26T10:21:43.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238811+0000", 2024-04-26T10:21:43.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8359000000000002e-05 2024-04-26T10:21:43.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238887+0000", 2024-04-26T10:21:43.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6909000000000005e-05 2024-04-26T10:21:43.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248433+0000", 2024-04-26T10:21:43.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095455650000000006 2024-04-26T10:21:43.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248564+0000", 2024-04-26T10:21:43.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131273 2024-04-26T10:21:43.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248795+0000", 2024-04-26T10:21:43.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023073500000000001 2024-04-26T10:21:43.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251497+0000", 2024-04-26T10:21:43.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002701976 2024-04-26T10:21:43.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253894+0000", 2024-04-26T10:21:43.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023967429999999998 2024-04-26T10:21:43.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253937+0000", 2024-04-26T10:21:43.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3006999999999997e-05 2024-04-26T10:21:43.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253972+0000", 2024-04-26T10:21:43.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5388000000000001e-05 2024-04-26T10:21:43.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.333 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.333 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.333 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:43.333 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:43.333 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.085009538999998, 2024-04-26T10:21:43.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016304328, 2024-04-26T10:21:43.334 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.334 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:43.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:43.334 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113 2024-04-26T10:21:43.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.334 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:43.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:43.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238898+0000", 2024-04-26T10:21:43.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238920+0000", 2024-04-26T10:21:43.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2056999999999999e-05 2024-04-26T10:21:43.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238937+0000", 2024-04-26T10:21:43.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6415000000000001e-05 2024-04-26T10:21:43.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238948+0000", 2024-04-26T10:21:43.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.11e-05 2024-04-26T10:21:43.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250527+0000", 2024-04-26T10:21:43.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011578662 2024-04-26T10:21:43.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250627+0000", 2024-04-26T10:21:43.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100418 2024-04-26T10:21:43.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250769+0000", 2024-04-26T10:21:43.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142111 2024-04-26T10:21:43.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253884+0000", 2024-04-26T10:21:43.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031148399999999998 2024-04-26T10:21:43.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254994+0000", 2024-04-26T10:21:43.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011095720000000001 2024-04-26T10:21:43.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255094+0000", 2024-04-26T10:21:43.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010092 2024-04-26T10:21:43.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255203+0000", 2024-04-26T10:21:43.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010906 2024-04-26T10:21:43.341 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.341 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.341 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.342 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:43.342 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:43.342 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.084952004000002, 2024-04-26T10:21:43.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016378984999999999, 2024-04-26T10:21:43.342 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.342 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.342 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.342 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:43.342 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:43.342 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 114 2024-04-26T10:21:43.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.343 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:43.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:43.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238956+0000", 2024-04-26T10:21:43.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238965+0000", 2024-04-26T10:21:43.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9469999999999992e-06 2024-04-26T10:21:43.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238993+0000", 2024-04-26T10:21:43.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8296000000000001e-05 2024-04-26T10:21:43.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239004+0000", 2024-04-26T10:21:43.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0482999999999999e-05 2024-04-26T10:21:43.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251532+0000", 2024-04-26T10:21:43.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01252852 2024-04-26T10:21:43.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251622+0000", 2024-04-26T10:21:43.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0044999999999996e-05 2024-04-26T10:21:43.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251763+0000", 2024-04-26T10:21:43.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140634 2024-04-26T10:21:43.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254035+0000", 2024-04-26T10:21:43.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022721320000000001 2024-04-26T10:21:43.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255220+0000", 2024-04-26T10:21:43.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011853059999999999 2024-04-26T10:21:43.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255301+0000", 2024-04-26T10:21:43.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0253999999999994e-05 2024-04-26T10:21:43.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255336+0000", 2024-04-26T10:21:43.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5098000000000002e-05 2024-04-26T10:21:43.347 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.348 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.348 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.348 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:43.348 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:43.348 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.084890055000002, 2024-04-26T10:21:43.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018452342, 2024-04-26T10:21:43.348 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.348 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.348 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.348 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:43.348 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:43.348 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115 2024-04-26T10:21:43.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.349 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:43.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:43.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239018+0000", 2024-04-26T10:21:43.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239152+0000", 2024-04-26T10:21:43.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414699999999999 2024-04-26T10:21:43.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239169+0000", 2024-04-26T10:21:43.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7013000000000001e-05 2024-04-26T10:21:43.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239190+0000", 2024-04-26T10:21:43.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1302999999999999e-05 2024-04-26T10:21:43.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252181+0000", 2024-04-26T10:21:43.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012990213 2024-04-26T10:21:43.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252411+0000", 2024-04-26T10:21:43.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023010199999999999 2024-04-26T10:21:43.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252687+0000", 2024-04-26T10:21:43.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000276063 2024-04-26T10:21:43.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254694+0000", 2024-04-26T10:21:43.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020072879999999999 2024-04-26T10:21:43.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257399+0000", 2024-04-26T10:21:43.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027051670000000001 2024-04-26T10:21:43.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257442+0000", 2024-04-26T10:21:43.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-04-26T10:21:43.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257471+0000", 2024-04-26T10:21:43.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.889e-05 2024-04-26T10:21:43.353 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.353 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.354 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.354 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:43.354 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:43.354 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.084709525999997, 2024-04-26T10:21:43.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018350615000000001, 2024-04-26T10:21:43.354 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.354 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:43.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:43.354 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116 2024-04-26T10:21:43.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.355 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:43.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:43.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239198+0000", 2024-04-26T10:21:43.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239213+0000", 2024-04-26T10:21:43.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4965e-05 2024-04-26T10:21:43.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239235+0000", 2024-04-26T10:21:43.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.156e-05 2024-04-26T10:21:43.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239243+0000", 2024-04-26T10:21:43.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9470000000000003e-06 2024-04-26T10:21:43.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253284+0000", 2024-04-26T10:21:43.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014041392999999999 2024-04-26T10:21:43.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253376+0000", 2024-04-26T10:21:43.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1198000000000003e-05 2024-04-26T10:21:43.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253508+0000", 2024-04-26T10:21:43.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013220199999999999 2024-04-26T10:21:43.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255474+0000", 2024-04-26T10:21:43.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019665590000000001 2024-04-26T10:21:43.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257480+0000", 2024-04-26T10:21:43.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00200599 2024-04-26T10:21:43.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257515+0000", 2024-04-26T10:21:43.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5126000000000002e-05 2024-04-26T10:21:43.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257550+0000", 2024-04-26T10:21:43.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4394000000000003e-05 2024-04-26T10:21:43.360 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.360 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.360 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.360 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:43.360 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:43.360 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.08465597, 2024-04-26T10:21:43.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018369330999999999, 2024-04-26T10:21:43.360 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.360 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.360 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.360 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:43.360 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:43.361 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117 2024-04-26T10:21:43.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.361 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:43.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:43.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239252+0000", 2024-04-26T10:21:43.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239267+0000", 2024-04-26T10:21:43.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4562999999999999e-05 2024-04-26T10:21:43.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239281+0000", 2024-04-26T10:21:43.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4e-05 2024-04-26T10:21:43.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239296+0000", 2024-04-26T10:21:43.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5492999999999999e-05 2024-04-26T10:21:43.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254076+0000", 2024-04-26T10:21:43.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014779814 2024-04-26T10:21:43.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254159+0000", 2024-04-26T10:21:43.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2923999999999994e-05 2024-04-26T10:21:43.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254279+0000", 2024-04-26T10:21:43.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011964300000000001 2024-04-26T10:21:43.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.256043+0000", 2024-04-26T10:21:43.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001764353 2024-04-26T10:21:43.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257559+0000", 2024-04-26T10:21:43.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015159189999999999 2024-04-26T10:21:43.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257597+0000", 2024-04-26T10:21:43.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8031999999999998e-05 2024-04-26T10:21:43.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257622+0000", 2024-04-26T10:21:43.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5213999999999999e-05 2024-04-26T10:21:43.365 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.365 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.365 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.365 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:43.366 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:43.366 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.872551594000001, 2024-04-26T10:21:43.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015980181999999999, 2024-04-26T10:21:43.366 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.366 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.366 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.366 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:43.366 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:43.366 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 141 2024-04-26T10:21:43.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.366 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:43.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:43.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451356+0000", 2024-04-26T10:21:43.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451362+0000", 2024-04-26T10:21:43.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:21:43.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451371+0000", 2024-04-26T10:21:43.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1829999999999994e-06 2024-04-26T10:21:43.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451377+0000", 2024-04-26T10:21:43.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7599999999999997e-06 2024-04-26T10:21:43.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463727+0000", 2024-04-26T10:21:43.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012349646000000001 2024-04-26T10:21:43.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463780+0000", 2024-04-26T10:21:43.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2645999999999997e-05 2024-04-26T10:21:43.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463874+0000", 2024-04-26T10:21:43.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4097000000000004e-05 2024-04-26T10:21:43.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.466138+0000", 2024-04-26T10:21:43.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022642690000000002 2024-04-26T10:21:43.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467281+0000", 2024-04-26T10:21:43.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011428510000000001 2024-04-26T10:21:43.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467315+0000", 2024-04-26T10:21:43.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4032999999999998e-05 2024-04-26T10:21:43.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467337+0000", 2024-04-26T10:21:43.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2444000000000001e-05 2024-04-26T10:21:43.371 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.371 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.371 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.372 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:43.372 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:43.372 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.674103023000001, 2024-04-26T10:21:43.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015587541, 2024-04-26T10:21:43.372 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.372 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.372 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.372 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:43.372 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:43.372 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 163 2024-04-26T10:21:43.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.372 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:43.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:43.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649805+0000", 2024-04-26T10:21:43.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649813+0000", 2024-04-26T10:21:43.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3319999999999992e-06 2024-04-26T10:21:43.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649851+0000", 2024-04-26T10:21:43.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7852999999999998e-05 2024-04-26T10:21:43.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649865+0000", 2024-04-26T10:21:43.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3626e-05 2024-04-26T10:21:43.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662071+0000", 2024-04-26T10:21:43.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01220689 2024-04-26T10:21:43.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662210+0000", 2024-04-26T10:21:43.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013893 2024-04-26T10:21:43.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662397+0000", 2024-04-26T10:21:43.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018690499999999999 2024-04-26T10:21:43.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664685+0000", 2024-04-26T10:21:43.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022876179999999999 2024-04-26T10:21:43.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665327+0000", 2024-04-26T10:21:43.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00064178900000000003 2024-04-26T10:21:43.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665365+0000", 2024-04-26T10:21:43.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8244999999999997e-05 2024-04-26T10:21:43.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665393+0000", 2024-04-26T10:21:43.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8232e-05 2024-04-26T10:21:43.378 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.378 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.378 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.378 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:43.378 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:43.378 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.674028376999999, 2024-04-26T10:21:43.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016970263999999999, 2024-04-26T10:21:43.378 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.378 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.378 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.378 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:43.379 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:43.379 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 164 2024-04-26T10:21:43.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.379 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:43.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:43.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649879+0000", 2024-04-26T10:21:43.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649963+0000", 2024-04-26T10:21:43.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4141999999999995e-05 2024-04-26T10:21:43.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649975+0000", 2024-04-26T10:21:43.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1416e-05 2024-04-26T10:21:43.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649983+0000", 2024-04-26T10:21:43.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8469999999999996e-06 2024-04-26T10:21:43.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662854+0000", 2024-04-26T10:21:43.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012871871999999999 2024-04-26T10:21:43.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662965+0000", 2024-04-26T10:21:43.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110413 2024-04-26T10:21:43.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.663109+0000", 2024-04-26T10:21:43.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144115 2024-04-26T10:21:43.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665992+0000", 2024-04-26T10:21:43.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028827340000000001 2024-04-26T10:21:43.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666784+0000", 2024-04-26T10:21:43.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00079253799999999997 2024-04-26T10:21:43.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666824+0000", 2024-04-26T10:21:43.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0139000000000003e-05 2024-04-26T10:21:43.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666851+0000", 2024-04-26T10:21:43.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6171999999999999e-05 2024-04-26T10:21:43.384 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.384 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.384 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.384 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:43.384 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:43.384 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.673917297000003, 2024-04-26T10:21:43.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019547338000000001, 2024-04-26T10:21:43.384 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.384 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.384 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.384 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:43.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:43.385 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165 2024-04-26T10:21:43.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.385 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:43.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:43.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:43.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649996+0000", 2024-04-26T10:21:43.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-04-26T10:21:43.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650021+0000", 2024-04-26T10:21:43.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5179999999999999e-05 2024-04-26T10:21:43.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650030+0000", 2024-04-26T10:21:43.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-04-26T10:21:43.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664733+0000", 2024-04-26T10:21:43.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014703097 2024-04-26T10:21:43.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664821+0000", 2024-04-26T10:21:43.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7918999999999996e-05 2024-04-26T10:21:43.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664953+0000", 2024-04-26T10:21:43.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132662 2024-04-26T10:21:43.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666776+0000", 2024-04-26T10:21:43.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018225509999999999 2024-04-26T10:21:43.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669480+0000", 2024-04-26T10:21:43.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00270382 2024-04-26T10:21:43.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669515+0000", 2024-04-26T10:21:43.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4885000000000002e-05 2024-04-26T10:21:43.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669539+0000", 2024-04-26T10:21:43.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4121000000000002e-05 2024-04-26T10:21:43.390 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.390 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.390 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.390 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:184 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:43.390 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:43.390 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.484423217, 2024-04-26T10:21:43.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015260631, 2024-04-26T10:21:43.390 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.391 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.391 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.391 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:43.391 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:43.391 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 184 2024-04-26T10:21:43.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.391 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:43.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:43.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839485+0000", 2024-04-26T10:21:43.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839493+0000", 2024-04-26T10:21:43.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7300000000000005e-06 2024-04-26T10:21:43.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839501+0000", 2024-04-26T10:21:43.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2940000000000006e-06 2024-04-26T10:21:43.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839508+0000", 2024-04-26T10:21:43.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6660000000000002e-06 2024-04-26T10:21:43.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.849315+0000", 2024-04-26T10:21:43.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0098072650000000008 2024-04-26T10:21:43.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.849564+0000", 2024-04-26T10:21:43.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024928800000000002 2024-04-26T10:21:43.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.849772+0000", 2024-04-26T10:21:43.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020795199999999999 2024-04-26T10:21:43.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853646+0000", 2024-04-26T10:21:43.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038744090000000001 2024-04-26T10:21:43.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854530+0000", 2024-04-26T10:21:43.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00088391200000000004 2024-04-26T10:21:43.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854623+0000", 2024-04-26T10:21:43.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2229000000000001e-05 2024-04-26T10:21:43.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854746+0000", 2024-04-26T10:21:43.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012354299999999999 2024-04-26T10:21:43.396 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.396 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.396 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.396 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:43.396 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:43.396 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.484394188000003, 2024-04-26T10:21:43.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017833541000000001, 2024-04-26T10:21:43.397 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.397 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:43.397 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:43.397 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185 2024-04-26T10:21:43.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.397 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:43.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:43.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839514+0000", 2024-04-26T10:21:43.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839612+0000", 2024-04-26T10:21:43.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7880999999999993e-05 2024-04-26T10:21:43.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839623+0000", 2024-04-26T10:21:43.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0917000000000001e-05 2024-04-26T10:21:43.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839632+0000", 2024-04-26T10:21:43.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0999999999999993e-06 2024-04-26T10:21:43.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850382+0000", 2024-04-26T10:21:43.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010750335 2024-04-26T10:21:43.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850502+0000", 2024-04-26T10:21:43.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120183 2024-04-26T10:21:43.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850685+0000", 2024-04-26T10:21:43.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000182442 2024-04-26T10:21:43.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854396+0000", 2024-04-26T10:21:43.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037114819999999999 2024-04-26T10:21:43.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857233+0000", 2024-04-26T10:21:43.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002836514 2024-04-26T10:21:43.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857300+0000", 2024-04-26T10:21:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6842999999999997e-05 2024-04-26T10:21:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857348+0000", 2024-04-26T10:21:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8504000000000002e-05 2024-04-26T10:21:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:43.402 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.484267836999997, 2024-04-26T10:21:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018757273000000001, 2024-04-26T10:21:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 186 2024-04-26T10:21:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839640+0000", 2024-04-26T10:21:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839646+0000", 2024-04-26T10:21:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:21:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839654+0000", 2024-04-26T10:21:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:21:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839661+0000", 2024-04-26T10:21:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.64e-06 2024-04-26T10:21:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852328+0000", 2024-04-26T10:21:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012667151 2024-04-26T10:21:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852538+0000", 2024-04-26T10:21:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020961100000000001 2024-04-26T10:21:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852945+0000", 2024-04-26T10:21:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040712099999999998 2024-04-26T10:21:43.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857372+0000", 2024-04-26T10:21:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044268049999999998 2024-04-26T10:21:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858321+0000", 2024-04-26T10:21:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094932999999999997 2024-04-26T10:21:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858367+0000", 2024-04-26T10:21:43.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5534000000000001e-05 2024-04-26T10:21:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858398+0000", 2024-04-26T10:21:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1562e-05 2024-04-26T10:21:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.484240671000002, 2024-04-26T10:21:43.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019669504000000001, 2024-04-26T10:21:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187 2024-04-26T10:21:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839667+0000", 2024-04-26T10:21:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839677+0000", 2024-04-26T10:21:43.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3270000000000007e-06 2024-04-26T10:21:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839685+0000", 2024-04-26T10:21:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2670000000000006e-06 2024-04-26T10:21:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839692+0000", 2024-04-26T10:21:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7129999999999999e-06 2024-04-26T10:21:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853685+0000", 2024-04-26T10:21:43.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013993716999999999 2024-04-26T10:21:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853876+0000", 2024-04-26T10:21:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019097100000000001 2024-04-26T10:21:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853989+0000", 2024-04-26T10:21:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011275199999999999 2024-04-26T10:21:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857377+0000", 2024-04-26T10:21:43.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033882489999999999 2024-04-26T10:21:43.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859222+0000", 2024-04-26T10:21:43.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001844233 2024-04-26T10:21:43.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859291+0000", 2024-04-26T10:21:43.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:21:43.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859338+0000", 2024-04-26T10:21:43.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6366000000000003e-05 2024-04-26T10:21:43.414 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.414 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.414 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.414 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:43.414 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:43.414 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.484209804999999, 2024-04-26T10:21:43.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019837468, 2024-04-26T10:21:43.414 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 188 2024-04-26T10:21:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:43.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839698+0000", 2024-04-26T10:21:43.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839829+0000", 2024-04-26T10:21:43.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013061099999999999 2024-04-26T10:21:43.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839853+0000", 2024-04-26T10:21:43.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3736000000000001e-05 2024-04-26T10:21:43.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839863+0000", 2024-04-26T10:21:43.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:43.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854869+0000", 2024-04-26T10:21:43.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015005978 2024-04-26T10:21:43.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854959+0000", 2024-04-26T10:21:43.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9468999999999993e-05 2024-04-26T10:21:43.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855114+0000", 2024-04-26T10:21:43.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015563799999999999 2024-04-26T10:21:43.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857386+0000", 2024-04-26T10:21:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002271852 2024-04-26T10:21:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859406+0000", 2024-04-26T10:21:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002019936 2024-04-26T10:21:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859461+0000", 2024-04-26T10:21:43.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4826e-05 2024-04-26T10:21:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859536+0000", 2024-04-26T10:21:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5566000000000001e-05 2024-04-26T10:21:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.484035941999998, 2024-04-26T10:21:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019826496999999998, 2024-04-26T10:21:43.420 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.421 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.421 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.421 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:43.421 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:43.421 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 189 2024-04-26T10:21:43.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.421 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:43.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839872+0000", 2024-04-26T10:21:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839882+0000", 2024-04-26T10:21:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:43.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839892+0000", 2024-04-26T10:21:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.217e-06 2024-04-26T10:21:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839900+0000", 2024-04-26T10:21:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5469999999999997e-06 2024-04-26T10:21:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855903+0000", 2024-04-26T10:21:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016002590000000001 2024-04-26T10:21:43.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856110+0000", 2024-04-26T10:21:43.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020711199999999999 2024-04-26T10:21:43.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856421+0000", 2024-04-26T10:21:43.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031128500000000001 2024-04-26T10:21:43.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857643+0000", 2024-04-26T10:21:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012215520000000001 2024-04-26T10:21:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859603+0000", 2024-04-26T10:21:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019600350000000002 2024-04-26T10:21:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859660+0000", 2024-04-26T10:21:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6857999999999997e-05 2024-04-26T10:21:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859699+0000", 2024-04-26T10:21:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9641999999999998e-05 2024-04-26T10:21:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15562 5.f 5:f08fe41e:::benchmark_data_smithi052_19421_object15561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3310203119999997, 2024-04-26T10:21:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015831088, 2024-04-26T10:21:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.426 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15562 2024-04-26T10:21:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992927+0000", 2024-04-26T10:21:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9285000000000001e-05 2024-04-26T10:21:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992940+0000", 2024-04-26T10:21:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3040999999999999e-05 2024-04-26T10:21:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992948+0000", 2024-04-26T10:21:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5850000000000002e-06 2024-04-26T10:21:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.997631+0000", 2024-04-26T10:21:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046834160000000001 2024-04-26T10:21:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.997851+0000", 2024-04-26T10:21:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000220416 2024-04-26T10:21:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.998105+0000", 2024-04-26T10:21:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025348599999999998 2024-04-26T10:21:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.004264+0000", 2024-04-26T10:21:43.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061588499999999996 2024-04-26T10:21:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008560+0000", 2024-04-26T10:21:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042958579999999996 2024-04-26T10:21:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008647+0000", 2024-04-26T10:21:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7609999999999996e-05 2024-04-26T10:21:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008719+0000", 2024-04-26T10:21:43.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2336000000000007e-05 2024-04-26T10:21:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15563 5.f 5:f98d3bb0:::benchmark_data_smithi052_19421_object15562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.993442+0000", 2024-04-26T10:21:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3304663200000002, 2024-04-26T10:21:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015592195999999999, 2024-04-26T10:21:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:43.432 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15563 2024-04-26T10:21:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993442+0000", 2024-04-26T10:21:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993442+0000", 2024-04-26T10:21:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993441+0000", 2024-04-26T10:21:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993494+0000", 2024-04-26T10:21:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2369e-05 2024-04-26T10:21:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993515+0000", 2024-04-26T10:21:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1274e-05 2024-04-26T10:21:43.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993528+0000", 2024-04-26T10:21:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2858e-05 2024-04-26T10:21:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.000547+0000", 2024-04-26T10:21:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070196010000000003 2024-04-26T10:21:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.000660+0000", 2024-04-26T10:21:43.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112273 2024-04-26T10:21:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.000757+0000", 2024-04-26T10:21:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6965000000000004e-05 2024-04-26T10:21:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.006425+0000", 2024-04-26T10:21:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056687639999999997 2024-04-26T10:21:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008907+0000", 2024-04-26T10:21:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024819289999999999 2024-04-26T10:21:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008993+0000", 2024-04-26T10:21:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5426999999999994e-05 2024-04-26T10:21:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.009035+0000", 2024-04-26T10:21:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1912000000000001e-05 2024-04-26T10:21:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.437 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15564 5.f 5:f61b0088:::benchmark_data_smithi052_19421_object15563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3295182910000003, 2024-04-26T10:21:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017729826000000001, 2024-04-26T10:21:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15564 2024-04-26T10:21:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.438 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994389+0000", 2024-04-26T10:21:43.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994451+0000", 2024-04-26T10:21:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2032999999999994e-05 2024-04-26T10:21:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994477+0000", 2024-04-26T10:21:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5267999999999999e-05 2024-04-26T10:21:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994486+0000", 2024-04-26T10:21:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9420000000000001e-06 2024-04-26T10:21:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001578+0000", 2024-04-26T10:21:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070928110000000001 2024-04-26T10:21:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001748+0000", 2024-04-26T10:21:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016944099999999999 2024-04-26T10:21:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001914+0000", 2024-04-26T10:21:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000166546 2024-04-26T10:21:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.006488+0000", 2024-04-26T10:21:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045735460000000004 2024-04-26T10:21:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012034+0000", 2024-04-26T10:21:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055461449999999997 2024-04-26T10:21:43.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012085+0000", 2024-04-26T10:21:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1319000000000001e-05 2024-04-26T10:21:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012120+0000", 2024-04-26T10:21:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4904999999999999e-05 2024-04-26T10:21:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15567 5.f 5:f5b92a5d:::benchmark_data_smithi052_19421_object15566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.996077+0000", 2024-04-26T10:21:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3278318530000002, 2024-04-26T10:21:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016208895000000001, 2024-04-26T10:21:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15567 2024-04-26T10:21:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996077+0000", 2024-04-26T10:21:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996077+0000", 2024-04-26T10:21:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996076+0000", 2024-04-26T10:21:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996139+0000", 2024-04-26T10:21:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2929999999999995e-05 2024-04-26T10:21:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996155+0000", 2024-04-26T10:21:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6076e-05 2024-04-26T10:21:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996163+0000", 2024-04-26T10:21:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0320000000000003e-06 2024-04-26T10:21:43.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.002727+0000", 2024-04-26T10:21:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065644240000000001 2024-04-26T10:21:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.002901+0000", 2024-04-26T10:21:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017414899999999999 2024-04-26T10:21:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.003080+0000", 2024-04-26T10:21:43.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017905199999999999 2024-04-26T10:21:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.009066+0000", 2024-04-26T10:21:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059855309999999997 2024-04-26T10:21:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012182+0000", 2024-04-26T10:21:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003116462 2024-04-26T10:21:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012230+0000", 2024-04-26T10:21:43.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7681e-05 2024-04-26T10:21:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012286+0000", 2024-04-26T10:21:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5763999999999997e-05 2024-04-26T10:21:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:43.449 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:43.449 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:43.451 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:43.451 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:43.449+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:43.552 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:43.548+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:43.581 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:27431 5.d e27/22 5:b398cdfb:::benchmark_data_smithi052_19421_object27430:head v 27'1766, mlcod=27'1764)", 2024-04-26T10:21:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:43.578535+0000", 2024-04-26T10:21:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0034959230000000002, 2024-04-26T10:21:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0035139979999999999, 2024-04-26T10:21:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.578535+0000", 2024-04-26T10:21:43.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.578535+0000", 2024-04-26T10:21:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.578534+0000", 2024-04-26T10:21:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.578563+0000", 2024-04-26T10:21:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8989999999999999e-05 2024-04-26T10:21:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.578571+0000", 2024-04-26T10:21:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3660000000000003e-06 2024-04-26T10:21:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.578575+0000", 2024-04-26T10:21:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6229999999999996e-06 2024-04-26T10:21:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.578620+0000", 2024-04-26T10:21:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4737999999999998e-05 2024-04-26T10:21:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.578634+0000", 2024-04-26T10:21:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3823e-05 2024-04-26T10:21:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.585 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:27434 5.e e27/22 5:74e849f6:::benchmark_data_smithi052_19421_object27433:head v 27'1729, mlcod=27'1725)", 2024-04-26T10:21:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:43.580157+0000", 2024-04-26T10:21:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0018738209999999999, 2024-04-26T10:21:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0019350070000000001, 2024-04-26T10:21:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.580157+0000", 2024-04-26T10:21:43.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.580157+0000", 2024-04-26T10:21:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.580156+0000", 2024-04-26T10:21:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.580245+0000", 2024-04-26T10:21:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9167999999999997e-05 2024-04-26T10:21:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.580260+0000", 2024-04-26T10:21:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4633e-05 2024-04-26T10:21:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.580267+0000", 2024-04-26T10:21:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6939999999999998e-06 2024-04-26T10:21:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.580293+0000", 2024-04-26T10:21:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6299999999999999e-05 2024-04-26T10:21:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.580311+0000", 2024-04-26T10:21:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7972999999999999e-05 2024-04-26T10:21:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:27436 5.b e27/22 5:dfd62539:::benchmark_data_smithi052_19421_object27435:head v 27'1738, mlcod=27'1734)", 2024-04-26T10:21:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:43.581645+0000", 2024-04-26T10:21:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00038626699999999998, 2024-04-26T10:21:43.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000484716, 2024-04-26T10:21:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.581645+0000", 2024-04-26T10:21:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.581645+0000", 2024-04-26T10:21:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.581644+0000", 2024-04-26T10:21:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.581756+0000", 2024-04-26T10:21:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111838 2024-04-26T10:21:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.581764+0000", 2024-04-26T10:21:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8229999999999995e-06 2024-04-26T10:21:43.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.581769+0000", 2024-04-26T10:21:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3979999999999998e-06 2024-04-26T10:21:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.581804+0000", 2024-04-26T10:21:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4557000000000001e-05 2024-04-26T10:21:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:43.581838+0000", 2024-04-26T10:21:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4743000000000003e-05 2024-04-26T10:21:43.592 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:21:43.593 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 3 2024-04-26T10:21:43.593 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:43.594 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:43.595 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T10:21:43.613 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 10 16 27510 27494 171.818 156.188 0.00400346 0.00581317 2024-04-26T10:21:43.653 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:43.649+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:43.716 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:43.716 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:21:43.717 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:21:43.717 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:21:43.717 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:43.730 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:43.775 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:43.772+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:43.852 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:43.852 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:21:43.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:21:43.852 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:43.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.853 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:43.853 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:43.853 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.546978514000003, 2024-04-26T10:21:43.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018441564000000001, 2024-04-26T10:21:43.853 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.853 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.854 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:43.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:43.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301372+0000", 2024-04-26T10:21:43.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:43.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301399+0000", 2024-04-26T10:21:43.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7039999999999999e-05 2024-04-26T10:21:43.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301426+0000", 2024-04-26T10:21:43.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6381e-05 2024-04-26T10:21:43.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301480+0000", 2024-04-26T10:21:43.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3681000000000003e-05 2024-04-26T10:21:43.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310584+0000", 2024-04-26T10:21:43.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091042339999999992 2024-04-26T10:21:43.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.860 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:43.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310591+0000", 2024-04-26T10:21:43.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8190000000000003e-06 2024-04-26T10:21:43.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311503+0000", 2024-04-26T10:21:43.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000911983 2024-04-26T10:21:43.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311605+0000", 2024-04-26T10:21:43.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102619 2024-04-26T10:21:43.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.863 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:43.863 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311730+0000", 2024-04-26T10:21:43.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012474400000000001 2024-04-26T10:21:43.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:43.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317287+0000", 2024-04-26T10:21:43.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055571140000000002 2024-04-26T10:21:43.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319724+0000", 2024-04-26T10:21:43.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002437294 2024-04-26T10:21:43.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319776+0000", 2024-04-26T10:21:43.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1992e-05 2024-04-26T10:21:43.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319816+0000", 2024-04-26T10:21:43.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9709999999999998e-05 2024-04-26T10:21:43.869 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.869 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.869 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.870 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:43.870 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:43.870 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.541662647999999, 2024-04-26T10:21:43.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013786338, 2024-04-26T10:21:43.870 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.870 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.870 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:43.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:43.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306689+0000", 2024-04-26T10:21:43.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306697+0000", 2024-04-26T10:21:43.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2420000000000003e-06 2024-04-26T10:21:43.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306725+0000", 2024-04-26T10:21:43.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8209e-05 2024-04-26T10:21:43.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306750+0000", 2024-04-26T10:21:43.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5432e-05 2024-04-26T10:21:43.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310622+0000", 2024-04-26T10:21:43.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003871738 2024-04-26T10:21:43.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:21:43.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310627+0000", 2024-04-26T10:21:43.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4890000000000003e-06 2024-04-26T10:21:43.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314030+0000", 2024-04-26T10:21:43.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003402094 2024-04-26T10:21:43.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314147+0000", 2024-04-26T10:21:43.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011776499999999999 2024-04-26T10:21:43.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:43.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314441+0000", 2024-04-26T10:21:43.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000293543 2024-04-26T10:21:43.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:43.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319422+0000", 2024-04-26T10:21:43.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004981096 2024-04-26T10:21:43.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320057+0000", 2024-04-26T10:21:43.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000635521 2024-04-26T10:21:43.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320110+0000", 2024-04-26T10:21:43.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2104999999999997e-05 2024-04-26T10:21:43.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320477+0000", 2024-04-26T10:21:43.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036709500000000001 2024-04-26T10:21:43.876 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.876 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.876 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.876 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:43.876 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:43.876 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.541569287000002, 2024-04-26T10:21:43.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013859405999999999, 2024-04-26T10:21:43.876 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.876 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.876 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:43.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:43.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306783+0000", 2024-04-26T10:21:43.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306788+0000", 2024-04-26T10:21:43.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3990000000000003e-06 2024-04-26T10:21:43.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306796+0000", 2024-04-26T10:21:43.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8820000000000001e-06 2024-04-26T10:21:43.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306803+0000", 2024-04-26T10:21:43.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6649999999999997e-06 2024-04-26T10:21:43.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314454+0000", 2024-04-26T10:21:43.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076508349999999999 2024-04-26T10:21:43.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314930+0000", 2024-04-26T10:21:43.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047624199999999998 2024-04-26T10:21:43.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:43.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315127+0000", 2024-04-26T10:21:43.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196751 2024-04-26T10:21:43.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:43.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320496+0000", 2024-04-26T10:21:43.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053690150000000004 2024-04-26T10:21:43.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320576+0000", 2024-04-26T10:21:43.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0327999999999994e-05 2024-04-26T10:21:43.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320611+0000", 2024-04-26T10:21:43.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-04-26T10:21:43.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320643+0000", 2024-04-26T10:21:43.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2474000000000001e-05 2024-04-26T10:21:43.881 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.881 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.881 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.881 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:43.882 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:43.882 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.541490115999999, 2024-04-26T10:21:43.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013889195, 2024-04-26T10:21:43.882 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.882 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.882 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:43.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:43.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306862+0000", 2024-04-26T10:21:43.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306867+0000", 2024-04-26T10:21:43.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5390000000000001e-06 2024-04-26T10:21:43.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306874+0000", 2024-04-26T10:21:43.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7549999999999997e-06 2024-04-26T10:21:43.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306887+0000", 2024-04-26T10:21:43.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.313e-05 2024-04-26T10:21:43.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315477+0000", 2024-04-26T10:21:43.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085902489999999995 2024-04-26T10:21:43.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315607+0000", 2024-04-26T10:21:43.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129789 2024-04-26T10:21:43.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:43.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315767+0000", 2024-04-26T10:21:43.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016052699999999999 2024-04-26T10:21:43.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:43.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320502+0000", 2024-04-26T10:21:43.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00473421 2024-04-26T10:21:43.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320691+0000", 2024-04-26T10:21:43.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018938900000000001 2024-04-26T10:21:43.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320721+0000", 2024-04-26T10:21:43.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9677000000000001e-05 2024-04-26T10:21:43.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320752+0000", 2024-04-26T10:21:43.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1486000000000003e-05 2024-04-26T10:21:43.887 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.887 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.887 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.887 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:43.887 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:43.887 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.541452198000002, 2024-04-26T10:21:43.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012590871, 2024-04-26T10:21:43.887 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.887 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.887 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:43.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:43.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306900+0000", 2024-04-26T10:21:43.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306905+0000", 2024-04-26T10:21:43.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9010000000000002e-06 2024-04-26T10:21:43.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306911+0000", 2024-04-26T10:21:43.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6030000000000004e-06 2024-04-26T10:21:43.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306916+0000", 2024-04-26T10:21:43.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8539999999999996e-06 2024-04-26T10:21:43.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308529+0000", 2024-04-26T10:21:43.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001613258 2024-04-26T10:21:43.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:43.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308537+0000", 2024-04-26T10:21:43.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1680000000000004e-06 2024-04-26T10:21:43.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311962+0000", 2024-04-26T10:21:43.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034247290000000001 2024-04-26T10:21:43.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.312092+0000", 2024-04-26T10:21:43.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013048700000000001 2024-04-26T10:21:43.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:43.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.312438+0000", 2024-04-26T10:21:43.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00034558700000000001 2024-04-26T10:21:43.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:43.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317984+0000", 2024-04-26T10:21:43.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005546067 2024-04-26T10:21:43.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319373+0000", 2024-04-26T10:21:43.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001389426 2024-04-26T10:21:43.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319438+0000", 2024-04-26T10:21:43.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4849000000000002e-05 2024-04-26T10:21:43.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319492+0000", 2024-04-26T10:21:43.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3554000000000003e-05 2024-04-26T10:21:43.893 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.893 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.893 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.893 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:43.893 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:43.893 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.539781615000003, 2024-04-26T10:21:43.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011321652999999999, 2024-04-26T10:21:43.893 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.894 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.894 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:43.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:43.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:43.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308576+0000", 2024-04-26T10:21:43.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2920000000000003e-06 2024-04-26T10:21:43.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308582+0000", 2024-04-26T10:21:43.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6540000000000002e-06 2024-04-26T10:21:43.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308590+0000", 2024-04-26T10:21:43.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-04-26T10:21:43.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308958+0000", 2024-04-26T10:21:43.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036823500000000001 2024-04-26T10:21:43.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.896 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:21:43.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308963+0000", 2024-04-26T10:21:43.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6160000000000001e-06 2024-04-26T10:21:43.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.313758+0000", 2024-04-26T10:21:43.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004794296 2024-04-26T10:21:43.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.313848+0000", 2024-04-26T10:21:43.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0488999999999994e-05 2024-04-26T10:21:43.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:43.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314099+0000", 2024-04-26T10:21:43.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025094700000000001 2024-04-26T10:21:43.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:43.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.318989+0000", 2024-04-26T10:21:43.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048896850000000004 2024-04-26T10:21:43.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319799+0000", 2024-04-26T10:21:43.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00080979299999999995 2024-04-26T10:21:43.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319847+0000", 2024-04-26T10:21:43.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8254999999999998e-05 2024-04-26T10:21:43.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319893+0000", 2024-04-26T10:21:43.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6108e-05 2024-04-26T10:21:43.899 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.899 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.899 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.900 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:43.900 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:43.900 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.539659766, 2024-04-26T10:21:43.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012032891, 2024-04-26T10:21:43.900 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.900 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.900 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:43.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:43.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:43.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308697+0000", 2024-04-26T10:21:43.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4449999999999998e-06 2024-04-26T10:21:43.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308864+0000", 2024-04-26T10:21:43.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000167045 2024-04-26T10:21:43.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308886+0000", 2024-04-26T10:21:43.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1858999999999999e-05 2024-04-26T10:21:43.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316346+0000", 2024-04-26T10:21:43.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007460225 2024-04-26T10:21:43.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316500+0000", 2024-04-26T10:21:43.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153776 2024-04-26T10:21:43.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:43.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316665+0000", 2024-04-26T10:21:43.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000164854 2024-04-26T10:21:43.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:43.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320564+0000", 2024-04-26T10:21:43.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038988339999999999 2024-04-26T10:21:43.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:43.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320680+0000", 2024-04-26T10:21:43.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011616399999999999 2024-04-26T10:21:43.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320710+0000", 2024-04-26T10:21:43.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0182e-05 2024-04-26T10:21:43.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320726+0000", 2024-04-26T10:21:43.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6118000000000001e-05 2024-04-26T10:21:43.905 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.905 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.905 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.905 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:15562 5.f e26/22 5:f08fe41e:::benchmark_data_smithi052_19421_object15561:head v 26'996, mlcod=26'994)", 2024-04-26T10:21:43.905 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:38.999553+0000", 2024-04-26T10:21:43.905 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8488002540000004, 2024-04-26T10:21:43.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010040301, 2024-04-26T10:21:43.906 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.906 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.906 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999553+0000", 2024-04-26T10:21:43.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999553+0000", 2024-04-26T10:21:43.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999551+0000", 2024-04-26T10:21:43.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:43.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999614+0000", 2024-04-26T10:21:43.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2706999999999994e-05 2024-04-26T10:21:43.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999634+0000", 2024-04-26T10:21:43.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9760999999999999e-05 2024-04-26T10:21:43.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999644+0000", 2024-04-26T10:21:43.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0756e-05 2024-04-26T10:21:43.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999719+0000", 2024-04-26T10:21:43.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4643999999999999e-05 2024-04-26T10:21:43.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999757+0000", 2024-04-26T10:21:43.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.858e-05 2024-04-26T10:21:43.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.009553+0000", 2024-04-26T10:21:43.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097958790000000004 2024-04-26T10:21:43.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.009593+0000", 2024-04-26T10:21:43.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9677e-05 2024-04-26T10:21:43.909 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.909 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.909 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.910 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:15776 5.d e26/22 5:b9043162:::benchmark_data_smithi052_19421_object15775:head v 26'993, mlcod=26'987)", 2024-04-26T10:21:43.910 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.091139+0000", 2024-04-26T10:21:43.910 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.7572141989999999, 2024-04-26T10:21:43.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098124079999999999, 2024-04-26T10:21:43.910 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.910 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.910 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.091139+0000", 2024-04-26T10:21:43.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.091139+0000", 2024-04-26T10:21:43.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.091137+0000", 2024-04-26T10:21:43.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:43.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.091223+0000", 2024-04-26T10:21:43.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5687999999999997e-05 2024-04-26T10:21:43.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.091240+0000", 2024-04-26T10:21:43.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6460000000000002e-05 2024-04-26T10:21:43.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.091249+0000", 2024-04-26T10:21:43.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6220000000000004e-06 2024-04-26T10:21:43.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.094310+0000", 2024-04-26T10:21:43.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030610839999999999 2024-04-26T10:21:43.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.094346+0000", 2024-04-26T10:21:43.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5472999999999997e-05 2024-04-26T10:21:43.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.100849+0000", 2024-04-26T10:21:43.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006502921 2024-04-26T10:21:43.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.100951+0000", 2024-04-26T10:21:43.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102562 2024-04-26T10:21:43.915 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.915 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.915 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.915 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17046 5.8 e26/22 5:18ede56e:::benchmark_data_smithi052_19421_object17045:head v 26'1090, mlcod=26'1088)", 2024-04-26T10:21:43.915 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.548338+0000", 2024-04-26T10:21:43.915 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3000146859999999, 2024-04-26T10:21:43.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010012109999999999, 2024-04-26T10:21:43.915 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.915 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.916 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548338+0000", 2024-04-26T10:21:43.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548338+0000", 2024-04-26T10:21:43.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548337+0000", 2024-04-26T10:21:43.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548399+0000", 2024-04-26T10:21:43.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1179000000000005e-05 2024-04-26T10:21:43.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548411+0000", 2024-04-26T10:21:43.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2191999999999999e-05 2024-04-26T10:21:43.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548419+0000", 2024-04-26T10:21:43.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8960000000000003e-06 2024-04-26T10:21:43.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548465+0000", 2024-04-26T10:21:43.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6251999999999997e-05 2024-04-26T10:21:43.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548534+0000", 2024-04-26T10:21:43.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9241999999999999e-05 2024-04-26T10:21:43.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.558299+0000", 2024-04-26T10:21:43.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097651000000000005 2024-04-26T10:21:43.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.558350+0000", 2024-04-26T10:21:43.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1119999999999998e-05 2024-04-26T10:21:43.919 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.919 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.919 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.919 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17045 5.0 e26/22 5:03aa7fc4:::benchmark_data_smithi052_19421_object17044:head v 26'998, mlcod=26'995)", 2024-04-26T10:21:43.919 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.548440+0000", 2024-04-26T10:21:43.919 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.2999130660000002, 2024-04-26T10:21:43.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099462109999999999, 2024-04-26T10:21:43.920 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.920 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.920 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548440+0000", 2024-04-26T10:21:43.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548440+0000", 2024-04-26T10:21:43.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548439+0000", 2024-04-26T10:21:43.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548504+0000", 2024-04-26T10:21:43.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4417000000000003e-05 2024-04-26T10:21:43.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548514+0000", 2024-04-26T10:21:43.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7459999999999995e-06 2024-04-26T10:21:43.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548520+0000", 2024-04-26T10:21:43.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5350000000000001e-06 2024-04-26T10:21:43.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548565+0000", 2024-04-26T10:21:43.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5235000000000003e-05 2024-04-26T10:21:43.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548661+0000", 2024-04-26T10:21:43.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5359000000000006e-05 2024-04-26T10:21:43.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.558355+0000", 2024-04-26T10:21:43.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096945269999999997 2024-04-26T10:21:43.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.558386+0000", 2024-04-26T10:21:43.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0910000000000001e-05 2024-04-26T10:21:43.923 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.923 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.924 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.924 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17047 5.9 e26/22 5:9051b83a:::benchmark_data_smithi052_19421_object17046:head v 26'1065, mlcod=26'1062)", 2024-04-26T10:21:43.924 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.548653+0000", 2024-04-26T10:21:43.924 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.2997004429999999, 2024-04-26T10:21:43.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096651910000000001, 2024-04-26T10:21:43.924 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.924 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.924 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548653+0000", 2024-04-26T10:21:43.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548653+0000", 2024-04-26T10:21:43.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548652+0000", 2024-04-26T10:21:43.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548722+0000", 2024-04-26T10:21:43.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0788000000000001e-05 2024-04-26T10:21:43.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548737+0000", 2024-04-26T10:21:43.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4541e-05 2024-04-26T10:21:43.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548748+0000", 2024-04-26T10:21:43.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1015999999999999e-05 2024-04-26T10:21:43.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548820+0000", 2024-04-26T10:21:43.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1830999999999997e-05 2024-04-26T10:21:43.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.548861+0000", 2024-04-26T10:21:43.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1768999999999999e-05 2024-04-26T10:21:43.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.558280+0000", 2024-04-26T10:21:43.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094187999999999997 2024-04-26T10:21:43.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.558318+0000", 2024-04-26T10:21:43.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7441999999999998e-05 2024-04-26T10:21:43.928 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.928 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.928 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.928 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17339 5.e e26/22 5:72e2fe32:::benchmark_data_smithi052_19421_object17338:head v 26'1109, mlcod=26'1106)", 2024-04-26T10:21:43.928 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.661438+0000", 2024-04-26T10:21:43.928 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.1869152740000004, 2024-04-26T10:21:43.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010169489, 2024-04-26T10:21:43.928 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.929 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.929 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661438+0000", 2024-04-26T10:21:43.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661438+0000", 2024-04-26T10:21:43.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661436+0000", 2024-04-26T10:21:43.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:43.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661484+0000", 2024-04-26T10:21:43.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7521999999999997e-05 2024-04-26T10:21:43.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661496+0000", 2024-04-26T10:21:43.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2368000000000001e-05 2024-04-26T10:21:43.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661505+0000", 2024-04-26T10:21:43.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3760000000000008e-06 2024-04-26T10:21:43.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661565+0000", 2024-04-26T10:21:43.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0384000000000003e-05 2024-04-26T10:21:43.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661598+0000", 2024-04-26T10:21:43.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2802999999999997e-05 2024-04-26T10:21:43.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.671560+0000", 2024-04-26T10:21:43.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099624180000000007 2024-04-26T10:21:43.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.671607+0000", 2024-04-26T10:21:43.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6931000000000002e-05 2024-04-26T10:21:43.932 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.932 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.932 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.932 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24842 5.0 e27/22 5:0a88cb3c:::benchmark_data_smithi052_19421_object24841:head v 27'1472, mlcod=27'1470)", 2024-04-26T10:21:43.932 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.545356+0000", 2024-04-26T10:21:43.933 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.302997167, 2024-04-26T10:21:43.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010303537, 2024-04-26T10:21:43.933 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.933 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.933 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545356+0000", 2024-04-26T10:21:43.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545356+0000", 2024-04-26T10:21:43.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545355+0000", 2024-04-26T10:21:43.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545413+0000", 2024-04-26T10:21:43.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8519e-05 2024-04-26T10:21:43.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545425+0000", 2024-04-26T10:21:43.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1844999999999999e-05 2024-04-26T10:21:43.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545433+0000", 2024-04-26T10:21:43.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6279999999999996e-06 2024-04-26T10:21:43.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545487+0000", 2024-04-26T10:21:43.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4523e-05 2024-04-26T10:21:43.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545524+0000", 2024-04-26T10:21:43.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6656000000000003e-05 2024-04-26T10:21:43.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555637+0000", 2024-04-26T10:21:43.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010113074999999999 2024-04-26T10:21:43.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555659+0000", 2024-04-26T10:21:43.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2379999999999999e-05 2024-04-26T10:21:43.936 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.936 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.937 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.937 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24843 5.8 e27/22 5:12cddf7e:::benchmark_data_smithi052_19421_object24842:head v 27'1588, mlcod=27'1586)", 2024-04-26T10:21:43.937 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.545451+0000", 2024-04-26T10:21:43.937 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.3029018530000001, 2024-04-26T10:21:43.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010159789000000001, 2024-04-26T10:21:43.937 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.937 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.937 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545451+0000", 2024-04-26T10:21:43.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545451+0000", 2024-04-26T10:21:43.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545451+0000", 2024-04-26T10:21:43.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545506+0000", 2024-04-26T10:21:43.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5708999999999998e-05 2024-04-26T10:21:43.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545527+0000", 2024-04-26T10:21:43.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0927000000000001e-05 2024-04-26T10:21:43.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545541+0000", 2024-04-26T10:21:43.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4008999999999999e-05 2024-04-26T10:21:43.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545600+0000", 2024-04-26T10:21:43.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8885999999999998e-05 2024-04-26T10:21:43.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545638+0000", 2024-04-26T10:21:43.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7546999999999998e-05 2024-04-26T10:21:43.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555568+0000", 2024-04-26T10:21:43.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099299090000000007 2024-04-26T10:21:43.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555611+0000", 2024-04-26T10:21:43.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3302e-05 2024-04-26T10:21:43.941 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.941 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.941 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.941 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24847 5.a e27/22 5:5eaae0d2:::benchmark_data_smithi052_19421_object24846:head v 27'1596, mlcod=27'1594)", 2024-04-26T10:21:43.941 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.545555+0000", 2024-04-26T10:21:43.941 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.302798262, 2024-04-26T10:21:43.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010033293, 2024-04-26T10:21:43.941 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.941 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.942 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545555+0000", 2024-04-26T10:21:43.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545555+0000", 2024-04-26T10:21:43.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545554+0000", 2024-04-26T10:21:43.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545596+0000", 2024-04-26T10:21:43.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1668999999999997e-05 2024-04-26T10:21:43.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545604+0000", 2024-04-26T10:21:43.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.473e-06 2024-04-26T10:21:43.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545611+0000", 2024-04-26T10:21:43.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5300000000000002e-06 2024-04-26T10:21:43.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545670+0000", 2024-04-26T10:21:43.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8653000000000002e-05 2024-04-26T10:21:43.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545724+0000", 2024-04-26T10:21:43.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4435999999999999e-05 2024-04-26T10:21:43.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555526+0000", 2024-04-26T10:21:43.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098015180000000004 2024-04-26T10:21:43.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555588+0000", 2024-04-26T10:21:43.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2440000000000005e-05 2024-04-26T10:21:43.945 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.945 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.945 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.945 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24855 5.d e27/22 5:ba6d2780:::benchmark_data_smithi052_19421_object24854:head v 27'1602, mlcod=27'1600)", 2024-04-26T10:21:43.945 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.545589+0000", 2024-04-26T10:21:43.945 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.302764305, 2024-04-26T10:21:43.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010064831, 2024-04-26T10:21:43.946 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.946 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.946 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545589+0000", 2024-04-26T10:21:43.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545589+0000", 2024-04-26T10:21:43.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545588+0000", 2024-04-26T10:21:43.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545644+0000", 2024-04-26T10:21:43.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6289000000000003e-05 2024-04-26T10:21:43.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545657+0000", 2024-04-26T10:21:43.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2826000000000001e-05 2024-04-26T10:21:43.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545666+0000", 2024-04-26T10:21:43.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1439999999999992e-06 2024-04-26T10:21:43.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545712+0000", 2024-04-26T10:21:43.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6105e-05 2024-04-26T10:21:43.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545726+0000", 2024-04-26T10:21:43.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3988000000000001e-05 2024-04-26T10:21:43.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555601+0000", 2024-04-26T10:21:43.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098745399999999994 2024-04-26T10:21:43.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555654+0000", 2024-04-26T10:21:43.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2850999999999999e-05 2024-04-26T10:21:43.949 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.949 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.949 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.950 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24852 5.9 e27/22 5:9011d5ec:::benchmark_data_smithi052_19421_object24851:head v 27'1544, mlcod=27'1541)", 2024-04-26T10:21:43.950 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.545686+0000", 2024-04-26T10:21:43.950 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.302667445, 2024-04-26T10:21:43.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009855328, 2024-04-26T10:21:43.950 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.950 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.950 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545686+0000", 2024-04-26T10:21:43.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545686+0000", 2024-04-26T10:21:43.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545685+0000", 2024-04-26T10:21:43.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545732+0000", 2024-04-26T10:21:43.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7026e-05 2024-04-26T10:21:43.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545742+0000", 2024-04-26T10:21:43.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5899999999999997e-06 2024-04-26T10:21:43.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545748+0000", 2024-04-26T10:21:43.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7510000000000002e-06 2024-04-26T10:21:43.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545797+0000", 2024-04-26T10:21:43.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8201999999999997e-05 2024-04-26T10:21:43.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545817+0000", 2024-04-26T10:21:43.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0154000000000001e-05 2024-04-26T10:21:43.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555485+0000", 2024-04-26T10:21:43.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0096682480000000008 2024-04-26T10:21:43.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555541+0000", 2024-04-26T10:21:43.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5855e-05 2024-04-26T10:21:43.954 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.954 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.954 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.954 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24863 5.e e27/22 5:70815639:::benchmark_data_smithi052_19421_object24862:head v 27'1571, mlcod=27'1569)", 2024-04-26T10:21:43.954 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:43.954 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.295047573, 2024-04-26T10:21:43.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014429724999999999, 2024-04-26T10:21:43.954 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.954 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.954 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:43.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:43.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553304+0000", 2024-04-26T10:21:43.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:43.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553377+0000", 2024-04-26T10:21:43.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3206000000000003e-05 2024-04-26T10:21:43.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553397+0000", 2024-04-26T10:21:43.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9366000000000001e-05 2024-04-26T10:21:43.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553407+0000", 2024-04-26T10:21:43.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0676000000000001e-05 2024-04-26T10:21:43.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553467+0000", 2024-04-26T10:21:43.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9735999999999999e-05 2024-04-26T10:21:43.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553486+0000", 2024-04-26T10:21:43.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8842e-05 2024-04-26T10:21:43.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.957 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.957 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.567649+0000", 2024-04-26T10:21:43.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01416272 2024-04-26T10:21:43.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.567735+0000", 2024-04-26T10:21:43.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6363e-05 2024-04-26T10:21:43.958 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.958 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.958 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.958 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:25863 5.e e27/22 5:71ddbd73:::benchmark_data_smithi052_19421_object25862:head v 27'1637, mlcod=27'1635)", 2024-04-26T10:21:43.958 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.953090+0000", 2024-04-26T10:21:43.958 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.89526251400000001, 2024-04-26T10:21:43.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010108455000000001, 2024-04-26T10:21:43.958 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:43.959 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:43.959 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:43.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:43.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.953090+0000", 2024-04-26T10:21:43.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:43.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.953090+0000", 2024-04-26T10:21:43.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:43.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:43.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.953090+0000", 2024-04-26T10:21:43.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:43.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:43.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.953141+0000", 2024-04-26T10:21:43.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0835999999999999e-05 2024-04-26T10:21:43.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:43.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.953147+0000", 2024-04-26T10:21:43.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.285e-06 2024-04-26T10:21:43.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:43.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.953151+0000", 2024-04-26T10:21:43.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3719999999999998e-06 2024-04-26T10:21:43.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:43.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.953223+0000", 2024-04-26T10:21:43.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1736999999999994e-05 2024-04-26T10:21:43.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:43.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.953250+0000", 2024-04-26T10:21:43.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7083000000000001e-05 2024-04-26T10:21:43.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:43.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.963157+0000", 2024-04-26T10:21:43.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099072190000000001 2024-04-26T10:21:43.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:43.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:43.962 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:43.962 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.963199+0000", 2024-04-26T10:21:43.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1483000000000002e-05 2024-04-26T10:21:43.962 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.962 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.962 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.962 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:43.962 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:43.962 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:43.964 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:43.965 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:43.961+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:44.064 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:44.060+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:44.094 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:44.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:28657 5.1 5:8c22e24c:::benchmark_data_smithi052_19421_object28656:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T10:21:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:44.090418+0000", 2024-04-26T10:21:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0028282649999999999, 2024-04-26T10:21:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002846922, 2024-04-26T10:21:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 28657 2024-04-26T10:21:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.095 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090418+0000", 2024-04-26T10:21:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090418+0000", 2024-04-26T10:21:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090417+0000", 2024-04-26T10:21:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090444+0000", 2024-04-26T10:21:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6741e-05 2024-04-26T10:21:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090454+0000", 2024-04-26T10:21:44.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5140000000000007e-06 2024-04-26T10:21:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090458+0000", 2024-04-26T10:21:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4560000000000002e-06 2024-04-26T10:21:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090492+0000", 2024-04-26T10:21:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3587999999999998e-05 2024-04-26T10:21:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090608+0000", 2024-04-26T10:21:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011610799999999999 2024-04-26T10:21:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-04-26T10:21:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090693+0000", 2024-04-26T10:21:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4748999999999998e-05 2024-04-26T10:21:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.101 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:28658 5.2 5:4137d984:::benchmark_data_smithi052_19421_object28657:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T10:21:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:44.090491+0000", 2024-04-26T10:21:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002755137, 2024-04-26T10:21:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002826159, 2024-04-26T10:21:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 28658 2024-04-26T10:21:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090491+0000", 2024-04-26T10:21:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090491+0000", 2024-04-26T10:21:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090491+0000", 2024-04-26T10:21:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090567+0000", 2024-04-26T10:21:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.674e-05 2024-04-26T10:21:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090578+0000", 2024-04-26T10:21:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0165e-05 2024-04-26T10:21:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090582+0000", 2024-04-26T10:21:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9179999999999996e-06 2024-04-26T10:21:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090613+0000", 2024-04-26T10:21:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1446999999999999e-05 2024-04-26T10:21:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090727+0000", 2024-04-26T10:21:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114267 2024-04-26T10:21:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-04-26T10:21:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090824+0000", 2024-04-26T10:21:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6781999999999996e-05 2024-04-26T10:21:44.105 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:28654 5.5 e28/22 5:a2a5e3ab:::benchmark_data_smithi052_19421_object28653:head v 28'1822, mlcod=28'1820)", 2024-04-26T10:21:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:44.090723+0000", 2024-04-26T10:21:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002523239, 2024-04-26T10:21:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026379770000000001, 2024-04-26T10:21:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090723+0000", 2024-04-26T10:21:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090723+0000", 2024-04-26T10:21:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090722+0000", 2024-04-26T10:21:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090798+0000", 2024-04-26T10:21:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5227000000000003e-05 2024-04-26T10:21:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090810+0000", 2024-04-26T10:21:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2747e-05 2024-04-26T10:21:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090814+0000", 2024-04-26T10:21:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0629999999999999e-06 2024-04-26T10:21:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090874+0000", 2024-04-26T10:21:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9669000000000001e-05 2024-04-26T10:21:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.090899+0000", 2024-04-26T10:21:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5174e-05 2024-04-26T10:21:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:28660 5.d 5:b10c51b5:::benchmark_data_smithi052_19421_object28659:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T10:21:44.109 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:44.091117+0000", 2024-04-26T10:21:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0021296790000000002, 2024-04-26T10:21:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022828089999999998, 2024-04-26T10:21:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:44.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 28660 2024-04-26T10:21:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.091117+0000", 2024-04-26T10:21:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.091117+0000", 2024-04-26T10:21:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.091116+0000", 2024-04-26T10:21:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.091204+0000", 2024-04-26T10:21:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8288000000000006e-05 2024-04-26T10:21:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.091213+0000", 2024-04-26T10:21:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5080000000000005e-06 2024-04-26T10:21:44.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.091217+0000", 2024-04-26T10:21:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0369999999999996e-06 2024-04-26T10:21:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.091264+0000", 2024-04-26T10:21:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7704000000000003e-05 2024-04-26T10:21:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.091444+0000", 2024-04-26T10:21:44.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017946100000000001 2024-04-26T10:21:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.091650+0000", 2024-04-26T10:21:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000206267 2024-04-26T10:21:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:28665 5.7 5:e6251894:::benchmark_data_smithi052_19421_object28664:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T10:21:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:44.093253+0000", 2024-04-26T10:21:44.114 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999933, 2024-04-26T10:21:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019235699999999999, 2024-04-26T10:21:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-04-26T10:21:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 28665 2024-04-26T10:21:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.093253+0000", 2024-04-26T10:21:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.093253+0000", 2024-04-26T10:21:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.093252+0000", 2024-04-26T10:21:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.093344+0000", 2024-04-26T10:21:44.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1713999999999996e-05 2024-04-26T10:21:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.093355+0000", 2024-04-26T10:21:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1630999999999999e-05 2024-04-26T10:21:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.093362+0000", 2024-04-26T10:21:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3740000000000003e-06 2024-04-26T10:21:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.093412+0000", 2024-04-26T10:21:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0741000000000001e-05 2024-04-26T10:21:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:28650 5.2 5:4b70aa23:::benchmark_data_smithi052_19421_object28649:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T10:21:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:44.087541+0000", 2024-04-26T10:21:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0057057310000000003, 2024-04-26T10:21:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059420929999999999, 2024-04-26T10:21:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.118 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 28650 2024-04-26T10:21:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.087541+0000", 2024-04-26T10:21:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.087541+0000", 2024-04-26T10:21:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.087539+0000", 2024-04-26T10:21:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.087657+0000", 2024-04-26T10:21:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117156 2024-04-26T10:21:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.087667+0000", 2024-04-26T10:21:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.045e-05 2024-04-26T10:21:44.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.087675+0000", 2024-04-26T10:21:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7020000000000001e-06 2024-04-26T10:21:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.088480+0000", 2024-04-26T10:21:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00080565300000000003 2024-04-26T10:21:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.088655+0000", 2024-04-26T10:21:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000174554 2024-04-26T10:21:44.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 2", 2024-04-26T10:21:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:44.088812+0000", 2024-04-26T10:21:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015744399999999999 2024-04-26T10:21:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:21:44.122 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 6 2024-04-26T10:21:44.122 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:44.123 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:44.165 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:44.160+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:44.253 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:21:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:21:44.253 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:21:44.253 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:44.267 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:44.267 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:44.260+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:44.369 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:44.364+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:44.394 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:21:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:21:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.152147354, 2024-04-26T10:21:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015326892, 2024-04-26T10:21:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:44.395 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 112 2024-04-26T10:21:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238644+0000", 2024-04-26T10:21:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238792+0000", 2024-04-26T10:21:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775699999999999 2024-04-26T10:21:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238811+0000", 2024-04-26T10:21:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8359000000000002e-05 2024-04-26T10:21:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238887+0000", 2024-04-26T10:21:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6909000000000005e-05 2024-04-26T10:21:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248433+0000", 2024-04-26T10:21:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095455650000000006 2024-04-26T10:21:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248564+0000", 2024-04-26T10:21:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131273 2024-04-26T10:21:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248795+0000", 2024-04-26T10:21:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023073500000000001 2024-04-26T10:21:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251497+0000", 2024-04-26T10:21:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002701976 2024-04-26T10:21:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253894+0000", 2024-04-26T10:21:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023967429999999998 2024-04-26T10:21:44.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253937+0000", 2024-04-26T10:21:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3006999999999997e-05 2024-04-26T10:21:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253972+0000", 2024-04-26T10:21:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5388000000000001e-05 2024-04-26T10:21:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.151893456000003, 2024-04-26T10:21:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016304328, 2024-04-26T10:21:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113 2024-04-26T10:21:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:44.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238898+0000", 2024-04-26T10:21:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238920+0000", 2024-04-26T10:21:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2056999999999999e-05 2024-04-26T10:21:44.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238937+0000", 2024-04-26T10:21:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6415000000000001e-05 2024-04-26T10:21:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238948+0000", 2024-04-26T10:21:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.11e-05 2024-04-26T10:21:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250527+0000", 2024-04-26T10:21:44.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011578662 2024-04-26T10:21:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250627+0000", 2024-04-26T10:21:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100418 2024-04-26T10:21:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250769+0000", 2024-04-26T10:21:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142111 2024-04-26T10:21:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253884+0000", 2024-04-26T10:21:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031148399999999998 2024-04-26T10:21:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254994+0000", 2024-04-26T10:21:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011095720000000001 2024-04-26T10:21:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255094+0000", 2024-04-26T10:21:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010092 2024-04-26T10:21:44.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255203+0000", 2024-04-26T10:21:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010906 2024-04-26T10:21:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.151835921, 2024-04-26T10:21:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016378984999999999, 2024-04-26T10:21:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.408 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 114 2024-04-26T10:21:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:44.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238956+0000", 2024-04-26T10:21:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238965+0000", 2024-04-26T10:21:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9469999999999992e-06 2024-04-26T10:21:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238993+0000", 2024-04-26T10:21:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8296000000000001e-05 2024-04-26T10:21:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239004+0000", 2024-04-26T10:21:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0482999999999999e-05 2024-04-26T10:21:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251532+0000", 2024-04-26T10:21:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01252852 2024-04-26T10:21:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251622+0000", 2024-04-26T10:21:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0044999999999996e-05 2024-04-26T10:21:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251763+0000", 2024-04-26T10:21:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140634 2024-04-26T10:21:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254035+0000", 2024-04-26T10:21:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022721320000000001 2024-04-26T10:21:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255220+0000", 2024-04-26T10:21:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011853059999999999 2024-04-26T10:21:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255301+0000", 2024-04-26T10:21:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0253999999999994e-05 2024-04-26T10:21:44.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255336+0000", 2024-04-26T10:21:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5098000000000002e-05 2024-04-26T10:21:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.151773972000001, 2024-04-26T10:21:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018452342, 2024-04-26T10:21:44.416 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115 2024-04-26T10:21:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239018+0000", 2024-04-26T10:21:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239152+0000", 2024-04-26T10:21:44.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414699999999999 2024-04-26T10:21:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239169+0000", 2024-04-26T10:21:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7013000000000001e-05 2024-04-26T10:21:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239190+0000", 2024-04-26T10:21:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1302999999999999e-05 2024-04-26T10:21:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252181+0000", 2024-04-26T10:21:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012990213 2024-04-26T10:21:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252411+0000", 2024-04-26T10:21:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023010199999999999 2024-04-26T10:21:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252687+0000", 2024-04-26T10:21:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000276063 2024-04-26T10:21:44.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254694+0000", 2024-04-26T10:21:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020072879999999999 2024-04-26T10:21:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257399+0000", 2024-04-26T10:21:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027051670000000001 2024-04-26T10:21:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257442+0000", 2024-04-26T10:21:44.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-04-26T10:21:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257471+0000", 2024-04-26T10:21:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.889e-05 2024-04-26T10:21:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:44.422 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.151593443000003, 2024-04-26T10:21:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018350615000000001, 2024-04-26T10:21:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116 2024-04-26T10:21:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239198+0000", 2024-04-26T10:21:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239213+0000", 2024-04-26T10:21:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4965e-05 2024-04-26T10:21:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239235+0000", 2024-04-26T10:21:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.156e-05 2024-04-26T10:21:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239243+0000", 2024-04-26T10:21:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9470000000000003e-06 2024-04-26T10:21:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253284+0000", 2024-04-26T10:21:44.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014041392999999999 2024-04-26T10:21:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253376+0000", 2024-04-26T10:21:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1198000000000003e-05 2024-04-26T10:21:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253508+0000", 2024-04-26T10:21:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013220199999999999 2024-04-26T10:21:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255474+0000", 2024-04-26T10:21:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019665590000000001 2024-04-26T10:21:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257480+0000", 2024-04-26T10:21:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00200599 2024-04-26T10:21:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257515+0000", 2024-04-26T10:21:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5126000000000002e-05 2024-04-26T10:21:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257550+0000", 2024-04-26T10:21:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4394000000000003e-05 2024-04-26T10:21:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:44.429 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.151539886999998, 2024-04-26T10:21:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018369330999999999, 2024-04-26T10:21:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117 2024-04-26T10:21:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239252+0000", 2024-04-26T10:21:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239267+0000", 2024-04-26T10:21:44.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4562999999999999e-05 2024-04-26T10:21:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239281+0000", 2024-04-26T10:21:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4e-05 2024-04-26T10:21:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239296+0000", 2024-04-26T10:21:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5492999999999999e-05 2024-04-26T10:21:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254076+0000", 2024-04-26T10:21:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014779814 2024-04-26T10:21:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254159+0000", 2024-04-26T10:21:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2923999999999994e-05 2024-04-26T10:21:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254279+0000", 2024-04-26T10:21:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011964300000000001 2024-04-26T10:21:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.256043+0000", 2024-04-26T10:21:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001764353 2024-04-26T10:21:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257559+0000", 2024-04-26T10:21:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015159189999999999 2024-04-26T10:21:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257597+0000", 2024-04-26T10:21:44.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8031999999999998e-05 2024-04-26T10:21:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257622+0000", 2024-04-26T10:21:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5213999999999999e-05 2024-04-26T10:21:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.435 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.939435510999999, 2024-04-26T10:21:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015980181999999999, 2024-04-26T10:21:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 141 2024-04-26T10:21:44.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451356+0000", 2024-04-26T10:21:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451362+0000", 2024-04-26T10:21:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:21:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451371+0000", 2024-04-26T10:21:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1829999999999994e-06 2024-04-26T10:21:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451377+0000", 2024-04-26T10:21:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7599999999999997e-06 2024-04-26T10:21:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463727+0000", 2024-04-26T10:21:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012349646000000001 2024-04-26T10:21:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463780+0000", 2024-04-26T10:21:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2645999999999997e-05 2024-04-26T10:21:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463874+0000", 2024-04-26T10:21:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4097000000000004e-05 2024-04-26T10:21:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.466138+0000", 2024-04-26T10:21:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022642690000000002 2024-04-26T10:21:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467281+0000", 2024-04-26T10:21:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011428510000000001 2024-04-26T10:21:44.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467315+0000", 2024-04-26T10:21:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4032999999999998e-05 2024-04-26T10:21:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467337+0000", 2024-04-26T10:21:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2444000000000001e-05 2024-04-26T10:21:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.740986939999999, 2024-04-26T10:21:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015587541, 2024-04-26T10:21:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 163 2024-04-26T10:21:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.442 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649805+0000", 2024-04-26T10:21:44.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649813+0000", 2024-04-26T10:21:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3319999999999992e-06 2024-04-26T10:21:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649851+0000", 2024-04-26T10:21:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7852999999999998e-05 2024-04-26T10:21:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649865+0000", 2024-04-26T10:21:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3626e-05 2024-04-26T10:21:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662071+0000", 2024-04-26T10:21:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01220689 2024-04-26T10:21:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662210+0000", 2024-04-26T10:21:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013893 2024-04-26T10:21:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662397+0000", 2024-04-26T10:21:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018690499999999999 2024-04-26T10:21:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664685+0000", 2024-04-26T10:21:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022876179999999999 2024-04-26T10:21:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665327+0000", 2024-04-26T10:21:44.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00064178900000000003 2024-04-26T10:21:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665365+0000", 2024-04-26T10:21:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8244999999999997e-05 2024-04-26T10:21:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665393+0000", 2024-04-26T10:21:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8232e-05 2024-04-26T10:21:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.447 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.740912293999997, 2024-04-26T10:21:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016970263999999999, 2024-04-26T10:21:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 164 2024-04-26T10:21:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.448 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649879+0000", 2024-04-26T10:21:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649963+0000", 2024-04-26T10:21:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4141999999999995e-05 2024-04-26T10:21:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649975+0000", 2024-04-26T10:21:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1416e-05 2024-04-26T10:21:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649983+0000", 2024-04-26T10:21:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8469999999999996e-06 2024-04-26T10:21:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662854+0000", 2024-04-26T10:21:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012871871999999999 2024-04-26T10:21:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662965+0000", 2024-04-26T10:21:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110413 2024-04-26T10:21:44.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.663109+0000", 2024-04-26T10:21:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144115 2024-04-26T10:21:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665992+0000", 2024-04-26T10:21:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028827340000000001 2024-04-26T10:21:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666784+0000", 2024-04-26T10:21:44.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00079253799999999997 2024-04-26T10:21:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666824+0000", 2024-04-26T10:21:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0139000000000003e-05 2024-04-26T10:21:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666851+0000", 2024-04-26T10:21:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6171999999999999e-05 2024-04-26T10:21:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.453 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.740801214000001, 2024-04-26T10:21:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019547338000000001, 2024-04-26T10:21:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165 2024-04-26T10:21:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.454 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:44.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:44.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:44.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649996+0000", 2024-04-26T10:21:44.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-04-26T10:21:44.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650021+0000", 2024-04-26T10:21:44.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5179999999999999e-05 2024-04-26T10:21:44.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650030+0000", 2024-04-26T10:21:44.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-04-26T10:21:44.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664733+0000", 2024-04-26T10:21:44.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014703097 2024-04-26T10:21:44.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664821+0000", 2024-04-26T10:21:44.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7918999999999996e-05 2024-04-26T10:21:44.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664953+0000", 2024-04-26T10:21:44.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132662 2024-04-26T10:21:44.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666776+0000", 2024-04-26T10:21:44.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018225509999999999 2024-04-26T10:21:44.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669480+0000", 2024-04-26T10:21:44.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00270382 2024-04-26T10:21:44.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669515+0000", 2024-04-26T10:21:44.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4885000000000002e-05 2024-04-26T10:21:44.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669539+0000", 2024-04-26T10:21:44.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4121000000000002e-05 2024-04-26T10:21:44.459 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.459 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.459 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.460 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:44.460 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:44.460 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.551278105000002, 2024-04-26T10:21:44.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017833541000000001, 2024-04-26T10:21:44.460 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.460 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:44.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:44.460 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185 2024-04-26T10:21:44.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.460 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:44.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:44.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839514+0000", 2024-04-26T10:21:44.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:44.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839612+0000", 2024-04-26T10:21:44.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7880999999999993e-05 2024-04-26T10:21:44.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839623+0000", 2024-04-26T10:21:44.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0917000000000001e-05 2024-04-26T10:21:44.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839632+0000", 2024-04-26T10:21:44.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0999999999999993e-06 2024-04-26T10:21:44.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850382+0000", 2024-04-26T10:21:44.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010750335 2024-04-26T10:21:44.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850502+0000", 2024-04-26T10:21:44.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120183 2024-04-26T10:21:44.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850685+0000", 2024-04-26T10:21:44.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000182442 2024-04-26T10:21:44.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854396+0000", 2024-04-26T10:21:44.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037114819999999999 2024-04-26T10:21:44.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857233+0000", 2024-04-26T10:21:44.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002836514 2024-04-26T10:21:44.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857300+0000", 2024-04-26T10:21:44.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6842999999999997e-05 2024-04-26T10:21:44.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857348+0000", 2024-04-26T10:21:44.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8504000000000002e-05 2024-04-26T10:21:44.466 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.466 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.466 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.466 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:44.466 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:44.466 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.551151754000003, 2024-04-26T10:21:44.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018757273000000001, 2024-04-26T10:21:44.466 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.466 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.467 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.467 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:44.467 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:44.467 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 186 2024-04-26T10:21:44.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.467 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:44.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:44.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839640+0000", 2024-04-26T10:21:44.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839646+0000", 2024-04-26T10:21:44.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:21:44.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839654+0000", 2024-04-26T10:21:44.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:21:44.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839661+0000", 2024-04-26T10:21:44.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.64e-06 2024-04-26T10:21:44.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852328+0000", 2024-04-26T10:21:44.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012667151 2024-04-26T10:21:44.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852538+0000", 2024-04-26T10:21:44.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020961100000000001 2024-04-26T10:21:44.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852945+0000", 2024-04-26T10:21:44.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040712099999999998 2024-04-26T10:21:44.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857372+0000", 2024-04-26T10:21:44.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044268049999999998 2024-04-26T10:21:44.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858321+0000", 2024-04-26T10:21:44.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094932999999999997 2024-04-26T10:21:44.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858367+0000", 2024-04-26T10:21:44.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5534000000000001e-05 2024-04-26T10:21:44.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858398+0000", 2024-04-26T10:21:44.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1562e-05 2024-04-26T10:21:44.472 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.472 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.472 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.472 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:44.472 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:44.472 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.551124588, 2024-04-26T10:21:44.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019669504000000001, 2024-04-26T10:21:44.472 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.472 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.473 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:44.473 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:44.473 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187 2024-04-26T10:21:44.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.473 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:44.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:44.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839667+0000", 2024-04-26T10:21:44.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:44.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839677+0000", 2024-04-26T10:21:44.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3270000000000007e-06 2024-04-26T10:21:44.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839685+0000", 2024-04-26T10:21:44.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2670000000000006e-06 2024-04-26T10:21:44.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839692+0000", 2024-04-26T10:21:44.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7129999999999999e-06 2024-04-26T10:21:44.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853685+0000", 2024-04-26T10:21:44.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013993716999999999 2024-04-26T10:21:44.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853876+0000", 2024-04-26T10:21:44.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019097100000000001 2024-04-26T10:21:44.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853989+0000", 2024-04-26T10:21:44.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011275199999999999 2024-04-26T10:21:44.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857377+0000", 2024-04-26T10:21:44.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033882489999999999 2024-04-26T10:21:44.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859222+0000", 2024-04-26T10:21:44.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001844233 2024-04-26T10:21:44.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859291+0000", 2024-04-26T10:21:44.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:21:44.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859338+0000", 2024-04-26T10:21:44.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6366000000000003e-05 2024-04-26T10:21:44.477 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.478 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.478 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.478 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:44.478 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:44.478 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.551093721999997, 2024-04-26T10:21:44.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019837468, 2024-04-26T10:21:44.478 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.478 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.478 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.478 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:44.478 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:44.479 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 188 2024-04-26T10:21:44.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.479 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:44.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:44.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839698+0000", 2024-04-26T10:21:44.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:44.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839829+0000", 2024-04-26T10:21:44.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013061099999999999 2024-04-26T10:21:44.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839853+0000", 2024-04-26T10:21:44.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3736000000000001e-05 2024-04-26T10:21:44.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839863+0000", 2024-04-26T10:21:44.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:44.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854869+0000", 2024-04-26T10:21:44.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015005978 2024-04-26T10:21:44.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854959+0000", 2024-04-26T10:21:44.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9468999999999993e-05 2024-04-26T10:21:44.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855114+0000", 2024-04-26T10:21:44.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015563799999999999 2024-04-26T10:21:44.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857386+0000", 2024-04-26T10:21:44.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002271852 2024-04-26T10:21:44.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859406+0000", 2024-04-26T10:21:44.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002019936 2024-04-26T10:21:44.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859461+0000", 2024-04-26T10:21:44.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4826e-05 2024-04-26T10:21:44.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859536+0000", 2024-04-26T10:21:44.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5566000000000001e-05 2024-04-26T10:21:44.483 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.483 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.483 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.484 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:44.484 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:44.484 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 41.550919858999997, 2024-04-26T10:21:44.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019826496999999998, 2024-04-26T10:21:44.484 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.484 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.484 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.484 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:44.484 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:44.484 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 189 2024-04-26T10:21:44.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.484 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:44.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:44.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839872+0000", 2024-04-26T10:21:44.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839882+0000", 2024-04-26T10:21:44.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:44.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839892+0000", 2024-04-26T10:21:44.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.217e-06 2024-04-26T10:21:44.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839900+0000", 2024-04-26T10:21:44.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5469999999999997e-06 2024-04-26T10:21:44.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855903+0000", 2024-04-26T10:21:44.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016002590000000001 2024-04-26T10:21:44.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856110+0000", 2024-04-26T10:21:44.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020711199999999999 2024-04-26T10:21:44.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856421+0000", 2024-04-26T10:21:44.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031128500000000001 2024-04-26T10:21:44.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857643+0000", 2024-04-26T10:21:44.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012215520000000001 2024-04-26T10:21:44.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859603+0000", 2024-04-26T10:21:44.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019600350000000002 2024-04-26T10:21:44.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859660+0000", 2024-04-26T10:21:44.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6857999999999997e-05 2024-04-26T10:21:44.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859699+0000", 2024-04-26T10:21:44.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9641999999999998e-05 2024-04-26T10:21:44.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.489 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.490 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15562 5.f 5:f08fe41e:::benchmark_data_smithi052_19421_object15561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:44.490 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:44.490 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.3979042289999999, 2024-04-26T10:21:44.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015831088, 2024-04-26T10:21:44.490 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.490 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:44.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:44.490 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15562 2024-04-26T10:21:44.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.490 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:44.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:44.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:44.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992927+0000", 2024-04-26T10:21:44.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9285000000000001e-05 2024-04-26T10:21:44.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992940+0000", 2024-04-26T10:21:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3040999999999999e-05 2024-04-26T10:21:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992948+0000", 2024-04-26T10:21:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5850000000000002e-06 2024-04-26T10:21:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.997631+0000", 2024-04-26T10:21:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046834160000000001 2024-04-26T10:21:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.997851+0000", 2024-04-26T10:21:44.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000220416 2024-04-26T10:21:44.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.998105+0000", 2024-04-26T10:21:44.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025348599999999998 2024-04-26T10:21:44.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.004264+0000", 2024-04-26T10:21:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061588499999999996 2024-04-26T10:21:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008560+0000", 2024-04-26T10:21:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042958579999999996 2024-04-26T10:21:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008647+0000", 2024-04-26T10:21:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7609999999999996e-05 2024-04-26T10:21:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008719+0000", 2024-04-26T10:21:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2336000000000007e-05 2024-04-26T10:21:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15563 5.f 5:f98d3bb0:::benchmark_data_smithi052_19421_object15562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.993442+0000", 2024-04-26T10:21:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.3973502370000004, 2024-04-26T10:21:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015592195999999999, 2024-04-26T10:21:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.496 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15563 2024-04-26T10:21:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993442+0000", 2024-04-26T10:21:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993442+0000", 2024-04-26T10:21:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993441+0000", 2024-04-26T10:21:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993494+0000", 2024-04-26T10:21:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2369e-05 2024-04-26T10:21:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993515+0000", 2024-04-26T10:21:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1274e-05 2024-04-26T10:21:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993528+0000", 2024-04-26T10:21:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2858e-05 2024-04-26T10:21:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.000547+0000", 2024-04-26T10:21:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070196010000000003 2024-04-26T10:21:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.000660+0000", 2024-04-26T10:21:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112273 2024-04-26T10:21:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.000757+0000", 2024-04-26T10:21:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6965000000000004e-05 2024-04-26T10:21:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.006425+0000", 2024-04-26T10:21:44.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056687639999999997 2024-04-26T10:21:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008907+0000", 2024-04-26T10:21:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024819289999999999 2024-04-26T10:21:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008993+0000", 2024-04-26T10:21:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5426999999999994e-05 2024-04-26T10:21:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.009035+0000", 2024-04-26T10:21:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1912000000000001e-05 2024-04-26T10:21:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15564 5.f 5:f61b0088:::benchmark_data_smithi052_19421_object15563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.3964022079999996, 2024-04-26T10:21:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017729826000000001, 2024-04-26T10:21:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.502 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15564 2024-04-26T10:21:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994389+0000", 2024-04-26T10:21:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994451+0000", 2024-04-26T10:21:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2032999999999994e-05 2024-04-26T10:21:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994477+0000", 2024-04-26T10:21:44.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5267999999999999e-05 2024-04-26T10:21:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994486+0000", 2024-04-26T10:21:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9420000000000001e-06 2024-04-26T10:21:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001578+0000", 2024-04-26T10:21:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070928110000000001 2024-04-26T10:21:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001748+0000", 2024-04-26T10:21:44.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016944099999999999 2024-04-26T10:21:44.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001914+0000", 2024-04-26T10:21:44.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000166546 2024-04-26T10:21:44.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.006488+0000", 2024-04-26T10:21:44.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045735460000000004 2024-04-26T10:21:44.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012034+0000", 2024-04-26T10:21:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055461449999999997 2024-04-26T10:21:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012085+0000", 2024-04-26T10:21:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1319000000000001e-05 2024-04-26T10:21:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012120+0000", 2024-04-26T10:21:44.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4904999999999999e-05 2024-04-26T10:21:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15567 5.f 5:f5b92a5d:::benchmark_data_smithi052_19421_object15566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.996077+0000", 2024-04-26T10:21:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.3947157700000004, 2024-04-26T10:21:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016208895000000001, 2024-04-26T10:21:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:44.508 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15567 2024-04-26T10:21:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996077+0000", 2024-04-26T10:21:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996077+0000", 2024-04-26T10:21:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996076+0000", 2024-04-26T10:21:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996139+0000", 2024-04-26T10:21:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2929999999999995e-05 2024-04-26T10:21:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996155+0000", 2024-04-26T10:21:44.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6076e-05 2024-04-26T10:21:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996163+0000", 2024-04-26T10:21:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0320000000000003e-06 2024-04-26T10:21:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.002727+0000", 2024-04-26T10:21:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065644240000000001 2024-04-26T10:21:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.002901+0000", 2024-04-26T10:21:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017414899999999999 2024-04-26T10:21:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.003080+0000", 2024-04-26T10:21:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017905199999999999 2024-04-26T10:21:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.009066+0000", 2024-04-26T10:21:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059855309999999997 2024-04-26T10:21:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012182+0000", 2024-04-26T10:21:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003116462 2024-04-26T10:21:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012230+0000", 2024-04-26T10:21:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7681e-05 2024-04-26T10:21:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012286+0000", 2024-04-26T10:21:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5763999999999997e-05 2024-04-26T10:21:44.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.514 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.514 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.514 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:27841 5.9 5:9893f413:::benchmark_data_smithi052_19421_object27840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T10:21:44.514 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:43.752430+0000", 2024-04-26T10:21:44.514 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.63836275099999995, 2024-04-26T10:21:44.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015615922000000001, 2024-04-26T10:21:44.514 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:44.514 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:44.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:44.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:44.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 27841 2024-04-26T10:21:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752430+0000", 2024-04-26T10:21:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752430+0000", 2024-04-26T10:21:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752429+0000", 2024-04-26T10:21:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752477+0000", 2024-04-26T10:21:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7899000000000003e-05 2024-04-26T10:21:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752495+0000", 2024-04-26T10:21:44.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8844000000000001e-05 2024-04-26T10:21:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752504+0000", 2024-04-26T10:21:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3010000000000007e-06 2024-04-26T10:21:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752538+0000", 2024-04-26T10:21:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4134000000000002e-05 2024-04-26T10:21:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:44.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752635+0000", 2024-04-26T10:21:44.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7461999999999996e-05 2024-04-26T10:21:44.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:44.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752710+0000", 2024-04-26T10:21:44.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4355000000000002e-05 2024-04-26T10:21:44.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:44.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.755511+0000", 2024-04-26T10:21:44.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028017979999999999 2024-04-26T10:21:44.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.767966+0000", 2024-04-26T10:21:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012454902 2024-04-26T10:21:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.768015+0000", 2024-04-26T10:21:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8523999999999998e-05 2024-04-26T10:21:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.768046+0000", 2024-04-26T10:21:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0956e-05 2024-04-26T10:21:44.519 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.520 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.520 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.520 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:44.520 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:44.520 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:44.521 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:44.522 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:44.517+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:44.527 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:21:44.613 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 11 16 29902 29886 169.788 149.5 0.00673197 0.00588314 2024-04-26T10:21:44.622 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:44.617+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:44.652 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:44.653 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:44.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.653 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29977 5.d e28/22 5:b3fa414f:::benchmark_data_smithi052_19421_object29976:head v 28'1940, mlcod=28'1935)", 2024-04-26T10:21:44.653 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.647111+0000", 2024-04-26T10:21:44.653 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0046864869999999996, 2024-04-26T10:21:44.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047168770000000004, 2024-04-26T10:21:44.653 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:44.653 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:44.653 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:44.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:44.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.647111+0000", 2024-04-26T10:21:44.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:44.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.647111+0000", 2024-04-26T10:21:44.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:44.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.647111+0000", 2024-04-26T10:21:44.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:44.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:44.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.647146+0000", 2024-04-26T10:21:44.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5562999999999998e-05 2024-04-26T10:21:44.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:44.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.647157+0000", 2024-04-26T10:21:44.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0312999999999999e-05 2024-04-26T10:21:44.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.647160+0000", 2024-04-26T10:21:44.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7579999999999998e-06 2024-04-26T10:21:44.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:44.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648098+0000", 2024-04-26T10:21:44.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000937268 2024-04-26T10:21:44.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:44.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648125+0000", 2024-04-26T10:21:44.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7555e-05 2024-04-26T10:21:44.656 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.656 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:44.656 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.657 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29982 5.e e28/22 5:7d3870b3:::benchmark_data_smithi052_19421_object29981:head v 28'1901, mlcod=28'1899)", 2024-04-26T10:21:44.657 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.647759+0000", 2024-04-26T10:21:44.657 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0040383909999999997, 2024-04-26T10:21:44.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041556869999999999, 2024-04-26T10:21:44.657 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:44.657 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:44.657 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:44.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:44.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.647759+0000", 2024-04-26T10:21:44.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:44.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.647759+0000", 2024-04-26T10:21:44.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:44.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.647758+0000", 2024-04-26T10:21:44.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:44.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.647813+0000", 2024-04-26T10:21:44.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4246999999999997e-05 2024-04-26T10:21:44.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:44.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.647821+0000", 2024-04-26T10:21:44.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:21:44.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.647826+0000", 2024-04-26T10:21:44.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.865e-06 2024-04-26T10:21:44.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:44.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.647885+0000", 2024-04-26T10:21:44.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8990000000000003e-05 2024-04-26T10:21:44.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:44.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.647933+0000", 2024-04-26T10:21:44.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8056000000000002e-05 2024-04-26T10:21:44.660 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.660 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:44.660 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.660 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29983 5.8 e28/22 5:19bd75ee:::benchmark_data_smithi052_19421_object29982:head v 28'1891, mlcod=28'1889)", 2024-04-26T10:21:44.661 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.648063+0000", 2024-04-26T10:21:44.661 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0037342719999999999, 2024-04-26T10:21:44.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0039260620000000001, 2024-04-26T10:21:44.661 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:44.661 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:44.661 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:44.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:44.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648063+0000", 2024-04-26T10:21:44.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:44.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648063+0000", 2024-04-26T10:21:44.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:44.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648063+0000", 2024-04-26T10:21:44.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:44.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:44.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648134+0000", 2024-04-26T10:21:44.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1544000000000005e-05 2024-04-26T10:21:44.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:44.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648151+0000", 2024-04-26T10:21:44.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6463000000000001e-05 2024-04-26T10:21:44.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648164+0000", 2024-04-26T10:21:44.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3081999999999999e-05 2024-04-26T10:21:44.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:44.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648203+0000", 2024-04-26T10:21:44.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9221000000000003e-05 2024-04-26T10:21:44.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:44.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648223+0000", 2024-04-26T10:21:44.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9987e-05 2024-04-26T10:21:44.664 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.664 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:44.664 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.664 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29985 5.4 e28/22 5:2bd0a6a8:::benchmark_data_smithi052_19421_object29984:head v 28'1892, mlcod=28'1890)", 2024-04-26T10:21:44.664 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.648178+0000", 2024-04-26T10:21:44.664 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0036197790000000001, 2024-04-26T10:21:44.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003851485, 2024-04-26T10:21:44.665 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:44.665 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:44.665 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:44.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:44.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648178+0000", 2024-04-26T10:21:44.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:44.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648178+0000", 2024-04-26T10:21:44.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:44.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648177+0000", 2024-04-26T10:21:44.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:44.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:44.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648222+0000", 2024-04-26T10:21:44.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4314999999999998e-05 2024-04-26T10:21:44.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:44.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648234+0000", 2024-04-26T10:21:44.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2231e-05 2024-04-26T10:21:44.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648241+0000", 2024-04-26T10:21:44.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9040000000000003e-06 2024-04-26T10:21:44.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:44.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648308+0000", 2024-04-26T10:21:44.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7189999999999999e-05 2024-04-26T10:21:44.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:44.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648334+0000", 2024-04-26T10:21:44.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6122000000000002e-05 2024-04-26T10:21:44.668 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.668 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:44.668 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.668 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29987 5.0 e28/22 5:0b16486f:::benchmark_data_smithi052_19421_object29986:head v 28'1793, mlcod=28'1791)", 2024-04-26T10:21:44.668 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.648274+0000", 2024-04-26T10:21:44.668 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.003524007, 2024-04-26T10:21:44.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0037967180000000001, 2024-04-26T10:21:44.668 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:44.668 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:44.668 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:44.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:44.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648274+0000", 2024-04-26T10:21:44.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:44.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648274+0000", 2024-04-26T10:21:44.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:44.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648273+0000", 2024-04-26T10:21:44.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:44.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:44.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648320+0000", 2024-04-26T10:21:44.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6597999999999997e-05 2024-04-26T10:21:44.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:44.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648325+0000", 2024-04-26T10:21:44.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3650000000000003e-06 2024-04-26T10:21:44.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648329+0000", 2024-04-26T10:21:44.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7290000000000002e-06 2024-04-26T10:21:44.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:44.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648362+0000", 2024-04-26T10:21:44.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2733e-05 2024-04-26T10:21:44.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:44.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648376+0000", 2024-04-26T10:21:44.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4372000000000001e-05 2024-04-26T10:21:44.671 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.671 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:44.671 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.672 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29986 5.d e28/22 5:bb3ef375:::benchmark_data_smithi052_19421_object29985:head v 28'1941, mlcod=28'1936)", 2024-04-26T10:21:44.672 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.648529+0000", 2024-04-26T10:21:44.672 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0032682800000000001, 2024-04-26T10:21:44.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0035919429999999998, 2024-04-26T10:21:44.672 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:44.672 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:44.672 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:44.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:44.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648529+0000", 2024-04-26T10:21:44.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:44.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648529+0000", 2024-04-26T10:21:44.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:44.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648529+0000", 2024-04-26T10:21:44.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:44.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648597+0000", 2024-04-26T10:21:44.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8755000000000002e-05 2024-04-26T10:21:44.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:44.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648611+0000", 2024-04-26T10:21:44.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3920000000000001e-05 2024-04-26T10:21:44.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.648618+0000", 2024-04-26T10:21:44.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.968e-06 2024-04-26T10:21:44.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:44.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.649247+0000", 2024-04-26T10:21:44.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00062841700000000004 2024-04-26T10:21:44.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:44.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.649283+0000", 2024-04-26T10:21:44.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6492000000000002e-05 2024-04-26T10:21:44.675 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.675 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:44.675 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.676 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29984 5.e e28/22 5:7b1d5869:::benchmark_data_smithi052_19421_object29983:head v 28'1902, mlcod=28'1899)", 2024-04-26T10:21:44.676 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.649469+0000", 2024-04-26T10:21:44.676 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.002328704, 2024-04-26T10:21:44.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0027025109999999999, 2024-04-26T10:21:44.676 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:44.676 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:44.676 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:44.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:44.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.649469+0000", 2024-04-26T10:21:44.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:44.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.649469+0000", 2024-04-26T10:21:44.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:44.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.649468+0000", 2024-04-26T10:21:44.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:44.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.649520+0000", 2024-04-26T10:21:44.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2114000000000003e-05 2024-04-26T10:21:44.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:44.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.649532+0000", 2024-04-26T10:21:44.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1567e-05 2024-04-26T10:21:44.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.649537+0000", 2024-04-26T10:21:44.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4569999999999996e-06 2024-04-26T10:21:44.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:44.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.649615+0000", 2024-04-26T10:21:44.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7510999999999997e-05 2024-04-26T10:21:44.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:44.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.649644+0000", 2024-04-26T10:21:44.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9045000000000001e-05 2024-04-26T10:21:44.679 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.679 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:44.679 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.680 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29991 5.9 e28/22 5:98dd639d:::benchmark_data_smithi052_19421_object29990:head v 28'1876, mlcod=28'1874)", 2024-04-26T10:21:44.680 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.649881+0000", 2024-04-26T10:21:44.680 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0019170599999999999, 2024-04-26T10:21:44.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0023892050000000001, 2024-04-26T10:21:44.680 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:44.680 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:44.680 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:44.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:44.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.649881+0000", 2024-04-26T10:21:44.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:44.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.649881+0000", 2024-04-26T10:21:44.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:44.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.649880+0000", 2024-04-26T10:21:44.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:44.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:44.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.649993+0000", 2024-04-26T10:21:44.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112932 2024-04-26T10:21:44.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:44.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.650004+0000", 2024-04-26T10:21:44.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1527e-05 2024-04-26T10:21:44.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.650009+0000", 2024-04-26T10:21:44.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8600000000000001e-06 2024-04-26T10:21:44.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:44.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.650073+0000", 2024-04-26T10:21:44.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4294000000000005e-05 2024-04-26T10:21:44.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:44.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.650104+0000", 2024-04-26T10:21:44.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0803000000000003e-05 2024-04-26T10:21:44.683 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.683 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:44.683 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.684 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29992 5.4 e28/22 5:2c992152:::benchmark_data_smithi052_19421_object29991:head v 28'1893, mlcod=28'1890)", 2024-04-26T10:21:44.684 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.649893+0000", 2024-04-26T10:21:44.684 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0019046950000000001, 2024-04-26T10:21:44.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024644469999999998, 2024-04-26T10:21:44.684 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:44.684 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:44.684 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:44.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:44.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.649893+0000", 2024-04-26T10:21:44.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:44.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.649893+0000", 2024-04-26T10:21:44.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:44.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.649892+0000", 2024-04-26T10:21:44.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:44.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.650012+0000", 2024-04-26T10:21:44.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120184 2024-04-26T10:21:44.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:44.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.650031+0000", 2024-04-26T10:21:44.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8978999999999999e-05 2024-04-26T10:21:44.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.650043+0000", 2024-04-26T10:21:44.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2303999999999999e-05 2024-04-26T10:21:44.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:44.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.650081+0000", 2024-04-26T10:21:44.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7663000000000002e-05 2024-04-26T10:21:44.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:44.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.650095+0000", 2024-04-26T10:21:44.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3885e-05 2024-04-26T10:21:44.687 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.687 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:44.687 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.687 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29993 5.8 e28/22 5:189e4fb3:::benchmark_data_smithi052_19421_object29992:head v 28'1892, mlcod=28'1889)", 2024-04-26T10:21:44.687 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.650464+0000", 2024-04-26T10:21:44.687 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0013332509999999999, 2024-04-26T10:21:44.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0019369159999999999, 2024-04-26T10:21:44.688 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:44.688 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:44.688 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:44.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:44.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.650464+0000", 2024-04-26T10:21:44.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:44.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.650464+0000", 2024-04-26T10:21:44.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:44.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.650464+0000", 2024-04-26T10:21:44.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:44.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:44.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.650542+0000", 2024-04-26T10:21:44.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8381999999999996e-05 2024-04-26T10:21:44.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:44.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.650563+0000", 2024-04-26T10:21:44.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1356999999999999e-05 2024-04-26T10:21:44.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.650572+0000", 2024-04-26T10:21:44.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7309999999999999e-06 2024-04-26T10:21:44.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:44.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.650633+0000", 2024-04-26T10:21:44.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0705000000000002e-05 2024-04-26T10:21:44.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:44.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.650668+0000", 2024-04-26T10:21:44.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5441999999999997e-05 2024-04-26T10:21:44.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.691 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:44.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.691 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29995 5.9 e28/22 5:96f8e505:::benchmark_data_smithi052_19421_object29994:head v 28'1877, mlcod=28'1874)", 2024-04-26T10:21:44.691 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.651603+0000", 2024-04-26T10:21:44.691 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00019506800000000001, 2024-04-26T10:21:44.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00083864599999999997, 2024-04-26T10:21:44.691 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:44.691 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:44.691 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:44.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:44.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.651603+0000", 2024-04-26T10:21:44.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:44.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.651603+0000", 2024-04-26T10:21:44.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:44.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.651602+0000", 2024-04-26T10:21:44.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:44.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.651650+0000", 2024-04-26T10:21:44.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7765000000000001e-05 2024-04-26T10:21:44.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:44.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.651680+0000", 2024-04-26T10:21:44.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0514e-05 2024-04-26T10:21:44.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.651686+0000", 2024-04-26T10:21:44.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:21:44.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:44.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.651749+0000", 2024-04-26T10:21:44.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2816000000000003e-05 2024-04-26T10:21:44.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:44.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.651788+0000", 2024-04-26T10:21:44.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8986000000000002e-05 2024-04-26T10:21:44.695 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.695 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:44.695 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.695 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29994 5.8 e28/22 5:1c4612d0:::benchmark_data_smithi052_19421_object29993:head v 28'1893, mlcod=28'1889)", 2024-04-26T10:21:44.695 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.652015+0000", 2024-04-26T10:21:44.695 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9997826, 2024-04-26T10:21:44.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047717499999999998, 2024-04-26T10:21:44.695 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:44.695 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:44.695 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:44.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:44.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.652015+0000", 2024-04-26T10:21:44.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:44.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.652015+0000", 2024-04-26T10:21:44.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:44.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.652015+0000", 2024-04-26T10:21:44.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:44.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:44.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.652075+0000", 2024-04-26T10:21:44.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.033e-05 2024-04-26T10:21:44.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:44.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.652085+0000", 2024-04-26T10:21:44.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8810000000000008e-06 2024-04-26T10:21:44.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.652091+0000", 2024-04-26T10:21:44.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.037e-06 2024-04-26T10:21:44.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:44.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.652136+0000", 2024-04-26T10:21:44.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4808000000000002e-05 2024-04-26T10:21:44.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:44.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.652150+0000", 2024-04-26T10:21:44.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.451e-05 2024-04-26T10:21:44.699 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.699 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:44.699 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.699 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29997 5.e e28/22 5:7e838f49:::benchmark_data_smithi052_19421_object29996:head v 28'1903, mlcod=28'1899)", 2024-04-26T10:21:44.699 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.652213+0000", 2024-04-26T10:21:44.699 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9995847, 2024-04-26T10:21:44.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000354741, 2024-04-26T10:21:44.699 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:44.699 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:44.699 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:44.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:44.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.652213+0000", 2024-04-26T10:21:44.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:44.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.652213+0000", 2024-04-26T10:21:44.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:44.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:44.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.652212+0000", 2024-04-26T10:21:44.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:44.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:44.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.652314+0000", 2024-04-26T10:21:44.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101814 2024-04-26T10:21:44.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:44.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.652323+0000", 2024-04-26T10:21:44.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1479999999999995e-06 2024-04-26T10:21:44.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:44.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.652328+0000", 2024-04-26T10:21:44.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2200000000000003e-06 2024-04-26T10:21:44.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:44.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.652374+0000", 2024-04-26T10:21:44.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6891999999999998e-05 2024-04-26T10:21:44.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:44.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:44.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:44.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.652402+0000", 2024-04-26T10:21:44.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7776e-05 2024-04-26T10:21:44.703 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.703 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:44.703 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.703 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:44.703 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:21:44.703 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 13 2024-04-26T10:21:44.703 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:44.704 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:21:44.705 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:44.705 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:21:44.723 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:44.721+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:44.725 INFO:teuthology.orchestra.run.smithi052.stdout:osd.2: {} 2024-04-26T10:21:44.727 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:21:44.727 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:21:44.728 INFO:teuthology.orchestra.run.smithi052.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-26T10:21:44.822 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:44.822 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:44.823 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:44.821+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:44.834 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:44.924 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:44.920+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:44.957 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:44.957 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:44.968 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:45.025 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:45.020+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:45.094 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:45.094 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:45.108 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:45.126 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:45.120+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:45.227 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:45.225+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:45.238 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:45.238 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:45.250 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:45.328 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:45.325+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:45.378 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:45.378 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:45.390 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:45.439 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:45.436+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:45.520 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:45.520 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:45.529 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:45.525+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:45.532 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:45.608 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:21:45.613 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 12 16 32343 32327 168.351 152.562 0.00742548 0.00593366 2024-04-26T10:21:45.630 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:45.624+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:45.653 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:45.653 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:45.664 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:45.731 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:45.729+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:45.781 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:45.782 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:45.793 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:45.832 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:45.828+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:45.920 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:45.921 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:45.933 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:45.934 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:45.928+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:46.033 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:46.029+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:46.061 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:46.062 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:46.074 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:46.134 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:46.128+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:46.202 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:46.202 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:46.215 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:46.234 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:46.233+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:46.330 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:46.331 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:46.335 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:46.332+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:46.342 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:46.436 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:46.432+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:46.459 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:46.459 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:46.470 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:46.537 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:46.532+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:46.614 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 13 15 34416 34401 165.371 129.625 0.0141221 0.00603992 2024-04-26T10:21:46.618 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T10:21:46.637 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:46.637 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:46.637 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:46.633+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:46.646 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:46.686 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T10:21:46.739 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:46.736+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:46.739 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:21:46.756 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:46.756 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:46.765 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:46.796 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-04-26T10:21:46.839 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:46.837+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:46.873 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:46.873 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:46.882 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:46.893 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:21:46.920 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:21:46.920 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:21:46.921 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:21:46.921 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:21:46.924 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:21:46.924 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:21:46.941 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:46.936+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:46.991 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:46.992 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:21:46.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:21:46.992 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:46.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:46.992 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:46.992 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:46.992 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.748275583000002, 2024-04-26T10:21:46.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015326892, 2024-04-26T10:21:46.992 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:46.992 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:46.992 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:46.992 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:46.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:46.993 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 112 2024-04-26T10:21:46.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:46.993 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:46.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:46.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:46.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:46.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:46.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:46.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:46.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:46.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238645+0000", 2024-04-26T10:21:46.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:46.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:46.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:46.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:46.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238644+0000", 2024-04-26T10:21:46.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:46.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:46.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:46.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:46.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238792+0000", 2024-04-26T10:21:46.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014775699999999999 2024-04-26T10:21:46.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:46.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:46.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:46.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238811+0000", 2024-04-26T10:21:46.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8359000000000002e-05 2024-04-26T10:21:46.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:46.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:46.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:46.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238887+0000", 2024-04-26T10:21:46.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6909000000000005e-05 2024-04-26T10:21:46.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:46.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:46.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:46.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248433+0000", 2024-04-26T10:21:46.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0095455650000000006 2024-04-26T10:21:46.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:46.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:46.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:46.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248564+0000", 2024-04-26T10:21:46.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000131273 2024-04-26T10:21:46.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:46.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:46.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:46.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.248795+0000", 2024-04-26T10:21:46.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023073500000000001 2024-04-26T10:21:46.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:46.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:46.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:46.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251497+0000", 2024-04-26T10:21:46.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002701976 2024-04-26T10:21:46.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:46.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:46.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:46.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253894+0000", 2024-04-26T10:21:46.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023967429999999998 2024-04-26T10:21:46.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:46.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:46.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:46.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253937+0000", 2024-04-26T10:21:46.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3006999999999997e-05 2024-04-26T10:21:46.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:46.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:46.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:46.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253972+0000", 2024-04-26T10:21:46.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5388000000000001e-05 2024-04-26T10:21:46.998 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:46.998 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:46.998 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:46.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:46.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:46.998 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:46.998 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:46.998 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.748021684999998, 2024-04-26T10:21:46.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016304328, 2024-04-26T10:21:46.998 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:46.998 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:46.998 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:46.998 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:46.999 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:46.999 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113 2024-04-26T10:21:46.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:46.999 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:46.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:46.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:46.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:46.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:46.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:46.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:46.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:47.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238898+0000", 2024-04-26T10:21:47.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238920+0000", 2024-04-26T10:21:47.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2056999999999999e-05 2024-04-26T10:21:47.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238937+0000", 2024-04-26T10:21:47.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6415000000000001e-05 2024-04-26T10:21:47.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238948+0000", 2024-04-26T10:21:47.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.11e-05 2024-04-26T10:21:47.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250527+0000", 2024-04-26T10:21:47.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011578662 2024-04-26T10:21:47.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250627+0000", 2024-04-26T10:21:47.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100418 2024-04-26T10:21:47.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250769+0000", 2024-04-26T10:21:47.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142111 2024-04-26T10:21:47.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253884+0000", 2024-04-26T10:21:47.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031148399999999998 2024-04-26T10:21:47.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254994+0000", 2024-04-26T10:21:47.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011095720000000001 2024-04-26T10:21:47.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255094+0000", 2024-04-26T10:21:47.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010092 2024-04-26T10:21:47.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255203+0000", 2024-04-26T10:21:47.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010906 2024-04-26T10:21:47.004 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.004 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.004 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.004 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:47.004 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:47.004 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.747964150000001, 2024-04-26T10:21:47.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016378984999999999, 2024-04-26T10:21:47.004 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.004 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.004 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.004 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:47.004 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:47.005 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 114 2024-04-26T10:21:47.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.005 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:47.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:47.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238956+0000", 2024-04-26T10:21:47.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238965+0000", 2024-04-26T10:21:47.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9469999999999992e-06 2024-04-26T10:21:47.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238993+0000", 2024-04-26T10:21:47.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8296000000000001e-05 2024-04-26T10:21:47.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239004+0000", 2024-04-26T10:21:47.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0482999999999999e-05 2024-04-26T10:21:47.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251532+0000", 2024-04-26T10:21:47.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01252852 2024-04-26T10:21:47.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251622+0000", 2024-04-26T10:21:47.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0044999999999996e-05 2024-04-26T10:21:47.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251763+0000", 2024-04-26T10:21:47.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140634 2024-04-26T10:21:47.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254035+0000", 2024-04-26T10:21:47.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022721320000000001 2024-04-26T10:21:47.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255220+0000", 2024-04-26T10:21:47.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011853059999999999 2024-04-26T10:21:47.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255301+0000", 2024-04-26T10:21:47.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0253999999999994e-05 2024-04-26T10:21:47.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255336+0000", 2024-04-26T10:21:47.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5098000000000002e-05 2024-04-26T10:21:47.009 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.009 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.010 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:47.010 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:47.010 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.747902201000002, 2024-04-26T10:21:47.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018452342, 2024-04-26T10:21:47.010 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.010 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.010 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.010 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:47.010 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:47.010 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115 2024-04-26T10:21:47.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.011 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:47.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:47.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239018+0000", 2024-04-26T10:21:47.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239152+0000", 2024-04-26T10:21:47.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414699999999999 2024-04-26T10:21:47.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239169+0000", 2024-04-26T10:21:47.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7013000000000001e-05 2024-04-26T10:21:47.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239190+0000", 2024-04-26T10:21:47.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1302999999999999e-05 2024-04-26T10:21:47.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252181+0000", 2024-04-26T10:21:47.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012990213 2024-04-26T10:21:47.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252411+0000", 2024-04-26T10:21:47.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023010199999999999 2024-04-26T10:21:47.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252687+0000", 2024-04-26T10:21:47.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000276063 2024-04-26T10:21:47.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254694+0000", 2024-04-26T10:21:47.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020072879999999999 2024-04-26T10:21:47.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257399+0000", 2024-04-26T10:21:47.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027051670000000001 2024-04-26T10:21:47.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257442+0000", 2024-04-26T10:21:47.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-04-26T10:21:47.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257471+0000", 2024-04-26T10:21:47.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.889e-05 2024-04-26T10:21:47.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.016 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.016 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.016 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:47.016 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:47.016 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.747721671999997, 2024-04-26T10:21:47.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018350615000000001, 2024-04-26T10:21:47.016 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.016 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:47.017 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:47.017 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116 2024-04-26T10:21:47.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.017 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:47.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:47.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239198+0000", 2024-04-26T10:21:47.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239213+0000", 2024-04-26T10:21:47.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4965e-05 2024-04-26T10:21:47.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239235+0000", 2024-04-26T10:21:47.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.156e-05 2024-04-26T10:21:47.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239243+0000", 2024-04-26T10:21:47.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9470000000000003e-06 2024-04-26T10:21:47.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253284+0000", 2024-04-26T10:21:47.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014041392999999999 2024-04-26T10:21:47.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253376+0000", 2024-04-26T10:21:47.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1198000000000003e-05 2024-04-26T10:21:47.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253508+0000", 2024-04-26T10:21:47.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013220199999999999 2024-04-26T10:21:47.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255474+0000", 2024-04-26T10:21:47.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019665590000000001 2024-04-26T10:21:47.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257480+0000", 2024-04-26T10:21:47.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00200599 2024-04-26T10:21:47.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257515+0000", 2024-04-26T10:21:47.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5126000000000002e-05 2024-04-26T10:21:47.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257550+0000", 2024-04-26T10:21:47.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4394000000000003e-05 2024-04-26T10:21:47.021 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.022 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.022 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.022 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:47.022 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:47.022 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.747668116, 2024-04-26T10:21:47.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018369330999999999, 2024-04-26T10:21:47.022 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.022 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:47.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117 2024-04-26T10:21:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239252+0000", 2024-04-26T10:21:47.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:47.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239267+0000", 2024-04-26T10:21:47.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4562999999999999e-05 2024-04-26T10:21:47.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239281+0000", 2024-04-26T10:21:47.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4e-05 2024-04-26T10:21:47.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239296+0000", 2024-04-26T10:21:47.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5492999999999999e-05 2024-04-26T10:21:47.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254076+0000", 2024-04-26T10:21:47.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014779814 2024-04-26T10:21:47.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254159+0000", 2024-04-26T10:21:47.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2923999999999994e-05 2024-04-26T10:21:47.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254279+0000", 2024-04-26T10:21:47.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011964300000000001 2024-04-26T10:21:47.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.256043+0000", 2024-04-26T10:21:47.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001764353 2024-04-26T10:21:47.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257559+0000", 2024-04-26T10:21:47.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015159189999999999 2024-04-26T10:21:47.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257597+0000", 2024-04-26T10:21:47.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8031999999999998e-05 2024-04-26T10:21:47.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257622+0000", 2024-04-26T10:21:47.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5213999999999999e-05 2024-04-26T10:21:47.027 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.027 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.027 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.028 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:47.028 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:47.028 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.535563740000001, 2024-04-26T10:21:47.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015980181999999999, 2024-04-26T10:21:47.028 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.028 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.028 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.028 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:47.028 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:47.028 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 141 2024-04-26T10:21:47.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.028 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:47.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:47.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451356+0000", 2024-04-26T10:21:47.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451362+0000", 2024-04-26T10:21:47.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:21:47.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451371+0000", 2024-04-26T10:21:47.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1829999999999994e-06 2024-04-26T10:21:47.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451377+0000", 2024-04-26T10:21:47.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7599999999999997e-06 2024-04-26T10:21:47.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463727+0000", 2024-04-26T10:21:47.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012349646000000001 2024-04-26T10:21:47.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463780+0000", 2024-04-26T10:21:47.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2645999999999997e-05 2024-04-26T10:21:47.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463874+0000", 2024-04-26T10:21:47.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4097000000000004e-05 2024-04-26T10:21:47.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.466138+0000", 2024-04-26T10:21:47.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022642690000000002 2024-04-26T10:21:47.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467281+0000", 2024-04-26T10:21:47.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011428510000000001 2024-04-26T10:21:47.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467315+0000", 2024-04-26T10:21:47.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4032999999999998e-05 2024-04-26T10:21:47.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467337+0000", 2024-04-26T10:21:47.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2444000000000001e-05 2024-04-26T10:21:47.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.033 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.033 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:47.033 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:47.033 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.337115169, 2024-04-26T10:21:47.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015587541, 2024-04-26T10:21:47.033 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.034 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:47.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:47.034 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 163 2024-04-26T10:21:47.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.034 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:47.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:47.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649805+0000", 2024-04-26T10:21:47.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649813+0000", 2024-04-26T10:21:47.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3319999999999992e-06 2024-04-26T10:21:47.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649851+0000", 2024-04-26T10:21:47.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7852999999999998e-05 2024-04-26T10:21:47.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649865+0000", 2024-04-26T10:21:47.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3626e-05 2024-04-26T10:21:47.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662071+0000", 2024-04-26T10:21:47.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01220689 2024-04-26T10:21:47.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662210+0000", 2024-04-26T10:21:47.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013893 2024-04-26T10:21:47.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662397+0000", 2024-04-26T10:21:47.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018690499999999999 2024-04-26T10:21:47.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664685+0000", 2024-04-26T10:21:47.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022876179999999999 2024-04-26T10:21:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665327+0000", 2024-04-26T10:21:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00064178900000000003 2024-04-26T10:21:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665365+0000", 2024-04-26T10:21:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8244999999999997e-05 2024-04-26T10:21:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665393+0000", 2024-04-26T10:21:47.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8232e-05 2024-04-26T10:21:47.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.039 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.039 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:47.039 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:47.039 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.337040522999999, 2024-04-26T10:21:47.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016970263999999999, 2024-04-26T10:21:47.039 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.039 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:47.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:47.040 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 164 2024-04-26T10:21:47.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.040 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:47.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:47.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649879+0000", 2024-04-26T10:21:47.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649963+0000", 2024-04-26T10:21:47.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4141999999999995e-05 2024-04-26T10:21:47.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649975+0000", 2024-04-26T10:21:47.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1416e-05 2024-04-26T10:21:47.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649983+0000", 2024-04-26T10:21:47.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8469999999999996e-06 2024-04-26T10:21:47.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662854+0000", 2024-04-26T10:21:47.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012871871999999999 2024-04-26T10:21:47.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662965+0000", 2024-04-26T10:21:47.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110413 2024-04-26T10:21:47.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.663109+0000", 2024-04-26T10:21:47.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144115 2024-04-26T10:21:47.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665992+0000", 2024-04-26T10:21:47.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028827340000000001 2024-04-26T10:21:47.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666784+0000", 2024-04-26T10:21:47.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00079253799999999997 2024-04-26T10:21:47.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666824+0000", 2024-04-26T10:21:47.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0139000000000003e-05 2024-04-26T10:21:47.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666851+0000", 2024-04-26T10:21:47.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6171999999999999e-05 2024-04-26T10:21:47.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.044 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.044 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:47.044 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:47.044 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.336929443000002, 2024-04-26T10:21:47.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019547338000000001, 2024-04-26T10:21:47.045 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.045 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:47.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:47.045 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165 2024-04-26T10:21:47.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.045 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:47.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:47.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:47.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649996+0000", 2024-04-26T10:21:47.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-04-26T10:21:47.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650021+0000", 2024-04-26T10:21:47.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5179999999999999e-05 2024-04-26T10:21:47.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650030+0000", 2024-04-26T10:21:47.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-04-26T10:21:47.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664733+0000", 2024-04-26T10:21:47.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014703097 2024-04-26T10:21:47.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664821+0000", 2024-04-26T10:21:47.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7918999999999996e-05 2024-04-26T10:21:47.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664953+0000", 2024-04-26T10:21:47.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132662 2024-04-26T10:21:47.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666776+0000", 2024-04-26T10:21:47.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018225509999999999 2024-04-26T10:21:47.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669480+0000", 2024-04-26T10:21:47.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00270382 2024-04-26T10:21:47.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669515+0000", 2024-04-26T10:21:47.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4885000000000002e-05 2024-04-26T10:21:47.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669539+0000", 2024-04-26T10:21:47.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4121000000000002e-05 2024-04-26T10:21:47.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.050 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.050 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:47.050 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:47.050 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.147406334000003, 2024-04-26T10:21:47.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017833541000000001, 2024-04-26T10:21:47.051 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.051 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:47.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:47.051 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185 2024-04-26T10:21:47.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.051 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:47.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:47.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839514+0000", 2024-04-26T10:21:47.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:47.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839612+0000", 2024-04-26T10:21:47.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7880999999999993e-05 2024-04-26T10:21:47.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839623+0000", 2024-04-26T10:21:47.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0917000000000001e-05 2024-04-26T10:21:47.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839632+0000", 2024-04-26T10:21:47.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0999999999999993e-06 2024-04-26T10:21:47.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850382+0000", 2024-04-26T10:21:47.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010750335 2024-04-26T10:21:47.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850502+0000", 2024-04-26T10:21:47.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120183 2024-04-26T10:21:47.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850685+0000", 2024-04-26T10:21:47.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000182442 2024-04-26T10:21:47.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854396+0000", 2024-04-26T10:21:47.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037114819999999999 2024-04-26T10:21:47.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857233+0000", 2024-04-26T10:21:47.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002836514 2024-04-26T10:21:47.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857300+0000", 2024-04-26T10:21:47.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6842999999999997e-05 2024-04-26T10:21:47.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857348+0000", 2024-04-26T10:21:47.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8504000000000002e-05 2024-04-26T10:21:47.056 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.056 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.056 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.056 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:47.056 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:47.056 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.147279982999997, 2024-04-26T10:21:47.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018757273000000001, 2024-04-26T10:21:47.056 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.057 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:47.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:47.057 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 186 2024-04-26T10:21:47.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.057 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:47.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:47.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839640+0000", 2024-04-26T10:21:47.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839646+0000", 2024-04-26T10:21:47.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:21:47.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839654+0000", 2024-04-26T10:21:47.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:21:47.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839661+0000", 2024-04-26T10:21:47.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.64e-06 2024-04-26T10:21:47.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852328+0000", 2024-04-26T10:21:47.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012667151 2024-04-26T10:21:47.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852538+0000", 2024-04-26T10:21:47.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020961100000000001 2024-04-26T10:21:47.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852945+0000", 2024-04-26T10:21:47.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040712099999999998 2024-04-26T10:21:47.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857372+0000", 2024-04-26T10:21:47.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044268049999999998 2024-04-26T10:21:47.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858321+0000", 2024-04-26T10:21:47.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094932999999999997 2024-04-26T10:21:47.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858367+0000", 2024-04-26T10:21:47.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5534000000000001e-05 2024-04-26T10:21:47.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858398+0000", 2024-04-26T10:21:47.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1562e-05 2024-04-26T10:21:47.062 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.063 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.063 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:47.063 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:47.063 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.147252817000002, 2024-04-26T10:21:47.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019669504000000001, 2024-04-26T10:21:47.063 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.063 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.063 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.063 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:47.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:47.064 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187 2024-04-26T10:21:47.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.064 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:47.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:47.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839667+0000", 2024-04-26T10:21:47.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:47.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839677+0000", 2024-04-26T10:21:47.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3270000000000007e-06 2024-04-26T10:21:47.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839685+0000", 2024-04-26T10:21:47.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2670000000000006e-06 2024-04-26T10:21:47.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839692+0000", 2024-04-26T10:21:47.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7129999999999999e-06 2024-04-26T10:21:47.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853685+0000", 2024-04-26T10:21:47.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013993716999999999 2024-04-26T10:21:47.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853876+0000", 2024-04-26T10:21:47.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019097100000000001 2024-04-26T10:21:47.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853989+0000", 2024-04-26T10:21:47.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011275199999999999 2024-04-26T10:21:47.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857377+0000", 2024-04-26T10:21:47.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033882489999999999 2024-04-26T10:21:47.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859222+0000", 2024-04-26T10:21:47.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001844233 2024-04-26T10:21:47.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859291+0000", 2024-04-26T10:21:47.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:21:47.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859338+0000", 2024-04-26T10:21:47.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6366000000000003e-05 2024-04-26T10:21:47.068 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.068 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.068 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.069 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:47.069 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:47.069 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.147221950999999, 2024-04-26T10:21:47.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019837468, 2024-04-26T10:21:47.069 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.069 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.069 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.069 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:47.069 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:47.069 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 188 2024-04-26T10:21:47.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.069 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:47.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:47.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839698+0000", 2024-04-26T10:21:47.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:47.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839829+0000", 2024-04-26T10:21:47.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013061099999999999 2024-04-26T10:21:47.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839853+0000", 2024-04-26T10:21:47.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3736000000000001e-05 2024-04-26T10:21:47.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839863+0000", 2024-04-26T10:21:47.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:47.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854869+0000", 2024-04-26T10:21:47.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015005978 2024-04-26T10:21:47.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854959+0000", 2024-04-26T10:21:47.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9468999999999993e-05 2024-04-26T10:21:47.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855114+0000", 2024-04-26T10:21:47.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015563799999999999 2024-04-26T10:21:47.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857386+0000", 2024-04-26T10:21:47.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002271852 2024-04-26T10:21:47.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859406+0000", 2024-04-26T10:21:47.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002019936 2024-04-26T10:21:47.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859461+0000", 2024-04-26T10:21:47.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4826e-05 2024-04-26T10:21:47.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859536+0000", 2024-04-26T10:21:47.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5566000000000001e-05 2024-04-26T10:21:47.075 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.075 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.075 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.075 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:47.075 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:47.075 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.147048087999998, 2024-04-26T10:21:47.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019826496999999998, 2024-04-26T10:21:47.076 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.076 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.076 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.076 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:47.076 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:47.076 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 189 2024-04-26T10:21:47.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.077 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:47.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:47.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839872+0000", 2024-04-26T10:21:47.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839882+0000", 2024-04-26T10:21:47.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:47.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839892+0000", 2024-04-26T10:21:47.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.217e-06 2024-04-26T10:21:47.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839900+0000", 2024-04-26T10:21:47.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5469999999999997e-06 2024-04-26T10:21:47.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855903+0000", 2024-04-26T10:21:47.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016002590000000001 2024-04-26T10:21:47.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856110+0000", 2024-04-26T10:21:47.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020711199999999999 2024-04-26T10:21:47.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856421+0000", 2024-04-26T10:21:47.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031128500000000001 2024-04-26T10:21:47.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857643+0000", 2024-04-26T10:21:47.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012215520000000001 2024-04-26T10:21:47.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859603+0000", 2024-04-26T10:21:47.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019600350000000002 2024-04-26T10:21:47.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859660+0000", 2024-04-26T10:21:47.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6857999999999997e-05 2024-04-26T10:21:47.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859699+0000", 2024-04-26T10:21:47.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9641999999999998e-05 2024-04-26T10:21:47.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.081 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.082 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15562 5.f 5:f08fe41e:::benchmark_data_smithi052_19421_object15561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:47.082 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:47.082 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.9940324579999995, 2024-04-26T10:21:47.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015831088, 2024-04-26T10:21:47.082 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.082 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:47.082 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:47.082 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15562 2024-04-26T10:21:47.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.083 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:47.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:47.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:47.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992927+0000", 2024-04-26T10:21:47.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9285000000000001e-05 2024-04-26T10:21:47.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992940+0000", 2024-04-26T10:21:47.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3040999999999999e-05 2024-04-26T10:21:47.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992948+0000", 2024-04-26T10:21:47.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5850000000000002e-06 2024-04-26T10:21:47.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.997631+0000", 2024-04-26T10:21:47.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046834160000000001 2024-04-26T10:21:47.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.997851+0000", 2024-04-26T10:21:47.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000220416 2024-04-26T10:21:47.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.998105+0000", 2024-04-26T10:21:47.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025348599999999998 2024-04-26T10:21:47.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.004264+0000", 2024-04-26T10:21:47.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061588499999999996 2024-04-26T10:21:47.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008560+0000", 2024-04-26T10:21:47.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042958579999999996 2024-04-26T10:21:47.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008647+0000", 2024-04-26T10:21:47.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7609999999999996e-05 2024-04-26T10:21:47.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008719+0000", 2024-04-26T10:21:47.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2336000000000007e-05 2024-04-26T10:21:47.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.087 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.088 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15563 5.f 5:f98d3bb0:::benchmark_data_smithi052_19421_object15562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:47.088 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.993442+0000", 2024-04-26T10:21:47.088 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.993478466, 2024-04-26T10:21:47.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015592195999999999, 2024-04-26T10:21:47.088 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.088 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:47.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:47.088 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15563 2024-04-26T10:21:47.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.088 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993442+0000", 2024-04-26T10:21:47.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993442+0000", 2024-04-26T10:21:47.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993441+0000", 2024-04-26T10:21:47.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993494+0000", 2024-04-26T10:21:47.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2369e-05 2024-04-26T10:21:47.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993515+0000", 2024-04-26T10:21:47.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1274e-05 2024-04-26T10:21:47.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993528+0000", 2024-04-26T10:21:47.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2858e-05 2024-04-26T10:21:47.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.000547+0000", 2024-04-26T10:21:47.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070196010000000003 2024-04-26T10:21:47.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.000660+0000", 2024-04-26T10:21:47.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112273 2024-04-26T10:21:47.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.000757+0000", 2024-04-26T10:21:47.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6965000000000004e-05 2024-04-26T10:21:47.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.006425+0000", 2024-04-26T10:21:47.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056687639999999997 2024-04-26T10:21:47.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008907+0000", 2024-04-26T10:21:47.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024819289999999999 2024-04-26T10:21:47.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008993+0000", 2024-04-26T10:21:47.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5426999999999994e-05 2024-04-26T10:21:47.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.009035+0000", 2024-04-26T10:21:47.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1912000000000001e-05 2024-04-26T10:21:47.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.093 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.094 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15564 5.f 5:f61b0088:::benchmark_data_smithi052_19421_object15563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:47.094 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:47.094 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.9925304370000001, 2024-04-26T10:21:47.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017729826000000001, 2024-04-26T10:21:47.094 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.094 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:47.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:47.094 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15564 2024-04-26T10:21:47.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.095 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:47.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:47.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994389+0000", 2024-04-26T10:21:47.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994451+0000", 2024-04-26T10:21:47.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2032999999999994e-05 2024-04-26T10:21:47.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994477+0000", 2024-04-26T10:21:47.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5267999999999999e-05 2024-04-26T10:21:47.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994486+0000", 2024-04-26T10:21:47.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9420000000000001e-06 2024-04-26T10:21:47.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001578+0000", 2024-04-26T10:21:47.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070928110000000001 2024-04-26T10:21:47.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001748+0000", 2024-04-26T10:21:47.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016944099999999999 2024-04-26T10:21:47.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001914+0000", 2024-04-26T10:21:47.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000166546 2024-04-26T10:21:47.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.006488+0000", 2024-04-26T10:21:47.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045735460000000004 2024-04-26T10:21:47.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012034+0000", 2024-04-26T10:21:47.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055461449999999997 2024-04-26T10:21:47.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012085+0000", 2024-04-26T10:21:47.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1319000000000001e-05 2024-04-26T10:21:47.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012120+0000", 2024-04-26T10:21:47.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4904999999999999e-05 2024-04-26T10:21:47.099 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.099 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.099 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.100 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15567 5.f 5:f5b92a5d:::benchmark_data_smithi052_19421_object15566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:47.100 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.996077+0000", 2024-04-26T10:21:47.100 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.990843999, 2024-04-26T10:21:47.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016208895000000001, 2024-04-26T10:21:47.100 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.100 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.100 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.100 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:47.100 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:47.100 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15567 2024-04-26T10:21:47.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.100 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996077+0000", 2024-04-26T10:21:47.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996077+0000", 2024-04-26T10:21:47.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996076+0000", 2024-04-26T10:21:47.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:47.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996139+0000", 2024-04-26T10:21:47.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2929999999999995e-05 2024-04-26T10:21:47.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996155+0000", 2024-04-26T10:21:47.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6076e-05 2024-04-26T10:21:47.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996163+0000", 2024-04-26T10:21:47.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0320000000000003e-06 2024-04-26T10:21:47.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.002727+0000", 2024-04-26T10:21:47.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065644240000000001 2024-04-26T10:21:47.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.002901+0000", 2024-04-26T10:21:47.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017414899999999999 2024-04-26T10:21:47.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.003080+0000", 2024-04-26T10:21:47.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017905199999999999 2024-04-26T10:21:47.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.009066+0000", 2024-04-26T10:21:47.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059855309999999997 2024-04-26T10:21:47.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012182+0000", 2024-04-26T10:21:47.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003116462 2024-04-26T10:21:47.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012230+0000", 2024-04-26T10:21:47.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7681e-05 2024-04-26T10:21:47.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012286+0000", 2024-04-26T10:21:47.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5763999999999997e-05 2024-04-26T10:21:47.105 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.105 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.105 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.106 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:27841 5.9 5:9893f413:::benchmark_data_smithi052_19421_object27840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T10:21:47.106 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:43.752430+0000", 2024-04-26T10:21:47.106 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.2344909799999999, 2024-04-26T10:21:47.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015615922000000001, 2024-04-26T10:21:47.106 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.106 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:47.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:47.106 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 27841 2024-04-26T10:21:47.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.106 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752430+0000", 2024-04-26T10:21:47.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752430+0000", 2024-04-26T10:21:47.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752429+0000", 2024-04-26T10:21:47.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:47.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752477+0000", 2024-04-26T10:21:47.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7899000000000003e-05 2024-04-26T10:21:47.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752495+0000", 2024-04-26T10:21:47.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8844000000000001e-05 2024-04-26T10:21:47.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752504+0000", 2024-04-26T10:21:47.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3010000000000007e-06 2024-04-26T10:21:47.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752538+0000", 2024-04-26T10:21:47.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4134000000000002e-05 2024-04-26T10:21:47.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752635+0000", 2024-04-26T10:21:47.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7461999999999996e-05 2024-04-26T10:21:47.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752710+0000", 2024-04-26T10:21:47.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4355000000000002e-05 2024-04-26T10:21:47.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.755511+0000", 2024-04-26T10:21:47.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028017979999999999 2024-04-26T10:21:47.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:47.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.767966+0000", 2024-04-26T10:21:47.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012454902 2024-04-26T10:21:47.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:47.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.768015+0000", 2024-04-26T10:21:47.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8523999999999998e-05 2024-04-26T10:21:47.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:47.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.768046+0000", 2024-04-26T10:21:47.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0956e-05 2024-04-26T10:21:47.111 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.111 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.111 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.111 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.111 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.111 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:47.113 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:47.114 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:47.109+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:47.214 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:47.208+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:47.232 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:47.232 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:21:47.233 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T10:21:47.233 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:47.243 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:47.315 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:47.312+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:47.349 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:47.350 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:21:47.350 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:21:47.350 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:21:47.350 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:47.359 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:47.417 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:47.412+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:47.517 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:47.512+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:47.522 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:47.522 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:21:47.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:21:47.522 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:47.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.522 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:47.522 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:47.522 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.217943855000001, 2024-04-26T10:21:47.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018441564000000001, 2024-04-26T10:21:47.522 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.523 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.523 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:47.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:47.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301372+0000", 2024-04-26T10:21:47.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:47.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301399+0000", 2024-04-26T10:21:47.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7039999999999999e-05 2024-04-26T10:21:47.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301426+0000", 2024-04-26T10:21:47.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6381e-05 2024-04-26T10:21:47.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301480+0000", 2024-04-26T10:21:47.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3681000000000003e-05 2024-04-26T10:21:47.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310584+0000", 2024-04-26T10:21:47.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091042339999999992 2024-04-26T10:21:47.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:47.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310591+0000", 2024-04-26T10:21:47.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8190000000000003e-06 2024-04-26T10:21:47.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311503+0000", 2024-04-26T10:21:47.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000911983 2024-04-26T10:21:47.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311605+0000", 2024-04-26T10:21:47.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102619 2024-04-26T10:21:47.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:47.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311730+0000", 2024-04-26T10:21:47.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012474400000000001 2024-04-26T10:21:47.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:47.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317287+0000", 2024-04-26T10:21:47.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055571140000000002 2024-04-26T10:21:47.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319724+0000", 2024-04-26T10:21:47.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002437294 2024-04-26T10:21:47.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319776+0000", 2024-04-26T10:21:47.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1992e-05 2024-04-26T10:21:47.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319816+0000", 2024-04-26T10:21:47.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9709999999999998e-05 2024-04-26T10:21:47.528 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.528 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.528 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.528 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:47.528 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:47.528 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.212627988999998, 2024-04-26T10:21:47.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013786338, 2024-04-26T10:21:47.529 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.529 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.529 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:47.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:47.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306689+0000", 2024-04-26T10:21:47.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306697+0000", 2024-04-26T10:21:47.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2420000000000003e-06 2024-04-26T10:21:47.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306725+0000", 2024-04-26T10:21:47.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8209e-05 2024-04-26T10:21:47.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306750+0000", 2024-04-26T10:21:47.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5432e-05 2024-04-26T10:21:47.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310622+0000", 2024-04-26T10:21:47.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003871738 2024-04-26T10:21:47.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:21:47.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310627+0000", 2024-04-26T10:21:47.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4890000000000003e-06 2024-04-26T10:21:47.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314030+0000", 2024-04-26T10:21:47.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003402094 2024-04-26T10:21:47.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314147+0000", 2024-04-26T10:21:47.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011776499999999999 2024-04-26T10:21:47.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:47.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314441+0000", 2024-04-26T10:21:47.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000293543 2024-04-26T10:21:47.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:47.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319422+0000", 2024-04-26T10:21:47.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004981096 2024-04-26T10:21:47.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320057+0000", 2024-04-26T10:21:47.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000635521 2024-04-26T10:21:47.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320110+0000", 2024-04-26T10:21:47.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2104999999999997e-05 2024-04-26T10:21:47.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320477+0000", 2024-04-26T10:21:47.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036709500000000001 2024-04-26T10:21:47.534 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.534 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.534 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.534 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:47.535 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:47.535 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.212534628, 2024-04-26T10:21:47.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013859405999999999, 2024-04-26T10:21:47.535 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.535 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.535 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:47.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:47.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306783+0000", 2024-04-26T10:21:47.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:47.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306788+0000", 2024-04-26T10:21:47.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3990000000000003e-06 2024-04-26T10:21:47.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306796+0000", 2024-04-26T10:21:47.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8820000000000001e-06 2024-04-26T10:21:47.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306803+0000", 2024-04-26T10:21:47.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6649999999999997e-06 2024-04-26T10:21:47.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314454+0000", 2024-04-26T10:21:47.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076508349999999999 2024-04-26T10:21:47.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314930+0000", 2024-04-26T10:21:47.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047624199999999998 2024-04-26T10:21:47.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:47.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315127+0000", 2024-04-26T10:21:47.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196751 2024-04-26T10:21:47.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:47.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320496+0000", 2024-04-26T10:21:47.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053690150000000004 2024-04-26T10:21:47.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320576+0000", 2024-04-26T10:21:47.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0327999999999994e-05 2024-04-26T10:21:47.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320611+0000", 2024-04-26T10:21:47.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-04-26T10:21:47.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320643+0000", 2024-04-26T10:21:47.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2474000000000001e-05 2024-04-26T10:21:47.540 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.540 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.540 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.540 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:47.540 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:47.540 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.212455456999997, 2024-04-26T10:21:47.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013889195, 2024-04-26T10:21:47.540 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.540 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.540 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:47.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:47.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306862+0000", 2024-04-26T10:21:47.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:47.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306867+0000", 2024-04-26T10:21:47.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5390000000000001e-06 2024-04-26T10:21:47.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306874+0000", 2024-04-26T10:21:47.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7549999999999997e-06 2024-04-26T10:21:47.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306887+0000", 2024-04-26T10:21:47.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.313e-05 2024-04-26T10:21:47.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315477+0000", 2024-04-26T10:21:47.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085902489999999995 2024-04-26T10:21:47.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315607+0000", 2024-04-26T10:21:47.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129789 2024-04-26T10:21:47.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:47.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315767+0000", 2024-04-26T10:21:47.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016052699999999999 2024-04-26T10:21:47.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:47.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320502+0000", 2024-04-26T10:21:47.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00473421 2024-04-26T10:21:47.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320691+0000", 2024-04-26T10:21:47.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018938900000000001 2024-04-26T10:21:47.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320721+0000", 2024-04-26T10:21:47.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9677000000000001e-05 2024-04-26T10:21:47.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320752+0000", 2024-04-26T10:21:47.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1486000000000003e-05 2024-04-26T10:21:47.545 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.545 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.545 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.545 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:47.545 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:47.545 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.212417539, 2024-04-26T10:21:47.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012590871, 2024-04-26T10:21:47.546 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.546 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.546 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:47.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:47.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306900+0000", 2024-04-26T10:21:47.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:47.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306905+0000", 2024-04-26T10:21:47.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9010000000000002e-06 2024-04-26T10:21:47.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306911+0000", 2024-04-26T10:21:47.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6030000000000004e-06 2024-04-26T10:21:47.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306916+0000", 2024-04-26T10:21:47.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8539999999999996e-06 2024-04-26T10:21:47.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308529+0000", 2024-04-26T10:21:47.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001613258 2024-04-26T10:21:47.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:47.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308537+0000", 2024-04-26T10:21:47.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1680000000000004e-06 2024-04-26T10:21:47.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311962+0000", 2024-04-26T10:21:47.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034247290000000001 2024-04-26T10:21:47.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.312092+0000", 2024-04-26T10:21:47.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013048700000000001 2024-04-26T10:21:47.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:47.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.312438+0000", 2024-04-26T10:21:47.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00034558700000000001 2024-04-26T10:21:47.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:47.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317984+0000", 2024-04-26T10:21:47.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005546067 2024-04-26T10:21:47.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319373+0000", 2024-04-26T10:21:47.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001389426 2024-04-26T10:21:47.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319438+0000", 2024-04-26T10:21:47.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4849000000000002e-05 2024-04-26T10:21:47.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319492+0000", 2024-04-26T10:21:47.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3554000000000003e-05 2024-04-26T10:21:47.551 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.551 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.551 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.551 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:47.551 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:47.551 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.210746956000001, 2024-04-26T10:21:47.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011321652999999999, 2024-04-26T10:21:47.552 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.552 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.552 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:47.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:47.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:47.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308576+0000", 2024-04-26T10:21:47.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2920000000000003e-06 2024-04-26T10:21:47.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308582+0000", 2024-04-26T10:21:47.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6540000000000002e-06 2024-04-26T10:21:47.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308590+0000", 2024-04-26T10:21:47.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-04-26T10:21:47.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308958+0000", 2024-04-26T10:21:47.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036823500000000001 2024-04-26T10:21:47.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:21:47.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308963+0000", 2024-04-26T10:21:47.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6160000000000001e-06 2024-04-26T10:21:47.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.313758+0000", 2024-04-26T10:21:47.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004794296 2024-04-26T10:21:47.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.313848+0000", 2024-04-26T10:21:47.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0488999999999994e-05 2024-04-26T10:21:47.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:47.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314099+0000", 2024-04-26T10:21:47.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025094700000000001 2024-04-26T10:21:47.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:47.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.318989+0000", 2024-04-26T10:21:47.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048896850000000004 2024-04-26T10:21:47.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319799+0000", 2024-04-26T10:21:47.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00080979299999999995 2024-04-26T10:21:47.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319847+0000", 2024-04-26T10:21:47.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8254999999999998e-05 2024-04-26T10:21:47.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319893+0000", 2024-04-26T10:21:47.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6108e-05 2024-04-26T10:21:47.557 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.557 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.557 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.558 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:47.558 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:47.558 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.210625106999998, 2024-04-26T10:21:47.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012032891, 2024-04-26T10:21:47.558 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.558 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.558 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:47.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:47.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:47.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:47.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308697+0000", 2024-04-26T10:21:47.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4449999999999998e-06 2024-04-26T10:21:47.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308864+0000", 2024-04-26T10:21:47.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000167045 2024-04-26T10:21:47.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308886+0000", 2024-04-26T10:21:47.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1858999999999999e-05 2024-04-26T10:21:47.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316346+0000", 2024-04-26T10:21:47.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007460225 2024-04-26T10:21:47.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316500+0000", 2024-04-26T10:21:47.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153776 2024-04-26T10:21:47.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:47.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316665+0000", 2024-04-26T10:21:47.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000164854 2024-04-26T10:21:47.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:47.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320564+0000", 2024-04-26T10:21:47.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038988339999999999 2024-04-26T10:21:47.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320680+0000", 2024-04-26T10:21:47.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011616399999999999 2024-04-26T10:21:47.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320710+0000", 2024-04-26T10:21:47.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0182e-05 2024-04-26T10:21:47.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320726+0000", 2024-04-26T10:21:47.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6118000000000001e-05 2024-04-26T10:21:47.563 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.563 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.563 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.563 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:15562 5.f e26/22 5:f08fe41e:::benchmark_data_smithi052_19421_object15561:head v 26'996, mlcod=26'994)", 2024-04-26T10:21:47.563 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:38.999553+0000", 2024-04-26T10:21:47.563 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.5197655949999991, 2024-04-26T10:21:47.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010040301, 2024-04-26T10:21:47.563 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.563 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.563 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999553+0000", 2024-04-26T10:21:47.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999553+0000", 2024-04-26T10:21:47.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999551+0000", 2024-04-26T10:21:47.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:47.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999614+0000", 2024-04-26T10:21:47.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2706999999999994e-05 2024-04-26T10:21:47.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999634+0000", 2024-04-26T10:21:47.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9760999999999999e-05 2024-04-26T10:21:47.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999644+0000", 2024-04-26T10:21:47.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0756e-05 2024-04-26T10:21:47.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999719+0000", 2024-04-26T10:21:47.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4643999999999999e-05 2024-04-26T10:21:47.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:38.999757+0000", 2024-04-26T10:21:47.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.858e-05 2024-04-26T10:21:47.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.009553+0000", 2024-04-26T10:21:47.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097958790000000004 2024-04-26T10:21:47.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.009593+0000", 2024-04-26T10:21:47.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9677e-05 2024-04-26T10:21:47.567 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.567 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.567 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.567 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:17339 5.e e26/22 5:72e2fe32:::benchmark_data_smithi052_19421_object17338:head v 26'1109, mlcod=26'1106)", 2024-04-26T10:21:47.567 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:39.661438+0000", 2024-04-26T10:21:47.568 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.857880615, 2024-04-26T10:21:47.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010169489, 2024-04-26T10:21:47.568 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.568 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.568 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661438+0000", 2024-04-26T10:21:47.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661438+0000", 2024-04-26T10:21:47.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661436+0000", 2024-04-26T10:21:47.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:47.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661484+0000", 2024-04-26T10:21:47.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7521999999999997e-05 2024-04-26T10:21:47.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661496+0000", 2024-04-26T10:21:47.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2368000000000001e-05 2024-04-26T10:21:47.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661505+0000", 2024-04-26T10:21:47.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3760000000000008e-06 2024-04-26T10:21:47.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661565+0000", 2024-04-26T10:21:47.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0384000000000003e-05 2024-04-26T10:21:47.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.661598+0000", 2024-04-26T10:21:47.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2802999999999997e-05 2024-04-26T10:21:47.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.671560+0000", 2024-04-26T10:21:47.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099624180000000007 2024-04-26T10:21:47.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:39.671607+0000", 2024-04-26T10:21:47.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6931000000000002e-05 2024-04-26T10:21:47.571 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.571 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.571 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.572 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24842 5.0 e27/22 5:0a88cb3c:::benchmark_data_smithi052_19421_object24841:head v 27'1472, mlcod=27'1470)", 2024-04-26T10:21:47.572 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.545356+0000", 2024-04-26T10:21:47.572 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.9739625079999996, 2024-04-26T10:21:47.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010303537, 2024-04-26T10:21:47.572 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.572 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.572 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545356+0000", 2024-04-26T10:21:47.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545356+0000", 2024-04-26T10:21:47.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545355+0000", 2024-04-26T10:21:47.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545413+0000", 2024-04-26T10:21:47.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8519e-05 2024-04-26T10:21:47.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545425+0000", 2024-04-26T10:21:47.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1844999999999999e-05 2024-04-26T10:21:47.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545433+0000", 2024-04-26T10:21:47.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6279999999999996e-06 2024-04-26T10:21:47.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545487+0000", 2024-04-26T10:21:47.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4523e-05 2024-04-26T10:21:47.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545524+0000", 2024-04-26T10:21:47.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6656000000000003e-05 2024-04-26T10:21:47.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555637+0000", 2024-04-26T10:21:47.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010113074999999999 2024-04-26T10:21:47.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555659+0000", 2024-04-26T10:21:47.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2379999999999999e-05 2024-04-26T10:21:47.576 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.576 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.576 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.576 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24843 5.8 e27/22 5:12cddf7e:::benchmark_data_smithi052_19421_object24842:head v 27'1588, mlcod=27'1586)", 2024-04-26T10:21:47.576 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.545451+0000", 2024-04-26T10:21:47.576 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.9738671940000003, 2024-04-26T10:21:47.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010159789000000001, 2024-04-26T10:21:47.576 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.576 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.576 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545451+0000", 2024-04-26T10:21:47.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545451+0000", 2024-04-26T10:21:47.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545451+0000", 2024-04-26T10:21:47.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:47.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545506+0000", 2024-04-26T10:21:47.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5708999999999998e-05 2024-04-26T10:21:47.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545527+0000", 2024-04-26T10:21:47.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0927000000000001e-05 2024-04-26T10:21:47.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545541+0000", 2024-04-26T10:21:47.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4008999999999999e-05 2024-04-26T10:21:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545600+0000", 2024-04-26T10:21:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8885999999999998e-05 2024-04-26T10:21:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545638+0000", 2024-04-26T10:21:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7546999999999998e-05 2024-04-26T10:21:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555568+0000", 2024-04-26T10:21:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099299090000000007 2024-04-26T10:21:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555611+0000", 2024-04-26T10:21:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3302e-05 2024-04-26T10:21:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24855 5.d e27/22 5:ba6d2780:::benchmark_data_smithi052_19421_object24854:head v 27'1602, mlcod=27'1600)", 2024-04-26T10:21:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.545589+0000", 2024-04-26T10:21:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.9737296459999998, 2024-04-26T10:21:47.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010064831, 2024-04-26T10:21:47.581 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.581 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.581 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545589+0000", 2024-04-26T10:21:47.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545589+0000", 2024-04-26T10:21:47.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545588+0000", 2024-04-26T10:21:47.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545644+0000", 2024-04-26T10:21:47.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6289000000000003e-05 2024-04-26T10:21:47.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545657+0000", 2024-04-26T10:21:47.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2826000000000001e-05 2024-04-26T10:21:47.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545666+0000", 2024-04-26T10:21:47.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1439999999999992e-06 2024-04-26T10:21:47.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545712+0000", 2024-04-26T10:21:47.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6105e-05 2024-04-26T10:21:47.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.545726+0000", 2024-04-26T10:21:47.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3988000000000001e-05 2024-04-26T10:21:47.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555601+0000", 2024-04-26T10:21:47.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098745399999999994 2024-04-26T10:21:47.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.555654+0000", 2024-04-26T10:21:47.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2850999999999999e-05 2024-04-26T10:21:47.584 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.584 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.584 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.585 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24863 5.e e27/22 5:70815639:::benchmark_data_smithi052_19421_object24862:head v 27'1571, mlcod=27'1569)", 2024-04-26T10:21:47.585 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:47.585 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.9660129140000002, 2024-04-26T10:21:47.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014429724999999999, 2024-04-26T10:21:47.585 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.585 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.585 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:47.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:47.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553304+0000", 2024-04-26T10:21:47.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553377+0000", 2024-04-26T10:21:47.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3206000000000003e-05 2024-04-26T10:21:47.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553397+0000", 2024-04-26T10:21:47.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9366000000000001e-05 2024-04-26T10:21:47.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553407+0000", 2024-04-26T10:21:47.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0676000000000001e-05 2024-04-26T10:21:47.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553467+0000", 2024-04-26T10:21:47.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9735999999999999e-05 2024-04-26T10:21:47.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553486+0000", 2024-04-26T10:21:47.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8842e-05 2024-04-26T10:21:47.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.567649+0000", 2024-04-26T10:21:47.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01416272 2024-04-26T10:21:47.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.567735+0000", 2024-04-26T10:21:47.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6363e-05 2024-04-26T10:21:47.589 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.589 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.589 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.589 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:25863 5.e e27/22 5:71ddbd73:::benchmark_data_smithi052_19421_object25862:head v 27'1637, mlcod=27'1635)", 2024-04-26T10:21:47.589 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.953090+0000", 2024-04-26T10:21:47.589 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.5662278550000002, 2024-04-26T10:21:47.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010108455000000001, 2024-04-26T10:21:47.589 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.589 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.589 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.953090+0000", 2024-04-26T10:21:47.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.953090+0000", 2024-04-26T10:21:47.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.953090+0000", 2024-04-26T10:21:47.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:47.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.953141+0000", 2024-04-26T10:21:47.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0835999999999999e-05 2024-04-26T10:21:47.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.953147+0000", 2024-04-26T10:21:47.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.285e-06 2024-04-26T10:21:47.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.953151+0000", 2024-04-26T10:21:47.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3719999999999998e-06 2024-04-26T10:21:47.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.953223+0000", 2024-04-26T10:21:47.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1736999999999994e-05 2024-04-26T10:21:47.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.953250+0000", 2024-04-26T10:21:47.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7083000000000001e-05 2024-04-26T10:21:47.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.963157+0000", 2024-04-26T10:21:47.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0099072190000000001 2024-04-26T10:21:47.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.963199+0000", 2024-04-26T10:21:47.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1483000000000002e-05 2024-04-26T10:21:47.593 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.593 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.593 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.593 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29347 5.f e28/22 5:fc6ad49e:::benchmark_data_smithi052_19421_object29346:head v 28'1843, mlcod=28'1841)", 2024-04-26T10:21:47.593 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.374473+0000", 2024-04-26T10:21:47.593 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.1448455210000001, 2024-04-26T10:21:47.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010808678, 2024-04-26T10:21:47.594 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.594 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.594 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.374473+0000", 2024-04-26T10:21:47.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.374473+0000", 2024-04-26T10:21:47.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.374472+0000", 2024-04-26T10:21:47.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.374535+0000", 2024-04-26T10:21:47.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3114000000000006e-05 2024-04-26T10:21:47.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.374572+0000", 2024-04-26T10:21:47.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7116999999999997e-05 2024-04-26T10:21:47.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.374581+0000", 2024-04-26T10:21:47.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8990000000000007e-06 2024-04-26T10:21:47.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.374641+0000", 2024-04-26T10:21:47.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0004999999999999e-05 2024-04-26T10:21:47.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.374664+0000", 2024-04-26T10:21:47.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3371999999999999e-05 2024-04-26T10:21:47.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.385220+0000", 2024-04-26T10:21:47.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010555138 2024-04-26T10:21:47.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.385281+0000", 2024-04-26T10:21:47.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1946000000000006e-05 2024-04-26T10:21:47.597 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.598 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.598 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.598 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29357 5.d e28/22 5:b70cb761:::benchmark_data_smithi052_19421_object29356:head v 28'1892, mlcod=28'1890)", 2024-04-26T10:21:47.598 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.378626+0000", 2024-04-26T10:21:47.598 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.1406926139999998, 2024-04-26T10:21:47.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012686653000000001, 2024-04-26T10:21:47.598 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.598 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.598 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378626+0000", 2024-04-26T10:21:47.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378626+0000", 2024-04-26T10:21:47.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378625+0000", 2024-04-26T10:21:47.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378673+0000", 2024-04-26T10:21:47.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8232000000000002e-05 2024-04-26T10:21:47.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378690+0000", 2024-04-26T10:21:47.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6983999999999999e-05 2024-04-26T10:21:47.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378699+0000", 2024-04-26T10:21:47.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3130000000000004e-06 2024-04-26T10:21:47.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378756+0000", 2024-04-26T10:21:47.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6437999999999997e-05 2024-04-26T10:21:47.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378776+0000", 2024-04-26T10:21:47.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0523999999999999e-05 2024-04-26T10:21:47.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.391219+0000", 2024-04-26T10:21:47.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012442698 2024-04-26T10:21:47.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.391312+0000", 2024-04-26T10:21:47.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3436000000000005e-05 2024-04-26T10:21:47.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.602 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.602 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29362 5.d e28/22 5:bea6ab30:::benchmark_data_smithi052_19421_object29361:head v 28'1893, mlcod=28'1890)", 2024-04-26T10:21:47.602 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.380758+0000", 2024-04-26T10:21:47.602 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.1385599200000001, 2024-04-26T10:21:47.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013097510999999999, 2024-04-26T10:21:47.602 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.602 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.602 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380758+0000", 2024-04-26T10:21:47.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380758+0000", 2024-04-26T10:21:47.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380758+0000", 2024-04-26T10:21:47.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:47.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380807+0000", 2024-04-26T10:21:47.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8588000000000003e-05 2024-04-26T10:21:47.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380819+0000", 2024-04-26T10:21:47.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2432999999999999e-05 2024-04-26T10:21:47.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380825+0000", 2024-04-26T10:21:47.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.874e-06 2024-04-26T10:21:47.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.381904+0000", 2024-04-26T10:21:47.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010787940000000001 2024-04-26T10:21:47.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.381923+0000", 2024-04-26T10:21:47.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9599999999999999e-05 2024-04-26T10:21:47.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.393810+0000", 2024-04-26T10:21:47.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011886346000000001 2024-04-26T10:21:47.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.393856+0000", 2024-04-26T10:21:47.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6372999999999998e-05 2024-04-26T10:21:47.606 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.606 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.606 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.606 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29366 5.d e28/22 5:b794875b:::benchmark_data_smithi052_19421_object29365:head v 28'1894, mlcod=28'1890)", 2024-04-26T10:21:47.606 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.382527+0000", 2024-04-26T10:21:47.606 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.136791455, 2024-04-26T10:21:47.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011368682999999999, 2024-04-26T10:21:47.607 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.607 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.607 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.382527+0000", 2024-04-26T10:21:47.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.382527+0000", 2024-04-26T10:21:47.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.382526+0000", 2024-04-26T10:21:47.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.382619+0000", 2024-04-26T10:21:47.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3325999999999994e-05 2024-04-26T10:21:47.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.382631+0000", 2024-04-26T10:21:47.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1092e-05 2024-04-26T10:21:47.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.382639+0000", 2024-04-26T10:21:47.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1950000000000003e-06 2024-04-26T10:21:47.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.385389+0000", 2024-04-26T10:21:47.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0027499170000000002 2024-04-26T10:21:47.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.385406+0000", 2024-04-26T10:21:47.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6969e-05 2024-04-26T10:21:47.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.393869+0000", 2024-04-26T10:21:47.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084636929999999996 2024-04-26T10:21:47.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.393896+0000", 2024-04-26T10:21:47.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6234999999999999e-05 2024-04-26T10:21:47.610 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.610 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.610 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.610 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29367 5.d e28/22 5:bbbc0f20:::benchmark_data_smithi052_19421_object29366:head v 28'1895, mlcod=28'1890)", 2024-04-26T10:21:47.611 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.383857+0000", 2024-04-26T10:21:47.611 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.135461228, 2024-04-26T10:21:47.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010059724000000001, 2024-04-26T10:21:47.611 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.611 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.611 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.383857+0000", 2024-04-26T10:21:47.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.383857+0000", 2024-04-26T10:21:47.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.383856+0000", 2024-04-26T10:21:47.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.383932+0000", 2024-04-26T10:21:47.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6012000000000003e-05 2024-04-26T10:21:47.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.383945+0000", 2024-04-26T10:21:47.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2261e-05 2024-04-26T10:21:47.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.383952+0000", 2024-04-26T10:21:47.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7870000000000002e-06 2024-04-26T10:21:47.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.386557+0000", 2024-04-26T10:21:47.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0026051080000000001 2024-04-26T10:21:47.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.386588+0000", 2024-04-26T10:21:47.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0366e-05 2024-04-26T10:21:47.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.393898+0000", 2024-04-26T10:21:47.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007310006 2024-04-26T10:21:47.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.393917+0000", 2024-04-26T10:21:47.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9055999999999998e-05 2024-04-26T10:21:47.614 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.614 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.614 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.615 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29403 5.8 e28/22 5:16857565:::benchmark_data_smithi052_19421_object29402:head v 28'1853, mlcod=28'1851)", 2024-04-26T10:21:47.615 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.399750+0000", 2024-04-26T10:21:47.615 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.1195685389999999, 2024-04-26T10:21:47.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011819834, 2024-04-26T10:21:47.615 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:47.615 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:47.615 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:47.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:47.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399750+0000", 2024-04-26T10:21:47.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:47.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399750+0000", 2024-04-26T10:21:47.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:47.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:47.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399749+0000", 2024-04-26T10:21:47.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:47.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:47.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399808+0000", 2024-04-26T10:21:47.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9106e-05 2024-04-26T10:21:47.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:47.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399819+0000", 2024-04-26T10:21:47.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0543999999999999e-05 2024-04-26T10:21:47.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399824+0000", 2024-04-26T10:21:47.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:21:47.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:47.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399889+0000", 2024-04-26T10:21:47.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5681999999999999e-05 2024-04-26T10:21:47.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:47.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399912+0000", 2024-04-26T10:21:47.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2673000000000001e-05 2024-04-26T10:21:47.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:47.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.411514+0000", 2024-04-26T10:21:47.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011601728 2024-04-26T10:21:47.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:47.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:47.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:47.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.411570+0000", 2024-04-26T10:21:47.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5852e-05 2024-04-26T10:21:47.619 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.619 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.619 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.619 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:47.619 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:47.619 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:47.620 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 14 16 34424 34408 153.59 0.4375 0.00240667 0.00604115 2024-04-26T10:21:47.621 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:47.624 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:47.616+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:47.721 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:47.716+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:47.765 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34772 5.7 5:eb875e49:::benchmark_data_smithi052_19421_object34771:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.758542+0000", 2024-04-26T10:21:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0048587910000000003, 2024-04-26T10:21:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048763699999999997, 2024-04-26T10:21:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:47.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34772 2024-04-26T10:21:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758542+0000", 2024-04-26T10:21:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758542+0000", 2024-04-26T10:21:47.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758541+0000", 2024-04-26T10:21:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758628+0000", 2024-04-26T10:21:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6534999999999997e-05 2024-04-26T10:21:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758633+0000", 2024-04-26T10:21:47.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4689999999999996e-06 2024-04-26T10:21:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758637+0000", 2024-04-26T10:21:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.602e-06 2024-04-26T10:21:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758679+0000", 2024-04-26T10:21:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2364999999999998e-05 2024-04-26T10:21:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758791+0000", 2024-04-26T10:21:47.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011142 2024-04-26T10:21:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34773 5.7 5:e9b464a1:::benchmark_data_smithi052_19421_object34772:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.758704+0000", 2024-04-26T10:21:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0046960029999999998, 2024-04-26T10:21:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047549970000000004, 2024-04-26T10:21:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:47.769 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34773 2024-04-26T10:21:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758704+0000", 2024-04-26T10:21:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758704+0000", 2024-04-26T10:21:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758704+0000", 2024-04-26T10:21:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758762+0000", 2024-04-26T10:21:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7961000000000003e-05 2024-04-26T10:21:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758767+0000", 2024-04-26T10:21:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6180000000000003e-06 2024-04-26T10:21:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758771+0000", 2024-04-26T10:21:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5839999999999999e-06 2024-04-26T10:21:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.760599+0000", 2024-04-26T10:21:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018279850000000001 2024-04-26T10:21:47.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.760720+0000", 2024-04-26T10:21:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121555 2024-04-26T10:21:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34774 5.6 5:639ff24d:::benchmark_data_smithi052_19421_object34773:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.758782+0000", 2024-04-26T10:21:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0046185510000000003, 2024-04-26T10:21:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047133380000000001, 2024-04-26T10:21:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.773 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34774 2024-04-26T10:21:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758782+0000", 2024-04-26T10:21:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758782+0000", 2024-04-26T10:21:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758781+0000", 2024-04-26T10:21:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758829+0000", 2024-04-26T10:21:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7364999999999998e-05 2024-04-26T10:21:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758834+0000", 2024-04-26T10:21:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1390000000000003e-06 2024-04-26T10:21:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758837+0000", 2024-04-26T10:21:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5410000000000001e-06 2024-04-26T10:21:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758887+0000", 2024-04-26T10:21:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9225999999999999e-05 2024-04-26T10:21:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758967+0000", 2024-04-26T10:21:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9814999999999994e-05 2024-04-26T10:21:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34775 5.d 5:bc5b9f6f:::benchmark_data_smithi052_19421_object34774:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.760735+0000", 2024-04-26T10:21:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0026650659999999998, 2024-04-26T10:21:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027937180000000002, 2024-04-26T10:21:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34775 2024-04-26T10:21:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.760735+0000", 2024-04-26T10:21:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.760735+0000", 2024-04-26T10:21:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.760734+0000", 2024-04-26T10:21:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.760866+0000", 2024-04-26T10:21:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132299 2024-04-26T10:21:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.760878+0000", 2024-04-26T10:21:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1936999999999999e-05 2024-04-26T10:21:47.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.760886+0000", 2024-04-26T10:21:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0639999999999994e-06 2024-04-26T10:21:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.760934+0000", 2024-04-26T10:21:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7648999999999997e-05 2024-04-26T10:21:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.761029+0000", 2024-04-26T10:21:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4633e-05 2024-04-26T10:21:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.761116+0000", 2024-04-26T10:21:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7041999999999998e-05 2024-04-26T10:21:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.763272+0000", 2024-04-26T10:21:47.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021568669999999998 2024-04-26T10:21:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34763 5.3 5:c8eda613:::benchmark_data_smithi052_19421_object34762:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.755783+0000", 2024-04-26T10:21:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0076178039999999997, 2024-04-26T10:21:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007788489, 2024-04-26T10:21:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:47.782 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34763 2024-04-26T10:21:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.755783+0000", 2024-04-26T10:21:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.755783+0000", 2024-04-26T10:21:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.755782+0000", 2024-04-26T10:21:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.755881+0000", 2024-04-26T10:21:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8850000000000004e-05 2024-04-26T10:21:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.755890+0000", 2024-04-26T10:21:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9209999999999998e-06 2024-04-26T10:21:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.755896+0000", 2024-04-26T10:21:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.348e-06 2024-04-26T10:21:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.757234+0000", 2024-04-26T10:21:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001337794 2024-04-26T10:21:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.757320+0000", 2024-04-26T10:21:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6470000000000004e-05 2024-04-26T10:21:47.785 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34764 5.3 5:c9a5b8bd:::benchmark_data_smithi052_19421_object34763:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.755907+0000", 2024-04-26T10:21:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0074935089999999998, 2024-04-26T10:21:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076991710000000003, 2024-04-26T10:21:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:47.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34764 2024-04-26T10:21:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.755907+0000", 2024-04-26T10:21:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.755907+0000", 2024-04-26T10:21:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.755906+0000", 2024-04-26T10:21:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.755940+0000", 2024-04-26T10:21:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4013000000000001e-05 2024-04-26T10:21:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.755948+0000", 2024-04-26T10:21:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9500000000000001e-06 2024-04-26T10:21:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.755954+0000", 2024-04-26T10:21:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7520000000000002e-06 2024-04-26T10:21:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758360+0000", 2024-04-26T10:21:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024062459999999999 2024-04-26T10:21:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758435+0000", 2024-04-26T10:21:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4900000000000005e-05 2024-04-26T10:21:47.789 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34765 5.3 5:c2efc727:::benchmark_data_smithi052_19421_object34764:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.755960+0000", 2024-04-26T10:21:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0074408779999999997, 2024-04-26T10:21:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00768003, 2024-04-26T10:21:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:47.790 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34765 2024-04-26T10:21:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.755960+0000", 2024-04-26T10:21:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.755960+0000", 2024-04-26T10:21:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.755959+0000", 2024-04-26T10:21:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756045+0000", 2024-04-26T10:21:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6164999999999999e-05 2024-04-26T10:21:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756056+0000", 2024-04-26T10:21:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1045e-05 2024-04-26T10:21:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756063+0000", 2024-04-26T10:21:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8229999999999997e-06 2024-04-26T10:21:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.759655+0000", 2024-04-26T10:21:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035921780000000001 2024-04-26T10:21:47.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.759774+0000", 2024-04-26T10:21:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118805 2024-04-26T10:21:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34767 5.d 5:b1cf3290:::benchmark_data_smithi052_19421_object34766:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.756552+0000", 2024-04-26T10:21:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0068481219999999999, 2024-04-26T10:21:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071242019999999996, 2024-04-26T10:21:47.794 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34767 2024-04-26T10:21:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756552+0000", 2024-04-26T10:21:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756552+0000", 2024-04-26T10:21:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756551+0000", 2024-04-26T10:21:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756652+0000", 2024-04-26T10:21:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010056999999999999 2024-04-26T10:21:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756658+0000", 2024-04-26T10:21:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.02e-06 2024-04-26T10:21:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756662+0000", 2024-04-26T10:21:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2520000000000001e-06 2024-04-26T10:21:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756703+0000", 2024-04-26T10:21:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0491999999999998e-05 2024-04-26T10:21:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756817+0000", 2024-04-26T10:21:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011375 2024-04-26T10:21:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756893+0000", 2024-04-26T10:21:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6254999999999994e-05 2024-04-26T10:21:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.759644+0000", 2024-04-26T10:21:47.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027508049999999998 2024-04-26T10:21:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34768 5.c 5:317e422c:::benchmark_data_smithi052_19421_object34767:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.756671+0000", 2024-04-26T10:21:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0067294449999999997, 2024-04-26T10:21:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070455479999999996, 2024-04-26T10:21:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.799 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34768 2024-04-26T10:21:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756671+0000", 2024-04-26T10:21:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756671+0000", 2024-04-26T10:21:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756670+0000", 2024-04-26T10:21:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756707+0000", 2024-04-26T10:21:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7305999999999998e-05 2024-04-26T10:21:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756715+0000", 2024-04-26T10:21:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2189999999999998e-06 2024-04-26T10:21:47.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756721+0000", 2024-04-26T10:21:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0499999999999997e-06 2024-04-26T10:21:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756769+0000", 2024-04-26T10:21:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7895000000000001e-05 2024-04-26T10:21:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.756877+0000", 2024-04-26T10:21:47.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108031 2024-04-26T10:21:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34769 5.2 5:475a9210:::benchmark_data_smithi052_19421_object34768:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.758221+0000", 2024-04-26T10:21:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.005179477, 2024-04-26T10:21:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055403129999999998, 2024-04-26T10:21:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:47.803 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34769 2024-04-26T10:21:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758221+0000", 2024-04-26T10:21:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758221+0000", 2024-04-26T10:21:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758220+0000", 2024-04-26T10:21:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758267+0000", 2024-04-26T10:21:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6851000000000003e-05 2024-04-26T10:21:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758284+0000", 2024-04-26T10:21:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7178999999999999e-05 2024-04-26T10:21:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758293+0000", 2024-04-26T10:21:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6540000000000005e-06 2024-04-26T10:21:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758346+0000", 2024-04-26T10:21:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3059999999999997e-05 2024-04-26T10:21:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758414+0000", 2024-04-26T10:21:47.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8541000000000007e-05 2024-04-26T10:21:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34770 5.2 5:4a0a3564:::benchmark_data_smithi052_19421_object34769:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.758450+0000", 2024-04-26T10:21:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0049503730000000001, 2024-04-26T10:21:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053510559999999999, 2024-04-26T10:21:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:47.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34770 2024-04-26T10:21:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758450+0000", 2024-04-26T10:21:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758450+0000", 2024-04-26T10:21:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758449+0000", 2024-04-26T10:21:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758524+0000", 2024-04-26T10:21:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4717999999999999e-05 2024-04-26T10:21:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758530+0000", 2024-04-26T10:21:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4500000000000001e-06 2024-04-26T10:21:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.758535+0000", 2024-04-26T10:21:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2729999999999996e-06 2024-04-26T10:21:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.759597+0000", 2024-04-26T10:21:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010622439999999999 2024-04-26T10:21:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.759710+0000", 2024-04-26T10:21:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011351 2024-04-26T10:21:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.810 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:47.811 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.811 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:47.811 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:21:47.811 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 11 2024-04-26T10:21:47.811 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:47.812 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:47.858 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:47.857+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:47.923 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:47.920+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:47.941 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:47.941 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:21:47.941 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:21:47.941 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:21:47.941 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:47.955 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:48.113 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:48.109+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:48.213 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:48.208+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:48.251 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:48.252 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:21:48.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:21:48.252 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:48.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.252 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:48.252 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:48.252 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 46.009534917000003, 2024-04-26T10:21:48.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016304328, 2024-04-26T10:21:48.252 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.252 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.252 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.252 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:48.252 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:48.253 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113 2024-04-26T10:21:48.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.253 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:48.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:48.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238898+0000", 2024-04-26T10:21:48.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238920+0000", 2024-04-26T10:21:48.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2056999999999999e-05 2024-04-26T10:21:48.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238937+0000", 2024-04-26T10:21:48.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6415000000000001e-05 2024-04-26T10:21:48.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238948+0000", 2024-04-26T10:21:48.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.11e-05 2024-04-26T10:21:48.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250527+0000", 2024-04-26T10:21:48.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011578662 2024-04-26T10:21:48.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250627+0000", 2024-04-26T10:21:48.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100418 2024-04-26T10:21:48.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250769+0000", 2024-04-26T10:21:48.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142111 2024-04-26T10:21:48.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253884+0000", 2024-04-26T10:21:48.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031148399999999998 2024-04-26T10:21:48.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254994+0000", 2024-04-26T10:21:48.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011095720000000001 2024-04-26T10:21:48.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255094+0000", 2024-04-26T10:21:48.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010092 2024-04-26T10:21:48.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255203+0000", 2024-04-26T10:21:48.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010906 2024-04-26T10:21:48.258 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.258 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.258 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.258 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:48.258 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:48.258 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 46.009477382, 2024-04-26T10:21:48.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016378984999999999, 2024-04-26T10:21:48.258 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.258 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.259 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.259 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:48.259 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:48.259 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 114 2024-04-26T10:21:48.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.259 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:48.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:48.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238956+0000", 2024-04-26T10:21:48.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238965+0000", 2024-04-26T10:21:48.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9469999999999992e-06 2024-04-26T10:21:48.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238993+0000", 2024-04-26T10:21:48.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8296000000000001e-05 2024-04-26T10:21:48.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239004+0000", 2024-04-26T10:21:48.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0482999999999999e-05 2024-04-26T10:21:48.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251532+0000", 2024-04-26T10:21:48.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01252852 2024-04-26T10:21:48.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251622+0000", 2024-04-26T10:21:48.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0044999999999996e-05 2024-04-26T10:21:48.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251763+0000", 2024-04-26T10:21:48.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140634 2024-04-26T10:21:48.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254035+0000", 2024-04-26T10:21:48.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022721320000000001 2024-04-26T10:21:48.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255220+0000", 2024-04-26T10:21:48.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011853059999999999 2024-04-26T10:21:48.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255301+0000", 2024-04-26T10:21:48.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0253999999999994e-05 2024-04-26T10:21:48.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255336+0000", 2024-04-26T10:21:48.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5098000000000002e-05 2024-04-26T10:21:48.263 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.264 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.264 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.264 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:48.264 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:48.264 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 46.009415433000001, 2024-04-26T10:21:48.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018452342, 2024-04-26T10:21:48.264 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.264 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.264 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.264 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:48.264 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:48.264 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115 2024-04-26T10:21:48.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.265 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:48.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:48.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239018+0000", 2024-04-26T10:21:48.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239152+0000", 2024-04-26T10:21:48.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414699999999999 2024-04-26T10:21:48.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239169+0000", 2024-04-26T10:21:48.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7013000000000001e-05 2024-04-26T10:21:48.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239190+0000", 2024-04-26T10:21:48.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1302999999999999e-05 2024-04-26T10:21:48.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252181+0000", 2024-04-26T10:21:48.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012990213 2024-04-26T10:21:48.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252411+0000", 2024-04-26T10:21:48.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023010199999999999 2024-04-26T10:21:48.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252687+0000", 2024-04-26T10:21:48.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000276063 2024-04-26T10:21:48.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254694+0000", 2024-04-26T10:21:48.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020072879999999999 2024-04-26T10:21:48.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257399+0000", 2024-04-26T10:21:48.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027051670000000001 2024-04-26T10:21:48.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257442+0000", 2024-04-26T10:21:48.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-04-26T10:21:48.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257471+0000", 2024-04-26T10:21:48.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.889e-05 2024-04-26T10:21:48.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.269 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.270 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:48.270 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:48.270 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 46.009234904000003, 2024-04-26T10:21:48.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018350615000000001, 2024-04-26T10:21:48.270 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.270 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:48.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:48.270 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116 2024-04-26T10:21:48.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.270 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:48.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:48.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239198+0000", 2024-04-26T10:21:48.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239213+0000", 2024-04-26T10:21:48.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4965e-05 2024-04-26T10:21:48.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239235+0000", 2024-04-26T10:21:48.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.156e-05 2024-04-26T10:21:48.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239243+0000", 2024-04-26T10:21:48.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9470000000000003e-06 2024-04-26T10:21:48.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253284+0000", 2024-04-26T10:21:48.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014041392999999999 2024-04-26T10:21:48.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253376+0000", 2024-04-26T10:21:48.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1198000000000003e-05 2024-04-26T10:21:48.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253508+0000", 2024-04-26T10:21:48.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013220199999999999 2024-04-26T10:21:48.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255474+0000", 2024-04-26T10:21:48.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019665590000000001 2024-04-26T10:21:48.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257480+0000", 2024-04-26T10:21:48.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00200599 2024-04-26T10:21:48.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257515+0000", 2024-04-26T10:21:48.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5126000000000002e-05 2024-04-26T10:21:48.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257550+0000", 2024-04-26T10:21:48.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4394000000000003e-05 2024-04-26T10:21:48.275 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.275 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.275 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.276 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:48.276 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:48.276 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 46.009181347999998, 2024-04-26T10:21:48.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018369330999999999, 2024-04-26T10:21:48.276 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.276 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:48.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:48.276 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117 2024-04-26T10:21:48.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.276 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:48.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:48.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239252+0000", 2024-04-26T10:21:48.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:48.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239267+0000", 2024-04-26T10:21:48.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4562999999999999e-05 2024-04-26T10:21:48.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239281+0000", 2024-04-26T10:21:48.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4e-05 2024-04-26T10:21:48.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239296+0000", 2024-04-26T10:21:48.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5492999999999999e-05 2024-04-26T10:21:48.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254076+0000", 2024-04-26T10:21:48.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014779814 2024-04-26T10:21:48.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254159+0000", 2024-04-26T10:21:48.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2923999999999994e-05 2024-04-26T10:21:48.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254279+0000", 2024-04-26T10:21:48.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011964300000000001 2024-04-26T10:21:48.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.256043+0000", 2024-04-26T10:21:48.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001764353 2024-04-26T10:21:48.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257559+0000", 2024-04-26T10:21:48.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015159189999999999 2024-04-26T10:21:48.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257597+0000", 2024-04-26T10:21:48.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8031999999999998e-05 2024-04-26T10:21:48.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257622+0000", 2024-04-26T10:21:48.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5213999999999999e-05 2024-04-26T10:21:48.281 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.281 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.281 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.281 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:48.282 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:48.282 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.797076971999999, 2024-04-26T10:21:48.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015980181999999999, 2024-04-26T10:21:48.282 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.282 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:48.282 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:48.282 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 141 2024-04-26T10:21:48.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.282 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:48.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:48.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451356+0000", 2024-04-26T10:21:48.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451362+0000", 2024-04-26T10:21:48.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:21:48.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451371+0000", 2024-04-26T10:21:48.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1829999999999994e-06 2024-04-26T10:21:48.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451377+0000", 2024-04-26T10:21:48.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7599999999999997e-06 2024-04-26T10:21:48.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463727+0000", 2024-04-26T10:21:48.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012349646000000001 2024-04-26T10:21:48.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463780+0000", 2024-04-26T10:21:48.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2645999999999997e-05 2024-04-26T10:21:48.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463874+0000", 2024-04-26T10:21:48.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4097000000000004e-05 2024-04-26T10:21:48.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.466138+0000", 2024-04-26T10:21:48.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022642690000000002 2024-04-26T10:21:48.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467281+0000", 2024-04-26T10:21:48.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011428510000000001 2024-04-26T10:21:48.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467315+0000", 2024-04-26T10:21:48.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4032999999999998e-05 2024-04-26T10:21:48.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467337+0000", 2024-04-26T10:21:48.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2444000000000001e-05 2024-04-26T10:21:48.287 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.287 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.287 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.287 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:163 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:48.287 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:48.288 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.598628400999999, 2024-04-26T10:21:48.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015587541, 2024-04-26T10:21:48.288 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.288 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.288 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.288 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:48.288 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:48.288 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 163 2024-04-26T10:21:48.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.288 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:48.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649806+0000", 2024-04-26T10:21:48.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649805+0000", 2024-04-26T10:21:48.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649813+0000", 2024-04-26T10:21:48.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3319999999999992e-06 2024-04-26T10:21:48.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649851+0000", 2024-04-26T10:21:48.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7852999999999998e-05 2024-04-26T10:21:48.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649865+0000", 2024-04-26T10:21:48.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3626e-05 2024-04-26T10:21:48.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662071+0000", 2024-04-26T10:21:48.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01220689 2024-04-26T10:21:48.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662210+0000", 2024-04-26T10:21:48.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013893 2024-04-26T10:21:48.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662397+0000", 2024-04-26T10:21:48.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018690499999999999 2024-04-26T10:21:48.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664685+0000", 2024-04-26T10:21:48.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022876179999999999 2024-04-26T10:21:48.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665327+0000", 2024-04-26T10:21:48.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00064178900000000003 2024-04-26T10:21:48.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665365+0000", 2024-04-26T10:21:48.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8244999999999997e-05 2024-04-26T10:21:48.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665393+0000", 2024-04-26T10:21:48.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8232e-05 2024-04-26T10:21:48.293 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.293 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.293 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.293 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:48.293 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:48.293 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.598553754999998, 2024-04-26T10:21:48.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016970263999999999, 2024-04-26T10:21:48.293 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.294 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.294 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.294 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:48.294 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:48.294 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 164 2024-04-26T10:21:48.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.294 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:48.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:48.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649879+0000", 2024-04-26T10:21:48.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649963+0000", 2024-04-26T10:21:48.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4141999999999995e-05 2024-04-26T10:21:48.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649975+0000", 2024-04-26T10:21:48.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1416e-05 2024-04-26T10:21:48.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649983+0000", 2024-04-26T10:21:48.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8469999999999996e-06 2024-04-26T10:21:48.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662854+0000", 2024-04-26T10:21:48.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012871871999999999 2024-04-26T10:21:48.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662965+0000", 2024-04-26T10:21:48.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110413 2024-04-26T10:21:48.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.663109+0000", 2024-04-26T10:21:48.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144115 2024-04-26T10:21:48.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665992+0000", 2024-04-26T10:21:48.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028827340000000001 2024-04-26T10:21:48.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666784+0000", 2024-04-26T10:21:48.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00079253799999999997 2024-04-26T10:21:48.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666824+0000", 2024-04-26T10:21:48.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0139000000000003e-05 2024-04-26T10:21:48.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666851+0000", 2024-04-26T10:21:48.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6171999999999999e-05 2024-04-26T10:21:48.299 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.299 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.299 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.299 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:48.299 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:48.299 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.598442675000001, 2024-04-26T10:21:48.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019547338000000001, 2024-04-26T10:21:48.299 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.299 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.299 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:48.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:48.300 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165 2024-04-26T10:21:48.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.300 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:48.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:48.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:48.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649996+0000", 2024-04-26T10:21:48.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-04-26T10:21:48.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650021+0000", 2024-04-26T10:21:48.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5179999999999999e-05 2024-04-26T10:21:48.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650030+0000", 2024-04-26T10:21:48.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-04-26T10:21:48.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664733+0000", 2024-04-26T10:21:48.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014703097 2024-04-26T10:21:48.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664821+0000", 2024-04-26T10:21:48.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7918999999999996e-05 2024-04-26T10:21:48.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664953+0000", 2024-04-26T10:21:48.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132662 2024-04-26T10:21:48.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666776+0000", 2024-04-26T10:21:48.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018225509999999999 2024-04-26T10:21:48.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669480+0000", 2024-04-26T10:21:48.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00270382 2024-04-26T10:21:48.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669515+0000", 2024-04-26T10:21:48.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4885000000000002e-05 2024-04-26T10:21:48.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669539+0000", 2024-04-26T10:21:48.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4121000000000002e-05 2024-04-26T10:21:48.305 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.305 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.305 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.305 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:48.305 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:48.305 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.408919566000002, 2024-04-26T10:21:48.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017833541000000001, 2024-04-26T10:21:48.305 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.305 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:48.306 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:48.306 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185 2024-04-26T10:21:48.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.306 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:48.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:48.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839514+0000", 2024-04-26T10:21:48.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:48.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839612+0000", 2024-04-26T10:21:48.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7880999999999993e-05 2024-04-26T10:21:48.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839623+0000", 2024-04-26T10:21:48.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0917000000000001e-05 2024-04-26T10:21:48.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839632+0000", 2024-04-26T10:21:48.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0999999999999993e-06 2024-04-26T10:21:48.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850382+0000", 2024-04-26T10:21:48.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010750335 2024-04-26T10:21:48.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850502+0000", 2024-04-26T10:21:48.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120183 2024-04-26T10:21:48.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850685+0000", 2024-04-26T10:21:48.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000182442 2024-04-26T10:21:48.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854396+0000", 2024-04-26T10:21:48.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037114819999999999 2024-04-26T10:21:48.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857233+0000", 2024-04-26T10:21:48.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002836514 2024-04-26T10:21:48.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857300+0000", 2024-04-26T10:21:48.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6842999999999997e-05 2024-04-26T10:21:48.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857348+0000", 2024-04-26T10:21:48.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8504000000000002e-05 2024-04-26T10:21:48.311 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.311 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.311 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.311 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:48.311 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:48.311 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.408793215000003, 2024-04-26T10:21:48.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018757273000000001, 2024-04-26T10:21:48.311 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.311 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.311 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.311 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:48.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:48.312 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 186 2024-04-26T10:21:48.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.312 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:48.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:48.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839640+0000", 2024-04-26T10:21:48.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839646+0000", 2024-04-26T10:21:48.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:21:48.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839654+0000", 2024-04-26T10:21:48.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:21:48.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839661+0000", 2024-04-26T10:21:48.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.64e-06 2024-04-26T10:21:48.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852328+0000", 2024-04-26T10:21:48.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012667151 2024-04-26T10:21:48.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852538+0000", 2024-04-26T10:21:48.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020961100000000001 2024-04-26T10:21:48.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852945+0000", 2024-04-26T10:21:48.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040712099999999998 2024-04-26T10:21:48.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857372+0000", 2024-04-26T10:21:48.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044268049999999998 2024-04-26T10:21:48.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858321+0000", 2024-04-26T10:21:48.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094932999999999997 2024-04-26T10:21:48.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858367+0000", 2024-04-26T10:21:48.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5534000000000001e-05 2024-04-26T10:21:48.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858398+0000", 2024-04-26T10:21:48.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1562e-05 2024-04-26T10:21:48.316 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.317 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.317 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.317 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:48.317 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:48.317 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.408766049, 2024-04-26T10:21:48.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019669504000000001, 2024-04-26T10:21:48.317 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.317 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.317 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.317 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:48.317 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:48.317 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187 2024-04-26T10:21:48.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.318 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:48.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:48.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839667+0000", 2024-04-26T10:21:48.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:48.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839677+0000", 2024-04-26T10:21:48.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3270000000000007e-06 2024-04-26T10:21:48.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839685+0000", 2024-04-26T10:21:48.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2670000000000006e-06 2024-04-26T10:21:48.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839692+0000", 2024-04-26T10:21:48.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7129999999999999e-06 2024-04-26T10:21:48.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853685+0000", 2024-04-26T10:21:48.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013993716999999999 2024-04-26T10:21:48.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853876+0000", 2024-04-26T10:21:48.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019097100000000001 2024-04-26T10:21:48.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853989+0000", 2024-04-26T10:21:48.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011275199999999999 2024-04-26T10:21:48.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857377+0000", 2024-04-26T10:21:48.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033882489999999999 2024-04-26T10:21:48.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859222+0000", 2024-04-26T10:21:48.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001844233 2024-04-26T10:21:48.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859291+0000", 2024-04-26T10:21:48.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:21:48.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859338+0000", 2024-04-26T10:21:48.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6366000000000003e-05 2024-04-26T10:21:48.322 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.322 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.322 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.323 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:48.323 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:48.323 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.408735182999997, 2024-04-26T10:21:48.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019837468, 2024-04-26T10:21:48.323 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.323 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.323 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.323 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:48.323 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:48.323 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 188 2024-04-26T10:21:48.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.323 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:48.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:48.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839698+0000", 2024-04-26T10:21:48.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:48.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839829+0000", 2024-04-26T10:21:48.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013061099999999999 2024-04-26T10:21:48.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839853+0000", 2024-04-26T10:21:48.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3736000000000001e-05 2024-04-26T10:21:48.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839863+0000", 2024-04-26T10:21:48.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:48.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854869+0000", 2024-04-26T10:21:48.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015005978 2024-04-26T10:21:48.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854959+0000", 2024-04-26T10:21:48.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9468999999999993e-05 2024-04-26T10:21:48.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855114+0000", 2024-04-26T10:21:48.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015563799999999999 2024-04-26T10:21:48.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857386+0000", 2024-04-26T10:21:48.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002271852 2024-04-26T10:21:48.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859406+0000", 2024-04-26T10:21:48.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002019936 2024-04-26T10:21:48.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859461+0000", 2024-04-26T10:21:48.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4826e-05 2024-04-26T10:21:48.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859536+0000", 2024-04-26T10:21:48.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5566000000000001e-05 2024-04-26T10:21:48.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.328 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.328 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.328 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:48.329 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:48.329 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.408561319999997, 2024-04-26T10:21:48.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019826496999999998, 2024-04-26T10:21:48.329 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.329 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.329 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.329 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:48.329 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:48.329 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 189 2024-04-26T10:21:48.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.329 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:48.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:48.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839872+0000", 2024-04-26T10:21:48.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839882+0000", 2024-04-26T10:21:48.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:48.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839892+0000", 2024-04-26T10:21:48.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.217e-06 2024-04-26T10:21:48.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839900+0000", 2024-04-26T10:21:48.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5469999999999997e-06 2024-04-26T10:21:48.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855903+0000", 2024-04-26T10:21:48.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016002590000000001 2024-04-26T10:21:48.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856110+0000", 2024-04-26T10:21:48.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020711199999999999 2024-04-26T10:21:48.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856421+0000", 2024-04-26T10:21:48.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031128500000000001 2024-04-26T10:21:48.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857643+0000", 2024-04-26T10:21:48.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012215520000000001 2024-04-26T10:21:48.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859603+0000", 2024-04-26T10:21:48.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019600350000000002 2024-04-26T10:21:48.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859660+0000", 2024-04-26T10:21:48.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6857999999999997e-05 2024-04-26T10:21:48.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859699+0000", 2024-04-26T10:21:48.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9641999999999998e-05 2024-04-26T10:21:48.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.334 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.334 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15562 5.f 5:f08fe41e:::benchmark_data_smithi052_19421_object15561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:48.334 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:48.335 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.2555456899999999, 2024-04-26T10:21:48.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015831088, 2024-04-26T10:21:48.335 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.335 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:48.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.335 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15562 2024-04-26T10:21:48.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.335 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:48.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:48.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:48.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992927+0000", 2024-04-26T10:21:48.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9285000000000001e-05 2024-04-26T10:21:48.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992940+0000", 2024-04-26T10:21:48.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3040999999999999e-05 2024-04-26T10:21:48.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992948+0000", 2024-04-26T10:21:48.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5850000000000002e-06 2024-04-26T10:21:48.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.997631+0000", 2024-04-26T10:21:48.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046834160000000001 2024-04-26T10:21:48.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.997851+0000", 2024-04-26T10:21:48.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000220416 2024-04-26T10:21:48.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.998105+0000", 2024-04-26T10:21:48.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025348599999999998 2024-04-26T10:21:48.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.004264+0000", 2024-04-26T10:21:48.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061588499999999996 2024-04-26T10:21:48.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008560+0000", 2024-04-26T10:21:48.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042958579999999996 2024-04-26T10:21:48.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008647+0000", 2024-04-26T10:21:48.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7609999999999996e-05 2024-04-26T10:21:48.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008719+0000", 2024-04-26T10:21:48.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2336000000000007e-05 2024-04-26T10:21:48.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.340 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.340 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15563 5.f 5:f98d3bb0:::benchmark_data_smithi052_19421_object15562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:48.340 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.993442+0000", 2024-04-26T10:21:48.340 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.2549916979999995, 2024-04-26T10:21:48.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015592195999999999, 2024-04-26T10:21:48.341 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.341 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:48.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.341 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15563 2024-04-26T10:21:48.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.341 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993442+0000", 2024-04-26T10:21:48.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993442+0000", 2024-04-26T10:21:48.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993441+0000", 2024-04-26T10:21:48.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993494+0000", 2024-04-26T10:21:48.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2369e-05 2024-04-26T10:21:48.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993515+0000", 2024-04-26T10:21:48.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1274e-05 2024-04-26T10:21:48.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.993528+0000", 2024-04-26T10:21:48.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2858e-05 2024-04-26T10:21:48.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.000547+0000", 2024-04-26T10:21:48.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070196010000000003 2024-04-26T10:21:48.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.000660+0000", 2024-04-26T10:21:48.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112273 2024-04-26T10:21:48.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.000757+0000", 2024-04-26T10:21:48.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6965000000000004e-05 2024-04-26T10:21:48.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.006425+0000", 2024-04-26T10:21:48.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056687639999999997 2024-04-26T10:21:48.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008907+0000", 2024-04-26T10:21:48.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024819289999999999 2024-04-26T10:21:48.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008993+0000", 2024-04-26T10:21:48.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5426999999999994e-05 2024-04-26T10:21:48.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.009035+0000", 2024-04-26T10:21:48.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1912000000000001e-05 2024-04-26T10:21:48.346 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.346 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.346 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.346 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15564 5.f 5:f61b0088:::benchmark_data_smithi052_19421_object15563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:48.346 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:48.346 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.2540436689999996, 2024-04-26T10:21:48.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017729826000000001, 2024-04-26T10:21:48.346 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.346 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.347 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.347 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:48.347 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.347 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15564 2024-04-26T10:21:48.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.347 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:48.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:48.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994389+0000", 2024-04-26T10:21:48.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994451+0000", 2024-04-26T10:21:48.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2032999999999994e-05 2024-04-26T10:21:48.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994477+0000", 2024-04-26T10:21:48.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5267999999999999e-05 2024-04-26T10:21:48.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994486+0000", 2024-04-26T10:21:48.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9420000000000001e-06 2024-04-26T10:21:48.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001578+0000", 2024-04-26T10:21:48.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070928110000000001 2024-04-26T10:21:48.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001748+0000", 2024-04-26T10:21:48.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016944099999999999 2024-04-26T10:21:48.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001914+0000", 2024-04-26T10:21:48.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000166546 2024-04-26T10:21:48.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.006488+0000", 2024-04-26T10:21:48.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045735460000000004 2024-04-26T10:21:48.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012034+0000", 2024-04-26T10:21:48.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055461449999999997 2024-04-26T10:21:48.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012085+0000", 2024-04-26T10:21:48.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1319000000000001e-05 2024-04-26T10:21:48.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012120+0000", 2024-04-26T10:21:48.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4904999999999999e-05 2024-04-26T10:21:48.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.352 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.352 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15567 5.f 5:f5b92a5d:::benchmark_data_smithi052_19421_object15566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:48.352 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.996077+0000", 2024-04-26T10:21:48.352 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.2523572309999995, 2024-04-26T10:21:48.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016208895000000001, 2024-04-26T10:21:48.352 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.352 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.352 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.352 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:48.353 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.353 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15567 2024-04-26T10:21:48.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.353 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996077+0000", 2024-04-26T10:21:48.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996077+0000", 2024-04-26T10:21:48.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996076+0000", 2024-04-26T10:21:48.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:48.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996139+0000", 2024-04-26T10:21:48.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2929999999999995e-05 2024-04-26T10:21:48.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996155+0000", 2024-04-26T10:21:48.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6076e-05 2024-04-26T10:21:48.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996163+0000", 2024-04-26T10:21:48.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0320000000000003e-06 2024-04-26T10:21:48.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.002727+0000", 2024-04-26T10:21:48.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065644240000000001 2024-04-26T10:21:48.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.002901+0000", 2024-04-26T10:21:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017414899999999999 2024-04-26T10:21:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.003080+0000", 2024-04-26T10:21:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017905199999999999 2024-04-26T10:21:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.009066+0000", 2024-04-26T10:21:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059855309999999997 2024-04-26T10:21:48.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012182+0000", 2024-04-26T10:21:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003116462 2024-04-26T10:21:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012230+0000", 2024-04-26T10:21:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7681e-05 2024-04-26T10:21:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012286+0000", 2024-04-26T10:21:48.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5763999999999997e-05 2024-04-26T10:21:48.358 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.358 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.358 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.358 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:27841 5.9 5:9893f413:::benchmark_data_smithi052_19421_object27840:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-26T10:21:48.358 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:43.752430+0000", 2024-04-26T10:21:48.358 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.4960042119999999, 2024-04-26T10:21:48.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015615922000000001, 2024-04-26T10:21:48.358 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.358 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.358 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:48.359 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.359 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 27841 2024-04-26T10:21:48.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.359 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752430+0000", 2024-04-26T10:21:48.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752430+0000", 2024-04-26T10:21:48.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752429+0000", 2024-04-26T10:21:48.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:48.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752477+0000", 2024-04-26T10:21:48.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7899000000000003e-05 2024-04-26T10:21:48.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752495+0000", 2024-04-26T10:21:48.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8844000000000001e-05 2024-04-26T10:21:48.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752504+0000", 2024-04-26T10:21:48.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3010000000000007e-06 2024-04-26T10:21:48.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752538+0000", 2024-04-26T10:21:48.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4134000000000002e-05 2024-04-26T10:21:48.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752635+0000", 2024-04-26T10:21:48.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7461999999999996e-05 2024-04-26T10:21:48.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:48.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.752710+0000", 2024-04-26T10:21:48.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4355000000000002e-05 2024-04-26T10:21:48.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.755511+0000", 2024-04-26T10:21:48.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028017979999999999 2024-04-26T10:21:48.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.767966+0000", 2024-04-26T10:21:48.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012454902 2024-04-26T10:21:48.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.768015+0000", 2024-04-26T10:21:48.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8523999999999998e-05 2024-04-26T10:21:48.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:43.768046+0000", 2024-04-26T10:21:48.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0956e-05 2024-04-26T10:21:48.363 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.364 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.364 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.364 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34427 5.7 5:ef7d83e6:::benchmark_data_smithi052_19421_object34426:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:48.364 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:21:48.364 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.61635566100000005, 2024-04-26T10:21:48.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02010443, 2024-04-26T10:21:48.364 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:48.364 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:48.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:48.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.364 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34427 2024-04-26T10:21:48.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.365 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:48.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:48.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:21:48.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:48.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:21:48.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:48.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:48.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632077+0000", 2024-04-26T10:21:48.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:48.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:48.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632139+0000", 2024-04-26T10:21:48.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2527999999999995e-05 2024-04-26T10:21:48.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:48.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632153+0000", 2024-04-26T10:21:48.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3608000000000001e-05 2024-04-26T10:21:48.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632165+0000", 2024-04-26T10:21:48.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2592000000000001e-05 2024-04-26T10:21:48.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635907+0000", 2024-04-26T10:21:48.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037419789999999999 2024-04-26T10:21:48.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:21:48.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635919+0000", 2024-04-26T10:21:48.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1511999999999999e-05 2024-04-26T10:21:48.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:48.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641616+0000", 2024-04-26T10:21:48.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056974770000000003 2024-04-26T10:21:48.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:48.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641772+0000", 2024-04-26T10:21:48.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155799 2024-04-26T10:21:48.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:48.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.651965+0000", 2024-04-26T10:21:48.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010193254000000001 2024-04-26T10:21:48.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:48.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652039+0000", 2024-04-26T10:21:48.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4031999999999999e-05 2024-04-26T10:21:48.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:48.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:48.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:48.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652183+0000", 2024-04-26T10:21:48.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014342599999999999 2024-04-26T10:21:48.369 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.369 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.369 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.369 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:48.370 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:48.370 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:48.371 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:48.372 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:48.369+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:48.472 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:48.469+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:48.506 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:48.507 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:48.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.507 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:36831 5.8 5:1bffaecd:::benchmark_data_smithi052_19421_object36830:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:48.507 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.502065+0000", 2024-04-26T10:21:48.507 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.003841494, 2024-04-26T10:21:48.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038711639999999999, 2024-04-26T10:21:48.507 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.507 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:48.507 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:48.507 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:48.507 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.508 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 36831 2024-04-26T10:21:48.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.508 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.502065+0000", 2024-04-26T10:21:48.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.502065+0000", 2024-04-26T10:21:48.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.502064+0000", 2024-04-26T10:21:48.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:48.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.502124+0000", 2024-04-26T10:21:48.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9825999999999999e-05 2024-04-26T10:21:48.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.502134+0000", 2024-04-26T10:21:48.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6120000000000005e-06 2024-04-26T10:21:48.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.502143+0000", 2024-04-26T10:21:48.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9180000000000006e-06 2024-04-26T10:21:48.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.503785+0000", 2024-04-26T10:21:48.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001641476 2024-04-26T10:21:48.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.503899+0000", 2024-04-26T10:21:48.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000113746 2024-04-26T10:21:48.511 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.511 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.511 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.511 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:36833 5.4 5:22139285:::benchmark_data_smithi052_19421_object36832:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:48.511 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.503426+0000", 2024-04-26T10:21:48.511 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0024809490000000001, 2024-04-26T10:21:48.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002646505, 2024-04-26T10:21:48.511 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.511 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:48.512 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:48.512 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:48.512 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.512 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 36833 2024-04-26T10:21:48.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.512 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.503426+0000", 2024-04-26T10:21:48.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.503426+0000", 2024-04-26T10:21:48.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.503425+0000", 2024-04-26T10:21:48.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.503515+0000", 2024-04-26T10:21:48.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9485000000000001e-05 2024-04-26T10:21:48.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.503525+0000", 2024-04-26T10:21:48.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0797e-05 2024-04-26T10:21:48.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.503533+0000", 2024-04-26T10:21:48.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3939999999999998e-06 2024-04-26T10:21:48.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.503591+0000", 2024-04-26T10:21:48.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8666999999999999e-05 2024-04-26T10:21:48.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.503739+0000", 2024-04-26T10:21:48.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014741600000000001 2024-04-26T10:21:48.515 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.515 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.515 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.515 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:36837 5.0 5:0936c4b2:::benchmark_data_smithi052_19421_object36836:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:48.515 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.504033+0000", 2024-04-26T10:21:48.515 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0018739939999999999, 2024-04-26T10:21:48.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002111028, 2024-04-26T10:21:48.516 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.516 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:48.516 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:48.516 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:48.516 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.516 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 36837 2024-04-26T10:21:48.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.516 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504033+0000", 2024-04-26T10:21:48.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504033+0000", 2024-04-26T10:21:48.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504032+0000", 2024-04-26T10:21:48.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504108+0000", 2024-04-26T10:21:48.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5951000000000005e-05 2024-04-26T10:21:48.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504122+0000", 2024-04-26T10:21:48.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3869999999999999e-05 2024-04-26T10:21:48.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504129+0000", 2024-04-26T10:21:48.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4340000000000003e-06 2024-04-26T10:21:48.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504165+0000", 2024-04-26T10:21:48.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6183999999999998e-05 2024-04-26T10:21:48.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504343+0000", 2024-04-26T10:21:48.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000177651 2024-04-26T10:21:48.519 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.519 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.519 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.520 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:36838 5.a 5:5e3844b8:::benchmark_data_smithi052_19421_object36837:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:48.520 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.504237+0000", 2024-04-26T10:21:48.520 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0016699110000000001, 2024-04-26T10:21:48.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0019677570000000001, 2024-04-26T10:21:48.520 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.520 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:48.520 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:48.520 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:48.520 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.520 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 36838 2024-04-26T10:21:48.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.520 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504237+0000", 2024-04-26T10:21:48.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504237+0000", 2024-04-26T10:21:48.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504236+0000", 2024-04-26T10:21:48.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:48.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504315+0000", 2024-04-26T10:21:48.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8724e-05 2024-04-26T10:21:48.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504331+0000", 2024-04-26T10:21:48.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5617999999999999e-05 2024-04-26T10:21:48.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504337+0000", 2024-04-26T10:21:48.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5060000000000001e-06 2024-04-26T10:21:48.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504410+0000", 2024-04-26T10:21:48.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2482000000000002e-05 2024-04-26T10:21:48.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504531+0000", 2024-04-26T10:21:48.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120874 2024-04-26T10:21:48.523 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.523 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.523 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.524 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:36840 5.4 5:2c4612bf:::benchmark_data_smithi052_19421_object36839:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:48.524 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.504423+0000", 2024-04-26T10:21:48.524 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0014836719999999999, 2024-04-26T10:21:48.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0018515700000000001, 2024-04-26T10:21:48.524 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.524 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:48.524 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:48.524 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:48.524 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.524 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 36840 2024-04-26T10:21:48.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.524 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504423+0000", 2024-04-26T10:21:48.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504423+0000", 2024-04-26T10:21:48.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504423+0000", 2024-04-26T10:21:48.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:48.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504513+0000", 2024-04-26T10:21:48.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0441999999999999e-05 2024-04-26T10:21:48.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504521+0000", 2024-04-26T10:21:48.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9340000000000006e-06 2024-04-26T10:21:48.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504527+0000", 2024-04-26T10:21:48.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2079999999999997e-06 2024-04-26T10:21:48.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.505170+0000", 2024-04-26T10:21:48.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00064281199999999998 2024-04-26T10:21:48.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.505337+0000", 2024-04-26T10:21:48.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016666599999999999 2024-04-26T10:21:48.527 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.527 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.527 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.528 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:36839 5.9 e30/22 5:90c3d767:::benchmark_data_smithi052_19421_object36838:head v 30'2298, mlcod=30'2295)", 2024-04-26T10:21:48.528 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.504822+0000", 2024-04-26T10:21:48.528 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.001084953, 2024-04-26T10:21:48.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00149577, 2024-04-26T10:21:48.528 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.528 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:48.528 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504822+0000", 2024-04-26T10:21:48.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504822+0000", 2024-04-26T10:21:48.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504821+0000", 2024-04-26T10:21:48.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504882+0000", 2024-04-26T10:21:48.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0435e-05 2024-04-26T10:21:48.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504892+0000", 2024-04-26T10:21:48.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9280000000000005e-06 2024-04-26T10:21:48.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504898+0000", 2024-04-26T10:21:48.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9880000000000001e-06 2024-04-26T10:21:48.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504931+0000", 2024-04-26T10:21:48.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3782999999999998e-05 2024-04-26T10:21:48.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.504965+0000", 2024-04-26T10:21:48.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3844000000000003e-05 2024-04-26T10:21:48.531 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.531 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.531 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.531 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:36842 5.0 5:0fb19c5d:::benchmark_data_smithi052_19421_object36841:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:48.532 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.505333+0000", 2024-04-26T10:21:48.532 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00057386299999999998, 2024-04-26T10:21:48.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010426579999999999, 2024-04-26T10:21:48.532 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.532 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:48.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:48.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:48.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.532 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 36842 2024-04-26T10:21:48.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.532 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.505333+0000", 2024-04-26T10:21:48.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.505333+0000", 2024-04-26T10:21:48.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.505332+0000", 2024-04-26T10:21:48.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.505412+0000", 2024-04-26T10:21:48.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0301000000000002e-05 2024-04-26T10:21:48.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.505422+0000", 2024-04-26T10:21:48.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8409999999999995e-06 2024-04-26T10:21:48.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.505429+0000", 2024-04-26T10:21:48.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8560000000000001e-06 2024-04-26T10:21:48.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.505720+0000", 2024-04-26T10:21:48.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029069399999999998 2024-04-26T10:21:48.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.505868+0000", 2024-04-26T10:21:48.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014796899999999999 2024-04-26T10:21:48.535 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.535 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.535 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.535 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:36843 5.b 5:da06788b:::benchmark_data_smithi052_19421_object36842:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:48.536 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.505981+0000", 2024-04-26T10:21:48.536 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9999256, 2024-04-26T10:21:48.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00046463100000000002, 2024-04-26T10:21:48.536 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.536 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:48.536 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:48.536 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:48.536 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.536 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 36843 2024-04-26T10:21:48.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.536 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.505981+0000", 2024-04-26T10:21:48.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.505981+0000", 2024-04-26T10:21:48.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.505980+0000", 2024-04-26T10:21:48.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.506030+0000", 2024-04-26T10:21:48.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9959000000000001e-05 2024-04-26T10:21:48.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.506041+0000", 2024-04-26T10:21:48.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1116e-05 2024-04-26T10:21:48.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.506049+0000", 2024-04-26T10:21:48.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5209999999999997e-06 2024-04-26T10:21:48.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.506107+0000", 2024-04-26T10:21:48.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7948999999999997e-05 2024-04-26T10:21:48.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.506254+0000", 2024-04-26T10:21:48.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014729200000000001 2024-04-26T10:21:48.539 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.539 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.539 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.539 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.539 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:21:48.540 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 8 2024-04-26T10:21:48.540 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:48.541 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:48.573 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:48.568+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:48.614 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 15 15 37125 37110 154.608 168.875 0.00756578 0.00646142 2024-04-26T10:21:48.630 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:21:48.665 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:48.665 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:21:48.665 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:21:48.665 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:21:48.665 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:48.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-26T10:21:48.674 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:48.668+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:48.677 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:48.775 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:48.773+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:48.842 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:48.843 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:21:48.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:21:48.843 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:48.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.843 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:48.843 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:48.843 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.539611471000001, 2024-04-26T10:21:48.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018441564000000001, 2024-04-26T10:21:48.843 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.843 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.843 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:48.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:48.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301372+0000", 2024-04-26T10:21:48.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:48.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301399+0000", 2024-04-26T10:21:48.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7039999999999999e-05 2024-04-26T10:21:48.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301426+0000", 2024-04-26T10:21:48.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6381e-05 2024-04-26T10:21:48.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301480+0000", 2024-04-26T10:21:48.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3681000000000003e-05 2024-04-26T10:21:48.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310584+0000", 2024-04-26T10:21:48.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091042339999999992 2024-04-26T10:21:48.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:48.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310591+0000", 2024-04-26T10:21:48.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8190000000000003e-06 2024-04-26T10:21:48.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311503+0000", 2024-04-26T10:21:48.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000911983 2024-04-26T10:21:48.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311605+0000", 2024-04-26T10:21:48.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102619 2024-04-26T10:21:48.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:48.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311730+0000", 2024-04-26T10:21:48.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012474400000000001 2024-04-26T10:21:48.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:48.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317287+0000", 2024-04-26T10:21:48.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055571140000000002 2024-04-26T10:21:48.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319724+0000", 2024-04-26T10:21:48.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002437294 2024-04-26T10:21:48.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319776+0000", 2024-04-26T10:21:48.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1992e-05 2024-04-26T10:21:48.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319816+0000", 2024-04-26T10:21:48.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9709999999999998e-05 2024-04-26T10:21:48.849 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.849 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.849 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.849 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:48.849 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:48.849 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.534295604999997, 2024-04-26T10:21:48.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013786338, 2024-04-26T10:21:48.850 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.850 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.850 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:48.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:48.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306689+0000", 2024-04-26T10:21:48.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306697+0000", 2024-04-26T10:21:48.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2420000000000003e-06 2024-04-26T10:21:48.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306725+0000", 2024-04-26T10:21:48.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8209e-05 2024-04-26T10:21:48.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306750+0000", 2024-04-26T10:21:48.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5432e-05 2024-04-26T10:21:48.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310622+0000", 2024-04-26T10:21:48.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003871738 2024-04-26T10:21:48.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:21:48.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310627+0000", 2024-04-26T10:21:48.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4890000000000003e-06 2024-04-26T10:21:48.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314030+0000", 2024-04-26T10:21:48.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003402094 2024-04-26T10:21:48.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314147+0000", 2024-04-26T10:21:48.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011776499999999999 2024-04-26T10:21:48.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:48.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314441+0000", 2024-04-26T10:21:48.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000293543 2024-04-26T10:21:48.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:48.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319422+0000", 2024-04-26T10:21:48.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004981096 2024-04-26T10:21:48.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320057+0000", 2024-04-26T10:21:48.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000635521 2024-04-26T10:21:48.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320110+0000", 2024-04-26T10:21:48.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2104999999999997e-05 2024-04-26T10:21:48.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320477+0000", 2024-04-26T10:21:48.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036709500000000001 2024-04-26T10:21:48.855 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.855 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.855 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.855 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:48.855 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:48.855 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.534202243999999, 2024-04-26T10:21:48.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013859405999999999, 2024-04-26T10:21:48.856 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.856 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.856 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:48.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:48.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306783+0000", 2024-04-26T10:21:48.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:48.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306788+0000", 2024-04-26T10:21:48.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3990000000000003e-06 2024-04-26T10:21:48.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306796+0000", 2024-04-26T10:21:48.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8820000000000001e-06 2024-04-26T10:21:48.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306803+0000", 2024-04-26T10:21:48.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6649999999999997e-06 2024-04-26T10:21:48.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314454+0000", 2024-04-26T10:21:48.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076508349999999999 2024-04-26T10:21:48.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314930+0000", 2024-04-26T10:21:48.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047624199999999998 2024-04-26T10:21:48.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:48.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315127+0000", 2024-04-26T10:21:48.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196751 2024-04-26T10:21:48.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:48.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320496+0000", 2024-04-26T10:21:48.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053690150000000004 2024-04-26T10:21:48.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320576+0000", 2024-04-26T10:21:48.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0327999999999994e-05 2024-04-26T10:21:48.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.863 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320611+0000", 2024-04-26T10:21:48.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-04-26T10:21:48.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.863 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.863 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320643+0000", 2024-04-26T10:21:48.863 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2474000000000001e-05 2024-04-26T10:21:48.863 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.863 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.863 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.863 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:48.863 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:48.864 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.534123073000004, 2024-04-26T10:21:48.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013889195, 2024-04-26T10:21:48.864 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.864 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.864 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:48.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.864 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.864 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.864 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.864 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:48.864 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306862+0000", 2024-04-26T10:21:48.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:48.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306867+0000", 2024-04-26T10:21:48.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5390000000000001e-06 2024-04-26T10:21:48.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306874+0000", 2024-04-26T10:21:48.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7549999999999997e-06 2024-04-26T10:21:48.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306887+0000", 2024-04-26T10:21:48.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.313e-05 2024-04-26T10:21:48.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315477+0000", 2024-04-26T10:21:48.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085902489999999995 2024-04-26T10:21:48.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315607+0000", 2024-04-26T10:21:48.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129789 2024-04-26T10:21:48.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:48.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315767+0000", 2024-04-26T10:21:48.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016052699999999999 2024-04-26T10:21:48.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:48.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320502+0000", 2024-04-26T10:21:48.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00473421 2024-04-26T10:21:48.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320691+0000", 2024-04-26T10:21:48.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018938900000000001 2024-04-26T10:21:48.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320721+0000", 2024-04-26T10:21:48.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9677000000000001e-05 2024-04-26T10:21:48.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.868 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320752+0000", 2024-04-26T10:21:48.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1486000000000003e-05 2024-04-26T10:21:48.869 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.869 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.869 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.869 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:48.869 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:48.869 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.534085155, 2024-04-26T10:21:48.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012590871, 2024-04-26T10:21:48.869 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.869 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.869 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:48.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:48.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306900+0000", 2024-04-26T10:21:48.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:48.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306905+0000", 2024-04-26T10:21:48.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9010000000000002e-06 2024-04-26T10:21:48.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306911+0000", 2024-04-26T10:21:48.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6030000000000004e-06 2024-04-26T10:21:48.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306916+0000", 2024-04-26T10:21:48.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8539999999999996e-06 2024-04-26T10:21:48.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308529+0000", 2024-04-26T10:21:48.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001613258 2024-04-26T10:21:48.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:48.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308537+0000", 2024-04-26T10:21:48.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1680000000000004e-06 2024-04-26T10:21:48.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311962+0000", 2024-04-26T10:21:48.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034247290000000001 2024-04-26T10:21:48.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.312092+0000", 2024-04-26T10:21:48.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013048700000000001 2024-04-26T10:21:48.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:48.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.312438+0000", 2024-04-26T10:21:48.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00034558700000000001 2024-04-26T10:21:48.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:48.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317984+0000", 2024-04-26T10:21:48.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005546067 2024-04-26T10:21:48.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319373+0000", 2024-04-26T10:21:48.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001389426 2024-04-26T10:21:48.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319438+0000", 2024-04-26T10:21:48.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4849000000000002e-05 2024-04-26T10:21:48.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319492+0000", 2024-04-26T10:21:48.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3554000000000003e-05 2024-04-26T10:21:48.875 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.875 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.875 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.875 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:48.875 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:48.875 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.532414572, 2024-04-26T10:21:48.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011321652999999999, 2024-04-26T10:21:48.876 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.876 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.876 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:48.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:48.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:48.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308576+0000", 2024-04-26T10:21:48.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2920000000000003e-06 2024-04-26T10:21:48.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308582+0000", 2024-04-26T10:21:48.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6540000000000002e-06 2024-04-26T10:21:48.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308590+0000", 2024-04-26T10:21:48.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-04-26T10:21:48.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308958+0000", 2024-04-26T10:21:48.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036823500000000001 2024-04-26T10:21:48.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:21:48.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308963+0000", 2024-04-26T10:21:48.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6160000000000001e-06 2024-04-26T10:21:48.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.313758+0000", 2024-04-26T10:21:48.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004794296 2024-04-26T10:21:48.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.313848+0000", 2024-04-26T10:21:48.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0488999999999994e-05 2024-04-26T10:21:48.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:48.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314099+0000", 2024-04-26T10:21:48.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025094700000000001 2024-04-26T10:21:48.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:48.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.318989+0000", 2024-04-26T10:21:48.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048896850000000004 2024-04-26T10:21:48.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319799+0000", 2024-04-26T10:21:48.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00080979299999999995 2024-04-26T10:21:48.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319847+0000", 2024-04-26T10:21:48.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8254999999999998e-05 2024-04-26T10:21:48.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.881 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.881 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319893+0000", 2024-04-26T10:21:48.881 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6108e-05 2024-04-26T10:21:48.881 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.881 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.881 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.881 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.881 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.882 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:48.882 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:48.882 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.532292722999998, 2024-04-26T10:21:48.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012032891, 2024-04-26T10:21:48.882 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.882 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.882 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.882 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:48.882 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.882 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.882 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.882 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:48.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:48.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:48.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.883 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.883 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308697+0000", 2024-04-26T10:21:48.883 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4449999999999998e-06 2024-04-26T10:21:48.883 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.883 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308864+0000", 2024-04-26T10:21:48.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000167045 2024-04-26T10:21:48.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308886+0000", 2024-04-26T10:21:48.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1858999999999999e-05 2024-04-26T10:21:48.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.884 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.884 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.884 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316346+0000", 2024-04-26T10:21:48.884 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007460225 2024-04-26T10:21:48.884 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316500+0000", 2024-04-26T10:21:48.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153776 2024-04-26T10:21:48.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:48.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316665+0000", 2024-04-26T10:21:48.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000164854 2024-04-26T10:21:48.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.885 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.885 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:48.885 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320564+0000", 2024-04-26T10:21:48.885 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038988339999999999 2024-04-26T10:21:48.885 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:48.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320680+0000", 2024-04-26T10:21:48.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011616399999999999 2024-04-26T10:21:48.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320710+0000", 2024-04-26T10:21:48.886 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0182e-05 2024-04-26T10:21:48.886 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.886 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.886 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.886 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320726+0000", 2024-04-26T10:21:48.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6118000000000001e-05 2024-04-26T10:21:48.887 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.887 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.887 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.887 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.887 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.887 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24863 5.e e27/22 5:70815639:::benchmark_data_smithi052_19421_object24862:head v 27'1571, mlcod=27'1569)", 2024-04-26T10:21:48.887 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:48.887 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.2876805300000003, 2024-04-26T10:21:48.887 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014429724999999999, 2024-04-26T10:21:48.887 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.887 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.887 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:48.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:48.888 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.888 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.888 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.888 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.888 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553304+0000", 2024-04-26T10:21:48.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553377+0000", 2024-04-26T10:21:48.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3206000000000003e-05 2024-04-26T10:21:48.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553397+0000", 2024-04-26T10:21:48.889 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9366000000000001e-05 2024-04-26T10:21:48.889 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.889 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.889 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.889 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553407+0000", 2024-04-26T10:21:48.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0676000000000001e-05 2024-04-26T10:21:48.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553467+0000", 2024-04-26T10:21:48.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9735999999999999e-05 2024-04-26T10:21:48.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.890 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.890 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.890 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553486+0000", 2024-04-26T10:21:48.890 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8842e-05 2024-04-26T10:21:48.890 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.567649+0000", 2024-04-26T10:21:48.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01416272 2024-04-26T10:21:48.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.891 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.891 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.567735+0000", 2024-04-26T10:21:48.891 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6363e-05 2024-04-26T10:21:48.891 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.891 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.891 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.891 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.891 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.892 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29357 5.d e28/22 5:b70cb761:::benchmark_data_smithi052_19421_object29356:head v 28'1892, mlcod=28'1890)", 2024-04-26T10:21:48.892 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.378626+0000", 2024-04-26T10:21:48.892 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4623602299999998, 2024-04-26T10:21:48.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012686653000000001, 2024-04-26T10:21:48.892 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.892 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.892 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.892 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378626+0000", 2024-04-26T10:21:48.892 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.892 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.892 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.892 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378626+0000", 2024-04-26T10:21:48.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378625+0000", 2024-04-26T10:21:48.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.893 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.893 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.893 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378673+0000", 2024-04-26T10:21:48.893 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8232000000000002e-05 2024-04-26T10:21:48.893 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378690+0000", 2024-04-26T10:21:48.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6983999999999999e-05 2024-04-26T10:21:48.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378699+0000", 2024-04-26T10:21:48.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3130000000000004e-06 2024-04-26T10:21:48.894 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.894 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.894 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.894 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378756+0000", 2024-04-26T10:21:48.894 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6437999999999997e-05 2024-04-26T10:21:48.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378776+0000", 2024-04-26T10:21:48.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0523999999999999e-05 2024-04-26T10:21:48.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.895 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.391219+0000", 2024-04-26T10:21:48.895 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012442698 2024-04-26T10:21:48.895 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.895 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.895 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.896 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.391312+0000", 2024-04-26T10:21:48.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3436000000000005e-05 2024-04-26T10:21:48.896 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.896 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.896 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.896 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.896 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.896 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29362 5.d e28/22 5:bea6ab30:::benchmark_data_smithi052_19421_object29361:head v 28'1893, mlcod=28'1890)", 2024-04-26T10:21:48.896 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.380758+0000", 2024-04-26T10:21:48.896 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4602275359999997, 2024-04-26T10:21:48.896 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013097510999999999, 2024-04-26T10:21:48.896 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.896 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.896 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380758+0000", 2024-04-26T10:21:48.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380758+0000", 2024-04-26T10:21:48.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.897 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.897 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.897 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.897 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380758+0000", 2024-04-26T10:21:48.897 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:48.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380807+0000", 2024-04-26T10:21:48.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8588000000000003e-05 2024-04-26T10:21:48.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.898 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380819+0000", 2024-04-26T10:21:48.898 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2432999999999999e-05 2024-04-26T10:21:48.898 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.898 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.898 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380825+0000", 2024-04-26T10:21:48.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.874e-06 2024-04-26T10:21:48.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.381904+0000", 2024-04-26T10:21:48.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010787940000000001 2024-04-26T10:21:48.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.899 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.899 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.381923+0000", 2024-04-26T10:21:48.899 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9599999999999999e-05 2024-04-26T10:21:48.899 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.899 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.393810+0000", 2024-04-26T10:21:48.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011886346000000001 2024-04-26T10:21:48.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.900 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.900 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.393856+0000", 2024-04-26T10:21:48.900 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6372999999999998e-05 2024-04-26T10:21:48.900 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.900 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.900 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.900 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.900 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.901 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29366 5.d e28/22 5:b794875b:::benchmark_data_smithi052_19421_object29365:head v 28'1894, mlcod=28'1890)", 2024-04-26T10:21:48.901 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.382527+0000", 2024-04-26T10:21:48.901 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4584590710000001, 2024-04-26T10:21:48.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011368682999999999, 2024-04-26T10:21:48.901 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.901 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.901 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.901 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.382527+0000", 2024-04-26T10:21:48.901 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.901 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.901 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.901 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.382527+0000", 2024-04-26T10:21:48.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.382526+0000", 2024-04-26T10:21:48.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.902 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.902 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.902 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.382619+0000", 2024-04-26T10:21:48.902 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3325999999999994e-05 2024-04-26T10:21:48.902 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.382631+0000", 2024-04-26T10:21:48.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1092e-05 2024-04-26T10:21:48.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.382639+0000", 2024-04-26T10:21:48.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1950000000000003e-06 2024-04-26T10:21:48.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.903 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.903 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.903 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.385389+0000", 2024-04-26T10:21:48.903 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0027499170000000002 2024-04-26T10:21:48.903 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.385406+0000", 2024-04-26T10:21:48.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6969e-05 2024-04-26T10:21:48.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.393869+0000", 2024-04-26T10:21:48.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084636929999999996 2024-04-26T10:21:48.904 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.904 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.904 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.904 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.393896+0000", 2024-04-26T10:21:48.904 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6234999999999999e-05 2024-04-26T10:21:48.904 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.905 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.905 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.905 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.905 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29403 5.8 e28/22 5:16857565:::benchmark_data_smithi052_19421_object29402:head v 28'1853, mlcod=28'1851)", 2024-04-26T10:21:48.905 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.399750+0000", 2024-04-26T10:21:48.905 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.4412361550000004, 2024-04-26T10:21:48.905 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011819834, 2024-04-26T10:21:48.905 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.905 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.905 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.905 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.905 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.905 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399750+0000", 2024-04-26T10:21:48.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399750+0000", 2024-04-26T10:21:48.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.906 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399749+0000", 2024-04-26T10:21:48.906 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:48.906 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.906 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.906 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399808+0000", 2024-04-26T10:21:48.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9106e-05 2024-04-26T10:21:48.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399819+0000", 2024-04-26T10:21:48.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0543999999999999e-05 2024-04-26T10:21:48.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.907 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.907 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399824+0000", 2024-04-26T10:21:48.907 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:21:48.907 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.907 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399889+0000", 2024-04-26T10:21:48.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5681999999999999e-05 2024-04-26T10:21:48.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399912+0000", 2024-04-26T10:21:48.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2673000000000001e-05 2024-04-26T10:21:48.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.908 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.908 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.411514+0000", 2024-04-26T10:21:48.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011601728 2024-04-26T10:21:48.908 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.411570+0000", 2024-04-26T10:21:48.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5852e-05 2024-04-26T10:21:48.909 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.909 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.909 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.909 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:34951 5.a 5:597bc7f6:::benchmark_data_smithi052_19421_object34950:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:48.909 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:47.829093+0000", 2024-04-26T10:21:48.909 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.011892582, 2024-04-26T10:21:48.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011173908, 2024-04-26T10:21:48.909 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.909 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.910 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:48.910 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:48.910 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.910 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 34951 2024-04-26T10:21:48.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.910 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:47.829093+0000", 2024-04-26T10:21:48.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:47.829093+0000", 2024-04-26T10:21:48.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:47.829092+0000", 2024-04-26T10:21:48.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:48.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:47.829173+0000", 2024-04-26T10:21:48.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1027999999999997e-05 2024-04-26T10:21:48.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:47.829186+0000", 2024-04-26T10:21:48.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3096e-05 2024-04-26T10:21:48.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:47.829193+0000", 2024-04-26T10:21:48.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7750000000000004e-06 2024-04-26T10:21:48.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:47.829242+0000", 2024-04-26T10:21:48.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9055999999999999e-05 2024-04-26T10:21:48.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:47.829402+0000", 2024-04-26T10:21:48.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016078800000000001 2024-04-26T10:21:48.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:48.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:47.840128+0000", 2024-04-26T10:21:48.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010725489 2024-04-26T10:21:48.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:47.840178+0000", 2024-04-26T10:21:48.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9824000000000003e-05 2024-04-26T10:21:48.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:47.840267+0000", 2024-04-26T10:21:48.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9591000000000003e-05 2024-04-26T10:21:48.914 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.914 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.914 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.914 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:35468 5.4 5:20cdaebe:::benchmark_data_smithi052_19421_object35467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:48.914 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.015558+0000", 2024-04-26T10:21:48.914 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.82542786999999995, 2024-04-26T10:21:48.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011215381999999999, 2024-04-26T10:21:48.915 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.915 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.915 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:48.915 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:48.915 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.915 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 35468 2024-04-26T10:21:48.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.915 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.015558+0000", 2024-04-26T10:21:48.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.015558+0000", 2024-04-26T10:21:48.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.015557+0000", 2024-04-26T10:21:48.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:48.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.015617+0000", 2024-04-26T10:21:48.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0414999999999997e-05 2024-04-26T10:21:48.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.015634+0000", 2024-04-26T10:21:48.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6934000000000001e-05 2024-04-26T10:21:48.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.015648+0000", 2024-04-26T10:21:48.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4428e-05 2024-04-26T10:21:48.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.015717+0000", 2024-04-26T10:21:48.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8652999999999995e-05 2024-04-26T10:21:48.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.015932+0000", 2024-04-26T10:21:48.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021495999999999999 2024-04-26T10:21:48.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:48.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.026640+0000", 2024-04-26T10:21:48.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010707845000000001 2024-04-26T10:21:48.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.026691+0000", 2024-04-26T10:21:48.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0970000000000002e-05 2024-04-26T10:21:48.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.026773+0000", 2024-04-26T10:21:48.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2572999999999997e-05 2024-04-26T10:21:48.919 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.919 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.919 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.920 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:35839 5.0 5:0a9de0e7:::benchmark_data_smithi052_19421_object35838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:48.920 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.151853+0000", 2024-04-26T10:21:48.920 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.68913283800000003, 2024-04-26T10:21:48.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012004918, 2024-04-26T10:21:48.920 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.920 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.920 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:48.920 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:48.920 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.920 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 35839 2024-04-26T10:21:48.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.920 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.151853+0000", 2024-04-26T10:21:48.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.151853+0000", 2024-04-26T10:21:48.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.921 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.151852+0000", 2024-04-26T10:21:48.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:48.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.151917+0000", 2024-04-26T10:21:48.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5124999999999997e-05 2024-04-26T10:21:48.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.151932+0000", 2024-04-26T10:21:48.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4961e-05 2024-04-26T10:21:48.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.151943+0000", 2024-04-26T10:21:48.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1063999999999999e-05 2024-04-26T10:21:48.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.155844+0000", 2024-04-26T10:21:48.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00390056 2024-04-26T10:21:48.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.155979+0000", 2024-04-26T10:21:48.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000135957 2024-04-26T10:21:48.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:48.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.163703+0000", 2024-04-26T10:21:48.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0077237470000000004 2024-04-26T10:21:48.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.163744+0000", 2024-04-26T10:21:48.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0513999999999999e-05 2024-04-26T10:21:48.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.163858+0000", 2024-04-26T10:21:48.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0001143 2024-04-26T10:21:48.924 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.924 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.924 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.925 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:36718 5.a 5:5e4d923f:::benchmark_data_smithi052_19421_object36717:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:48.925 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.462468+0000", 2024-04-26T10:21:48.925 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.37851758000000002, 2024-04-26T10:21:48.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011334789, 2024-04-26T10:21:48.925 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.925 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.925 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:48.925 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:48.925 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.925 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 36718 2024-04-26T10:21:48.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.925 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462468+0000", 2024-04-26T10:21:48.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462468+0000", 2024-04-26T10:21:48.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462468+0000", 2024-04-26T10:21:48.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:48.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462506+0000", 2024-04-26T10:21:48.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8624999999999997e-05 2024-04-26T10:21:48.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462520+0000", 2024-04-26T10:21:48.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3200999999999999e-05 2024-04-26T10:21:48.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462524+0000", 2024-04-26T10:21:48.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9280000000000003e-06 2024-04-26T10:21:48.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.465700+0000", 2024-04-26T10:21:48.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031760650000000001 2024-04-26T10:21:48.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.465801+0000", 2024-04-26T10:21:48.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010164 2024-04-26T10:21:48.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:48.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.473673+0000", 2024-04-26T10:21:48.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0078713329999999995 2024-04-26T10:21:48.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.473734+0000", 2024-04-26T10:21:48.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1274999999999999e-05 2024-04-26T10:21:48.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.473803+0000", 2024-04-26T10:21:48.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9296999999999997e-05 2024-04-26T10:21:48.929 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.929 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.930 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.930 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:36719 5.a 5:59a5d173:::benchmark_data_smithi052_19421_object36718:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:48.930 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.462527+0000", 2024-04-26T10:21:48.930 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.37845847900000001, 2024-04-26T10:21:48.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011370177, 2024-04-26T10:21:48.930 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.930 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.930 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:48.930 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:48.930 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.930 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 36719 2024-04-26T10:21:48.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.931 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462527+0000", 2024-04-26T10:21:48.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462527+0000", 2024-04-26T10:21:48.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462527+0000", 2024-04-26T10:21:48.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:48.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462557+0000", 2024-04-26T10:21:48.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9595999999999999e-05 2024-04-26T10:21:48.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462568+0000", 2024-04-26T10:21:48.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1259e-05 2024-04-26T10:21:48.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462572+0000", 2024-04-26T10:21:48.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4429999999999996e-06 2024-04-26T10:21:48.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.468747+0000", 2024-04-26T10:21:48.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061746559999999997 2024-04-26T10:21:48.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.468915+0000", 2024-04-26T10:21:48.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000167689 2024-04-26T10:21:48.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:48.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.473812+0000", 2024-04-26T10:21:48.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048972099999999999 2024-04-26T10:21:48.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.473845+0000", 2024-04-26T10:21:48.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3033e-05 2024-04-26T10:21:48.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.473898+0000", 2024-04-26T10:21:48.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2623000000000001e-05 2024-04-26T10:21:48.935 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.935 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.935 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.935 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:37587 5.8 5:15f2a9e2:::benchmark_data_smithi052_19421_object37586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:48.935 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.782998+0000", 2024-04-26T10:21:48.935 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.057987590999999998, 2024-04-26T10:21:48.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011576672, 2024-04-26T10:21:48.935 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.935 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.935 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:48.935 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:48.936 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.936 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 37587 2024-04-26T10:21:48.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.936 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.782998+0000", 2024-04-26T10:21:48.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.782998+0000", 2024-04-26T10:21:48.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.782998+0000", 2024-04-26T10:21:48.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:48.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783038+0000", 2024-04-26T10:21:48.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0519000000000003e-05 2024-04-26T10:21:48.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783045+0000", 2024-04-26T10:21:48.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1289999999999998e-06 2024-04-26T10:21:48.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783052+0000", 2024-04-26T10:21:48.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1179999999999997e-06 2024-04-26T10:21:48.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.788222+0000", 2024-04-26T10:21:48.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051701459999999996 2024-04-26T10:21:48.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.788393+0000", 2024-04-26T10:21:48.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017154099999999999 2024-04-26T10:21:48.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:48.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.794456+0000", 2024-04-26T10:21:48.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0060629669999999998 2024-04-26T10:21:48.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.794502+0000", 2024-04-26T10:21:48.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5929e-05 2024-04-26T10:21:48.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.794575+0000", 2024-04-26T10:21:48.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2943999999999998e-05 2024-04-26T10:21:48.940 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.940 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.940 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.940 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:37588 5.0 5:02ecbf83:::benchmark_data_smithi052_19421_object37587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:48.940 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.783366+0000", 2024-04-26T10:21:48.940 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.057619670999999997, 2024-04-26T10:21:48.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011349655, 2024-04-26T10:21:48.940 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.940 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.941 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:48.941 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:48.941 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.941 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 37588 2024-04-26T10:21:48.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.941 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783366+0000", 2024-04-26T10:21:48.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783366+0000", 2024-04-26T10:21:48.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783365+0000", 2024-04-26T10:21:48.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:48.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783443+0000", 2024-04-26T10:21:48.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7922000000000004e-05 2024-04-26T10:21:48.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783460+0000", 2024-04-26T10:21:48.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6807999999999999e-05 2024-04-26T10:21:48.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783470+0000", 2024-04-26T10:21:48.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6169999999999996e-06 2024-04-26T10:21:48.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.788212+0000", 2024-04-26T10:21:48.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004741856 2024-04-26T10:21:48.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.788388+0000", 2024-04-26T10:21:48.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017666099999999999 2024-04-26T10:21:48.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:48.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.794598+0000", 2024-04-26T10:21:48.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0062094869999999996 2024-04-26T10:21:48.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.794647+0000", 2024-04-26T10:21:48.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9657000000000002e-05 2024-04-26T10:21:48.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.794716+0000", 2024-04-26T10:21:48.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8554999999999997e-05 2024-04-26T10:21:48.945 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.945 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.945 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.945 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:37589 5.8 5:1dd2bd76:::benchmark_data_smithi052_19421_object37588:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:48.945 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.783477+0000", 2024-04-26T10:21:48.945 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.057509224999999997, 2024-04-26T10:21:48.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012240964999999999, 2024-04-26T10:21:48.945 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:48.946 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:48.946 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:48.946 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:48.946 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:48.946 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 37589 2024-04-26T10:21:48.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.946 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:48.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:48.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783477+0000", 2024-04-26T10:21:48.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:48.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783477+0000", 2024-04-26T10:21:48.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:48.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:48.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783476+0000", 2024-04-26T10:21:48.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:48.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:48.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783513+0000", 2024-04-26T10:21:48.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6999000000000003e-05 2024-04-26T10:21:48.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:48.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783520+0000", 2024-04-26T10:21:48.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0740000000000004e-06 2024-04-26T10:21:48.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:48.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783526+0000", 2024-04-26T10:21:48.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6420000000000004e-06 2024-04-26T10:21:48.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:48.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.790052+0000", 2024-04-26T10:21:48.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006525955 2024-04-26T10:21:48.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:48.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.790193+0000", 2024-04-26T10:21:48.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000140908 2024-04-26T10:21:48.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:48.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.795635+0000", 2024-04-26T10:21:48.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054424360000000001 2024-04-26T10:21:48.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:48.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.795677+0000", 2024-04-26T10:21:48.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2009999999999999e-05 2024-04-26T10:21:48.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:48.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:48.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:48.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.795718+0000", 2024-04-26T10:21:48.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.053e-05 2024-04-26T10:21:48.950 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.950 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.950 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.950 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:48.950 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:48.950 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:48.951 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:21:48.952 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:48.949+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:48.953 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:49.053 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:49.048+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:49.086 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:49.087 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:49.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.087 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:38372 5.9 5:9b42615b:::benchmark_data_smithi052_19421_object38371:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:49.087 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:49.080269+0000", 2024-04-26T10:21:49.087 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0047351069999999997, 2024-04-26T10:21:49.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047541500000000004, 2024-04-26T10:21:49.087 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:49.087 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:49.087 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:49.087 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:49.087 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:49.088 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 38372 2024-04-26T10:21:49.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.088 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:49.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:49.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.080269+0000", 2024-04-26T10:21:49.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:49.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:49.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.080269+0000", 2024-04-26T10:21:49.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:49.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:49.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.080269+0000", 2024-04-26T10:21:49.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:49.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:49.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.080373+0000", 2024-04-26T10:21:49.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001042 2024-04-26T10:21:49.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:49.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.080391+0000", 2024-04-26T10:21:49.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8057e-05 2024-04-26T10:21:49.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:49.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.080399+0000", 2024-04-26T10:21:49.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5660000000000007e-06 2024-04-26T10:21:49.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:49.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.080450+0000", 2024-04-26T10:21:49.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0395000000000001e-05 2024-04-26T10:21:49.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:49.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.080547+0000", 2024-04-26T10:21:49.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7065999999999995e-05 2024-04-26T10:21:49.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:49.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.080676+0000", 2024-04-26T10:21:49.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000128751 2024-04-26T10:21:49.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:49.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.082560+0000", 2024-04-26T10:21:49.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001884028 2024-04-26T10:21:49.092 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:49.092 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:49.092 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:49.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.092 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:38381 5.d 5:be0b5fea:::benchmark_data_smithi052_19421_object38380:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:49.092 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:49.082877+0000", 2024-04-26T10:21:49.092 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0021280000000000001, 2024-04-26T10:21:49.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021970409999999998, 2024-04-26T10:21:49.092 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:49.092 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:49.092 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:49.092 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:49.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:49.093 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 38381 2024-04-26T10:21:49.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.093 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:49.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:49.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.082877+0000", 2024-04-26T10:21:49.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:49.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:49.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.082877+0000", 2024-04-26T10:21:49.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:49.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:49.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.082875+0000", 2024-04-26T10:21:49.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:49.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:49.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.082988+0000", 2024-04-26T10:21:49.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112743 2024-04-26T10:21:49.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:49.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.083002+0000", 2024-04-26T10:21:49.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3944999999999999e-05 2024-04-26T10:21:49.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:49.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.083010+0000", 2024-04-26T10:21:49.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3710000000000002e-06 2024-04-26T10:21:49.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:49.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.083049+0000", 2024-04-26T10:21:49.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9774999999999998e-05 2024-04-26T10:21:49.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:49.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.083162+0000", 2024-04-26T10:21:49.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112904 2024-04-26T10:21:49.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:49.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.083282+0000", 2024-04-26T10:21:49.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119577 2024-04-26T10:21:49.096 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:49.096 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:49.096 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:49.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.097 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:38382 5.c 5:3c58415b:::benchmark_data_smithi052_19421_object38381:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:49.097 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:49.083025+0000", 2024-04-26T10:21:49.097 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001979368, 2024-04-26T10:21:49.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002088828, 2024-04-26T10:21:49.097 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:49.097 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:49.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:49.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:49.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:49.097 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 38382 2024-04-26T10:21:49.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.097 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:49.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:49.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.083025+0000", 2024-04-26T10:21:49.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:49.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:49.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.083025+0000", 2024-04-26T10:21:49.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:49.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:49.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.083024+0000", 2024-04-26T10:21:49.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:49.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:49.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.083068+0000", 2024-04-26T10:21:49.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3958000000000002e-05 2024-04-26T10:21:49.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:49.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.083077+0000", 2024-04-26T10:21:49.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5660000000000007e-06 2024-04-26T10:21:49.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:49.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.083083+0000", 2024-04-26T10:21:49.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2190000000000001e-06 2024-04-26T10:21:49.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:49.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.083123+0000", 2024-04-26T10:21:49.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0231999999999997e-05 2024-04-26T10:21:49.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:49.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:49.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:49.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:49.083236+0000", 2024-04-26T10:21:49.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011315900000000001 2024-04-26T10:21:49.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:49.100 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:49.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:49.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:49.101 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:21:49.101 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 3 2024-04-26T10:21:49.101 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:49.101 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:21:49.102 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:49.122 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:21:49.122 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:21:49.123 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:21:49.123 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:21:49.127 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:21:49.128 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:21:49.153 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:49.148+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:49.237 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:49.237 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:49.253 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:49.254 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:49.249+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:49.355 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:49.353+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:49.383 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:49.383 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:49.397 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:49.456 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:49.452+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:49.531 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:49.531 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:49.545 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:49.557 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:49.553+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:49.614 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 16 16 39768 39752 155.264 165.125 0.00832302 0.00643416 2024-04-26T10:21:49.639 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T10:21:49.658 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:49.653+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:49.668 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:49.668 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:49.681 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:49.758 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:49.757+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:49.808 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:49.808 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:49.819 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:49.866 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:49.865+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:49.951 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:49.951 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:49.960 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:49.957+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:49.962 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:50.062 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:50.056+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:50.094 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:50.094 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:50.106 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:50.162 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:50.161+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:50.239 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:50.240 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:50.252 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:50.263 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:50.261+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:50.364 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:50.360+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:50.387 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:50.387 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:50.400 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:50.466 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:50.460+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:50.524 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:50.525 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:50.536 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:50.566 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:50.565+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:50.614 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 17 16 42391 42375 155.773 163.938 0.0045295 0.00641347 2024-04-26T10:21:50.667 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:50.664+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:50.669 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:50.669 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:50.682 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:50.767 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:50.765+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:50.797 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T10:21:50.812 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:50.812 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:50.825 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:50.868 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:50.865+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:50.906 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-04-26T10:21:50.952 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:50.952 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:50.966 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:50.969 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:50.964+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:51.007 INFO:teuthology.orchestra.console.smithi164:Power off completed 2024-04-26T10:21:51.070 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:51.064+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:51.129 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:21:51.144 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:51.144 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:51.158 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:51.171 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:51.169+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:51.272 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:51.268+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:51.287 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:21:51.288 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:51.288 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:51.301 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:51.309 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:21:51.309 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:21:51.309 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:21:51.309 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:21:51.314 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:21:51.314 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:21:51.372 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:51.369+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:51.428 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:51.428 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:21:51.428 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:21:51.428 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:21:51.428 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:51.441 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:51.474 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:51.468+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:51.562 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:51.562 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:21:51.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:21:51.562 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:51.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.562 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:51.562 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:51.563 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.258167602, 2024-04-26T10:21:51.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018441564000000001, 2024-04-26T10:21:51.563 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.563 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.563 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:51.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:51.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301372+0000", 2024-04-26T10:21:51.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:51.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301399+0000", 2024-04-26T10:21:51.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7039999999999999e-05 2024-04-26T10:21:51.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301426+0000", 2024-04-26T10:21:51.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6381e-05 2024-04-26T10:21:51.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301480+0000", 2024-04-26T10:21:51.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3681000000000003e-05 2024-04-26T10:21:51.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310584+0000", 2024-04-26T10:21:51.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091042339999999992 2024-04-26T10:21:51.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:51.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310591+0000", 2024-04-26T10:21:51.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8190000000000003e-06 2024-04-26T10:21:51.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311503+0000", 2024-04-26T10:21:51.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000911983 2024-04-26T10:21:51.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311605+0000", 2024-04-26T10:21:51.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102619 2024-04-26T10:21:51.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:51.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311730+0000", 2024-04-26T10:21:51.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012474400000000001 2024-04-26T10:21:51.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:51.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317287+0000", 2024-04-26T10:21:51.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055571140000000002 2024-04-26T10:21:51.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:51.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319724+0000", 2024-04-26T10:21:51.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002437294 2024-04-26T10:21:51.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319776+0000", 2024-04-26T10:21:51.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1992e-05 2024-04-26T10:21:51.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319816+0000", 2024-04-26T10:21:51.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9709999999999998e-05 2024-04-26T10:21:51.569 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.569 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.569 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.569 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:51.569 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:51.569 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.252851735999997, 2024-04-26T10:21:51.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013786338, 2024-04-26T10:21:51.570 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.570 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.570 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:51.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:51.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306689+0000", 2024-04-26T10:21:51.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:51.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306697+0000", 2024-04-26T10:21:51.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2420000000000003e-06 2024-04-26T10:21:51.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306725+0000", 2024-04-26T10:21:51.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8209e-05 2024-04-26T10:21:51.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306750+0000", 2024-04-26T10:21:51.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5432e-05 2024-04-26T10:21:51.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310622+0000", 2024-04-26T10:21:51.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003871738 2024-04-26T10:21:51.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:21:51.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310627+0000", 2024-04-26T10:21:51.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4890000000000003e-06 2024-04-26T10:21:51.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314030+0000", 2024-04-26T10:21:51.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003402094 2024-04-26T10:21:51.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314147+0000", 2024-04-26T10:21:51.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011776499999999999 2024-04-26T10:21:51.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:51.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314441+0000", 2024-04-26T10:21:51.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000293543 2024-04-26T10:21:51.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:51.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319422+0000", 2024-04-26T10:21:51.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004981096 2024-04-26T10:21:51.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:51.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320057+0000", 2024-04-26T10:21:51.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000635521 2024-04-26T10:21:51.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320110+0000", 2024-04-26T10:21:51.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2104999999999997e-05 2024-04-26T10:21:51.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320477+0000", 2024-04-26T10:21:51.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036709500000000001 2024-04-26T10:21:51.576 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.576 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.576 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.576 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:51.576 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:51.576 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.252758374999999, 2024-04-26T10:21:51.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013859405999999999, 2024-04-26T10:21:51.577 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.577 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.577 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:51.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:51.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306783+0000", 2024-04-26T10:21:51.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:51.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306788+0000", 2024-04-26T10:21:51.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3990000000000003e-06 2024-04-26T10:21:51.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306796+0000", 2024-04-26T10:21:51.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8820000000000001e-06 2024-04-26T10:21:51.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306803+0000", 2024-04-26T10:21:51.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6649999999999997e-06 2024-04-26T10:21:51.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314454+0000", 2024-04-26T10:21:51.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076508349999999999 2024-04-26T10:21:51.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314930+0000", 2024-04-26T10:21:51.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047624199999999998 2024-04-26T10:21:51.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:51.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315127+0000", 2024-04-26T10:21:51.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196751 2024-04-26T10:21:51.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:51.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320496+0000", 2024-04-26T10:21:51.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053690150000000004 2024-04-26T10:21:51.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:51.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320576+0000", 2024-04-26T10:21:51.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0327999999999994e-05 2024-04-26T10:21:51.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320611+0000", 2024-04-26T10:21:51.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-04-26T10:21:51.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320643+0000", 2024-04-26T10:21:51.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2474000000000001e-05 2024-04-26T10:21:51.582 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.582 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.582 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.582 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:51.583 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:51.583 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.252679204000003, 2024-04-26T10:21:51.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013889195, 2024-04-26T10:21:51.583 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.583 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.583 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:51.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:51.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306862+0000", 2024-04-26T10:21:51.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:51.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306867+0000", 2024-04-26T10:21:51.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5390000000000001e-06 2024-04-26T10:21:51.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306874+0000", 2024-04-26T10:21:51.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7549999999999997e-06 2024-04-26T10:21:51.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306887+0000", 2024-04-26T10:21:51.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.313e-05 2024-04-26T10:21:51.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315477+0000", 2024-04-26T10:21:51.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085902489999999995 2024-04-26T10:21:51.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315607+0000", 2024-04-26T10:21:51.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129789 2024-04-26T10:21:51.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:51.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315767+0000", 2024-04-26T10:21:51.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016052699999999999 2024-04-26T10:21:51.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:51.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320502+0000", 2024-04-26T10:21:51.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00473421 2024-04-26T10:21:51.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:51.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320691+0000", 2024-04-26T10:21:51.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018938900000000001 2024-04-26T10:21:51.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320721+0000", 2024-04-26T10:21:51.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9677000000000001e-05 2024-04-26T10:21:51.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320752+0000", 2024-04-26T10:21:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1486000000000003e-05 2024-04-26T10:21:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.252641285999999, 2024-04-26T10:21:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012590871, 2024-04-26T10:21:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:51.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:51.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306900+0000", 2024-04-26T10:21:51.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:51.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306905+0000", 2024-04-26T10:21:51.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9010000000000002e-06 2024-04-26T10:21:51.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306911+0000", 2024-04-26T10:21:51.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6030000000000004e-06 2024-04-26T10:21:51.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306916+0000", 2024-04-26T10:21:51.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8539999999999996e-06 2024-04-26T10:21:51.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308529+0000", 2024-04-26T10:21:51.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001613258 2024-04-26T10:21:51.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:51.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308537+0000", 2024-04-26T10:21:51.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1680000000000004e-06 2024-04-26T10:21:51.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311962+0000", 2024-04-26T10:21:51.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034247290000000001 2024-04-26T10:21:51.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.312092+0000", 2024-04-26T10:21:51.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013048700000000001 2024-04-26T10:21:51.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:51.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.312438+0000", 2024-04-26T10:21:51.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00034558700000000001 2024-04-26T10:21:51.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:51.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317984+0000", 2024-04-26T10:21:51.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005546067 2024-04-26T10:21:51.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:51.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319373+0000", 2024-04-26T10:21:51.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001389426 2024-04-26T10:21:51.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319438+0000", 2024-04-26T10:21:51.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4849000000000002e-05 2024-04-26T10:21:51.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319492+0000", 2024-04-26T10:21:51.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3554000000000003e-05 2024-04-26T10:21:51.594 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.594 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.594 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.594 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:51.594 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:51.594 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.250970703, 2024-04-26T10:21:51.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011321652999999999, 2024-04-26T10:21:51.594 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.594 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.594 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:51.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:51.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308571+0000", 2024-04-26T10:21:51.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:51.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308576+0000", 2024-04-26T10:21:51.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2920000000000003e-06 2024-04-26T10:21:51.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308582+0000", 2024-04-26T10:21:51.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6540000000000002e-06 2024-04-26T10:21:51.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308590+0000", 2024-04-26T10:21:51.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1049999999999997e-06 2024-04-26T10:21:51.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308958+0000", 2024-04-26T10:21:51.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036823500000000001 2024-04-26T10:21:51.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:21:51.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308963+0000", 2024-04-26T10:21:51.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6160000000000001e-06 2024-04-26T10:21:51.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.313758+0000", 2024-04-26T10:21:51.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004794296 2024-04-26T10:21:51.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.313848+0000", 2024-04-26T10:21:51.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0488999999999994e-05 2024-04-26T10:21:51.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:51.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314099+0000", 2024-04-26T10:21:51.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025094700000000001 2024-04-26T10:21:51.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:51.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.318989+0000", 2024-04-26T10:21:51.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048896850000000004 2024-04-26T10:21:51.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:51.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319799+0000", 2024-04-26T10:21:51.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00080979299999999995 2024-04-26T10:21:51.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319847+0000", 2024-04-26T10:21:51.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8254999999999998e-05 2024-04-26T10:21:51.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319893+0000", 2024-04-26T10:21:51.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6108e-05 2024-04-26T10:21:51.600 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.600 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.600 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.600 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:30 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:51.601 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:51.601 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 42.250848853999997, 2024-04-26T10:21:51.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012032891, 2024-04-26T10:21:51.601 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.601 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.601 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:51.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:51.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308693+0000", 2024-04-26T10:21:51.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:51.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308697+0000", 2024-04-26T10:21:51.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4449999999999998e-06 2024-04-26T10:21:51.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308864+0000", 2024-04-26T10:21:51.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000167045 2024-04-26T10:21:51.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308886+0000", 2024-04-26T10:21:51.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1858999999999999e-05 2024-04-26T10:21:51.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316346+0000", 2024-04-26T10:21:51.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007460225 2024-04-26T10:21:51.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316500+0000", 2024-04-26T10:21:51.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153776 2024-04-26T10:21:51.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:51.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.316665+0000", 2024-04-26T10:21:51.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000164854 2024-04-26T10:21:51.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:51.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320564+0000", 2024-04-26T10:21:51.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038988339999999999 2024-04-26T10:21:51.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:51.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320680+0000", 2024-04-26T10:21:51.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011616399999999999 2024-04-26T10:21:51.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320710+0000", 2024-04-26T10:21:51.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0182e-05 2024-04-26T10:21:51.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320726+0000", 2024-04-26T10:21:51.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6118000000000001e-05 2024-04-26T10:21:51.605 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.606 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.606 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.606 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24863 5.e e27/22 5:70815639:::benchmark_data_smithi052_19421_object24862:head v 27'1571, mlcod=27'1569)", 2024-04-26T10:21:51.606 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:51.606 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.0062366610000009, 2024-04-26T10:21:51.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014429724999999999, 2024-04-26T10:21:51.606 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.606 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.606 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:51.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:51.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553304+0000", 2024-04-26T10:21:51.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:51.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553377+0000", 2024-04-26T10:21:51.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3206000000000003e-05 2024-04-26T10:21:51.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553397+0000", 2024-04-26T10:21:51.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9366000000000001e-05 2024-04-26T10:21:51.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553407+0000", 2024-04-26T10:21:51.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0676000000000001e-05 2024-04-26T10:21:51.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553467+0000", 2024-04-26T10:21:51.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9735999999999999e-05 2024-04-26T10:21:51.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553486+0000", 2024-04-26T10:21:51.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8842e-05 2024-04-26T10:21:51.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.567649+0000", 2024-04-26T10:21:51.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01416272 2024-04-26T10:21:51.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.567735+0000", 2024-04-26T10:21:51.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6363e-05 2024-04-26T10:21:51.610 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.610 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.610 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.610 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29357 5.d e28/22 5:b70cb761:::benchmark_data_smithi052_19421_object29356:head v 28'1892, mlcod=28'1890)", 2024-04-26T10:21:51.610 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.378626+0000", 2024-04-26T10:21:51.610 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.1809163610000004, 2024-04-26T10:21:51.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012686653000000001, 2024-04-26T10:21:51.611 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.611 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.611 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378626+0000", 2024-04-26T10:21:51.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378626+0000", 2024-04-26T10:21:51.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378625+0000", 2024-04-26T10:21:51.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:51.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378673+0000", 2024-04-26T10:21:51.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8232000000000002e-05 2024-04-26T10:21:51.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378690+0000", 2024-04-26T10:21:51.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6983999999999999e-05 2024-04-26T10:21:51.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378699+0000", 2024-04-26T10:21:51.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3130000000000004e-06 2024-04-26T10:21:51.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378756+0000", 2024-04-26T10:21:51.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6437999999999997e-05 2024-04-26T10:21:51.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378776+0000", 2024-04-26T10:21:51.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0523999999999999e-05 2024-04-26T10:21:51.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.391219+0000", 2024-04-26T10:21:51.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012442698 2024-04-26T10:21:51.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.391312+0000", 2024-04-26T10:21:51.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3436000000000005e-05 2024-04-26T10:21:51.614 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.614 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.614 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.615 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29362 5.d e28/22 5:bea6ab30:::benchmark_data_smithi052_19421_object29361:head v 28'1893, mlcod=28'1890)", 2024-04-26T10:21:51.615 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.380758+0000", 2024-04-26T10:21:51.615 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.1787836670000003, 2024-04-26T10:21:51.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013097510999999999, 2024-04-26T10:21:51.615 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.615 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.615 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380758+0000", 2024-04-26T10:21:51.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380758+0000", 2024-04-26T10:21:51.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380758+0000", 2024-04-26T10:21:51.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:51.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380807+0000", 2024-04-26T10:21:51.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8588000000000003e-05 2024-04-26T10:21:51.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380819+0000", 2024-04-26T10:21:51.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2432999999999999e-05 2024-04-26T10:21:51.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380825+0000", 2024-04-26T10:21:51.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.874e-06 2024-04-26T10:21:51.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.381904+0000", 2024-04-26T10:21:51.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010787940000000001 2024-04-26T10:21:51.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.381923+0000", 2024-04-26T10:21:51.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9599999999999999e-05 2024-04-26T10:21:51.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.393810+0000", 2024-04-26T10:21:51.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011886346000000001 2024-04-26T10:21:51.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.393856+0000", 2024-04-26T10:21:51.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6372999999999998e-05 2024-04-26T10:21:51.619 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.619 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.619 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.619 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29366 5.d e28/22 5:b794875b:::benchmark_data_smithi052_19421_object29365:head v 28'1894, mlcod=28'1890)", 2024-04-26T10:21:51.619 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.382527+0000", 2024-04-26T10:21:51.619 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.1770152019999998, 2024-04-26T10:21:51.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011368682999999999, 2024-04-26T10:21:51.619 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.620 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.620 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.382527+0000", 2024-04-26T10:21:51.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.382527+0000", 2024-04-26T10:21:51.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.382526+0000", 2024-04-26T10:21:51.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:51.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.382619+0000", 2024-04-26T10:21:51.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3325999999999994e-05 2024-04-26T10:21:51.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.382631+0000", 2024-04-26T10:21:51.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1092e-05 2024-04-26T10:21:51.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.382639+0000", 2024-04-26T10:21:51.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1950000000000003e-06 2024-04-26T10:21:51.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.385389+0000", 2024-04-26T10:21:51.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0027499170000000002 2024-04-26T10:21:51.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.385406+0000", 2024-04-26T10:21:51.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6969e-05 2024-04-26T10:21:51.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.393869+0000", 2024-04-26T10:21:51.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084636929999999996 2024-04-26T10:21:51.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.393896+0000", 2024-04-26T10:21:51.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6234999999999999e-05 2024-04-26T10:21:51.623 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.623 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.623 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.624 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29403 5.8 e28/22 5:16857565:::benchmark_data_smithi052_19421_object29402:head v 28'1853, mlcod=28'1851)", 2024-04-26T10:21:51.624 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.399750+0000", 2024-04-26T10:21:51.624 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.1597922860000001, 2024-04-26T10:21:51.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011819834, 2024-04-26T10:21:51.624 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.624 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.624 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399750+0000", 2024-04-26T10:21:51.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399750+0000", 2024-04-26T10:21:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399749+0000", 2024-04-26T10:21:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399808+0000", 2024-04-26T10:21:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9106e-05 2024-04-26T10:21:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399819+0000", 2024-04-26T10:21:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0543999999999999e-05 2024-04-26T10:21:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399824+0000", 2024-04-26T10:21:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7840000000000003e-06 2024-04-26T10:21:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399889+0000", 2024-04-26T10:21:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5681999999999999e-05 2024-04-26T10:21:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.399912+0000", 2024-04-26T10:21:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2673000000000001e-05 2024-04-26T10:21:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.411514+0000", 2024-04-26T10:21:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011601728 2024-04-26T10:21:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.411570+0000", 2024-04-26T10:21:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5852e-05 2024-04-26T10:21:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.627 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:35468 5.4 5:20cdaebe:::benchmark_data_smithi052_19421_object35467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.015558+0000", 2024-04-26T10:21:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.5439840010000001, 2024-04-26T10:21:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011215381999999999, 2024-04-26T10:21:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 35468 2024-04-26T10:21:51.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.015558+0000", 2024-04-26T10:21:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.015558+0000", 2024-04-26T10:21:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.015557+0000", 2024-04-26T10:21:51.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.015617+0000", 2024-04-26T10:21:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0414999999999997e-05 2024-04-26T10:21:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.015634+0000", 2024-04-26T10:21:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6934000000000001e-05 2024-04-26T10:21:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.015648+0000", 2024-04-26T10:21:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4428e-05 2024-04-26T10:21:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.015717+0000", 2024-04-26T10:21:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8652999999999995e-05 2024-04-26T10:21:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.015932+0000", 2024-04-26T10:21:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021495999999999999 2024-04-26T10:21:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.026640+0000", 2024-04-26T10:21:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010707845000000001 2024-04-26T10:21:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.026691+0000", 2024-04-26T10:21:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0970000000000002e-05 2024-04-26T10:21:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.026773+0000", 2024-04-26T10:21:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2572999999999997e-05 2024-04-26T10:21:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.632 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:35839 5.0 5:0a9de0e7:::benchmark_data_smithi052_19421_object35838:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.151853+0000", 2024-04-26T10:21:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.4076889690000001, 2024-04-26T10:21:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012004918, 2024-04-26T10:21:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 35839 2024-04-26T10:21:51.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.151853+0000", 2024-04-26T10:21:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.151853+0000", 2024-04-26T10:21:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.151852+0000", 2024-04-26T10:21:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.151917+0000", 2024-04-26T10:21:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5124999999999997e-05 2024-04-26T10:21:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.151932+0000", 2024-04-26T10:21:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4961e-05 2024-04-26T10:21:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.151943+0000", 2024-04-26T10:21:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1063999999999999e-05 2024-04-26T10:21:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.155844+0000", 2024-04-26T10:21:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00390056 2024-04-26T10:21:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.155979+0000", 2024-04-26T10:21:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000135957 2024-04-26T10:21:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.163703+0000", 2024-04-26T10:21:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0077237470000000004 2024-04-26T10:21:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.163744+0000", 2024-04-26T10:21:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0513999999999999e-05 2024-04-26T10:21:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.163858+0000", 2024-04-26T10:21:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0001143 2024-04-26T10:21:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.637 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:36718 5.a 5:5e4d923f:::benchmark_data_smithi052_19421_object36717:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.462468+0000", 2024-04-26T10:21:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.0970737110000002, 2024-04-26T10:21:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011334789, 2024-04-26T10:21:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 36718 2024-04-26T10:21:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.638 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462468+0000", 2024-04-26T10:21:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462468+0000", 2024-04-26T10:21:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462468+0000", 2024-04-26T10:21:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462506+0000", 2024-04-26T10:21:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8624999999999997e-05 2024-04-26T10:21:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462520+0000", 2024-04-26T10:21:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3200999999999999e-05 2024-04-26T10:21:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462524+0000", 2024-04-26T10:21:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9280000000000003e-06 2024-04-26T10:21:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.465700+0000", 2024-04-26T10:21:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031760650000000001 2024-04-26T10:21:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.465801+0000", 2024-04-26T10:21:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010164 2024-04-26T10:21:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.473673+0000", 2024-04-26T10:21:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0078713329999999995 2024-04-26T10:21:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.473734+0000", 2024-04-26T10:21:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1274999999999999e-05 2024-04-26T10:21:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.473803+0000", 2024-04-26T10:21:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9296999999999997e-05 2024-04-26T10:21:51.642 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:36719 5.a 5:59a5d173:::benchmark_data_smithi052_19421_object36718:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.462527+0000", 2024-04-26T10:21:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.09701461, 2024-04-26T10:21:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011370177, 2024-04-26T10:21:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:51.643 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 36719 2024-04-26T10:21:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462527+0000", 2024-04-26T10:21:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462527+0000", 2024-04-26T10:21:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462527+0000", 2024-04-26T10:21:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462557+0000", 2024-04-26T10:21:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9595999999999999e-05 2024-04-26T10:21:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462568+0000", 2024-04-26T10:21:51.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1259e-05 2024-04-26T10:21:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.462572+0000", 2024-04-26T10:21:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4429999999999996e-06 2024-04-26T10:21:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.468747+0000", 2024-04-26T10:21:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061746559999999997 2024-04-26T10:21:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.468915+0000", 2024-04-26T10:21:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000167689 2024-04-26T10:21:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.473812+0000", 2024-04-26T10:21:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048972099999999999 2024-04-26T10:21:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.473845+0000", 2024-04-26T10:21:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3033e-05 2024-04-26T10:21:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.473898+0000", 2024-04-26T10:21:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2623000000000001e-05 2024-04-26T10:21:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:37587 5.8 5:15f2a9e2:::benchmark_data_smithi052_19421_object37586:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.782998+0000", 2024-04-26T10:21:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 2.776543722, 2024-04-26T10:21:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011576672, 2024-04-26T10:21:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.648 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 37587 2024-04-26T10:21:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.782998+0000", 2024-04-26T10:21:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.782998+0000", 2024-04-26T10:21:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.782998+0000", 2024-04-26T10:21:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783038+0000", 2024-04-26T10:21:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0519000000000003e-05 2024-04-26T10:21:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783045+0000", 2024-04-26T10:21:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1289999999999998e-06 2024-04-26T10:21:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783052+0000", 2024-04-26T10:21:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1179999999999997e-06 2024-04-26T10:21:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.788222+0000", 2024-04-26T10:21:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051701459999999996 2024-04-26T10:21:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.788393+0000", 2024-04-26T10:21:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017154099999999999 2024-04-26T10:21:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.794456+0000", 2024-04-26T10:21:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0060629669999999998 2024-04-26T10:21:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.794502+0000", 2024-04-26T10:21:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5929e-05 2024-04-26T10:21:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.794575+0000", 2024-04-26T10:21:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2943999999999998e-05 2024-04-26T10:21:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:37588 5.0 5:02ecbf83:::benchmark_data_smithi052_19421_object37587:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.783366+0000", 2024-04-26T10:21:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 2.776175802, 2024-04-26T10:21:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011349655, 2024-04-26T10:21:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.653 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 37588 2024-04-26T10:21:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783366+0000", 2024-04-26T10:21:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783366+0000", 2024-04-26T10:21:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783365+0000", 2024-04-26T10:21:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783443+0000", 2024-04-26T10:21:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7922000000000004e-05 2024-04-26T10:21:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783460+0000", 2024-04-26T10:21:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6807999999999999e-05 2024-04-26T10:21:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783470+0000", 2024-04-26T10:21:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6169999999999996e-06 2024-04-26T10:21:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.788212+0000", 2024-04-26T10:21:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004741856 2024-04-26T10:21:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.788388+0000", 2024-04-26T10:21:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017666099999999999 2024-04-26T10:21:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.794598+0000", 2024-04-26T10:21:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0062094869999999996 2024-04-26T10:21:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.794647+0000", 2024-04-26T10:21:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9657000000000002e-05 2024-04-26T10:21:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.794716+0000", 2024-04-26T10:21:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8554999999999997e-05 2024-04-26T10:21:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:37589 5.8 5:1dd2bd76:::benchmark_data_smithi052_19421_object37588:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:48.783477+0000", 2024-04-26T10:21:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 2.7760653560000002, 2024-04-26T10:21:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012240964999999999, 2024-04-26T10:21:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.658 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 37589 2024-04-26T10:21:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783477+0000", 2024-04-26T10:21:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783477+0000", 2024-04-26T10:21:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783476+0000", 2024-04-26T10:21:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783513+0000", 2024-04-26T10:21:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6999000000000003e-05 2024-04-26T10:21:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783520+0000", 2024-04-26T10:21:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0740000000000004e-06 2024-04-26T10:21:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.783526+0000", 2024-04-26T10:21:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6420000000000004e-06 2024-04-26T10:21:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.790052+0000", 2024-04-26T10:21:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006525955 2024-04-26T10:21:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.790193+0000", 2024-04-26T10:21:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000140908 2024-04-26T10:21:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.795635+0000", 2024-04-26T10:21:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054424360000000001 2024-04-26T10:21:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.795677+0000", 2024-04-26T10:21:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2009999999999999e-05 2024-04-26T10:21:51.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:48.795718+0000", 2024-04-26T10:21:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.053e-05 2024-04-26T10:21:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:44559 5.b 5:dae3b3b1:::benchmark_data_smithi052_19421_object44558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.457431+0000", 2024-04-26T10:21:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.10211100100000001, 2024-04-26T10:21:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012161323999999999, 2024-04-26T10:21:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:51.663 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 44559 2024-04-26T10:21:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.457431+0000", 2024-04-26T10:21:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.457431+0000", 2024-04-26T10:21:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.457430+0000", 2024-04-26T10:21:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.457510+0000", 2024-04-26T10:21:51.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0662999999999997e-05 2024-04-26T10:21:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.457542+0000", 2024-04-26T10:21:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1371999999999997e-05 2024-04-26T10:21:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.457546+0000", 2024-04-26T10:21:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5750000000000002e-06 2024-04-26T10:21:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:51.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.458179+0000", 2024-04-26T10:21:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00063298300000000005 2024-04-26T10:21:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.458367+0000", 2024-04-26T10:21:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018767400000000001 2024-04-26T10:21:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.469436+0000", 2024-04-26T10:21:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011068652999999999 2024-04-26T10:21:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.469487+0000", 2024-04-26T10:21:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1127e-05 2024-04-26T10:21:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.469592+0000", 2024-04-26T10:21:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105519 2024-04-26T10:21:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:51.668 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:51.668 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:51.669 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:21:51.670 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 18 16 44955 44939 156.021 160.25 0.00438856 0.0064033 2024-04-26T10:21:51.671 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:51.664+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:51.671 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:51.771 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:51.769+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:51.800 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45365 5.d 5:bdebd63d:::benchmark_data_smithi052_19421_object45364:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.791648+0000", 2024-04-26T10:21:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0063104859999999997, 2024-04-26T10:21:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063303910000000003, 2024-04-26T10:21:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:51.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45365 2024-04-26T10:21:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.791648+0000", 2024-04-26T10:21:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.791648+0000", 2024-04-26T10:21:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.791647+0000", 2024-04-26T10:21:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:51.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.791726+0000", 2024-04-26T10:21:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8914999999999999e-05 2024-04-26T10:21:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.791735+0000", 2024-04-26T10:21:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7480000000000005e-06 2024-04-26T10:21:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.791743+0000", 2024-04-26T10:21:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4889999999999998e-06 2024-04-26T10:21:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.793408+0000", 2024-04-26T10:21:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016653989999999999 2024-04-26T10:21:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.793633+0000", 2024-04-26T10:21:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022492399999999999 2024-04-26T10:21:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.793833+0000", 2024-04-26T10:21:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000200254 2024-04-26T10:21:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45369 5.d 5:be754d6e:::benchmark_data_smithi052_19421_object45368:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.791971+0000", 2024-04-26T10:21:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0059872390000000001, 2024-04-26T10:21:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060704089999999997, 2024-04-26T10:21:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:51.805 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45369 2024-04-26T10:21:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.791971+0000", 2024-04-26T10:21:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.791971+0000", 2024-04-26T10:21:51.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.791970+0000", 2024-04-26T10:21:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792047+0000", 2024-04-26T10:21:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6564999999999996e-05 2024-04-26T10:21:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792053+0000", 2024-04-26T10:21:51.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0979999999999999e-06 2024-04-26T10:21:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792075+0000", 2024-04-26T10:21:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2374999999999998e-05 2024-04-26T10:21:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795482+0000", 2024-04-26T10:21:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034070070000000001 2024-04-26T10:21:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795605+0000", 2024-04-26T10:21:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012310399999999999 2024-04-26T10:21:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795739+0000", 2024-04-26T10:21:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013359900000000001 2024-04-26T10:21:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45370 5.5 5:adc2d145:::benchmark_data_smithi052_19421_object45369:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.792079+0000", 2024-04-26T10:21:51.809 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0058786489999999997, 2024-04-26T10:21:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060041620000000004, 2024-04-26T10:21:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45370 2024-04-26T10:21:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792079+0000", 2024-04-26T10:21:51.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792079+0000", 2024-04-26T10:21:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792079+0000", 2024-04-26T10:21:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:51.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792104+0000", 2024-04-26T10:21:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5055e-05 2024-04-26T10:21:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792109+0000", 2024-04-26T10:21:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5539999999999999e-06 2024-04-26T10:21:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792112+0000", 2024-04-26T10:21:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:21:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:51.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795468+0000", 2024-04-26T10:21:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033555360000000001 2024-04-26T10:21:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795545+0000", 2024-04-26T10:21:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6979999999999998e-05 2024-04-26T10:21:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45371 5.f 5:fcc71079:::benchmark_data_smithi052_19421_object45370:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.792202+0000", 2024-04-26T10:21:51.813 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0057556439999999999, 2024-04-26T10:21:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005918876, 2024-04-26T10:21:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45371 2024-04-26T10:21:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792202+0000", 2024-04-26T10:21:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792202+0000", 2024-04-26T10:21:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792202+0000", 2024-04-26T10:21:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792256+0000", 2024-04-26T10:21:51.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4125000000000001e-05 2024-04-26T10:21:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792264+0000", 2024-04-26T10:21:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9990000000000008e-06 2024-04-26T10:21:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792268+0000", 2024-04-26T10:21:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.844e-06 2024-04-26T10:21:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:51.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792317+0000", 2024-04-26T10:21:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8908e-05 2024-04-26T10:21:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792442+0000", 2024-04-26T10:21:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012519000000000001 2024-04-26T10:21:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792563+0000", 2024-04-26T10:21:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121054 2024-04-26T10:21:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:51.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795107+0000", 2024-04-26T10:21:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025443699999999998 2024-04-26T10:21:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45374 5.d 5:b9fc733c:::benchmark_data_smithi052_19421_object45373:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.792452+0000", 2024-04-26T10:21:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0055062879999999998, 2024-04-26T10:21:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057375830000000001, 2024-04-26T10:21:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:51.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45374 2024-04-26T10:21:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792452+0000", 2024-04-26T10:21:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792452+0000", 2024-04-26T10:21:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792451+0000", 2024-04-26T10:21:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792541+0000", 2024-04-26T10:21:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9380000000000001e-05 2024-04-26T10:21:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792549+0000", 2024-04-26T10:21:51.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0090000000000007e-06 2024-04-26T10:21:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.792555+0000", 2024-04-26T10:21:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8409999999999996e-06 2024-04-26T10:21:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.797099+0000", 2024-04-26T10:21:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045444530000000004 2024-04-26T10:21:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:51.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.797265+0000", 2024-04-26T10:21:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000166403 2024-04-26T10:21:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.797376+0000", 2024-04-26T10:21:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110742 2024-04-26T10:21:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45378 5.5 5.63580be5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:51.822 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.795364+0000", 2024-04-26T10:21:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0025943749999999999, 2024-04-26T10:21:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028987449999999999, 2024-04-26T10:21:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:21:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45378 2024-04-26T10:21:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795364+0000", 2024-04-26T10:21:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795364+0000", 2024-04-26T10:21:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795363+0000", 2024-04-26T10:21:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795483+0000", 2024-04-26T10:21:51.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012048999999999999 2024-04-26T10:21:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795494+0000", 2024-04-26T10:21:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0589e-05 2024-04-26T10:21:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795504+0000", 2024-04-26T10:21:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.533e-06 2024-04-26T10:21:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45380 5.7 5:e3e37d45:::benchmark_data_smithi052_19421_object45379:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.795512+0000", 2024-04-26T10:21:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0024462910000000002, 2024-04-26T10:21:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028007449999999999, 2024-04-26T10:21:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45380 2024-04-26T10:21:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:51.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795512+0000", 2024-04-26T10:21:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795512+0000", 2024-04-26T10:21:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795511+0000", 2024-04-26T10:21:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:51.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795546+0000", 2024-04-26T10:21:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5132000000000002e-05 2024-04-26T10:21:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795554+0000", 2024-04-26T10:21:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0509999999999997e-06 2024-04-26T10:21:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795560+0000", 2024-04-26T10:21:51.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.02e-06 2024-04-26T10:21:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795607+0000", 2024-04-26T10:21:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.651e-05 2024-04-26T10:21:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.795731+0000", 2024-04-26T10:21:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012473700000000001 2024-04-26T10:21:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45383 5.3 5:c720b8c5:::benchmark_data_smithi052_19421_object45382:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.797156+0000", 2024-04-26T10:21:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00080241899999999996, 2024-04-26T10:21:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012056090000000001, 2024-04-26T10:21:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45383 2024-04-26T10:21:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:51.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.797156+0000", 2024-04-26T10:21:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.797156+0000", 2024-04-26T10:21:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.797155+0000", 2024-04-26T10:21:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.797221+0000", 2024-04-26T10:21:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6462000000000002e-05 2024-04-26T10:21:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.797229+0000", 2024-04-26T10:21:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1119999999999996e-06 2024-04-26T10:21:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.797235+0000", 2024-04-26T10:21:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2750000000000003e-06 2024-04-26T10:21:51.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.797286+0000", 2024-04-26T10:21:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1391999999999999e-05 2024-04-26T10:21:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.797372+0000", 2024-04-26T10:21:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6170999999999999e-05 2024-04-26T10:21:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:45364 5.d e31/22)", 2024-04-26T10:21:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.798145+0000", 2024-04-26T10:21:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9998126, 2024-04-26T10:21:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024929200000000002, 2024-04-26T10:21:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:21:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798145+0000", 2024-04-26T10:21:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798145+0000", 2024-04-26T10:21:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798145+0000", 2024-04-26T10:21:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798152+0000", 2024-04-26T10:21:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.024e-06 2024-04-26T10:21:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798165+0000", 2024-04-26T10:21:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3386e-05 2024-04-26T10:21:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798172+0000", 2024-04-26T10:21:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8020000000000003e-06 2024-04-26T10:21:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:45371 5.f e31/22 ondisk, result = 0)", 2024-04-26T10:21:51.836 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.798207+0000", 2024-04-26T10:21:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9997511, 2024-04-26T10:21:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000212222, 2024-04-26T10:21:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798207+0000", 2024-04-26T10:21:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:51.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798207+0000", 2024-04-26T10:21:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798207+0000", 2024-04-26T10:21:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798209+0000", 2024-04-26T10:21:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4930000000000001e-06 2024-04-26T10:21:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798215+0000", 2024-04-26T10:21:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1319999999999999e-06 2024-04-26T10:21:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798220+0000", 2024-04-26T10:21:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2520000000000001e-06 2024-04-26T10:21:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798400+0000", 2024-04-26T10:21:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017988100000000001 2024-04-26T10:21:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798406+0000", 2024-04-26T10:21:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0639999999999999e-06 2024-04-26T10:21:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:45365 5.d e31/22)", 2024-04-26T10:21:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.798247+0000", 2024-04-26T10:21:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.999711, 2024-04-26T10:21:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000201425, 2024-04-26T10:21:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:51.840 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:21:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798247+0000", 2024-04-26T10:21:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798247+0000", 2024-04-26T10:21:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:51.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798247+0000", 2024-04-26T10:21:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798250+0000", 2024-04-26T10:21:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0989999999999999e-06 2024-04-26T10:21:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798256+0000", 2024-04-26T10:21:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0689999999999998e-06 2024-04-26T10:21:51.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.798261+0000", 2024-04-26T10:21:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3569999999999997e-06 2024-04-26T10:21:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45364 5.d 5:baf78a69:::benchmark_data_smithi052_19421_object45363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.791451+0000", 2024-04-26T10:21:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0065073650000000002, 2024-04-26T10:21:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070321130000000004, 2024-04-26T10:21:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:51.843 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45364 2024-04-26T10:21:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.791451+0000", 2024-04-26T10:21:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:51.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.791451+0000", 2024-04-26T10:21:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.791449+0000", 2024-04-26T10:21:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.791481+0000", 2024-04-26T10:21:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.205e-05 2024-04-26T10:21:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.791502+0000", 2024-04-26T10:21:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0642e-05 2024-04-26T10:21:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.791509+0000", 2024-04-26T10:21:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5180000000000001e-06 2024-04-26T10:21:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.791553+0000", 2024-04-26T10:21:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4765000000000003e-05 2024-04-26T10:21:51.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.791681+0000", 2024-04-26T10:21:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000127343 2024-04-26T10:21:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.791789+0000", 2024-04-26T10:21:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108649 2024-04-26T10:21:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:21:51.847 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 12 2024-04-26T10:21:51.848 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:51.849 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:51.872 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:51.869+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:51.973 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:51.969+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:51.982 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:51.982 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:21:51.982 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:21:51.982 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:21:51.983 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:51.994 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:52.073 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:52.068+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:52.174 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:52.168+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:52.175 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:52.175 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:21:52.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:21:52.175 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:52.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.176 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:52.176 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:52.176 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.932416951999997, 2024-04-26T10:21:52.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016304328, 2024-04-26T10:21:52.176 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.176 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.176 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.176 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:52.176 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:52.176 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 113 2024-04-26T10:21:52.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.176 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:52.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238899+0000", 2024-04-26T10:21:52.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238898+0000", 2024-04-26T10:21:52.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238920+0000", 2024-04-26T10:21:52.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2056999999999999e-05 2024-04-26T10:21:52.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238937+0000", 2024-04-26T10:21:52.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6415000000000001e-05 2024-04-26T10:21:52.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238948+0000", 2024-04-26T10:21:52.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.11e-05 2024-04-26T10:21:52.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250527+0000", 2024-04-26T10:21:52.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011578662 2024-04-26T10:21:52.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250627+0000", 2024-04-26T10:21:52.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100418 2024-04-26T10:21:52.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.250769+0000", 2024-04-26T10:21:52.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142111 2024-04-26T10:21:52.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253884+0000", 2024-04-26T10:21:52.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031148399999999998 2024-04-26T10:21:52.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254994+0000", 2024-04-26T10:21:52.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011095720000000001 2024-04-26T10:21:52.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255094+0000", 2024-04-26T10:21:52.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010092 2024-04-26T10:21:52.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255203+0000", 2024-04-26T10:21:52.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010906 2024-04-26T10:21:52.181 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.181 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.181 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.181 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:52.181 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:52.182 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.932359417000001, 2024-04-26T10:21:52.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016378984999999999, 2024-04-26T10:21:52.182 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.182 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.182 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.182 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:52.182 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:52.182 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 114 2024-04-26T10:21:52.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.182 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:52.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:52.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238956+0000", 2024-04-26T10:21:52.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238965+0000", 2024-04-26T10:21:52.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9469999999999992e-06 2024-04-26T10:21:52.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238993+0000", 2024-04-26T10:21:52.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8296000000000001e-05 2024-04-26T10:21:52.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239004+0000", 2024-04-26T10:21:52.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0482999999999999e-05 2024-04-26T10:21:52.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251532+0000", 2024-04-26T10:21:52.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01252852 2024-04-26T10:21:52.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251622+0000", 2024-04-26T10:21:52.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0044999999999996e-05 2024-04-26T10:21:52.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251763+0000", 2024-04-26T10:21:52.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140634 2024-04-26T10:21:52.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254035+0000", 2024-04-26T10:21:52.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022721320000000001 2024-04-26T10:21:52.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255220+0000", 2024-04-26T10:21:52.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011853059999999999 2024-04-26T10:21:52.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255301+0000", 2024-04-26T10:21:52.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0253999999999994e-05 2024-04-26T10:21:52.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255336+0000", 2024-04-26T10:21:52.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5098000000000002e-05 2024-04-26T10:21:52.187 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.187 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.187 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.187 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:52.187 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:52.187 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.932297468000002, 2024-04-26T10:21:52.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018452342, 2024-04-26T10:21:52.187 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.188 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.188 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.188 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:52.188 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:52.188 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115 2024-04-26T10:21:52.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.188 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:52.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:52.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239018+0000", 2024-04-26T10:21:52.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239152+0000", 2024-04-26T10:21:52.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414699999999999 2024-04-26T10:21:52.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239169+0000", 2024-04-26T10:21:52.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7013000000000001e-05 2024-04-26T10:21:52.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239190+0000", 2024-04-26T10:21:52.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1302999999999999e-05 2024-04-26T10:21:52.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252181+0000", 2024-04-26T10:21:52.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012990213 2024-04-26T10:21:52.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252411+0000", 2024-04-26T10:21:52.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023010199999999999 2024-04-26T10:21:52.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252687+0000", 2024-04-26T10:21:52.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000276063 2024-04-26T10:21:52.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254694+0000", 2024-04-26T10:21:52.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020072879999999999 2024-04-26T10:21:52.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257399+0000", 2024-04-26T10:21:52.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027051670000000001 2024-04-26T10:21:52.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257442+0000", 2024-04-26T10:21:52.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-04-26T10:21:52.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257471+0000", 2024-04-26T10:21:52.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.889e-05 2024-04-26T10:21:52.193 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.193 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.193 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.193 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:52.193 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:52.193 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.932116938999997, 2024-04-26T10:21:52.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018350615000000001, 2024-04-26T10:21:52.193 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.193 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.194 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:52.194 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:52.194 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116 2024-04-26T10:21:52.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.194 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:52.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:52.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239198+0000", 2024-04-26T10:21:52.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239213+0000", 2024-04-26T10:21:52.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4965e-05 2024-04-26T10:21:52.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239235+0000", 2024-04-26T10:21:52.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.156e-05 2024-04-26T10:21:52.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239243+0000", 2024-04-26T10:21:52.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9470000000000003e-06 2024-04-26T10:21:52.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253284+0000", 2024-04-26T10:21:52.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014041392999999999 2024-04-26T10:21:52.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253376+0000", 2024-04-26T10:21:52.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1198000000000003e-05 2024-04-26T10:21:52.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253508+0000", 2024-04-26T10:21:52.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013220199999999999 2024-04-26T10:21:52.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255474+0000", 2024-04-26T10:21:52.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019665590000000001 2024-04-26T10:21:52.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257480+0000", 2024-04-26T10:21:52.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00200599 2024-04-26T10:21:52.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257515+0000", 2024-04-26T10:21:52.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5126000000000002e-05 2024-04-26T10:21:52.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257550+0000", 2024-04-26T10:21:52.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4394000000000003e-05 2024-04-26T10:21:52.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.200 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.200 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.200 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:52.200 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:52.200 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.932063382999999, 2024-04-26T10:21:52.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018369330999999999, 2024-04-26T10:21:52.200 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.200 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.200 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:52.201 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:52.201 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117 2024-04-26T10:21:52.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.201 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:52.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:52.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239252+0000", 2024-04-26T10:21:52.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239267+0000", 2024-04-26T10:21:52.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4562999999999999e-05 2024-04-26T10:21:52.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239281+0000", 2024-04-26T10:21:52.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4e-05 2024-04-26T10:21:52.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239296+0000", 2024-04-26T10:21:52.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5492999999999999e-05 2024-04-26T10:21:52.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254076+0000", 2024-04-26T10:21:52.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014779814 2024-04-26T10:21:52.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254159+0000", 2024-04-26T10:21:52.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2923999999999994e-05 2024-04-26T10:21:52.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254279+0000", 2024-04-26T10:21:52.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011964300000000001 2024-04-26T10:21:52.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.256043+0000", 2024-04-26T10:21:52.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001764353 2024-04-26T10:21:52.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257559+0000", 2024-04-26T10:21:52.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015159189999999999 2024-04-26T10:21:52.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257597+0000", 2024-04-26T10:21:52.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8031999999999998e-05 2024-04-26T10:21:52.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257622+0000", 2024-04-26T10:21:52.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5213999999999999e-05 2024-04-26T10:21:52.205 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.205 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.206 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.206 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:52.206 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:52.206 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.719959007, 2024-04-26T10:21:52.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015980181999999999, 2024-04-26T10:21:52.206 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.206 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.206 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.206 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:52.206 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:52.206 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 141 2024-04-26T10:21:52.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.207 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:52.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451357+0000", 2024-04-26T10:21:52.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451356+0000", 2024-04-26T10:21:52.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451362+0000", 2024-04-26T10:21:52.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:21:52.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451371+0000", 2024-04-26T10:21:52.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1829999999999994e-06 2024-04-26T10:21:52.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.451377+0000", 2024-04-26T10:21:52.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7599999999999997e-06 2024-04-26T10:21:52.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463727+0000", 2024-04-26T10:21:52.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012349646000000001 2024-04-26T10:21:52.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463780+0000", 2024-04-26T10:21:52.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2645999999999997e-05 2024-04-26T10:21:52.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.463874+0000", 2024-04-26T10:21:52.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4097000000000004e-05 2024-04-26T10:21:52.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.466138+0000", 2024-04-26T10:21:52.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022642690000000002 2024-04-26T10:21:52.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467281+0000", 2024-04-26T10:21:52.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011428510000000001 2024-04-26T10:21:52.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467315+0000", 2024-04-26T10:21:52.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4032999999999998e-05 2024-04-26T10:21:52.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.467337+0000", 2024-04-26T10:21:52.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2444000000000001e-05 2024-04-26T10:21:52.211 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.211 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.211 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.212 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:52.212 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:52.212 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.521435789999998, 2024-04-26T10:21:52.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016970263999999999, 2024-04-26T10:21:52.212 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.212 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.212 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.212 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:52.212 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:52.212 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 164 2024-04-26T10:21:52.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.212 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:52.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:52.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649879+0000", 2024-04-26T10:21:52.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649963+0000", 2024-04-26T10:21:52.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4141999999999995e-05 2024-04-26T10:21:52.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649975+0000", 2024-04-26T10:21:52.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1416e-05 2024-04-26T10:21:52.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649983+0000", 2024-04-26T10:21:52.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8469999999999996e-06 2024-04-26T10:21:52.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662854+0000", 2024-04-26T10:21:52.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012871871999999999 2024-04-26T10:21:52.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662965+0000", 2024-04-26T10:21:52.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110413 2024-04-26T10:21:52.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.663109+0000", 2024-04-26T10:21:52.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144115 2024-04-26T10:21:52.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665992+0000", 2024-04-26T10:21:52.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028827340000000001 2024-04-26T10:21:52.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666784+0000", 2024-04-26T10:21:52.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00079253799999999997 2024-04-26T10:21:52.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666824+0000", 2024-04-26T10:21:52.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0139000000000003e-05 2024-04-26T10:21:52.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666851+0000", 2024-04-26T10:21:52.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6171999999999999e-05 2024-04-26T10:21:52.217 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.217 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.217 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.217 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:52.217 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:52.218 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.521324710000002, 2024-04-26T10:21:52.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019547338000000001, 2024-04-26T10:21:52.218 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.218 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:52.218 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:52.218 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165 2024-04-26T10:21:52.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.218 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:52.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:52.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:52.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649996+0000", 2024-04-26T10:21:52.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-04-26T10:21:52.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650021+0000", 2024-04-26T10:21:52.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5179999999999999e-05 2024-04-26T10:21:52.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650030+0000", 2024-04-26T10:21:52.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-04-26T10:21:52.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664733+0000", 2024-04-26T10:21:52.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014703097 2024-04-26T10:21:52.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664821+0000", 2024-04-26T10:21:52.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7918999999999996e-05 2024-04-26T10:21:52.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664953+0000", 2024-04-26T10:21:52.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132662 2024-04-26T10:21:52.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666776+0000", 2024-04-26T10:21:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018225509999999999 2024-04-26T10:21:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669480+0000", 2024-04-26T10:21:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00270382 2024-04-26T10:21:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669515+0000", 2024-04-26T10:21:52.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4885000000000002e-05 2024-04-26T10:21:52.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669539+0000", 2024-04-26T10:21:52.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4121000000000002e-05 2024-04-26T10:21:52.223 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.223 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.223 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.223 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:52.223 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:52.223 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.331801601000002, 2024-04-26T10:21:52.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017833541000000001, 2024-04-26T10:21:52.223 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.224 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.224 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.224 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:52.224 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:52.224 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185 2024-04-26T10:21:52.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.224 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:52.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:52.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839514+0000", 2024-04-26T10:21:52.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839612+0000", 2024-04-26T10:21:52.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7880999999999993e-05 2024-04-26T10:21:52.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839623+0000", 2024-04-26T10:21:52.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0917000000000001e-05 2024-04-26T10:21:52.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839632+0000", 2024-04-26T10:21:52.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0999999999999993e-06 2024-04-26T10:21:52.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850382+0000", 2024-04-26T10:21:52.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010750335 2024-04-26T10:21:52.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850502+0000", 2024-04-26T10:21:52.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120183 2024-04-26T10:21:52.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850685+0000", 2024-04-26T10:21:52.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000182442 2024-04-26T10:21:52.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854396+0000", 2024-04-26T10:21:52.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037114819999999999 2024-04-26T10:21:52.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857233+0000", 2024-04-26T10:21:52.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002836514 2024-04-26T10:21:52.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857300+0000", 2024-04-26T10:21:52.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6842999999999997e-05 2024-04-26T10:21:52.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857348+0000", 2024-04-26T10:21:52.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8504000000000002e-05 2024-04-26T10:21:52.229 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.229 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.229 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.229 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:52.229 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:52.229 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.331675250000004, 2024-04-26T10:21:52.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018757273000000001, 2024-04-26T10:21:52.229 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.229 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:52.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:52.230 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 186 2024-04-26T10:21:52.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.230 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:52.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:52.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839640+0000", 2024-04-26T10:21:52.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839646+0000", 2024-04-26T10:21:52.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:21:52.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839654+0000", 2024-04-26T10:21:52.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:21:52.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839661+0000", 2024-04-26T10:21:52.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.64e-06 2024-04-26T10:21:52.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852328+0000", 2024-04-26T10:21:52.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012667151 2024-04-26T10:21:52.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852538+0000", 2024-04-26T10:21:52.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020961100000000001 2024-04-26T10:21:52.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852945+0000", 2024-04-26T10:21:52.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040712099999999998 2024-04-26T10:21:52.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857372+0000", 2024-04-26T10:21:52.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044268049999999998 2024-04-26T10:21:52.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858321+0000", 2024-04-26T10:21:52.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094932999999999997 2024-04-26T10:21:52.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858367+0000", 2024-04-26T10:21:52.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5534000000000001e-05 2024-04-26T10:21:52.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858398+0000", 2024-04-26T10:21:52.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1562e-05 2024-04-26T10:21:52.234 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.234 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.234 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.235 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:52.235 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:52.235 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.331648084000001, 2024-04-26T10:21:52.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019669504000000001, 2024-04-26T10:21:52.235 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.235 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:52.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:52.235 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187 2024-04-26T10:21:52.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.235 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:52.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:52.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839667+0000", 2024-04-26T10:21:52.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839677+0000", 2024-04-26T10:21:52.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3270000000000007e-06 2024-04-26T10:21:52.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839685+0000", 2024-04-26T10:21:52.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2670000000000006e-06 2024-04-26T10:21:52.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839692+0000", 2024-04-26T10:21:52.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7129999999999999e-06 2024-04-26T10:21:52.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853685+0000", 2024-04-26T10:21:52.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013993716999999999 2024-04-26T10:21:52.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853876+0000", 2024-04-26T10:21:52.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019097100000000001 2024-04-26T10:21:52.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853989+0000", 2024-04-26T10:21:52.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011275199999999999 2024-04-26T10:21:52.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857377+0000", 2024-04-26T10:21:52.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033882489999999999 2024-04-26T10:21:52.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859222+0000", 2024-04-26T10:21:52.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001844233 2024-04-26T10:21:52.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859291+0000", 2024-04-26T10:21:52.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:21:52.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859338+0000", 2024-04-26T10:21:52.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6366000000000003e-05 2024-04-26T10:21:52.240 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.240 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.240 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.240 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.331617217999998, 2024-04-26T10:21:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019837468, 2024-04-26T10:21:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 188 2024-04-26T10:21:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839698+0000", 2024-04-26T10:21:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839829+0000", 2024-04-26T10:21:52.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013061099999999999 2024-04-26T10:21:52.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839853+0000", 2024-04-26T10:21:52.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3736000000000001e-05 2024-04-26T10:21:52.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839863+0000", 2024-04-26T10:21:52.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:52.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854869+0000", 2024-04-26T10:21:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015005978 2024-04-26T10:21:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854959+0000", 2024-04-26T10:21:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9468999999999993e-05 2024-04-26T10:21:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855114+0000", 2024-04-26T10:21:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015563799999999999 2024-04-26T10:21:52.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857386+0000", 2024-04-26T10:21:52.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002271852 2024-04-26T10:21:52.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859406+0000", 2024-04-26T10:21:52.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002019936 2024-04-26T10:21:52.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859461+0000", 2024-04-26T10:21:52.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4826e-05 2024-04-26T10:21:52.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859536+0000", 2024-04-26T10:21:52.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5566000000000001e-05 2024-04-26T10:21:52.246 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.246 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.246 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.246 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:52.246 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:52.246 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.331443354999998, 2024-04-26T10:21:52.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019826496999999998, 2024-04-26T10:21:52.247 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.247 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.247 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.247 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:52.247 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:52.247 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 189 2024-04-26T10:21:52.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.247 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:52.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:52.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839872+0000", 2024-04-26T10:21:52.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839882+0000", 2024-04-26T10:21:52.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:52.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839892+0000", 2024-04-26T10:21:52.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.217e-06 2024-04-26T10:21:52.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839900+0000", 2024-04-26T10:21:52.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5469999999999997e-06 2024-04-26T10:21:52.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855903+0000", 2024-04-26T10:21:52.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016002590000000001 2024-04-26T10:21:52.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856110+0000", 2024-04-26T10:21:52.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020711199999999999 2024-04-26T10:21:52.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856421+0000", 2024-04-26T10:21:52.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031128500000000001 2024-04-26T10:21:52.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857643+0000", 2024-04-26T10:21:52.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012215520000000001 2024-04-26T10:21:52.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859603+0000", 2024-04-26T10:21:52.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019600350000000002 2024-04-26T10:21:52.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859660+0000", 2024-04-26T10:21:52.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6857999999999997e-05 2024-04-26T10:21:52.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859699+0000", 2024-04-26T10:21:52.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9641999999999998e-05 2024-04-26T10:21:52.252 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.252 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.252 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.252 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15562 5.f 5:f08fe41e:::benchmark_data_smithi052_19421_object15561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:52.252 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:52.252 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.178427725000001, 2024-04-26T10:21:52.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015831088, 2024-04-26T10:21:52.252 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.252 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.252 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.252 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.252 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.253 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15562 2024-04-26T10:21:52.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.253 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:52.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:52.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992888+0000", 2024-04-26T10:21:52.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992927+0000", 2024-04-26T10:21:52.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9285000000000001e-05 2024-04-26T10:21:52.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992940+0000", 2024-04-26T10:21:52.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3040999999999999e-05 2024-04-26T10:21:52.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.992948+0000", 2024-04-26T10:21:52.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5850000000000002e-06 2024-04-26T10:21:52.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.997631+0000", 2024-04-26T10:21:52.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046834160000000001 2024-04-26T10:21:52.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.997851+0000", 2024-04-26T10:21:52.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000220416 2024-04-26T10:21:52.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.998105+0000", 2024-04-26T10:21:52.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025348599999999998 2024-04-26T10:21:52.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.004264+0000", 2024-04-26T10:21:52.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061588499999999996 2024-04-26T10:21:52.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008560+0000", 2024-04-26T10:21:52.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042958579999999996 2024-04-26T10:21:52.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008647+0000", 2024-04-26T10:21:52.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7609999999999996e-05 2024-04-26T10:21:52.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.008719+0000", 2024-04-26T10:21:52.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2336000000000007e-05 2024-04-26T10:21:52.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.257 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.257 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15564 5.f 5:f61b0088:::benchmark_data_smithi052_19421_object15563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:52.258 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:52.258 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.176925704, 2024-04-26T10:21:52.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017729826000000001, 2024-04-26T10:21:52.258 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.258 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.258 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15564 2024-04-26T10:21:52.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.258 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:52.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:52.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994389+0000", 2024-04-26T10:21:52.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994451+0000", 2024-04-26T10:21:52.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2032999999999994e-05 2024-04-26T10:21:52.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994477+0000", 2024-04-26T10:21:52.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5267999999999999e-05 2024-04-26T10:21:52.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994486+0000", 2024-04-26T10:21:52.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9420000000000001e-06 2024-04-26T10:21:52.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001578+0000", 2024-04-26T10:21:52.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070928110000000001 2024-04-26T10:21:52.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001748+0000", 2024-04-26T10:21:52.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016944099999999999 2024-04-26T10:21:52.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001914+0000", 2024-04-26T10:21:52.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000166546 2024-04-26T10:21:52.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.006488+0000", 2024-04-26T10:21:52.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045735460000000004 2024-04-26T10:21:52.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012034+0000", 2024-04-26T10:21:52.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055461449999999997 2024-04-26T10:21:52.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012085+0000", 2024-04-26T10:21:52.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1319000000000001e-05 2024-04-26T10:21:52.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012120+0000", 2024-04-26T10:21:52.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4904999999999999e-05 2024-04-26T10:21:52.263 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.263 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.263 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.263 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15567 5.f 5:f5b92a5d:::benchmark_data_smithi052_19421_object15566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:52.263 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.996077+0000", 2024-04-26T10:21:52.264 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.175239266, 2024-04-26T10:21:52.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016208895000000001, 2024-04-26T10:21:52.264 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.264 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.264 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.264 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.264 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.264 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15567 2024-04-26T10:21:52.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.264 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996077+0000", 2024-04-26T10:21:52.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996077+0000", 2024-04-26T10:21:52.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996076+0000", 2024-04-26T10:21:52.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:52.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996139+0000", 2024-04-26T10:21:52.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2929999999999995e-05 2024-04-26T10:21:52.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996155+0000", 2024-04-26T10:21:52.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6076e-05 2024-04-26T10:21:52.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.996163+0000", 2024-04-26T10:21:52.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0320000000000003e-06 2024-04-26T10:21:52.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.002727+0000", 2024-04-26T10:21:52.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065644240000000001 2024-04-26T10:21:52.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.002901+0000", 2024-04-26T10:21:52.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017414899999999999 2024-04-26T10:21:52.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.003080+0000", 2024-04-26T10:21:52.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017905199999999999 2024-04-26T10:21:52.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.009066+0000", 2024-04-26T10:21:52.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059855309999999997 2024-04-26T10:21:52.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012182+0000", 2024-04-26T10:21:52.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003116462 2024-04-26T10:21:52.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012230+0000", 2024-04-26T10:21:52.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7681e-05 2024-04-26T10:21:52.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012286+0000", 2024-04-26T10:21:52.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5763999999999997e-05 2024-04-26T10:21:52.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.269 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.269 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34427 5.7 5:ef7d83e6:::benchmark_data_smithi052_19421_object34426:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:52.269 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:21:52.269 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5392376959999998, 2024-04-26T10:21:52.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02010443, 2024-04-26T10:21:52.269 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.269 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.270 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34427 2024-04-26T10:21:52.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.270 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:21:52.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:21:52.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632077+0000", 2024-04-26T10:21:52.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:52.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632139+0000", 2024-04-26T10:21:52.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2527999999999995e-05 2024-04-26T10:21:52.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632153+0000", 2024-04-26T10:21:52.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3608000000000001e-05 2024-04-26T10:21:52.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632165+0000", 2024-04-26T10:21:52.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2592000000000001e-05 2024-04-26T10:21:52.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635907+0000", 2024-04-26T10:21:52.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037419789999999999 2024-04-26T10:21:52.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:21:52.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635919+0000", 2024-04-26T10:21:52.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1511999999999999e-05 2024-04-26T10:21:52.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641616+0000", 2024-04-26T10:21:52.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056974770000000003 2024-04-26T10:21:52.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641772+0000", 2024-04-26T10:21:52.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155799 2024-04-26T10:21:52.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.651965+0000", 2024-04-26T10:21:52.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010193254000000001 2024-04-26T10:21:52.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652039+0000", 2024-04-26T10:21:52.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4031999999999999e-05 2024-04-26T10:21:52.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652183+0000", 2024-04-26T10:21:52.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014342599999999999 2024-04-26T10:21:52.275 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.275 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.275 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.275 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45130 5.5 5:a1beca5f:::benchmark_data_smithi052_19421_object45129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:52.275 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:21:52.275 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48575407300000001, 2024-04-26T10:21:52.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019561411000000001, 2024-04-26T10:21:52.275 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.275 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.275 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.275 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.276 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.276 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45130 2024-04-26T10:21:52.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.276 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:21:52.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:21:52.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685561+0000", 2024-04-26T10:21:52.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685648+0000", 2024-04-26T10:21:52.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6552999999999996e-05 2024-04-26T10:21:52.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685657+0000", 2024-04-26T10:21:52.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1330000000000005e-06 2024-04-26T10:21:52.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685664+0000", 2024-04-26T10:21:52.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1069999999999999e-06 2024-04-26T10:21:52.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.691613+0000", 2024-04-26T10:21:52.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059489199999999999 2024-04-26T10:21:52.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.691779+0000", 2024-04-26T10:21:52.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016567700000000001 2024-04-26T10:21:52.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705021+0000", 2024-04-26T10:21:52.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013242812 2024-04-26T10:21:52.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705054+0000", 2024-04-26T10:21:52.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2709999999999997e-05 2024-04-26T10:21:52.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705123+0000", 2024-04-26T10:21:52.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9246999999999996e-05 2024-04-26T10:21:52.280 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.280 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.280 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.280 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45135 5.d 5:b49760b4:::benchmark_data_smithi052_19421_object45134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:52.280 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.687970+0000", 2024-04-26T10:21:52.280 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48334619000000001, 2024-04-26T10:21:52.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017262387000000001, 2024-04-26T10:21:52.280 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.280 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.281 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45135 2024-04-26T10:21:52.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.281 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.687970+0000", 2024-04-26T10:21:52.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.687970+0000", 2024-04-26T10:21:52.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.687969+0000", 2024-04-26T10:21:52.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.688062+0000", 2024-04-26T10:21:52.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2904000000000004e-05 2024-04-26T10:21:52.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.688076+0000", 2024-04-26T10:21:52.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4585e-05 2024-04-26T10:21:52.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.688084+0000", 2024-04-26T10:21:52.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4039999999999998e-06 2024-04-26T10:21:52.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.692001+0000", 2024-04-26T10:21:52.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039169699999999997 2024-04-26T10:21:52.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.692188+0000", 2024-04-26T10:21:52.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000186801 2024-04-26T10:21:52.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.692336+0000", 2024-04-26T10:21:52.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014784999999999999 2024-04-26T10:21:52.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.696839+0000", 2024-04-26T10:21:52.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045038329999999996 2024-04-26T10:21:52.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705139+0000", 2024-04-26T10:21:52.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083000910000000008 2024-04-26T10:21:52.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705200+0000", 2024-04-26T10:21:52.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0176000000000001e-05 2024-04-26T10:21:52.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705232+0000", 2024-04-26T10:21:52.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2691999999999998e-05 2024-04-26T10:21:52.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.285 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.286 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.286 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45141 5.5 5:a19de173:::benchmark_data_smithi052_19421_object45140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:52.286 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.690367+0000", 2024-04-26T10:21:52.286 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48094941899999999, 2024-04-26T10:21:52.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016983505999999999, 2024-04-26T10:21:52.286 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.286 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.286 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45141 2024-04-26T10:21:52.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.287 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690367+0000", 2024-04-26T10:21:52.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690367+0000", 2024-04-26T10:21:52.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690366+0000", 2024-04-26T10:21:52.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690419+0000", 2024-04-26T10:21:52.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3244e-05 2024-04-26T10:21:52.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690427+0000", 2024-04-26T10:21:52.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8699999999999992e-06 2024-04-26T10:21:52.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690432+0000", 2024-04-26T10:21:52.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1059999999999999e-06 2024-04-26T10:21:52.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.693916+0000", 2024-04-26T10:21:52.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003483955 2024-04-26T10:21:52.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.694104+0000", 2024-04-26T10:21:52.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187784 2024-04-26T10:21:52.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.707243+0000", 2024-04-26T10:21:52.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013139194 2024-04-26T10:21:52.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:52.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.707289+0000", 2024-04-26T10:21:52.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6119999999999999e-05 2024-04-26T10:21:52.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:52.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.707350+0000", 2024-04-26T10:21:52.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1094999999999997e-05 2024-04-26T10:21:52.290 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.290 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.290 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.290 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.291 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.291 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:52.292 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:52.288+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:52.292 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:52.393 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:52.388+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:52.417 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:52.418 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:52.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.418 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:46930 5.e 5:7f24b8b6:::benchmark_data_smithi052_19421_object46929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:52.418 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:52.410398+0000", 2024-04-26T10:21:52.418 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0076121039999999997, 2024-04-26T10:21:52.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00764367, 2024-04-26T10:21:52.418 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.418 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:52.418 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:52.418 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:52.418 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.419 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 46930 2024-04-26T10:21:52.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.419 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.410398+0000", 2024-04-26T10:21:52.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.410398+0000", 2024-04-26T10:21:52.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.410396+0000", 2024-04-26T10:21:52.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.410477+0000", 2024-04-26T10:21:52.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0648000000000004e-05 2024-04-26T10:21:52.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.410486+0000", 2024-04-26T10:21:52.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8899999999999996e-06 2024-04-26T10:21:52.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.410494+0000", 2024-04-26T10:21:52.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7770000000000002e-06 2024-04-26T10:21:52.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.415183+0000", 2024-04-26T10:21:52.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046887780000000002 2024-04-26T10:21:52.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.415271+0000", 2024-04-26T10:21:52.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8370999999999998e-05 2024-04-26T10:21:52.422 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.422 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.422 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.423 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:46935 5.4 5:2a002033:::benchmark_data_smithi052_19421_object46934:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:52.423 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:52.412263+0000", 2024-04-26T10:21:52.423 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0057464980000000001, 2024-04-26T10:21:52.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058345519999999998, 2024-04-26T10:21:52.423 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.423 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:52.423 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:52.423 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:52.423 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.423 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 46935 2024-04-26T10:21:52.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.423 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.412263+0000", 2024-04-26T10:21:52.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.412263+0000", 2024-04-26T10:21:52.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.412262+0000", 2024-04-26T10:21:52.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.412339+0000", 2024-04-26T10:21:52.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7291000000000002e-05 2024-04-26T10:21:52.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.412355+0000", 2024-04-26T10:21:52.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6093999999999999e-05 2024-04-26T10:21:52.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.412364+0000", 2024-04-26T10:21:52.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.541e-06 2024-04-26T10:21:52.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.414807+0000", 2024-04-26T10:21:52.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024428240000000001 2024-04-26T10:21:52.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.415029+0000", 2024-04-26T10:21:52.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022244100000000001 2024-04-26T10:21:52.426 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.426 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.426 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.427 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:46942 5.0 5:02853950:::benchmark_data_smithi052_19421_object46941:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:52.427 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:52.415876+0000", 2024-04-26T10:21:52.427 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0021335600000000001, 2024-04-26T10:21:52.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022638089999999999, 2024-04-26T10:21:52.427 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.427 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:52.427 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:52.427 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:52.427 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.427 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 46942 2024-04-26T10:21:52.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.427 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.415876+0000", 2024-04-26T10:21:52.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.415876+0000", 2024-04-26T10:21:52.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.415875+0000", 2024-04-26T10:21:52.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.415934+0000", 2024-04-26T10:21:52.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8847000000000001e-05 2024-04-26T10:21:52.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.415948+0000", 2024-04-26T10:21:52.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4561e-05 2024-04-26T10:21:52.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.415956+0000", 2024-04-26T10:21:52.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4320000000000002e-06 2024-04-26T10:21:52.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.416005+0000", 2024-04-26T10:21:52.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9271999999999999e-05 2024-04-26T10:21:52.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.416121+0000", 2024-04-26T10:21:52.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000116254 2024-04-26T10:21:52.430 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.430 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.430 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.431 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:46940 5.9 e31/22 5:9a541735:::benchmark_data_smithi052_19421_object46939:head v 31'2933, mlcod=31'2930)", 2024-04-26T10:21:52.431 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:52.416001+0000", 2024-04-26T10:21:52.431 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0020086259999999999, 2024-04-26T10:21:52.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021761129999999999, 2024-04-26T10:21:52.431 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.431 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:52.431 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.416001+0000", 2024-04-26T10:21:52.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.416001+0000", 2024-04-26T10:21:52.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.416000+0000", 2024-04-26T10:21:52.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.416076+0000", 2024-04-26T10:21:52.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5995000000000007e-05 2024-04-26T10:21:52.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.416090+0000", 2024-04-26T10:21:52.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3526000000000001e-05 2024-04-26T10:21:52.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.416097+0000", 2024-04-26T10:21:52.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7780000000000002e-06 2024-04-26T10:21:52.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.416134+0000", 2024-04-26T10:21:52.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7126000000000003e-05 2024-04-26T10:21:52.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.416161+0000", 2024-04-26T10:21:52.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7537000000000001e-05 2024-04-26T10:21:52.434 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.434 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.434 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.434 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.434 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:21:52.434 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 4 2024-04-26T10:21:52.434 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:52.435 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:52.493 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:52.489+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:52.566 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:52.566 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:21:52.566 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:21:52.566 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:21:52.566 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:52.578 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:52.614 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 19 16 47428 47412 155.943 154.562 0.00686548 0.00640686 2024-04-26T10:21:52.623 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:52.620+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:52.645 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T10:21:52.695 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:52.693+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:52.704 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:21:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:21:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.704 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.401148386999999, 2024-04-26T10:21:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018441564000000001, 2024-04-26T10:21:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301372+0000", 2024-04-26T10:21:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301399+0000", 2024-04-26T10:21:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7039999999999999e-05 2024-04-26T10:21:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301426+0000", 2024-04-26T10:21:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6381e-05 2024-04-26T10:21:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301480+0000", 2024-04-26T10:21:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3681000000000003e-05 2024-04-26T10:21:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310584+0000", 2024-04-26T10:21:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091042339999999992 2024-04-26T10:21:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:52.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310591+0000", 2024-04-26T10:21:52.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8190000000000003e-06 2024-04-26T10:21:52.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311503+0000", 2024-04-26T10:21:52.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000911983 2024-04-26T10:21:52.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311605+0000", 2024-04-26T10:21:52.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102619 2024-04-26T10:21:52.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:52.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311730+0000", 2024-04-26T10:21:52.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012474400000000001 2024-04-26T10:21:52.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:52.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317287+0000", 2024-04-26T10:21:52.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055571140000000002 2024-04-26T10:21:52.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319724+0000", 2024-04-26T10:21:52.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002437294 2024-04-26T10:21:52.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319776+0000", 2024-04-26T10:21:52.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1992e-05 2024-04-26T10:21:52.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319816+0000", 2024-04-26T10:21:52.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9709999999999998e-05 2024-04-26T10:21:52.710 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.710 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.710 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.711 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:52.711 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:52.711 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.395832521000003, 2024-04-26T10:21:52.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013786338, 2024-04-26T10:21:52.711 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.711 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.711 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:52.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306690+0000", 2024-04-26T10:21:52.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306689+0000", 2024-04-26T10:21:52.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306697+0000", 2024-04-26T10:21:52.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2420000000000003e-06 2024-04-26T10:21:52.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306725+0000", 2024-04-26T10:21:52.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8209e-05 2024-04-26T10:21:52.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306750+0000", 2024-04-26T10:21:52.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5432e-05 2024-04-26T10:21:52.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310622+0000", 2024-04-26T10:21:52.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003871738 2024-04-26T10:21:52.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting_for_map not empty", 2024-04-26T10:21:52.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310627+0000", 2024-04-26T10:21:52.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4890000000000003e-06 2024-04-26T10:21:52.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314030+0000", 2024-04-26T10:21:52.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003402094 2024-04-26T10:21:52.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314147+0000", 2024-04-26T10:21:52.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011776499999999999 2024-04-26T10:21:52.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:52.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314441+0000", 2024-04-26T10:21:52.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000293543 2024-04-26T10:21:52.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:52.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319422+0000", 2024-04-26T10:21:52.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004981096 2024-04-26T10:21:52.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320057+0000", 2024-04-26T10:21:52.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000635521 2024-04-26T10:21:52.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320110+0000", 2024-04-26T10:21:52.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2104999999999997e-05 2024-04-26T10:21:52.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320477+0000", 2024-04-26T10:21:52.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036709500000000001 2024-04-26T10:21:52.718 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.718 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.718 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.718 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:52.718 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:52.718 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.395739159999998, 2024-04-26T10:21:52.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013859405999999999, 2024-04-26T10:21:52.718 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.718 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.718 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:52.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:52.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306783+0000", 2024-04-26T10:21:52.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306788+0000", 2024-04-26T10:21:52.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3990000000000003e-06 2024-04-26T10:21:52.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306796+0000", 2024-04-26T10:21:52.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8820000000000001e-06 2024-04-26T10:21:52.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306803+0000", 2024-04-26T10:21:52.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6649999999999997e-06 2024-04-26T10:21:52.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314454+0000", 2024-04-26T10:21:52.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076508349999999999 2024-04-26T10:21:52.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314930+0000", 2024-04-26T10:21:52.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047624199999999998 2024-04-26T10:21:52.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:52.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315127+0000", 2024-04-26T10:21:52.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196751 2024-04-26T10:21:52.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:52.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320496+0000", 2024-04-26T10:21:52.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053690150000000004 2024-04-26T10:21:52.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320576+0000", 2024-04-26T10:21:52.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0327999999999994e-05 2024-04-26T10:21:52.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320611+0000", 2024-04-26T10:21:52.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-04-26T10:21:52.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320643+0000", 2024-04-26T10:21:52.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2474000000000001e-05 2024-04-26T10:21:52.723 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.723 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.723 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.723 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:52.723 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:52.723 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.395659989000002, 2024-04-26T10:21:52.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013889195, 2024-04-26T10:21:52.724 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.724 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.724 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:52.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:52.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306862+0000", 2024-04-26T10:21:52.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306867+0000", 2024-04-26T10:21:52.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5390000000000001e-06 2024-04-26T10:21:52.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306874+0000", 2024-04-26T10:21:52.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7549999999999997e-06 2024-04-26T10:21:52.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306887+0000", 2024-04-26T10:21:52.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.313e-05 2024-04-26T10:21:52.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315477+0000", 2024-04-26T10:21:52.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085902489999999995 2024-04-26T10:21:52.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315607+0000", 2024-04-26T10:21:52.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129789 2024-04-26T10:21:52.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:52.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315767+0000", 2024-04-26T10:21:52.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016052699999999999 2024-04-26T10:21:52.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:52.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320502+0000", 2024-04-26T10:21:52.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00473421 2024-04-26T10:21:52.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320691+0000", 2024-04-26T10:21:52.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018938900000000001 2024-04-26T10:21:52.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320721+0000", 2024-04-26T10:21:52.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9677000000000001e-05 2024-04-26T10:21:52.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320752+0000", 2024-04-26T10:21:52.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1486000000000003e-05 2024-04-26T10:21:52.730 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.730 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.730 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.730 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:52.730 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:52.730 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.395622070999998, 2024-04-26T10:21:52.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012590871, 2024-04-26T10:21:52.730 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.730 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.730 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:52.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306901+0000", 2024-04-26T10:21:52.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306900+0000", 2024-04-26T10:21:52.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306905+0000", 2024-04-26T10:21:52.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9010000000000002e-06 2024-04-26T10:21:52.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306911+0000", 2024-04-26T10:21:52.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6030000000000004e-06 2024-04-26T10:21:52.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306916+0000", 2024-04-26T10:21:52.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8539999999999996e-06 2024-04-26T10:21:52.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308529+0000", 2024-04-26T10:21:52.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001613258 2024-04-26T10:21:52.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:52.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.308537+0000", 2024-04-26T10:21:52.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1680000000000004e-06 2024-04-26T10:21:52.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311962+0000", 2024-04-26T10:21:52.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034247290000000001 2024-04-26T10:21:52.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.312092+0000", 2024-04-26T10:21:52.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013048700000000001 2024-04-26T10:21:52.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:52.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.312438+0000", 2024-04-26T10:21:52.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00034558700000000001 2024-04-26T10:21:52.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:52.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317984+0000", 2024-04-26T10:21:52.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005546067 2024-04-26T10:21:52.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:52.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319373+0000", 2024-04-26T10:21:52.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001389426 2024-04-26T10:21:52.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319438+0000", 2024-04-26T10:21:52.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4849000000000002e-05 2024-04-26T10:21:52.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319492+0000", 2024-04-26T10:21:52.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3554000000000003e-05 2024-04-26T10:21:52.737 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.737 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.737 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.738 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24863 5.e e27/22 5:70815639:::benchmark_data_smithi052_19421_object24862:head v 27'1571, mlcod=27'1569)", 2024-04-26T10:21:52.739 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:52.739 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 10.149217446, 2024-04-26T10:21:52.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014429724999999999, 2024-04-26T10:21:52.739 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.739 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.739 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:52.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:52.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553304+0000", 2024-04-26T10:21:52.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553377+0000", 2024-04-26T10:21:52.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3206000000000003e-05 2024-04-26T10:21:52.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553397+0000", 2024-04-26T10:21:52.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9366000000000001e-05 2024-04-26T10:21:52.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553407+0000", 2024-04-26T10:21:52.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0676000000000001e-05 2024-04-26T10:21:52.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553467+0000", 2024-04-26T10:21:52.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9735999999999999e-05 2024-04-26T10:21:52.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553486+0000", 2024-04-26T10:21:52.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8842e-05 2024-04-26T10:21:52.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.567649+0000", 2024-04-26T10:21:52.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01416272 2024-04-26T10:21:52.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.567735+0000", 2024-04-26T10:21:52.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6363e-05 2024-04-26T10:21:52.743 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.743 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.743 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.743 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29357 5.d e28/22 5:b70cb761:::benchmark_data_smithi052_19421_object29356:head v 28'1892, mlcod=28'1890)", 2024-04-26T10:21:52.743 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.378626+0000", 2024-04-26T10:21:52.743 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.3238971460000002, 2024-04-26T10:21:52.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012686653000000001, 2024-04-26T10:21:52.743 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.743 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.743 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378626+0000", 2024-04-26T10:21:52.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378626+0000", 2024-04-26T10:21:52.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378625+0000", 2024-04-26T10:21:52.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378673+0000", 2024-04-26T10:21:52.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8232000000000002e-05 2024-04-26T10:21:52.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378690+0000", 2024-04-26T10:21:52.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6983999999999999e-05 2024-04-26T10:21:52.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378699+0000", 2024-04-26T10:21:52.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3130000000000004e-06 2024-04-26T10:21:52.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378756+0000", 2024-04-26T10:21:52.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6437999999999997e-05 2024-04-26T10:21:52.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.378776+0000", 2024-04-26T10:21:52.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0523999999999999e-05 2024-04-26T10:21:52.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.391219+0000", 2024-04-26T10:21:52.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012442698 2024-04-26T10:21:52.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.391312+0000", 2024-04-26T10:21:52.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3436000000000005e-05 2024-04-26T10:21:52.747 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.747 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.747 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.747 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:29362 5.d e28/22 5:bea6ab30:::benchmark_data_smithi052_19421_object29361:head v 28'1893, mlcod=28'1890)", 2024-04-26T10:21:52.747 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:44.380758+0000", 2024-04-26T10:21:52.748 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.321764452, 2024-04-26T10:21:52.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013097510999999999, 2024-04-26T10:21:52.748 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.748 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.748 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380758+0000", 2024-04-26T10:21:52.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380758+0000", 2024-04-26T10:21:52.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380758+0000", 2024-04-26T10:21:52.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380807+0000", 2024-04-26T10:21:52.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8588000000000003e-05 2024-04-26T10:21:52.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380819+0000", 2024-04-26T10:21:52.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2432999999999999e-05 2024-04-26T10:21:52.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.380825+0000", 2024-04-26T10:21:52.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.874e-06 2024-04-26T10:21:52.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.381904+0000", 2024-04-26T10:21:52.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010787940000000001 2024-04-26T10:21:52.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.381923+0000", 2024-04-26T10:21:52.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9599999999999999e-05 2024-04-26T10:21:52.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.393810+0000", 2024-04-26T10:21:52.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011886346000000001 2024-04-26T10:21:52.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:44.393856+0000", 2024-04-26T10:21:52.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6372999999999998e-05 2024-04-26T10:21:52.752 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.753 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.753 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.754 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:44989 5.0 5:077e0e1f:::benchmark_data_smithi052_19421_object44988:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:52.754 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.626737+0000", 2024-04-26T10:21:52.754 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.075785835, 2024-04-26T10:21:52.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012653948999999999, 2024-04-26T10:21:52.754 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.754 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.754 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:52.754 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:52.754 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.754 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 44989 2024-04-26T10:21:52.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.754 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.626737+0000", 2024-04-26T10:21:52.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.626737+0000", 2024-04-26T10:21:52.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.626737+0000", 2024-04-26T10:21:52.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.626771+0000", 2024-04-26T10:21:52.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4379999999999999e-05 2024-04-26T10:21:52.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.626791+0000", 2024-04-26T10:21:52.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0279e-05 2024-04-26T10:21:52.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.626799+0000", 2024-04-26T10:21:52.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4730000000000003e-06 2024-04-26T10:21:52.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.633061+0000", 2024-04-26T10:21:52.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0062620050000000002 2024-04-26T10:21:52.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.633261+0000", 2024-04-26T10:21:52.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019984899999999999 2024-04-26T10:21:52.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:52.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.639107+0000", 2024-04-26T10:21:52.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058463680000000002 2024-04-26T10:21:52.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.639183+0000", 2024-04-26T10:21:52.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5982000000000005e-05 2024-04-26T10:21:52.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.639391+0000", 2024-04-26T10:21:52.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000208118 2024-04-26T10:21:52.758 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.758 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.759 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.759 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45088 5.a 5:590632b0:::benchmark_data_smithi052_19421_object45087:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:52.759 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.670144+0000", 2024-04-26T10:21:52.759 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0323791630000001, 2024-04-26T10:21:52.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013987737, 2024-04-26T10:21:52.759 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.759 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.759 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:52.759 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:52.759 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.759 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45088 2024-04-26T10:21:52.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.760 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670144+0000", 2024-04-26T10:21:52.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670144+0000", 2024-04-26T10:21:52.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670143+0000", 2024-04-26T10:21:52.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670207+0000", 2024-04-26T10:21:52.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.389e-05 2024-04-26T10:21:52.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670216+0000", 2024-04-26T10:21:52.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2730000000000008e-06 2024-04-26T10:21:52.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670221+0000", 2024-04-26T10:21:52.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5700000000000003e-06 2024-04-26T10:21:52.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.672563+0000", 2024-04-26T10:21:52.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0023421760000000001 2024-04-26T10:21:52.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.672728+0000", 2024-04-26T10:21:52.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000165112 2024-04-26T10:21:52.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:52.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.683924+0000", 2024-04-26T10:21:52.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011196330000000001 2024-04-26T10:21:52.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.684045+0000", 2024-04-26T10:21:52.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012078000000000001 2024-04-26T10:21:52.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.684131+0000", 2024-04-26T10:21:52.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6481000000000001e-05 2024-04-26T10:21:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45090 5.a 5:5255ea9c:::benchmark_data_smithi052_19421_object45089:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.670235+0000", 2024-04-26T10:21:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.032287688, 2024-04-26T10:21:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014033166999999999, 2024-04-26T10:21:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:52.764 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.765 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45090 2024-04-26T10:21:52.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.765 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670235+0000", 2024-04-26T10:21:52.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670235+0000", 2024-04-26T10:21:52.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670235+0000", 2024-04-26T10:21:52.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670300+0000", 2024-04-26T10:21:52.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5100999999999999e-05 2024-04-26T10:21:52.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670308+0000", 2024-04-26T10:21:52.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5259999999999993e-06 2024-04-26T10:21:52.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670313+0000", 2024-04-26T10:21:52.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.437e-06 2024-04-26T10:21:52.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.675953+0000", 2024-04-26T10:21:52.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056399220000000003 2024-04-26T10:21:52.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.676040+0000", 2024-04-26T10:21:52.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7012e-05 2024-04-26T10:21:52.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:52.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.684145+0000", 2024-04-26T10:21:52.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0081054620000000008 2024-04-26T10:21:52.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.684209+0000", 2024-04-26T10:21:52.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3765999999999999e-05 2024-04-26T10:21:52.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.684268+0000", 2024-04-26T10:21:52.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9537000000000003e-05 2024-04-26T10:21:52.769 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.769 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.769 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.769 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45174 5.0 5:032622a5:::benchmark_data_smithi052_19421_object45173:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:52.769 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.704887+0000", 2024-04-26T10:21:52.769 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.997635614, 2024-04-26T10:21:52.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016545051000000002, 2024-04-26T10:21:52.769 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.769 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.769 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:52.769 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:52.770 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.770 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45174 2024-04-26T10:21:52.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.770 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.704887+0000", 2024-04-26T10:21:52.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.704887+0000", 2024-04-26T10:21:52.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.704886+0000", 2024-04-26T10:21:52.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.704993+0000", 2024-04-26T10:21:52.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000106517 2024-04-26T10:21:52.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.705008+0000", 2024-04-26T10:21:52.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5534000000000001e-05 2024-04-26T10:21:52.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.705017+0000", 2024-04-26T10:21:52.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7979999999999995e-06 2024-04-26T10:21:52.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.705087+0000", 2024-04-26T10:21:52.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0426999999999995e-05 2024-04-26T10:21:52.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.705239+0000", 2024-04-26T10:21:52.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151154 2024-04-26T10:21:52.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:52.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721301+0000", 2024-04-26T10:21:52.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016062456999999999 2024-04-26T10:21:52.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721353+0000", 2024-04-26T10:21:52.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1892999999999999e-05 2024-04-26T10:21:52.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721432+0000", 2024-04-26T10:21:52.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9358999999999997e-05 2024-04-26T10:21:52.774 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.774 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.774 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.774 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45179 5.4 5:28762c42:::benchmark_data_smithi052_19421_object45178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:52.774 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.707356+0000", 2024-04-26T10:21:52.774 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.99516686099999996, 2024-04-26T10:21:52.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013159268, 2024-04-26T10:21:52.774 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.775 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.775 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:52.775 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:52.775 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.775 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45179 2024-04-26T10:21:52.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.775 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707356+0000", 2024-04-26T10:21:52.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707356+0000", 2024-04-26T10:21:52.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707355+0000", 2024-04-26T10:21:52.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707411+0000", 2024-04-26T10:21:52.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6078000000000001e-05 2024-04-26T10:21:52.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707425+0000", 2024-04-26T10:21:52.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3862999999999999e-05 2024-04-26T10:21:52.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707436+0000", 2024-04-26T10:21:52.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1134999999999999e-05 2024-04-26T10:21:52.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707485+0000", 2024-04-26T10:21:52.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8668999999999998e-05 2024-04-26T10:21:52.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707650+0000", 2024-04-26T10:21:52.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000165167 2024-04-26T10:21:52.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:52.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.720248+0000", 2024-04-26T10:21:52.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012598322 2024-04-26T10:21:52.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.720390+0000", 2024-04-26T10:21:52.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014154 2024-04-26T10:21:52.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.720515+0000", 2024-04-26T10:21:52.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012568 2024-04-26T10:21:52.779 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.779 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.779 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.779 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45181 5.8 5:13f857b3:::benchmark_data_smithi052_19421_object45180:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:52.779 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.707868+0000", 2024-04-26T10:21:52.779 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.99465447900000004, 2024-04-26T10:21:52.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015842045999999999, 2024-04-26T10:21:52.779 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.779 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.780 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:52.780 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:52.780 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.780 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45181 2024-04-26T10:21:52.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.780 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707868+0000", 2024-04-26T10:21:52.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707868+0000", 2024-04-26T10:21:52.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707868+0000", 2024-04-26T10:21:52.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707915+0000", 2024-04-26T10:21:52.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7101000000000002e-05 2024-04-26T10:21:52.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707925+0000", 2024-04-26T10:21:52.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7540000000000001e-06 2024-04-26T10:21:52.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707933+0000", 2024-04-26T10:21:52.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4849999999999992e-06 2024-04-26T10:21:52.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.708001+0000", 2024-04-26T10:21:52.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8262999999999993e-05 2024-04-26T10:21:52.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.708229+0000", 2024-04-26T10:21:52.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022797900000000001 2024-04-26T10:21:52.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:52.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723592+0000", 2024-04-26T10:21:52.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015363039 2024-04-26T10:21:52.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723645+0000", 2024-04-26T10:21:52.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2899000000000003e-05 2024-04-26T10:21:52.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723710+0000", 2024-04-26T10:21:52.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5166000000000006e-05 2024-04-26T10:21:52.784 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.784 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.784 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.784 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45188 5.8 5:1d98f307:::benchmark_data_smithi052_19421_object45187:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:52.784 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.709354+0000", 2024-04-26T10:21:52.784 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.99316926699999997, 2024-04-26T10:21:52.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01444054, 2024-04-26T10:21:52.784 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.784 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.784 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:52.785 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:52.785 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.785 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45188 2024-04-26T10:21:52.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.785 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709354+0000", 2024-04-26T10:21:52.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709354+0000", 2024-04-26T10:21:52.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709353+0000", 2024-04-26T10:21:52.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709392+0000", 2024-04-26T10:21:52.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9233000000000002e-05 2024-04-26T10:21:52.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709400+0000", 2024-04-26T10:21:52.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4719999999999998e-06 2024-04-26T10:21:52.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709406+0000", 2024-04-26T10:21:52.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7989999999999999e-06 2024-04-26T10:21:52.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.713808+0000", 2024-04-26T10:21:52.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044027090000000003 2024-04-26T10:21:52.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.713972+0000", 2024-04-26T10:21:52.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000163635 2024-04-26T10:21:52.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:52.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723718+0000", 2024-04-26T10:21:52.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097456680000000007 2024-04-26T10:21:52.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723747+0000", 2024-04-26T10:21:52.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9788e-05 2024-04-26T10:21:52.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723794+0000", 2024-04-26T10:21:52.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6826000000000002e-05 2024-04-26T10:21:52.789 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.789 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.789 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.789 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45189 5.8 5:1231b8d6:::benchmark_data_smithi052_19421_object45188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:52.789 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.709778+0000", 2024-04-26T10:21:52.789 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.99274501699999995, 2024-04-26T10:21:52.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014196112, 2024-04-26T10:21:52.789 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.789 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.789 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:52.790 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:52.790 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.790 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45189 2024-04-26T10:21:52.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.790 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709778+0000", 2024-04-26T10:21:52.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709778+0000", 2024-04-26T10:21:52.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709777+0000", 2024-04-26T10:21:52.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709901+0000", 2024-04-26T10:21:52.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000124218 2024-04-26T10:21:52.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709914+0000", 2024-04-26T10:21:52.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2680000000000001e-05 2024-04-26T10:21:52.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709923+0000", 2024-04-26T10:21:52.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8779999999999993e-06 2024-04-26T10:21:52.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.716807+0000", 2024-04-26T10:21:52.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0068834450000000002 2024-04-26T10:21:52.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.716964+0000", 2024-04-26T10:21:52.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015735799999999999 2024-04-26T10:21:52.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:52.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723875+0000", 2024-04-26T10:21:52.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069109849999999997 2024-04-26T10:21:52.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723908+0000", 2024-04-26T10:21:52.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2855000000000003e-05 2024-04-26T10:21:52.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723974+0000", 2024-04-26T10:21:52.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5820000000000003e-05 2024-04-26T10:21:52.794 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.794 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.794 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.795 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45191 5.8 5:13552580:::benchmark_data_smithi052_19421_object45190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:52.795 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.710022+0000", 2024-04-26T10:21:52.795 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.99250108999999997, 2024-04-26T10:21:52.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016838605999999999, 2024-04-26T10:21:52.795 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.795 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.795 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:52.795 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:52.795 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.795 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45191 2024-04-26T10:21:52.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.795 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710022+0000", 2024-04-26T10:21:52.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710022+0000", 2024-04-26T10:21:52.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710021+0000", 2024-04-26T10:21:52.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710087+0000", 2024-04-26T10:21:52.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6248000000000007e-05 2024-04-26T10:21:52.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710106+0000", 2024-04-26T10:21:52.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8357000000000001e-05 2024-04-26T10:21:52.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710110+0000", 2024-04-26T10:21:52.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3989999999999997e-06 2024-04-26T10:21:52.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.720365+0000", 2024-04-26T10:21:52.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010254733 2024-04-26T10:21:52.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.720471+0000", 2024-04-26T10:21:52.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000106 2024-04-26T10:21:52.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:52.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.726665+0000", 2024-04-26T10:21:52.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006194003 2024-04-26T10:21:52.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.726769+0000", 2024-04-26T10:21:52.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104131 2024-04-26T10:21:52.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.726860+0000", 2024-04-26T10:21:52.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1552999999999996e-05 2024-04-26T10:21:52.799 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.799 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.799 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.800 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45194 5.0 5:044a38f1:::benchmark_data_smithi052_19421_object45193:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:52.800 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.714358+0000", 2024-04-26T10:21:52.800 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.98816499899999999, 2024-04-26T10:21:52.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012595135, 2024-04-26T10:21:52.800 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.800 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.800 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:52.800 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:52.800 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.800 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45194 2024-04-26T10:21:52.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.800 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.714358+0000", 2024-04-26T10:21:52.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.714358+0000", 2024-04-26T10:21:52.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.714357+0000", 2024-04-26T10:21:52.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.714463+0000", 2024-04-26T10:21:52.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010626199999999999 2024-04-26T10:21:52.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.714474+0000", 2024-04-26T10:21:52.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1251e-05 2024-04-26T10:21:52.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.714481+0000", 2024-04-26T10:21:52.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6100000000000002e-06 2024-04-26T10:21:52.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721461+0000", 2024-04-26T10:21:52.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069803620000000004 2024-04-26T10:21:52.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721618+0000", 2024-04-26T10:21:52.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015669300000000001 2024-04-26T10:21:52.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:52.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.726872+0000", 2024-04-26T10:21:52.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052544760000000001 2024-04-26T10:21:52.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.726909+0000", 2024-04-26T10:21:52.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6980000000000002e-05 2024-04-26T10:21:52.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.726953+0000", 2024-04-26T10:21:52.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3596000000000001e-05 2024-04-26T10:21:52.804 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.804 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.804 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.805 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45197 5.a 5:57bdb4dc:::benchmark_data_smithi052_19421_object45196:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:52.805 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.720931+0000", 2024-04-26T10:21:52.805 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.98159140499999997, 2024-04-26T10:21:52.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014117672, 2024-04-26T10:21:52.805 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.805 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.805 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:52.805 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:52.805 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.805 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45197 2024-04-26T10:21:52.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.805 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.720931+0000", 2024-04-26T10:21:52.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.720931+0000", 2024-04-26T10:21:52.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.720931+0000", 2024-04-26T10:21:52.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721041+0000", 2024-04-26T10:21:52.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110288 2024-04-26T10:21:52.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721048+0000", 2024-04-26T10:21:52.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9190000000000002e-06 2024-04-26T10:21:52.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721052+0000", 2024-04-26T10:21:52.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5349999999999998e-06 2024-04-26T10:21:52.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723060+0000", 2024-04-26T10:21:52.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020076289999999999 2024-04-26T10:21:52.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723332+0000", 2024-04-26T10:21:52.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027210899999999998 2024-04-26T10:21:52.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:52.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.734970+0000", 2024-04-26T10:21:52.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011637922 2024-04-26T10:21:52.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.735003+0000", 2024-04-26T10:21:52.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2561000000000002e-05 2024-04-26T10:21:52.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.735049+0000", 2024-04-26T10:21:52.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6507e-05 2024-04-26T10:21:52.809 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.809 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.809 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.810 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:47235 5.e 5:7fbfb3de:::benchmark_data_smithi052_19421_object47234:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:52.810 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:52.534893+0000", 2024-04-26T10:21:52.810 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.16762976299999999, 2024-04-26T10:21:52.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014645362, 2024-04-26T10:21:52.810 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:52.810 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:52.810 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:52.810 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:52.810 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.810 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 47235 2024-04-26T10:21:52.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.810 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:52.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:52.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.534893+0000", 2024-04-26T10:21:52.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:52.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.534893+0000", 2024-04-26T10:21:52.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:52.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:52.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.534893+0000", 2024-04-26T10:21:52.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:52.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.534923+0000", 2024-04-26T10:21:52.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0380999999999999e-05 2024-04-26T10:21:52.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:52.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.534928+0000", 2024-04-26T10:21:52.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.685e-06 2024-04-26T10:21:52.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.534931+0000", 2024-04-26T10:21:52.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0079999999999998e-06 2024-04-26T10:21:52.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:52.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.540936+0000", 2024-04-26T10:21:52.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0060048519999999998 2024-04-26T10:21:52.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:52.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.541142+0000", 2024-04-26T10:21:52.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020689600000000001 2024-04-26T10:21:52.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:52.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.549456+0000", 2024-04-26T10:21:52.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083134420000000007 2024-04-26T10:21:52.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:52.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.549494+0000", 2024-04-26T10:21:52.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8164999999999998e-05 2024-04-26T10:21:52.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:52.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:52.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:52.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.549538+0000", 2024-04-26T10:21:52.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4384000000000001e-05 2024-04-26T10:21:52.814 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.814 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.814 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.814 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:52.815 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:52.815 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:52.816 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:52.813+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:52.816 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:52.916 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:52.913+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:52.945 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48181 5.f 5:f8720e23:::benchmark_data_smithi052_19421_object48180:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:52.938144+0000", 2024-04-26T10:21:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0056743289999999997, 2024-04-26T10:21:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005694345, 2024-04-26T10:21:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48181 2024-04-26T10:21:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938144+0000", 2024-04-26T10:21:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938144+0000", 2024-04-26T10:21:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938143+0000", 2024-04-26T10:21:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938174+0000", 2024-04-26T10:21:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0167000000000001e-05 2024-04-26T10:21:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938182+0000", 2024-04-26T10:21:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0129999999999993e-06 2024-04-26T10:21:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938188+0000", 2024-04-26T10:21:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9370000000000001e-06 2024-04-26T10:21:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938276+0000", 2024-04-26T10:21:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8228999999999998e-05 2024-04-26T10:21:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938413+0000", 2024-04-26T10:21:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013696699999999999 2024-04-26T10:21:52.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938566+0000", 2024-04-26T10:21:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015348900000000001 2024-04-26T10:21:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.942041+0000", 2024-04-26T10:21:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034747670000000001 2024-04-26T10:21:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.950 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48184 5.d 5:b8d346a3:::benchmark_data_smithi052_19421_object48183:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:52.940650+0000", 2024-04-26T10:21:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0031686040000000002, 2024-04-26T10:21:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032370340000000002, 2024-04-26T10:21:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.951 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48184 2024-04-26T10:21:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940650+0000", 2024-04-26T10:21:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940650+0000", 2024-04-26T10:21:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940649+0000", 2024-04-26T10:21:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940729+0000", 2024-04-26T10:21:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0562000000000006e-05 2024-04-26T10:21:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940743+0000", 2024-04-26T10:21:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4214e-05 2024-04-26T10:21:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940751+0000", 2024-04-26T10:21:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3610000000000003e-06 2024-04-26T10:21:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940818+0000", 2024-04-26T10:21:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7712999999999994e-05 2024-04-26T10:21:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940974+0000", 2024-04-26T10:21:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155236 2024-04-26T10:21:52.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.941149+0000", 2024-04-26T10:21:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017570699999999999 2024-04-26T10:21:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48185 5.2 5:4f731591:::benchmark_data_smithi052_19421_object48184:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:52.940772+0000", 2024-04-26T10:21:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003046801, 2024-04-26T10:21:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031542609999999998, 2024-04-26T10:21:52.955 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48185 2024-04-26T10:21:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940772+0000", 2024-04-26T10:21:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940772+0000", 2024-04-26T10:21:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940771+0000", 2024-04-26T10:21:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940816+0000", 2024-04-26T10:21:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5346999999999998e-05 2024-04-26T10:21:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940827+0000", 2024-04-26T10:21:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0879999999999999e-05 2024-04-26T10:21:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940834+0000", 2024-04-26T10:21:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4370000000000004e-06 2024-04-26T10:21:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940895+0000", 2024-04-26T10:21:52.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1582999999999996e-05 2024-04-26T10:21:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.941044+0000", 2024-04-26T10:21:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014919600000000001 2024-04-26T10:21:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.959 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48186 5.7 5:eb5dfd1a:::benchmark_data_smithi052_19421_object48185:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:52.940875+0000", 2024-04-26T10:21:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0029438369999999999, 2024-04-26T10:21:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003086559, 2024-04-26T10:21:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48186 2024-04-26T10:21:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940875+0000", 2024-04-26T10:21:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940875+0000", 2024-04-26T10:21:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940874+0000", 2024-04-26T10:21:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940925+0000", 2024-04-26T10:21:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0705000000000003e-05 2024-04-26T10:21:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940932+0000", 2024-04-26T10:21:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6380000000000004e-06 2024-04-26T10:21:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940939+0000", 2024-04-26T10:21:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2790000000000004e-06 2024-04-26T10:21:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.942039+0000", 2024-04-26T10:21:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011004610000000001 2024-04-26T10:21:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.942175+0000", 2024-04-26T10:21:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136119 2024-04-26T10:21:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.963 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48187 5.2 5:4d05d3c2:::benchmark_data_smithi052_19421_object48186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:52.940958+0000", 2024-04-26T10:21:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0028607620000000002, 2024-04-26T10:21:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030376790000000002, 2024-04-26T10:21:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48187 2024-04-26T10:21:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940958+0000", 2024-04-26T10:21:52.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940958+0000", 2024-04-26T10:21:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940957+0000", 2024-04-26T10:21:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.941011+0000", 2024-04-26T10:21:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4129999999999998e-05 2024-04-26T10:21:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.941026+0000", 2024-04-26T10:21:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4949e-05 2024-04-26T10:21:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.941032+0000", 2024-04-26T10:21:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7790000000000001e-06 2024-04-26T10:21:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.942912+0000", 2024-04-26T10:21:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018800220000000001 2024-04-26T10:21:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.943137+0000", 2024-04-26T10:21:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022548199999999999 2024-04-26T10:21:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.967 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48188 5.3 5:c532637f:::benchmark_data_smithi052_19421_object48187:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:52.941040+0000", 2024-04-26T10:21:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0027785190000000001, 2024-04-26T10:21:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029895329999999999, 2024-04-26T10:21:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48188 2024-04-26T10:21:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.941040+0000", 2024-04-26T10:21:52.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.941040+0000", 2024-04-26T10:21:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.941039+0000", 2024-04-26T10:21:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.941085+0000", 2024-04-26T10:21:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5846000000000001e-05 2024-04-26T10:21:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.941093+0000", 2024-04-26T10:21:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7139999999999993e-06 2024-04-26T10:21:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.941098+0000", 2024-04-26T10:21:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3669999999999996e-06 2024-04-26T10:21:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.941151+0000", 2024-04-26T10:21:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2927999999999999e-05 2024-04-26T10:21:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.941258+0000", 2024-04-26T10:21:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106644 2024-04-26T10:21:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48191 5.d 5:b5613e39:::benchmark_data_smithi052_19421_object48190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:52.942128+0000", 2024-04-26T10:21:52.971 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0016901240000000001, 2024-04-26T10:21:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001934741, 2024-04-26T10:21:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48191 2024-04-26T10:21:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.942128+0000", 2024-04-26T10:21:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.942128+0000", 2024-04-26T10:21:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.942127+0000", 2024-04-26T10:21:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.942229+0000", 2024-04-26T10:21:52.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010226999999999999 2024-04-26T10:21:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.942246+0000", 2024-04-26T10:21:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6382999999999999e-05 2024-04-26T10:21:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.942254+0000", 2024-04-26T10:21:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.858e-06 2024-04-26T10:21:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.943192+0000", 2024-04-26T10:21:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00093872300000000003 2024-04-26T10:21:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.943331+0000", 2024-04-26T10:21:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013867999999999999 2024-04-26T10:21:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.943474+0000", 2024-04-26T10:21:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014298800000000001 2024-04-26T10:21:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.975 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48192 5.3 5:c48f974c:::benchmark_data_smithi052_19421_object48191:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:52.943108+0000", 2024-04-26T10:21:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00071064800000000003, 2024-04-26T10:21:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00099441299999999998, 2024-04-26T10:21:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48192 2024-04-26T10:21:52.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.943108+0000", 2024-04-26T10:21:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.943108+0000", 2024-04-26T10:21:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.943107+0000", 2024-04-26T10:21:52.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.943183+0000", 2024-04-26T10:21:52.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5600999999999997e-05 2024-04-26T10:21:52.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.943192+0000", 2024-04-26T10:21:52.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7769999999999997e-06 2024-04-26T10:21:52.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.943199+0000", 2024-04-26T10:21:52.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8519999999999998e-06 2024-04-26T10:21:52.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.943233+0000", 2024-04-26T10:21:52.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3404000000000001e-05 2024-04-26T10:21:52.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.943372+0000", 2024-04-26T10:21:52.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013969399999999999 2024-04-26T10:21:52.979 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.979 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.980 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48175 5.9 5:9848d591:::benchmark_data_smithi052_19421_object48174:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:52.980 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:52.936562+0000", 2024-04-26T10:21:52.980 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0072565720000000002, 2024-04-26T10:21:52.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0075764990000000004, 2024-04-26T10:21:52.980 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.980 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:52.980 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.980 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.980 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.980 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48175 2024-04-26T10:21:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.936562+0000", 2024-04-26T10:21:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.936562+0000", 2024-04-26T10:21:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.936561+0000", 2024-04-26T10:21:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.936594+0000", 2024-04-26T10:21:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2335000000000001e-05 2024-04-26T10:21:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.936604+0000", 2024-04-26T10:21:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9550000000000004e-06 2024-04-26T10:21:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.936610+0000", 2024-04-26T10:21:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7050000000000002e-06 2024-04-26T10:21:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.936748+0000", 2024-04-26T10:21:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013749300000000001 2024-04-26T10:21:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.936880+0000", 2024-04-26T10:21:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013219999999999999 2024-04-26T10:21:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.936972+0000", 2024-04-26T10:21:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2467999999999996e-05 2024-04-26T10:21:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.941783+0000", 2024-04-26T10:21:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048100640000000002 2024-04-26T10:21:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.984 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48177 5.9 5:9bbff3c2:::benchmark_data_smithi052_19421_object48176:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:52.937216+0000", 2024-04-26T10:21:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0066028049999999998, 2024-04-26T10:21:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070437520000000003, 2024-04-26T10:21:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48177 2024-04-26T10:21:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.937216+0000", 2024-04-26T10:21:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.937216+0000", 2024-04-26T10:21:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.937215+0000", 2024-04-26T10:21:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.937277+0000", 2024-04-26T10:21:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1933000000000005e-05 2024-04-26T10:21:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.937313+0000", 2024-04-26T10:21:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6677000000000001e-05 2024-04-26T10:21:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.937321+0000", 2024-04-26T10:21:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6059999999999997e-06 2024-04-26T10:21:52.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938324+0000", 2024-04-26T10:21:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001002583 2024-04-26T10:21:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938447+0000", 2024-04-26T10:21:52.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012289899999999999 2024-04-26T10:21:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938574+0000", 2024-04-26T10:21:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000127453 2024-04-26T10:21:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.941868+0000", 2024-04-26T10:21:52.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00329444 2024-04-26T10:21:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48178 5.9 5:9f5532ab:::benchmark_data_smithi052_19421_object48177:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:52.937340+0000", 2024-04-26T10:21:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0064787070000000002, 2024-04-26T10:21:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070041519999999996, 2024-04-26T10:21:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.990 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48178 2024-04-26T10:21:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.937340+0000", 2024-04-26T10:21:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.937340+0000", 2024-04-26T10:21:52.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.937339+0000", 2024-04-26T10:21:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.937382+0000", 2024-04-26T10:21:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2957999999999998e-05 2024-04-26T10:21:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.937391+0000", 2024-04-26T10:21:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6829999999999997e-06 2024-04-26T10:21:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.937397+0000", 2024-04-26T10:21:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4849999999999997e-06 2024-04-26T10:21:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940121+0000", 2024-04-26T10:21:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027236420000000001 2024-04-26T10:21:52.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940277+0000", 2024-04-26T10:21:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155809 2024-04-26T10:21:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.940414+0000", 2024-04-26T10:21:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000137615 2024-04-26T10:21:52.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.942243+0000", 2024-04-26T10:21:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018288950000000001 2024-04-26T10:21:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48180 5.3 5:ce20672d:::benchmark_data_smithi052_19421_object48179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:52.938062+0000", 2024-04-26T10:21:52.995 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0057567599999999997, 2024-04-26T10:21:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006332402, 2024-04-26T10:21:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48180 2024-04-26T10:21:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938062+0000", 2024-04-26T10:21:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938062+0000", 2024-04-26T10:21:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938061+0000", 2024-04-26T10:21:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938106+0000", 2024-04-26T10:21:52.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5398000000000001e-05 2024-04-26T10:21:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938123+0000", 2024-04-26T10:21:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6337e-05 2024-04-26T10:21:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938130+0000", 2024-04-26T10:21:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7999999999999999e-06 2024-04-26T10:21:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:52.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938187+0000", 2024-04-26T10:21:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6400999999999998e-05 2024-04-26T10:21:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.938318+0000", 2024-04-26T10:21:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130903 2024-04-26T10:21:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:21:52.999 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 12 2024-04-26T10:21:52.999 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:53.001 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:53.017 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:53.013+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:53.119 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:53.117+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:53.130 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:53.130 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:21:53.130 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:21:53.130 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:21:53.130 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:53.144 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:53.222 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:53.216+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:53.318 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:21:53.323 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:53.321+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:53.330 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:53.330 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:21:53.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:21:53.331 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:53.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.331 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:53.331 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:53.331 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.088641461999998, 2024-04-26T10:21:53.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016378984999999999, 2024-04-26T10:21:53.331 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.331 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.331 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.331 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:53.331 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:53.331 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 114 2024-04-26T10:21:53.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.331 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:53.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238957+0000", 2024-04-26T10:21:53.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238956+0000", 2024-04-26T10:21:53.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:53.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238965+0000", 2024-04-26T10:21:53.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9469999999999992e-06 2024-04-26T10:21:53.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.238993+0000", 2024-04-26T10:21:53.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8296000000000001e-05 2024-04-26T10:21:53.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239004+0000", 2024-04-26T10:21:53.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0482999999999999e-05 2024-04-26T10:21:53.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251532+0000", 2024-04-26T10:21:53.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01252852 2024-04-26T10:21:53.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251622+0000", 2024-04-26T10:21:53.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0044999999999996e-05 2024-04-26T10:21:53.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:53.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.251763+0000", 2024-04-26T10:21:53.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140634 2024-04-26T10:21:53.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:53.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254035+0000", 2024-04-26T10:21:53.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022721320000000001 2024-04-26T10:21:53.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255220+0000", 2024-04-26T10:21:53.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011853059999999999 2024-04-26T10:21:53.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255301+0000", 2024-04-26T10:21:53.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0253999999999994e-05 2024-04-26T10:21:53.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255336+0000", 2024-04-26T10:21:53.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5098000000000002e-05 2024-04-26T10:21:53.336 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.336 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.336 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.337 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:53.337 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:53.337 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.088579512999999, 2024-04-26T10:21:53.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018452342, 2024-04-26T10:21:53.337 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.337 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.337 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.337 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:53.337 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:53.337 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115 2024-04-26T10:21:53.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.337 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:53.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:53.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239018+0000", 2024-04-26T10:21:53.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:53.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239152+0000", 2024-04-26T10:21:53.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414699999999999 2024-04-26T10:21:53.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239169+0000", 2024-04-26T10:21:53.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7013000000000001e-05 2024-04-26T10:21:53.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239190+0000", 2024-04-26T10:21:53.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1302999999999999e-05 2024-04-26T10:21:53.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252181+0000", 2024-04-26T10:21:53.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012990213 2024-04-26T10:21:53.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252411+0000", 2024-04-26T10:21:53.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023010199999999999 2024-04-26T10:21:53.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:53.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252687+0000", 2024-04-26T10:21:53.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000276063 2024-04-26T10:21:53.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:53.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254694+0000", 2024-04-26T10:21:53.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020072879999999999 2024-04-26T10:21:53.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257399+0000", 2024-04-26T10:21:53.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027051670000000001 2024-04-26T10:21:53.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257442+0000", 2024-04-26T10:21:53.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-04-26T10:21:53.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257471+0000", 2024-04-26T10:21:53.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.889e-05 2024-04-26T10:21:53.342 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.342 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.342 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.343 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:53.343 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:53.343 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.088398984000001, 2024-04-26T10:21:53.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018350615000000001, 2024-04-26T10:21:53.343 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.343 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:53.343 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:53.343 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116 2024-04-26T10:21:53.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.343 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:53.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:53.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239198+0000", 2024-04-26T10:21:53.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:53.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239213+0000", 2024-04-26T10:21:53.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4965e-05 2024-04-26T10:21:53.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239235+0000", 2024-04-26T10:21:53.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.156e-05 2024-04-26T10:21:53.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239243+0000", 2024-04-26T10:21:53.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9470000000000003e-06 2024-04-26T10:21:53.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253284+0000", 2024-04-26T10:21:53.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014041392999999999 2024-04-26T10:21:53.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253376+0000", 2024-04-26T10:21:53.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1198000000000003e-05 2024-04-26T10:21:53.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:53.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253508+0000", 2024-04-26T10:21:53.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013220199999999999 2024-04-26T10:21:53.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:53.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255474+0000", 2024-04-26T10:21:53.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019665590000000001 2024-04-26T10:21:53.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257480+0000", 2024-04-26T10:21:53.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00200599 2024-04-26T10:21:53.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257515+0000", 2024-04-26T10:21:53.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5126000000000002e-05 2024-04-26T10:21:53.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257550+0000", 2024-04-26T10:21:53.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4394000000000003e-05 2024-04-26T10:21:53.348 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.348 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.348 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.349 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:53.349 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:53.349 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.088345427999997, 2024-04-26T10:21:53.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018369330999999999, 2024-04-26T10:21:53.349 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.349 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.349 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.349 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:53.349 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:53.349 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117 2024-04-26T10:21:53.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.349 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:53.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:53.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239252+0000", 2024-04-26T10:21:53.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:53.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239267+0000", 2024-04-26T10:21:53.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4562999999999999e-05 2024-04-26T10:21:53.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239281+0000", 2024-04-26T10:21:53.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4e-05 2024-04-26T10:21:53.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239296+0000", 2024-04-26T10:21:53.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5492999999999999e-05 2024-04-26T10:21:53.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254076+0000", 2024-04-26T10:21:53.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014779814 2024-04-26T10:21:53.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254159+0000", 2024-04-26T10:21:53.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2923999999999994e-05 2024-04-26T10:21:53.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:53.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254279+0000", 2024-04-26T10:21:53.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011964300000000001 2024-04-26T10:21:53.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:53.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.256043+0000", 2024-04-26T10:21:53.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001764353 2024-04-26T10:21:53.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257559+0000", 2024-04-26T10:21:53.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015159189999999999 2024-04-26T10:21:53.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257597+0000", 2024-04-26T10:21:53.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8031999999999998e-05 2024-04-26T10:21:53.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257622+0000", 2024-04-26T10:21:53.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5213999999999999e-05 2024-04-26T10:21:53.354 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.354 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.354 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.355 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:53.355 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:53.355 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.677717835000003, 2024-04-26T10:21:53.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016970263999999999, 2024-04-26T10:21:53.355 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.355 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.355 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.355 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:53.355 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:53.355 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 164 2024-04-26T10:21:53.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.355 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:53.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:53.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649879+0000", 2024-04-26T10:21:53.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:53.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649963+0000", 2024-04-26T10:21:53.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4141999999999995e-05 2024-04-26T10:21:53.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649975+0000", 2024-04-26T10:21:53.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1416e-05 2024-04-26T10:21:53.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649983+0000", 2024-04-26T10:21:53.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8469999999999996e-06 2024-04-26T10:21:53.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662854+0000", 2024-04-26T10:21:53.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012871871999999999 2024-04-26T10:21:53.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662965+0000", 2024-04-26T10:21:53.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110413 2024-04-26T10:21:53.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:53.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.663109+0000", 2024-04-26T10:21:53.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144115 2024-04-26T10:21:53.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:53.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665992+0000", 2024-04-26T10:21:53.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028827340000000001 2024-04-26T10:21:53.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666784+0000", 2024-04-26T10:21:53.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00079253799999999997 2024-04-26T10:21:53.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666824+0000", 2024-04-26T10:21:53.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0139000000000003e-05 2024-04-26T10:21:53.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666851+0000", 2024-04-26T10:21:53.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6171999999999999e-05 2024-04-26T10:21:53.360 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.360 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.360 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.360 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:53.360 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:53.361 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.677606754999999, 2024-04-26T10:21:53.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019547338000000001, 2024-04-26T10:21:53.361 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.361 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:53.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:53.361 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165 2024-04-26T10:21:53.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.361 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:53.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:53.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:53.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:53.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649996+0000", 2024-04-26T10:21:53.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-04-26T10:21:53.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650021+0000", 2024-04-26T10:21:53.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5179999999999999e-05 2024-04-26T10:21:53.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650030+0000", 2024-04-26T10:21:53.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-04-26T10:21:53.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664733+0000", 2024-04-26T10:21:53.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014703097 2024-04-26T10:21:53.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664821+0000", 2024-04-26T10:21:53.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7918999999999996e-05 2024-04-26T10:21:53.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:53.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664953+0000", 2024-04-26T10:21:53.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132662 2024-04-26T10:21:53.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:53.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666776+0000", 2024-04-26T10:21:53.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018225509999999999 2024-04-26T10:21:53.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669480+0000", 2024-04-26T10:21:53.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00270382 2024-04-26T10:21:53.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669515+0000", 2024-04-26T10:21:53.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4885000000000002e-05 2024-04-26T10:21:53.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669539+0000", 2024-04-26T10:21:53.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4121000000000002e-05 2024-04-26T10:21:53.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.368 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.368 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:53.369 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:53.369 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.488083646, 2024-04-26T10:21:53.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017833541000000001, 2024-04-26T10:21:53.369 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.369 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:53.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:53.369 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185 2024-04-26T10:21:53.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.369 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:53.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:53.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839514+0000", 2024-04-26T10:21:53.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:53.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839612+0000", 2024-04-26T10:21:53.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7880999999999993e-05 2024-04-26T10:21:53.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839623+0000", 2024-04-26T10:21:53.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0917000000000001e-05 2024-04-26T10:21:53.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839632+0000", 2024-04-26T10:21:53.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0999999999999993e-06 2024-04-26T10:21:53.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850382+0000", 2024-04-26T10:21:53.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010750335 2024-04-26T10:21:53.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850502+0000", 2024-04-26T10:21:53.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120183 2024-04-26T10:21:53.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:53.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850685+0000", 2024-04-26T10:21:53.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000182442 2024-04-26T10:21:53.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854396+0000", 2024-04-26T10:21:53.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037114819999999999 2024-04-26T10:21:53.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:53.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857233+0000", 2024-04-26T10:21:53.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002836514 2024-04-26T10:21:53.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857300+0000", 2024-04-26T10:21:53.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6842999999999997e-05 2024-04-26T10:21:53.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857348+0000", 2024-04-26T10:21:53.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8504000000000002e-05 2024-04-26T10:21:53.374 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.374 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.374 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.375 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:53.375 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:53.375 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.487957295000001, 2024-04-26T10:21:53.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018757273000000001, 2024-04-26T10:21:53.375 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.375 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.375 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.375 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:53.375 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:53.375 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 186 2024-04-26T10:21:53.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.375 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:53.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:53.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839640+0000", 2024-04-26T10:21:53.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:53.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839646+0000", 2024-04-26T10:21:53.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:21:53.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839654+0000", 2024-04-26T10:21:53.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:21:53.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839661+0000", 2024-04-26T10:21:53.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.64e-06 2024-04-26T10:21:53.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852328+0000", 2024-04-26T10:21:53.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012667151 2024-04-26T10:21:53.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852538+0000", 2024-04-26T10:21:53.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020961100000000001 2024-04-26T10:21:53.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:53.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852945+0000", 2024-04-26T10:21:53.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040712099999999998 2024-04-26T10:21:53.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857372+0000", 2024-04-26T10:21:53.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044268049999999998 2024-04-26T10:21:53.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:53.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858321+0000", 2024-04-26T10:21:53.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094932999999999997 2024-04-26T10:21:53.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858367+0000", 2024-04-26T10:21:53.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5534000000000001e-05 2024-04-26T10:21:53.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858398+0000", 2024-04-26T10:21:53.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1562e-05 2024-04-26T10:21:53.380 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.380 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.380 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.380 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:53.380 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:53.381 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.487930128999999, 2024-04-26T10:21:53.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019669504000000001, 2024-04-26T10:21:53.381 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.381 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:53.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:53.381 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187 2024-04-26T10:21:53.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.381 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:53.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:53.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839667+0000", 2024-04-26T10:21:53.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:53.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839677+0000", 2024-04-26T10:21:53.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3270000000000007e-06 2024-04-26T10:21:53.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839685+0000", 2024-04-26T10:21:53.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2670000000000006e-06 2024-04-26T10:21:53.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839692+0000", 2024-04-26T10:21:53.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7129999999999999e-06 2024-04-26T10:21:53.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853685+0000", 2024-04-26T10:21:53.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013993716999999999 2024-04-26T10:21:53.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853876+0000", 2024-04-26T10:21:53.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019097100000000001 2024-04-26T10:21:53.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:53.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853989+0000", 2024-04-26T10:21:53.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011275199999999999 2024-04-26T10:21:53.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857377+0000", 2024-04-26T10:21:53.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033882489999999999 2024-04-26T10:21:53.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:53.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859222+0000", 2024-04-26T10:21:53.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001844233 2024-04-26T10:21:53.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859291+0000", 2024-04-26T10:21:53.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:21:53.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859338+0000", 2024-04-26T10:21:53.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6366000000000003e-05 2024-04-26T10:21:53.386 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.386 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.386 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.386 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:53.386 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:53.386 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.487899263000003, 2024-04-26T10:21:53.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019837468, 2024-04-26T10:21:53.387 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.387 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.387 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.387 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:53.387 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:53.387 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 188 2024-04-26T10:21:53.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.387 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:53.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:53.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839698+0000", 2024-04-26T10:21:53.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:53.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839829+0000", 2024-04-26T10:21:53.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013061099999999999 2024-04-26T10:21:53.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839853+0000", 2024-04-26T10:21:53.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3736000000000001e-05 2024-04-26T10:21:53.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839863+0000", 2024-04-26T10:21:53.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:53.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854869+0000", 2024-04-26T10:21:53.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015005978 2024-04-26T10:21:53.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854959+0000", 2024-04-26T10:21:53.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9468999999999993e-05 2024-04-26T10:21:53.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:53.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855114+0000", 2024-04-26T10:21:53.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015563799999999999 2024-04-26T10:21:53.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857386+0000", 2024-04-26T10:21:53.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002271852 2024-04-26T10:21:53.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:53.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859406+0000", 2024-04-26T10:21:53.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002019936 2024-04-26T10:21:53.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859461+0000", 2024-04-26T10:21:53.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4826e-05 2024-04-26T10:21:53.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859536+0000", 2024-04-26T10:21:53.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5566000000000001e-05 2024-04-26T10:21:53.392 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.392 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.392 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.392 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:53.392 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:53.392 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 50.487725400000002, 2024-04-26T10:21:53.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019826496999999998, 2024-04-26T10:21:53.392 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.393 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.393 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.393 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:53.393 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:53.393 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 189 2024-04-26T10:21:53.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.393 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:53.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:53.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839872+0000", 2024-04-26T10:21:53.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:53.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839882+0000", 2024-04-26T10:21:53.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:53.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839892+0000", 2024-04-26T10:21:53.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.217e-06 2024-04-26T10:21:53.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839900+0000", 2024-04-26T10:21:53.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5469999999999997e-06 2024-04-26T10:21:53.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855903+0000", 2024-04-26T10:21:53.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016002590000000001 2024-04-26T10:21:53.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856110+0000", 2024-04-26T10:21:53.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020711199999999999 2024-04-26T10:21:53.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:53.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856421+0000", 2024-04-26T10:21:53.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031128500000000001 2024-04-26T10:21:53.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857643+0000", 2024-04-26T10:21:53.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012215520000000001 2024-04-26T10:21:53.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:53.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859603+0000", 2024-04-26T10:21:53.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019600350000000002 2024-04-26T10:21:53.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859660+0000", 2024-04-26T10:21:53.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6857999999999997e-05 2024-04-26T10:21:53.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859699+0000", 2024-04-26T10:21:53.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9641999999999998e-05 2024-04-26T10:21:53.398 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.398 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.398 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.398 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15564 5.f 5:f61b0088:::benchmark_data_smithi052_19421_object15563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:53.398 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:53.398 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.333207749, 2024-04-26T10:21:53.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017729826000000001, 2024-04-26T10:21:53.398 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.399 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.399 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.399 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:53.399 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:53.399 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15564 2024-04-26T10:21:53.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.399 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:53.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:53.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994389+0000", 2024-04-26T10:21:53.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:53.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994451+0000", 2024-04-26T10:21:53.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2032999999999994e-05 2024-04-26T10:21:53.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994477+0000", 2024-04-26T10:21:53.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5267999999999999e-05 2024-04-26T10:21:53.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994486+0000", 2024-04-26T10:21:53.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9420000000000001e-06 2024-04-26T10:21:53.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001578+0000", 2024-04-26T10:21:53.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070928110000000001 2024-04-26T10:21:53.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001748+0000", 2024-04-26T10:21:53.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016944099999999999 2024-04-26T10:21:53.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:53.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001914+0000", 2024-04-26T10:21:53.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000166546 2024-04-26T10:21:53.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.006488+0000", 2024-04-26T10:21:53.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045735460000000004 2024-04-26T10:21:53.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:53.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012034+0000", 2024-04-26T10:21:53.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055461449999999997 2024-04-26T10:21:53.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012085+0000", 2024-04-26T10:21:53.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1319000000000001e-05 2024-04-26T10:21:53.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012120+0000", 2024-04-26T10:21:53.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4904999999999999e-05 2024-04-26T10:21:53.404 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.404 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.404 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.404 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34427 5.7 5:ef7d83e6:::benchmark_data_smithi052_19421_object34426:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:53.404 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:21:53.404 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.695519741, 2024-04-26T10:21:53.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02010443, 2024-04-26T10:21:53.404 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.404 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.404 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.404 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:53.405 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:53.405 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34427 2024-04-26T10:21:53.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.405 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:21:53.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:21:53.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632077+0000", 2024-04-26T10:21:53.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:53.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632139+0000", 2024-04-26T10:21:53.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2527999999999995e-05 2024-04-26T10:21:53.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632153+0000", 2024-04-26T10:21:53.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3608000000000001e-05 2024-04-26T10:21:53.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632165+0000", 2024-04-26T10:21:53.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2592000000000001e-05 2024-04-26T10:21:53.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635907+0000", 2024-04-26T10:21:53.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037419789999999999 2024-04-26T10:21:53.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:21:53.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635919+0000", 2024-04-26T10:21:53.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1511999999999999e-05 2024-04-26T10:21:53.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641616+0000", 2024-04-26T10:21:53.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056974770000000003 2024-04-26T10:21:53.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641772+0000", 2024-04-26T10:21:53.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155799 2024-04-26T10:21:53.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.651965+0000", 2024-04-26T10:21:53.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010193254000000001 2024-04-26T10:21:53.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652039+0000", 2024-04-26T10:21:53.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4031999999999999e-05 2024-04-26T10:21:53.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652183+0000", 2024-04-26T10:21:53.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014342599999999999 2024-04-26T10:21:53.410 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.410 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.410 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.410 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45130 5.5 5:a1beca5f:::benchmark_data_smithi052_19421_object45129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:53.410 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:21:53.410 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.642036118, 2024-04-26T10:21:53.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019561411000000001, 2024-04-26T10:21:53.410 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.410 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.410 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.411 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:53.411 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:53.411 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45130 2024-04-26T10:21:53.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.411 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:21:53.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:21:53.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685561+0000", 2024-04-26T10:21:53.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:53.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685648+0000", 2024-04-26T10:21:53.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6552999999999996e-05 2024-04-26T10:21:53.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685657+0000", 2024-04-26T10:21:53.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1330000000000005e-06 2024-04-26T10:21:53.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685664+0000", 2024-04-26T10:21:53.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1069999999999999e-06 2024-04-26T10:21:53.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.691613+0000", 2024-04-26T10:21:53.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059489199999999999 2024-04-26T10:21:53.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.691779+0000", 2024-04-26T10:21:53.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016567700000000001 2024-04-26T10:21:53.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705021+0000", 2024-04-26T10:21:53.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013242812 2024-04-26T10:21:53.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705054+0000", 2024-04-26T10:21:53.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2709999999999997e-05 2024-04-26T10:21:53.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705123+0000", 2024-04-26T10:21:53.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9246999999999996e-05 2024-04-26T10:21:53.415 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.415 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.415 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.415 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45135 5.d 5:b49760b4:::benchmark_data_smithi052_19421_object45134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:53.415 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.687970+0000", 2024-04-26T10:21:53.415 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.639628235, 2024-04-26T10:21:53.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017262387000000001, 2024-04-26T10:21:53.416 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.416 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.416 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:53.417 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:53.417 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45135 2024-04-26T10:21:53.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.417 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.687970+0000", 2024-04-26T10:21:53.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.687970+0000", 2024-04-26T10:21:53.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.687969+0000", 2024-04-26T10:21:53.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:53.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.688062+0000", 2024-04-26T10:21:53.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2904000000000004e-05 2024-04-26T10:21:53.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.688076+0000", 2024-04-26T10:21:53.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4585e-05 2024-04-26T10:21:53.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.688084+0000", 2024-04-26T10:21:53.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4039999999999998e-06 2024-04-26T10:21:53.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.692001+0000", 2024-04-26T10:21:53.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039169699999999997 2024-04-26T10:21:53.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.692188+0000", 2024-04-26T10:21:53.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000186801 2024-04-26T10:21:53.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:53.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.692336+0000", 2024-04-26T10:21:53.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014784999999999999 2024-04-26T10:21:53.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:53.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.696839+0000", 2024-04-26T10:21:53.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045038329999999996 2024-04-26T10:21:53.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705139+0000", 2024-04-26T10:21:53.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083000910000000008 2024-04-26T10:21:53.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705200+0000", 2024-04-26T10:21:53.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0176000000000001e-05 2024-04-26T10:21:53.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705232+0000", 2024-04-26T10:21:53.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2691999999999998e-05 2024-04-26T10:21:53.422 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.422 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.422 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.423 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45141 5.5 5:a19de173:::benchmark_data_smithi052_19421_object45140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:53.423 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.690367+0000", 2024-04-26T10:21:53.423 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.6372314640000001, 2024-04-26T10:21:53.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016983505999999999, 2024-04-26T10:21:53.423 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.423 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:53.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:53.423 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45141 2024-04-26T10:21:53.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.423 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690367+0000", 2024-04-26T10:21:53.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690367+0000", 2024-04-26T10:21:53.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690366+0000", 2024-04-26T10:21:53.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:53.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690419+0000", 2024-04-26T10:21:53.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3244e-05 2024-04-26T10:21:53.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690427+0000", 2024-04-26T10:21:53.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8699999999999992e-06 2024-04-26T10:21:53.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690432+0000", 2024-04-26T10:21:53.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1059999999999999e-06 2024-04-26T10:21:53.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.693916+0000", 2024-04-26T10:21:53.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003483955 2024-04-26T10:21:53.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.694104+0000", 2024-04-26T10:21:53.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187784 2024-04-26T10:21:53.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.707243+0000", 2024-04-26T10:21:53.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013139194 2024-04-26T10:21:53.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.707289+0000", 2024-04-26T10:21:53.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6119999999999999e-05 2024-04-26T10:21:53.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.707350+0000", 2024-04-26T10:21:53.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1094999999999997e-05 2024-04-26T10:21:53.427 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.427 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.427 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.428 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48105 5.f 5:f6d53e5c:::benchmark_data_smithi052_19421_object48104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:53.428 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:52.902076+0000", 2024-04-26T10:21:53.428 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.42552203300000002, 2024-04-26T10:21:53.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016920236000000002, 2024-04-26T10:21:53.428 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.428 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.428 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.428 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:53.428 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:53.428 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48105 2024-04-26T10:21:53.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.428 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.902076+0000", 2024-04-26T10:21:53.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.902076+0000", 2024-04-26T10:21:53.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.902075+0000", 2024-04-26T10:21:53.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:53.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.902158+0000", 2024-04-26T10:21:53.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3332999999999996e-05 2024-04-26T10:21:53.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.902175+0000", 2024-04-26T10:21:53.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6620999999999999e-05 2024-04-26T10:21:53.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.902182+0000", 2024-04-26T10:21:53.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9059999999999996e-06 2024-04-26T10:21:53.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.902925+0000", 2024-04-26T10:21:53.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00074319700000000002 2024-04-26T10:21:53.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.903055+0000", 2024-04-26T10:21:53.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012956999999999999 2024-04-26T10:21:53.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:53.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.903191+0000", 2024-04-26T10:21:53.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013664300000000001 2024-04-26T10:21:53.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.905217+0000", 2024-04-26T10:21:53.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020251069999999999 2024-04-26T10:21:53.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:53.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.918919+0000", 2024-04-26T10:21:53.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013702064 2024-04-26T10:21:53.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.918964+0000", 2024-04-26T10:21:53.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5291999999999999e-05 2024-04-26T10:21:53.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.918996+0000", 2024-04-26T10:21:53.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2483000000000001e-05 2024-04-26T10:21:53.433 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.433 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.433 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.433 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48200 5.1 5:8d5f1d4d:::benchmark_data_smithi052_19421_object48199:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:53.433 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:52.947591+0000", 2024-04-26T10:21:53.434 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.380007549, 2024-04-26T10:21:53.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016367816, 2024-04-26T10:21:53.434 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.434 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:53.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:53.434 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48200 2024-04-26T10:21:53.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.434 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.947591+0000", 2024-04-26T10:21:53.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.947591+0000", 2024-04-26T10:21:53.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.947589+0000", 2024-04-26T10:21:53.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:53.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.947692+0000", 2024-04-26T10:21:53.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102583 2024-04-26T10:21:53.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.947699+0000", 2024-04-26T10:21:53.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4830000000000002e-06 2024-04-26T10:21:53.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.947705+0000", 2024-04-26T10:21:53.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8549999999999998e-06 2024-04-26T10:21:53.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.949801+0000", 2024-04-26T10:21:53.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020954789999999999 2024-04-26T10:21:53.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.949913+0000", 2024-04-26T10:21:53.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011247399999999999 2024-04-26T10:21:53.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.963886+0000", 2024-04-26T10:21:53.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01397232 2024-04-26T10:21:53.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.963918+0000", 2024-04-26T10:21:53.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2159000000000002e-05 2024-04-26T10:21:53.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.963958+0000", 2024-04-26T10:21:53.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0754999999999999e-05 2024-04-26T10:21:53.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.438 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.439 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48926 5.5 5:a7805aa6:::benchmark_data_smithi052_19421_object48925:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:53.439 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:53.250366+0000", 2024-04-26T10:21:53.439 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.077232518999999999, 2024-04-26T10:21:53.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016749528, 2024-04-26T10:21:53.439 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.439 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:53.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:53.439 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48926 2024-04-26T10:21:53.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.439 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.250366+0000", 2024-04-26T10:21:53.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.250366+0000", 2024-04-26T10:21:53.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.250364+0000", 2024-04-26T10:21:53.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:53.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.250415+0000", 2024-04-26T10:21:53.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0077999999999997e-05 2024-04-26T10:21:53.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.250428+0000", 2024-04-26T10:21:53.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3242e-05 2024-04-26T10:21:53.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.250451+0000", 2024-04-26T10:21:53.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2793999999999999e-05 2024-04-26T10:21:53.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.252597+0000", 2024-04-26T10:21:53.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021459980000000001 2024-04-26T10:21:53.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.252688+0000", 2024-04-26T10:21:53.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1411999999999998e-05 2024-04-26T10:21:53.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.266911+0000", 2024-04-26T10:21:53.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014222517 2024-04-26T10:21:53.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.266993+0000", 2024-04-26T10:21:53.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2898000000000005e-05 2024-04-26T10:21:53.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.267115+0000", 2024-04-26T10:21:53.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012173299999999999 2024-04-26T10:21:53.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.444 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.444 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.444 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48930 5.d 5:bb090a7c:::benchmark_data_smithi052_19421_object48929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:53.444 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:53.252747+0000", 2024-04-26T10:21:53.444 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.074850982999999996, 2024-04-26T10:21:53.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016389232, 2024-04-26T10:21:53.444 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:53.444 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:53.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:53.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:53.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:53.444 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48930 2024-04-26T10:21:53.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.445 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:53.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:53.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.252747+0000", 2024-04-26T10:21:53.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:53.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.252747+0000", 2024-04-26T10:21:53.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:53.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:53.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.252746+0000", 2024-04-26T10:21:53.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:53.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:53.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.252879+0000", 2024-04-26T10:21:53.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132528 2024-04-26T10:21:53.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:53.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.252891+0000", 2024-04-26T10:21:53.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2525e-05 2024-04-26T10:21:53.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:53.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.252897+0000", 2024-04-26T10:21:53.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2609999999999999e-06 2024-04-26T10:21:53.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:53.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.254332+0000", 2024-04-26T10:21:53.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001434114 2024-04-26T10:21:53.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:53.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.254483+0000", 2024-04-26T10:21:53.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015173699999999999 2024-04-26T10:21:53.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:53.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.254632+0000", 2024-04-26T10:21:53.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014888100000000001 2024-04-26T10:21:53.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:53.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.258353+0000", 2024-04-26T10:21:53.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037204040000000001 2024-04-26T10:21:53.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:53.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.269063+0000", 2024-04-26T10:21:53.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010710654 2024-04-26T10:21:53.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:53.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.269113+0000", 2024-04-26T10:21:53.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0028000000000003e-05 2024-04-26T10:21:53.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:53.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:53.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:53.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.269136+0000", 2024-04-26T10:21:53.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3139e-05 2024-04-26T10:21:53.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.449 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.449 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:53.450 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:53.450 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:53.450 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:53.464 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:53.461+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:53.486 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:21:53.508 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:21:53.509 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:21:53.509 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:21:53.509 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:21:53.514 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:21:53.514 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:21:53.553 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:53.549+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:53.580 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:53.580 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:53.593 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:53.615 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:2024-04-26T10:21:53.614186+0000 min lat: 0.00175409 max lat: 1.03442 avg lat: 0.00642674 2024-04-26T10:21:53.615 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-26T10:21:53.615 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 20 16 49764 49748 155.445 146 0.0119611 0.00642674 2024-04-26T10:21:53.654 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:53.649+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:53.718 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:53.719 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:53.731 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:53.754 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:53.748+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:53.853 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:53.853 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:53.855 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:53.852+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:53.866 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:53.956 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:53.953+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:53.999 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:54.000 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:54.013 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:54.058 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:54.053+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:54.149 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:54.149 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:54.158 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:54.157+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:54.162 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:54.259 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:54.257+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:54.332 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:54.333 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:54.345 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:54.360 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:54.356+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:54.461 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:54.456+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:54.471 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:54.471 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:54.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2024-04-26T10:21:54.484 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:54.562 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:54.561+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:54.615 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 21 16 52127 52111 155.075 147.688 0.00353134 0.00644263 2024-04-26T10:21:54.651 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:54.651 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:54.659 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:21:54.663 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:54.663 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:54.656+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:54.763 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:54.761+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:54.788 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:54.788 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:54.801 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:54.864 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:54.860+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:54.933 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:54.933 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:54.946 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:54.965 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:54.960+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:55.065 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:55.060+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:55.075 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:55.075 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:55.088 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:55.167 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:55.165+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:55.221 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:55.221 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:55.236 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:55.268 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:55.265+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:55.364 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:55.365 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:55.369 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:55.365+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:55.377 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:55.469 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:55.464+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:55.501 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:55.501 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:55.515 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:21:55.516 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:55.571 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:55.568+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:55.615 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 22 15 54440 54425 154.599 144.625 0.00547626 0.0064626 2024-04-26T10:21:55.643 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:55.644 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:55.645 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T10:21:55.656 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:55.679 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:21:55.699 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:21:55.700 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:21:55.700 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:21:55.700 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:21:55.703 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:55.700+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:55.704 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:21:55.704 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:21:55.773 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:55.768+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:55.785 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:55.785 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:55.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.785 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:54813 5.5 5:a4685e52:::benchmark_data_smithi052_19421_object54812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:55.785 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:55.777003+0000", 2024-04-26T10:21:55.785 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0061884280000000002, 2024-04-26T10:21:55.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062214000000000002, 2024-04-26T10:21:55.786 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:55.786 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:55.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:55.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:55.786 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:55.786 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54813 2024-04-26T10:21:55.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.786 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:55.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:55.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.777003+0000", 2024-04-26T10:21:55.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:55.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:55.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.777003+0000", 2024-04-26T10:21:55.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:55.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:55.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.777003+0000", 2024-04-26T10:21:55.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:55.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:55.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.777098+0000", 2024-04-26T10:21:55.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4877000000000007e-05 2024-04-26T10:21:55.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:55.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.777108+0000", 2024-04-26T10:21:55.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0868e-05 2024-04-26T10:21:55.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:55.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.777113+0000", 2024-04-26T10:21:55.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.78e-06 2024-04-26T10:21:55.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:55.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.778926+0000", 2024-04-26T10:21:55.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018126150000000001 2024-04-26T10:21:55.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:55.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.779063+0000", 2024-04-26T10:21:55.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013748699999999999 2024-04-26T10:21:55.789 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:55.789 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:55.789 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:55.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.789 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:54814 5.d 5:b268fa94:::benchmark_data_smithi052_19421_object54813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:55.789 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:55.777974+0000", 2024-04-26T10:21:55.789 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0052181290000000002, 2024-04-26T10:21:55.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053496990000000003, 2024-04-26T10:21:55.790 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:55.790 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:55.790 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:55.790 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:55.790 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:55.790 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54814 2024-04-26T10:21:55.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.790 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:55.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:55.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.777974+0000", 2024-04-26T10:21:55.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:55.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:55.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.777974+0000", 2024-04-26T10:21:55.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:55.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:55.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.777973+0000", 2024-04-26T10:21:55.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:55.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:55.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.778058+0000", 2024-04-26T10:21:55.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5075999999999997e-05 2024-04-26T10:21:55.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:55.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.778067+0000", 2024-04-26T10:21:55.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5350000000000004e-06 2024-04-26T10:21:55.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:55.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.778070+0000", 2024-04-26T10:21:55.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8770000000000003e-06 2024-04-26T10:21:55.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:55.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.778911+0000", 2024-04-26T10:21:55.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00084095600000000002 2024-04-26T10:21:55.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:55.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.779023+0000", 2024-04-26T10:21:55.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011147899999999999 2024-04-26T10:21:55.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:55.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.779125+0000", 2024-04-26T10:21:55.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010248599999999999 2024-04-26T10:21:55.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:55.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.781914+0000", 2024-04-26T10:21:55.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027886650000000001 2024-04-26T10:21:55.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:55.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783138+0000", 2024-04-26T10:21:55.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012238889999999999 2024-04-26T10:21:55.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:55.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783184+0000", 2024-04-26T10:21:55.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6505999999999998e-05 2024-04-26T10:21:55.794 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:55.794 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:55.794 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:55.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.795 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:54820 5.9 5:9d9f3d0a:::benchmark_data_smithi052_19421_object54819:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:55.795 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:55.779088+0000", 2024-04-26T10:21:55.795 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0041038489999999997, 2024-04-26T10:21:55.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043403399999999998, 2024-04-26T10:21:55.795 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:55.795 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:55.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:55.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:55.795 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:55.795 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54820 2024-04-26T10:21:55.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.795 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:55.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:55.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.779088+0000", 2024-04-26T10:21:55.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:55.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:55.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.779088+0000", 2024-04-26T10:21:55.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:55.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:55.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.779087+0000", 2024-04-26T10:21:55.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:55.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:55.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.779209+0000", 2024-04-26T10:21:55.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121747 2024-04-26T10:21:55.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:55.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.779218+0000", 2024-04-26T10:21:55.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5370000000000003e-06 2024-04-26T10:21:55.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:55.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.779225+0000", 2024-04-26T10:21:55.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1289999999999998e-06 2024-04-26T10:21:55.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:55.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.779279+0000", 2024-04-26T10:21:55.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3962000000000003e-05 2024-04-26T10:21:55.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:55.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.779440+0000", 2024-04-26T10:21:55.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016101700000000001 2024-04-26T10:21:55.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:55.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.779621+0000", 2024-04-26T10:21:55.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000180848 2024-04-26T10:21:55.799 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:55.799 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:55.799 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:55.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.799 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:54827 5.9 5:905abd12:::benchmark_data_smithi052_19421_object54826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:55.799 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:55.781552+0000", 2024-04-26T10:21:55.799 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001639679, 2024-04-26T10:21:55.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001930509, 2024-04-26T10:21:55.799 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:55.799 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:55.799 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:55.799 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:55.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:55.800 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54827 2024-04-26T10:21:55.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.800 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:55.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:55.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.781552+0000", 2024-04-26T10:21:55.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:55.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:55.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.781552+0000", 2024-04-26T10:21:55.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:55.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:55.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.781551+0000", 2024-04-26T10:21:55.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:55.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:55.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.781600+0000", 2024-04-26T10:21:55.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8853999999999997e-05 2024-04-26T10:21:55.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:55.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.781615+0000", 2024-04-26T10:21:55.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5702999999999999e-05 2024-04-26T10:21:55.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:55.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.781627+0000", 2024-04-26T10:21:55.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1377e-05 2024-04-26T10:21:55.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:55.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.781741+0000", 2024-04-26T10:21:55.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113936 2024-04-26T10:21:55.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:55.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.781849+0000", 2024-04-26T10:21:55.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108281 2024-04-26T10:21:55.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:55.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.781957+0000", 2024-04-26T10:21:55.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108517 2024-04-26T10:21:55.803 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:55.803 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:55.803 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:55.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.803 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:54828 5.1 5:80d35d7a:::benchmark_data_smithi052_19421_object54827:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:55.803 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:55.783043+0000", 2024-04-26T10:21:55.804 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00014866900000000001, 2024-04-26T10:21:55.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00048760900000000001, 2024-04-26T10:21:55.804 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:55.804 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:55.804 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:55.804 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:55.804 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:55.804 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54828 2024-04-26T10:21:55.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.804 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:55.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:55.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783043+0000", 2024-04-26T10:21:55.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:55.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:55.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783043+0000", 2024-04-26T10:21:55.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:55.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:55.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783042+0000", 2024-04-26T10:21:55.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:55.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:55.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783113+0000", 2024-04-26T10:21:55.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0669999999999999e-05 2024-04-26T10:21:55.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:55.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783129+0000", 2024-04-26T10:21:55.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6243e-05 2024-04-26T10:21:55.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:55.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783134+0000", 2024-04-26T10:21:55.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4650000000000002e-06 2024-04-26T10:21:55.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:55.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783174+0000", 2024-04-26T10:21:55.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9549999999999999e-05 2024-04-26T10:21:55.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:55.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783310+0000", 2024-04-26T10:21:55.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136117 2024-04-26T10:21:55.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:55.807 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:55.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:55.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.807 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:54830 5.c 5:343f9ee3:::benchmark_data_smithi052_19421_object54829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:55.807 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:55.783145+0000", 2024-04-26T10:21:55.807 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.6532000000000001e-05, 2024-04-26T10:21:55.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042993000000000003, 2024-04-26T10:21:55.808 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:55.808 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:55.808 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:55.808 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:55.808 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:55.808 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54830 2024-04-26T10:21:55.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.808 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:55.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:55.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783145+0000", 2024-04-26T10:21:55.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:55.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:55.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783145+0000", 2024-04-26T10:21:55.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:55.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:55.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783144+0000", 2024-04-26T10:21:55.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:55.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:55.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783173+0000", 2024-04-26T10:21:55.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.834e-05 2024-04-26T10:21:55.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:55.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783180+0000", 2024-04-26T10:21:55.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4549999999999998e-06 2024-04-26T10:21:55.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:55.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783185+0000", 2024-04-26T10:21:55.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8980000000000004e-06 2024-04-26T10:21:55.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:55.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783232+0000", 2024-04-26T10:21:55.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7332e-05 2024-04-26T10:21:55.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:55.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783341+0000", 2024-04-26T10:21:55.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108893 2024-04-26T10:21:55.811 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:55.811 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:55.811 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:55.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.811 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:54831 5.f 5.6fd5f3f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:55.811 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:55.783492+0000", 2024-04-26T10:21:55.811 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9997001, 2024-04-26T10:21:55.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000156031, 2024-04-26T10:21:55.812 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:55.812 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-04-26T10:21:55.812 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:55.812 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:55.812 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:55.812 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 54831 2024-04-26T10:21:55.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.812 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:55.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:55.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783492+0000", 2024-04-26T10:21:55.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:55.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:55.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783492+0000", 2024-04-26T10:21:55.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:55.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:55.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783491+0000", 2024-04-26T10:21:55.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:55.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:55.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783552+0000", 2024-04-26T10:21:55.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0853999999999997e-05 2024-04-26T10:21:55.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:55.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783562+0000", 2024-04-26T10:21:55.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0219e-05 2024-04-26T10:21:55.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:55.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783568+0000", 2024-04-26T10:21:55.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3629999999999999e-06 2024-04-26T10:21:55.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:55.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:55.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:55.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:55.783619+0000", 2024-04-26T10:21:55.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0800999999999997e-05 2024-04-26T10:21:55.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:55.815 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:55.815 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:55.815 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:55.815 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:21:55.815 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 7 2024-04-26T10:21:55.815 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:55.816 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:55.873 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:55.869+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:55.945 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:55.945 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:21:55.945 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:21:55.945 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:21:55.945 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:55.957 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:56.002 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:56.001+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:56.076 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:56.073+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:56.087 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:56.087 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:21:56.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:21:56.087 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:56.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.087 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:56.087 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:56.088 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.845077529000001, 2024-04-26T10:21:56.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018452342, 2024-04-26T10:21:56.088 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.088 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:56.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:56.088 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115 2024-04-26T10:21:56.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.088 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:56.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:56.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239018+0000", 2024-04-26T10:21:56.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239152+0000", 2024-04-26T10:21:56.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414699999999999 2024-04-26T10:21:56.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239169+0000", 2024-04-26T10:21:56.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7013000000000001e-05 2024-04-26T10:21:56.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239190+0000", 2024-04-26T10:21:56.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1302999999999999e-05 2024-04-26T10:21:56.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252181+0000", 2024-04-26T10:21:56.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012990213 2024-04-26T10:21:56.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252411+0000", 2024-04-26T10:21:56.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023010199999999999 2024-04-26T10:21:56.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252687+0000", 2024-04-26T10:21:56.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000276063 2024-04-26T10:21:56.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254694+0000", 2024-04-26T10:21:56.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020072879999999999 2024-04-26T10:21:56.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257399+0000", 2024-04-26T10:21:56.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027051670000000001 2024-04-26T10:21:56.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257442+0000", 2024-04-26T10:21:56.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-04-26T10:21:56.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257471+0000", 2024-04-26T10:21:56.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.889e-05 2024-04-26T10:21:56.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.093 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.093 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:56.093 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:56.093 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.844897000000003, 2024-04-26T10:21:56.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018350615000000001, 2024-04-26T10:21:56.093 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.094 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:56.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:56.094 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116 2024-04-26T10:21:56.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.094 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:56.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:56.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239198+0000", 2024-04-26T10:21:56.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239213+0000", 2024-04-26T10:21:56.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4965e-05 2024-04-26T10:21:56.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239235+0000", 2024-04-26T10:21:56.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.156e-05 2024-04-26T10:21:56.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239243+0000", 2024-04-26T10:21:56.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9470000000000003e-06 2024-04-26T10:21:56.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253284+0000", 2024-04-26T10:21:56.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014041392999999999 2024-04-26T10:21:56.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253376+0000", 2024-04-26T10:21:56.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1198000000000003e-05 2024-04-26T10:21:56.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253508+0000", 2024-04-26T10:21:56.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013220199999999999 2024-04-26T10:21:56.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255474+0000", 2024-04-26T10:21:56.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019665590000000001 2024-04-26T10:21:56.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257480+0000", 2024-04-26T10:21:56.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00200599 2024-04-26T10:21:56.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257515+0000", 2024-04-26T10:21:56.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5126000000000002e-05 2024-04-26T10:21:56.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257550+0000", 2024-04-26T10:21:56.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4394000000000003e-05 2024-04-26T10:21:56.099 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.099 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.099 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.099 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:56.099 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:56.099 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.844843443999999, 2024-04-26T10:21:56.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018369330999999999, 2024-04-26T10:21:56.099 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.099 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:56.100 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:56.100 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117 2024-04-26T10:21:56.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.100 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:56.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:56.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239252+0000", 2024-04-26T10:21:56.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239267+0000", 2024-04-26T10:21:56.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4562999999999999e-05 2024-04-26T10:21:56.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239281+0000", 2024-04-26T10:21:56.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4e-05 2024-04-26T10:21:56.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239296+0000", 2024-04-26T10:21:56.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5492999999999999e-05 2024-04-26T10:21:56.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254076+0000", 2024-04-26T10:21:56.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014779814 2024-04-26T10:21:56.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254159+0000", 2024-04-26T10:21:56.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2923999999999994e-05 2024-04-26T10:21:56.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254279+0000", 2024-04-26T10:21:56.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011964300000000001 2024-04-26T10:21:56.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.256043+0000", 2024-04-26T10:21:56.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001764353 2024-04-26T10:21:56.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257559+0000", 2024-04-26T10:21:56.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015159189999999999 2024-04-26T10:21:56.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257597+0000", 2024-04-26T10:21:56.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8031999999999998e-05 2024-04-26T10:21:56.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257622+0000", 2024-04-26T10:21:56.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5213999999999999e-05 2024-04-26T10:21:56.104 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.104 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.104 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.105 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:164 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:56.105 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:56.105 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.434215850999998, 2024-04-26T10:21:56.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016970263999999999, 2024-04-26T10:21:56.105 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.105 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.105 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.105 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:56.105 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:56.105 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 164 2024-04-26T10:21:56.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.106 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:56.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649880+0000", 2024-04-26T10:21:56.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649879+0000", 2024-04-26T10:21:56.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649963+0000", 2024-04-26T10:21:56.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4141999999999995e-05 2024-04-26T10:21:56.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649975+0000", 2024-04-26T10:21:56.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1416e-05 2024-04-26T10:21:56.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649983+0000", 2024-04-26T10:21:56.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8469999999999996e-06 2024-04-26T10:21:56.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662854+0000", 2024-04-26T10:21:56.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012871871999999999 2024-04-26T10:21:56.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.662965+0000", 2024-04-26T10:21:56.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110413 2024-04-26T10:21:56.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.663109+0000", 2024-04-26T10:21:56.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144115 2024-04-26T10:21:56.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.665992+0000", 2024-04-26T10:21:56.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028827340000000001 2024-04-26T10:21:56.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666784+0000", 2024-04-26T10:21:56.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00079253799999999997 2024-04-26T10:21:56.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666824+0000", 2024-04-26T10:21:56.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0139000000000003e-05 2024-04-26T10:21:56.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666851+0000", 2024-04-26T10:21:56.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6171999999999999e-05 2024-04-26T10:21:56.110 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.110 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.110 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.111 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:56.111 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:56.111 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.434104771000001, 2024-04-26T10:21:56.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019547338000000001, 2024-04-26T10:21:56.111 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.111 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.111 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.111 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:56.111 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:56.111 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165 2024-04-26T10:21:56.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.112 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:56.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:56.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:56.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649996+0000", 2024-04-26T10:21:56.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-04-26T10:21:56.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650021+0000", 2024-04-26T10:21:56.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5179999999999999e-05 2024-04-26T10:21:56.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650030+0000", 2024-04-26T10:21:56.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-04-26T10:21:56.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664733+0000", 2024-04-26T10:21:56.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014703097 2024-04-26T10:21:56.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664821+0000", 2024-04-26T10:21:56.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7918999999999996e-05 2024-04-26T10:21:56.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664953+0000", 2024-04-26T10:21:56.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132662 2024-04-26T10:21:56.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666776+0000", 2024-04-26T10:21:56.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018225509999999999 2024-04-26T10:21:56.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669480+0000", 2024-04-26T10:21:56.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00270382 2024-04-26T10:21:56.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669515+0000", 2024-04-26T10:21:56.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4885000000000002e-05 2024-04-26T10:21:56.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669539+0000", 2024-04-26T10:21:56.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4121000000000002e-05 2024-04-26T10:21:56.116 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.116 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.116 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.117 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:56.117 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:56.117 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.244581662000002, 2024-04-26T10:21:56.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017833541000000001, 2024-04-26T10:21:56.117 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.117 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.117 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.117 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:56.117 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:56.117 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185 2024-04-26T10:21:56.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.117 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:56.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:56.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839514+0000", 2024-04-26T10:21:56.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839612+0000", 2024-04-26T10:21:56.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7880999999999993e-05 2024-04-26T10:21:56.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839623+0000", 2024-04-26T10:21:56.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0917000000000001e-05 2024-04-26T10:21:56.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839632+0000", 2024-04-26T10:21:56.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0999999999999993e-06 2024-04-26T10:21:56.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850382+0000", 2024-04-26T10:21:56.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010750335 2024-04-26T10:21:56.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850502+0000", 2024-04-26T10:21:56.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120183 2024-04-26T10:21:56.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850685+0000", 2024-04-26T10:21:56.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000182442 2024-04-26T10:21:56.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854396+0000", 2024-04-26T10:21:56.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037114819999999999 2024-04-26T10:21:56.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857233+0000", 2024-04-26T10:21:56.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002836514 2024-04-26T10:21:56.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857300+0000", 2024-04-26T10:21:56.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6842999999999997e-05 2024-04-26T10:21:56.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857348+0000", 2024-04-26T10:21:56.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8504000000000002e-05 2024-04-26T10:21:56.122 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.122 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.122 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.123 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:56.123 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:56.123 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.244455311000003, 2024-04-26T10:21:56.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018757273000000001, 2024-04-26T10:21:56.123 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.123 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.123 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.123 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:56.123 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:56.123 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 186 2024-04-26T10:21:56.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.123 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:56.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:56.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839640+0000", 2024-04-26T10:21:56.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839646+0000", 2024-04-26T10:21:56.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:21:56.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839654+0000", 2024-04-26T10:21:56.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:21:56.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839661+0000", 2024-04-26T10:21:56.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.64e-06 2024-04-26T10:21:56.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852328+0000", 2024-04-26T10:21:56.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012667151 2024-04-26T10:21:56.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852538+0000", 2024-04-26T10:21:56.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020961100000000001 2024-04-26T10:21:56.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852945+0000", 2024-04-26T10:21:56.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040712099999999998 2024-04-26T10:21:56.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857372+0000", 2024-04-26T10:21:56.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044268049999999998 2024-04-26T10:21:56.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858321+0000", 2024-04-26T10:21:56.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094932999999999997 2024-04-26T10:21:56.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858367+0000", 2024-04-26T10:21:56.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5534000000000001e-05 2024-04-26T10:21:56.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858398+0000", 2024-04-26T10:21:56.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1562e-05 2024-04-26T10:21:56.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.128 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.128 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:56.128 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:56.128 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.244428145000001, 2024-04-26T10:21:56.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019669504000000001, 2024-04-26T10:21:56.129 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.129 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:56.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:56.129 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187 2024-04-26T10:21:56.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.129 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:56.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:56.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839667+0000", 2024-04-26T10:21:56.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839677+0000", 2024-04-26T10:21:56.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3270000000000007e-06 2024-04-26T10:21:56.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839685+0000", 2024-04-26T10:21:56.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2670000000000006e-06 2024-04-26T10:21:56.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839692+0000", 2024-04-26T10:21:56.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7129999999999999e-06 2024-04-26T10:21:56.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853685+0000", 2024-04-26T10:21:56.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013993716999999999 2024-04-26T10:21:56.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853876+0000", 2024-04-26T10:21:56.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019097100000000001 2024-04-26T10:21:56.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853989+0000", 2024-04-26T10:21:56.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011275199999999999 2024-04-26T10:21:56.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857377+0000", 2024-04-26T10:21:56.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033882489999999999 2024-04-26T10:21:56.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859222+0000", 2024-04-26T10:21:56.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001844233 2024-04-26T10:21:56.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859291+0000", 2024-04-26T10:21:56.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:21:56.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859338+0000", 2024-04-26T10:21:56.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6366000000000003e-05 2024-04-26T10:21:56.133 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.133 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.134 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.134 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:56.134 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:56.134 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.244397278999998, 2024-04-26T10:21:56.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019837468, 2024-04-26T10:21:56.134 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.134 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.134 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.134 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:56.134 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:56.134 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 188 2024-04-26T10:21:56.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.135 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:56.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:56.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839698+0000", 2024-04-26T10:21:56.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839829+0000", 2024-04-26T10:21:56.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013061099999999999 2024-04-26T10:21:56.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839853+0000", 2024-04-26T10:21:56.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3736000000000001e-05 2024-04-26T10:21:56.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839863+0000", 2024-04-26T10:21:56.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:56.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854869+0000", 2024-04-26T10:21:56.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015005978 2024-04-26T10:21:56.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854959+0000", 2024-04-26T10:21:56.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9468999999999993e-05 2024-04-26T10:21:56.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855114+0000", 2024-04-26T10:21:56.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015563799999999999 2024-04-26T10:21:56.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857386+0000", 2024-04-26T10:21:56.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002271852 2024-04-26T10:21:56.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859406+0000", 2024-04-26T10:21:56.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002019936 2024-04-26T10:21:56.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859461+0000", 2024-04-26T10:21:56.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4826e-05 2024-04-26T10:21:56.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859536+0000", 2024-04-26T10:21:56.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5566000000000001e-05 2024-04-26T10:21:56.139 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.139 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.139 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.140 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:56.140 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:56.140 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 53.244223415999997, 2024-04-26T10:21:56.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019826496999999998, 2024-04-26T10:21:56.140 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.140 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.140 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.140 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:56.140 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:56.140 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 189 2024-04-26T10:21:56.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.140 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:56.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:56.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839872+0000", 2024-04-26T10:21:56.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839882+0000", 2024-04-26T10:21:56.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:56.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839892+0000", 2024-04-26T10:21:56.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.217e-06 2024-04-26T10:21:56.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839900+0000", 2024-04-26T10:21:56.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5469999999999997e-06 2024-04-26T10:21:56.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855903+0000", 2024-04-26T10:21:56.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016002590000000001 2024-04-26T10:21:56.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856110+0000", 2024-04-26T10:21:56.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020711199999999999 2024-04-26T10:21:56.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856421+0000", 2024-04-26T10:21:56.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031128500000000001 2024-04-26T10:21:56.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857643+0000", 2024-04-26T10:21:56.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012215520000000001 2024-04-26T10:21:56.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859603+0000", 2024-04-26T10:21:56.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019600350000000002 2024-04-26T10:21:56.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859660+0000", 2024-04-26T10:21:56.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6857999999999997e-05 2024-04-26T10:21:56.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859699+0000", 2024-04-26T10:21:56.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9641999999999998e-05 2024-04-26T10:21:56.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.145 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.146 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15564 5.f 5:f61b0088:::benchmark_data_smithi052_19421_object15563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:56.146 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:56.146 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.089705765000001, 2024-04-26T10:21:56.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017729826000000001, 2024-04-26T10:21:56.146 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.146 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.146 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15564 2024-04-26T10:21:56.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.146 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:56.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:56.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994389+0000", 2024-04-26T10:21:56.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994451+0000", 2024-04-26T10:21:56.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2032999999999994e-05 2024-04-26T10:21:56.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994477+0000", 2024-04-26T10:21:56.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5267999999999999e-05 2024-04-26T10:21:56.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994486+0000", 2024-04-26T10:21:56.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9420000000000001e-06 2024-04-26T10:21:56.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001578+0000", 2024-04-26T10:21:56.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070928110000000001 2024-04-26T10:21:56.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001748+0000", 2024-04-26T10:21:56.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016944099999999999 2024-04-26T10:21:56.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001914+0000", 2024-04-26T10:21:56.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000166546 2024-04-26T10:21:56.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.006488+0000", 2024-04-26T10:21:56.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045735460000000004 2024-04-26T10:21:56.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012034+0000", 2024-04-26T10:21:56.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055461449999999997 2024-04-26T10:21:56.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012085+0000", 2024-04-26T10:21:56.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1319000000000001e-05 2024-04-26T10:21:56.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012120+0000", 2024-04-26T10:21:56.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4904999999999999e-05 2024-04-26T10:21:56.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.151 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.151 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34427 5.7 5:ef7d83e6:::benchmark_data_smithi052_19421_object34426:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:56.151 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:21:56.152 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4520177570000001, 2024-04-26T10:21:56.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02010443, 2024-04-26T10:21:56.152 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.152 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.152 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.152 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.152 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.152 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34427 2024-04-26T10:21:56.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.152 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:21:56.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:21:56.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632077+0000", 2024-04-26T10:21:56.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:56.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632139+0000", 2024-04-26T10:21:56.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2527999999999995e-05 2024-04-26T10:21:56.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632153+0000", 2024-04-26T10:21:56.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3608000000000001e-05 2024-04-26T10:21:56.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632165+0000", 2024-04-26T10:21:56.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2592000000000001e-05 2024-04-26T10:21:56.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635907+0000", 2024-04-26T10:21:56.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037419789999999999 2024-04-26T10:21:56.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:21:56.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635919+0000", 2024-04-26T10:21:56.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1511999999999999e-05 2024-04-26T10:21:56.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641616+0000", 2024-04-26T10:21:56.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056974770000000003 2024-04-26T10:21:56.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641772+0000", 2024-04-26T10:21:56.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155799 2024-04-26T10:21:56.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.651965+0000", 2024-04-26T10:21:56.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010193254000000001 2024-04-26T10:21:56.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652039+0000", 2024-04-26T10:21:56.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4031999999999999e-05 2024-04-26T10:21:56.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652183+0000", 2024-04-26T10:21:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014342599999999999 2024-04-26T10:21:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45130 5.5 5:a1beca5f:::benchmark_data_smithi052_19421_object45129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:21:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3985341340000002, 2024-04-26T10:21:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019561411000000001, 2024-04-26T10:21:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.157 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.158 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45130 2024-04-26T10:21:56.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.158 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:21:56.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:21:56.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685561+0000", 2024-04-26T10:21:56.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685648+0000", 2024-04-26T10:21:56.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6552999999999996e-05 2024-04-26T10:21:56.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685657+0000", 2024-04-26T10:21:56.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1330000000000005e-06 2024-04-26T10:21:56.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685664+0000", 2024-04-26T10:21:56.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1069999999999999e-06 2024-04-26T10:21:56.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.691613+0000", 2024-04-26T10:21:56.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059489199999999999 2024-04-26T10:21:56.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.691779+0000", 2024-04-26T10:21:56.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016567700000000001 2024-04-26T10:21:56.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705021+0000", 2024-04-26T10:21:56.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013242812 2024-04-26T10:21:56.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705054+0000", 2024-04-26T10:21:56.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2709999999999997e-05 2024-04-26T10:21:56.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705123+0000", 2024-04-26T10:21:56.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9246999999999996e-05 2024-04-26T10:21:56.161 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.162 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.162 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.162 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45135 5.d 5:b49760b4:::benchmark_data_smithi052_19421_object45134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:56.162 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.687970+0000", 2024-04-26T10:21:56.162 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3961262510000001, 2024-04-26T10:21:56.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017262387000000001, 2024-04-26T10:21:56.162 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.162 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.162 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45135 2024-04-26T10:21:56.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.163 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.687970+0000", 2024-04-26T10:21:56.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.687970+0000", 2024-04-26T10:21:56.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.687969+0000", 2024-04-26T10:21:56.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.688062+0000", 2024-04-26T10:21:56.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2904000000000004e-05 2024-04-26T10:21:56.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.688076+0000", 2024-04-26T10:21:56.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4585e-05 2024-04-26T10:21:56.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.688084+0000", 2024-04-26T10:21:56.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4039999999999998e-06 2024-04-26T10:21:56.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.692001+0000", 2024-04-26T10:21:56.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039169699999999997 2024-04-26T10:21:56.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.692188+0000", 2024-04-26T10:21:56.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000186801 2024-04-26T10:21:56.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.692336+0000", 2024-04-26T10:21:56.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014784999999999999 2024-04-26T10:21:56.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.696839+0000", 2024-04-26T10:21:56.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045038329999999996 2024-04-26T10:21:56.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705139+0000", 2024-04-26T10:21:56.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083000910000000008 2024-04-26T10:21:56.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705200+0000", 2024-04-26T10:21:56.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0176000000000001e-05 2024-04-26T10:21:56.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705232+0000", 2024-04-26T10:21:56.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2691999999999998e-05 2024-04-26T10:21:56.167 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.167 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.167 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.167 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45141 5.5 5:a19de173:::benchmark_data_smithi052_19421_object45140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:56.167 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.690367+0000", 2024-04-26T10:21:56.167 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.3937294800000002, 2024-04-26T10:21:56.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016983505999999999, 2024-04-26T10:21:56.167 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.168 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.168 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.168 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.168 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.168 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45141 2024-04-26T10:21:56.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.168 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690367+0000", 2024-04-26T10:21:56.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690367+0000", 2024-04-26T10:21:56.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690366+0000", 2024-04-26T10:21:56.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690419+0000", 2024-04-26T10:21:56.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3244e-05 2024-04-26T10:21:56.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690427+0000", 2024-04-26T10:21:56.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8699999999999992e-06 2024-04-26T10:21:56.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690432+0000", 2024-04-26T10:21:56.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1059999999999999e-06 2024-04-26T10:21:56.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.693916+0000", 2024-04-26T10:21:56.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003483955 2024-04-26T10:21:56.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.694104+0000", 2024-04-26T10:21:56.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187784 2024-04-26T10:21:56.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.707243+0000", 2024-04-26T10:21:56.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013139194 2024-04-26T10:21:56.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.707289+0000", 2024-04-26T10:21:56.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6119999999999999e-05 2024-04-26T10:21:56.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.707350+0000", 2024-04-26T10:21:56.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1094999999999997e-05 2024-04-26T10:21:56.172 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.172 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.172 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.172 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48105 5.f 5:f6d53e5c:::benchmark_data_smithi052_19421_object48104:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:56.172 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:52.902076+0000", 2024-04-26T10:21:56.173 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.1820200490000001, 2024-04-26T10:21:56.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016920236000000002, 2024-04-26T10:21:56.173 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.173 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.173 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.173 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.173 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.173 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48105 2024-04-26T10:21:56.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.173 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.902076+0000", 2024-04-26T10:21:56.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.902076+0000", 2024-04-26T10:21:56.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.902075+0000", 2024-04-26T10:21:56.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.902158+0000", 2024-04-26T10:21:56.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3332999999999996e-05 2024-04-26T10:21:56.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.902175+0000", 2024-04-26T10:21:56.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6620999999999999e-05 2024-04-26T10:21:56.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.902182+0000", 2024-04-26T10:21:56.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9059999999999996e-06 2024-04-26T10:21:56.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.902925+0000", 2024-04-26T10:21:56.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00074319700000000002 2024-04-26T10:21:56.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.903055+0000", 2024-04-26T10:21:56.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012956999999999999 2024-04-26T10:21:56.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.903191+0000", 2024-04-26T10:21:56.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013664300000000001 2024-04-26T10:21:56.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.905217+0000", 2024-04-26T10:21:56.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020251069999999999 2024-04-26T10:21:56.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.918919+0000", 2024-04-26T10:21:56.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013702064 2024-04-26T10:21:56.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.918964+0000", 2024-04-26T10:21:56.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5291999999999999e-05 2024-04-26T10:21:56.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:52.918996+0000", 2024-04-26T10:21:56.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2483000000000001e-05 2024-04-26T10:21:56.178 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.178 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.178 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.178 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48926 5.5 5:a7805aa6:::benchmark_data_smithi052_19421_object48925:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:56.178 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:53.250366+0000", 2024-04-26T10:21:56.178 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8337305349999999, 2024-04-26T10:21:56.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016749528, 2024-04-26T10:21:56.178 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.178 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.179 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.179 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48926 2024-04-26T10:21:56.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.179 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.250366+0000", 2024-04-26T10:21:56.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.250366+0000", 2024-04-26T10:21:56.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.250364+0000", 2024-04-26T10:21:56.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.250415+0000", 2024-04-26T10:21:56.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0077999999999997e-05 2024-04-26T10:21:56.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.250428+0000", 2024-04-26T10:21:56.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3242e-05 2024-04-26T10:21:56.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.250451+0000", 2024-04-26T10:21:56.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2793999999999999e-05 2024-04-26T10:21:56.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.252597+0000", 2024-04-26T10:21:56.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021459980000000001 2024-04-26T10:21:56.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.252688+0000", 2024-04-26T10:21:56.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1411999999999998e-05 2024-04-26T10:21:56.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.266911+0000", 2024-04-26T10:21:56.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014222517 2024-04-26T10:21:56.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.266993+0000", 2024-04-26T10:21:56.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2898000000000005e-05 2024-04-26T10:21:56.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.267115+0000", 2024-04-26T10:21:56.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012173299999999999 2024-04-26T10:21:56.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.182 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.183 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:48930 5.d 5:bb090a7c:::benchmark_data_smithi052_19421_object48929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:56.183 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:53.252747+0000", 2024-04-26T10:21:56.183 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8313489990000003, 2024-04-26T10:21:56.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016389232, 2024-04-26T10:21:56.183 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.183 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.183 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 48930 2024-04-26T10:21:56.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.183 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.252747+0000", 2024-04-26T10:21:56.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.252747+0000", 2024-04-26T10:21:56.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.252746+0000", 2024-04-26T10:21:56.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.252879+0000", 2024-04-26T10:21:56.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132528 2024-04-26T10:21:56.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.252891+0000", 2024-04-26T10:21:56.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2525e-05 2024-04-26T10:21:56.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.252897+0000", 2024-04-26T10:21:56.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2609999999999999e-06 2024-04-26T10:21:56.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.254332+0000", 2024-04-26T10:21:56.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001434114 2024-04-26T10:21:56.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.254483+0000", 2024-04-26T10:21:56.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015173699999999999 2024-04-26T10:21:56.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.254632+0000", 2024-04-26T10:21:56.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014888100000000001 2024-04-26T10:21:56.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.258353+0000", 2024-04-26T10:21:56.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037204040000000001 2024-04-26T10:21:56.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.269063+0000", 2024-04-26T10:21:56.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010710654 2024-04-26T10:21:56.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.269113+0000", 2024-04-26T10:21:56.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0028000000000003e-05 2024-04-26T10:21:56.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.269136+0000", 2024-04-26T10:21:56.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3139e-05 2024-04-26T10:21:56.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.188 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.188 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:49103 5.f 5:f082f091:::benchmark_data_smithi052_19421_object49102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:56.188 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:21:56.188 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.7559282669999998, 2024-04-26T10:21:56.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019587917, 2024-04-26T10:21:56.188 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.188 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.189 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49103 2024-04-26T10:21:56.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.189 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:21:56.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:21:56.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328167+0000", 2024-04-26T10:21:56.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328207+0000", 2024-04-26T10:21:56.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0275999999999999e-05 2024-04-26T10:21:56.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328220+0000", 2024-04-26T10:21:56.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2968e-05 2024-04-26T10:21:56.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328233+0000", 2024-04-26T10:21:56.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2203e-05 2024-04-26T10:21:56.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.333946+0000", 2024-04-26T10:21:56.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057135110000000001 2024-04-26T10:21:56.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.335894+0000", 2024-04-26T10:21:56.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019474959999999999 2024-04-26T10:21:56.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.336030+0000", 2024-04-26T10:21:56.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013601999999999999 2024-04-26T10:21:56.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.340794+0000", 2024-04-26T10:21:56.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047643800000000004 2024-04-26T10:21:56.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347659+0000", 2024-04-26T10:21:56.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068648800000000003 2024-04-26T10:21:56.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347713+0000", 2024-04-26T10:21:56.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3736000000000002e-05 2024-04-26T10:21:56.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347756+0000", 2024-04-26T10:21:56.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3155000000000003e-05 2024-04-26T10:21:56.195 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.196 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.196 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.196 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:49261 5.5 5:a449de5e:::benchmark_data_smithi052_19421_object49260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:56.196 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:21:56.196 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.6919242209999998, 2024-04-26T10:21:56.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020598741, 2024-04-26T10:21:56.196 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.196 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.196 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.196 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.196 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.196 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49261 2024-04-26T10:21:56.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.197 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:21:56.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:21:56.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392171+0000", 2024-04-26T10:21:56.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392212+0000", 2024-04-26T10:21:56.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0889000000000001e-05 2024-04-26T10:21:56.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392221+0000", 2024-04-26T10:21:56.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1970000000000002e-06 2024-04-26T10:21:56.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392228+0000", 2024-04-26T10:21:56.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:21:56.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.397869+0000", 2024-04-26T10:21:56.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056403180000000001 2024-04-26T10:21:56.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.398010+0000", 2024-04-26T10:21:56.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014105300000000001 2024-04-26T10:21:56.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:56.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412532+0000", 2024-04-26T10:21:56.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014522431000000001 2024-04-26T10:21:56.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:56.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412692+0000", 2024-04-26T10:21:56.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015970700000000001 2024-04-26T10:21:56.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:56.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412771+0000", 2024-04-26T10:21:56.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8980000000000006e-05 2024-04-26T10:21:56.201 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.201 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.201 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.201 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.201 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.201 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:56.201 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-26T10:21:56.201 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:21:56.202 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-26T10:21:56.202 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-26T10:21:56.202 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-26T10:21:56.202 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-26T10:21:56.203 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:56.200+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:56.204 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:56.304 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:56.300+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:56.326 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:56.327 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:56.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.327 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:56040 5.e 5:7af820b7:::benchmark_data_smithi052_19421_object56039:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.327 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:56.325636+0000", 2024-04-26T10:21:56.327 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0014675350000000001, 2024-04-26T10:21:56.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001489291, 2024-04-26T10:21:56.327 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.327 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:56.327 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:56.327 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:56.327 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.327 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 56040 2024-04-26T10:21:56.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.328 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.325636+0000", 2024-04-26T10:21:56.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.325636+0000", 2024-04-26T10:21:56.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.325635+0000", 2024-04-26T10:21:56.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:56.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.325671+0000", 2024-04-26T10:21:56.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6329999999999999e-05 2024-04-26T10:21:56.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.325683+0000", 2024-04-26T10:21:56.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2223e-05 2024-04-26T10:21:56.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.325690+0000", 2024-04-26T10:21:56.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.815e-06 2024-04-26T10:21:56.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.325729+0000", 2024-04-26T10:21:56.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8562000000000001e-05 2024-04-26T10:21:56.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.325831+0000", 2024-04-26T10:21:56.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010268399999999999 2024-04-26T10:21:56.331 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.331 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.331 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.331 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.331 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:21:56.331 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 1 2024-04-26T10:21:56.331 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:56.340 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:56.369 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:56.369 INFO:teuthology.orchestra.run.smithi120.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-26T10:21:56.369 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:56.405 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:56.400+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:56.463 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:56.463 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:21:56.463 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:21:56.463 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:21:56.463 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:56.475 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:56.505 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:56.500+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:56.607 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:56.604+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:56.611 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:56.611 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:21:56.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:21:56.611 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:56.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.611 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.306615244, 2024-04-26T10:21:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018441564000000001, 2024-04-26T10:21:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301372+0000", 2024-04-26T10:21:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301399+0000", 2024-04-26T10:21:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7039999999999999e-05 2024-04-26T10:21:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301426+0000", 2024-04-26T10:21:56.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6381e-05 2024-04-26T10:21:56.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301480+0000", 2024-04-26T10:21:56.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3681000000000003e-05 2024-04-26T10:21:56.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310584+0000", 2024-04-26T10:21:56.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091042339999999992 2024-04-26T10:21:56.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310591+0000", 2024-04-26T10:21:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8190000000000003e-06 2024-04-26T10:21:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311503+0000", 2024-04-26T10:21:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000911983 2024-04-26T10:21:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311605+0000", 2024-04-26T10:21:56.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102619 2024-04-26T10:21:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311730+0000", 2024-04-26T10:21:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012474400000000001 2024-04-26T10:21:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317287+0000", 2024-04-26T10:21:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055571140000000002 2024-04-26T10:21:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319724+0000", 2024-04-26T10:21:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002437294 2024-04-26T10:21:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319776+0000", 2024-04-26T10:21:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1992e-05 2024-04-26T10:21:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319816+0000", 2024-04-26T10:21:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9709999999999998e-05 2024-04-26T10:21:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.301206016999998, 2024-04-26T10:21:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013859405999999999, 2024-04-26T10:21:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306784+0000", 2024-04-26T10:21:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306783+0000", 2024-04-26T10:21:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306788+0000", 2024-04-26T10:21:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3990000000000003e-06 2024-04-26T10:21:56.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306796+0000", 2024-04-26T10:21:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8820000000000001e-06 2024-04-26T10:21:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306803+0000", 2024-04-26T10:21:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6649999999999997e-06 2024-04-26T10:21:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314454+0000", 2024-04-26T10:21:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076508349999999999 2024-04-26T10:21:56.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.314930+0000", 2024-04-26T10:21:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047624199999999998 2024-04-26T10:21:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315127+0000", 2024-04-26T10:21:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196751 2024-04-26T10:21:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320496+0000", 2024-04-26T10:21:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053690150000000004 2024-04-26T10:21:56.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320576+0000", 2024-04-26T10:21:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0327999999999994e-05 2024-04-26T10:21:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320611+0000", 2024-04-26T10:21:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4489999999999997e-05 2024-04-26T10:21:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320643+0000", 2024-04-26T10:21:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2474000000000001e-05 2024-04-26T10:21:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 47.301126846000003, 2024-04-26T10:21:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013889195, 2024-04-26T10:21:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306863+0000", 2024-04-26T10:21:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306862+0000", 2024-04-26T10:21:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306867+0000", 2024-04-26T10:21:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5390000000000001e-06 2024-04-26T10:21:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306874+0000", 2024-04-26T10:21:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7549999999999997e-06 2024-04-26T10:21:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.306887+0000", 2024-04-26T10:21:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.313e-05 2024-04-26T10:21:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315477+0000", 2024-04-26T10:21:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085902489999999995 2024-04-26T10:21:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315607+0000", 2024-04-26T10:21:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129789 2024-04-26T10:21:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.315767+0000", 2024-04-26T10:21:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016052699999999999 2024-04-26T10:21:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320502+0000", 2024-04-26T10:21:56.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00473421 2024-04-26T10:21:56.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320691+0000", 2024-04-26T10:21:56.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018938900000000001 2024-04-26T10:21:56.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320721+0000", 2024-04-26T10:21:56.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9677000000000001e-05 2024-04-26T10:21:56.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.320752+0000", 2024-04-26T10:21:56.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1486000000000003e-05 2024-04-26T10:21:56.628 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.628 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.628 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.628 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:24863 5.e e27/22 5:70815639:::benchmark_data_smithi052_19421_object24862:head v 27'1571, mlcod=27'1569)", 2024-04-26T10:21:56.628 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:56.628 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.054684303, 2024-04-26T10:21:56.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014429724999999999, 2024-04-26T10:21:56.628 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.628 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.629 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:56.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553305+0000", 2024-04-26T10:21:56.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553304+0000", 2024-04-26T10:21:56.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553377+0000", 2024-04-26T10:21:56.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3206000000000003e-05 2024-04-26T10:21:56.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553397+0000", 2024-04-26T10:21:56.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9366000000000001e-05 2024-04-26T10:21:56.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553407+0000", 2024-04-26T10:21:56.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0676000000000001e-05 2024-04-26T10:21:56.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553467+0000", 2024-04-26T10:21:56.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9735999999999999e-05 2024-04-26T10:21:56.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.553486+0000", 2024-04-26T10:21:56.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8842e-05 2024-04-26T10:21:56.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.567649+0000", 2024-04-26T10:21:56.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01416272 2024-04-26T10:21:56.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:42.567735+0000", 2024-04-26T10:21:56.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6363e-05 2024-04-26T10:21:56.632 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.632 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.632 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.632 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45088 5.a 5:590632b0:::benchmark_data_smithi052_19421_object45087:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:56.632 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.670144+0000", 2024-04-26T10:21:56.632 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.9378460200000003, 2024-04-26T10:21:56.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013987737, 2024-04-26T10:21:56.632 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.633 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.633 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:56.633 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:56.633 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.633 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45088 2024-04-26T10:21:56.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.633 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670144+0000", 2024-04-26T10:21:56.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670144+0000", 2024-04-26T10:21:56.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670143+0000", 2024-04-26T10:21:56.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670207+0000", 2024-04-26T10:21:56.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.389e-05 2024-04-26T10:21:56.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670216+0000", 2024-04-26T10:21:56.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2730000000000008e-06 2024-04-26T10:21:56.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670221+0000", 2024-04-26T10:21:56.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5700000000000003e-06 2024-04-26T10:21:56.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.672563+0000", 2024-04-26T10:21:56.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0023421760000000001 2024-04-26T10:21:56.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.672728+0000", 2024-04-26T10:21:56.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000165112 2024-04-26T10:21:56.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.683924+0000", 2024-04-26T10:21:56.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011196330000000001 2024-04-26T10:21:56.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.684045+0000", 2024-04-26T10:21:56.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012078000000000001 2024-04-26T10:21:56.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.684131+0000", 2024-04-26T10:21:56.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6481000000000001e-05 2024-04-26T10:21:56.637 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.637 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.637 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.637 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45090 5.a 5:5255ea9c:::benchmark_data_smithi052_19421_object45089:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:56.637 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.670235+0000", 2024-04-26T10:21:56.637 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.9377545449999998, 2024-04-26T10:21:56.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014033166999999999, 2024-04-26T10:21:56.637 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.637 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.638 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:56.638 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:56.638 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.638 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45090 2024-04-26T10:21:56.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.638 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670235+0000", 2024-04-26T10:21:56.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670235+0000", 2024-04-26T10:21:56.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670235+0000", 2024-04-26T10:21:56.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670300+0000", 2024-04-26T10:21:56.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5100999999999999e-05 2024-04-26T10:21:56.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670308+0000", 2024-04-26T10:21:56.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5259999999999993e-06 2024-04-26T10:21:56.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.670313+0000", 2024-04-26T10:21:56.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.437e-06 2024-04-26T10:21:56.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.675953+0000", 2024-04-26T10:21:56.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056399220000000003 2024-04-26T10:21:56.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.676040+0000", 2024-04-26T10:21:56.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7012e-05 2024-04-26T10:21:56.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.684145+0000", 2024-04-26T10:21:56.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0081054620000000008 2024-04-26T10:21:56.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.684209+0000", 2024-04-26T10:21:56.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3765999999999999e-05 2024-04-26T10:21:56.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.684268+0000", 2024-04-26T10:21:56.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9537000000000003e-05 2024-04-26T10:21:56.642 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.642 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.642 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.642 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45174 5.0 5:032622a5:::benchmark_data_smithi052_19421_object45173:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:56.642 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.704887+0000", 2024-04-26T10:21:56.642 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.9031024710000004, 2024-04-26T10:21:56.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016545051000000002, 2024-04-26T10:21:56.642 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.642 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.642 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:56.642 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:56.643 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.643 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45174 2024-04-26T10:21:56.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.643 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.704887+0000", 2024-04-26T10:21:56.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.704887+0000", 2024-04-26T10:21:56.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.704886+0000", 2024-04-26T10:21:56.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.704993+0000", 2024-04-26T10:21:56.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000106517 2024-04-26T10:21:56.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.705008+0000", 2024-04-26T10:21:56.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5534000000000001e-05 2024-04-26T10:21:56.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.705017+0000", 2024-04-26T10:21:56.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7979999999999995e-06 2024-04-26T10:21:56.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.705087+0000", 2024-04-26T10:21:56.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0426999999999995e-05 2024-04-26T10:21:56.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.705239+0000", 2024-04-26T10:21:56.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151154 2024-04-26T10:21:56.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721301+0000", 2024-04-26T10:21:56.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016062456999999999 2024-04-26T10:21:56.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721353+0000", 2024-04-26T10:21:56.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1892999999999999e-05 2024-04-26T10:21:56.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721432+0000", 2024-04-26T10:21:56.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9358999999999997e-05 2024-04-26T10:21:56.647 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.647 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.647 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.647 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45181 5.8 5:13f857b3:::benchmark_data_smithi052_19421_object45180:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:56.647 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.707868+0000", 2024-04-26T10:21:56.647 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.9001213359999998, 2024-04-26T10:21:56.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015842045999999999, 2024-04-26T10:21:56.647 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.647 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.647 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:56.647 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:56.647 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.648 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45181 2024-04-26T10:21:56.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.648 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707868+0000", 2024-04-26T10:21:56.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707868+0000", 2024-04-26T10:21:56.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707868+0000", 2024-04-26T10:21:56.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707915+0000", 2024-04-26T10:21:56.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7101000000000002e-05 2024-04-26T10:21:56.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707925+0000", 2024-04-26T10:21:56.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7540000000000001e-06 2024-04-26T10:21:56.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707933+0000", 2024-04-26T10:21:56.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4849999999999992e-06 2024-04-26T10:21:56.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.708001+0000", 2024-04-26T10:21:56.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8262999999999993e-05 2024-04-26T10:21:56.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.708229+0000", 2024-04-26T10:21:56.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022797900000000001 2024-04-26T10:21:56.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723592+0000", 2024-04-26T10:21:56.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015363039 2024-04-26T10:21:56.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723645+0000", 2024-04-26T10:21:56.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2899000000000003e-05 2024-04-26T10:21:56.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723710+0000", 2024-04-26T10:21:56.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5166000000000006e-05 2024-04-26T10:21:56.651 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.651 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.652 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.652 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45188 5.8 5:1d98f307:::benchmark_data_smithi052_19421_object45187:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:56.652 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.709354+0000", 2024-04-26T10:21:56.652 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8986361240000003, 2024-04-26T10:21:56.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01444054, 2024-04-26T10:21:56.652 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.652 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.652 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:56.652 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:56.652 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.652 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45188 2024-04-26T10:21:56.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.652 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709354+0000", 2024-04-26T10:21:56.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709354+0000", 2024-04-26T10:21:56.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709353+0000", 2024-04-26T10:21:56.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709392+0000", 2024-04-26T10:21:56.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9233000000000002e-05 2024-04-26T10:21:56.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709400+0000", 2024-04-26T10:21:56.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4719999999999998e-06 2024-04-26T10:21:56.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709406+0000", 2024-04-26T10:21:56.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7989999999999999e-06 2024-04-26T10:21:56.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.713808+0000", 2024-04-26T10:21:56.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044027090000000003 2024-04-26T10:21:56.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.713972+0000", 2024-04-26T10:21:56.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000163635 2024-04-26T10:21:56.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723718+0000", 2024-04-26T10:21:56.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0097456680000000007 2024-04-26T10:21:56.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723747+0000", 2024-04-26T10:21:56.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9788e-05 2024-04-26T10:21:56.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723794+0000", 2024-04-26T10:21:56.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6826000000000002e-05 2024-04-26T10:21:56.656 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.656 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.656 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.657 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45189 5.8 5:1231b8d6:::benchmark_data_smithi052_19421_object45188:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:56.657 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.709778+0000", 2024-04-26T10:21:56.657 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8982118740000002, 2024-04-26T10:21:56.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014196112, 2024-04-26T10:21:56.657 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.657 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.657 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:56.657 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:56.657 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.657 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45189 2024-04-26T10:21:56.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.657 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709778+0000", 2024-04-26T10:21:56.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709778+0000", 2024-04-26T10:21:56.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709777+0000", 2024-04-26T10:21:56.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709901+0000", 2024-04-26T10:21:56.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000124218 2024-04-26T10:21:56.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709914+0000", 2024-04-26T10:21:56.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2680000000000001e-05 2024-04-26T10:21:56.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.709923+0000", 2024-04-26T10:21:56.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8779999999999993e-06 2024-04-26T10:21:56.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.716807+0000", 2024-04-26T10:21:56.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0068834450000000002 2024-04-26T10:21:56.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.716964+0000", 2024-04-26T10:21:56.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015735799999999999 2024-04-26T10:21:56.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723875+0000", 2024-04-26T10:21:56.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069109849999999997 2024-04-26T10:21:56.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723908+0000", 2024-04-26T10:21:56.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2855000000000003e-05 2024-04-26T10:21:56.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723974+0000", 2024-04-26T10:21:56.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5820000000000003e-05 2024-04-26T10:21:56.661 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.661 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.661 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.662 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45191 5.8 5:13552580:::benchmark_data_smithi052_19421_object45190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:56.662 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.710022+0000", 2024-04-26T10:21:56.662 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.8979679469999997, 2024-04-26T10:21:56.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016838605999999999, 2024-04-26T10:21:56.662 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.662 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.662 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:56.662 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:56.662 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.662 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45191 2024-04-26T10:21:56.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.662 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710022+0000", 2024-04-26T10:21:56.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710022+0000", 2024-04-26T10:21:56.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710021+0000", 2024-04-26T10:21:56.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710087+0000", 2024-04-26T10:21:56.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6248000000000007e-05 2024-04-26T10:21:56.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710106+0000", 2024-04-26T10:21:56.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8357000000000001e-05 2024-04-26T10:21:56.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710110+0000", 2024-04-26T10:21:56.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3989999999999997e-06 2024-04-26T10:21:56.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.720365+0000", 2024-04-26T10:21:56.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010254733 2024-04-26T10:21:56.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.720471+0000", 2024-04-26T10:21:56.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000106 2024-04-26T10:21:56.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.726665+0000", 2024-04-26T10:21:56.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006194003 2024-04-26T10:21:56.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.726769+0000", 2024-04-26T10:21:56.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104131 2024-04-26T10:21:56.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.726860+0000", 2024-04-26T10:21:56.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1552999999999996e-05 2024-04-26T10:21:56.667 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.667 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.667 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.667 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45197 5.a 5:57bdb4dc:::benchmark_data_smithi052_19421_object45196:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:56.667 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.720931+0000", 2024-04-26T10:21:56.667 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.887058262, 2024-04-26T10:21:56.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014117672, 2024-04-26T10:21:56.667 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.667 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.667 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:56.667 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:56.667 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.667 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45197 2024-04-26T10:21:56.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.668 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.720931+0000", 2024-04-26T10:21:56.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.720931+0000", 2024-04-26T10:21:56.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.720931+0000", 2024-04-26T10:21:56.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721041+0000", 2024-04-26T10:21:56.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110288 2024-04-26T10:21:56.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721048+0000", 2024-04-26T10:21:56.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9190000000000002e-06 2024-04-26T10:21:56.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721052+0000", 2024-04-26T10:21:56.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5349999999999998e-06 2024-04-26T10:21:56.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723060+0000", 2024-04-26T10:21:56.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020076289999999999 2024-04-26T10:21:56.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723332+0000", 2024-04-26T10:21:56.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027210899999999998 2024-04-26T10:21:56.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.734970+0000", 2024-04-26T10:21:56.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011637922 2024-04-26T10:21:56.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.735003+0000", 2024-04-26T10:21:56.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2561000000000002e-05 2024-04-26T10:21:56.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.735049+0000", 2024-04-26T10:21:56.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6507e-05 2024-04-26T10:21:56.671 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.672 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.672 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.672 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:47235 5.e 5:7fbfb3de:::benchmark_data_smithi052_19421_object47234:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:56.672 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:52.534893+0000", 2024-04-26T10:21:56.672 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.0730966200000003, 2024-04-26T10:21:56.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014645362, 2024-04-26T10:21:56.672 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.672 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.672 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:56.672 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:56.672 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.672 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 47235 2024-04-26T10:21:56.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.673 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.534893+0000", 2024-04-26T10:21:56.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.534893+0000", 2024-04-26T10:21:56.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.534893+0000", 2024-04-26T10:21:56.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.534923+0000", 2024-04-26T10:21:56.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0380999999999999e-05 2024-04-26T10:21:56.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.534928+0000", 2024-04-26T10:21:56.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.685e-06 2024-04-26T10:21:56.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.534931+0000", 2024-04-26T10:21:56.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0079999999999998e-06 2024-04-26T10:21:56.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.540936+0000", 2024-04-26T10:21:56.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0060048519999999998 2024-04-26T10:21:56.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.541142+0000", 2024-04-26T10:21:56.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020689600000000001 2024-04-26T10:21:56.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.549456+0000", 2024-04-26T10:21:56.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083134420000000007 2024-04-26T10:21:56.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.549494+0000", 2024-04-26T10:21:56.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8164999999999998e-05 2024-04-26T10:21:56.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.549538+0000", 2024-04-26T10:21:56.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4384000000000001e-05 2024-04-26T10:21:56.676 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.676 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.677 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.677 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:54948 5.0 5:0f5c60af:::benchmark_data_smithi052_19421_object54947:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.677 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:55.837736+0000", 2024-04-26T10:21:56.677 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.77025336600000005, 2024-04-26T10:21:56.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014667217999999999, 2024-04-26T10:21:56.677 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.677 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.677 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:56.677 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:56.677 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.677 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 54948 2024-04-26T10:21:56.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.678 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.837736+0000", 2024-04-26T10:21:56.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.837736+0000", 2024-04-26T10:21:56.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.837735+0000", 2024-04-26T10:21:56.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.837794+0000", 2024-04-26T10:21:56.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8331000000000001e-05 2024-04-26T10:21:56.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.837805+0000", 2024-04-26T10:21:56.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1576000000000001e-05 2024-04-26T10:21:56.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.837814+0000", 2024-04-26T10:21:56.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7919999999999998e-06 2024-04-26T10:21:56.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.840990+0000", 2024-04-26T10:21:56.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031754230000000001 2024-04-26T10:21:56.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.841127+0000", 2024-04-26T10:21:56.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013785199999999999 2024-04-26T10:21:56.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.852324+0000", 2024-04-26T10:21:56.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011196894000000001 2024-04-26T10:21:56.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.852358+0000", 2024-04-26T10:21:56.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3544000000000003e-05 2024-04-26T10:21:56.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.852404+0000", 2024-04-26T10:21:56.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5680000000000003e-05 2024-04-26T10:21:56.682 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.682 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.682 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.682 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:54951 5.0 5:0e404ac7:::benchmark_data_smithi052_19421_object54950:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.682 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:55.838223+0000", 2024-04-26T10:21:56.682 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.76976698700000001, 2024-04-26T10:21:56.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014254565, 2024-04-26T10:21:56.682 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.682 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:56.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:56.683 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.683 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 54951 2024-04-26T10:21:56.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.683 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.838223+0000", 2024-04-26T10:21:56.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.838223+0000", 2024-04-26T10:21:56.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.838222+0000", 2024-04-26T10:21:56.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.838330+0000", 2024-04-26T10:21:56.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000108235 2024-04-26T10:21:56.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.838344+0000", 2024-04-26T10:21:56.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3665999999999999e-05 2024-04-26T10:21:56.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.838361+0000", 2024-04-26T10:21:56.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7005999999999999e-05 2024-04-26T10:21:56.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.843594+0000", 2024-04-26T10:21:56.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052330789999999999 2024-04-26T10:21:56.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.843851+0000", 2024-04-26T10:21:56.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025747699999999999 2024-04-26T10:21:56.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.852412+0000", 2024-04-26T10:21:56.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085607849999999996 2024-04-26T10:21:56.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.852439+0000", 2024-04-26T10:21:56.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.656e-05 2024-04-26T10:21:56.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.852477+0000", 2024-04-26T10:21:56.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8593000000000001e-05 2024-04-26T10:21:56.687 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.687 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.687 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.687 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:55791 5.a 5:51807120:::benchmark_data_smithi052_19421_object55790:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.687 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:56.214578+0000", 2024-04-26T10:21:56.687 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.39341182600000002, 2024-04-26T10:21:56.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014932202, 2024-04-26T10:21:56.687 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.687 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.687 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:56.687 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:56.687 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.688 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 55791 2024-04-26T10:21:56.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.688 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.214578+0000", 2024-04-26T10:21:56.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.214578+0000", 2024-04-26T10:21:56.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.214577+0000", 2024-04-26T10:21:56.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.214621+0000", 2024-04-26T10:21:56.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4168000000000001e-05 2024-04-26T10:21:56.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.214632+0000", 2024-04-26T10:21:56.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0402e-05 2024-04-26T10:21:56.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.214639+0000", 2024-04-26T10:21:56.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1420000000000004e-06 2024-04-26T10:21:56.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.216402+0000", 2024-04-26T10:21:56.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001762572 2024-04-26T10:21:56.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.216575+0000", 2024-04-26T10:21:56.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000173532 2024-04-26T10:21:56.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.229436+0000", 2024-04-26T10:21:56.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012861236999999999 2024-04-26T10:21:56.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.229467+0000", 2024-04-26T10:21:56.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1084000000000003e-05 2024-04-26T10:21:56.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.229510+0000", 2024-04-26T10:21:56.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2713000000000003e-05 2024-04-26T10:21:56.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.691 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.692 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.692 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:55795 5.a 5:54e0ec7e:::benchmark_data_smithi052_19421_object55794:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.692 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:56.215002+0000", 2024-04-26T10:21:56.692 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.39298819499999998, 2024-04-26T10:21:56.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014568997, 2024-04-26T10:21:56.692 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.692 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:56.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:56.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.692 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 55795 2024-04-26T10:21:56.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.693 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.215002+0000", 2024-04-26T10:21:56.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.215002+0000", 2024-04-26T10:21:56.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.215001+0000", 2024-04-26T10:21:56.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.215039+0000", 2024-04-26T10:21:56.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8175e-05 2024-04-26T10:21:56.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.215055+0000", 2024-04-26T10:21:56.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6566e-05 2024-04-26T10:21:56.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.215064+0000", 2024-04-26T10:21:56.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7739999999999993e-06 2024-04-26T10:21:56.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.220040+0000", 2024-04-26T10:21:56.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0049759679999999999 2024-04-26T10:21:56.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.220247+0000", 2024-04-26T10:21:56.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020707599999999999 2024-04-26T10:21:56.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.229517+0000", 2024-04-26T10:21:56.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0092697620000000008 2024-04-26T10:21:56.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.229540+0000", 2024-04-26T10:21:56.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2886000000000001e-05 2024-04-26T10:21:56.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.229571+0000", 2024-04-26T10:21:56.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0735999999999998e-05 2024-04-26T10:21:56.696 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.696 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.697 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.697 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:55945 5.4 5:2e965466:::benchmark_data_smithi052_19421_object55944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.697 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:56.281026+0000", 2024-04-26T10:21:56.697 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.32696357199999998, 2024-04-26T10:21:56.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014484255999999999, 2024-04-26T10:21:56.697 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.697 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.697 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:56.697 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:56.697 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.697 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 55945 2024-04-26T10:21:56.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.698 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.281026+0000", 2024-04-26T10:21:56.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.281026+0000", 2024-04-26T10:21:56.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.281026+0000", 2024-04-26T10:21:56.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.281062+0000", 2024-04-26T10:21:56.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6560999999999998e-05 2024-04-26T10:21:56.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.281070+0000", 2024-04-26T10:21:56.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6149999999999999e-06 2024-04-26T10:21:56.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.281076+0000", 2024-04-26T10:21:56.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8950000000000003e-06 2024-04-26T10:21:56.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.282642+0000", 2024-04-26T10:21:56.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015663610000000001 2024-04-26T10:21:56.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.282811+0000", 2024-04-26T10:21:56.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016928000000000001 2024-04-26T10:21:56.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.295418+0000", 2024-04-26T10:21:56.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012606206999999999 2024-04-26T10:21:56.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.295446+0000", 2024-04-26T10:21:56.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8694999999999999e-05 2024-04-26T10:21:56.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.295510+0000", 2024-04-26T10:21:56.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4183000000000005e-05 2024-04-26T10:21:56.701 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.701 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.701 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.702 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:55946 5.4 5:2105a9b5:::benchmark_data_smithi052_19421_object55945:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.702 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:56.281114+0000", 2024-04-26T10:21:56.702 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.32687621, 2024-04-26T10:21:56.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014477977, 2024-04-26T10:21:56.702 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.702 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.702 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:56.702 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:56.702 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.702 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 55946 2024-04-26T10:21:56.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.702 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.281114+0000", 2024-04-26T10:21:56.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.281114+0000", 2024-04-26T10:21:56.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.281113+0000", 2024-04-26T10:21:56.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.281148+0000", 2024-04-26T10:21:56.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4727999999999997e-05 2024-04-26T10:21:56.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.281156+0000", 2024-04-26T10:21:56.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1470000000000001e-06 2024-04-26T10:21:56.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.281162+0000", 2024-04-26T10:21:56.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0669999999999997e-06 2024-04-26T10:21:56.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.285174+0000", 2024-04-26T10:21:56.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040124849999999997 2024-04-26T10:21:56.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.285285+0000", 2024-04-26T10:21:56.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110221 2024-04-26T10:21:56.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.295524+0000", 2024-04-26T10:21:56.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01023959 2024-04-26T10:21:56.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.295549+0000", 2024-04-26T10:21:56.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4440999999999999e-05 2024-04-26T10:21:56.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.295591+0000", 2024-04-26T10:21:56.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2858000000000002e-05 2024-04-26T10:21:56.706 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.706 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.706 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.707 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:55950 5.4 5:26b63144:::benchmark_data_smithi052_19421_object55949:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.707 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:56.283106+0000", 2024-04-26T10:21:56.707 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.32488346099999998, 2024-04-26T10:21:56.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014326200000000001, 2024-04-26T10:21:56.707 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:56.707 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:56.707 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:56.707 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:56.707 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.707 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 55950 2024-04-26T10:21:56.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.707 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:56.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:56.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.283106+0000", 2024-04-26T10:21:56.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:56.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.283106+0000", 2024-04-26T10:21:56.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:56.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:56.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.283106+0000", 2024-04-26T10:21:56.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:56.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.283135+0000", 2024-04-26T10:21:56.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9034e-05 2024-04-26T10:21:56.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:56.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.283142+0000", 2024-04-26T10:21:56.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8569999999999997e-06 2024-04-26T10:21:56.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.283147+0000", 2024-04-26T10:21:56.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5979999999999996e-06 2024-04-26T10:21:56.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:56.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.287415+0000", 2024-04-26T10:21:56.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00426773 2024-04-26T10:21:56.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:56.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.287503+0000", 2024-04-26T10:21:56.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7775999999999994e-05 2024-04-26T10:21:56.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:56.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.297312+0000", 2024-04-26T10:21:56.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098090929999999996 2024-04-26T10:21:56.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:56.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.297361+0000", 2024-04-26T10:21:56.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9549999999999998e-05 2024-04-26T10:21:56.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:56.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:56.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:56.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.297432+0000", 2024-04-26T10:21:56.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1169999999999998e-05 2024-04-26T10:21:56.711 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.711 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.711 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.711 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:56.712 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:56.712 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:56.713 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 23 16 56707 56691 154.034 141.625 0.00443757 0.00648608 2024-04-26T10:21:56.713 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:56.708+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:56.714 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:56.814 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:56.813+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:56.847 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:56.847 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:56.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.847 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:57232 5.d 5:bc87ba25:::benchmark_data_smithi052_19421_object57231:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.847 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:56.840966+0000", 2024-04-26T10:21:56.847 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0041563700000000004, 2024-04-26T10:21:56.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042161639999999997, 2024-04-26T10:21:56.847 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.847 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:56.847 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.847 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.848 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 57232 2024-04-26T10:21:56.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.848 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.840966+0000", 2024-04-26T10:21:56.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.840966+0000", 2024-04-26T10:21:56.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.840965+0000", 2024-04-26T10:21:56.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.841039+0000", 2024-04-26T10:21:56.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4328999999999999e-05 2024-04-26T10:21:56.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.841054+0000", 2024-04-26T10:21:56.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4810000000000001e-05 2024-04-26T10:21:56.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.841062+0000", 2024-04-26T10:21:56.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9929999999999995e-06 2024-04-26T10:21:56.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.841117+0000", 2024-04-26T10:21:56.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4996e-05 2024-04-26T10:21:56.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.841297+0000", 2024-04-26T10:21:56.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018047699999999999 2024-04-26T10:21:56.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.841427+0000", 2024-04-26T10:21:56.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129472 2024-04-26T10:21:56.851 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.851 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.851 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.851 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:57233 5.5 5:a461713d:::benchmark_data_smithi052_19421_object57232:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.851 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:56.841077+0000", 2024-04-26T10:21:56.851 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0040457560000000002, 2024-04-26T10:21:56.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042222290000000001, 2024-04-26T10:21:56.851 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.851 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:56.851 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.851 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.852 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.852 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 57233 2024-04-26T10:21:56.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.852 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.841077+0000", 2024-04-26T10:21:56.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.841077+0000", 2024-04-26T10:21:56.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.841076+0000", 2024-04-26T10:21:56.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.841114+0000", 2024-04-26T10:21:56.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7734000000000002e-05 2024-04-26T10:21:56.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.841129+0000", 2024-04-26T10:21:56.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5158e-05 2024-04-26T10:21:56.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.841135+0000", 2024-04-26T10:21:56.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5359999999999998e-06 2024-04-26T10:21:56.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.841176+0000", 2024-04-26T10:21:56.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0986999999999999e-05 2024-04-26T10:21:56.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.841336+0000", 2024-04-26T10:21:56.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016016000000000001 2024-04-26T10:21:56.854 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.854 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.854 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.855 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:57235 5.d 5:bf054db5:::benchmark_data_smithi052_19421_object57234:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.855 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:56.843834+0000", 2024-04-26T10:21:56.855 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0012886270000000001, 2024-04-26T10:21:56.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001530874, 2024-04-26T10:21:56.855 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.855 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:56.855 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.855 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.855 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.855 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 57235 2024-04-26T10:21:56.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.855 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.843834+0000", 2024-04-26T10:21:56.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.843834+0000", 2024-04-26T10:21:56.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.843833+0000", 2024-04-26T10:21:56.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.843906+0000", 2024-04-26T10:21:56.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3570000000000002e-05 2024-04-26T10:21:56.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.843917+0000", 2024-04-26T10:21:56.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0861e-05 2024-04-26T10:21:56.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.843927+0000", 2024-04-26T10:21:56.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8570000000000007e-06 2024-04-26T10:21:56.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.843976+0000", 2024-04-26T10:21:56.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9407999999999999e-05 2024-04-26T10:21:56.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844105+0000", 2024-04-26T10:21:56.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129028 2024-04-26T10:21:56.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844256+0000", 2024-04-26T10:21:56.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015036100000000001 2024-04-26T10:21:56.858 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.859 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.859 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.859 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:57236 5.6 5:67b283de:::benchmark_data_smithi052_19421_object57235:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.859 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:56.843943+0000", 2024-04-26T10:21:56.859 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0011796560000000001, 2024-04-26T10:21:56.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014872240000000001, 2024-04-26T10:21:56.859 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.859 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:56.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.859 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 57236 2024-04-26T10:21:56.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.860 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.843943+0000", 2024-04-26T10:21:56.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.843943+0000", 2024-04-26T10:21:56.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.843942+0000", 2024-04-26T10:21:56.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.843981+0000", 2024-04-26T10:21:56.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8766000000000001e-05 2024-04-26T10:21:56.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.843989+0000", 2024-04-26T10:21:56.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6670000000000002e-06 2024-04-26T10:21:56.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.843996+0000", 2024-04-26T10:21:56.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3219999999999998e-06 2024-04-26T10:21:56.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844054+0000", 2024-04-26T10:21:56.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8721000000000002e-05 2024-04-26T10:21:56.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844191+0000", 2024-04-26T10:21:56.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013687500000000001 2024-04-26T10:21:56.862 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.863 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.863 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.863 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:57237 5.2 5:48ca11da:::benchmark_data_smithi052_19421_object57236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.863 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:56.844118+0000", 2024-04-26T10:21:56.863 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001004174, 2024-04-26T10:21:56.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013748149999999999, 2024-04-26T10:21:56.863 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.863 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:56.863 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.863 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.863 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.863 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 57237 2024-04-26T10:21:56.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.864 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844118+0000", 2024-04-26T10:21:56.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844118+0000", 2024-04-26T10:21:56.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844117+0000", 2024-04-26T10:21:56.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844188+0000", 2024-04-26T10:21:56.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0531999999999995e-05 2024-04-26T10:21:56.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844197+0000", 2024-04-26T10:21:56.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4569999999999994e-06 2024-04-26T10:21:56.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844227+0000", 2024-04-26T10:21:56.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9862e-05 2024-04-26T10:21:56.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844279+0000", 2024-04-26T10:21:56.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2182999999999998e-05 2024-04-26T10:21:56.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844407+0000", 2024-04-26T10:21:56.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012775699999999999 2024-04-26T10:21:56.866 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.866 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.867 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.867 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:57238 5.d 5.7b820abd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.867 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:56.844559+0000", 2024-04-26T10:21:56.867 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00056320800000000005, 2024-04-26T10:21:56.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00098920600000000007, 2024-04-26T10:21:56.867 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.867 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:21:56.867 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.867 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.867 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.867 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 57238 2024-04-26T10:21:56.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.867 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844559+0000", 2024-04-26T10:21:56.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844559+0000", 2024-04-26T10:21:56.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844558+0000", 2024-04-26T10:21:56.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844589+0000", 2024-04-26T10:21:56.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1399000000000002e-05 2024-04-26T10:21:56.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844599+0000", 2024-04-26T10:21:56.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5179999999999993e-06 2024-04-26T10:21:56.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844607+0000", 2024-04-26T10:21:56.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0779999999999996e-06 2024-04-26T10:21:56.869 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.869 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.869 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.870 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:57241 5.2 5.4e045ac2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.870 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:56.844620+0000", 2024-04-26T10:21:56.870 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00050274599999999999, 2024-04-26T10:21:56.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00097739900000000011, 2024-04-26T10:21:56.870 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.870 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:21:56.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.870 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.870 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 57241 2024-04-26T10:21:56.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.870 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844620+0000", 2024-04-26T10:21:56.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844620+0000", 2024-04-26T10:21:56.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844619+0000", 2024-04-26T10:21:56.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844650+0000", 2024-04-26T10:21:56.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0969000000000001e-05 2024-04-26T10:21:56.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844658+0000", 2024-04-26T10:21:56.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0669999999999992e-06 2024-04-26T10:21:56.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844663+0000", 2024-04-26T10:21:56.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6420000000000004e-06 2024-04-26T10:21:56.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.872 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.873 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:57232 5.d e33/22)", 2024-04-26T10:21:56.873 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:56.844753+0000", 2024-04-26T10:21:56.873 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00036956199999999998, 2024-04-26T10:21:56.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090294500000000005, 2024-04-26T10:21:56.873 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.873 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:21:56.873 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844753+0000", 2024-04-26T10:21:56.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844753+0000", 2024-04-26T10:21:56.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844752+0000", 2024-04-26T10:21:56.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844756+0000", 2024-04-26T10:21:56.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.245e-06 2024-04-26T10:21:56.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844769+0000", 2024-04-26T10:21:56.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2336e-05 2024-04-26T10:21:56.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844775+0000", 2024-04-26T10:21:56.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5849999999999996e-06 2024-04-26T10:21:56.875 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.875 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.875 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.875 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:57242 5.c 5:306e7565:::benchmark_data_smithi052_19421_object57241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.876 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:56.844986+0000", 2024-04-26T10:21:56.876 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00013616600000000001, 2024-04-26T10:21:56.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071543400000000004, 2024-04-26T10:21:56.876 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.876 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:56.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.876 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 57242 2024-04-26T10:21:56.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.876 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844986+0000", 2024-04-26T10:21:56.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844986+0000", 2024-04-26T10:21:56.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.844985+0000", 2024-04-26T10:21:56.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845070+0000", 2024-04-26T10:21:56.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5113999999999999e-05 2024-04-26T10:21:56.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845082+0000", 2024-04-26T10:21:56.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1708e-05 2024-04-26T10:21:56.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845088+0000", 2024-04-26T10:21:56.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3669999999999996e-06 2024-04-26T10:21:56.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845135+0000", 2024-04-26T10:21:56.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7298e-05 2024-04-26T10:21:56.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845277+0000", 2024-04-26T10:21:56.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142046 2024-04-26T10:21:56.879 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.879 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.879 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.879 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:57243 5.6 5.a5876626 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.879 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:56.845097+0000", 2024-04-26T10:21:56.880 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.5173000000000001e-05, 2024-04-26T10:21:56.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00065946899999999998, 2024-04-26T10:21:56.880 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.880 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:21:56.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.880 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 57243 2024-04-26T10:21:56.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.880 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845097+0000", 2024-04-26T10:21:56.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845097+0000", 2024-04-26T10:21:56.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845097+0000", 2024-04-26T10:21:56.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845162+0000", 2024-04-26T10:21:56.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5050999999999998e-05 2024-04-26T10:21:56.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845173+0000", 2024-04-26T10:21:56.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1415e-05 2024-04-26T10:21:56.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845177+0000", 2024-04-26T10:21:56.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8890000000000004e-06 2024-04-26T10:21:56.882 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.882 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.882 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.882 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:57244 5.f 5:fd614bc0:::benchmark_data_smithi052_19421_object57243:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.883 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:56.845185+0000", 2024-04-26T10:21:56.883 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999371, 2024-04-26T10:21:56.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062552400000000002, 2024-04-26T10:21:56.883 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.883 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:56.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.883 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 57244 2024-04-26T10:21:56.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.883 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845185+0000", 2024-04-26T10:21:56.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845185+0000", 2024-04-26T10:21:56.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845184+0000", 2024-04-26T10:21:56.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:56.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845223+0000", 2024-04-26T10:21:56.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8763000000000001e-05 2024-04-26T10:21:56.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845228+0000", 2024-04-26T10:21:56.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0930000000000002e-06 2024-04-26T10:21:56.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845232+0000", 2024-04-26T10:21:56.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5420000000000001e-06 2024-04-26T10:21:56.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845270+0000", 2024-04-26T10:21:56.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8534000000000001e-05 2024-04-26T10:21:56.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845379+0000", 2024-04-26T10:21:56.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010945700000000001 2024-04-26T10:21:56.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845494+0000", 2024-04-26T10:21:56.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114553 2024-04-26T10:21:56.886 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.886 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.886 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.886 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:57246 5.1 5:8f0f7053:::benchmark_data_smithi052_19421_object57245:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.886 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:56.845241+0000", 2024-04-26T10:21:56.887 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9998813, 2024-04-26T10:21:56.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00063505199999999999, 2024-04-26T10:21:56.887 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.887 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:21:56.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.887 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 57246 2024-04-26T10:21:56.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.887 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845241+0000", 2024-04-26T10:21:56.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845241+0000", 2024-04-26T10:21:56.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845241+0000", 2024-04-26T10:21:56.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845273+0000", 2024-04-26T10:21:56.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2203000000000003e-05 2024-04-26T10:21:56.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845278+0000", 2024-04-26T10:21:56.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2229999999999998e-06 2024-04-26T10:21:56.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845282+0000", 2024-04-26T10:21:56.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4580000000000002e-06 2024-04-26T10:21:56.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845314+0000", 2024-04-26T10:21:56.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2455e-05 2024-04-26T10:21:56.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845394+0000", 2024-04-26T10:21:56.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0345000000000004e-05 2024-04-26T10:21:56.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.890 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.890 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:57227 5.9 5:98e9cc0b:::benchmark_data_smithi052_19421_object57226:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:56.890 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:56.837466+0000", 2024-04-26T10:21:56.890 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0076558470000000003, 2024-04-26T10:21:56.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084704829999999991, 2024-04-26T10:21:56.890 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:56.890 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:21:56.890 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:56.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:56.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:56.891 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 57227 2024-04-26T10:21:56.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.891 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:56.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:56.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.837466+0000", 2024-04-26T10:21:56.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:56.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.837466+0000", 2024-04-26T10:21:56.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:56.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:56.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.837466+0000", 2024-04-26T10:21:56.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:56.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:56.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.837493+0000", 2024-04-26T10:21:56.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.745e-05 2024-04-26T10:21:56.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:56.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.837500+0000", 2024-04-26T10:21:56.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0820000000000001e-06 2024-04-26T10:21:56.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:56.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.837506+0000", 2024-04-26T10:21:56.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8019999999999997e-06 2024-04-26T10:21:56.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:56.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.841881+0000", 2024-04-26T10:21:56.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043744830000000002 2024-04-26T10:21:56.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:56.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.841999+0000", 2024-04-26T10:21:56.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118038 2024-04-26T10:21:56.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:56.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.842133+0000", 2024-04-26T10:21:56.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134046 2024-04-26T10:21:56.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:56.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:56.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:56.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.845818+0000", 2024-04-26T10:21:56.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036852170000000002 2024-04-26T10:21:56.894 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.894 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:56.894 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.894 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:56.894 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:21:56.894 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 13 2024-04-26T10:21:56.894 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:56.895 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:56.914 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:56.912+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:57.016 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:57.013+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:57.071 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:57.071 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:21:57.071 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:21:57.071 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:21:57.071 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:57.084 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:57.116 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:57.112+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:57.215 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:21:57.215 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:21:57.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:21:57.215 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:21:57.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.216 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:57.216 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:57.216 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 54.972388885000001, 2024-04-26T10:21:57.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018452342, 2024-04-26T10:21:57.216 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.216 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.216 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.216 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:57.216 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:57.216 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115 2024-04-26T10:21:57.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.216 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:57.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:21:57.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239018+0000", 2024-04-26T10:21:57.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239152+0000", 2024-04-26T10:21:57.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414699999999999 2024-04-26T10:21:57.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239169+0000", 2024-04-26T10:21:57.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7013000000000001e-05 2024-04-26T10:21:57.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239190+0000", 2024-04-26T10:21:57.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1302999999999999e-05 2024-04-26T10:21:57.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252181+0000", 2024-04-26T10:21:57.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012990213 2024-04-26T10:21:57.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252411+0000", 2024-04-26T10:21:57.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023010199999999999 2024-04-26T10:21:57.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:57.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252687+0000", 2024-04-26T10:21:57.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000276063 2024-04-26T10:21:57.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:57.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254694+0000", 2024-04-26T10:21:57.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020072879999999999 2024-04-26T10:21:57.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257399+0000", 2024-04-26T10:21:57.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027051670000000001 2024-04-26T10:21:57.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257442+0000", 2024-04-26T10:21:57.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-04-26T10:21:57.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257471+0000", 2024-04-26T10:21:57.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.889e-05 2024-04-26T10:21:57.221 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.221 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.222 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.222 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:57.222 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:57.222 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 54.972208356000003, 2024-04-26T10:21:57.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018350615000000001, 2024-04-26T10:21:57.222 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.222 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.222 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.222 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:57.222 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:57.223 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116 2024-04-26T10:21:57.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.223 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:57.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:21:57.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239198+0000", 2024-04-26T10:21:57.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239213+0000", 2024-04-26T10:21:57.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4965e-05 2024-04-26T10:21:57.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239235+0000", 2024-04-26T10:21:57.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.156e-05 2024-04-26T10:21:57.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239243+0000", 2024-04-26T10:21:57.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9470000000000003e-06 2024-04-26T10:21:57.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253284+0000", 2024-04-26T10:21:57.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014041392999999999 2024-04-26T10:21:57.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253376+0000", 2024-04-26T10:21:57.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1198000000000003e-05 2024-04-26T10:21:57.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:57.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253508+0000", 2024-04-26T10:21:57.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013220199999999999 2024-04-26T10:21:57.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:57.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255474+0000", 2024-04-26T10:21:57.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019665590000000001 2024-04-26T10:21:57.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257480+0000", 2024-04-26T10:21:57.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00200599 2024-04-26T10:21:57.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257515+0000", 2024-04-26T10:21:57.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5126000000000002e-05 2024-04-26T10:21:57.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257550+0000", 2024-04-26T10:21:57.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4394000000000003e-05 2024-04-26T10:21:57.227 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.227 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.227 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.228 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:57.228 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:57.228 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 54.972154799999998, 2024-04-26T10:21:57.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018369330999999999, 2024-04-26T10:21:57.228 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.228 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.228 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.228 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:57.228 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:57.228 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117 2024-04-26T10:21:57.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.228 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:57.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:21:57.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239252+0000", 2024-04-26T10:21:57.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:57.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239267+0000", 2024-04-26T10:21:57.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4562999999999999e-05 2024-04-26T10:21:57.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239281+0000", 2024-04-26T10:21:57.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4e-05 2024-04-26T10:21:57.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239296+0000", 2024-04-26T10:21:57.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5492999999999999e-05 2024-04-26T10:21:57.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254076+0000", 2024-04-26T10:21:57.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014779814 2024-04-26T10:21:57.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254159+0000", 2024-04-26T10:21:57.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2923999999999994e-05 2024-04-26T10:21:57.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:57.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254279+0000", 2024-04-26T10:21:57.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011964300000000001 2024-04-26T10:21:57.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:57.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.256043+0000", 2024-04-26T10:21:57.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001764353 2024-04-26T10:21:57.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257559+0000", 2024-04-26T10:21:57.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015159189999999999 2024-04-26T10:21:57.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257597+0000", 2024-04-26T10:21:57.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8031999999999998e-05 2024-04-26T10:21:57.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257622+0000", 2024-04-26T10:21:57.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5213999999999999e-05 2024-04-26T10:21:57.233 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.233 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.233 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.234 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:57.234 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:57.234 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 54.561416127000001, 2024-04-26T10:21:57.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019547338000000001, 2024-04-26T10:21:57.234 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.234 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.234 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.234 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:57.234 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:57.234 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165 2024-04-26T10:21:57.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.234 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:57.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:57.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:21:57.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649996+0000", 2024-04-26T10:21:57.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-04-26T10:21:57.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650021+0000", 2024-04-26T10:21:57.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5179999999999999e-05 2024-04-26T10:21:57.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650030+0000", 2024-04-26T10:21:57.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-04-26T10:21:57.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664733+0000", 2024-04-26T10:21:57.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014703097 2024-04-26T10:21:57.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664821+0000", 2024-04-26T10:21:57.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7918999999999996e-05 2024-04-26T10:21:57.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:57.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664953+0000", 2024-04-26T10:21:57.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132662 2024-04-26T10:21:57.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:57.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666776+0000", 2024-04-26T10:21:57.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018225509999999999 2024-04-26T10:21:57.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669480+0000", 2024-04-26T10:21:57.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00270382 2024-04-26T10:21:57.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669515+0000", 2024-04-26T10:21:57.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4885000000000002e-05 2024-04-26T10:21:57.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669539+0000", 2024-04-26T10:21:57.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4121000000000002e-05 2024-04-26T10:21:57.240 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.240 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.240 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.240 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:185 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:57.240 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:57.240 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 54.371893018000002, 2024-04-26T10:21:57.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017833541000000001, 2024-04-26T10:21:57.240 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.240 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.240 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.240 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:57.240 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:57.241 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185 2024-04-26T10:21:57.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.241 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:57.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839515+0000", 2024-04-26T10:21:57.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839514+0000", 2024-04-26T10:21:57.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:57.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839612+0000", 2024-04-26T10:21:57.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7880999999999993e-05 2024-04-26T10:21:57.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839623+0000", 2024-04-26T10:21:57.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0917000000000001e-05 2024-04-26T10:21:57.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839632+0000", 2024-04-26T10:21:57.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0999999999999993e-06 2024-04-26T10:21:57.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850382+0000", 2024-04-26T10:21:57.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010750335 2024-04-26T10:21:57.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850502+0000", 2024-04-26T10:21:57.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120183 2024-04-26T10:21:57.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:57.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.850685+0000", 2024-04-26T10:21:57.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000182442 2024-04-26T10:21:57.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854396+0000", 2024-04-26T10:21:57.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037114819999999999 2024-04-26T10:21:57.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:57.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857233+0000", 2024-04-26T10:21:57.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002836514 2024-04-26T10:21:57.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857300+0000", 2024-04-26T10:21:57.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6842999999999997e-05 2024-04-26T10:21:57.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857348+0000", 2024-04-26T10:21:57.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8504000000000002e-05 2024-04-26T10:21:57.245 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.245 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.246 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.246 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:57.246 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:57.246 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 54.371766667000003, 2024-04-26T10:21:57.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018757273000000001, 2024-04-26T10:21:57.246 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.246 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.246 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.246 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:57.246 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:57.246 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 186 2024-04-26T10:21:57.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.247 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:57.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:21:57.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839640+0000", 2024-04-26T10:21:57.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839646+0000", 2024-04-26T10:21:57.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:21:57.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839654+0000", 2024-04-26T10:21:57.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:21:57.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839661+0000", 2024-04-26T10:21:57.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.64e-06 2024-04-26T10:21:57.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852328+0000", 2024-04-26T10:21:57.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012667151 2024-04-26T10:21:57.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852538+0000", 2024-04-26T10:21:57.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020961100000000001 2024-04-26T10:21:57.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:57.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852945+0000", 2024-04-26T10:21:57.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040712099999999998 2024-04-26T10:21:57.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857372+0000", 2024-04-26T10:21:57.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044268049999999998 2024-04-26T10:21:57.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:57.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858321+0000", 2024-04-26T10:21:57.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094932999999999997 2024-04-26T10:21:57.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858367+0000", 2024-04-26T10:21:57.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5534000000000001e-05 2024-04-26T10:21:57.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858398+0000", 2024-04-26T10:21:57.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1562e-05 2024-04-26T10:21:57.254 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.254 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.254 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.255 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:57.255 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:57.255 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 54.371739501, 2024-04-26T10:21:57.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019669504000000001, 2024-04-26T10:21:57.255 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.255 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:57.255 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:57.255 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187 2024-04-26T10:21:57.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.255 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:57.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:21:57.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839667+0000", 2024-04-26T10:21:57.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:57.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839677+0000", 2024-04-26T10:21:57.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3270000000000007e-06 2024-04-26T10:21:57.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839685+0000", 2024-04-26T10:21:57.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2670000000000006e-06 2024-04-26T10:21:57.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839692+0000", 2024-04-26T10:21:57.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7129999999999999e-06 2024-04-26T10:21:57.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853685+0000", 2024-04-26T10:21:57.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013993716999999999 2024-04-26T10:21:57.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853876+0000", 2024-04-26T10:21:57.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019097100000000001 2024-04-26T10:21:57.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:57.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853989+0000", 2024-04-26T10:21:57.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011275199999999999 2024-04-26T10:21:57.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857377+0000", 2024-04-26T10:21:57.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033882489999999999 2024-04-26T10:21:57.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:57.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859222+0000", 2024-04-26T10:21:57.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001844233 2024-04-26T10:21:57.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859291+0000", 2024-04-26T10:21:57.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:21:57.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859338+0000", 2024-04-26T10:21:57.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6366000000000003e-05 2024-04-26T10:21:57.260 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.260 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.260 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.260 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:57.260 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:57.260 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 54.371708634999997, 2024-04-26T10:21:57.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019837468, 2024-04-26T10:21:57.261 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.261 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:57.261 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:57.261 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 188 2024-04-26T10:21:57.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.261 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:57.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:21:57.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839698+0000", 2024-04-26T10:21:57.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:57.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839829+0000", 2024-04-26T10:21:57.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013061099999999999 2024-04-26T10:21:57.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839853+0000", 2024-04-26T10:21:57.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3736000000000001e-05 2024-04-26T10:21:57.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839863+0000", 2024-04-26T10:21:57.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:57.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854869+0000", 2024-04-26T10:21:57.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015005978 2024-04-26T10:21:57.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854959+0000", 2024-04-26T10:21:57.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9468999999999993e-05 2024-04-26T10:21:57.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:57.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855114+0000", 2024-04-26T10:21:57.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015563799999999999 2024-04-26T10:21:57.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857386+0000", 2024-04-26T10:21:57.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002271852 2024-04-26T10:21:57.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:57.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859406+0000", 2024-04-26T10:21:57.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002019936 2024-04-26T10:21:57.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859461+0000", 2024-04-26T10:21:57.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4826e-05 2024-04-26T10:21:57.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859536+0000", 2024-04-26T10:21:57.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5566000000000001e-05 2024-04-26T10:21:57.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.266 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.266 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:21:57.266 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:57.267 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 54.371534771999997, 2024-04-26T10:21:57.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019826496999999998, 2024-04-26T10:21:57.267 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.267 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:21:57.267 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:21:57.267 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 189 2024-04-26T10:21:57.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.267 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:57.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:21:57.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839872+0000", 2024-04-26T10:21:57.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839882+0000", 2024-04-26T10:21:57.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:21:57.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839892+0000", 2024-04-26T10:21:57.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.217e-06 2024-04-26T10:21:57.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839900+0000", 2024-04-26T10:21:57.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5469999999999997e-06 2024-04-26T10:21:57.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855903+0000", 2024-04-26T10:21:57.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016002590000000001 2024-04-26T10:21:57.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856110+0000", 2024-04-26T10:21:57.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020711199999999999 2024-04-26T10:21:57.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:57.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856421+0000", 2024-04-26T10:21:57.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031128500000000001 2024-04-26T10:21:57.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857643+0000", 2024-04-26T10:21:57.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012215520000000001 2024-04-26T10:21:57.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:57.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859603+0000", 2024-04-26T10:21:57.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019600350000000002 2024-04-26T10:21:57.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859660+0000", 2024-04-26T10:21:57.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6857999999999997e-05 2024-04-26T10:21:57.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859699+0000", 2024-04-26T10:21:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9641999999999998e-05 2024-04-26T10:21:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:15564 5.f 5:f61b0088:::benchmark_data_smithi052_19421_object15563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-26T10:21:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.217017121000001, 2024-04-26T10:21:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017729826000000001, 2024-04-26T10:21:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.272 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 15564 2024-04-26T10:21:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994390+0000", 2024-04-26T10:21:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994389+0000", 2024-04-26T10:21:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994451+0000", 2024-04-26T10:21:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2032999999999994e-05 2024-04-26T10:21:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994477+0000", 2024-04-26T10:21:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5267999999999999e-05 2024-04-26T10:21:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:38.994486+0000", 2024-04-26T10:21:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9420000000000001e-06 2024-04-26T10:21:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001578+0000", 2024-04-26T10:21:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070928110000000001 2024-04-26T10:21:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001748+0000", 2024-04-26T10:21:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016944099999999999 2024-04-26T10:21:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.001914+0000", 2024-04-26T10:21:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000166546 2024-04-26T10:21:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.006488+0000", 2024-04-26T10:21:57.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045735460000000004 2024-04-26T10:21:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012034+0000", 2024-04-26T10:21:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055461449999999997 2024-04-26T10:21:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012085+0000", 2024-04-26T10:21:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1319000000000001e-05 2024-04-26T10:21:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:39.012120+0000", 2024-04-26T10:21:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4904999999999999e-05 2024-04-26T10:21:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34427 5.7 5:ef7d83e6:::benchmark_data_smithi052_19421_object34426:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:21:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:21:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.579329113, 2024-04-26T10:21:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02010443, 2024-04-26T10:21:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34427 2024-04-26T10:21:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:21:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:21:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632077+0000", 2024-04-26T10:21:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632139+0000", 2024-04-26T10:21:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2527999999999995e-05 2024-04-26T10:21:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632153+0000", 2024-04-26T10:21:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3608000000000001e-05 2024-04-26T10:21:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632165+0000", 2024-04-26T10:21:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2592000000000001e-05 2024-04-26T10:21:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635907+0000", 2024-04-26T10:21:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037419789999999999 2024-04-26T10:21:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:21:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635919+0000", 2024-04-26T10:21:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1511999999999999e-05 2024-04-26T10:21:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641616+0000", 2024-04-26T10:21:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056974770000000003 2024-04-26T10:21:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641772+0000", 2024-04-26T10:21:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155799 2024-04-26T10:21:57.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.651965+0000", 2024-04-26T10:21:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010193254000000001 2024-04-26T10:21:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652039+0000", 2024-04-26T10:21:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4031999999999999e-05 2024-04-26T10:21:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652183+0000", 2024-04-26T10:21:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014342599999999999 2024-04-26T10:21:57.283 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45130 5.5 5:a1beca5f:::benchmark_data_smithi052_19421_object45129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:21:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.52584549, 2024-04-26T10:21:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019561411000000001, 2024-04-26T10:21:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.284 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45130 2024-04-26T10:21:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:21:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:21:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685561+0000", 2024-04-26T10:21:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685648+0000", 2024-04-26T10:21:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6552999999999996e-05 2024-04-26T10:21:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685657+0000", 2024-04-26T10:21:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1330000000000005e-06 2024-04-26T10:21:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685664+0000", 2024-04-26T10:21:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1069999999999999e-06 2024-04-26T10:21:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.691613+0000", 2024-04-26T10:21:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059489199999999999 2024-04-26T10:21:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.691779+0000", 2024-04-26T10:21:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016567700000000001 2024-04-26T10:21:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705021+0000", 2024-04-26T10:21:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013242812 2024-04-26T10:21:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705054+0000", 2024-04-26T10:21:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2709999999999997e-05 2024-04-26T10:21:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705123+0000", 2024-04-26T10:21:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9246999999999996e-05 2024-04-26T10:21:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45135 5.d 5:b49760b4:::benchmark_data_smithi052_19421_object45134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.687970+0000", 2024-04-26T10:21:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.523437607, 2024-04-26T10:21:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017262387000000001, 2024-04-26T10:21:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45135 2024-04-26T10:21:57.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.687970+0000", 2024-04-26T10:21:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.687970+0000", 2024-04-26T10:21:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.687969+0000", 2024-04-26T10:21:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.688062+0000", 2024-04-26T10:21:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2904000000000004e-05 2024-04-26T10:21:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.688076+0000", 2024-04-26T10:21:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4585e-05 2024-04-26T10:21:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.688084+0000", 2024-04-26T10:21:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4039999999999998e-06 2024-04-26T10:21:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.692001+0000", 2024-04-26T10:21:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039169699999999997 2024-04-26T10:21:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.692188+0000", 2024-04-26T10:21:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000186801 2024-04-26T10:21:57.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.692336+0000", 2024-04-26T10:21:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014784999999999999 2024-04-26T10:21:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.696839+0000", 2024-04-26T10:21:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045038329999999996 2024-04-26T10:21:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705139+0000", 2024-04-26T10:21:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083000910000000008 2024-04-26T10:21:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705200+0000", 2024-04-26T10:21:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0176000000000001e-05 2024-04-26T10:21:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705232+0000", 2024-04-26T10:21:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2691999999999998e-05 2024-04-26T10:21:57.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45141 5.5 5:a19de173:::benchmark_data_smithi052_19421_object45140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.690367+0000", 2024-04-26T10:21:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.5210408360000001, 2024-04-26T10:21:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016983505999999999, 2024-04-26T10:21:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.295 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45141 2024-04-26T10:21:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690367+0000", 2024-04-26T10:21:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690367+0000", 2024-04-26T10:21:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690366+0000", 2024-04-26T10:21:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690419+0000", 2024-04-26T10:21:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3244e-05 2024-04-26T10:21:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690427+0000", 2024-04-26T10:21:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8699999999999992e-06 2024-04-26T10:21:57.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.690432+0000", 2024-04-26T10:21:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1059999999999999e-06 2024-04-26T10:21:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.693916+0000", 2024-04-26T10:21:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003483955 2024-04-26T10:21:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.694104+0000", 2024-04-26T10:21:57.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000187784 2024-04-26T10:21:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.707243+0000", 2024-04-26T10:21:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013139194 2024-04-26T10:21:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.707289+0000", 2024-04-26T10:21:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6119999999999999e-05 2024-04-26T10:21:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.707350+0000", 2024-04-26T10:21:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1094999999999997e-05 2024-04-26T10:21:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:49103 5.f 5:f082f091:::benchmark_data_smithi052_19421_object49102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:21:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8832396230000001, 2024-04-26T10:21:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019587917, 2024-04-26T10:21:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49103 2024-04-26T10:21:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:21:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:21:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328167+0000", 2024-04-26T10:21:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328207+0000", 2024-04-26T10:21:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0275999999999999e-05 2024-04-26T10:21:57.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328220+0000", 2024-04-26T10:21:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2968e-05 2024-04-26T10:21:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328233+0000", 2024-04-26T10:21:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2203e-05 2024-04-26T10:21:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.333946+0000", 2024-04-26T10:21:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057135110000000001 2024-04-26T10:21:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.335894+0000", 2024-04-26T10:21:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019474959999999999 2024-04-26T10:21:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.336030+0000", 2024-04-26T10:21:57.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013601999999999999 2024-04-26T10:21:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.340794+0000", 2024-04-26T10:21:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047643800000000004 2024-04-26T10:21:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347659+0000", 2024-04-26T10:21:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068648800000000003 2024-04-26T10:21:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347713+0000", 2024-04-26T10:21:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3736000000000002e-05 2024-04-26T10:21:57.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347756+0000", 2024-04-26T10:21:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3155000000000003e-05 2024-04-26T10:21:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:49261 5.5 5:a449de5e:::benchmark_data_smithi052_19421_object49260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:21:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:21:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.8192355770000002, 2024-04-26T10:21:57.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020598741, 2024-04-26T10:21:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49261 2024-04-26T10:21:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:21:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:21:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392171+0000", 2024-04-26T10:21:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392212+0000", 2024-04-26T10:21:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0889000000000001e-05 2024-04-26T10:21:57.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392221+0000", 2024-04-26T10:21:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1970000000000002e-06 2024-04-26T10:21:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392228+0000", 2024-04-26T10:21:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:21:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.397869+0000", 2024-04-26T10:21:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056403180000000001 2024-04-26T10:21:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.398010+0000", 2024-04-26T10:21:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014105300000000001 2024-04-26T10:21:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412532+0000", 2024-04-26T10:21:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014522431000000001 2024-04-26T10:21:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412692+0000", 2024-04-26T10:21:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015970700000000001 2024-04-26T10:21:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412771+0000", 2024-04-26T10:21:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8980000000000006e-05 2024-04-26T10:21:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.311 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:55504 5.f 5:fdf24afe:::benchmark_data_smithi052_19421_object55503:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:56.090060+0000", 2024-04-26T10:21:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.1213473519999999, 2024-04-26T10:21:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018118057999999999, 2024-04-26T10:21:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 55504 2024-04-26T10:21:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.090060+0000", 2024-04-26T10:21:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.090060+0000", 2024-04-26T10:21:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.090059+0000", 2024-04-26T10:21:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.090088+0000", 2024-04-26T10:21:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8952999999999999e-05 2024-04-26T10:21:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.090097+0000", 2024-04-26T10:21:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4039999999999995e-06 2024-04-26T10:21:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.090108+0000", 2024-04-26T10:21:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1235e-05 2024-04-26T10:21:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.092935+0000", 2024-04-26T10:21:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028271469999999999 2024-04-26T10:21:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.093094+0000", 2024-04-26T10:21:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158949 2024-04-26T10:21:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.093187+0000", 2024-04-26T10:21:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3542999999999995e-05 2024-04-26T10:21:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.097109+0000", 2024-04-26T10:21:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039219210000000001 2024-04-26T10:21:57.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.108111+0000", 2024-04-26T10:21:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011001319000000001 2024-04-26T10:21:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.108147+0000", 2024-04-26T10:21:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5954000000000002e-05 2024-04-26T10:21:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.108178+0000", 2024-04-26T10:21:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1627000000000001e-05 2024-04-26T10:21:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.316 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:55505 5.f 5:f545fe6f:::benchmark_data_smithi052_19421_object55504:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:56.090114+0000", 2024-04-26T10:21:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.121293785, 2024-04-26T10:21:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018138418999999999, 2024-04-26T10:21:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.317 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 55505 2024-04-26T10:21:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.090114+0000", 2024-04-26T10:21:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.090114+0000", 2024-04-26T10:21:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.090113+0000", 2024-04-26T10:21:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.090140+0000", 2024-04-26T10:21:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.722e-05 2024-04-26T10:21:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.090148+0000", 2024-04-26T10:21:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1729999999999998e-06 2024-04-26T10:21:57.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.090152+0000", 2024-04-26T10:21:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.228e-06 2024-04-26T10:21:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.095183+0000", 2024-04-26T10:21:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050310959999999997 2024-04-26T10:21:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.095313+0000", 2024-04-26T10:21:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013002399999999999 2024-04-26T10:21:57.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:21:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.095435+0000", 2024-04-26T10:21:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012216399999999999 2024-04-26T10:21:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.099847+0000", 2024-04-26T10:21:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044119550000000004 2024-04-26T10:21:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.108206+0000", 2024-04-26T10:21:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083589800000000002 2024-04-26T10:21:57.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.108230+0000", 2024-04-26T10:21:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3549000000000001e-05 2024-04-26T10:21:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.108252+0000", 2024-04-26T10:21:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2552999999999999e-05 2024-04-26T10:21:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:57202 5.c 5:3efc0ca6:::benchmark_data_smithi052_19421_object57201:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:56.825983+0000", 2024-04-26T10:21:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.38542417800000001, 2024-04-26T10:21:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017556669, 2024-04-26T10:21:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 57202 2024-04-26T10:21:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.825983+0000", 2024-04-26T10:21:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.825983+0000", 2024-04-26T10:21:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.825983+0000", 2024-04-26T10:21:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.826080+0000", 2024-04-26T10:21:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7652999999999995e-05 2024-04-26T10:21:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.826089+0000", 2024-04-26T10:21:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4519999999999997e-06 2024-04-26T10:21:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.826096+0000", 2024-04-26T10:21:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1130000000000003e-06 2024-04-26T10:21:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.828429+0000", 2024-04-26T10:21:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023332689999999998 2024-04-26T10:21:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.828696+0000", 2024-04-26T10:21:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026705499999999998 2024-04-26T10:21:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.843414+0000", 2024-04-26T10:21:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014718192999999999 2024-04-26T10:21:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.843459+0000", 2024-04-26T10:21:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4282000000000001e-05 2024-04-26T10:21:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.843540+0000", 2024-04-26T10:21:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1273000000000006e-05 2024-04-26T10:21:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:57845 5.5 5:ab0b7883:::benchmark_data_smithi052_19421_object57844:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:57.106074+0000", 2024-04-26T10:21:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.105333759, 2024-04-26T10:21:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.017212855999999999, 2024-04-26T10:21:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:21:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:21:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:21:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 57845 2024-04-26T10:21:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:21:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:21:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:57.106074+0000", 2024-04-26T10:21:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:21:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:57.106074+0000", 2024-04-26T10:21:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:21:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:21:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:57.106073+0000", 2024-04-26T10:21:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:21:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:57.106109+0000", 2024-04-26T10:21:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6229999999999997e-05 2024-04-26T10:21:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:21:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:57.106118+0000", 2024-04-26T10:21:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7369999999999995e-06 2024-04-26T10:21:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:57.106123+0000", 2024-04-26T10:21:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1769999999999997e-06 2024-04-26T10:21:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:21:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:57.116389+0000", 2024-04-26T10:21:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010265366 2024-04-26T10:21:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:21:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:57.116566+0000", 2024-04-26T10:21:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017769199999999999 2024-04-26T10:21:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:21:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:57.123169+0000", 2024-04-26T10:21:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066020649999999998 2024-04-26T10:21:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:21:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:57.123214+0000", 2024-04-26T10:21:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5237000000000001e-05 2024-04-26T10:21:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:21:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:21:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:21:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:57.123287+0000", 2024-04-26T10:21:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2886000000000007e-05 2024-04-26T10:21:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:21:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:21:57.332 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:21:57.334 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:57.335 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:57.329+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:57.434 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:57.433+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:57.465 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:57.465 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:57.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.465 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:58603 5.4 5:2b55a973:::benchmark_data_smithi052_19421_object58602:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.465 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.461964+0000", 2024-04-26T10:21:57.465 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0022892849999999998, 2024-04-26T10:21:57.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0023080930000000002, 2024-04-26T10:21:57.465 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.465 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:57.465 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.465 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.466 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.466 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 58603 2024-04-26T10:21:57.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.466 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.461964+0000", 2024-04-26T10:21:57.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.461964+0000", 2024-04-26T10:21:57.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.461961+0000", 2024-04-26T10:21:57.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:57.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462077+0000", 2024-04-26T10:21:57.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115812 2024-04-26T10:21:57.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462225+0000", 2024-04-26T10:21:57.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000147677 2024-04-26T10:21:57.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462233+0000", 2024-04-26T10:21:57.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5229999999999995e-06 2024-04-26T10:21:57.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462311+0000", 2024-04-26T10:21:57.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7911000000000007e-05 2024-04-26T10:21:57.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462476+0000", 2024-04-26T10:21:57.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016423499999999999 2024-04-26T10:21:57.469 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.469 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.469 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.469 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:58605 5.e 5:7d7fc379:::benchmark_data_smithi052_19421_object58604:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.469 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.462248+0000", 2024-04-26T10:21:57.469 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0020051579999999999, 2024-04-26T10:21:57.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020839090000000001, 2024-04-26T10:21:57.469 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.469 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:57.469 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.469 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.470 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.470 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 58605 2024-04-26T10:21:57.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.470 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462248+0000", 2024-04-26T10:21:57.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462248+0000", 2024-04-26T10:21:57.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462247+0000", 2024-04-26T10:21:57.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462291+0000", 2024-04-26T10:21:57.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3732000000000001e-05 2024-04-26T10:21:57.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462299+0000", 2024-04-26T10:21:57.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6799999999999999e-06 2024-04-26T10:21:57.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462306+0000", 2024-04-26T10:21:57.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3770000000000001e-06 2024-04-26T10:21:57.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462363+0000", 2024-04-26T10:21:57.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7386999999999998e-05 2024-04-26T10:21:57.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462522+0000", 2024-04-26T10:21:57.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015895500000000001 2024-04-26T10:21:57.473 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.473 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.473 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.473 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:58602 5.f e33/22 5:ffad7e4c:::benchmark_data_smithi052_19421_object58601:head v 33'3691, mlcod=33'3689)", 2024-04-26T10:21:57.473 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.462707+0000", 2024-04-26T10:21:57.473 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0015461629999999999, 2024-04-26T10:21:57.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016936029999999999, 2024-04-26T10:21:57.473 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.473 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:57.473 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462707+0000", 2024-04-26T10:21:57.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462707+0000", 2024-04-26T10:21:57.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462706+0000", 2024-04-26T10:21:57.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462784+0000", 2024-04-26T10:21:57.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7779000000000002e-05 2024-04-26T10:21:57.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462793+0000", 2024-04-26T10:21:57.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8199999999999992e-06 2024-04-26T10:21:57.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462800+0000", 2024-04-26T10:21:57.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6470000000000001e-06 2024-04-26T10:21:57.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462846+0000", 2024-04-26T10:21:57.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5825999999999998e-05 2024-04-26T10:21:57.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.462879+0000", 2024-04-26T10:21:57.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3445000000000003e-05 2024-04-26T10:21:57.476 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.476 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.476 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.476 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:58610 5.a 5:55b91e55:::benchmark_data_smithi052_19421_object58609:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.477 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.464235+0000", 2024-04-26T10:21:57.477 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.8172000000000002e-05, 2024-04-26T10:21:57.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022676700000000001, 2024-04-26T10:21:57.477 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.477 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T10:21:57.477 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.477 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.477 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.477 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 58610 2024-04-26T10:21:57.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.477 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.464235+0000", 2024-04-26T10:21:57.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.464235+0000", 2024-04-26T10:21:57.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.464234+0000", 2024-04-26T10:21:57.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.464322+0000", 2024-04-26T10:21:57.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8179999999999999e-05 2024-04-26T10:21:57.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.464332+0000", 2024-04-26T10:21:57.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0665999999999999e-05 2024-04-26T10:21:57.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.464341+0000", 2024-04-26T10:21:57.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5480000000000002e-06 2024-04-26T10:21:57.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.464376+0000", 2024-04-26T10:21:57.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5267e-05 2024-04-26T10:21:57.480 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.480 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.480 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.480 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:58598 5.4 5:22a72cd7:::benchmark_data_smithi052_19421_object58597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.480 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.458403+0000", 2024-04-26T10:21:57.480 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0058502800000000002, 2024-04-26T10:21:57.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006130679, 2024-04-26T10:21:57.480 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.480 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:57.480 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.481 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.481 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.481 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 58598 2024-04-26T10:21:57.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.481 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.458403+0000", 2024-04-26T10:21:57.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.458403+0000", 2024-04-26T10:21:57.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.458402+0000", 2024-04-26T10:21:57.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:57.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.458461+0000", 2024-04-26T10:21:57.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9276e-05 2024-04-26T10:21:57.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.458468+0000", 2024-04-26T10:21:57.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8859999999999998e-06 2024-04-26T10:21:57.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.458474+0000", 2024-04-26T10:21:57.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3759999999999999e-06 2024-04-26T10:21:57.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.459854+0000", 2024-04-26T10:21:57.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0013803769999999999 2024-04-26T10:21:57.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.459937+0000", 2024-04-26T10:21:57.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3170999999999994e-05 2024-04-26T10:21:57.484 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.484 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.484 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.484 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:58599 5.8 5:1089b542:::benchmark_data_smithi052_19421_object58598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.484 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.458484+0000", 2024-04-26T10:21:57.484 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0057691929999999997, 2024-04-26T10:21:57.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061196990000000001, 2024-04-26T10:21:57.484 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.484 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:21:57.484 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.484 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.485 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.485 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 58599 2024-04-26T10:21:57.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.485 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.458484+0000", 2024-04-26T10:21:57.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.458484+0000", 2024-04-26T10:21:57.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.458483+0000", 2024-04-26T10:21:57.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:57.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.458520+0000", 2024-04-26T10:21:57.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6572999999999997e-05 2024-04-26T10:21:57.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.458526+0000", 2024-04-26T10:21:57.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2809999999999997e-06 2024-04-26T10:21:57.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.458531+0000", 2024-04-26T10:21:57.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8470000000000003e-06 2024-04-26T10:21:57.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.460575+0000", 2024-04-26T10:21:57.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020439109999999998 2024-04-26T10:21:57.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.460724+0000", 2024-04-26T10:21:57.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014941499999999999 2024-04-26T10:21:57.488 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.488 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.488 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.488 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.488 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:21:57.488 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 6 2024-04-26T10:21:57.488 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:57.489 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:57.536 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:57.533+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:57.615 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:57.615 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:21:57.615 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:21:57.615 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:21:57.615 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:57.616 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 24 16 58958 58942 153.477 140.688 0.00743508 0.00651041 2024-04-26T10:21:57.626 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:57.636 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:57.632+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:57.660 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:21:57.705 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:21:57.737 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:57.732+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:57.756 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:21:57.757 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:21:57.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:21:57.757 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:21:57.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.757 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:21:57.757 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:57.757 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.453695238000002, 2024-04-26T10:21:57.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018441564000000001, 2024-04-26T10:21:57.757 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.757 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.757 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:57.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:21:57.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301372+0000", 2024-04-26T10:21:57.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:21:57.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301399+0000", 2024-04-26T10:21:57.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7039999999999999e-05 2024-04-26T10:21:57.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301426+0000", 2024-04-26T10:21:57.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6381e-05 2024-04-26T10:21:57.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301480+0000", 2024-04-26T10:21:57.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3681000000000003e-05 2024-04-26T10:21:57.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310584+0000", 2024-04-26T10:21:57.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091042339999999992 2024-04-26T10:21:57.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:21:57.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310591+0000", 2024-04-26T10:21:57.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8190000000000003e-06 2024-04-26T10:21:57.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311503+0000", 2024-04-26T10:21:57.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000911983 2024-04-26T10:21:57.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311605+0000", 2024-04-26T10:21:57.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102619 2024-04-26T10:21:57.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:21:57.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311730+0000", 2024-04-26T10:21:57.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012474400000000001 2024-04-26T10:21:57.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317287+0000", 2024-04-26T10:21:57.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055571140000000002 2024-04-26T10:21:57.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:21:57.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319724+0000", 2024-04-26T10:21:57.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002437294 2024-04-26T10:21:57.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319776+0000", 2024-04-26T10:21:57.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1992e-05 2024-04-26T10:21:57.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319816+0000", 2024-04-26T10:21:57.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9709999999999998e-05 2024-04-26T10:21:57.763 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.763 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.763 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.763 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45174 5.0 5:032622a5:::benchmark_data_smithi052_19421_object45173:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:57.763 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.704887+0000", 2024-04-26T10:21:57.763 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.0501824649999998, 2024-04-26T10:21:57.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016545051000000002, 2024-04-26T10:21:57.763 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.763 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.764 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.764 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.764 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.764 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45174 2024-04-26T10:21:57.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.764 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.704887+0000", 2024-04-26T10:21:57.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.704887+0000", 2024-04-26T10:21:57.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.704886+0000", 2024-04-26T10:21:57.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.704993+0000", 2024-04-26T10:21:57.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000106517 2024-04-26T10:21:57.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.705008+0000", 2024-04-26T10:21:57.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5534000000000001e-05 2024-04-26T10:21:57.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.705017+0000", 2024-04-26T10:21:57.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7979999999999995e-06 2024-04-26T10:21:57.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.705087+0000", 2024-04-26T10:21:57.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0426999999999995e-05 2024-04-26T10:21:57.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.705239+0000", 2024-04-26T10:21:57.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151154 2024-04-26T10:21:57.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721301+0000", 2024-04-26T10:21:57.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016062456999999999 2024-04-26T10:21:57.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721353+0000", 2024-04-26T10:21:57.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1892999999999999e-05 2024-04-26T10:21:57.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721432+0000", 2024-04-26T10:21:57.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9358999999999997e-05 2024-04-26T10:21:57.768 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.768 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.768 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.768 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45181 5.8 5:13f857b3:::benchmark_data_smithi052_19421_object45180:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:57.768 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.707868+0000", 2024-04-26T10:21:57.768 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.04720133, 2024-04-26T10:21:57.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015842045999999999, 2024-04-26T10:21:57.768 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.768 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.768 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.768 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.769 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.769 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45181 2024-04-26T10:21:57.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.769 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707868+0000", 2024-04-26T10:21:57.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707868+0000", 2024-04-26T10:21:57.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707868+0000", 2024-04-26T10:21:57.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:57.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707915+0000", 2024-04-26T10:21:57.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7101000000000002e-05 2024-04-26T10:21:57.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707925+0000", 2024-04-26T10:21:57.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7540000000000001e-06 2024-04-26T10:21:57.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.707933+0000", 2024-04-26T10:21:57.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4849999999999992e-06 2024-04-26T10:21:57.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.708001+0000", 2024-04-26T10:21:57.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8262999999999993e-05 2024-04-26T10:21:57.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.708229+0000", 2024-04-26T10:21:57.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022797900000000001 2024-04-26T10:21:57.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723592+0000", 2024-04-26T10:21:57.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015363039 2024-04-26T10:21:57.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723645+0000", 2024-04-26T10:21:57.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2899000000000003e-05 2024-04-26T10:21:57.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.723710+0000", 2024-04-26T10:21:57.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5166000000000006e-05 2024-04-26T10:21:57.772 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.772 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.773 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.773 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45191 5.8 5:13552580:::benchmark_data_smithi052_19421_object45190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:57.773 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.710022+0000", 2024-04-26T10:21:57.773 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.045047941, 2024-04-26T10:21:57.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016838605999999999, 2024-04-26T10:21:57.773 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.773 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.773 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.773 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.773 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.773 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45191 2024-04-26T10:21:57.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.774 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710022+0000", 2024-04-26T10:21:57.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710022+0000", 2024-04-26T10:21:57.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710021+0000", 2024-04-26T10:21:57.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710087+0000", 2024-04-26T10:21:57.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6248000000000007e-05 2024-04-26T10:21:57.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710106+0000", 2024-04-26T10:21:57.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8357000000000001e-05 2024-04-26T10:21:57.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710110+0000", 2024-04-26T10:21:57.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3989999999999997e-06 2024-04-26T10:21:57.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.720365+0000", 2024-04-26T10:21:57.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010254733 2024-04-26T10:21:57.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.720471+0000", 2024-04-26T10:21:57.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000106 2024-04-26T10:21:57.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.726665+0000", 2024-04-26T10:21:57.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006194003 2024-04-26T10:21:57.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.726769+0000", 2024-04-26T10:21:57.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104131 2024-04-26T10:21:57.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.726860+0000", 2024-04-26T10:21:57.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1552999999999996e-05 2024-04-26T10:21:57.777 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.777 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.777 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.778 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:47235 5.e 5:7fbfb3de:::benchmark_data_smithi052_19421_object47234:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:21:57.778 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:52.534893+0000", 2024-04-26T10:21:57.778 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.2201766139999997, 2024-04-26T10:21:57.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014645362, 2024-04-26T10:21:57.778 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.778 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.778 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.778 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.778 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.778 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 47235 2024-04-26T10:21:57.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.778 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.534893+0000", 2024-04-26T10:21:57.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.534893+0000", 2024-04-26T10:21:57.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.534893+0000", 2024-04-26T10:21:57.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:57.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.534923+0000", 2024-04-26T10:21:57.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0380999999999999e-05 2024-04-26T10:21:57.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.534928+0000", 2024-04-26T10:21:57.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.685e-06 2024-04-26T10:21:57.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.534931+0000", 2024-04-26T10:21:57.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0079999999999998e-06 2024-04-26T10:21:57.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.540936+0000", 2024-04-26T10:21:57.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0060048519999999998 2024-04-26T10:21:57.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.541142+0000", 2024-04-26T10:21:57.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020689600000000001 2024-04-26T10:21:57.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.549456+0000", 2024-04-26T10:21:57.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0083134420000000007 2024-04-26T10:21:57.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.549494+0000", 2024-04-26T10:21:57.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8164999999999998e-05 2024-04-26T10:21:57.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:52.549538+0000", 2024-04-26T10:21:57.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4384000000000001e-05 2024-04-26T10:21:57.782 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.782 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.782 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.782 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:54948 5.0 5:0f5c60af:::benchmark_data_smithi052_19421_object54947:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.782 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:55.837736+0000", 2024-04-26T10:21:57.782 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.91733336, 2024-04-26T10:21:57.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014667217999999999, 2024-04-26T10:21:57.783 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.783 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.783 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.783 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.783 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.783 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 54948 2024-04-26T10:21:57.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.783 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.837736+0000", 2024-04-26T10:21:57.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.837736+0000", 2024-04-26T10:21:57.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.837735+0000", 2024-04-26T10:21:57.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.837794+0000", 2024-04-26T10:21:57.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8331000000000001e-05 2024-04-26T10:21:57.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.837805+0000", 2024-04-26T10:21:57.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1576000000000001e-05 2024-04-26T10:21:57.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.837814+0000", 2024-04-26T10:21:57.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7919999999999998e-06 2024-04-26T10:21:57.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.840990+0000", 2024-04-26T10:21:57.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031754230000000001 2024-04-26T10:21:57.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.841127+0000", 2024-04-26T10:21:57.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013785199999999999 2024-04-26T10:21:57.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.852324+0000", 2024-04-26T10:21:57.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011196894000000001 2024-04-26T10:21:57.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.852358+0000", 2024-04-26T10:21:57.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3544000000000003e-05 2024-04-26T10:21:57.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:55.852404+0000", 2024-04-26T10:21:57.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5680000000000003e-05 2024-04-26T10:21:57.787 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.787 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.787 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.787 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:55791 5.a 5:51807120:::benchmark_data_smithi052_19421_object55790:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.787 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:56.214578+0000", 2024-04-26T10:21:57.787 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.54049182, 2024-04-26T10:21:57.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014932202, 2024-04-26T10:21:57.787 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.788 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.788 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.788 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.788 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.788 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 55791 2024-04-26T10:21:57.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.788 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.214578+0000", 2024-04-26T10:21:57.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.214578+0000", 2024-04-26T10:21:57.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.214577+0000", 2024-04-26T10:21:57.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:57.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.214621+0000", 2024-04-26T10:21:57.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4168000000000001e-05 2024-04-26T10:21:57.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.214632+0000", 2024-04-26T10:21:57.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0402e-05 2024-04-26T10:21:57.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.214639+0000", 2024-04-26T10:21:57.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1420000000000004e-06 2024-04-26T10:21:57.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.216402+0000", 2024-04-26T10:21:57.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001762572 2024-04-26T10:21:57.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.216575+0000", 2024-04-26T10:21:57.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000173532 2024-04-26T10:21:57.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.229436+0000", 2024-04-26T10:21:57.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012861236999999999 2024-04-26T10:21:57.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.229467+0000", 2024-04-26T10:21:57.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1084000000000003e-05 2024-04-26T10:21:57.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.229510+0000", 2024-04-26T10:21:57.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2713000000000003e-05 2024-04-26T10:21:57.792 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.792 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.792 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.792 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:55795 5.a 5:54e0ec7e:::benchmark_data_smithi052_19421_object55794:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.792 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:56.215002+0000", 2024-04-26T10:21:57.792 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.5400681889999999, 2024-04-26T10:21:57.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014568997, 2024-04-26T10:21:57.792 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.792 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.792 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.792 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.792 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.793 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 55795 2024-04-26T10:21:57.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.793 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.215002+0000", 2024-04-26T10:21:57.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.215002+0000", 2024-04-26T10:21:57.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.215001+0000", 2024-04-26T10:21:57.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.215039+0000", 2024-04-26T10:21:57.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8175e-05 2024-04-26T10:21:57.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.215055+0000", 2024-04-26T10:21:57.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6566e-05 2024-04-26T10:21:57.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.215064+0000", 2024-04-26T10:21:57.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7739999999999993e-06 2024-04-26T10:21:57.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.220040+0000", 2024-04-26T10:21:57.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0049759679999999999 2024-04-26T10:21:57.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.220247+0000", 2024-04-26T10:21:57.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020707599999999999 2024-04-26T10:21:57.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.229517+0000", 2024-04-26T10:21:57.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0092697620000000008 2024-04-26T10:21:57.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.229540+0000", 2024-04-26T10:21:57.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2886000000000001e-05 2024-04-26T10:21:57.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.229571+0000", 2024-04-26T10:21:57.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0735999999999998e-05 2024-04-26T10:21:57.797 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.797 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.797 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.797 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:56682 5.8 5:197b6bf5:::benchmark_data_smithi052_19421_object56681:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.797 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:56.605943+0000", 2024-04-26T10:21:57.797 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.1491271789999999, 2024-04-26T10:21:57.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015361372999999999, 2024-04-26T10:21:57.797 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.797 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.797 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.797 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.797 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.797 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 56682 2024-04-26T10:21:57.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.798 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.605943+0000", 2024-04-26T10:21:57.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.605943+0000", 2024-04-26T10:21:57.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.605941+0000", 2024-04-26T10:21:57.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:57.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.605987+0000", 2024-04-26T10:21:57.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5479000000000003e-05 2024-04-26T10:21:57.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.605998+0000", 2024-04-26T10:21:57.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1058e-05 2024-04-26T10:21:57.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.606007+0000", 2024-04-26T10:21:57.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6959999999999994e-06 2024-04-26T10:21:57.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.606595+0000", 2024-04-26T10:21:57.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00058807599999999999 2024-04-26T10:21:57.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.606757+0000", 2024-04-26T10:21:57.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016241500000000001 2024-04-26T10:21:57.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.621211+0000", 2024-04-26T10:21:57.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014454432999999999 2024-04-26T10:21:57.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.621243+0000", 2024-04-26T10:21:57.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2011999999999998e-05 2024-04-26T10:21:57.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:56.621304+0000", 2024-04-26T10:21:57.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0442000000000002e-05 2024-04-26T10:21:57.801 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.801 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.801 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.802 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:57607 5.8 5:105dd583:::benchmark_data_smithi052_19421_object57606:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.802 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.000809+0000", 2024-04-26T10:21:57.802 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.75426080799999995, 2024-04-26T10:21:57.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016273816, 2024-04-26T10:21:57.802 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.802 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.802 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.802 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.802 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.802 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 57607 2024-04-26T10:21:57.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.802 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.000809+0000", 2024-04-26T10:21:57.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.000809+0000", 2024-04-26T10:21:57.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.000808+0000", 2024-04-26T10:21:57.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:57.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.000869+0000", 2024-04-26T10:21:57.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1439999999999995e-05 2024-04-26T10:21:57.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.000884+0000", 2024-04-26T10:21:57.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5234e-05 2024-04-26T10:21:57.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.000892+0000", 2024-04-26T10:21:57.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8620000000000003e-06 2024-04-26T10:21:57.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.000947+0000", 2024-04-26T10:21:57.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4437000000000001e-05 2024-04-26T10:21:57.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.001133+0000", 2024-04-26T10:21:57.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018662299999999999 2024-04-26T10:21:57.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.016923+0000", 2024-04-26T10:21:57.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015789530999999999 2024-04-26T10:21:57.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.016995+0000", 2024-04-26T10:21:57.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2426000000000001e-05 2024-04-26T10:21:57.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.017083+0000", 2024-04-26T10:21:57.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7638000000000004e-05 2024-04-26T10:21:57.806 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.806 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.806 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.806 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:57868 5.0 5:0c54e5dd:::benchmark_data_smithi052_19421_object57867:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.807 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.120269+0000", 2024-04-26T10:21:57.807 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.634800696, 2024-04-26T10:21:57.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014842663000000001, 2024-04-26T10:21:57.807 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.807 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.807 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.807 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.807 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.807 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 57868 2024-04-26T10:21:57.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.807 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.120269+0000", 2024-04-26T10:21:57.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.120269+0000", 2024-04-26T10:21:57.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.120268+0000", 2024-04-26T10:21:57.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:57.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.120378+0000", 2024-04-26T10:21:57.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010995199999999999 2024-04-26T10:21:57.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.120394+0000", 2024-04-26T10:21:57.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6215999999999999e-05 2024-04-26T10:21:57.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.120404+0000", 2024-04-26T10:21:57.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6520000000000001e-06 2024-04-26T10:21:57.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.122313+0000", 2024-04-26T10:21:57.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001909822 2024-04-26T10:21:57.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.122422+0000", 2024-04-26T10:21:57.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010851199999999999 2024-04-26T10:21:57.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.134963+0000", 2024-04-26T10:21:57.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012541274 2024-04-26T10:21:57.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.135008+0000", 2024-04-26T10:21:57.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5163000000000001e-05 2024-04-26T10:21:57.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.811 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.135112+0000", 2024-04-26T10:21:57.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103366 2024-04-26T10:21:57.811 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.811 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.811 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.811 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:58326 5.8 5:1a65eb1c:::benchmark_data_smithi052_19421_object58325:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.811 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.332298+0000", 2024-04-26T10:21:57.812 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.422771338, 2024-04-26T10:21:57.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014891582, 2024-04-26T10:21:57.812 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.812 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.812 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.812 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.812 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.812 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 58326 2024-04-26T10:21:57.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.812 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332298+0000", 2024-04-26T10:21:57.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332298+0000", 2024-04-26T10:21:57.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332297+0000", 2024-04-26T10:21:57.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:57.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332399+0000", 2024-04-26T10:21:57.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102395 2024-04-26T10:21:57.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332414+0000", 2024-04-26T10:21:57.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5068e-05 2024-04-26T10:21:57.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332423+0000", 2024-04-26T10:21:57.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9379999999999998e-06 2024-04-26T10:21:57.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332503+0000", 2024-04-26T10:21:57.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9819000000000003e-05 2024-04-26T10:21:57.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332622+0000", 2024-04-26T10:21:57.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118947 2024-04-26T10:21:57.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.347097+0000", 2024-04-26T10:21:57.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014474498000000001 2024-04-26T10:21:57.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.347139+0000", 2024-04-26T10:21:57.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2284999999999999e-05 2024-04-26T10:21:57.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.816 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.816 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.347190+0000", 2024-04-26T10:21:57.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1119000000000003e-05 2024-04-26T10:21:57.816 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.816 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.816 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.816 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:58328 5.0 5:098a339b:::benchmark_data_smithi052_19421_object58327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.816 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.332541+0000", 2024-04-26T10:21:57.816 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.42252853299999998, 2024-04-26T10:21:57.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016832981, 2024-04-26T10:21:57.816 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.816 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.817 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.817 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.817 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.817 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 58328 2024-04-26T10:21:57.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.817 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332541+0000", 2024-04-26T10:21:57.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332541+0000", 2024-04-26T10:21:57.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332541+0000", 2024-04-26T10:21:57.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:57.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332582+0000", 2024-04-26T10:21:57.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1009e-05 2024-04-26T10:21:57.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332590+0000", 2024-04-26T10:21:57.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1799999999999996e-06 2024-04-26T10:21:57.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332596+0000", 2024-04-26T10:21:57.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1419999999999998e-06 2024-04-26T10:21:57.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.334884+0000", 2024-04-26T10:21:57.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022879039999999999 2024-04-26T10:21:57.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.335044+0000", 2024-04-26T10:21:57.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000160674 2024-04-26T10:21:57.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.349242+0000", 2024-04-26T10:21:57.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014197100000000001 2024-04-26T10:21:57.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.349288+0000", 2024-04-26T10:21:57.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6446999999999998e-05 2024-04-26T10:21:57.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.349374+0000", 2024-04-26T10:21:57.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6137999999999994e-05 2024-04-26T10:21:57.821 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.821 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.821 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.821 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:58337 5.8 5:12179de2:::benchmark_data_smithi052_19421_object58336:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.821 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.335369+0000", 2024-04-26T10:21:57.821 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.41970084499999999, 2024-04-26T10:21:57.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01572467, 2024-04-26T10:21:57.821 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.821 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.821 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.821 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.821 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.822 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 58337 2024-04-26T10:21:57.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.822 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.335369+0000", 2024-04-26T10:21:57.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.335369+0000", 2024-04-26T10:21:57.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.335368+0000", 2024-04-26T10:21:57.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.335501+0000", 2024-04-26T10:21:57.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0001338 2024-04-26T10:21:57.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.335512+0000", 2024-04-26T10:21:57.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0988000000000001e-05 2024-04-26T10:21:57.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.335522+0000", 2024-04-26T10:21:57.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9000000000000001e-06 2024-04-26T10:21:57.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.337367+0000", 2024-04-26T10:21:57.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0018444819999999999 2024-04-26T10:21:57.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.337524+0000", 2024-04-26T10:21:57.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015731100000000001 2024-04-26T10:21:57.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.350977+0000", 2024-04-26T10:21:57.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013452581999999999 2024-04-26T10:21:57.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.351023+0000", 2024-04-26T10:21:57.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6551999999999997e-05 2024-04-26T10:21:57.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.351094+0000", 2024-04-26T10:21:57.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0224999999999999e-05 2024-04-26T10:21:57.826 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.826 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.826 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.826 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:58340 5.8 5:17155514:::benchmark_data_smithi052_19421_object58339:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.826 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.336083+0000", 2024-04-26T10:21:57.826 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.418987043, 2024-04-26T10:21:57.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015151329, 2024-04-26T10:21:57.826 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.827 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.827 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.827 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.827 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.827 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 58340 2024-04-26T10:21:57.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.827 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.336083+0000", 2024-04-26T10:21:57.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.336083+0000", 2024-04-26T10:21:57.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.336082+0000", 2024-04-26T10:21:57.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.336305+0000", 2024-04-26T10:21:57.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022340700000000001 2024-04-26T10:21:57.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.828 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.828 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.336312+0000", 2024-04-26T10:21:57.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8090000000000004e-06 2024-04-26T10:21:57.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.336316+0000", 2024-04-26T10:21:57.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3939999999999998e-06 2024-04-26T10:21:57.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.339733+0000", 2024-04-26T10:21:57.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003416877 2024-04-26T10:21:57.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.339938+0000", 2024-04-26T10:21:57.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020450500000000001 2024-04-26T10:21:57.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.351104+0000", 2024-04-26T10:21:57.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011165997 2024-04-26T10:21:57.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.351154+0000", 2024-04-26T10:21:57.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0589e-05 2024-04-26T10:21:57.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.351234+0000", 2024-04-26T10:21:57.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9627000000000002e-05 2024-04-26T10:21:57.831 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.831 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.831 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.831 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:58420 5.a 5:53e997fe:::benchmark_data_smithi052_19421_object58419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.831 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.374980+0000", 2024-04-26T10:21:57.831 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.38008931600000001, 2024-04-26T10:21:57.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01652547, 2024-04-26T10:21:57.831 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.831 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.831 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.831 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.831 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.831 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 58420 2024-04-26T10:21:57.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.832 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.374980+0000", 2024-04-26T10:21:57.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.374980+0000", 2024-04-26T10:21:57.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.374980+0000", 2024-04-26T10:21:57.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:21:57.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.375048+0000", 2024-04-26T10:21:57.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8357999999999998e-05 2024-04-26T10:21:57.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.375057+0000", 2024-04-26T10:21:57.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1120000000000002e-06 2024-04-26T10:21:57.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.375064+0000", 2024-04-26T10:21:57.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.985e-06 2024-04-26T10:21:57.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.375132+0000", 2024-04-26T10:21:57.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8073999999999999e-05 2024-04-26T10:21:57.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.375268+0000", 2024-04-26T10:21:57.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013601499999999999 2024-04-26T10:21:57.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.391311+0000", 2024-04-26T10:21:57.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016042921000000002 2024-04-26T10:21:57.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.391384+0000", 2024-04-26T10:21:57.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3381999999999996e-05 2024-04-26T10:21:57.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.391506+0000", 2024-04-26T10:21:57.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000121403 2024-04-26T10:21:57.835 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.835 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.836 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.836 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:58421 5.a 5:5a8c1126:::benchmark_data_smithi052_19421_object58420:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.836 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.376514+0000", 2024-04-26T10:21:57.836 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.378555537, 2024-04-26T10:21:57.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015128264000000001, 2024-04-26T10:21:57.836 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.836 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.836 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.836 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.836 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.836 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 58421 2024-04-26T10:21:57.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.837 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.376514+0000", 2024-04-26T10:21:57.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.376514+0000", 2024-04-26T10:21:57.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.376513+0000", 2024-04-26T10:21:57.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:57.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.376580+0000", 2024-04-26T10:21:57.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7599000000000001e-05 2024-04-26T10:21:57.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.376597+0000", 2024-04-26T10:21:57.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7030000000000001e-05 2024-04-26T10:21:57.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.376610+0000", 2024-04-26T10:21:57.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2836999999999999e-05 2024-04-26T10:21:57.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.379836+0000", 2024-04-26T10:21:57.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003226016 2024-04-26T10:21:57.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.379990+0000", 2024-04-26T10:21:57.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000153638 2024-04-26T10:21:57.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.391514+0000", 2024-04-26T10:21:57.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011524519 2024-04-26T10:21:57.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.391577+0000", 2024-04-26T10:21:57.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2337999999999998e-05 2024-04-26T10:21:57.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.391642+0000", 2024-04-26T10:21:57.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5611999999999995e-05 2024-04-26T10:21:57.840 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.840 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.840 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.841 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:58747 5.8 5:15b8f127:::benchmark_data_smithi052_19421_object58746:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.841 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.520143+0000", 2024-04-26T10:21:57.841 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.23492682400000001, 2024-04-26T10:21:57.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015601797000000001, 2024-04-26T10:21:57.841 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.841 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.841 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.841 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.841 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.841 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 58747 2024-04-26T10:21:57.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.841 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.520143+0000", 2024-04-26T10:21:57.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.520143+0000", 2024-04-26T10:21:57.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.520142+0000", 2024-04-26T10:21:57.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:57.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.520177+0000", 2024-04-26T10:21:57.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4477000000000002e-05 2024-04-26T10:21:57.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.520184+0000", 2024-04-26T10:21:57.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5020000000000003e-06 2024-04-26T10:21:57.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.520190+0000", 2024-04-26T10:21:57.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5480000000000001e-06 2024-04-26T10:21:57.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.522230+0000", 2024-04-26T10:21:57.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020405060000000001 2024-04-26T10:21:57.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.522477+0000", 2024-04-26T10:21:57.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00024708500000000002 2024-04-26T10:21:57.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.535617+0000", 2024-04-26T10:21:57.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0131395 2024-04-26T10:21:57.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.535674+0000", 2024-04-26T10:21:57.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7292e-05 2024-04-26T10:21:57.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.535745+0000", 2024-04-26T10:21:57.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0420999999999995e-05 2024-04-26T10:21:57.845 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.845 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.845 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.845 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:58752 5.e 5:7795a6c0:::benchmark_data_smithi052_19421_object58751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.845 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.522524+0000", 2024-04-26T10:21:57.845 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.23254583200000001, 2024-04-26T10:21:57.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016319113, 2024-04-26T10:21:57.846 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.846 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.846 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.846 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.846 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.846 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 58752 2024-04-26T10:21:57.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.846 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.522524+0000", 2024-04-26T10:21:57.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.522524+0000", 2024-04-26T10:21:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.522523+0000", 2024-04-26T10:21:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:21:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.522617+0000", 2024-04-26T10:21:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4208000000000003e-05 2024-04-26T10:21:57.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.522628+0000", 2024-04-26T10:21:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0927000000000001e-05 2024-04-26T10:21:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.522636+0000", 2024-04-26T10:21:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.32e-06 2024-04-26T10:21:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.522682+0000", 2024-04-26T10:21:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5713000000000001e-05 2024-04-26T10:21:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.522856+0000", 2024-04-26T10:21:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017405900000000001 2024-04-26T10:21:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.538674+0000", 2024-04-26T10:21:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015818123999999999 2024-04-26T10:21:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.538764+0000", 2024-04-26T10:21:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9625999999999999e-05 2024-04-26T10:21:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.538843+0000", 2024-04-26T10:21:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9424000000000004e-05 2024-04-26T10:21:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:58863 5.b 5:d3a8b859:::benchmark_data_smithi052_19421_object58862:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:21:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.572378+0000", 2024-04-26T10:21:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.18269149500000001, 2024-04-26T10:21:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015482576, 2024-04-26T10:21:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:21:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:21:57.850 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:21:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:21:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:21:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 58863 2024-04-26T10:21:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:21:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:21:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.572378+0000", 2024-04-26T10:21:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:21:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.572378+0000", 2024-04-26T10:21:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:21:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:21:57.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.572378+0000", 2024-04-26T10:21:57.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:21:57.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:21:57.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.572459+0000", 2024-04-26T10:21:57.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1558999999999996e-05 2024-04-26T10:21:57.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:21:57.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.572467+0000", 2024-04-26T10:21:57.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2690000000000002e-06 2024-04-26T10:21:57.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:21:57.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.572472+0000", 2024-04-26T10:21:57.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8969999999999996e-06 2024-04-26T10:21:57.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:21:57.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.577369+0000", 2024-04-26T10:21:57.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048966080000000002 2024-04-26T10:21:57.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:21:57.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.577467+0000", 2024-04-26T10:21:57.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8208999999999994e-05 2024-04-26T10:21:57.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:21:57.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.587796+0000", 2024-04-26T10:21:57.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010328609000000001 2024-04-26T10:21:57.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:21:57.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.587820+0000", 2024-04-26T10:21:57.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4224999999999999e-05 2024-04-26T10:21:57.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:21:57.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:21:57.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:21:57.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.587861+0000", 2024-04-26T10:21:57.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0717000000000003e-05 2024-04-26T10:21:57.854 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.854 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.854 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.854 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:21:57.854 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:21:57.854 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:21:57.856 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:57.853+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:57.856 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:57.857 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:21:57.879 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:21:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:21:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:21:57.880 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:21:57.885 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:21:57.885 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:21:57.958 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:57.957+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:57.986 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:57.986 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:58.000 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:58.057 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:58.053+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:58.124 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:58.124 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:58.136 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:58.157 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:58.153+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:58.258 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:58.252+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:58.264 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:58.264 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:58.276 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:58.360 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:58.357+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:58.399 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:58.399 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:58.412 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:58.461 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:58.456+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:58.536 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:58.536 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:58.548 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:58.561 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:58.557+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:58.615 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 25 16 61192 61176 152.923 139.625 0.00349246 0.00653339 2024-04-26T10:21:58.663 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:58.661+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:58.667 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T10:21:58.720 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:58.720 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:58.732 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:58.764 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:58.760+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:58.864 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:58.861+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:58.865 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:58.865 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:58.877 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:58.965 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:58.960+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:58.999 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:58.999 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:59.012 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:59.066 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:59.060+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:59.137 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:59.137 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:59.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:21:59.195 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:59.192+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:59.268 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:59.264+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:59.288 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:59.288 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:59.302 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:21:59.368 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:59.365+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:59.432 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:59.433 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:59.445 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:21:59.469 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:59.465+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:59.569 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:59.570 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:59.570 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:59.565+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:59.582 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:21:59.615 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 26 16 63349 63333 152.226 134.812 0.0072728 0.00656338 2024-04-26T10:21:59.670 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:21:59.669+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:21:59.719 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:59.719 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:59.730 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:21:59.771 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:59.768+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:59.859 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:21:59.859 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:21:59.871 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:21:59.872 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:59.868+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:21:59.886 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:21:59.973 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:21:59.968+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:00.000 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:00.000 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:00.013 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:00.033 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:00.054 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:00.054 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:00.055 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:00.055 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:00.059 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:00.059 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:00.073 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:00.069+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:00.156 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:00.156 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:00.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.156 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64475 5.8 5:1a1d6ed7:::benchmark_data_smithi052_19421_object64474:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.156 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.147908+0000", 2024-04-26T10:22:00.156 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0073907310000000002, 2024-04-26T10:22:00.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0074116759999999999, 2024-04-26T10:22:00.157 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.157 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:00.157 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.157 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.157 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.157 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64475 2024-04-26T10:22:00.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.157 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.147908+0000", 2024-04-26T10:22:00.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.147908+0000", 2024-04-26T10:22:00.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.147900+0000", 2024-04-26T10:22:00.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999924 2024-04-26T10:22:00.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.147997+0000", 2024-04-26T10:22:00.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6878000000000003e-05 2024-04-26T10:22:00.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.148017+0000", 2024-04-26T10:22:00.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.982e-05 2024-04-26T10:22:00.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.148030+0000", 2024-04-26T10:22:00.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3137e-05 2024-04-26T10:22:00.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.148147+0000", 2024-04-26T10:22:00.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000117549 2024-04-26T10:22:00.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.148317+0000", 2024-04-26T10:22:00.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016938599999999999 2024-04-26T10:22:00.160 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.160 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.160 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.161 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64478 5.b 5:dcb411a5:::benchmark_data_smithi052_19421_object64477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.161 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.150212+0000", 2024-04-26T10:22:00.161 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0050862529999999998, 2024-04-26T10:22:00.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051551039999999998, 2024-04-26T10:22:00.161 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.161 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:00.161 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.161 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.162 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.162 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64478 2024-04-26T10:22:00.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.162 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.150212+0000", 2024-04-26T10:22:00.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.150212+0000", 2024-04-26T10:22:00.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.150211+0000", 2024-04-26T10:22:00.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:00.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.150267+0000", 2024-04-26T10:22:00.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6771000000000002e-05 2024-04-26T10:22:00.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.150282+0000", 2024-04-26T10:22:00.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4031e-05 2024-04-26T10:22:00.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.150294+0000", 2024-04-26T10:22:00.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2480000000000001e-05 2024-04-26T10:22:00.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.150545+0000", 2024-04-26T10:22:00.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025074599999999999 2024-04-26T10:22:00.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.150720+0000", 2024-04-26T10:22:00.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000175334 2024-04-26T10:22:00.165 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.165 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.165 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.165 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:64479 5.f e34/22 5:f7c5c1b6:::benchmark_data_smithi052_19421_object64478:head v 34'4066, mlcod=34'4063)", 2024-04-26T10:22:00.165 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.151168+0000", 2024-04-26T10:22:00.165 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0041304999999999996, 2024-04-26T10:22:00.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042371259999999999, 2024-04-26T10:22:00.165 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.165 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:00.165 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.151168+0000", 2024-04-26T10:22:00.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.151168+0000", 2024-04-26T10:22:00.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.151167+0000", 2024-04-26T10:22:00.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.151229+0000", 2024-04-26T10:22:00.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2038999999999993e-05 2024-04-26T10:22:00.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.151238+0000", 2024-04-26T10:22:00.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9330000000000007e-06 2024-04-26T10:22:00.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.151244+0000", 2024-04-26T10:22:00.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8749999999999997e-06 2024-04-26T10:22:00.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.151291+0000", 2024-04-26T10:22:00.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7119000000000001e-05 2024-04-26T10:22:00.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.151316+0000", 2024-04-26T10:22:00.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5491e-05 2024-04-26T10:22:00.169 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.169 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.169 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.169 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:64480 5.d e34/22 5:b92d8404:::benchmark_data_smithi052_19421_object64479:head v 34'4052, mlcod=34'4048)", 2024-04-26T10:22:00.169 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.151428+0000", 2024-04-26T10:22:00.169 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.003870573, 2024-04-26T10:22:00.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040247199999999999, 2024-04-26T10:22:00.169 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.169 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:00.170 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.151428+0000", 2024-04-26T10:22:00.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.151428+0000", 2024-04-26T10:22:00.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.151427+0000", 2024-04-26T10:22:00.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:00.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.151492+0000", 2024-04-26T10:22:00.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4377999999999999e-05 2024-04-26T10:22:00.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.151501+0000", 2024-04-26T10:22:00.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1069999999999994e-06 2024-04-26T10:22:00.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.151506+0000", 2024-04-26T10:22:00.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9439999999999996e-06 2024-04-26T10:22:00.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.151542+0000", 2024-04-26T10:22:00.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6789000000000003e-05 2024-04-26T10:22:00.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.151564+0000", 2024-04-26T10:22:00.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1883999999999999e-05 2024-04-26T10:22:00.173 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.173 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.173 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.173 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64484 5.8 5:1f87a015:::benchmark_data_smithi052_19421_object64483:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.174 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.153510+0000", 2024-04-26T10:22:00.174 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0017885970000000001, 2024-04-26T10:22:00.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020124449999999999, 2024-04-26T10:22:00.174 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.174 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:00.174 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.174 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.174 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.174 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64484 2024-04-26T10:22:00.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.174 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.153510+0000", 2024-04-26T10:22:00.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.153510+0000", 2024-04-26T10:22:00.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.153509+0000", 2024-04-26T10:22:00.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.153540+0000", 2024-04-26T10:22:00.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1503e-05 2024-04-26T10:22:00.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.153553+0000", 2024-04-26T10:22:00.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2891000000000001e-05 2024-04-26T10:22:00.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.153559+0000", 2024-04-26T10:22:00.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8370000000000002e-06 2024-04-26T10:22:00.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.153616+0000", 2024-04-26T10:22:00.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7425e-05 2024-04-26T10:22:00.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.153836+0000", 2024-04-26T10:22:00.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021996099999999999 2024-04-26T10:22:00.178 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.178 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.178 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.178 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:64482 5.9 e34/22 5:991d5c67:::benchmark_data_smithi052_19421_object64481:head v 34'3996, mlcod=34'3993)", 2024-04-26T10:22:00.178 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.153654+0000", 2024-04-26T10:22:00.178 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0016439810000000001, 2024-04-26T10:22:00.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001920202, 2024-04-26T10:22:00.179 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.179 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:00.179 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.153654+0000", 2024-04-26T10:22:00.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.153654+0000", 2024-04-26T10:22:00.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.153653+0000", 2024-04-26T10:22:00.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.153703+0000", 2024-04-26T10:22:00.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9147000000000002e-05 2024-04-26T10:22:00.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.153713+0000", 2024-04-26T10:22:00.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0584000000000001e-05 2024-04-26T10:22:00.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.153719+0000", 2024-04-26T10:22:00.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7740000000000001e-06 2024-04-26T10:22:00.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.153756+0000", 2024-04-26T10:22:00.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6798999999999998e-05 2024-04-26T10:22:00.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.153768+0000", 2024-04-26T10:22:00.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1854e-05 2024-04-26T10:22:00.182 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.182 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.182 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.183 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64485 5.0 5:009a1a37:::benchmark_data_smithi052_19421_object64484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.183 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.154071+0000", 2024-04-26T10:22:00.183 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.001227559, 2024-04-26T10:22:00.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001552398, 2024-04-26T10:22:00.183 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.183 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:00.183 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.183 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.183 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.183 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64485 2024-04-26T10:22:00.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.183 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.154071+0000", 2024-04-26T10:22:00.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.154071+0000", 2024-04-26T10:22:00.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.154070+0000", 2024-04-26T10:22:00.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.154144+0000", 2024-04-26T10:22:00.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3854000000000001e-05 2024-04-26T10:22:00.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.154154+0000", 2024-04-26T10:22:00.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8980000000000008e-06 2024-04-26T10:22:00.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.154159+0000", 2024-04-26T10:22:00.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5090000000000001e-06 2024-04-26T10:22:00.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.154204+0000", 2024-04-26T10:22:00.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5253000000000002e-05 2024-04-26T10:22:00.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.154344+0000", 2024-04-26T10:22:00.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000139173 2024-04-26T10:22:00.186 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.186 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.186 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.187 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64486 5.0 5.77c27520 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.187 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.154169+0000", 2024-04-26T10:22:00.187 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0011288540000000001, 2024-04-26T10:22:00.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015582549999999999, 2024-04-26T10:22:00.187 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.187 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:00.187 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.187 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.187 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.187 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64486 2024-04-26T10:22:00.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.188 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.154169+0000", 2024-04-26T10:22:00.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.154169+0000", 2024-04-26T10:22:00.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.154169+0000", 2024-04-26T10:22:00.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:00.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.154204+0000", 2024-04-26T10:22:00.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5397e-05 2024-04-26T10:22:00.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.154209+0000", 2024-04-26T10:22:00.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8740000000000003e-06 2024-04-26T10:22:00.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.154213+0000", 2024-04-26T10:22:00.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4060000000000001e-06 2024-04-26T10:22:00.190 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.190 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.190 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.190 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64488 5.a 5:569d05d6:::benchmark_data_smithi052_19421_object64487:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.191 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.155352+0000", 2024-04-26T10:22:00.191 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9999466, 2024-04-26T10:22:00.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00045194300000000001, 2024-04-26T10:22:00.191 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.191 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:00.191 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.191 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.191 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.191 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64488 2024-04-26T10:22:00.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.191 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155352+0000", 2024-04-26T10:22:00.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155352+0000", 2024-04-26T10:22:00.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155351+0000", 2024-04-26T10:22:00.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155436+0000", 2024-04-26T10:22:00.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5634e-05 2024-04-26T10:22:00.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155453+0000", 2024-04-26T10:22:00.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6421000000000001e-05 2024-04-26T10:22:00.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155459+0000", 2024-04-26T10:22:00.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9139999999999996e-06 2024-04-26T10:22:00.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155525+0000", 2024-04-26T10:22:00.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6532000000000006e-05 2024-04-26T10:22:00.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155674+0000", 2024-04-26T10:22:00.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000148703 2024-04-26T10:22:00.195 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.195 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.195 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.195 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64489 5.a 5.6d2e635a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.195 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.155470+0000", 2024-04-26T10:22:00.195 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9998283, 2024-04-26T10:22:00.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041311899999999999, 2024-04-26T10:22:00.195 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.195 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:00.195 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.195 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.196 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.196 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64489 2024-04-26T10:22:00.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.196 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155470+0000", 2024-04-26T10:22:00.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155470+0000", 2024-04-26T10:22:00.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155469+0000", 2024-04-26T10:22:00.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155515+0000", 2024-04-26T10:22:00.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6007000000000002e-05 2024-04-26T10:22:00.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155523+0000", 2024-04-26T10:22:00.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1009999999999992e-06 2024-04-26T10:22:00.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155529+0000", 2024-04-26T10:22:00.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7370000000000003e-06 2024-04-26T10:22:00.199 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.199 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.199 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.199 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64490 5.e 5:791157d6:::benchmark_data_smithi052_19421_object64489:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.199 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.155538+0000", 2024-04-26T10:22:00.199 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9997602, 2024-04-26T10:22:00.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041734999999999998, 2024-04-26T10:22:00.199 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.199 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:00.200 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.200 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.200 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.200 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64490 2024-04-26T10:22:00.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.200 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155538+0000", 2024-04-26T10:22:00.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155538+0000", 2024-04-26T10:22:00.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155538+0000", 2024-04-26T10:22:00.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:00.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155577+0000", 2024-04-26T10:22:00.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9087e-05 2024-04-26T10:22:00.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155592+0000", 2024-04-26T10:22:00.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4973999999999999e-05 2024-04-26T10:22:00.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155597+0000", 2024-04-26T10:22:00.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7610000000000004e-06 2024-04-26T10:22:00.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155645+0000", 2024-04-26T10:22:00.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7957000000000002e-05 2024-04-26T10:22:00.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.155804+0000", 2024-04-26T10:22:00.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015881700000000001 2024-04-26T10:22:00.203 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.203 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.203 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.203 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.203 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:00.203 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 11 2024-04-26T10:22:00.203 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:00.205 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:00.205 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:00.200+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:00.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~12s 2024-04-26T10:22:00.305 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:00.300+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:00.330 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:00.330 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:00.330 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:00.330 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:00.330 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:00.344 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:00.406 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:00.404+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:00.468 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:00.468 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:00.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:00.469 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:00.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.469 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:22:00.469 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:22:00.469 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.165630120000003, 2024-04-26T10:22:00.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018441564000000001, 2024-04-26T10:22:00.469 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.469 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.469 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:22:00.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:22:00.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301372+0000", 2024-04-26T10:22:00.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:00.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301399+0000", 2024-04-26T10:22:00.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7039999999999999e-05 2024-04-26T10:22:00.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301426+0000", 2024-04-26T10:22:00.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6381e-05 2024-04-26T10:22:00.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301480+0000", 2024-04-26T10:22:00.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3681000000000003e-05 2024-04-26T10:22:00.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310584+0000", 2024-04-26T10:22:00.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091042339999999992 2024-04-26T10:22:00.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:22:00.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310591+0000", 2024-04-26T10:22:00.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8190000000000003e-06 2024-04-26T10:22:00.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311503+0000", 2024-04-26T10:22:00.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000911983 2024-04-26T10:22:00.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311605+0000", 2024-04-26T10:22:00.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102619 2024-04-26T10:22:00.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:00.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311730+0000", 2024-04-26T10:22:00.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012474400000000001 2024-04-26T10:22:00.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317287+0000", 2024-04-26T10:22:00.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055571140000000002 2024-04-26T10:22:00.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:00.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319724+0000", 2024-04-26T10:22:00.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002437294 2024-04-26T10:22:00.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319776+0000", 2024-04-26T10:22:00.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1992e-05 2024-04-26T10:22:00.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319816+0000", 2024-04-26T10:22:00.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9709999999999998e-05 2024-04-26T10:22:00.474 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.475 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.475 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.475 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45174 5.0 5:032622a5:::benchmark_data_smithi052_19421_object45173:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:22:00.475 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.704887+0000", 2024-04-26T10:22:00.475 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.7621173470000002, 2024-04-26T10:22:00.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016545051000000002, 2024-04-26T10:22:00.475 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.475 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.475 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.475 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.475 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.476 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45174 2024-04-26T10:22:00.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.476 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.704887+0000", 2024-04-26T10:22:00.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.704887+0000", 2024-04-26T10:22:00.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.704886+0000", 2024-04-26T10:22:00.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.704993+0000", 2024-04-26T10:22:00.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000106517 2024-04-26T10:22:00.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.705008+0000", 2024-04-26T10:22:00.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5534000000000001e-05 2024-04-26T10:22:00.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.705017+0000", 2024-04-26T10:22:00.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7979999999999995e-06 2024-04-26T10:22:00.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.705087+0000", 2024-04-26T10:22:00.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0426999999999995e-05 2024-04-26T10:22:00.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.705239+0000", 2024-04-26T10:22:00.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151154 2024-04-26T10:22:00.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721301+0000", 2024-04-26T10:22:00.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016062456999999999 2024-04-26T10:22:00.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721353+0000", 2024-04-26T10:22:00.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1892999999999999e-05 2024-04-26T10:22:00.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.721432+0000", 2024-04-26T10:22:00.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9358999999999997e-05 2024-04-26T10:22:00.480 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.480 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.480 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.480 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:45191 5.8 5:13552580:::benchmark_data_smithi052_19421_object45190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:22:00.480 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:51.710022+0000", 2024-04-26T10:22:00.480 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.7569828229999995, 2024-04-26T10:22:00.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016838605999999999, 2024-04-26T10:22:00.480 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.480 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.480 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.481 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.481 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.481 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 45191 2024-04-26T10:22:00.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.481 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710022+0000", 2024-04-26T10:22:00.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710022+0000", 2024-04-26T10:22:00.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710021+0000", 2024-04-26T10:22:00.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710087+0000", 2024-04-26T10:22:00.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6248000000000007e-05 2024-04-26T10:22:00.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710106+0000", 2024-04-26T10:22:00.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8357000000000001e-05 2024-04-26T10:22:00.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.710110+0000", 2024-04-26T10:22:00.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3989999999999997e-06 2024-04-26T10:22:00.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.720365+0000", 2024-04-26T10:22:00.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010254733 2024-04-26T10:22:00.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.720471+0000", 2024-04-26T10:22:00.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000106 2024-04-26T10:22:00.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.726665+0000", 2024-04-26T10:22:00.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006194003 2024-04-26T10:22:00.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.726769+0000", 2024-04-26T10:22:00.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000104131 2024-04-26T10:22:00.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:51.726860+0000", 2024-04-26T10:22:00.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1552999999999996e-05 2024-04-26T10:22:00.485 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.485 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.485 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.485 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:58328 5.0 5:098a339b:::benchmark_data_smithi052_19421_object58327:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:22:00.485 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.332541+0000", 2024-04-26T10:22:00.485 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.1344634149999999, 2024-04-26T10:22:00.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016832981, 2024-04-26T10:22:00.485 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.485 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.485 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.486 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.486 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.486 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 58328 2024-04-26T10:22:00.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.486 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332541+0000", 2024-04-26T10:22:00.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332541+0000", 2024-04-26T10:22:00.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332541+0000", 2024-04-26T10:22:00.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:00.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332582+0000", 2024-04-26T10:22:00.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1009e-05 2024-04-26T10:22:00.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332590+0000", 2024-04-26T10:22:00.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1799999999999996e-06 2024-04-26T10:22:00.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.332596+0000", 2024-04-26T10:22:00.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1419999999999998e-06 2024-04-26T10:22:00.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.334884+0000", 2024-04-26T10:22:00.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022879039999999999 2024-04-26T10:22:00.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.335044+0000", 2024-04-26T10:22:00.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000160674 2024-04-26T10:22:00.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.349242+0000", 2024-04-26T10:22:00.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014197100000000001 2024-04-26T10:22:00.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.349288+0000", 2024-04-26T10:22:00.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6446999999999998e-05 2024-04-26T10:22:00.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.349374+0000", 2024-04-26T10:22:00.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6137999999999994e-05 2024-04-26T10:22:00.490 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.490 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.490 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.490 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:58420 5.a 5:53e997fe:::benchmark_data_smithi052_19421_object58419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:22:00.490 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.374980+0000", 2024-04-26T10:22:00.490 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.0920241979999998, 2024-04-26T10:22:00.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01652547, 2024-04-26T10:22:00.491 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.491 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.491 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.491 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.491 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.491 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 58420 2024-04-26T10:22:00.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.491 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.374980+0000", 2024-04-26T10:22:00.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.374980+0000", 2024-04-26T10:22:00.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.374980+0000", 2024-04-26T10:22:00.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.375048+0000", 2024-04-26T10:22:00.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8357999999999998e-05 2024-04-26T10:22:00.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.375057+0000", 2024-04-26T10:22:00.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1120000000000002e-06 2024-04-26T10:22:00.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.375064+0000", 2024-04-26T10:22:00.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.985e-06 2024-04-26T10:22:00.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.375132+0000", 2024-04-26T10:22:00.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8073999999999999e-05 2024-04-26T10:22:00.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.375268+0000", 2024-04-26T10:22:00.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013601499999999999 2024-04-26T10:22:00.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.391311+0000", 2024-04-26T10:22:00.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016042921000000002 2024-04-26T10:22:00.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.391384+0000", 2024-04-26T10:22:00.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3381999999999996e-05 2024-04-26T10:22:00.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.391506+0000", 2024-04-26T10:22:00.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000121403 2024-04-26T10:22:00.495 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.495 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.495 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.495 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:59294 5.b 5:d501c7e5:::benchmark_data_smithi052_19421_object59293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:22:00.495 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.768266+0000", 2024-04-26T10:22:00.495 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 2.6987381240000001, 2024-04-26T10:22:00.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017609123000000001, 2024-04-26T10:22:00.496 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.496 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.496 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.496 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.496 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.496 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59294 2024-04-26T10:22:00.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.496 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.768266+0000", 2024-04-26T10:22:00.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.768266+0000", 2024-04-26T10:22:00.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.768265+0000", 2024-04-26T10:22:00.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.768303+0000", 2024-04-26T10:22:00.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7756000000000002e-05 2024-04-26T10:22:00.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.768315+0000", 2024-04-26T10:22:00.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1741e-05 2024-04-26T10:22:00.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.768323+0000", 2024-04-26T10:22:00.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6410000000000002e-06 2024-04-26T10:22:00.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.770209+0000", 2024-04-26T10:22:00.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0018864019999999999 2024-04-26T10:22:00.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.770299+0000", 2024-04-26T10:22:00.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9902999999999996e-05 2024-04-26T10:22:00.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.785757+0000", 2024-04-26T10:22:00.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015457815999999999 2024-04-26T10:22:00.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.785804+0000", 2024-04-26T10:22:00.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7744000000000002e-05 2024-04-26T10:22:00.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.785876+0000", 2024-04-26T10:22:00.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1104000000000002e-05 2024-04-26T10:22:00.500 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.500 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.500 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.500 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:59296 5.b 5:ddd8634c:::benchmark_data_smithi052_19421_object59295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:22:00.500 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.768421+0000", 2024-04-26T10:22:00.501 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 2.6985838019999999, 2024-04-26T10:22:00.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017576899, 2024-04-26T10:22:00.501 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.501 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.501 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.501 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.501 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.501 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59296 2024-04-26T10:22:00.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.501 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.768421+0000", 2024-04-26T10:22:00.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.768421+0000", 2024-04-26T10:22:00.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.768420+0000", 2024-04-26T10:22:00.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.768510+0000", 2024-04-26T10:22:00.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9970999999999996e-05 2024-04-26T10:22:00.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.768521+0000", 2024-04-26T10:22:00.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.081e-05 2024-04-26T10:22:00.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.768529+0000", 2024-04-26T10:22:00.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0269999999999995e-06 2024-04-26T10:22:00.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.773762+0000", 2024-04-26T10:22:00.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052328770000000004 2024-04-26T10:22:00.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.773904+0000", 2024-04-26T10:22:00.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014252899999999999 2024-04-26T10:22:00.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.785884+0000", 2024-04-26T10:22:00.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011979933999999999 2024-04-26T10:22:00.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.785927+0000", 2024-04-26T10:22:00.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2769999999999999e-05 2024-04-26T10:22:00.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.785998+0000", 2024-04-26T10:22:00.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0821000000000005e-05 2024-04-26T10:22:00.505 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.505 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.505 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.505 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:59297 5.b 5:dcf0aa73:::benchmark_data_smithi052_19421_object59296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:22:00.506 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.768536+0000", 2024-04-26T10:22:00.506 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 2.698468697, 2024-04-26T10:22:00.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.017597519999999998, 2024-04-26T10:22:00.506 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.506 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.506 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.506 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.506 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.506 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59297 2024-04-26T10:22:00.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.506 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.768536+0000", 2024-04-26T10:22:00.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.768536+0000", 2024-04-26T10:22:00.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.768535+0000", 2024-04-26T10:22:00.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:00.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.768580+0000", 2024-04-26T10:22:00.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4533999999999997e-05 2024-04-26T10:22:00.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.768588+0000", 2024-04-26T10:22:00.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2789999999999998e-06 2024-04-26T10:22:00.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.768595+0000", 2024-04-26T10:22:00.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0720000000000002e-06 2024-04-26T10:22:00.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.776760+0000", 2024-04-26T10:22:00.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0081643740000000003 2024-04-26T10:22:00.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.776848+0000", 2024-04-26T10:22:00.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8324000000000003e-05 2024-04-26T10:22:00.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.786013+0000", 2024-04-26T10:22:00.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009165009 2024-04-26T10:22:00.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.786067+0000", 2024-04-26T10:22:00.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4224000000000001e-05 2024-04-26T10:22:00.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.786133+0000", 2024-04-26T10:22:00.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6357000000000002e-05 2024-04-26T10:22:00.510 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.510 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.510 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.511 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:59321 5.b 5:dcf11033:::benchmark_data_smithi052_19421_object59320:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:22:00.511 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:57.779198+0000", 2024-04-26T10:22:00.511 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 2.6878062419999997, 2024-04-26T10:22:00.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016336926000000002, 2024-04-26T10:22:00.511 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.511 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.511 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.511 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.511 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.511 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 59321 2024-04-26T10:22:00.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.511 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.779198+0000", 2024-04-26T10:22:00.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.779198+0000", 2024-04-26T10:22:00.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.779198+0000", 2024-04-26T10:22:00.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:00.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.779255+0000", 2024-04-26T10:22:00.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7720000000000003e-05 2024-04-26T10:22:00.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.779273+0000", 2024-04-26T10:22:00.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7311000000000001e-05 2024-04-26T10:22:00.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.779287+0000", 2024-04-26T10:22:00.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3991e-05 2024-04-26T10:22:00.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.784101+0000", 2024-04-26T10:22:00.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048142949999999997 2024-04-26T10:22:00.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.784206+0000", 2024-04-26T10:22:00.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010517400000000001 2024-04-26T10:22:00.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.795457+0000", 2024-04-26T10:22:00.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011250982 2024-04-26T10:22:00.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.795489+0000", 2024-04-26T10:22:00.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1857999999999999e-05 2024-04-26T10:22:00.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:57.795535+0000", 2024-04-26T10:22:00.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6248000000000002e-05 2024-04-26T10:22:00.515 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.515 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.515 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.516 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64290 5.0 5:02d08f76:::benchmark_data_smithi052_19421_object64289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.516 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.055825+0000", 2024-04-26T10:22:00.516 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.41117957900000002, 2024-04-26T10:22:00.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01713539, 2024-04-26T10:22:00.516 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.516 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.516 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.516 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.516 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.516 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64290 2024-04-26T10:22:00.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.516 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.055825+0000", 2024-04-26T10:22:00.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.055825+0000", 2024-04-26T10:22:00.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.055824+0000", 2024-04-26T10:22:00.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:00.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.055894+0000", 2024-04-26T10:22:00.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9919000000000006e-05 2024-04-26T10:22:00.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.055905+0000", 2024-04-26T10:22:00.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0406e-05 2024-04-26T10:22:00.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.055912+0000", 2024-04-26T10:22:00.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0450000000000003e-06 2024-04-26T10:22:00.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.055949+0000", 2024-04-26T10:22:00.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7157999999999999e-05 2024-04-26T10:22:00.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056067+0000", 2024-04-26T10:22:00.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011770299999999999 2024-04-26T10:22:00.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.072710+0000", 2024-04-26T10:22:00.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016643069999999999 2024-04-26T10:22:00.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.072880+0000", 2024-04-26T10:22:00.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017030100000000001 2024-04-26T10:22:00.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.072960+0000", 2024-04-26T10:22:00.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0492000000000001e-05 2024-04-26T10:22:00.522 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.522 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.522 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.523 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64291 5.8 5:1fa0ff16:::benchmark_data_smithi052_19421_object64290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.523 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.055923+0000", 2024-04-26T10:22:00.523 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.41108191199999999, 2024-04-26T10:22:00.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018007083, 2024-04-26T10:22:00.523 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.523 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.523 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64291 2024-04-26T10:22:00.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.523 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.055923+0000", 2024-04-26T10:22:00.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.055923+0000", 2024-04-26T10:22:00.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.055922+0000", 2024-04-26T10:22:00.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.055988+0000", 2024-04-26T10:22:00.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6575999999999994e-05 2024-04-26T10:22:00.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.055996+0000", 2024-04-26T10:22:00.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8769999999999993e-06 2024-04-26T10:22:00.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056004+0000", 2024-04-26T10:22:00.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.362e-06 2024-04-26T10:22:00.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.059455+0000", 2024-04-26T10:22:00.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034511580000000002 2024-04-26T10:22:00.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.059658+0000", 2024-04-26T10:22:00.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000203184 2024-04-26T10:22:00.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.073758+0000", 2024-04-26T10:22:00.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014099801 2024-04-26T10:22:00.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.073826+0000", 2024-04-26T10:22:00.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8394999999999998e-05 2024-04-26T10:22:00.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.073930+0000", 2024-04-26T10:22:00.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010354899999999999 2024-04-26T10:22:00.527 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.527 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.527 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.528 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64292 5.8 5:17adbaae:::benchmark_data_smithi052_19421_object64291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.528 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.056028+0000", 2024-04-26T10:22:00.528 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.41097644500000002, 2024-04-26T10:22:00.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018078303, 2024-04-26T10:22:00.528 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.528 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.528 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.528 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.528 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.528 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64292 2024-04-26T10:22:00.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.528 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056028+0000", 2024-04-26T10:22:00.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056028+0000", 2024-04-26T10:22:00.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056028+0000", 2024-04-26T10:22:00.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:00.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056094+0000", 2024-04-26T10:22:00.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6874999999999999e-05 2024-04-26T10:22:00.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056102+0000", 2024-04-26T10:22:00.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0399999999999993e-06 2024-04-26T10:22:00.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056109+0000", 2024-04-26T10:22:00.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1009999999999997e-06 2024-04-26T10:22:00.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.062543+0000", 2024-04-26T10:22:00.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0064340969999999997 2024-04-26T10:22:00.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.062750+0000", 2024-04-26T10:22:00.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020710600000000001 2024-04-26T10:22:00.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.073940+0000", 2024-04-26T10:22:00.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011189948 2024-04-26T10:22:00.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.074030+0000", 2024-04-26T10:22:00.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0792999999999996e-05 2024-04-26T10:22:00.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.074106+0000", 2024-04-26T10:22:00.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5957000000000005e-05 2024-04-26T10:22:00.533 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.533 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.533 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.533 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64293 5.0 5:08ad4717:::benchmark_data_smithi052_19421_object64292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.533 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.056116+0000", 2024-04-26T10:22:00.533 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.41088818199999999, 2024-04-26T10:22:00.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018134676999999998, 2024-04-26T10:22:00.533 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.533 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.533 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.533 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.534 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.534 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64293 2024-04-26T10:22:00.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.534 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056116+0000", 2024-04-26T10:22:00.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056116+0000", 2024-04-26T10:22:00.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056116+0000", 2024-04-26T10:22:00.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:00.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056169+0000", 2024-04-26T10:22:00.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2666e-05 2024-04-26T10:22:00.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056176+0000", 2024-04-26T10:22:00.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.204e-06 2024-04-26T10:22:00.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056181+0000", 2024-04-26T10:22:00.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9910000000000002e-06 2024-04-26T10:22:00.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.062687+0000", 2024-04-26T10:22:00.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0065063619999999999 2024-04-26T10:22:00.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.062911+0000", 2024-04-26T10:22:00.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022376000000000001 2024-04-26T10:22:00.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.074118+0000", 2024-04-26T10:22:00.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011206644999999999 2024-04-26T10:22:00.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.074175+0000", 2024-04-26T10:22:00.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7887999999999999e-05 2024-04-26T10:22:00.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.074251+0000", 2024-04-26T10:22:00.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5626999999999999e-05 2024-04-26T10:22:00.538 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.538 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.538 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.538 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64610 5.a 5:57daa913:::benchmark_data_smithi052_19421_object64609:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.538 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.211728+0000", 2024-04-26T10:22:00.538 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.25527696700000002, 2024-04-26T10:22:00.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020479739, 2024-04-26T10:22:00.538 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.538 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.539 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.539 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.539 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.539 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64610 2024-04-26T10:22:00.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.539 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211728+0000", 2024-04-26T10:22:00.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211728+0000", 2024-04-26T10:22:00.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211727+0000", 2024-04-26T10:22:00.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211790+0000", 2024-04-26T10:22:00.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3325999999999996e-05 2024-04-26T10:22:00.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211799+0000", 2024-04-26T10:22:00.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2790000000000004e-06 2024-04-26T10:22:00.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211808+0000", 2024-04-26T10:22:00.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0909999999999999e-06 2024-04-26T10:22:00.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.218692+0000", 2024-04-26T10:22:00.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0068833729999999999 2024-04-26T10:22:00.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.218790+0000", 2024-04-26T10:22:00.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8395999999999998e-05 2024-04-26T10:22:00.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.232078+0000", 2024-04-26T10:22:00.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01328821 2024-04-26T10:22:00.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.232130+0000", 2024-04-26T10:22:00.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1715999999999997e-05 2024-04-26T10:22:00.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.232207+0000", 2024-04-26T10:22:00.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7379999999999994e-05 2024-04-26T10:22:00.543 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.543 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.543 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.543 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64829 5.b 5:d0158a8f:::benchmark_data_smithi052_19421_object64828:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.543 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.316366+0000", 2024-04-26T10:22:00.543 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.150638775, 2024-04-26T10:22:00.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016447376, 2024-04-26T10:22:00.543 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.544 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.544 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.544 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.544 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.544 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64829 2024-04-26T10:22:00.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.544 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.316366+0000", 2024-04-26T10:22:00.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.316366+0000", 2024-04-26T10:22:00.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.316365+0000", 2024-04-26T10:22:00.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.316467+0000", 2024-04-26T10:22:00.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102174 2024-04-26T10:22:00.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.316478+0000", 2024-04-26T10:22:00.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0647e-05 2024-04-26T10:22:00.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.316483+0000", 2024-04-26T10:22:00.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.451e-06 2024-04-26T10:22:00.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.320345+0000", 2024-04-26T10:22:00.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003861583 2024-04-26T10:22:00.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.320454+0000", 2024-04-26T10:22:00.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109423 2024-04-26T10:22:00.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.332727+0000", 2024-04-26T10:22:00.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012272307 2024-04-26T10:22:00.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.332767+0000", 2024-04-26T10:22:00.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0336999999999997e-05 2024-04-26T10:22:00.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.332813+0000", 2024-04-26T10:22:00.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6344999999999998e-05 2024-04-26T10:22:00.548 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.548 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.548 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.548 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64897 5.8 5:13345e39:::benchmark_data_smithi052_19421_object64896:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.548 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.347490+0000", 2024-04-26T10:22:00.548 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.119514255, 2024-04-26T10:22:00.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018246572999999999, 2024-04-26T10:22:00.548 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.548 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.548 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.548 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.548 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.548 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64897 2024-04-26T10:22:00.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.549 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.347490+0000", 2024-04-26T10:22:00.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.347490+0000", 2024-04-26T10:22:00.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.347489+0000", 2024-04-26T10:22:00.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:00.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.347547+0000", 2024-04-26T10:22:00.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8084999999999997e-05 2024-04-26T10:22:00.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.347572+0000", 2024-04-26T10:22:00.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4771999999999999e-05 2024-04-26T10:22:00.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.347583+0000", 2024-04-26T10:22:00.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0723999999999999e-05 2024-04-26T10:22:00.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.347649+0000", 2024-04-26T10:22:00.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5848999999999999e-05 2024-04-26T10:22:00.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.347789+0000", 2024-04-26T10:22:00.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014049099999999999 2024-04-26T10:22:00.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.364022+0000", 2024-04-26T10:22:00.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016233379999999999 2024-04-26T10:22:00.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.364076+0000", 2024-04-26T10:22:00.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3804999999999997e-05 2024-04-26T10:22:00.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.365737+0000", 2024-04-26T10:22:00.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001660683 2024-04-26T10:22:00.552 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.552 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.553 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.553 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64900 5.8 5:18471966:::benchmark_data_smithi052_19421_object64899:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.553 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.349453+0000", 2024-04-26T10:22:00.553 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.117551813, 2024-04-26T10:22:00.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016536757999999999, 2024-04-26T10:22:00.553 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.553 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.553 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64900 2024-04-26T10:22:00.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.554 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.349453+0000", 2024-04-26T10:22:00.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.349453+0000", 2024-04-26T10:22:00.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.349451+0000", 2024-04-26T10:22:00.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:00.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.349501+0000", 2024-04-26T10:22:00.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9555999999999998e-05 2024-04-26T10:22:00.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.349517+0000", 2024-04-26T10:22:00.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.645e-05 2024-04-26T10:22:00.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.349526+0000", 2024-04-26T10:22:00.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.439e-06 2024-04-26T10:22:00.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.351162+0000", 2024-04-26T10:22:00.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016357780000000001 2024-04-26T10:22:00.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.351331+0000", 2024-04-26T10:22:00.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016919099999999999 2024-04-26T10:22:00.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.365759+0000", 2024-04-26T10:22:00.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014428366 2024-04-26T10:22:00.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.365834+0000", 2024-04-26T10:22:00.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5055000000000006e-05 2024-04-26T10:22:00.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.365990+0000", 2024-04-26T10:22:00.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015523800000000001 2024-04-26T10:22:00.557 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.557 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.557 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.557 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64901 5.8 5:14946633:::benchmark_data_smithi052_19421_object64900:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.557 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.350365+0000", 2024-04-26T10:22:00.558 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.116639356, 2024-04-26T10:22:00.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018606020000000001, 2024-04-26T10:22:00.558 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.558 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.558 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.558 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.558 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.558 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64901 2024-04-26T10:22:00.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.558 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.350365+0000", 2024-04-26T10:22:00.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.350365+0000", 2024-04-26T10:22:00.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.350364+0000", 2024-04-26T10:22:00.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.350454+0000", 2024-04-26T10:22:00.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0098000000000004e-05 2024-04-26T10:22:00.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.350467+0000", 2024-04-26T10:22:00.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2216e-05 2024-04-26T10:22:00.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.350473+0000", 2024-04-26T10:22:00.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0260000000000004e-06 2024-04-26T10:22:00.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.354149+0000", 2024-04-26T10:22:00.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003676066 2024-04-26T10:22:00.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.354358+0000", 2024-04-26T10:22:00.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020943399999999999 2024-04-26T10:22:00.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.368850+0000", 2024-04-26T10:22:00.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014491680999999999 2024-04-26T10:22:00.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.368900+0000", 2024-04-26T10:22:00.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9907000000000002e-05 2024-04-26T10:22:00.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.368971+0000", 2024-04-26T10:22:00.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1495999999999994e-05 2024-04-26T10:22:00.562 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.562 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.562 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.562 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64909 5.8 5:1814e925:::benchmark_data_smithi052_19421_object64908:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.562 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.352095+0000", 2024-04-26T10:22:00.562 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.114910078, 2024-04-26T10:22:00.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019235625999999999, 2024-04-26T10:22:00.562 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.562 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.563 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.563 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.563 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.563 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64909 2024-04-26T10:22:00.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.563 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352095+0000", 2024-04-26T10:22:00.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352095+0000", 2024-04-26T10:22:00.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352094+0000", 2024-04-26T10:22:00.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:00.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352193+0000", 2024-04-26T10:22:00.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8881000000000004e-05 2024-04-26T10:22:00.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352202+0000", 2024-04-26T10:22:00.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.098e-06 2024-04-26T10:22:00.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352206+0000", 2024-04-26T10:22:00.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2889999999999999e-06 2024-04-26T10:22:00.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.358151+0000", 2024-04-26T10:22:00.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059452460000000004 2024-04-26T10:22:00.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.358266+0000", 2024-04-26T10:22:00.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114237 2024-04-26T10:22:00.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.371147+0000", 2024-04-26T10:22:00.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012881528999999999 2024-04-26T10:22:00.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.371224+0000", 2024-04-26T10:22:00.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7068000000000001e-05 2024-04-26T10:22:00.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.371330+0000", 2024-04-26T10:22:00.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010598399999999999 2024-04-26T10:22:00.567 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.567 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.567 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.567 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64911 5.0 5:03505961:::benchmark_data_smithi052_19421_object64910:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.567 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.352891+0000", 2024-04-26T10:22:00.567 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.11411315700000001, 2024-04-26T10:22:00.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018641553000000002, 2024-04-26T10:22:00.567 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:00.568 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.568 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:00.568 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:00.568 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.568 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64911 2024-04-26T10:22:00.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.568 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:00.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:00.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352891+0000", 2024-04-26T10:22:00.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:00.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352891+0000", 2024-04-26T10:22:00.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:00.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:00.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352891+0000", 2024-04-26T10:22:00.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:00.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:00.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.353016+0000", 2024-04-26T10:22:00.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012571899999999999 2024-04-26T10:22:00.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:00.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.353027+0000", 2024-04-26T10:22:00.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0057999999999999e-05 2024-04-26T10:22:00.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.353031+0000", 2024-04-26T10:22:00.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7859999999999996e-06 2024-04-26T10:22:00.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:00.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.358327+0000", 2024-04-26T10:22:00.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052954630000000003 2024-04-26T10:22:00.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:00.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.358532+0000", 2024-04-26T10:22:00.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020537600000000001 2024-04-26T10:22:00.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:00.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.371353+0000", 2024-04-26T10:22:00.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012820710000000001 2024-04-26T10:22:00.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:00.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.371423+0000", 2024-04-26T10:22:00.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0042000000000005e-05 2024-04-26T10:22:00.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:00.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:00.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:00.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.371533+0000", 2024-04-26T10:22:00.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011008799999999999 2024-04-26T10:22:00.572 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.572 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.572 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.572 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:00.572 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:00.572 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:00.574 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:00.574 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:00.569+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:00.615 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 27 16 65301 65285 151.105 122 0.00364839 0.00659335 2024-04-26T10:22:00.674 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:00.673+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:00.684 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:22:00.698 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:00.698 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:00.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.698 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65426 5.9 5:914352a1:::benchmark_data_smithi052_19421_object65425:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.698 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.690270+0000", 2024-04-26T10:22:00.698 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0069094530000000003, 2024-04-26T10:22:00.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069309139999999998, 2024-04-26T10:22:00.698 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:00.698 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:00.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:00.699 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:00.699 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.699 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65426 2024-04-26T10:22:00.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.699 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:00.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:00.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.690270+0000", 2024-04-26T10:22:00.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:00.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:00.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.690270+0000", 2024-04-26T10:22:00.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:00.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:00.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.690270+0000", 2024-04-26T10:22:00.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:00.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:00.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.690363+0000", 2024-04-26T10:22:00.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3234999999999998e-05 2024-04-26T10:22:00.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:00.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.690372+0000", 2024-04-26T10:22:00.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2490000000000007e-06 2024-04-26T10:22:00.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.690380+0000", 2024-04-26T10:22:00.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9670000000000001e-06 2024-04-26T10:22:00.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:00.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.690428+0000", 2024-04-26T10:22:00.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7731000000000001e-05 2024-04-26T10:22:00.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:00.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.690563+0000", 2024-04-26T10:22:00.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013537900000000001 2024-04-26T10:22:00.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:00.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.690701+0000", 2024-04-26T10:22:00.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013800600000000001 2024-04-26T10:22:00.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:00.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.693432+0000", 2024-04-26T10:22:00.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027305010000000002 2024-04-26T10:22:00.702 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:00.702 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:00.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:00.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.703 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65428 5.d 5:bf4ebd96:::benchmark_data_smithi052_19421_object65427:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.703 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.690565+0000", 2024-04-26T10:22:00.703 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.006614834, 2024-04-26T10:22:00.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067013569999999998, 2024-04-26T10:22:00.703 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:00.703 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:00.703 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:00.703 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:00.703 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.703 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65428 2024-04-26T10:22:00.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.703 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:00.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:00.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.690565+0000", 2024-04-26T10:22:00.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:00.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:00.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.690565+0000", 2024-04-26T10:22:00.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:00.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:00.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.690564+0000", 2024-04-26T10:22:00.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:00.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.690661+0000", 2024-04-26T10:22:00.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7221999999999999e-05 2024-04-26T10:22:00.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:00.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.690669+0000", 2024-04-26T10:22:00.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3039999999999999e-06 2024-04-26T10:22:00.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.690673+0000", 2024-04-26T10:22:00.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5940000000000004e-06 2024-04-26T10:22:00.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:00.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.692342+0000", 2024-04-26T10:22:00.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016691259999999999 2024-04-26T10:22:00.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:00.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.692430+0000", 2024-04-26T10:22:00.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7658000000000007e-05 2024-04-26T10:22:00.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.692506+0000", 2024-04-26T10:22:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5860999999999998e-05 2024-04-26T10:22:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.694522+0000", 2024-04-26T10:22:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020158480000000002 2024-04-26T10:22:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65433 5.9 5:9039c121:::benchmark_data_smithi052_19421_object65432:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.693502+0000", 2024-04-26T10:22:00.707 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0036779809999999999, 2024-04-26T10:22:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003818718, 2024-04-26T10:22:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65433 2024-04-26T10:22:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.693502+0000", 2024-04-26T10:22:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:00.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.693502+0000", 2024-04-26T10:22:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.693501+0000", 2024-04-26T10:22:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.693636+0000", 2024-04-26T10:22:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013540199999999999 2024-04-26T10:22:00.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.693647+0000", 2024-04-26T10:22:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0883999999999999e-05 2024-04-26T10:22:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.693653+0000", 2024-04-26T10:22:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6210000000000001e-06 2024-04-26T10:22:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.693679+0000", 2024-04-26T10:22:00.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6429999999999999e-05 2024-04-26T10:22:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.693762+0000", 2024-04-26T10:22:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2594000000000002e-05 2024-04-26T10:22:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.693838+0000", 2024-04-26T10:22:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6569000000000005e-05 2024-04-26T10:22:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.695830+0000", 2024-04-26T10:22:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019918570000000001 2024-04-26T10:22:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65436 5.6 5:6b6b0177:::benchmark_data_smithi052_19421_object65435:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.696975+0000", 2024-04-26T10:22:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00020502300000000001, 2024-04-26T10:22:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039912900000000002, 2024-04-26T10:22:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:00.712 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65436 2024-04-26T10:22:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.696975+0000", 2024-04-26T10:22:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:00.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.696975+0000", 2024-04-26T10:22:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.696974+0000", 2024-04-26T10:22:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.697036+0000", 2024-04-26T10:22:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1748000000000006e-05 2024-04-26T10:22:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.697048+0000", 2024-04-26T10:22:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2216e-05 2024-04-26T10:22:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.697054+0000", 2024-04-26T10:22:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3899999999999998e-06 2024-04-26T10:22:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.697115+0000", 2024-04-26T10:22:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0622999999999999e-05 2024-04-26T10:22:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.697219+0000", 2024-04-26T10:22:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103967 2024-04-26T10:22:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:00.716 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 4 2024-04-26T10:22:00.716 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:00.717 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:00.776 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:00.773+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:00.839 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:00.840 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:00.840 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:00.840 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:00.840 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:00.852 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:00.876 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:00.872+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:00.977 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:00.972+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:00.990 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:00.990 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:00.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:00.990 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:00.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:22:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.748371362999997, 2024-04-26T10:22:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018452342, 2024-04-26T10:22:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115 2024-04-26T10:22:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:22:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:22:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239018+0000", 2024-04-26T10:22:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239152+0000", 2024-04-26T10:22:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414699999999999 2024-04-26T10:22:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239169+0000", 2024-04-26T10:22:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7013000000000001e-05 2024-04-26T10:22:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239190+0000", 2024-04-26T10:22:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1302999999999999e-05 2024-04-26T10:22:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252181+0000", 2024-04-26T10:22:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012990213 2024-04-26T10:22:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252411+0000", 2024-04-26T10:22:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023010199999999999 2024-04-26T10:22:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252687+0000", 2024-04-26T10:22:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000276063 2024-04-26T10:22:00.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254694+0000", 2024-04-26T10:22:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020072879999999999 2024-04-26T10:22:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257399+0000", 2024-04-26T10:22:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027051670000000001 2024-04-26T10:22:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257442+0000", 2024-04-26T10:22:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-04-26T10:22:00.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257471+0000", 2024-04-26T10:22:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.889e-05 2024-04-26T10:22:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:22:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.748190833999999, 2024-04-26T10:22:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018350615000000001, 2024-04-26T10:22:00.996 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116 2024-04-26T10:22:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:22:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:22:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239198+0000", 2024-04-26T10:22:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239213+0000", 2024-04-26T10:22:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4965e-05 2024-04-26T10:22:00.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239235+0000", 2024-04-26T10:22:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.156e-05 2024-04-26T10:22:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239243+0000", 2024-04-26T10:22:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9470000000000003e-06 2024-04-26T10:22:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:00.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253284+0000", 2024-04-26T10:22:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014041392999999999 2024-04-26T10:22:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253376+0000", 2024-04-26T10:22:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1198000000000003e-05 2024-04-26T10:22:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253508+0000", 2024-04-26T10:22:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013220199999999999 2024-04-26T10:22:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:01.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255474+0000", 2024-04-26T10:22:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019665590000000001 2024-04-26T10:22:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257480+0000", 2024-04-26T10:22:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00200599 2024-04-26T10:22:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257515+0000", 2024-04-26T10:22:01.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5126000000000002e-05 2024-04-26T10:22:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257550+0000", 2024-04-26T10:22:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4394000000000003e-05 2024-04-26T10:22:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:22:01.002 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.748137278000002, 2024-04-26T10:22:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018369330999999999, 2024-04-26T10:22:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117 2024-04-26T10:22:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:22:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:22:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239252+0000", 2024-04-26T10:22:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239267+0000", 2024-04-26T10:22:01.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4562999999999999e-05 2024-04-26T10:22:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239281+0000", 2024-04-26T10:22:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4e-05 2024-04-26T10:22:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239296+0000", 2024-04-26T10:22:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5492999999999999e-05 2024-04-26T10:22:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254076+0000", 2024-04-26T10:22:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014779814 2024-04-26T10:22:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254159+0000", 2024-04-26T10:22:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2923999999999994e-05 2024-04-26T10:22:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254279+0000", 2024-04-26T10:22:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011964300000000001 2024-04-26T10:22:01.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.256043+0000", 2024-04-26T10:22:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001764353 2024-04-26T10:22:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257559+0000", 2024-04-26T10:22:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015159189999999999 2024-04-26T10:22:01.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257597+0000", 2024-04-26T10:22:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8031999999999998e-05 2024-04-26T10:22:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257622+0000", 2024-04-26T10:22:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5213999999999999e-05 2024-04-26T10:22:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.008 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.337398604999997, 2024-04-26T10:22:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019547338000000001, 2024-04-26T10:22:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165 2024-04-26T10:22:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:01.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649996+0000", 2024-04-26T10:22:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-04-26T10:22:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650021+0000", 2024-04-26T10:22:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5179999999999999e-05 2024-04-26T10:22:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650030+0000", 2024-04-26T10:22:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-04-26T10:22:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664733+0000", 2024-04-26T10:22:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014703097 2024-04-26T10:22:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664821+0000", 2024-04-26T10:22:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7918999999999996e-05 2024-04-26T10:22:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664953+0000", 2024-04-26T10:22:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132662 2024-04-26T10:22:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666776+0000", 2024-04-26T10:22:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018225509999999999 2024-04-26T10:22:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669480+0000", 2024-04-26T10:22:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00270382 2024-04-26T10:22:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669515+0000", 2024-04-26T10:22:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4885000000000002e-05 2024-04-26T10:22:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669539+0000", 2024-04-26T10:22:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4121000000000002e-05 2024-04-26T10:22:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:22:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.147749144999999, 2024-04-26T10:22:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018757273000000001, 2024-04-26T10:22:01.014 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 186 2024-04-26T10:22:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:22:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:22:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839640+0000", 2024-04-26T10:22:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839646+0000", 2024-04-26T10:22:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:22:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839654+0000", 2024-04-26T10:22:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:22:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839661+0000", 2024-04-26T10:22:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.64e-06 2024-04-26T10:22:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852328+0000", 2024-04-26T10:22:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012667151 2024-04-26T10:22:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852538+0000", 2024-04-26T10:22:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020961100000000001 2024-04-26T10:22:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852945+0000", 2024-04-26T10:22:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040712099999999998 2024-04-26T10:22:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857372+0000", 2024-04-26T10:22:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044268049999999998 2024-04-26T10:22:01.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858321+0000", 2024-04-26T10:22:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094932999999999997 2024-04-26T10:22:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858367+0000", 2024-04-26T10:22:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5534000000000001e-05 2024-04-26T10:22:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858398+0000", 2024-04-26T10:22:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1562e-05 2024-04-26T10:22:01.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:22:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.147721979000004, 2024-04-26T10:22:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019669504000000001, 2024-04-26T10:22:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187 2024-04-26T10:22:01.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:22:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:22:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839667+0000", 2024-04-26T10:22:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839677+0000", 2024-04-26T10:22:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3270000000000007e-06 2024-04-26T10:22:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839685+0000", 2024-04-26T10:22:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2670000000000006e-06 2024-04-26T10:22:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839692+0000", 2024-04-26T10:22:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7129999999999999e-06 2024-04-26T10:22:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853685+0000", 2024-04-26T10:22:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013993716999999999 2024-04-26T10:22:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853876+0000", 2024-04-26T10:22:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019097100000000001 2024-04-26T10:22:01.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853989+0000", 2024-04-26T10:22:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011275199999999999 2024-04-26T10:22:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857377+0000", 2024-04-26T10:22:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033882489999999999 2024-04-26T10:22:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859222+0000", 2024-04-26T10:22:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001844233 2024-04-26T10:22:01.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859291+0000", 2024-04-26T10:22:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:22:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859338+0000", 2024-04-26T10:22:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6366000000000003e-05 2024-04-26T10:22:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.025 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:22:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.147691113, 2024-04-26T10:22:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019837468, 2024-04-26T10:22:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 188 2024-04-26T10:22:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:22:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:22:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839698+0000", 2024-04-26T10:22:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839829+0000", 2024-04-26T10:22:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013061099999999999 2024-04-26T10:22:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839853+0000", 2024-04-26T10:22:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3736000000000001e-05 2024-04-26T10:22:01.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839863+0000", 2024-04-26T10:22:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:22:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854869+0000", 2024-04-26T10:22:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015005978 2024-04-26T10:22:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854959+0000", 2024-04-26T10:22:01.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9468999999999993e-05 2024-04-26T10:22:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855114+0000", 2024-04-26T10:22:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015563799999999999 2024-04-26T10:22:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857386+0000", 2024-04-26T10:22:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002271852 2024-04-26T10:22:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:01.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859406+0000", 2024-04-26T10:22:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002019936 2024-04-26T10:22:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859461+0000", 2024-04-26T10:22:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4826e-05 2024-04-26T10:22:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859536+0000", 2024-04-26T10:22:01.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5566000000000001e-05 2024-04-26T10:22:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:22:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 58.14751725, 2024-04-26T10:22:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019826496999999998, 2024-04-26T10:22:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.032 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.033 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:01.033 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:01.033 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 189 2024-04-26T10:22:01.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.033 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:22:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:22:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839872+0000", 2024-04-26T10:22:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839882+0000", 2024-04-26T10:22:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:22:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839892+0000", 2024-04-26T10:22:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.217e-06 2024-04-26T10:22:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839900+0000", 2024-04-26T10:22:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5469999999999997e-06 2024-04-26T10:22:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855903+0000", 2024-04-26T10:22:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016002590000000001 2024-04-26T10:22:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856110+0000", 2024-04-26T10:22:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020711199999999999 2024-04-26T10:22:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:01.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856421+0000", 2024-04-26T10:22:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031128500000000001 2024-04-26T10:22:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857643+0000", 2024-04-26T10:22:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012215520000000001 2024-04-26T10:22:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859603+0000", 2024-04-26T10:22:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019600350000000002 2024-04-26T10:22:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859660+0000", 2024-04-26T10:22:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6857999999999997e-05 2024-04-26T10:22:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859699+0000", 2024-04-26T10:22:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9641999999999998e-05 2024-04-26T10:22:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34427 5.7 5:ef7d83e6:::benchmark_data_smithi052_19421_object34426:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:22:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:22:01.038 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.355311591, 2024-04-26T10:22:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02010443, 2024-04-26T10:22:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34427 2024-04-26T10:22:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:22:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:22:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632077+0000", 2024-04-26T10:22:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632139+0000", 2024-04-26T10:22:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2527999999999995e-05 2024-04-26T10:22:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632153+0000", 2024-04-26T10:22:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3608000000000001e-05 2024-04-26T10:22:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632165+0000", 2024-04-26T10:22:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2592000000000001e-05 2024-04-26T10:22:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635907+0000", 2024-04-26T10:22:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037419789999999999 2024-04-26T10:22:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635919+0000", 2024-04-26T10:22:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1511999999999999e-05 2024-04-26T10:22:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641616+0000", 2024-04-26T10:22:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056974770000000003 2024-04-26T10:22:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641772+0000", 2024-04-26T10:22:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155799 2024-04-26T10:22:01.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.651965+0000", 2024-04-26T10:22:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010193254000000001 2024-04-26T10:22:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652039+0000", 2024-04-26T10:22:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4031999999999999e-05 2024-04-26T10:22:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652183+0000", 2024-04-26T10:22:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014342599999999999 2024-04-26T10:22:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.043 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45130 5.5 5:a1beca5f:::benchmark_data_smithi052_19421_object45129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:22:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:22:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.3018279679999996, 2024-04-26T10:22:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019561411000000001, 2024-04-26T10:22:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45130 2024-04-26T10:22:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.044 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:22:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:22:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685561+0000", 2024-04-26T10:22:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685648+0000", 2024-04-26T10:22:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6552999999999996e-05 2024-04-26T10:22:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685657+0000", 2024-04-26T10:22:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1330000000000005e-06 2024-04-26T10:22:01.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685664+0000", 2024-04-26T10:22:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1069999999999999e-06 2024-04-26T10:22:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.691613+0000", 2024-04-26T10:22:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059489199999999999 2024-04-26T10:22:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.691779+0000", 2024-04-26T10:22:01.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016567700000000001 2024-04-26T10:22:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705021+0000", 2024-04-26T10:22:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013242812 2024-04-26T10:22:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705054+0000", 2024-04-26T10:22:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2709999999999997e-05 2024-04-26T10:22:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705123+0000", 2024-04-26T10:22:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9246999999999996e-05 2024-04-26T10:22:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:49103 5.f 5:f082f091:::benchmark_data_smithi052_19421_object49102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:22:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:22:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.6592221010000001, 2024-04-26T10:22:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019587917, 2024-04-26T10:22:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49103 2024-04-26T10:22:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:22:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:22:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328167+0000", 2024-04-26T10:22:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328207+0000", 2024-04-26T10:22:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0275999999999999e-05 2024-04-26T10:22:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328220+0000", 2024-04-26T10:22:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2968e-05 2024-04-26T10:22:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328233+0000", 2024-04-26T10:22:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2203e-05 2024-04-26T10:22:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.333946+0000", 2024-04-26T10:22:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057135110000000001 2024-04-26T10:22:01.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.335894+0000", 2024-04-26T10:22:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019474959999999999 2024-04-26T10:22:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.336030+0000", 2024-04-26T10:22:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013601999999999999 2024-04-26T10:22:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.340794+0000", 2024-04-26T10:22:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047643800000000004 2024-04-26T10:22:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347659+0000", 2024-04-26T10:22:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068648800000000003 2024-04-26T10:22:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347713+0000", 2024-04-26T10:22:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3736000000000002e-05 2024-04-26T10:22:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347756+0000", 2024-04-26T10:22:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3155000000000003e-05 2024-04-26T10:22:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:49261 5.5 5:a449de5e:::benchmark_data_smithi052_19421_object49260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:22:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:22:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.5952180550000001, 2024-04-26T10:22:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020598741, 2024-04-26T10:22:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.055 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49261 2024-04-26T10:22:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:22:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:22:01.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392171+0000", 2024-04-26T10:22:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392212+0000", 2024-04-26T10:22:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0889000000000001e-05 2024-04-26T10:22:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392221+0000", 2024-04-26T10:22:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1970000000000002e-06 2024-04-26T10:22:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392228+0000", 2024-04-26T10:22:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.397869+0000", 2024-04-26T10:22:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056403180000000001 2024-04-26T10:22:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.398010+0000", 2024-04-26T10:22:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014105300000000001 2024-04-26T10:22:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412532+0000", 2024-04-26T10:22:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014522431000000001 2024-04-26T10:22:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412692+0000", 2024-04-26T10:22:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015970700000000001 2024-04-26T10:22:01.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412771+0000", 2024-04-26T10:22:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8980000000000006e-05 2024-04-26T10:22:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:55505 5.f 5:f545fe6f:::benchmark_data_smithi052_19421_object55504:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-26T10:22:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:56.090114+0000", 2024-04-26T10:22:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.8972762630000002, 2024-04-26T10:22:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018138418999999999, 2024-04-26T10:22:01.060 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 55505 2024-04-26T10:22:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.090114+0000", 2024-04-26T10:22:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.090114+0000", 2024-04-26T10:22:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.090113+0000", 2024-04-26T10:22:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.090140+0000", 2024-04-26T10:22:01.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.722e-05 2024-04-26T10:22:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.090148+0000", 2024-04-26T10:22:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1729999999999998e-06 2024-04-26T10:22:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.090152+0000", 2024-04-26T10:22:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.228e-06 2024-04-26T10:22:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.095183+0000", 2024-04-26T10:22:01.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050310959999999997 2024-04-26T10:22:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.095313+0000", 2024-04-26T10:22:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013002399999999999 2024-04-26T10:22:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.095435+0000", 2024-04-26T10:22:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012216399999999999 2024-04-26T10:22:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.099847+0000", 2024-04-26T10:22:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044119550000000004 2024-04-26T10:22:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.108206+0000", 2024-04-26T10:22:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083589800000000002 2024-04-26T10:22:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.108230+0000", 2024-04-26T10:22:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3549000000000001e-05 2024-04-26T10:22:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:56.108252+0000", 2024-04-26T10:22:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2552999999999999e-05 2024-04-26T10:22:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.45804381100000002, 2024-04-26T10:22:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:01.066 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:01.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.45350859900000001, 2024-04-26T10:22:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.45287730700000001, 2024-04-26T10:22:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:01.078 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:01.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:01.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65604 5.9 5:9c239c32:::benchmark_data_smithi052_19421_object65603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.21777442299999999, 2024-04-26T10:22:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025897677000000001, 2024-04-26T10:22:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65604 2024-04-26T10:22:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769615+0000", 2024-04-26T10:22:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769694+0000", 2024-04-26T10:22:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9087999999999999e-05 2024-04-26T10:22:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769702+0000", 2024-04-26T10:22:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8150000000000006e-06 2024-04-26T10:22:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769709+0000", 2024-04-26T10:22:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:22:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772336+0000", 2024-04-26T10:22:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002626836 2024-04-26T10:22:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772470+0000", 2024-04-26T10:22:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013453299999999999 2024-04-26T10:22:01.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772605+0000", 2024-04-26T10:22:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013428499999999999 2024-04-26T10:22:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779374+0000", 2024-04-26T10:22:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067694000000000001 2024-04-26T10:22:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795401+0000", 2024-04-26T10:22:01.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016026543000000001 2024-04-26T10:22:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795461+0000", 2024-04-26T10:22:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9923999999999998e-05 2024-04-26T10:22:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795513+0000", 2024-04-26T10:22:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2737e-05 2024-04-26T10:22:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65613 5.1 5:85cc6530:::benchmark_data_smithi052_19421_object65612:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.215401377, 2024-04-26T10:22:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023662843999999999, 2024-04-26T10:22:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65613 2024-04-26T10:22:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771988+0000", 2024-04-26T10:22:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772053+0000", 2024-04-26T10:22:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5067000000000006e-05 2024-04-26T10:22:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772065+0000", 2024-04-26T10:22:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2252999999999999e-05 2024-04-26T10:22:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772072+0000", 2024-04-26T10:22:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1400000000000002e-06 2024-04-26T10:22:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779354+0000", 2024-04-26T10:22:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072818120000000004 2024-04-26T10:22:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779455+0000", 2024-04-26T10:22:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101109 2024-04-26T10:22:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795526+0000", 2024-04-26T10:22:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016071203999999999 2024-04-26T10:22:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795572+0000", 2024-04-26T10:22:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5865999999999998e-05 2024-04-26T10:22:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795651+0000", 2024-04-26T10:22:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9192999999999999e-05 2024-04-26T10:22:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65614 5.9 5:993a4fbe:::benchmark_data_smithi052_19421_object65613:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.094 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.21530918600000001, 2024-04-26T10:22:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023664145000000001, 2024-04-26T10:22:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65614 2024-04-26T10:22:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772080+0000", 2024-04-26T10:22:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772117+0000", 2024-04-26T10:22:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6418000000000003e-05 2024-04-26T10:22:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772124+0000", 2024-04-26T10:22:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4730000000000003e-06 2024-04-26T10:22:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772132+0000", 2024-04-26T10:22:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3900000000000004e-06 2024-04-26T10:22:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781379+0000", 2024-04-26T10:22:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092471059999999997 2024-04-26T10:22:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781495+0000", 2024-04-26T10:22:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001159 2024-04-26T10:22:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781581+0000", 2024-04-26T10:22:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6087000000000004e-05 2024-04-26T10:22:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.785948+0000", 2024-04-26T10:22:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043671669999999999 2024-04-26T10:22:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795661+0000", 2024-04-26T10:22:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097130310000000004 2024-04-26T10:22:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795710+0000", 2024-04-26T10:22:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8959000000000003e-05 2024-04-26T10:22:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795745+0000", 2024-04-26T10:22:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5172000000000001e-05 2024-04-26T10:22:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.099 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65619 5.1 5:89edbbcc:::benchmark_data_smithi052_19421_object65618:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.775377+0000", 2024-04-26T10:22:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.21201328799999999, 2024-04-26T10:22:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020492052, 2024-04-26T10:22:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65619 2024-04-26T10:22:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775377+0000", 2024-04-26T10:22:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775377+0000", 2024-04-26T10:22:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775376+0000", 2024-04-26T10:22:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775450+0000", 2024-04-26T10:22:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3485000000000005e-05 2024-04-26T10:22:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775459+0000", 2024-04-26T10:22:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1030000000000008e-06 2024-04-26T10:22:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775463+0000", 2024-04-26T10:22:01.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0060000000000003e-06 2024-04-26T10:22:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.783840+0000", 2024-04-26T10:22:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083774339999999996 2024-04-26T10:22:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.783963+0000", 2024-04-26T10:22:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012291900000000001 2024-04-26T10:22:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795755+0000", 2024-04-26T10:22:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011791793 2024-04-26T10:22:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795798+0000", 2024-04-26T10:22:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3597999999999998e-05 2024-04-26T10:22:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795869+0000", 2024-04-26T10:22:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0413000000000005e-05 2024-04-26T10:22:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.104 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.105 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.105 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:01.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:01.107 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:01.100+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:01.206 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:01.200+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:01.239 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:66623 5.0 5:0bb217ff:::benchmark_data_smithi052_19421_object66622:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:01.233183+0000", 2024-04-26T10:22:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0056914920000000003, 2024-04-26T10:22:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057112370000000001, 2024-04-26T10:22:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.240 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 66623 2024-04-26T10:22:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233183+0000", 2024-04-26T10:22:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233183+0000", 2024-04-26T10:22:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233182+0000", 2024-04-26T10:22:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233238+0000", 2024-04-26T10:22:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5337999999999998e-05 2024-04-26T10:22:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233243+0000", 2024-04-26T10:22:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7919999999999998e-06 2024-04-26T10:22:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233250+0000", 2024-04-26T10:22:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1770000000000003e-06 2024-04-26T10:22:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233302+0000", 2024-04-26T10:22:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2491000000000003e-05 2024-04-26T10:22:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233454+0000", 2024-04-26T10:22:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151557 2024-04-26T10:22:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.243 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:66625 5.a 5:5d2f4ac4:::benchmark_data_smithi052_19421_object66624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:01.233295+0000", 2024-04-26T10:22:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0055793370000000002, 2024-04-26T10:22:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056417000000000004, 2024-04-26T10:22:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 66625 2024-04-26T10:22:01.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233295+0000", 2024-04-26T10:22:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233295+0000", 2024-04-26T10:22:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233294+0000", 2024-04-26T10:22:01.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233367+0000", 2024-04-26T10:22:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2849999999999995e-05 2024-04-26T10:22:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233381+0000", 2024-04-26T10:22:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3909e-05 2024-04-26T10:22:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233388+0000", 2024-04-26T10:22:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5519999999999999e-06 2024-04-26T10:22:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233436+0000", 2024-04-26T10:22:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7506000000000002e-05 2024-04-26T10:22:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233566+0000", 2024-04-26T10:22:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012990500000000001 2024-04-26T10:22:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.247 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:66627 5.a 5:535ccba7:::benchmark_data_smithi052_19421_object66626:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:01.233647+0000", 2024-04-26T10:22:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.005227186, 2024-04-26T10:22:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053245000000000002, 2024-04-26T10:22:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 66627 2024-04-26T10:22:01.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233647+0000", 2024-04-26T10:22:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233647+0000", 2024-04-26T10:22:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233646+0000", 2024-04-26T10:22:01.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233709+0000", 2024-04-26T10:22:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2346000000000002e-05 2024-04-26T10:22:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233750+0000", 2024-04-26T10:22:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1313000000000002e-05 2024-04-26T10:22:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233758+0000", 2024-04-26T10:22:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5350000000000004e-06 2024-04-26T10:22:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.238007+0000", 2024-04-26T10:22:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042488079999999998 2024-04-26T10:22:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.238129+0000", 2024-04-26T10:22:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122036 2024-04-26T10:22:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.251 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:66628 5.0 5:02469b3a:::benchmark_data_smithi052_19421_object66627:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:01.233796+0000", 2024-04-26T10:22:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0050787649999999998, 2024-04-26T10:22:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053624229999999998, 2024-04-26T10:22:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 66628 2024-04-26T10:22:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.252 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233796+0000", 2024-04-26T10:22:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233796+0000", 2024-04-26T10:22:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233795+0000", 2024-04-26T10:22:01.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233824+0000", 2024-04-26T10:22:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8501e-05 2024-04-26T10:22:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233835+0000", 2024-04-26T10:22:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:22:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.233841+0000", 2024-04-26T10:22:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9699999999999996e-06 2024-04-26T10:22:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.235359+0000", 2024-04-26T10:22:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015181979999999999 2024-04-26T10:22:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.235477+0000", 2024-04-26T10:22:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118607 2024-04-26T10:22:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.255 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:66629 5.b 5:d7cebbf3:::benchmark_data_smithi052_19421_object66628:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:01.234957+0000", 2024-04-26T10:22:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0039171070000000004, 2024-04-26T10:22:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043515109999999997, 2024-04-26T10:22:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 66629 2024-04-26T10:22:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.256 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.234957+0000", 2024-04-26T10:22:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.234957+0000", 2024-04-26T10:22:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.234956+0000", 2024-04-26T10:22:01.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.235035+0000", 2024-04-26T10:22:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8604999999999997e-05 2024-04-26T10:22:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.235051+0000", 2024-04-26T10:22:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6033999999999999e-05 2024-04-26T10:22:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.235063+0000", 2024-04-26T10:22:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2571e-05 2024-04-26T10:22:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.235149+0000", 2024-04-26T10:22:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5898999999999999e-05 2024-04-26T10:22:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.235357+0000", 2024-04-26T10:22:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020718599999999999 2024-04-26T10:22:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.259 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:66633 5.8 5:16e854c0:::benchmark_data_smithi052_19421_object66632:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:01.236433+0000", 2024-04-26T10:22:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0024409649999999998, 2024-04-26T10:22:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029299650000000001, 2024-04-26T10:22:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 66633 2024-04-26T10:22:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.260 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236433+0000", 2024-04-26T10:22:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236433+0000", 2024-04-26T10:22:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236432+0000", 2024-04-26T10:22:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236534+0000", 2024-04-26T10:22:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101173 2024-04-26T10:22:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236545+0000", 2024-04-26T10:22:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1798e-05 2024-04-26T10:22:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236551+0000", 2024-04-26T10:22:01.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1250000000000001e-06 2024-04-26T10:22:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.237504+0000", 2024-04-26T10:22:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00095357000000000005 2024-04-26T10:22:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.237664+0000", 2024-04-26T10:22:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015987799999999999 2024-04-26T10:22:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:66634 5.0 5:0e3a5460:::benchmark_data_smithi052_19421_object66633:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:01.236565+0000", 2024-04-26T10:22:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0023094669999999999, 2024-04-26T10:22:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028362330000000001, 2024-04-26T10:22:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 66634 2024-04-26T10:22:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236565+0000", 2024-04-26T10:22:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236565+0000", 2024-04-26T10:22:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236564+0000", 2024-04-26T10:22:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236671+0000", 2024-04-26T10:22:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010613800000000001 2024-04-26T10:22:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236676+0000", 2024-04-26T10:22:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9279999999999998e-06 2024-04-26T10:22:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236680+0000", 2024-04-26T10:22:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9419999999999997e-06 2024-04-26T10:22:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.237640+0000", 2024-04-26T10:22:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00095987199999999996 2024-04-26T10:22:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.237770+0000", 2024-04-26T10:22:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013001399999999999 2024-04-26T10:22:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.267 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:66631 5.9 e34/22 5:9f41d37b:::benchmark_data_smithi052_19421_object66630:head v 34'4149, mlcod=34'4147)", 2024-04-26T10:22:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:01.236832+0000", 2024-04-26T10:22:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.002042295, 2024-04-26T10:22:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0026078149999999999, 2024-04-26T10:22:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236832+0000", 2024-04-26T10:22:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236832+0000", 2024-04-26T10:22:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236831+0000", 2024-04-26T10:22:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236894+0000", 2024-04-26T10:22:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2682999999999996e-05 2024-04-26T10:22:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236903+0000", 2024-04-26T10:22:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3249999999999997e-06 2024-04-26T10:22:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236908+0000", 2024-04-26T10:22:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8520000000000003e-06 2024-04-26T10:22:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236940+0000", 2024-04-26T10:22:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2023999999999997e-05 2024-04-26T10:22:01.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236957+0000", 2024-04-26T10:22:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7184999999999999e-05 2024-04-26T10:22:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:66630 5.f e34/22 5:fd7555c7:::benchmark_data_smithi052_19421_object66629:head v 34'4201, mlcod=34'4198)", 2024-04-26T10:22:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:01.236919+0000", 2024-04-26T10:22:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0019551019999999998, 2024-04-26T10:22:01.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025539080000000001, 2024-04-26T10:22:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236919+0000", 2024-04-26T10:22:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236919+0000", 2024-04-26T10:22:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236919+0000", 2024-04-26T10:22:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236958+0000", 2024-04-26T10:22:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9050000000000001e-05 2024-04-26T10:22:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236962+0000", 2024-04-26T10:22:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4299999999999999e-06 2024-04-26T10:22:01.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236966+0000", 2024-04-26T10:22:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2109999999999998e-06 2024-04-26T10:22:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.236994+0000", 2024-04-26T10:22:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8702000000000001e-05 2024-04-26T10:22:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.237009+0000", 2024-04-26T10:22:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5143999999999999e-05 2024-04-26T10:22:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:66638 5.4 5:2fe2971e:::benchmark_data_smithi052_19421_object66637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:01.239252+0000", 2024-04-26T10:22:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9996223, 2024-04-26T10:22:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027662200000000002, 2024-04-26T10:22:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T10:22:01.275 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 66638 2024-04-26T10:22:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.239252+0000", 2024-04-26T10:22:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.239252+0000", 2024-04-26T10:22:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.239251+0000", 2024-04-26T10:22:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.239295+0000", 2024-04-26T10:22:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4703000000000002e-05 2024-04-26T10:22:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.239313+0000", 2024-04-26T10:22:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7912999999999999e-05 2024-04-26T10:22:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.239321+0000", 2024-04-26T10:22:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8359999999999992e-06 2024-04-26T10:22:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.239366+0000", 2024-04-26T10:22:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5050999999999999e-05 2024-04-26T10:22:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.278 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:66636 5.f e34/22 5:fd5a6a1a:::benchmark_data_smithi052_19421_object66635:head v 34'4202, mlcod=34'4199)", 2024-04-26T10:22:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:01.239403+0000", 2024-04-26T10:22:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9994707, 2024-04-26T10:22:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000183871, 2024-04-26T10:22:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.239403+0000", 2024-04-26T10:22:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.239403+0000", 2024-04-26T10:22:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.239402+0000", 2024-04-26T10:22:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.239460+0000", 2024-04-26T10:22:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7831000000000002e-05 2024-04-26T10:22:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.239470+0000", 2024-04-26T10:22:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4839999999999993e-06 2024-04-26T10:22:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.239476+0000", 2024-04-26T10:22:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1670000000000004e-06 2024-04-26T10:22:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.239540+0000", 2024-04-26T10:22:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4397e-05 2024-04-26T10:22:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.239558+0000", 2024-04-26T10:22:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7657000000000001e-05 2024-04-26T10:22:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:01.282 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 11 2024-04-26T10:22:01.283 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:01.284 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:01.307 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:01.305+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:01.383 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-26T10:22:01.383 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:22:01.384 INFO:tasks.thrashosds.thrasher:Reweighting osd 1 to 0.3424494064658256 2024-04-26T10:22:01.384 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 0.3424494064658256 2024-04-26T10:22:01.407 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:01.404+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:01.410 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:01.410 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:01.410 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:01.410 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:01.411 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:01.423 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:01.508 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:01.504+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:01.595 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:01.596 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:01.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:01.596 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:01.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.596 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-26T10:22:01.596 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:22:01.596 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.293013090000002, 2024-04-26T10:22:01.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018441564000000001, 2024-04-26T10:22:01.596 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.596 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.596 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:22:01.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301374+0000", 2024-04-26T10:22:01.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301372+0000", 2024-04-26T10:22:01.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:01.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301399+0000", 2024-04-26T10:22:01.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7039999999999999e-05 2024-04-26T10:22:01.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301426+0000", 2024-04-26T10:22:01.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6381e-05 2024-04-26T10:22:01.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.301480+0000", 2024-04-26T10:22:01.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3681000000000003e-05 2024-04-26T10:22:01.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310584+0000", 2024-04-26T10:22:01.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0091042339999999992 2024-04-26T10:22:01.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op must wait for map", 2024-04-26T10:22:01.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.310591+0000", 2024-04-26T10:22:01.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8190000000000003e-06 2024-04-26T10:22:01.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311503+0000", 2024-04-26T10:22:01.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000911983 2024-04-26T10:22:01.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311605+0000", 2024-04-26T10:22:01.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102619 2024-04-26T10:22:01.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:01.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.311730+0000", 2024-04-26T10:22:01.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012474400000000001 2024-04-26T10:22:01.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:01.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.317287+0000", 2024-04-26T10:22:01.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055571140000000002 2024-04-26T10:22:01.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:01.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319724+0000", 2024-04-26T10:22:01.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002437294 2024-04-26T10:22:01.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319776+0000", 2024-04-26T10:22:01.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1992e-05 2024-04-26T10:22:01.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:21:09.319816+0000", 2024-04-26T10:22:01.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9709999999999998e-05 2024-04-26T10:22:01.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.602 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.602 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64293 5.0 5:08ad4717:::benchmark_data_smithi052_19421_object64292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.602 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.056116+0000", 2024-04-26T10:22:01.602 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.5382711520000001, 2024-04-26T10:22:01.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018134676999999998, 2024-04-26T10:22:01.602 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.602 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.602 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.603 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.603 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.603 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64293 2024-04-26T10:22:01.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.603 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056116+0000", 2024-04-26T10:22:01.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056116+0000", 2024-04-26T10:22:01.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056116+0000", 2024-04-26T10:22:01.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056169+0000", 2024-04-26T10:22:01.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2666e-05 2024-04-26T10:22:01.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056176+0000", 2024-04-26T10:22:01.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.204e-06 2024-04-26T10:22:01.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.056181+0000", 2024-04-26T10:22:01.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9910000000000002e-06 2024-04-26T10:22:01.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.062687+0000", 2024-04-26T10:22:01.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0065063619999999999 2024-04-26T10:22:01.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.062911+0000", 2024-04-26T10:22:01.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022376000000000001 2024-04-26T10:22:01.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:01.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.074118+0000", 2024-04-26T10:22:01.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011206644999999999 2024-04-26T10:22:01.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.074175+0000", 2024-04-26T10:22:01.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7887999999999999e-05 2024-04-26T10:22:01.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.074251+0000", 2024-04-26T10:22:01.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5626999999999999e-05 2024-04-26T10:22:01.607 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.607 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.607 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.607 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64610 5.a 5:57daa913:::benchmark_data_smithi052_19421_object64609:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.607 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.211728+0000", 2024-04-26T10:22:01.607 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.3826599370000001, 2024-04-26T10:22:01.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020479739, 2024-04-26T10:22:01.607 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.607 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.607 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.608 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.608 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.608 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64610 2024-04-26T10:22:01.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.608 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211728+0000", 2024-04-26T10:22:01.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211728+0000", 2024-04-26T10:22:01.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211727+0000", 2024-04-26T10:22:01.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211790+0000", 2024-04-26T10:22:01.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3325999999999996e-05 2024-04-26T10:22:01.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211799+0000", 2024-04-26T10:22:01.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2790000000000004e-06 2024-04-26T10:22:01.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211808+0000", 2024-04-26T10:22:01.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0909999999999999e-06 2024-04-26T10:22:01.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.218692+0000", 2024-04-26T10:22:01.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0068833729999999999 2024-04-26T10:22:01.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.218790+0000", 2024-04-26T10:22:01.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8395999999999998e-05 2024-04-26T10:22:01.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:01.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.232078+0000", 2024-04-26T10:22:01.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01328821 2024-04-26T10:22:01.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.232130+0000", 2024-04-26T10:22:01.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1715999999999997e-05 2024-04-26T10:22:01.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.232207+0000", 2024-04-26T10:22:01.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7379999999999994e-05 2024-04-26T10:22:01.613 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.613 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.613 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.613 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64897 5.8 5:13345e39:::benchmark_data_smithi052_19421_object64896:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.613 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.347490+0000", 2024-04-26T10:22:01.613 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.2468972250000001, 2024-04-26T10:22:01.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018246572999999999, 2024-04-26T10:22:01.613 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.614 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.614 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.614 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.614 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.614 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64897 2024-04-26T10:22:01.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.614 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.347490+0000", 2024-04-26T10:22:01.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.347490+0000", 2024-04-26T10:22:01.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.347489+0000", 2024-04-26T10:22:01.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:01.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.347547+0000", 2024-04-26T10:22:01.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8084999999999997e-05 2024-04-26T10:22:01.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.347572+0000", 2024-04-26T10:22:01.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4771999999999999e-05 2024-04-26T10:22:01.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.347583+0000", 2024-04-26T10:22:01.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0723999999999999e-05 2024-04-26T10:22:01.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.347649+0000", 2024-04-26T10:22:01.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5848999999999999e-05 2024-04-26T10:22:01.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.347789+0000", 2024-04-26T10:22:01.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014049099999999999 2024-04-26T10:22:01.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:01.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.364022+0000", 2024-04-26T10:22:01.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016233379999999999 2024-04-26T10:22:01.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.364076+0000", 2024-04-26T10:22:01.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3804999999999997e-05 2024-04-26T10:22:01.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.365737+0000", 2024-04-26T10:22:01.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001660683 2024-04-26T10:22:01.618 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.618 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.618 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.619 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64901 5.8 5:14946633:::benchmark_data_smithi052_19421_object64900:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.619 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.350365+0000", 2024-04-26T10:22:01.619 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.2440223260000001, 2024-04-26T10:22:01.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018606020000000001, 2024-04-26T10:22:01.619 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.619 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.619 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64901 2024-04-26T10:22:01.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.619 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.350365+0000", 2024-04-26T10:22:01.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.350365+0000", 2024-04-26T10:22:01.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.350364+0000", 2024-04-26T10:22:01.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.350454+0000", 2024-04-26T10:22:01.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0098000000000004e-05 2024-04-26T10:22:01.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.350467+0000", 2024-04-26T10:22:01.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2216e-05 2024-04-26T10:22:01.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.350473+0000", 2024-04-26T10:22:01.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0260000000000004e-06 2024-04-26T10:22:01.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.354149+0000", 2024-04-26T10:22:01.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003676066 2024-04-26T10:22:01.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.354358+0000", 2024-04-26T10:22:01.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020943399999999999 2024-04-26T10:22:01.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:01.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.368850+0000", 2024-04-26T10:22:01.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014491680999999999 2024-04-26T10:22:01.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.368900+0000", 2024-04-26T10:22:01.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9907000000000002e-05 2024-04-26T10:22:01.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.368971+0000", 2024-04-26T10:22:01.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1495999999999994e-05 2024-04-26T10:22:01.623 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.623 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.623 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.624 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64909 5.8 5:1814e925:::benchmark_data_smithi052_19421_object64908:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.624 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.352095+0000", 2024-04-26T10:22:01.624 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.2422930480000001, 2024-04-26T10:22:01.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019235625999999999, 2024-04-26T10:22:01.624 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.624 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.624 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.624 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.624 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.624 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64909 2024-04-26T10:22:01.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.624 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352095+0000", 2024-04-26T10:22:01.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352095+0000", 2024-04-26T10:22:01.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352094+0000", 2024-04-26T10:22:01.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352193+0000", 2024-04-26T10:22:01.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8881000000000004e-05 2024-04-26T10:22:01.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352202+0000", 2024-04-26T10:22:01.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.098e-06 2024-04-26T10:22:01.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352206+0000", 2024-04-26T10:22:01.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2889999999999999e-06 2024-04-26T10:22:01.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.358151+0000", 2024-04-26T10:22:01.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059452460000000004 2024-04-26T10:22:01.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.358266+0000", 2024-04-26T10:22:01.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114237 2024-04-26T10:22:01.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:01.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.371147+0000", 2024-04-26T10:22:01.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012881528999999999 2024-04-26T10:22:01.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.371224+0000", 2024-04-26T10:22:01.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7068000000000001e-05 2024-04-26T10:22:01.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.371330+0000", 2024-04-26T10:22:01.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010598399999999999 2024-04-26T10:22:01.628 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.628 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.628 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.628 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64911 5.0 5:03505961:::benchmark_data_smithi052_19421_object64910:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.629 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.352891+0000", 2024-04-26T10:22:01.629 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.241496127, 2024-04-26T10:22:01.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018641553000000002, 2024-04-26T10:22:01.629 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.629 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.629 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64911 2024-04-26T10:22:01.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.629 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352891+0000", 2024-04-26T10:22:01.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352891+0000", 2024-04-26T10:22:01.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352891+0000", 2024-04-26T10:22:01.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.353016+0000", 2024-04-26T10:22:01.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012571899999999999 2024-04-26T10:22:01.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.353027+0000", 2024-04-26T10:22:01.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0057999999999999e-05 2024-04-26T10:22:01.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.353031+0000", 2024-04-26T10:22:01.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7859999999999996e-06 2024-04-26T10:22:01.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.358327+0000", 2024-04-26T10:22:01.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052954630000000003 2024-04-26T10:22:01.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.358532+0000", 2024-04-26T10:22:01.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020537600000000001 2024-04-26T10:22:01.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:01.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.371353+0000", 2024-04-26T10:22:01.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012820710000000001 2024-04-26T10:22:01.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.371423+0000", 2024-04-26T10:22:01.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0042000000000005e-05 2024-04-26T10:22:01.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.371533+0000", 2024-04-26T10:22:01.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011008799999999999 2024-04-26T10:22:01.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.634 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.634 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.634 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.634 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:01.634 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0637467119999999, 2024-04-26T10:22:01.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:01.634 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.634 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.635 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:01.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.635 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:01.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:01.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:01.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:01.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:01.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:01.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:01.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:01.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:01.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:01.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:01.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:01.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:01.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:01.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:01.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:01.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:01.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:01.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:01.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:01.639 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.639 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.639 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.639 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.640 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:01.640 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0617644850000001, 2024-04-26T10:22:01.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:01.640 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.640 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.640 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:01.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.640 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:01.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:01.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:01.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:01.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:01.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:01.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:01.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:01.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:01.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:01.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:01.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:01.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:01.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:01.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:01.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:01.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:01.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:01.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:01.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:01.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:01.644 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.644 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.644 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.644 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.644 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:01.645 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.061565101, 2024-04-26T10:22:01.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:01.645 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.645 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.645 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.645 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.645 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.645 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:01.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.645 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:01.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:01.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:01.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:01.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:01.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:01.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:01.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:01.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:01.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:01.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:01.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:01.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:01.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:01.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:01.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:01.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:01.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:01.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:01.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:01.649 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.649 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.649 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.649 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:01.649 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:01.649 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.061346481, 2024-04-26T10:22:01.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:01.649 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.649 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.649 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:01.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:01.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:01.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:01.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:01.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:01.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:01.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:01.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:01.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:01.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:01.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:01.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:01.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:01.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:01.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:01.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:01.653 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.653 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.653 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.653 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.653 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:01.653 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.058975043, 2024-04-26T10:22:01.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:01.653 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.653 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.653 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.654 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:01.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.654 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:01.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:01.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:01.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:01.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:01.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:01.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:01.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:01.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:01.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:01.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:01.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:01.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:01.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:01.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:01.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:01.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:01.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:01.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:01.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:01.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:01.657 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.658 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.658 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.658 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.658 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:01.658 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0588744210000001, 2024-04-26T10:22:01.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:01.658 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.658 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.659 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:01.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.659 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:01.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:01.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:01.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:01.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:01.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:01.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:01.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:01.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:01.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:01.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:01.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:01.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:01.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:01.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:01.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:01.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:01.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:01.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:01.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:01.662 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.663 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.663 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.663 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:01.663 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:01.663 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.05875586, 2024-04-26T10:22:01.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:01.663 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.663 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.663 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:01.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:01.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:01.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:01.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:01.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:01.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:01.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:01.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:01.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:01.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:01.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:01.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:01.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:01.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:01.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:01.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:01.667 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.667 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.667 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.667 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.667 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:01.667 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0586534620000001, 2024-04-26T10:22:01.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:01.667 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.667 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.668 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.668 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:01.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.668 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:01.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:01.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:01.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:01.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:01.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:01.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:01.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:01.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:01.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:01.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:01.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:01.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:01.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:01.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:01.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:01.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:01.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:01.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:01.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:01.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:01.672 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.672 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.672 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.672 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65294 5.e 5:7438ad6f:::benchmark_data_smithi052_19421_object65293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.672 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:01.672 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.057973345, 2024-04-26T10:22:01.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091965517999999996, 2024-04-26T10:22:01.672 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.672 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.672 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.672 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.672 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.672 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65294 2024-04-26T10:22:01.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.673 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:01.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:01.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536413+0000", 2024-04-26T10:22:01.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536470+0000", 2024-04-26T10:22:01.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6443999999999997e-05 2024-04-26T10:22:01.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536480+0000", 2024-04-26T10:22:01.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0652999999999999e-05 2024-04-26T10:22:01.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536488+0000", 2024-04-26T10:22:01.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7929999999999998e-06 2024-04-26T10:22:01.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536548+0000", 2024-04-26T10:22:01.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9556999999999999e-05 2024-04-26T10:22:01.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536728+0000", 2024-04-26T10:22:01.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000180958 2024-04-26T10:22:01.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:01.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628168+0000", 2024-04-26T10:22:01.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091439276999999999 2024-04-26T10:22:01.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628258+0000", 2024-04-26T10:22:01.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0158e-05 2024-04-26T10:22:01.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628380+0000", 2024-04-26T10:22:01.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012180699999999999 2024-04-26T10:22:01.676 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.677 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.677 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.677 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.677 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:01.677 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.057632905, 2024-04-26T10:22:01.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:01.677 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.677 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.677 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.677 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.677 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.677 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:01.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.678 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:01.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:01.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:01.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:01.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:01.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:01.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:01.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:01.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:01.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:01.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:01.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:01.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:01.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:01.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:01.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:01.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:01.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:01.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:01.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:01.682 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.682 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.682 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.682 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.682 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:01.682 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0564826300000001, 2024-04-26T10:22:01.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:01.682 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.682 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.683 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:01.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.683 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:01.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:01.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:01.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:01.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:01.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:01.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:01.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:01.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:01.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:01.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:01.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:01.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:01.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:01.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:01.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:01.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:01.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:01.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:01.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:01.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:01.687 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.687 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.687 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.687 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65292 5.f e34/22 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head v 34'4129, mlcod=34'4125)", 2024-04-26T10:22:01.687 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:01.687 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.0563083740000001, 2024-04-26T10:22:01.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093470155999999999, 2024-04-26T10:22:01.687 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.687 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.687 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:01.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:01.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538078+0000", 2024-04-26T10:22:01.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538140+0000", 2024-04-26T10:22:01.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1970000000000005e-05 2024-04-26T10:22:01.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538149+0000", 2024-04-26T10:22:01.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2189999999999993e-06 2024-04-26T10:22:01.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538158+0000", 2024-04-26T10:22:01.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0930000000000003e-06 2024-04-26T10:22:01.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627053+0000", 2024-04-26T10:22:01.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088895221999999996 2024-04-26T10:22:01.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627092+0000", 2024-04-26T10:22:01.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9657000000000003e-05 2024-04-26T10:22:01.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631499+0000", 2024-04-26T10:22:01.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044066560000000001 2024-04-26T10:22:01.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631549+0000", 2024-04-26T10:22:01.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0259000000000001e-05 2024-04-26T10:22:01.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.691 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.691 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65298 5.b 5:d51c4e52:::benchmark_data_smithi052_19421_object65297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:01.691 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:01.691 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.055541917, 2024-04-26T10:22:01.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091641671999999993, 2024-04-26T10:22:01.692 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:01.692 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:01.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:01.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:01.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.692 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65298 2024-04-26T10:22:01.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.692 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:01.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:01.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:01.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538844+0000", 2024-04-26T10:22:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538919+0000", 2024-04-26T10:22:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4626e-05 2024-04-26T10:22:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:01.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626007+0000", 2024-04-26T10:22:01.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087087516000000004 2024-04-26T10:22:01.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626074+0000", 2024-04-26T10:22:01.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7077999999999997e-05 2024-04-26T10:22:01.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:01.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626150+0000", 2024-04-26T10:22:01.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5982999999999994e-05 2024-04-26T10:22:01.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:01.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626341+0000", 2024-04-26T10:22:01.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019141199999999999 2024-04-26T10:22:01.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:01.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630359+0000", 2024-04-26T10:22:01.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040175710000000002 2024-04-26T10:22:01.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:01.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630412+0000", 2024-04-26T10:22:01.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3779000000000001e-05 2024-04-26T10:22:01.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:01.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:01.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:01.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630487+0000", 2024-04-26T10:22:01.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4913999999999995e-05 2024-04-26T10:22:01.696 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.696 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.696 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.696 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:01.696 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:01.696 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:01.697 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 28 16 67449 67433 150.503 134.25 0.00861994 0.00663869 2024-04-26T10:22:01.697 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T10:22:01.698 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:01.692+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:01.698 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:01.798 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:01.792+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:01.823 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:01.823 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:01.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.824 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:67888 5.5 5:ae284898:::benchmark_data_smithi052_19421_object67887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:22:01.824 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:01.816203+0000", 2024-04-26T10:22:01.824 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0057194389999999998, 2024-04-26T10:22:01.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057392149999999998, 2024-04-26T10:22:01.824 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.824 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:01.824 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.824 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.824 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.824 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67888 2024-04-26T10:22:01.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.824 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816203+0000", 2024-04-26T10:22:01.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816203+0000", 2024-04-26T10:22:01.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816202+0000", 2024-04-26T10:22:01.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816296+0000", 2024-04-26T10:22:01.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3834999999999999e-05 2024-04-26T10:22:01.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816304+0000", 2024-04-26T10:22:01.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:22:01.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816309+0000", 2024-04-26T10:22:01.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4700000000000001e-06 2024-04-26T10:22:01.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816350+0000", 2024-04-26T10:22:01.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0970000000000002e-05 2024-04-26T10:22:01.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816450+0000", 2024-04-26T10:22:01.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9895999999999994e-05 2024-04-26T10:22:01.827 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.827 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.827 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.828 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:67889 5.f 5:fb802d52:::benchmark_data_smithi052_19421_object67888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:22:01.828 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:01.816320+0000", 2024-04-26T10:22:01.828 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0056023080000000003, 2024-04-26T10:22:01.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056641, 2024-04-26T10:22:01.828 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.828 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:01.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.828 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.828 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67889 2024-04-26T10:22:01.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.828 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816320+0000", 2024-04-26T10:22:01.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816320+0000", 2024-04-26T10:22:01.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816320+0000", 2024-04-26T10:22:01.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816351+0000", 2024-04-26T10:22:01.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0960999999999997e-05 2024-04-26T10:22:01.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816357+0000", 2024-04-26T10:22:01.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6649999999999997e-06 2024-04-26T10:22:01.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816361+0000", 2024-04-26T10:22:01.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.743e-06 2024-04-26T10:22:01.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.818886+0000", 2024-04-26T10:22:01.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025248919999999999 2024-04-26T10:22:01.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.819018+0000", 2024-04-26T10:22:01.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013163500000000001 2024-04-26T10:22:01.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:01.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.819170+0000", 2024-04-26T10:22:01.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015271699999999999 2024-04-26T10:22:01.832 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.832 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.832 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.832 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:67890 5.3 5:c7ed75eb:::benchmark_data_smithi052_19421_object67889:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:22:01.832 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:01.816369+0000", 2024-04-26T10:22:01.832 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0055534920000000002, 2024-04-26T10:22:01.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056825499999999998, 2024-04-26T10:22:01.832 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.832 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:01.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.833 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.833 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.833 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67890 2024-04-26T10:22:01.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.833 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816369+0000", 2024-04-26T10:22:01.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816369+0000", 2024-04-26T10:22:01.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816369+0000", 2024-04-26T10:22:01.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816401+0000", 2024-04-26T10:22:01.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2045000000000002e-05 2024-04-26T10:22:01.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816415+0000", 2024-04-26T10:22:01.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.433e-05 2024-04-26T10:22:01.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816419+0000", 2024-04-26T10:22:01.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1139999999999999e-06 2024-04-26T10:22:01.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816464+0000", 2024-04-26T10:22:01.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4916000000000002e-05 2024-04-26T10:22:01.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816600+0000", 2024-04-26T10:22:01.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000135978 2024-04-26T10:22:01.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.836 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.836 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:67891 5.1 5:8d8889f9:::benchmark_data_smithi052_19421_object67890:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:22:01.836 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:01.816429+0000", 2024-04-26T10:22:01.836 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0054938529999999999, 2024-04-26T10:22:01.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056579530000000003, 2024-04-26T10:22:01.836 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.836 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:01.836 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.837 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67891 2024-04-26T10:22:01.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.837 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816429+0000", 2024-04-26T10:22:01.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816429+0000", 2024-04-26T10:22:01.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816428+0000", 2024-04-26T10:22:01.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816464+0000", 2024-04-26T10:22:01.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5818999999999997e-05 2024-04-26T10:22:01.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816469+0000", 2024-04-26T10:22:01.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1669999999999998e-06 2024-04-26T10:22:01.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816474+0000", 2024-04-26T10:22:01.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9119999999999997e-06 2024-04-26T10:22:01.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.818617+0000", 2024-04-26T10:22:01.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021434470000000001 2024-04-26T10:22:01.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.818751+0000", 2024-04-26T10:22:01.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133483 2024-04-26T10:22:01.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.840 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.840 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:67892 5.6 5:6412f742:::benchmark_data_smithi052_19421_object67891:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:22:01.840 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:01.816580+0000", 2024-04-26T10:22:01.840 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0053425740000000001, 2024-04-26T10:22:01.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055423699999999996, 2024-04-26T10:22:01.840 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.840 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:01.840 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.841 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67892 2024-04-26T10:22:01.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.841 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816580+0000", 2024-04-26T10:22:01.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816580+0000", 2024-04-26T10:22:01.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816579+0000", 2024-04-26T10:22:01.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816632+0000", 2024-04-26T10:22:01.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2688000000000001e-05 2024-04-26T10:22:01.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816639+0000", 2024-04-26T10:22:01.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3379999999999999e-06 2024-04-26T10:22:01.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816649+0000", 2024-04-26T10:22:01.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4269999999999997e-06 2024-04-26T10:22:01.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816691+0000", 2024-04-26T10:22:01.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2602999999999999e-05 2024-04-26T10:22:01.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.816819+0000", 2024-04-26T10:22:01.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012786399999999999 2024-04-26T10:22:01.844 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.844 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.844 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.844 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:67894 5.3 5:c11d327e:::benchmark_data_smithi052_19421_object67893:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:22:01.844 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:01.817722+0000", 2024-04-26T10:22:01.844 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0042007609999999999, 2024-04-26T10:22:01.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044357379999999998, 2024-04-26T10:22:01.844 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.844 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:01.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.845 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67894 2024-04-26T10:22:01.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.845 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.817722+0000", 2024-04-26T10:22:01.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.817722+0000", 2024-04-26T10:22:01.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.817721+0000", 2024-04-26T10:22:01.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.817789+0000", 2024-04-26T10:22:01.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7930999999999997e-05 2024-04-26T10:22:01.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.817803+0000", 2024-04-26T10:22:01.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3997e-05 2024-04-26T10:22:01.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.817810+0000", 2024-04-26T10:22:01.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1210000000000001e-06 2024-04-26T10:22:01.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.819215+0000", 2024-04-26T10:22:01.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014053970000000001 2024-04-26T10:22:01.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.819338+0000", 2024-04-26T10:22:01.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012262699999999999 2024-04-26T10:22:01.847 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.848 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.848 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.848 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:67895 5.1 5:807a835b:::benchmark_data_smithi052_19421_object67894:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:22:01.848 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:01.817829+0000", 2024-04-26T10:22:01.848 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0040939640000000003, 2024-04-26T10:22:01.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044034010000000004, 2024-04-26T10:22:01.848 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.848 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:01.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.849 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67895 2024-04-26T10:22:01.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.849 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.817829+0000", 2024-04-26T10:22:01.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.817829+0000", 2024-04-26T10:22:01.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.817828+0000", 2024-04-26T10:22:01.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.817863+0000", 2024-04-26T10:22:01.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5055000000000002e-05 2024-04-26T10:22:01.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.817874+0000", 2024-04-26T10:22:01.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0781999999999999e-05 2024-04-26T10:22:01.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.817880+0000", 2024-04-26T10:22:01.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7450000000000001e-06 2024-04-26T10:22:01.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.820906+0000", 2024-04-26T10:22:01.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030260550000000002 2024-04-26T10:22:01.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.821088+0000", 2024-04-26T10:22:01.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018284700000000001 2024-04-26T10:22:01.852 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.852 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.852 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.852 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:67896 5.c 5:30625d78:::benchmark_data_smithi052_19421_object67895:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:22:01.852 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:01.818469+0000", 2024-04-26T10:22:01.852 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003453247, 2024-04-26T10:22:01.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038067650000000001, 2024-04-26T10:22:01.852 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.852 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:01.853 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.853 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.853 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.853 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67896 2024-04-26T10:22:01.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.853 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.818469+0000", 2024-04-26T10:22:01.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.818469+0000", 2024-04-26T10:22:01.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.818468+0000", 2024-04-26T10:22:01.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.818555+0000", 2024-04-26T10:22:01.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6565999999999998e-05 2024-04-26T10:22:01.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.818564+0000", 2024-04-26T10:22:01.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3239999999999992e-06 2024-04-26T10:22:01.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.818571+0000", 2024-04-26T10:22:01.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5660000000000003e-06 2024-04-26T10:22:01.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.818628+0000", 2024-04-26T10:22:01.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7537999999999997e-05 2024-04-26T10:22:01.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.818718+0000", 2024-04-26T10:22:01.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9662999999999999e-05 2024-04-26T10:22:01.856 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.856 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.856 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.856 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:67897 5.3 5:cccf01dc:::benchmark_data_smithi052_19421_object67896:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:22:01.856 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:01.818915+0000", 2024-04-26T10:22:01.856 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0030070349999999999, 2024-04-26T10:22:01.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033944399999999999, 2024-04-26T10:22:01.856 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.857 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:01.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.857 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67897 2024-04-26T10:22:01.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.857 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.818915+0000", 2024-04-26T10:22:01.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.818915+0000", 2024-04-26T10:22:01.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.818915+0000", 2024-04-26T10:22:01.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:01.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.818992+0000", 2024-04-26T10:22:01.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7690999999999999e-05 2024-04-26T10:22:01.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.818999+0000", 2024-04-26T10:22:01.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4629999999999998e-06 2024-04-26T10:22:01.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.819003+0000", 2024-04-26T10:22:01.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4229999999999998e-06 2024-04-26T10:22:01.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.821380+0000", 2024-04-26T10:22:01.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023768449999999998 2024-04-26T10:22:01.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.821519+0000", 2024-04-26T10:22:01.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139147 2024-04-26T10:22:01.860 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.860 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.860 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.860 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:67884 5.9 5:9602461f:::benchmark_data_smithi052_19421_object67883:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:22:01.860 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:01.813606+0000", 2024-04-26T10:22:01.860 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0083165449999999998, 2024-04-26T10:22:01.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087383229999999992, 2024-04-26T10:22:01.860 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:01.861 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:01.861 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:01.861 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:01.861 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:01.861 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 67884 2024-04-26T10:22:01.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.861 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:01.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:01.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.813606+0000", 2024-04-26T10:22:01.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:01.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.813606+0000", 2024-04-26T10:22:01.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:01.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:01.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.813606+0000", 2024-04-26T10:22:01.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:01.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:01.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.813686+0000", 2024-04-26T10:22:01.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0468000000000003e-05 2024-04-26T10:22:01.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:01.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.813692+0000", 2024-04-26T10:22:01.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2140000000000001e-06 2024-04-26T10:22:01.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:01.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.813696+0000", 2024-04-26T10:22:01.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2180000000000001e-06 2024-04-26T10:22:01.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:01.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.813798+0000", 2024-04-26T10:22:01.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101245 2024-04-26T10:22:01.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:01.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.813946+0000", 2024-04-26T10:22:01.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014778 2024-04-26T10:22:01.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:01.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.814102+0000", 2024-04-26T10:22:01.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015689499999999999 2024-04-26T10:22:01.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:01.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:01.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:01.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.821167+0000", 2024-04-26T10:22:01.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070647560000000002 2024-04-26T10:22:01.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.865 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:01.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:01.865 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:01.865 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 10 2024-04-26T10:22:01.865 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:01.866 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:01.899 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:01.896+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:01.997 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:01.998 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:01.998 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:02.000 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:01.997+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:02.012 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:02.060 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:22:02.101 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:02.097+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:02.137 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:22:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 59.894210884000003, 2024-04-26T10:22:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018452342, 2024-04-26T10:22:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115 2024-04-26T10:22:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:22:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:22:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239018+0000", 2024-04-26T10:22:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239152+0000", 2024-04-26T10:22:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414699999999999 2024-04-26T10:22:02.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239169+0000", 2024-04-26T10:22:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7013000000000001e-05 2024-04-26T10:22:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239190+0000", 2024-04-26T10:22:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1302999999999999e-05 2024-04-26T10:22:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252181+0000", 2024-04-26T10:22:02.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012990213 2024-04-26T10:22:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252411+0000", 2024-04-26T10:22:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023010199999999999 2024-04-26T10:22:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252687+0000", 2024-04-26T10:22:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000276063 2024-04-26T10:22:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:02.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254694+0000", 2024-04-26T10:22:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020072879999999999 2024-04-26T10:22:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257399+0000", 2024-04-26T10:22:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027051670000000001 2024-04-26T10:22:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257442+0000", 2024-04-26T10:22:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-04-26T10:22:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257471+0000", 2024-04-26T10:22:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.889e-05 2024-04-26T10:22:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:22:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 59.894030354999998, 2024-04-26T10:22:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018350615000000001, 2024-04-26T10:22:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.143 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116 2024-04-26T10:22:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:22:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:22:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239198+0000", 2024-04-26T10:22:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239213+0000", 2024-04-26T10:22:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4965e-05 2024-04-26T10:22:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239235+0000", 2024-04-26T10:22:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.156e-05 2024-04-26T10:22:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239243+0000", 2024-04-26T10:22:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9470000000000003e-06 2024-04-26T10:22:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253284+0000", 2024-04-26T10:22:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014041392999999999 2024-04-26T10:22:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253376+0000", 2024-04-26T10:22:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1198000000000003e-05 2024-04-26T10:22:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253508+0000", 2024-04-26T10:22:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013220199999999999 2024-04-26T10:22:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255474+0000", 2024-04-26T10:22:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019665590000000001 2024-04-26T10:22:02.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257480+0000", 2024-04-26T10:22:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00200599 2024-04-26T10:22:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257515+0000", 2024-04-26T10:22:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5126000000000002e-05 2024-04-26T10:22:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257550+0000", 2024-04-26T10:22:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4394000000000003e-05 2024-04-26T10:22:02.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:22:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 59.893976799000001, 2024-04-26T10:22:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018369330999999999, 2024-04-26T10:22:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:02.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117 2024-04-26T10:22:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:22:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:22:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239252+0000", 2024-04-26T10:22:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239267+0000", 2024-04-26T10:22:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4562999999999999e-05 2024-04-26T10:22:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239281+0000", 2024-04-26T10:22:02.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4e-05 2024-04-26T10:22:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239296+0000", 2024-04-26T10:22:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5492999999999999e-05 2024-04-26T10:22:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254076+0000", 2024-04-26T10:22:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014779814 2024-04-26T10:22:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254159+0000", 2024-04-26T10:22:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2923999999999994e-05 2024-04-26T10:22:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254279+0000", 2024-04-26T10:22:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011964300000000001 2024-04-26T10:22:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.256043+0000", 2024-04-26T10:22:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001764353 2024-04-26T10:22:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257559+0000", 2024-04-26T10:22:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015159189999999999 2024-04-26T10:22:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257597+0000", 2024-04-26T10:22:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8031999999999998e-05 2024-04-26T10:22:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257622+0000", 2024-04-26T10:22:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5213999999999999e-05 2024-04-26T10:22:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.157 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 59.483238126000003, 2024-04-26T10:22:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019547338000000001, 2024-04-26T10:22:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165 2024-04-26T10:22:02.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:02.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649996+0000", 2024-04-26T10:22:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-04-26T10:22:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650021+0000", 2024-04-26T10:22:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5179999999999999e-05 2024-04-26T10:22:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650030+0000", 2024-04-26T10:22:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-04-26T10:22:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664733+0000", 2024-04-26T10:22:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014703097 2024-04-26T10:22:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664821+0000", 2024-04-26T10:22:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7918999999999996e-05 2024-04-26T10:22:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664953+0000", 2024-04-26T10:22:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132662 2024-04-26T10:22:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666776+0000", 2024-04-26T10:22:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018225509999999999 2024-04-26T10:22:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669480+0000", 2024-04-26T10:22:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00270382 2024-04-26T10:22:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669515+0000", 2024-04-26T10:22:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4885000000000002e-05 2024-04-26T10:22:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669539+0000", 2024-04-26T10:22:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4121000000000002e-05 2024-04-26T10:22:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.163 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:22:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 59.293588665999998, 2024-04-26T10:22:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018757273000000001, 2024-04-26T10:22:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 186 2024-04-26T10:22:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:22:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:22:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839640+0000", 2024-04-26T10:22:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839646+0000", 2024-04-26T10:22:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:22:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839654+0000", 2024-04-26T10:22:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:22:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839661+0000", 2024-04-26T10:22:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.64e-06 2024-04-26T10:22:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852328+0000", 2024-04-26T10:22:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012667151 2024-04-26T10:22:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852538+0000", 2024-04-26T10:22:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020961100000000001 2024-04-26T10:22:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852945+0000", 2024-04-26T10:22:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040712099999999998 2024-04-26T10:22:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857372+0000", 2024-04-26T10:22:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044268049999999998 2024-04-26T10:22:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858321+0000", 2024-04-26T10:22:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094932999999999997 2024-04-26T10:22:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858367+0000", 2024-04-26T10:22:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5534000000000001e-05 2024-04-26T10:22:02.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858398+0000", 2024-04-26T10:22:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1562e-05 2024-04-26T10:22:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:22:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 59.293561500000003, 2024-04-26T10:22:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019669504000000001, 2024-04-26T10:22:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.169 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187 2024-04-26T10:22:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:22:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:22:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839667+0000", 2024-04-26T10:22:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839677+0000", 2024-04-26T10:22:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3270000000000007e-06 2024-04-26T10:22:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839685+0000", 2024-04-26T10:22:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2670000000000006e-06 2024-04-26T10:22:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839692+0000", 2024-04-26T10:22:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7129999999999999e-06 2024-04-26T10:22:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853685+0000", 2024-04-26T10:22:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013993716999999999 2024-04-26T10:22:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853876+0000", 2024-04-26T10:22:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019097100000000001 2024-04-26T10:22:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853989+0000", 2024-04-26T10:22:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011275199999999999 2024-04-26T10:22:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857377+0000", 2024-04-26T10:22:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033882489999999999 2024-04-26T10:22:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859222+0000", 2024-04-26T10:22:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001844233 2024-04-26T10:22:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859291+0000", 2024-04-26T10:22:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:22:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859338+0000", 2024-04-26T10:22:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6366000000000003e-05 2024-04-26T10:22:02.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:22:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 59.293530634, 2024-04-26T10:22:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019837468, 2024-04-26T10:22:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:02.175 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 188 2024-04-26T10:22:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:22:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:22:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839698+0000", 2024-04-26T10:22:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839829+0000", 2024-04-26T10:22:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013061099999999999 2024-04-26T10:22:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839853+0000", 2024-04-26T10:22:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3736000000000001e-05 2024-04-26T10:22:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839863+0000", 2024-04-26T10:22:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:22:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854869+0000", 2024-04-26T10:22:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015005978 2024-04-26T10:22:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854959+0000", 2024-04-26T10:22:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9468999999999993e-05 2024-04-26T10:22:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855114+0000", 2024-04-26T10:22:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015563799999999999 2024-04-26T10:22:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857386+0000", 2024-04-26T10:22:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002271852 2024-04-26T10:22:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859406+0000", 2024-04-26T10:22:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002019936 2024-04-26T10:22:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859461+0000", 2024-04-26T10:22:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4826e-05 2024-04-26T10:22:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859536+0000", 2024-04-26T10:22:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5566000000000001e-05 2024-04-26T10:22:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.180 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:22:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 59.293356770999999, 2024-04-26T10:22:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019826496999999998, 2024-04-26T10:22:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 189 2024-04-26T10:22:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:22:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:22:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839872+0000", 2024-04-26T10:22:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839882+0000", 2024-04-26T10:22:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:22:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839892+0000", 2024-04-26T10:22:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.217e-06 2024-04-26T10:22:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839900+0000", 2024-04-26T10:22:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5469999999999997e-06 2024-04-26T10:22:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855903+0000", 2024-04-26T10:22:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016002590000000001 2024-04-26T10:22:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856110+0000", 2024-04-26T10:22:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020711199999999999 2024-04-26T10:22:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856421+0000", 2024-04-26T10:22:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031128500000000001 2024-04-26T10:22:02.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857643+0000", 2024-04-26T10:22:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012215520000000001 2024-04-26T10:22:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859603+0000", 2024-04-26T10:22:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019600350000000002 2024-04-26T10:22:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859660+0000", 2024-04-26T10:22:02.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6857999999999997e-05 2024-04-26T10:22:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859699+0000", 2024-04-26T10:22:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9641999999999998e-05 2024-04-26T10:22:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34427 5.7 5:ef7d83e6:::benchmark_data_smithi052_19421_object34426:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:22:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:22:02.186 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.501151112000001, 2024-04-26T10:22:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02010443, 2024-04-26T10:22:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34427 2024-04-26T10:22:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:22:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:22:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632077+0000", 2024-04-26T10:22:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632139+0000", 2024-04-26T10:22:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2527999999999995e-05 2024-04-26T10:22:02.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632153+0000", 2024-04-26T10:22:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3608000000000001e-05 2024-04-26T10:22:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632165+0000", 2024-04-26T10:22:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2592000000000001e-05 2024-04-26T10:22:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635907+0000", 2024-04-26T10:22:02.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037419789999999999 2024-04-26T10:22:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635919+0000", 2024-04-26T10:22:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1511999999999999e-05 2024-04-26T10:22:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641616+0000", 2024-04-26T10:22:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056974770000000003 2024-04-26T10:22:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641772+0000", 2024-04-26T10:22:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155799 2024-04-26T10:22:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.651965+0000", 2024-04-26T10:22:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010193254000000001 2024-04-26T10:22:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652039+0000", 2024-04-26T10:22:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4031999999999999e-05 2024-04-26T10:22:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652183+0000", 2024-04-26T10:22:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014342599999999999 2024-04-26T10:22:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45130 5.5 5:a1beca5f:::benchmark_data_smithi052_19421_object45129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:22:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:22:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.447667489000001, 2024-04-26T10:22:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019561411000000001, 2024-04-26T10:22:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.192 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45130 2024-04-26T10:22:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:22:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:22:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685561+0000", 2024-04-26T10:22:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685648+0000", 2024-04-26T10:22:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6552999999999996e-05 2024-04-26T10:22:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685657+0000", 2024-04-26T10:22:02.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1330000000000005e-06 2024-04-26T10:22:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685664+0000", 2024-04-26T10:22:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1069999999999999e-06 2024-04-26T10:22:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.691613+0000", 2024-04-26T10:22:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059489199999999999 2024-04-26T10:22:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.691779+0000", 2024-04-26T10:22:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016567700000000001 2024-04-26T10:22:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705021+0000", 2024-04-26T10:22:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013242812 2024-04-26T10:22:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705054+0000", 2024-04-26T10:22:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2709999999999997e-05 2024-04-26T10:22:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705123+0000", 2024-04-26T10:22:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9246999999999996e-05 2024-04-26T10:22:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:49103 5.f 5:f082f091:::benchmark_data_smithi052_19421_object49102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:22:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:22:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8050616220000002, 2024-04-26T10:22:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019587917, 2024-04-26T10:22:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.197 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49103 2024-04-26T10:22:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:22:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:22:02.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328167+0000", 2024-04-26T10:22:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328207+0000", 2024-04-26T10:22:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0275999999999999e-05 2024-04-26T10:22:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328220+0000", 2024-04-26T10:22:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2968e-05 2024-04-26T10:22:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328233+0000", 2024-04-26T10:22:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2203e-05 2024-04-26T10:22:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.333946+0000", 2024-04-26T10:22:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057135110000000001 2024-04-26T10:22:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.335894+0000", 2024-04-26T10:22:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019474959999999999 2024-04-26T10:22:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.336030+0000", 2024-04-26T10:22:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013601999999999999 2024-04-26T10:22:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.340794+0000", 2024-04-26T10:22:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047643800000000004 2024-04-26T10:22:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347659+0000", 2024-04-26T10:22:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068648800000000003 2024-04-26T10:22:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347713+0000", 2024-04-26T10:22:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3736000000000002e-05 2024-04-26T10:22:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347756+0000", 2024-04-26T10:22:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3155000000000003e-05 2024-04-26T10:22:02.202 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:49261 5.5 5:a449de5e:::benchmark_data_smithi052_19421_object49260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:22:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:22:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.7410575759999993, 2024-04-26T10:22:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020598741, 2024-04-26T10:22:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:02.203 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49261 2024-04-26T10:22:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:22:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:22:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392171+0000", 2024-04-26T10:22:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392212+0000", 2024-04-26T10:22:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0889000000000001e-05 2024-04-26T10:22:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392221+0000", 2024-04-26T10:22:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1970000000000002e-06 2024-04-26T10:22:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392228+0000", 2024-04-26T10:22:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.397869+0000", 2024-04-26T10:22:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056403180000000001 2024-04-26T10:22:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.398010+0000", 2024-04-26T10:22:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014105300000000001 2024-04-26T10:22:02.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412532+0000", 2024-04-26T10:22:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014522431000000001 2024-04-26T10:22:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412692+0000", 2024-04-26T10:22:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015970700000000001 2024-04-26T10:22:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412771+0000", 2024-04-26T10:22:02.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8980000000000006e-05 2024-04-26T10:22:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.6038833320000001, 2024-04-26T10:22:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:02.208 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:02.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.213 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.5993481200000002, 2024-04-26T10:22:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.214 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:02.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:02.219 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.5987168280000001, 2024-04-26T10:22:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:02.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:02.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:02.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.225 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65604 5.9 5:9c239c32:::benchmark_data_smithi052_19421_object65603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.3636139439999999, 2024-04-26T10:22:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025897677000000001, 2024-04-26T10:22:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65604 2024-04-26T10:22:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.226 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769615+0000", 2024-04-26T10:22:02.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769694+0000", 2024-04-26T10:22:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9087999999999999e-05 2024-04-26T10:22:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769702+0000", 2024-04-26T10:22:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8150000000000006e-06 2024-04-26T10:22:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769709+0000", 2024-04-26T10:22:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:22:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772336+0000", 2024-04-26T10:22:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002626836 2024-04-26T10:22:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772470+0000", 2024-04-26T10:22:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013453299999999999 2024-04-26T10:22:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772605+0000", 2024-04-26T10:22:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013428499999999999 2024-04-26T10:22:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779374+0000", 2024-04-26T10:22:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067694000000000001 2024-04-26T10:22:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795401+0000", 2024-04-26T10:22:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016026543000000001 2024-04-26T10:22:02.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795461+0000", 2024-04-26T10:22:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9923999999999998e-05 2024-04-26T10:22:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795513+0000", 2024-04-26T10:22:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2737e-05 2024-04-26T10:22:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.231 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65613 5.1 5:85cc6530:::benchmark_data_smithi052_19421_object65612:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.3612408979999999, 2024-04-26T10:22:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023662843999999999, 2024-04-26T10:22:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65613 2024-04-26T10:22:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771988+0000", 2024-04-26T10:22:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772053+0000", 2024-04-26T10:22:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5067000000000006e-05 2024-04-26T10:22:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772065+0000", 2024-04-26T10:22:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2252999999999999e-05 2024-04-26T10:22:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772072+0000", 2024-04-26T10:22:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1400000000000002e-06 2024-04-26T10:22:02.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779354+0000", 2024-04-26T10:22:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072818120000000004 2024-04-26T10:22:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779455+0000", 2024-04-26T10:22:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101109 2024-04-26T10:22:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795526+0000", 2024-04-26T10:22:02.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016071203999999999 2024-04-26T10:22:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795572+0000", 2024-04-26T10:22:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5865999999999998e-05 2024-04-26T10:22:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795651+0000", 2024-04-26T10:22:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9192999999999999e-05 2024-04-26T10:22:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.236 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65614 5.9 5:993a4fbe:::benchmark_data_smithi052_19421_object65613:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.3611487069999999, 2024-04-26T10:22:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023664145000000001, 2024-04-26T10:22:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65614 2024-04-26T10:22:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772080+0000", 2024-04-26T10:22:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:02.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772117+0000", 2024-04-26T10:22:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6418000000000003e-05 2024-04-26T10:22:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772124+0000", 2024-04-26T10:22:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4730000000000003e-06 2024-04-26T10:22:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772132+0000", 2024-04-26T10:22:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3900000000000004e-06 2024-04-26T10:22:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781379+0000", 2024-04-26T10:22:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092471059999999997 2024-04-26T10:22:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781495+0000", 2024-04-26T10:22:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001159 2024-04-26T10:22:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781581+0000", 2024-04-26T10:22:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6087000000000004e-05 2024-04-26T10:22:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.785948+0000", 2024-04-26T10:22:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043671669999999999 2024-04-26T10:22:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795661+0000", 2024-04-26T10:22:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097130310000000004 2024-04-26T10:22:02.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795710+0000", 2024-04-26T10:22:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8959000000000003e-05 2024-04-26T10:22:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795745+0000", 2024-04-26T10:22:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5172000000000001e-05 2024-04-26T10:22:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.243 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65619 5.1 5:89edbbcc:::benchmark_data_smithi052_19421_object65618:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:02.243 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.775377+0000", 2024-04-26T10:22:02.243 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.3578528089999999, 2024-04-26T10:22:02.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020492052, 2024-04-26T10:22:02.243 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.243 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.243 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.243 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:02.243 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:02.243 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65619 2024-04-26T10:22:02.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.243 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775377+0000", 2024-04-26T10:22:02.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775377+0000", 2024-04-26T10:22:02.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775376+0000", 2024-04-26T10:22:02.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:02.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775450+0000", 2024-04-26T10:22:02.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3485000000000005e-05 2024-04-26T10:22:02.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775459+0000", 2024-04-26T10:22:02.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1030000000000008e-06 2024-04-26T10:22:02.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775463+0000", 2024-04-26T10:22:02.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0060000000000003e-06 2024-04-26T10:22:02.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.783840+0000", 2024-04-26T10:22:02.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083774339999999996 2024-04-26T10:22:02.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.783963+0000", 2024-04-26T10:22:02.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012291900000000001 2024-04-26T10:22:02.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795755+0000", 2024-04-26T10:22:02.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011791793 2024-04-26T10:22:02.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795798+0000", 2024-04-26T10:22:02.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3597999999999998e-05 2024-04-26T10:22:02.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795869+0000", 2024-04-26T10:22:02.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0413000000000005e-05 2024-04-26T10:22:02.247 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.247 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.247 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.247 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:68218 5.9 5:9d226c09:::benchmark_data_smithi052_19421_object68217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:22:02.247 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:01.979822+0000", 2024-04-26T10:22:02.248 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.15340705299999999, 2024-04-26T10:22:02.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021403591, 2024-04-26T10:22:02.248 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:02.248 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:02.248 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:02.248 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:02.248 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:02.248 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 68218 2024-04-26T10:22:02.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.248 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:02.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:02.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979822+0000", 2024-04-26T10:22:02.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:02.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979822+0000", 2024-04-26T10:22:02.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:02.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:02.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979822+0000", 2024-04-26T10:22:02.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:02.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:02.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979889+0000", 2024-04-26T10:22:02.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7892000000000007e-05 2024-04-26T10:22:02.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:02.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979902+0000", 2024-04-26T10:22:02.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2668e-05 2024-04-26T10:22:02.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:02.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979912+0000", 2024-04-26T10:22:02.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5599999999999999e-06 2024-04-26T10:22:02.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:02.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979959+0000", 2024-04-26T10:22:02.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6980000000000001e-05 2024-04-26T10:22:02.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:02.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.980117+0000", 2024-04-26T10:22:02.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015815499999999999 2024-04-26T10:22:02.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:02.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.980279+0000", 2024-04-26T10:22:02.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161903 2024-04-26T10:22:02.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:02.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.984675+0000", 2024-04-26T10:22:02.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043966159999999999 2024-04-26T10:22:02.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:02.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:02.001127+0000", 2024-04-26T10:22:02.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016452106000000001 2024-04-26T10:22:02.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:02.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:02.001177+0000", 2024-04-26T10:22:02.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9882000000000001e-05 2024-04-26T10:22:02.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:02.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:02.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:02.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:02.001226+0000", 2024-04-26T10:22:02.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8748000000000002e-05 2024-04-26T10:22:02.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.253 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:02.253 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:02.253 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:02.255 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:02.255 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:02.255 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:02.256 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:02.256 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:02.253+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:02.257 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:02.257 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:02.257 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:02.257 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:02.359 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:02.352+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:02.385 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:02.386 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:02.397 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:02.457 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:02.452+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:02.521 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:02.522 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:02.532 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:02.579 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:02.576+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:02.616 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 29 16 69590 69574 149.927 133.812 0.00805651 0.00666428 2024-04-26T10:22:02.658 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:02.653+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:02.701 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.1 to 0.342449 (57aa) 2024-04-26T10:22:02.705 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:02.705 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:02.715 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:02.759 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:02.756+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:02.818 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:02.818 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:02.827 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:02.860 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:02.857+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:02.929 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:02.929 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:02.939 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:02.962 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:02.956+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:03.062 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:03.060+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:03.089 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:03.089 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:03.100 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:03.163 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:03.160+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:03.221 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:03.221 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:03.231 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:03.264 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:03.261+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:03.337 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:03.337 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:03.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:03.365 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:03.361+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:03.454 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:03.454 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:03.464 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:03.466 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:03.460+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:03.567 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:03.565+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:03.581 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:03.581 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:03.591 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:03.616 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 30 16 69809 69793 145.385 13.6875 0.00296747 0.00666794 2024-04-26T10:22:03.668 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:03.665+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:03.699 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:03.700 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:03.702 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:22:03.709 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:03.770 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:03.764+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:03.814 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:03.814 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:03.823 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:03.871 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:03.868+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:03.938 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:03.938 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:03.948 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:03.991 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:03.988+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:04.073 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:04.069+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:04.104 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:04.104 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:04.114 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:04.149 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T10:22:04.173 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:04.168+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:04.237 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:04.237 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:04.247 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:04.258 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:22:04.273 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:04.269+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:04.374 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:04.373+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:04.377 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:04.377 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:04.392 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:04.411 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:04.431 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:04.431 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:04.432 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:04.432 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:04.436 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:04.436 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:04.475 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:04.472+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:04.565 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:04.566 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:04.566 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:04.566 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:04.566 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:04.577 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:04.573+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:04.578 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:04.616 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 31 16 70544 70528 142.177 45.9375 0.0189547 0.00702788 2024-04-26T10:22:04.677 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:04.672+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:04.718 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:04.718 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:04.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:22:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.473680700000003, 2024-04-26T10:22:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018452342, 2024-04-26T10:22:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:04.719 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115 2024-04-26T10:22:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:22:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:22:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239018+0000", 2024-04-26T10:22:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239152+0000", 2024-04-26T10:22:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414699999999999 2024-04-26T10:22:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239169+0000", 2024-04-26T10:22:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7013000000000001e-05 2024-04-26T10:22:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239190+0000", 2024-04-26T10:22:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1302999999999999e-05 2024-04-26T10:22:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252181+0000", 2024-04-26T10:22:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012990213 2024-04-26T10:22:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252411+0000", 2024-04-26T10:22:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023010199999999999 2024-04-26T10:22:04.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252687+0000", 2024-04-26T10:22:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000276063 2024-04-26T10:22:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254694+0000", 2024-04-26T10:22:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020072879999999999 2024-04-26T10:22:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257399+0000", 2024-04-26T10:22:04.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027051670000000001 2024-04-26T10:22:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257442+0000", 2024-04-26T10:22:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-04-26T10:22:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257471+0000", 2024-04-26T10:22:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.889e-05 2024-04-26T10:22:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.724 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:22:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.473500170999998, 2024-04-26T10:22:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018350615000000001, 2024-04-26T10:22:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116 2024-04-26T10:22:04.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:22:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:22:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239198+0000", 2024-04-26T10:22:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239213+0000", 2024-04-26T10:22:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4965e-05 2024-04-26T10:22:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239235+0000", 2024-04-26T10:22:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.156e-05 2024-04-26T10:22:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239243+0000", 2024-04-26T10:22:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9470000000000003e-06 2024-04-26T10:22:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253284+0000", 2024-04-26T10:22:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014041392999999999 2024-04-26T10:22:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253376+0000", 2024-04-26T10:22:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1198000000000003e-05 2024-04-26T10:22:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253508+0000", 2024-04-26T10:22:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013220199999999999 2024-04-26T10:22:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255474+0000", 2024-04-26T10:22:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019665590000000001 2024-04-26T10:22:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257480+0000", 2024-04-26T10:22:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00200599 2024-04-26T10:22:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257515+0000", 2024-04-26T10:22:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5126000000000002e-05 2024-04-26T10:22:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257550+0000", 2024-04-26T10:22:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4394000000000003e-05 2024-04-26T10:22:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:22:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.473446615, 2024-04-26T10:22:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018369330999999999, 2024-04-26T10:22:04.730 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117 2024-04-26T10:22:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:22:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:22:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239252+0000", 2024-04-26T10:22:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239267+0000", 2024-04-26T10:22:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4562999999999999e-05 2024-04-26T10:22:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239281+0000", 2024-04-26T10:22:04.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4e-05 2024-04-26T10:22:04.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239296+0000", 2024-04-26T10:22:04.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5492999999999999e-05 2024-04-26T10:22:04.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254076+0000", 2024-04-26T10:22:04.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014779814 2024-04-26T10:22:04.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254159+0000", 2024-04-26T10:22:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2923999999999994e-05 2024-04-26T10:22:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254279+0000", 2024-04-26T10:22:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011964300000000001 2024-04-26T10:22:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.256043+0000", 2024-04-26T10:22:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001764353 2024-04-26T10:22:04.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257559+0000", 2024-04-26T10:22:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015159189999999999 2024-04-26T10:22:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257597+0000", 2024-04-26T10:22:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8031999999999998e-05 2024-04-26T10:22:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257622+0000", 2024-04-26T10:22:04.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5213999999999999e-05 2024-04-26T10:22:04.736 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.736 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.736 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.736 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:04.736 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:04.736 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 62.062707942000003, 2024-04-26T10:22:04.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019547338000000001, 2024-04-26T10:22:04.736 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.736 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:04.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165 2024-04-26T10:22:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:04.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:04.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649996+0000", 2024-04-26T10:22:04.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-04-26T10:22:04.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650021+0000", 2024-04-26T10:22:04.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5179999999999999e-05 2024-04-26T10:22:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650030+0000", 2024-04-26T10:22:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-04-26T10:22:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664733+0000", 2024-04-26T10:22:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014703097 2024-04-26T10:22:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664821+0000", 2024-04-26T10:22:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7918999999999996e-05 2024-04-26T10:22:04.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664953+0000", 2024-04-26T10:22:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132662 2024-04-26T10:22:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666776+0000", 2024-04-26T10:22:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018225509999999999 2024-04-26T10:22:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669480+0000", 2024-04-26T10:22:04.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00270382 2024-04-26T10:22:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669515+0000", 2024-04-26T10:22:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4885000000000002e-05 2024-04-26T10:22:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669539+0000", 2024-04-26T10:22:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4121000000000002e-05 2024-04-26T10:22:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:22:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.873058481999998, 2024-04-26T10:22:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018757273000000001, 2024-04-26T10:22:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 186 2024-04-26T10:22:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:22:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:22:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839640+0000", 2024-04-26T10:22:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839646+0000", 2024-04-26T10:22:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:22:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839654+0000", 2024-04-26T10:22:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:22:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839661+0000", 2024-04-26T10:22:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.64e-06 2024-04-26T10:22:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852328+0000", 2024-04-26T10:22:04.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012667151 2024-04-26T10:22:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852538+0000", 2024-04-26T10:22:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020961100000000001 2024-04-26T10:22:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852945+0000", 2024-04-26T10:22:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040712099999999998 2024-04-26T10:22:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857372+0000", 2024-04-26T10:22:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044268049999999998 2024-04-26T10:22:04.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858321+0000", 2024-04-26T10:22:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094932999999999997 2024-04-26T10:22:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858367+0000", 2024-04-26T10:22:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5534000000000001e-05 2024-04-26T10:22:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858398+0000", 2024-04-26T10:22:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1562e-05 2024-04-26T10:22:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:22:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.873031316000002, 2024-04-26T10:22:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019669504000000001, 2024-04-26T10:22:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:04.747 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187 2024-04-26T10:22:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:22:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:22:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839667+0000", 2024-04-26T10:22:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839677+0000", 2024-04-26T10:22:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3270000000000007e-06 2024-04-26T10:22:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839685+0000", 2024-04-26T10:22:04.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2670000000000006e-06 2024-04-26T10:22:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839692+0000", 2024-04-26T10:22:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7129999999999999e-06 2024-04-26T10:22:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853685+0000", 2024-04-26T10:22:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013993716999999999 2024-04-26T10:22:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853876+0000", 2024-04-26T10:22:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019097100000000001 2024-04-26T10:22:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853989+0000", 2024-04-26T10:22:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011275199999999999 2024-04-26T10:22:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857377+0000", 2024-04-26T10:22:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033882489999999999 2024-04-26T10:22:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859222+0000", 2024-04-26T10:22:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001844233 2024-04-26T10:22:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859291+0000", 2024-04-26T10:22:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:22:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859338+0000", 2024-04-26T10:22:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6366000000000003e-05 2024-04-26T10:22:04.752 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:22:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.873000449999999, 2024-04-26T10:22:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019837468, 2024-04-26T10:22:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 188 2024-04-26T10:22:04.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:22:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:22:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839698+0000", 2024-04-26T10:22:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839829+0000", 2024-04-26T10:22:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013061099999999999 2024-04-26T10:22:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839853+0000", 2024-04-26T10:22:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3736000000000001e-05 2024-04-26T10:22:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839863+0000", 2024-04-26T10:22:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:22:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854869+0000", 2024-04-26T10:22:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015005978 2024-04-26T10:22:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854959+0000", 2024-04-26T10:22:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9468999999999993e-05 2024-04-26T10:22:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855114+0000", 2024-04-26T10:22:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015563799999999999 2024-04-26T10:22:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857386+0000", 2024-04-26T10:22:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002271852 2024-04-26T10:22:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859406+0000", 2024-04-26T10:22:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002019936 2024-04-26T10:22:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859461+0000", 2024-04-26T10:22:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4826e-05 2024-04-26T10:22:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859536+0000", 2024-04-26T10:22:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5566000000000001e-05 2024-04-26T10:22:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.758 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:22:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.872826586999999, 2024-04-26T10:22:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019826496999999998, 2024-04-26T10:22:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 189 2024-04-26T10:22:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:22:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:22:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839872+0000", 2024-04-26T10:22:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839882+0000", 2024-04-26T10:22:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:22:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839892+0000", 2024-04-26T10:22:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.217e-06 2024-04-26T10:22:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839900+0000", 2024-04-26T10:22:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5469999999999997e-06 2024-04-26T10:22:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855903+0000", 2024-04-26T10:22:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016002590000000001 2024-04-26T10:22:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856110+0000", 2024-04-26T10:22:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020711199999999999 2024-04-26T10:22:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856421+0000", 2024-04-26T10:22:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031128500000000001 2024-04-26T10:22:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857643+0000", 2024-04-26T10:22:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012215520000000001 2024-04-26T10:22:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859603+0000", 2024-04-26T10:22:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019600350000000002 2024-04-26T10:22:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859660+0000", 2024-04-26T10:22:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6857999999999997e-05 2024-04-26T10:22:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859699+0000", 2024-04-26T10:22:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9641999999999998e-05 2024-04-26T10:22:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34427 5.7 5:ef7d83e6:::benchmark_data_smithi052_19421_object34426:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:22:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:22:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.080620927999998, 2024-04-26T10:22:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02010443, 2024-04-26T10:22:04.764 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34427 2024-04-26T10:22:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:22:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:22:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632077+0000", 2024-04-26T10:22:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632139+0000", 2024-04-26T10:22:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2527999999999995e-05 2024-04-26T10:22:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632153+0000", 2024-04-26T10:22:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3608000000000001e-05 2024-04-26T10:22:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632165+0000", 2024-04-26T10:22:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2592000000000001e-05 2024-04-26T10:22:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635907+0000", 2024-04-26T10:22:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037419789999999999 2024-04-26T10:22:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:04.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635919+0000", 2024-04-26T10:22:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1511999999999999e-05 2024-04-26T10:22:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641616+0000", 2024-04-26T10:22:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056974770000000003 2024-04-26T10:22:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641772+0000", 2024-04-26T10:22:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155799 2024-04-26T10:22:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.651965+0000", 2024-04-26T10:22:04.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010193254000000001 2024-04-26T10:22:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652039+0000", 2024-04-26T10:22:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4031999999999999e-05 2024-04-26T10:22:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652183+0000", 2024-04-26T10:22:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014342599999999999 2024-04-26T10:22:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.770 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45130 5.5 5:a1beca5f:::benchmark_data_smithi052_19421_object45129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:22:04.770 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:22:04.770 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.027137305, 2024-04-26T10:22:04.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019561411000000001, 2024-04-26T10:22:04.770 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.770 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:04.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:04.770 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45130 2024-04-26T10:22:04.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.770 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:22:04.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:22:04.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685561+0000", 2024-04-26T10:22:04.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:04.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685648+0000", 2024-04-26T10:22:04.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6552999999999996e-05 2024-04-26T10:22:04.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685657+0000", 2024-04-26T10:22:04.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1330000000000005e-06 2024-04-26T10:22:04.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685664+0000", 2024-04-26T10:22:04.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1069999999999999e-06 2024-04-26T10:22:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.691613+0000", 2024-04-26T10:22:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059489199999999999 2024-04-26T10:22:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.691779+0000", 2024-04-26T10:22:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016567700000000001 2024-04-26T10:22:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705021+0000", 2024-04-26T10:22:04.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013242812 2024-04-26T10:22:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705054+0000", 2024-04-26T10:22:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2709999999999997e-05 2024-04-26T10:22:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705123+0000", 2024-04-26T10:22:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9246999999999996e-05 2024-04-26T10:22:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:49103 5.f 5:f082f091:::benchmark_data_smithi052_19421_object49102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:22:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:22:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.384531438, 2024-04-26T10:22:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019587917, 2024-04-26T10:22:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49103 2024-04-26T10:22:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:22:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:22:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328167+0000", 2024-04-26T10:22:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328207+0000", 2024-04-26T10:22:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0275999999999999e-05 2024-04-26T10:22:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328220+0000", 2024-04-26T10:22:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2968e-05 2024-04-26T10:22:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328233+0000", 2024-04-26T10:22:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2203e-05 2024-04-26T10:22:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.333946+0000", 2024-04-26T10:22:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057135110000000001 2024-04-26T10:22:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.335894+0000", 2024-04-26T10:22:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019474959999999999 2024-04-26T10:22:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.336030+0000", 2024-04-26T10:22:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013601999999999999 2024-04-26T10:22:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.340794+0000", 2024-04-26T10:22:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047643800000000004 2024-04-26T10:22:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347659+0000", 2024-04-26T10:22:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068648800000000003 2024-04-26T10:22:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347713+0000", 2024-04-26T10:22:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3736000000000002e-05 2024-04-26T10:22:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347756+0000", 2024-04-26T10:22:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3155000000000003e-05 2024-04-26T10:22:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:49261 5.5 5:a449de5e:::benchmark_data_smithi052_19421_object49260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:22:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:22:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.320527392000001, 2024-04-26T10:22:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020598741, 2024-04-26T10:22:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:04.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49261 2024-04-26T10:22:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:22:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:22:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392171+0000", 2024-04-26T10:22:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392212+0000", 2024-04-26T10:22:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0889000000000001e-05 2024-04-26T10:22:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392221+0000", 2024-04-26T10:22:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1970000000000002e-06 2024-04-26T10:22:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392228+0000", 2024-04-26T10:22:04.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.397869+0000", 2024-04-26T10:22:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056403180000000001 2024-04-26T10:22:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.398010+0000", 2024-04-26T10:22:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014105300000000001 2024-04-26T10:22:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412532+0000", 2024-04-26T10:22:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014522431000000001 2024-04-26T10:22:04.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412692+0000", 2024-04-26T10:22:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015970700000000001 2024-04-26T10:22:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412771+0000", 2024-04-26T10:22:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8980000000000006e-05 2024-04-26T10:22:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.784 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.1833531480000001, 2024-04-26T10:22:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:04.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.1788179359999997, 2024-04-26T10:22:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.790 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:04.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.1781866440000002, 2024-04-26T10:22:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:04.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:04.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:04.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65604 5.9 5:9c239c32:::benchmark_data_smithi052_19421_object65603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.9430837599999999, 2024-04-26T10:22:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025897677000000001, 2024-04-26T10:22:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:04.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65604 2024-04-26T10:22:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769615+0000", 2024-04-26T10:22:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769694+0000", 2024-04-26T10:22:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9087999999999999e-05 2024-04-26T10:22:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769702+0000", 2024-04-26T10:22:04.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8150000000000006e-06 2024-04-26T10:22:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769709+0000", 2024-04-26T10:22:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:22:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772336+0000", 2024-04-26T10:22:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002626836 2024-04-26T10:22:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772470+0000", 2024-04-26T10:22:04.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013453299999999999 2024-04-26T10:22:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772605+0000", 2024-04-26T10:22:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013428499999999999 2024-04-26T10:22:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779374+0000", 2024-04-26T10:22:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067694000000000001 2024-04-26T10:22:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795401+0000", 2024-04-26T10:22:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016026543000000001 2024-04-26T10:22:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795461+0000", 2024-04-26T10:22:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9923999999999998e-05 2024-04-26T10:22:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795513+0000", 2024-04-26T10:22:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2737e-05 2024-04-26T10:22:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65613 5.1 5:85cc6530:::benchmark_data_smithi052_19421_object65612:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.9407107139999997, 2024-04-26T10:22:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023662843999999999, 2024-04-26T10:22:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65613 2024-04-26T10:22:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:04.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771988+0000", 2024-04-26T10:22:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772053+0000", 2024-04-26T10:22:04.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5067000000000006e-05 2024-04-26T10:22:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772065+0000", 2024-04-26T10:22:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2252999999999999e-05 2024-04-26T10:22:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772072+0000", 2024-04-26T10:22:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1400000000000002e-06 2024-04-26T10:22:04.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779354+0000", 2024-04-26T10:22:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072818120000000004 2024-04-26T10:22:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779455+0000", 2024-04-26T10:22:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101109 2024-04-26T10:22:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795526+0000", 2024-04-26T10:22:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016071203999999999 2024-04-26T10:22:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795572+0000", 2024-04-26T10:22:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5865999999999998e-05 2024-04-26T10:22:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795651+0000", 2024-04-26T10:22:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9192999999999999e-05 2024-04-26T10:22:04.816 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65614 5.9 5:993a4fbe:::benchmark_data_smithi052_19421_object65613:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.9406185229999999, 2024-04-26T10:22:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023664145000000001, 2024-04-26T10:22:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65614 2024-04-26T10:22:04.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772080+0000", 2024-04-26T10:22:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772117+0000", 2024-04-26T10:22:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6418000000000003e-05 2024-04-26T10:22:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772124+0000", 2024-04-26T10:22:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4730000000000003e-06 2024-04-26T10:22:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772132+0000", 2024-04-26T10:22:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3900000000000004e-06 2024-04-26T10:22:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781379+0000", 2024-04-26T10:22:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092471059999999997 2024-04-26T10:22:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781495+0000", 2024-04-26T10:22:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001159 2024-04-26T10:22:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:04.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781581+0000", 2024-04-26T10:22:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6087000000000004e-05 2024-04-26T10:22:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.785948+0000", 2024-04-26T10:22:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043671669999999999 2024-04-26T10:22:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795661+0000", 2024-04-26T10:22:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097130310000000004 2024-04-26T10:22:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795710+0000", 2024-04-26T10:22:04.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8959000000000003e-05 2024-04-26T10:22:04.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795745+0000", 2024-04-26T10:22:04.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5172000000000001e-05 2024-04-26T10:22:04.822 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.822 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.822 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.822 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65619 5.1 5:89edbbcc:::benchmark_data_smithi052_19421_object65618:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:04.822 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.775377+0000", 2024-04-26T10:22:04.822 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.9373226250000002, 2024-04-26T10:22:04.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020492052, 2024-04-26T10:22:04.822 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.823 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.823 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.823 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:04.823 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:04.823 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65619 2024-04-26T10:22:04.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.823 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775377+0000", 2024-04-26T10:22:04.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775377+0000", 2024-04-26T10:22:04.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775376+0000", 2024-04-26T10:22:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775450+0000", 2024-04-26T10:22:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3485000000000005e-05 2024-04-26T10:22:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775459+0000", 2024-04-26T10:22:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1030000000000008e-06 2024-04-26T10:22:04.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775463+0000", 2024-04-26T10:22:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0060000000000003e-06 2024-04-26T10:22:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.783840+0000", 2024-04-26T10:22:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083774339999999996 2024-04-26T10:22:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.783963+0000", 2024-04-26T10:22:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012291900000000001 2024-04-26T10:22:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795755+0000", 2024-04-26T10:22:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011791793 2024-04-26T10:22:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795798+0000", 2024-04-26T10:22:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3597999999999998e-05 2024-04-26T10:22:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795869+0000", 2024-04-26T10:22:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0413000000000005e-05 2024-04-26T10:22:04.826 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:68218 5.9 5:9d226c09:::benchmark_data_smithi052_19421_object68217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:22:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:01.979822+0000", 2024-04-26T10:22:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.732876869, 2024-04-26T10:22:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021403591, 2024-04-26T10:22:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 68218 2024-04-26T10:22:04.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979822+0000", 2024-04-26T10:22:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979822+0000", 2024-04-26T10:22:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:04.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979822+0000", 2024-04-26T10:22:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979889+0000", 2024-04-26T10:22:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7892000000000007e-05 2024-04-26T10:22:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979902+0000", 2024-04-26T10:22:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2668e-05 2024-04-26T10:22:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979912+0000", 2024-04-26T10:22:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5599999999999999e-06 2024-04-26T10:22:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979959+0000", 2024-04-26T10:22:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6980000000000001e-05 2024-04-26T10:22:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.980117+0000", 2024-04-26T10:22:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015815499999999999 2024-04-26T10:22:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.980279+0000", 2024-04-26T10:22:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161903 2024-04-26T10:22:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.984675+0000", 2024-04-26T10:22:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043966159999999999 2024-04-26T10:22:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:02.001127+0000", 2024-04-26T10:22:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016452106000000001 2024-04-26T10:22:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:04.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:02.001177+0000", 2024-04-26T10:22:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9882000000000001e-05 2024-04-26T10:22:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:02.001226+0000", 2024-04-26T10:22:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8748000000000002e-05 2024-04-26T10:22:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:04.832 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:04.832 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:04.834 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:04.834 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:04.829+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:04.934 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:04.933+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:04.962 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:04.962 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:04.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.963 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:71265 5.a 5:5beff8a8:::benchmark_data_smithi052_19421_object71264:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:04.963 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.950749+0000", 2024-04-26T10:22:04.963 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.010577342, 2024-04-26T10:22:04.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010606752000000001, 2024-04-26T10:22:04.963 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:04.963 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:04.963 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:04.963 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:04.963 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:04.963 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 71265 2024-04-26T10:22:04.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.963 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:04.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:04.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.950749+0000", 2024-04-26T10:22:04.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:04.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:04.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.950749+0000", 2024-04-26T10:22:04.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:04.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:04.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.950749+0000", 2024-04-26T10:22:04.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:04.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:04.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.950805+0000", 2024-04-26T10:22:04.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6622000000000001e-05 2024-04-26T10:22:04.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:04.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.950815+0000", 2024-04-26T10:22:04.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5480000000000007e-06 2024-04-26T10:22:04.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.950825+0000", 2024-04-26T10:22:04.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0645999999999999e-05 2024-04-26T10:22:04.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:04.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.952982+0000", 2024-04-26T10:22:04.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021564969999999998 2024-04-26T10:22:04.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:04.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.953136+0000", 2024-04-26T10:22:04.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000154079 2024-04-26T10:22:04.966 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:04.966 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:04.967 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:04.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.967 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:71266 5.0 5:04471379:::benchmark_data_smithi052_19421_object71265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:04.967 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.950847+0000", 2024-04-26T10:22:04.967 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.010480207, 2024-04-26T10:22:04.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010588767000000001, 2024-04-26T10:22:04.967 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:04.967 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:04.967 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:04.967 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:04.967 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:04.967 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 71266 2024-04-26T10:22:04.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.968 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:04.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:04.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.950847+0000", 2024-04-26T10:22:04.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:04.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:04.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.950847+0000", 2024-04-26T10:22:04.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:04.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:04.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.950846+0000", 2024-04-26T10:22:04.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:04.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:04.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.950882+0000", 2024-04-26T10:22:04.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5751999999999999e-05 2024-04-26T10:22:04.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:04.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.950891+0000", 2024-04-26T10:22:04.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0499999999999997e-06 2024-04-26T10:22:04.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.950897+0000", 2024-04-26T10:22:04.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9529999999999996e-06 2024-04-26T10:22:04.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:04.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.953352+0000", 2024-04-26T10:22:04.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024556579999999999 2024-04-26T10:22:04.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:04.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.953486+0000", 2024-04-26T10:22:04.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013396400000000001 2024-04-26T10:22:04.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:04.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.953642+0000", 2024-04-26T10:22:04.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015564100000000001 2024-04-26T10:22:04.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:04.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.959204+0000", 2024-04-26T10:22:04.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055621159999999998 2024-04-26T10:22:04.971 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:04.971 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:04.971 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:04.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.972 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:71271 5.4 5:2724aab8:::benchmark_data_smithi052_19421_object71270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:04.972 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.952692+0000", 2024-04-26T10:22:04.972 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0086347760000000003, 2024-04-26T10:22:04.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0088254500000000003, 2024-04-26T10:22:04.972 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:04.972 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:04.972 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:04.972 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:04.972 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:04.972 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 71271 2024-04-26T10:22:04.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.973 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:04.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:04.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.952692+0000", 2024-04-26T10:22:04.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:04.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:04.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.952692+0000", 2024-04-26T10:22:04.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:04.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:04.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.952691+0000", 2024-04-26T10:22:04.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:04.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:04.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.952763+0000", 2024-04-26T10:22:04.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1805999999999997e-05 2024-04-26T10:22:04.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:04.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.952788+0000", 2024-04-26T10:22:04.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5031000000000001e-05 2024-04-26T10:22:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.952798+0000", 2024-04-26T10:22:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5540000000000003e-06 2024-04-26T10:22:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.954433+0000", 2024-04-26T10:22:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001635713 2024-04-26T10:22:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:04.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.954614+0000", 2024-04-26T10:22:04.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018066499999999999 2024-04-26T10:22:04.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:04.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.954772+0000", 2024-04-26T10:22:04.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015758100000000001 2024-04-26T10:22:04.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:04.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.959173+0000", 2024-04-26T10:22:04.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004401004 2024-04-26T10:22:04.976 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:04.976 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:04.976 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:04.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.977 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:71272 5.a 5:5054148e:::benchmark_data_smithi052_19421_object71271:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:04.977 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.952916+0000", 2024-04-26T10:22:04.977 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0084109749999999994, 2024-04-26T10:22:04.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086828170000000007, 2024-04-26T10:22:04.977 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:04.977 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:04.977 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:04.977 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:04.977 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:04.977 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 71272 2024-04-26T10:22:04.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.978 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:04.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:04.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.952916+0000", 2024-04-26T10:22:04.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:04.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:04.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.952916+0000", 2024-04-26T10:22:04.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:04.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.952915+0000", 2024-04-26T10:22:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.953037+0000", 2024-04-26T10:22:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000121759 2024-04-26T10:22:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.953046+0000", 2024-04-26T10:22:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6630000000000005e-06 2024-04-26T10:22:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.953054+0000", 2024-04-26T10:22:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3220000000000004e-06 2024-04-26T10:22:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.956903+0000", 2024-04-26T10:22:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038493920000000001 2024-04-26T10:22:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.957047+0000", 2024-04-26T10:22:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014333400000000001 2024-04-26T10:22:04.980 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:71273 5.d e38/37 5:babf7c4e:::benchmark_data_smithi052_19421_object71272:head v 38'4497, mlcod=38'4495)", 2024-04-26T10:22:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.953588+0000", 2024-04-26T10:22:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0077392349999999997, 2024-04-26T10:22:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0080762569999999999, 2024-04-26T10:22:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.953588+0000", 2024-04-26T10:22:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.953588+0000", 2024-04-26T10:22:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.953587+0000", 2024-04-26T10:22:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:04.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.953631+0000", 2024-04-26T10:22:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4076999999999998e-05 2024-04-26T10:22:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.953639+0000", 2024-04-26T10:22:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.909e-06 2024-04-26T10:22:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.953645+0000", 2024-04-26T10:22:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.711e-06 2024-04-26T10:22:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.953703+0000", 2024-04-26T10:22:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7822999999999998e-05 2024-04-26T10:22:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.953726+0000", 2024-04-26T10:22:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3371e-05 2024-04-26T10:22:04.984 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:71275 5.8 5:1835a5be:::benchmark_data_smithi052_19421_object71274:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.955004+0000", 2024-04-26T10:22:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0063231670000000002, 2024-04-26T10:22:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0067219100000000002, 2024-04-26T10:22:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:04.985 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 71275 2024-04-26T10:22:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.955004+0000", 2024-04-26T10:22:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.955004+0000", 2024-04-26T10:22:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.955002+0000", 2024-04-26T10:22:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.955039+0000", 2024-04-26T10:22:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6801000000000002e-05 2024-04-26T10:22:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.955051+0000", 2024-04-26T10:22:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1965e-05 2024-04-26T10:22:04.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.955059+0000", 2024-04-26T10:22:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9149999999999996e-06 2024-04-26T10:22:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.955145+0000", 2024-04-26T10:22:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6206999999999996e-05 2024-04-26T10:22:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.955259+0000", 2024-04-26T10:22:04.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000113399 2024-04-26T10:22:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:71274 5.9 e38/37 5:9122c2c9:::benchmark_data_smithi052_19421_object71273:head v 38'4441, mlcod=38'4437)", 2024-04-26T10:22:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.955683+0000", 2024-04-26T10:22:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0056441319999999996, 2024-04-26T10:22:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061060910000000001, 2024-04-26T10:22:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:04.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.955683+0000", 2024-04-26T10:22:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.955683+0000", 2024-04-26T10:22:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.955682+0000", 2024-04-26T10:22:04.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:04.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:04.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.955708+0000", 2024-04-26T10:22:04.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6105000000000002e-05 2024-04-26T10:22:04.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:04.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.955718+0000", 2024-04-26T10:22:04.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8789999999999998e-06 2024-04-26T10:22:04.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.955726+0000", 2024-04-26T10:22:04.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6199999999999999e-06 2024-04-26T10:22:04.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:04.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.955768+0000", 2024-04-26T10:22:04.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2425000000000001e-05 2024-04-26T10:22:04.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:04.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.955796+0000", 2024-04-26T10:22:04.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7957999999999999e-05 2024-04-26T10:22:04.992 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:04.992 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:04.993 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:04.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.993 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:71278 5.b 5:df09e21c:::benchmark_data_smithi052_19421_object71277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:04.993 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.956623+0000", 2024-04-26T10:22:04.993 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0047041330000000001, 2024-04-26T10:22:04.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052310059999999999, 2024-04-26T10:22:04.993 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:04.993 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:04.993 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:04.993 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:04.993 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:04.993 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 71278 2024-04-26T10:22:04.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.994 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:04.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:04.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.956623+0000", 2024-04-26T10:22:04.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:04.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:04.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.956623+0000", 2024-04-26T10:22:04.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:04.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:04.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.956622+0000", 2024-04-26T10:22:04.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:04.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:04.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.956665+0000", 2024-04-26T10:22:04.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3622999999999999e-05 2024-04-26T10:22:04.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:04.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.956677+0000", 2024-04-26T10:22:04.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1280999999999999e-05 2024-04-26T10:22:04.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:04.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.956685+0000", 2024-04-26T10:22:04.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0399999999999993e-06 2024-04-26T10:22:04.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:04.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.956897+0000", 2024-04-26T10:22:04.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021208199999999999 2024-04-26T10:22:04.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:04.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.956983+0000", 2024-04-26T10:22:04.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6706999999999995e-05 2024-04-26T10:22:04.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:04.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.957080+0000", 2024-04-26T10:22:04.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6181000000000006e-05 2024-04-26T10:22:04.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:04.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.959748+0000", 2024-04-26T10:22:04.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002668119 2024-04-26T10:22:04.997 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:04.997 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:04.997 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:04.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.998 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:71277 5.f e38/37 5:fd8c9f73:::benchmark_data_smithi052_19421_object71276:head v 38'4500, mlcod=38'4497)", 2024-04-26T10:22:04.998 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.957185+0000", 2024-04-26T10:22:04.998 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.004142176, 2024-04-26T10:22:04.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004744201, 2024-04-26T10:22:04.998 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:04.998 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:04.998 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:04.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:04.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.957185+0000", 2024-04-26T10:22:04.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:04.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:04.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.957185+0000", 2024-04-26T10:22:04.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:04.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:04.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.957184+0000", 2024-04-26T10:22:04.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:04.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:04.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:04.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:04.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.957232+0000", 2024-04-26T10:22:04.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.863e-05 2024-04-26T10:22:04.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.957244+0000", 2024-04-26T10:22:05.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1748e-05 2024-04-26T10:22:05.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.957251+0000", 2024-04-26T10:22:05.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.827e-06 2024-04-26T10:22:05.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.957297+0000", 2024-04-26T10:22:05.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5710000000000001e-05 2024-04-26T10:22:05.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.957318+0000", 2024-04-26T10:22:05.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1209999999999999e-05 2024-04-26T10:22:05.001 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.001 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.001 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.001 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:71281 5.d e38/37 5:bc3a609a:::benchmark_data_smithi052_19421_object71280:head v 38'4498, mlcod=38'4495)", 2024-04-26T10:22:05.001 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.958097+0000", 2024-04-26T10:22:05.002 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0032297039999999999, 2024-04-26T10:22:05.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038890410000000002, 2024-04-26T10:22:05.002 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.002 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:05.002 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.958097+0000", 2024-04-26T10:22:05.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.958097+0000", 2024-04-26T10:22:05.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.958097+0000", 2024-04-26T10:22:05.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.958153+0000", 2024-04-26T10:22:05.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6081000000000001e-05 2024-04-26T10:22:05.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.958164+0000", 2024-04-26T10:22:05.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1797000000000001e-05 2024-04-26T10:22:05.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.958170+0000", 2024-04-26T10:22:05.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6010000000000002e-06 2024-04-26T10:22:05.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.958210+0000", 2024-04-26T10:22:05.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0040999999999998e-05 2024-04-26T10:22:05.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.005 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.958227+0000", 2024-04-26T10:22:05.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7053000000000001e-05 2024-04-26T10:22:05.005 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.005 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.005 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.005 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:71283 5.8 5:191ab0e7:::benchmark_data_smithi052_19421_object71282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:05.005 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.959428+0000", 2024-04-26T10:22:05.005 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0018992779999999999, 2024-04-26T10:22:05.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00262013, 2024-04-26T10:22:05.005 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.005 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:05.006 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:05.006 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:05.006 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.006 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 71283 2024-04-26T10:22:05.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.006 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.959428+0000", 2024-04-26T10:22:05.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.959428+0000", 2024-04-26T10:22:05.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.959426+0000", 2024-04-26T10:22:05.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:05.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.959477+0000", 2024-04-26T10:22:05.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0481e-05 2024-04-26T10:22:05.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.959491+0000", 2024-04-26T10:22:05.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.469e-05 2024-04-26T10:22:05.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.959499+0000", 2024-04-26T10:22:05.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5939999999999996e-06 2024-04-26T10:22:05.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.959740+0000", 2024-04-26T10:22:05.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000240931 2024-04-26T10:22:05.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.959868+0000", 2024-04-26T10:22:05.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012825799999999999 2024-04-26T10:22:05.009 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.009 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.009 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.009 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:71285 5.9 e38/37 5:99a7fb1d:::benchmark_data_smithi052_19421_object71284:head v 38'4442, mlcod=38'4439)", 2024-04-26T10:22:05.010 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.960462+0000", 2024-04-26T10:22:05.010 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00086512399999999999, 2024-04-26T10:22:05.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001653624, 2024-04-26T10:22:05.010 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.010 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:05.010 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.960462+0000", 2024-04-26T10:22:05.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.010 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.960462+0000", 2024-04-26T10:22:05.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.960461+0000", 2024-04-26T10:22:05.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.960520+0000", 2024-04-26T10:22:05.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8641999999999999e-05 2024-04-26T10:22:05.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.960531+0000", 2024-04-26T10:22:05.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0879999999999999e-05 2024-04-26T10:22:05.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.960539+0000", 2024-04-26T10:22:05.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8850000000000005e-06 2024-04-26T10:22:05.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.960603+0000", 2024-04-26T10:22:05.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3603999999999996e-05 2024-04-26T10:22:05.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.960630+0000", 2024-04-26T10:22:05.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6664000000000001e-05 2024-04-26T10:22:05.013 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.013 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.013 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.013 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:71286 5.d e38/37 5:bf550c39:::benchmark_data_smithi052_19421_object71285:head v 38'4499, mlcod=38'4495)", 2024-04-26T10:22:05.013 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.960575+0000", 2024-04-26T10:22:05.013 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00075161499999999997, 2024-04-26T10:22:05.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016019859999999999, 2024-04-26T10:22:05.014 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.014 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:05.014 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.960575+0000", 2024-04-26T10:22:05.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.960575+0000", 2024-04-26T10:22:05.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.960575+0000", 2024-04-26T10:22:05.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.960662+0000", 2024-04-26T10:22:05.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7188999999999995e-05 2024-04-26T10:22:05.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.960676+0000", 2024-04-26T10:22:05.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3801999999999999e-05 2024-04-26T10:22:05.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.960684+0000", 2024-04-26T10:22:05.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7809999999999994e-06 2024-04-26T10:22:05.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.016 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.016 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.960731+0000", 2024-04-26T10:22:05.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6626999999999999e-05 2024-04-26T10:22:05.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.960756+0000", 2024-04-26T10:22:05.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4383999999999999e-05 2024-04-26T10:22:05.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.017 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.017 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.017 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:05.017 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 13 2024-04-26T10:22:05.017 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:05.018 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:05.035 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:05.032+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:05.136 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:05.133+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:05.150 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:05.150 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:05.150 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:05.150 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:05.150 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:05.164 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:05.237 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:05.232+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:05.299 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:05.299 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:05.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:05.299 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:05.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.299 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64610 5.a 5:57daa913:::benchmark_data_smithi052_19421_object64609:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.299 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.211728+0000", 2024-04-26T10:22:05.299 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.0848150969999999, 2024-04-26T10:22:05.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020479739, 2024-04-26T10:22:05.300 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.300 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.300 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:05.300 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:05.300 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.300 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64610 2024-04-26T10:22:05.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.300 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211728+0000", 2024-04-26T10:22:05.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211728+0000", 2024-04-26T10:22:05.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211727+0000", 2024-04-26T10:22:05.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211790+0000", 2024-04-26T10:22:05.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3325999999999996e-05 2024-04-26T10:22:05.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211799+0000", 2024-04-26T10:22:05.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2790000000000004e-06 2024-04-26T10:22:05.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211808+0000", 2024-04-26T10:22:05.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0909999999999999e-06 2024-04-26T10:22:05.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.218692+0000", 2024-04-26T10:22:05.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0068833729999999999 2024-04-26T10:22:05.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.218790+0000", 2024-04-26T10:22:05.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8395999999999998e-05 2024-04-26T10:22:05.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:05.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.232078+0000", 2024-04-26T10:22:05.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01328821 2024-04-26T10:22:05.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.232130+0000", 2024-04-26T10:22:05.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1715999999999997e-05 2024-04-26T10:22:05.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.232207+0000", 2024-04-26T10:22:05.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7379999999999994e-05 2024-04-26T10:22:05.304 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.304 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.304 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.304 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64909 5.8 5:1814e925:::benchmark_data_smithi052_19421_object64908:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.304 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.352095+0000", 2024-04-26T10:22:05.304 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.9444482079999998, 2024-04-26T10:22:05.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019235625999999999, 2024-04-26T10:22:05.305 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.305 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.305 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:05.305 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:05.305 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.305 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64909 2024-04-26T10:22:05.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.305 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352095+0000", 2024-04-26T10:22:05.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352095+0000", 2024-04-26T10:22:05.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352094+0000", 2024-04-26T10:22:05.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352193+0000", 2024-04-26T10:22:05.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8881000000000004e-05 2024-04-26T10:22:05.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352202+0000", 2024-04-26T10:22:05.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.098e-06 2024-04-26T10:22:05.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.352206+0000", 2024-04-26T10:22:05.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2889999999999999e-06 2024-04-26T10:22:05.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.358151+0000", 2024-04-26T10:22:05.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059452460000000004 2024-04-26T10:22:05.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.358266+0000", 2024-04-26T10:22:05.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114237 2024-04-26T10:22:05.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:05.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.371147+0000", 2024-04-26T10:22:05.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012881528999999999 2024-04-26T10:22:05.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.371224+0000", 2024-04-26T10:22:05.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7068000000000001e-05 2024-04-26T10:22:05.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.371330+0000", 2024-04-26T10:22:05.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010598399999999999 2024-04-26T10:22:05.309 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.309 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.309 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.309 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.309 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:05.310 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.7659018719999997, 2024-04-26T10:22:05.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:05.310 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.310 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:05.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:05.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.310 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:05.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.310 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:05.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:05.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:05.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:05.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:05.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:05.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:05.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:05.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:05.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:05.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:05.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:05.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:05.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:05.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:05.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:05.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:05.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:05.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:05.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:05.314 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.314 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.314 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.315 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.315 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:05.315 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.7639196449999996, 2024-04-26T10:22:05.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:05.315 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.315 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.315 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:05.315 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:05.315 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.315 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:05.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.315 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:05.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:05.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:05.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:05.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:05.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:05.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:05.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:05.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:05.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:05.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:05.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:05.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:05.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:05.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:05.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:05.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:05.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:05.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:05.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:05.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:05.319 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.320 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.320 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.320 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.320 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:05.320 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.7637202609999996, 2024-04-26T10:22:05.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:05.320 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.320 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.320 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:05.320 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:05.320 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.320 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:05.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.321 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:05.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:05.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:05.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:05.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:05.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:05.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:05.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:05.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:05.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:05.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:05.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:05.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:05.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:05.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:05.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:05.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:05.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:05.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:05.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:05.325 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.325 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.325 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.325 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:05.325 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:05.325 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.7635016409999995, 2024-04-26T10:22:05.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:05.325 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.325 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.325 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:05.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:05.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:05.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:05.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:05.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:05.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:05.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:05.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:05.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:05.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:05.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:05.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:05.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:05.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:05.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:05.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:05.329 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.329 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.329 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.329 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.329 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:05.329 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.7611302030000004, 2024-04-26T10:22:05.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:05.329 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.330 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:05.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:05.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.330 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:05.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.330 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:05.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:05.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:05.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:05.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:05.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:05.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:05.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:05.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:05.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:05.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:05.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:05.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:05.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:05.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:05.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:05.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:05.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:05.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:05.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:05.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:05.334 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.334 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.334 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.334 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.334 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:05.334 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.7610295809999998, 2024-04-26T10:22:05.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:05.334 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.334 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.334 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:05.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:05.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.335 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:05.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.335 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:05.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:05.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:05.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:05.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:05.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:05.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:05.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:05.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:05.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:05.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:05.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:05.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:05.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:05.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:05.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:05.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:05.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:05.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:05.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:05.339 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.339 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.339 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.339 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:05.339 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:05.339 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.76091102, 2024-04-26T10:22:05.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:05.339 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.339 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.339 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:05.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:05.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:05.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:05.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:05.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:05.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:05.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:05.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:05.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:05.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:05.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:05.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:05.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:05.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:05.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:05.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:05.343 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.343 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.343 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.343 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.343 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:05.343 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.7608086219999999, 2024-04-26T10:22:05.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:05.343 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.344 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:05.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:05.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.344 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:05.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.344 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:05.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:05.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:05.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:05.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:05.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:05.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:05.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:05.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:05.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:05.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:05.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:05.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:05.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:05.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:05.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:05.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:05.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:05.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:05.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:05.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:05.348 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.348 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.348 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.348 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65294 5.e 5:7438ad6f:::benchmark_data_smithi052_19421_object65293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.348 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:05.348 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.760128505, 2024-04-26T10:22:05.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091965517999999996, 2024-04-26T10:22:05.349 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.349 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.349 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:05.349 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:05.349 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.349 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65294 2024-04-26T10:22:05.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.349 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:05.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:05.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536413+0000", 2024-04-26T10:22:05.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536470+0000", 2024-04-26T10:22:05.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6443999999999997e-05 2024-04-26T10:22:05.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536480+0000", 2024-04-26T10:22:05.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0652999999999999e-05 2024-04-26T10:22:05.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536488+0000", 2024-04-26T10:22:05.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7929999999999998e-06 2024-04-26T10:22:05.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536548+0000", 2024-04-26T10:22:05.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9556999999999999e-05 2024-04-26T10:22:05.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536728+0000", 2024-04-26T10:22:05.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000180958 2024-04-26T10:22:05.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:05.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628168+0000", 2024-04-26T10:22:05.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091439276999999999 2024-04-26T10:22:05.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628258+0000", 2024-04-26T10:22:05.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0158e-05 2024-04-26T10:22:05.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628380+0000", 2024-04-26T10:22:05.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012180699999999999 2024-04-26T10:22:05.353 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.353 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.353 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.354 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.354 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:05.354 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.7597880650000004, 2024-04-26T10:22:05.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:05.354 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.354 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.354 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:05.354 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:05.354 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.354 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:05.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.355 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:05.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:05.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:05.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:05.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:05.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:05.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:05.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:05.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:05.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:05.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:05.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:05.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:05.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:05.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:05.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:05.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:05.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:05.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:05.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:05.358 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.358 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.359 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.359 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.359 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:05.359 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.7586377899999999, 2024-04-26T10:22:05.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:05.359 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.359 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.359 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:05.359 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:05.359 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.359 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:05.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.360 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:05.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:05.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:05.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:05.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:05.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:05.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:05.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:05.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:05.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:05.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:05.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:05.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:05.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:05.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:05.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:05.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:05.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:05.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:05.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:05.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:05.364 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.364 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.364 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.364 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65292 5.f e34/22 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head v 34'4129, mlcod=34'4125)", 2024-04-26T10:22:05.364 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:05.364 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.7584635339999997, 2024-04-26T10:22:05.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093470155999999999, 2024-04-26T10:22:05.364 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.364 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.364 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:05.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:05.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538078+0000", 2024-04-26T10:22:05.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538140+0000", 2024-04-26T10:22:05.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1970000000000005e-05 2024-04-26T10:22:05.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538149+0000", 2024-04-26T10:22:05.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2189999999999993e-06 2024-04-26T10:22:05.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538158+0000", 2024-04-26T10:22:05.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0930000000000003e-06 2024-04-26T10:22:05.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627053+0000", 2024-04-26T10:22:05.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088895221999999996 2024-04-26T10:22:05.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627092+0000", 2024-04-26T10:22:05.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9657000000000003e-05 2024-04-26T10:22:05.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631499+0000", 2024-04-26T10:22:05.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044066560000000001 2024-04-26T10:22:05.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631549+0000", 2024-04-26T10:22:05.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0259000000000001e-05 2024-04-26T10:22:05.368 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.368 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.368 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.368 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65298 5.b 5:d51c4e52:::benchmark_data_smithi052_19421_object65297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.368 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:05.368 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.7576970769999996, 2024-04-26T10:22:05.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091641671999999993, 2024-04-26T10:22:05.368 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.368 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.369 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:05.369 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:05.369 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.369 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65298 2024-04-26T10:22:05.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.369 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:05.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:05.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538844+0000", 2024-04-26T10:22:05.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:05.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538919+0000", 2024-04-26T10:22:05.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4626e-05 2024-04-26T10:22:05.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626007+0000", 2024-04-26T10:22:05.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087087516000000004 2024-04-26T10:22:05.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626074+0000", 2024-04-26T10:22:05.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7077999999999997e-05 2024-04-26T10:22:05.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626150+0000", 2024-04-26T10:22:05.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5982999999999994e-05 2024-04-26T10:22:05.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626341+0000", 2024-04-26T10:22:05.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019141199999999999 2024-04-26T10:22:05.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:05.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630359+0000", 2024-04-26T10:22:05.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040175710000000002 2024-04-26T10:22:05.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630412+0000", 2024-04-26T10:22:05.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3779000000000001e-05 2024-04-26T10:22:05.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630487+0000", 2024-04-26T10:22:05.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4913999999999995e-05 2024-04-26T10:22:05.373 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.373 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.373 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.373 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:67959 5.b 5:dfe45e5d:::benchmark_data_smithi052_19421_object67958:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:22:05.373 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:01.848647+0000", 2024-04-26T10:22:05.373 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.447895661, 2024-04-26T10:22:05.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018705395999999999, 2024-04-26T10:22:05.373 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.373 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.374 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:05.374 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:05.374 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.374 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 67959 2024-04-26T10:22:05.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.374 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.848647+0000", 2024-04-26T10:22:05.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.848647+0000", 2024-04-26T10:22:05.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.848646+0000", 2024-04-26T10:22:05.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.848726+0000", 2024-04-26T10:22:05.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0140000000000002e-05 2024-04-26T10:22:05.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.848737+0000", 2024-04-26T10:22:05.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0508e-05 2024-04-26T10:22:05.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.848743+0000", 2024-04-26T10:22:05.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.733e-06 2024-04-26T10:22:05.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.853009+0000", 2024-04-26T10:22:05.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042665050000000003 2024-04-26T10:22:05.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.853174+0000", 2024-04-26T10:22:05.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016453799999999999 2024-04-26T10:22:05.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:05.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.867282+0000", 2024-04-26T10:22:05.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014107957000000001 2024-04-26T10:22:05.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.867314+0000", 2024-04-26T10:22:05.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2135000000000003e-05 2024-04-26T10:22:05.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:01.867352+0000", 2024-04-26T10:22:05.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8652999999999997e-05 2024-04-26T10:22:05.378 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.378 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.378 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.379 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:70510 5.0 5:0062bf1e:::benchmark_data_smithi052_19421_object70509:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:05.379 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.597783+0000", 2024-04-26T10:22:05.379 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.69875976699999998, 2024-04-26T10:22:05.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.018827005000000001, 2024-04-26T10:22:05.379 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.379 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.379 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:05.379 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:05.379 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.379 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 70510 2024-04-26T10:22:05.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.379 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.597783+0000", 2024-04-26T10:22:05.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.597783+0000", 2024-04-26T10:22:05.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.597782+0000", 2024-04-26T10:22:05.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:05.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.597855+0000", 2024-04-26T10:22:05.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3297e-05 2024-04-26T10:22:05.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.597865+0000", 2024-04-26T10:22:05.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0000000000000001e-05 2024-04-26T10:22:05.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.597874+0000", 2024-04-26T10:22:05.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.251e-06 2024-04-26T10:22:05.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.606624+0000", 2024-04-26T10:22:05.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087491889999999992 2024-04-26T10:22:05.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.606820+0000", 2024-04-26T10:22:05.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196379 2024-04-26T10:22:05.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:05.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.606985+0000", 2024-04-26T10:22:05.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016548499999999999 2024-04-26T10:22:05.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.614790+0000", 2024-04-26T10:22:05.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0078048689999999999 2024-04-26T10:22:05.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:05.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616363+0000", 2024-04-26T10:22:05.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015731600000000001 2024-04-26T10:22:05.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616454+0000", 2024-04-26T10:22:05.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0576999999999997e-05 2024-04-26T10:22:05.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616610+0000", 2024-04-26T10:22:05.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000155993 2024-04-26T10:22:05.384 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.384 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.384 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.385 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:70533 5.0 5:01246de6:::benchmark_data_smithi052_19421_object70532:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:05.385 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.612488+0000", 2024-04-26T10:22:05.385 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.68405522200000002, 2024-04-26T10:22:05.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020317557, 2024-04-26T10:22:05.385 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.385 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.385 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:05.385 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:05.385 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.385 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 70533 2024-04-26T10:22:05.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.385 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.612488+0000", 2024-04-26T10:22:05.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.612488+0000", 2024-04-26T10:22:05.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.612486+0000", 2024-04-26T10:22:05.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.612542+0000", 2024-04-26T10:22:05.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5414000000000002e-05 2024-04-26T10:22:05.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.612555+0000", 2024-04-26T10:22:05.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3174e-05 2024-04-26T10:22:05.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.612562+0000", 2024-04-26T10:22:05.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2350000000000002e-06 2024-04-26T10:22:05.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616664+0000", 2024-04-26T10:22:05.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041013150000000003 2024-04-26T10:22:05.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616879+0000", 2024-04-26T10:22:05.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000214945 2024-04-26T10:22:05.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:05.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.617134+0000", 2024-04-26T10:22:05.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025564400000000002 2024-04-26T10:22:05.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.622299+0000", 2024-04-26T10:22:05.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005165289 2024-04-26T10:22:05.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:05.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.632659+0000", 2024-04-26T10:22:05.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010359515999999999 2024-04-26T10:22:05.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.632714+0000", 2024-04-26T10:22:05.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5136999999999997e-05 2024-04-26T10:22:05.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.632805+0000", 2024-04-26T10:22:05.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0946999999999995e-05 2024-04-26T10:22:05.390 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.390 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.390 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.390 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:70535 5.8 5:1871dc9c:::benchmark_data_smithi052_19421_object70534:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:05.391 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.613036+0000", 2024-04-26T10:22:05.391 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.683506854, 2024-04-26T10:22:05.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021812264000000001, 2024-04-26T10:22:05.391 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.391 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.391 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:05.391 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:05.391 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.391 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 70535 2024-04-26T10:22:05.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.391 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613036+0000", 2024-04-26T10:22:05.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613036+0000", 2024-04-26T10:22:05.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613035+0000", 2024-04-26T10:22:05.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613072+0000", 2024-04-26T10:22:05.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6766e-05 2024-04-26T10:22:05.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613087+0000", 2024-04-26T10:22:05.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5349000000000002e-05 2024-04-26T10:22:05.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613094+0000", 2024-04-26T10:22:05.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8079999999999999e-06 2024-04-26T10:22:05.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.619353+0000", 2024-04-26T10:22:05.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0062593839999999998 2024-04-26T10:22:05.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.619503+0000", 2024-04-26T10:22:05.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000149715 2024-04-26T10:22:05.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:05.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.634715+0000", 2024-04-26T10:22:05.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015211875 2024-04-26T10:22:05.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.634765+0000", 2024-04-26T10:22:05.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0757000000000002e-05 2024-04-26T10:22:05.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.634848+0000", 2024-04-26T10:22:05.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2707000000000006e-05 2024-04-26T10:22:05.395 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.395 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.395 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.396 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:70544 5.0 5:009299e5:::benchmark_data_smithi052_19421_object70543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:05.396 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.616758+0000", 2024-04-26T10:22:05.396 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.679784571, 2024-04-26T10:22:05.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020254284000000001, 2024-04-26T10:22:05.396 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:05.396 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.396 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:05.396 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:05.396 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.396 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 70544 2024-04-26T10:22:05.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.396 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:05.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:05.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616758+0000", 2024-04-26T10:22:05.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:05.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616758+0000", 2024-04-26T10:22:05.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:05.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:05.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616757+0000", 2024-04-26T10:22:05.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:05.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:05.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616825+0000", 2024-04-26T10:22:05.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8444999999999999e-05 2024-04-26T10:22:05.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:05.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616844+0000", 2024-04-26T10:22:05.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9216e-05 2024-04-26T10:22:05.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616853+0000", 2024-04-26T10:22:05.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8689999999999993e-06 2024-04-26T10:22:05.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:05.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.619576+0000", 2024-04-26T10:22:05.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0027225940000000001 2024-04-26T10:22:05.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:05.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.619751+0000", 2024-04-26T10:22:05.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017471899999999999 2024-04-26T10:22:05.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:05.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.619932+0000", 2024-04-26T10:22:05.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000180846 2024-04-26T10:22:05.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.627546+0000", 2024-04-26T10:22:05.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007614025 2024-04-26T10:22:05.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:05.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.636898+0000", 2024-04-26T10:22:05.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093526010000000003 2024-04-26T10:22:05.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:05.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.636946+0000", 2024-04-26T10:22:05.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7509000000000002e-05 2024-04-26T10:22:05.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:05.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:05.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:05.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.637012+0000", 2024-04-26T10:22:05.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6778000000000003e-05 2024-04-26T10:22:05.401 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.401 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.401 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.401 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:05.401 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:05.401 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:05.403 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:05.396+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:05.403 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:05.503 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:05.500+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:05.533 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:72475 5.3 5:c4079411:::benchmark_data_smithi052_19421_object72474:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:05.528439+0000", 2024-04-26T10:22:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0022669949999999999, 2024-04-26T10:22:05.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002291792, 2024-04-26T10:22:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72475 2024-04-26T10:22:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528439+0000", 2024-04-26T10:22:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528439+0000", 2024-04-26T10:22:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528438+0000", 2024-04-26T10:22:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528471+0000", 2024-04-26T10:22:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3164999999999998e-05 2024-04-26T10:22:05.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528479+0000", 2024-04-26T10:22:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7000000000000008e-06 2024-04-26T10:22:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528485+0000", 2024-04-26T10:22:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:22:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528699+0000", 2024-04-26T10:22:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021377000000000001 2024-04-26T10:22:05.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528858+0000", 2024-04-26T10:22:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000159037 2024-04-26T10:22:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:72477 5.9 5:9b9e8674:::benchmark_data_smithi052_19421_object72476:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:05.529072+0000", 2024-04-26T10:22:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0016337719999999999, 2024-04-26T10:22:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017359929999999999, 2024-04-26T10:22:05.537 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72477 2024-04-26T10:22:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529072+0000", 2024-04-26T10:22:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529072+0000", 2024-04-26T10:22:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529071+0000", 2024-04-26T10:22:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529117+0000", 2024-04-26T10:22:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5670000000000002e-05 2024-04-26T10:22:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529126+0000", 2024-04-26T10:22:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8440000000000004e-06 2024-04-26T10:22:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529134+0000", 2024-04-26T10:22:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7430000000000002e-06 2024-04-26T10:22:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529173+0000", 2024-04-26T10:22:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9415000000000001e-05 2024-04-26T10:22:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529335+0000", 2024-04-26T10:22:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016168399999999999 2024-04-26T10:22:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529462+0000", 2024-04-26T10:22:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000127572 2024-04-26T10:22:05.541 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:72478 5.5 5.c2c57e25 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:05.529147+0000", 2024-04-26T10:22:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00155916, 2024-04-26T10:22:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017303150000000001, 2024-04-26T10:22:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.542 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72478 2024-04-26T10:22:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529147+0000", 2024-04-26T10:22:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529147+0000", 2024-04-26T10:22:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529146+0000", 2024-04-26T10:22:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529190+0000", 2024-04-26T10:22:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3547000000000002e-05 2024-04-26T10:22:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529197+0000", 2024-04-26T10:22:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5809999999999999e-06 2024-04-26T10:22:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529203+0000", 2024-04-26T10:22:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0839999999999997e-06 2024-04-26T10:22:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:72479 5.9 5.8175ec09 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:05.529209+0000", 2024-04-26T10:22:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0014968080000000001, 2024-04-26T10:22:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017407, 2024-04-26T10:22:05.545 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72479 2024-04-26T10:22:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529209+0000", 2024-04-26T10:22:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529209+0000", 2024-04-26T10:22:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529209+0000", 2024-04-26T10:22:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529248+0000", 2024-04-26T10:22:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9465999999999998e-05 2024-04-26T10:22:05.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529255+0000", 2024-04-26T10:22:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.951e-06 2024-04-26T10:22:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529268+0000", 2024-04-26T10:22:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3213999999999999e-05 2024-04-26T10:22:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.548 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:72463 5.d e38/37 ondisk, result = 0)", 2024-04-26T10:22:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:05.529282+0000", 2024-04-26T10:22:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0014236089999999999, 2024-04-26T10:22:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001751032, 2024-04-26T10:22:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529282+0000", 2024-04-26T10:22:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529282+0000", 2024-04-26T10:22:05.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529282+0000", 2024-04-26T10:22:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529285+0000", 2024-04-26T10:22:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1049999999999999e-06 2024-04-26T10:22:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529309+0000", 2024-04-26T10:22:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3938e-05 2024-04-26T10:22:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529313+0000", 2024-04-26T10:22:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:22:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.530884+0000", 2024-04-26T10:22:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001570115 2024-04-26T10:22:05.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.530890+0000", 2024-04-26T10:22:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0340000000000002e-06 2024-04-26T10:22:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:72481 5.9 5.a278bda9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:05.530189+0000", 2024-04-26T10:22:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00051693300000000002, 2024-04-26T10:22:05.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090314900000000001, 2024-04-26T10:22:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72481 2024-04-26T10:22:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.530189+0000", 2024-04-26T10:22:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.530189+0000", 2024-04-26T10:22:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.530188+0000", 2024-04-26T10:22:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.530321+0000", 2024-04-26T10:22:05.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013302600000000001 2024-04-26T10:22:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.530330+0000", 2024-04-26T10:22:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4839999999999993e-06 2024-04-26T10:22:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.530337+0000", 2024-04-26T10:22:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0400000000000004e-06 2024-04-26T10:22:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.555 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:72482 5.3 5:cf899065:::benchmark_data_smithi052_19421_object72481:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:05.530345+0000", 2024-04-26T10:22:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00036127000000000002, 2024-04-26T10:22:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00079990300000000003, 2024-04-26T10:22:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-04-26T10:22:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72482 2024-04-26T10:22:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.530345+0000", 2024-04-26T10:22:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.530345+0000", 2024-04-26T10:22:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.530344+0000", 2024-04-26T10:22:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.530370+0000", 2024-04-26T10:22:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6151000000000001e-05 2024-04-26T10:22:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.530377+0000", 2024-04-26T10:22:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6239999999999996e-06 2024-04-26T10:22:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.530382+0000", 2024-04-26T10:22:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2050000000000001e-06 2024-04-26T10:22:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.531037+0000", 2024-04-26T10:22:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00065493099999999998 2024-04-26T10:22:05.558 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "MOSDPGPush(5.0 38/37 [PushOp(5:00b31331:::benchmark_data_smithi052_19421_object68753:head, version: 35'4243, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:00b31331:::benchmark_data_smithi052_19421_object68753:head@35'4243, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-04-26T10:22:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:05.530933+0000", 2024-04-26T10:22:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.999773, 2024-04-26T10:22:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025979300000000002, 2024-04-26T10:22:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.530933+0000", 2024-04-26T10:22:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.530933+0000", 2024-04-26T10:22:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.530932+0000", 2024-04-26T10:22:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.531016+0000", 2024-04-26T10:22:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3922000000000001e-05 2024-04-26T10:22:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.531027+0000", 2024-04-26T10:22:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1265e-05 2024-04-26T10:22:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.531036+0000", 2024-04-26T10:22:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5609999999999999e-06 2024-04-26T10:22:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.531109+0000", 2024-04-26T10:22:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3337000000000006e-05 2024-04-26T10:22:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.531121+0000", 2024-04-26T10:22:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1783000000000001e-05 2024-04-26T10:22:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "pg_backfill(progress 5.0 e 38/38 lb 5:00b2f96b:::benchmark_data_smithi052_19421_object51812:head)", 2024-04-26T10:22:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:05.531057+0000", 2024-04-26T10:22:05.562 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.999649, 2024-04-26T10:22:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000179712, 2024-04-26T10:22:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.531057+0000", 2024-04-26T10:22:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.531057+0000", 2024-04-26T10:22:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.531056+0000", 2024-04-26T10:22:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.531065+0000", 2024-04-26T10:22:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.653e-06 2024-04-26T10:22:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.531073+0000", 2024-04-26T10:22:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3699999999999997e-06 2024-04-26T10:22:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.531080+0000", 2024-04-26T10:22:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8439999999999998e-06 2024-04-26T10:22:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:72465 5.3 5:cf0b5753:::benchmark_data_smithi052_19421_object72464:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:05.524398+0000", 2024-04-26T10:22:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.006307778, 2024-04-26T10:22:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068876600000000003, 2024-04-26T10:22:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.565 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72465 2024-04-26T10:22:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.524398+0000", 2024-04-26T10:22:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.524398+0000", 2024-04-26T10:22:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.524327+0000", 2024-04-26T10:22:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999929 2024-04-26T10:22:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.524445+0000", 2024-04-26T10:22:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011768399999999999 2024-04-26T10:22:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.524453+0000", 2024-04-26T10:22:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9060000000000002e-06 2024-04-26T10:22:05.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.524459+0000", 2024-04-26T10:22:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5010000000000001e-06 2024-04-26T10:22:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.524499+0000", 2024-04-26T10:22:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.947e-05 2024-04-26T10:22:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.524616+0000", 2024-04-26T10:22:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011759199999999999 2024-04-26T10:22:05.568 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:72466 5.5 5:aa11ee5e:::benchmark_data_smithi052_19421_object72465:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:05.526145+0000", 2024-04-26T10:22:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0045608410000000004, 2024-04-26T10:22:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052023659999999999, 2024-04-26T10:22:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.569 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72466 2024-04-26T10:22:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526145+0000", 2024-04-26T10:22:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526145+0000", 2024-04-26T10:22:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526144+0000", 2024-04-26T10:22:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526192+0000", 2024-04-26T10:22:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7951999999999998e-05 2024-04-26T10:22:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526204+0000", 2024-04-26T10:22:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1545999999999999e-05 2024-04-26T10:22:05.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526211+0000", 2024-04-26T10:22:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4030000000000001e-06 2024-04-26T10:22:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526269+0000", 2024-04-26T10:22:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7664999999999998e-05 2024-04-26T10:22:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526433+0000", 2024-04-26T10:22:05.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016433100000000001 2024-04-26T10:22:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:72468 5.d 5:b3972d7e:::benchmark_data_smithi052_19421_object72467:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:05.526226+0000", 2024-04-26T10:22:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0044795709999999999, 2024-04-26T10:22:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051705800000000001, 2024-04-26T10:22:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72468 2024-04-26T10:22:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526226+0000", 2024-04-26T10:22:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526226+0000", 2024-04-26T10:22:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526226+0000", 2024-04-26T10:22:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526268+0000", 2024-04-26T10:22:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2653e-05 2024-04-26T10:22:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526278+0000", 2024-04-26T10:22:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7140000000000005e-06 2024-04-26T10:22:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526285+0000", 2024-04-26T10:22:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1339999999999998e-06 2024-04-26T10:22:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526323+0000", 2024-04-26T10:22:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7675000000000001e-05 2024-04-26T10:22:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526442+0000", 2024-04-26T10:22:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119428 2024-04-26T10:22:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526588+0000", 2024-04-26T10:22:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014545399999999999 2024-04-26T10:22:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.531043+0000", 2024-04-26T10:22:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044549100000000003 2024-04-26T10:22:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.577 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:72469 5.d 5:be382486:::benchmark_data_smithi052_19421_object72468:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:05.526295+0000", 2024-04-26T10:22:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0044108100000000003, 2024-04-26T10:22:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051591839999999998, 2024-04-26T10:22:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72469 2024-04-26T10:22:05.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526295+0000", 2024-04-26T10:22:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526295+0000", 2024-04-26T10:22:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526294+0000", 2024-04-26T10:22:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526326+0000", 2024-04-26T10:22:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1754000000000001e-05 2024-04-26T10:22:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526334+0000", 2024-04-26T10:22:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.34e-06 2024-04-26T10:22:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526339+0000", 2024-04-26T10:22:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4060000000000004e-06 2024-04-26T10:22:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528868+0000", 2024-04-26T10:22:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025286079999999999 2024-04-26T10:22:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528986+0000", 2024-04-26T10:22:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118436 2024-04-26T10:22:05.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.529107+0000", 2024-04-26T10:22:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012063200000000001 2024-04-26T10:22:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:72470 5.9 5:969117f9:::benchmark_data_smithi052_19421_object72469:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:05.526346+0000", 2024-04-26T10:22:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0043600740000000002, 2024-04-26T10:22:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052223759999999999, 2024-04-26T10:22:05.582 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72470 2024-04-26T10:22:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526346+0000", 2024-04-26T10:22:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526346+0000", 2024-04-26T10:22:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526345+0000", 2024-04-26T10:22:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526376+0000", 2024-04-26T10:22:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0732999999999999e-05 2024-04-26T10:22:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526381+0000", 2024-04-26T10:22:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7160000000000002e-06 2024-04-26T10:22:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526384+0000", 2024-04-26T10:22:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4340000000000001e-06 2024-04-26T10:22:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526422+0000", 2024-04-26T10:22:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7360000000000001e-05 2024-04-26T10:22:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526549+0000", 2024-04-26T10:22:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012726299999999999 2024-04-26T10:22:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526688+0000", 2024-04-26T10:22:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013931999999999999 2024-04-26T10:22:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528969+0000", 2024-04-26T10:22:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002281403 2024-04-26T10:22:05.586 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:72473 5.5 5:a7311fb8:::benchmark_data_smithi052_19421_object72472:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:05.526506+0000", 2024-04-26T10:22:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0042002029999999996, 2024-04-26T10:22:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005155799, 2024-04-26T10:22:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 72473 2024-04-26T10:22:05.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526506+0000", 2024-04-26T10:22:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526506+0000", 2024-04-26T10:22:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526505+0000", 2024-04-26T10:22:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526532+0000", 2024-04-26T10:22:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7319000000000001e-05 2024-04-26T10:22:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526539+0000", 2024-04-26T10:22:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9619999999999996e-06 2024-04-26T10:22:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.526545+0000", 2024-04-26T10:22:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1419999999999998e-06 2024-04-26T10:22:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.530880+0000", 2024-04-26T10:22:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043342140000000003 2024-04-26T10:22:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.531018+0000", 2024-04-26T10:22:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013812899999999999 2024-04-26T10:22:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.590 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:72474 5.0 e38/37 5:0f7560a0:::benchmark_data_smithi052_19421_object72473:head v 38'4489, mlcod=38'4487)", 2024-04-26T10:22:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:05.528307+0000", 2024-04-26T10:22:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0023994049999999999, 2024-04-26T10:22:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034153550000000001, 2024-04-26T10:22:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528307+0000", 2024-04-26T10:22:05.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528307+0000", 2024-04-26T10:22:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528306+0000", 2024-04-26T10:22:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528313+0000", 2024-04-26T10:22:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.063e-06 2024-04-26T10:22:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528336+0000", 2024-04-26T10:22:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3329999999999999e-05 2024-04-26T10:22:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528343+0000", 2024-04-26T10:22:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5830000000000003e-06 2024-04-26T10:22:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528399+0000", 2024-04-26T10:22:05.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6023000000000002e-05 2024-04-26T10:22:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:05.528423+0000", 2024-04-26T10:22:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4675e-05 2024-04-26T10:22:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:05.594 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 16 2024-04-26T10:22:05.594 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:05.596 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:05.604 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:05.600+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:05.616 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 32 16 72659 72643 141.864 132.188 0.00715416 0.0070434 2024-04-26T10:22:05.705 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:05.701+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:05.729 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:05.729 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:05.729 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:05.729 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:05.729 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:05.742 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:05.805 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:05.800+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:05.877 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:05.877 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:05.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:05.877 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:22:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 63.634788952000001, 2024-04-26T10:22:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018452342, 2024-04-26T10:22:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115 2024-04-26T10:22:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.878 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:22:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:22:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239018+0000", 2024-04-26T10:22:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239152+0000", 2024-04-26T10:22:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414699999999999 2024-04-26T10:22:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239169+0000", 2024-04-26T10:22:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7013000000000001e-05 2024-04-26T10:22:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239190+0000", 2024-04-26T10:22:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1302999999999999e-05 2024-04-26T10:22:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252181+0000", 2024-04-26T10:22:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012990213 2024-04-26T10:22:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252411+0000", 2024-04-26T10:22:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023010199999999999 2024-04-26T10:22:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252687+0000", 2024-04-26T10:22:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000276063 2024-04-26T10:22:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254694+0000", 2024-04-26T10:22:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020072879999999999 2024-04-26T10:22:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257399+0000", 2024-04-26T10:22:05.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027051670000000001 2024-04-26T10:22:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257442+0000", 2024-04-26T10:22:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-04-26T10:22:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257471+0000", 2024-04-26T10:22:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.889e-05 2024-04-26T10:22:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:22:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 63.634608423000003, 2024-04-26T10:22:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018350615000000001, 2024-04-26T10:22:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116 2024-04-26T10:22:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:22:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:22:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239198+0000", 2024-04-26T10:22:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239213+0000", 2024-04-26T10:22:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4965e-05 2024-04-26T10:22:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239235+0000", 2024-04-26T10:22:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.156e-05 2024-04-26T10:22:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239243+0000", 2024-04-26T10:22:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9470000000000003e-06 2024-04-26T10:22:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253284+0000", 2024-04-26T10:22:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014041392999999999 2024-04-26T10:22:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253376+0000", 2024-04-26T10:22:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1198000000000003e-05 2024-04-26T10:22:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253508+0000", 2024-04-26T10:22:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013220199999999999 2024-04-26T10:22:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255474+0000", 2024-04-26T10:22:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019665590000000001 2024-04-26T10:22:05.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257480+0000", 2024-04-26T10:22:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00200599 2024-04-26T10:22:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257515+0000", 2024-04-26T10:22:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5126000000000002e-05 2024-04-26T10:22:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257550+0000", 2024-04-26T10:22:05.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4394000000000003e-05 2024-04-26T10:22:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:22:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 63.634554866999999, 2024-04-26T10:22:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018369330999999999, 2024-04-26T10:22:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.890 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117 2024-04-26T10:22:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:22:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:22:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239252+0000", 2024-04-26T10:22:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239267+0000", 2024-04-26T10:22:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4562999999999999e-05 2024-04-26T10:22:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239281+0000", 2024-04-26T10:22:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4e-05 2024-04-26T10:22:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239296+0000", 2024-04-26T10:22:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5492999999999999e-05 2024-04-26T10:22:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254076+0000", 2024-04-26T10:22:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014779814 2024-04-26T10:22:05.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254159+0000", 2024-04-26T10:22:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2923999999999994e-05 2024-04-26T10:22:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254279+0000", 2024-04-26T10:22:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011964300000000001 2024-04-26T10:22:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.256043+0000", 2024-04-26T10:22:05.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001764353 2024-04-26T10:22:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257559+0000", 2024-04-26T10:22:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015159189999999999 2024-04-26T10:22:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257597+0000", 2024-04-26T10:22:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8031999999999998e-05 2024-04-26T10:22:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257622+0000", 2024-04-26T10:22:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5213999999999999e-05 2024-04-26T10:22:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 63.223816194000001, 2024-04-26T10:22:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019547338000000001, 2024-04-26T10:22:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165 2024-04-26T10:22:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649996+0000", 2024-04-26T10:22:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-04-26T10:22:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650021+0000", 2024-04-26T10:22:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5179999999999999e-05 2024-04-26T10:22:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650030+0000", 2024-04-26T10:22:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-04-26T10:22:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664733+0000", 2024-04-26T10:22:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014703097 2024-04-26T10:22:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664821+0000", 2024-04-26T10:22:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7918999999999996e-05 2024-04-26T10:22:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664953+0000", 2024-04-26T10:22:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132662 2024-04-26T10:22:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666776+0000", 2024-04-26T10:22:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018225509999999999 2024-04-26T10:22:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669480+0000", 2024-04-26T10:22:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00270382 2024-04-26T10:22:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669515+0000", 2024-04-26T10:22:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4885000000000002e-05 2024-04-26T10:22:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669539+0000", 2024-04-26T10:22:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4121000000000002e-05 2024-04-26T10:22:05.901 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:22:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 63.034166734000003, 2024-04-26T10:22:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018757273000000001, 2024-04-26T10:22:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:05.902 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 186 2024-04-26T10:22:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:22:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:22:05.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839640+0000", 2024-04-26T10:22:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839646+0000", 2024-04-26T10:22:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:22:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839654+0000", 2024-04-26T10:22:05.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:22:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839661+0000", 2024-04-26T10:22:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.64e-06 2024-04-26T10:22:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852328+0000", 2024-04-26T10:22:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012667151 2024-04-26T10:22:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852538+0000", 2024-04-26T10:22:05.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020961100000000001 2024-04-26T10:22:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852945+0000", 2024-04-26T10:22:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040712099999999998 2024-04-26T10:22:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857372+0000", 2024-04-26T10:22:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044268049999999998 2024-04-26T10:22:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858321+0000", 2024-04-26T10:22:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094932999999999997 2024-04-26T10:22:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858367+0000", 2024-04-26T10:22:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5534000000000001e-05 2024-04-26T10:22:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858398+0000", 2024-04-26T10:22:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1562e-05 2024-04-26T10:22:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.907 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:22:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 63.034139568000001, 2024-04-26T10:22:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019669504000000001, 2024-04-26T10:22:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:05.908 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187 2024-04-26T10:22:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:22:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:22:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839667+0000", 2024-04-26T10:22:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839677+0000", 2024-04-26T10:22:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3270000000000007e-06 2024-04-26T10:22:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839685+0000", 2024-04-26T10:22:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2670000000000006e-06 2024-04-26T10:22:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839692+0000", 2024-04-26T10:22:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7129999999999999e-06 2024-04-26T10:22:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853685+0000", 2024-04-26T10:22:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013993716999999999 2024-04-26T10:22:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853876+0000", 2024-04-26T10:22:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019097100000000001 2024-04-26T10:22:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853989+0000", 2024-04-26T10:22:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011275199999999999 2024-04-26T10:22:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857377+0000", 2024-04-26T10:22:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033882489999999999 2024-04-26T10:22:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859222+0000", 2024-04-26T10:22:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001844233 2024-04-26T10:22:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859291+0000", 2024-04-26T10:22:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:22:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859338+0000", 2024-04-26T10:22:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6366000000000003e-05 2024-04-26T10:22:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:22:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 63.034108701999997, 2024-04-26T10:22:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019837468, 2024-04-26T10:22:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.914 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 188 2024-04-26T10:22:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:22:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:22:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839698+0000", 2024-04-26T10:22:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839829+0000", 2024-04-26T10:22:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013061099999999999 2024-04-26T10:22:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839853+0000", 2024-04-26T10:22:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3736000000000001e-05 2024-04-26T10:22:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839863+0000", 2024-04-26T10:22:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:22:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854869+0000", 2024-04-26T10:22:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015005978 2024-04-26T10:22:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854959+0000", 2024-04-26T10:22:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9468999999999993e-05 2024-04-26T10:22:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855114+0000", 2024-04-26T10:22:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015563799999999999 2024-04-26T10:22:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857386+0000", 2024-04-26T10:22:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002271852 2024-04-26T10:22:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859406+0000", 2024-04-26T10:22:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002019936 2024-04-26T10:22:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859461+0000", 2024-04-26T10:22:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4826e-05 2024-04-26T10:22:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859536+0000", 2024-04-26T10:22:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5566000000000001e-05 2024-04-26T10:22:05.919 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:22:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 63.033934838999997, 2024-04-26T10:22:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019826496999999998, 2024-04-26T10:22:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:05.920 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 189 2024-04-26T10:22:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:22:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:22:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839872+0000", 2024-04-26T10:22:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839882+0000", 2024-04-26T10:22:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:22:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839892+0000", 2024-04-26T10:22:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.217e-06 2024-04-26T10:22:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839900+0000", 2024-04-26T10:22:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5469999999999997e-06 2024-04-26T10:22:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855903+0000", 2024-04-26T10:22:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016002590000000001 2024-04-26T10:22:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856110+0000", 2024-04-26T10:22:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020711199999999999 2024-04-26T10:22:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856421+0000", 2024-04-26T10:22:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031128500000000001 2024-04-26T10:22:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857643+0000", 2024-04-26T10:22:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012215520000000001 2024-04-26T10:22:05.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859603+0000", 2024-04-26T10:22:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019600350000000002 2024-04-26T10:22:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859660+0000", 2024-04-26T10:22:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6857999999999997e-05 2024-04-26T10:22:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859699+0000", 2024-04-26T10:22:05.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9641999999999998e-05 2024-04-26T10:22:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34427 5.7 5:ef7d83e6:::benchmark_data_smithi052_19421_object34426:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:22:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:22:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.24172918, 2024-04-26T10:22:05.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02010443, 2024-04-26T10:22:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34427 2024-04-26T10:22:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:22:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:22:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632077+0000", 2024-04-26T10:22:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632139+0000", 2024-04-26T10:22:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2527999999999995e-05 2024-04-26T10:22:05.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632153+0000", 2024-04-26T10:22:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3608000000000001e-05 2024-04-26T10:22:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632165+0000", 2024-04-26T10:22:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2592000000000001e-05 2024-04-26T10:22:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635907+0000", 2024-04-26T10:22:05.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037419789999999999 2024-04-26T10:22:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635919+0000", 2024-04-26T10:22:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1511999999999999e-05 2024-04-26T10:22:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641616+0000", 2024-04-26T10:22:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056974770000000003 2024-04-26T10:22:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641772+0000", 2024-04-26T10:22:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155799 2024-04-26T10:22:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.651965+0000", 2024-04-26T10:22:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010193254000000001 2024-04-26T10:22:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652039+0000", 2024-04-26T10:22:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4031999999999999e-05 2024-04-26T10:22:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652183+0000", 2024-04-26T10:22:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014342599999999999 2024-04-26T10:22:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45130 5.5 5:a1beca5f:::benchmark_data_smithi052_19421_object45129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:22:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:22:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.188245557, 2024-04-26T10:22:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019561411000000001, 2024-04-26T10:22:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.932 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45130 2024-04-26T10:22:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:22:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:22:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685561+0000", 2024-04-26T10:22:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685648+0000", 2024-04-26T10:22:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6552999999999996e-05 2024-04-26T10:22:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685657+0000", 2024-04-26T10:22:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1330000000000005e-06 2024-04-26T10:22:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685664+0000", 2024-04-26T10:22:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1069999999999999e-06 2024-04-26T10:22:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.691613+0000", 2024-04-26T10:22:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059489199999999999 2024-04-26T10:22:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.691779+0000", 2024-04-26T10:22:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016567700000000001 2024-04-26T10:22:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705021+0000", 2024-04-26T10:22:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013242812 2024-04-26T10:22:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705054+0000", 2024-04-26T10:22:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2709999999999997e-05 2024-04-26T10:22:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705123+0000", 2024-04-26T10:22:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9246999999999996e-05 2024-04-26T10:22:05.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:49103 5.f 5:f082f091:::benchmark_data_smithi052_19421_object49102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:22:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:22:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.54563969, 2024-04-26T10:22:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019587917, 2024-04-26T10:22:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49103 2024-04-26T10:22:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:22:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:22:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328167+0000", 2024-04-26T10:22:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328207+0000", 2024-04-26T10:22:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0275999999999999e-05 2024-04-26T10:22:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328220+0000", 2024-04-26T10:22:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2968e-05 2024-04-26T10:22:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328233+0000", 2024-04-26T10:22:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2203e-05 2024-04-26T10:22:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.333946+0000", 2024-04-26T10:22:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057135110000000001 2024-04-26T10:22:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.335894+0000", 2024-04-26T10:22:05.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019474959999999999 2024-04-26T10:22:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.336030+0000", 2024-04-26T10:22:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013601999999999999 2024-04-26T10:22:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.340794+0000", 2024-04-26T10:22:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047643800000000004 2024-04-26T10:22:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347659+0000", 2024-04-26T10:22:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068648800000000003 2024-04-26T10:22:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347713+0000", 2024-04-26T10:22:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3736000000000002e-05 2024-04-26T10:22:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347756+0000", 2024-04-26T10:22:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3155000000000003e-05 2024-04-26T10:22:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:49261 5.5 5:a449de5e:::benchmark_data_smithi052_19421_object49260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:22:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:22:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.481635644000001, 2024-04-26T10:22:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020598741, 2024-04-26T10:22:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49261 2024-04-26T10:22:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.944 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:22:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:22:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392171+0000", 2024-04-26T10:22:05.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392212+0000", 2024-04-26T10:22:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0889000000000001e-05 2024-04-26T10:22:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392221+0000", 2024-04-26T10:22:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1970000000000002e-06 2024-04-26T10:22:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392228+0000", 2024-04-26T10:22:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.397869+0000", 2024-04-26T10:22:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056403180000000001 2024-04-26T10:22:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.398010+0000", 2024-04-26T10:22:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014105300000000001 2024-04-26T10:22:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412532+0000", 2024-04-26T10:22:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014522431000000001 2024-04-26T10:22:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412692+0000", 2024-04-26T10:22:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015970700000000001 2024-04-26T10:22:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412771+0000", 2024-04-26T10:22:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8980000000000006e-05 2024-04-26T10:22:05.948 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.3444614000000001, 2024-04-26T10:22:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.949 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:05.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:05.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.3399261879999997, 2024-04-26T10:22:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:05.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:05.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.3392948960000002, 2024-04-26T10:22:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:05.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:05.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.966 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65604 5.9 5:9c239c32:::benchmark_data_smithi052_19421_object65603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.1041920120000004, 2024-04-26T10:22:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025897677000000001, 2024-04-26T10:22:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65604 2024-04-26T10:22:05.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769615+0000", 2024-04-26T10:22:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769694+0000", 2024-04-26T10:22:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9087999999999999e-05 2024-04-26T10:22:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769702+0000", 2024-04-26T10:22:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8150000000000006e-06 2024-04-26T10:22:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769709+0000", 2024-04-26T10:22:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:22:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772336+0000", 2024-04-26T10:22:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002626836 2024-04-26T10:22:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772470+0000", 2024-04-26T10:22:05.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013453299999999999 2024-04-26T10:22:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772605+0000", 2024-04-26T10:22:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013428499999999999 2024-04-26T10:22:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779374+0000", 2024-04-26T10:22:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067694000000000001 2024-04-26T10:22:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795401+0000", 2024-04-26T10:22:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016026543000000001 2024-04-26T10:22:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795461+0000", 2024-04-26T10:22:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9923999999999998e-05 2024-04-26T10:22:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795513+0000", 2024-04-26T10:22:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2737e-05 2024-04-26T10:22:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65613 5.1 5:85cc6530:::benchmark_data_smithi052_19421_object65612:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.1018189659999997, 2024-04-26T10:22:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023662843999999999, 2024-04-26T10:22:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65613 2024-04-26T10:22:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771988+0000", 2024-04-26T10:22:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772053+0000", 2024-04-26T10:22:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5067000000000006e-05 2024-04-26T10:22:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772065+0000", 2024-04-26T10:22:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2252999999999999e-05 2024-04-26T10:22:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772072+0000", 2024-04-26T10:22:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1400000000000002e-06 2024-04-26T10:22:05.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779354+0000", 2024-04-26T10:22:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072818120000000004 2024-04-26T10:22:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779455+0000", 2024-04-26T10:22:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101109 2024-04-26T10:22:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795526+0000", 2024-04-26T10:22:05.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016071203999999999 2024-04-26T10:22:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795572+0000", 2024-04-26T10:22:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5865999999999998e-05 2024-04-26T10:22:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795651+0000", 2024-04-26T10:22:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9192999999999999e-05 2024-04-26T10:22:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65614 5.9 5:993a4fbe:::benchmark_data_smithi052_19421_object65613:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.1017267750000004, 2024-04-26T10:22:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023664145000000001, 2024-04-26T10:22:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65614 2024-04-26T10:22:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772080+0000", 2024-04-26T10:22:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772117+0000", 2024-04-26T10:22:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6418000000000003e-05 2024-04-26T10:22:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772124+0000", 2024-04-26T10:22:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4730000000000003e-06 2024-04-26T10:22:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772132+0000", 2024-04-26T10:22:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3900000000000004e-06 2024-04-26T10:22:05.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781379+0000", 2024-04-26T10:22:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092471059999999997 2024-04-26T10:22:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781495+0000", 2024-04-26T10:22:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001159 2024-04-26T10:22:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781581+0000", 2024-04-26T10:22:05.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6087000000000004e-05 2024-04-26T10:22:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.785948+0000", 2024-04-26T10:22:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043671669999999999 2024-04-26T10:22:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795661+0000", 2024-04-26T10:22:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097130310000000004 2024-04-26T10:22:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795710+0000", 2024-04-26T10:22:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8959000000000003e-05 2024-04-26T10:22:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795745+0000", 2024-04-26T10:22:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5172000000000001e-05 2024-04-26T10:22:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65619 5.1 5:89edbbcc:::benchmark_data_smithi052_19421_object65618:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.775377+0000", 2024-04-26T10:22:05.983 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.0984308770000002, 2024-04-26T10:22:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020492052, 2024-04-26T10:22:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65619 2024-04-26T10:22:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775377+0000", 2024-04-26T10:22:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775377+0000", 2024-04-26T10:22:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775376+0000", 2024-04-26T10:22:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775450+0000", 2024-04-26T10:22:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3485000000000005e-05 2024-04-26T10:22:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775459+0000", 2024-04-26T10:22:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1030000000000008e-06 2024-04-26T10:22:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775463+0000", 2024-04-26T10:22:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0060000000000003e-06 2024-04-26T10:22:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.783840+0000", 2024-04-26T10:22:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083774339999999996 2024-04-26T10:22:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.783963+0000", 2024-04-26T10:22:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012291900000000001 2024-04-26T10:22:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795755+0000", 2024-04-26T10:22:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011791793 2024-04-26T10:22:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795798+0000", 2024-04-26T10:22:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3597999999999998e-05 2024-04-26T10:22:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795869+0000", 2024-04-26T10:22:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0413000000000005e-05 2024-04-26T10:22:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:68218 5.9 5:9d226c09:::benchmark_data_smithi052_19421_object68217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:22:05.988 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:01.979822+0000", 2024-04-26T10:22:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.893985121, 2024-04-26T10:22:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021403591, 2024-04-26T10:22:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 68218 2024-04-26T10:22:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:05.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979822+0000", 2024-04-26T10:22:05.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:05.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979822+0000", 2024-04-26T10:22:05.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:05.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:05.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979822+0000", 2024-04-26T10:22:05.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:05.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:05.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979889+0000", 2024-04-26T10:22:05.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7892000000000007e-05 2024-04-26T10:22:05.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:05.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979902+0000", 2024-04-26T10:22:05.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2668e-05 2024-04-26T10:22:05.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:05.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979912+0000", 2024-04-26T10:22:05.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5599999999999999e-06 2024-04-26T10:22:05.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:05.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979959+0000", 2024-04-26T10:22:05.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6980000000000001e-05 2024-04-26T10:22:05.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:05.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.980117+0000", 2024-04-26T10:22:05.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015815499999999999 2024-04-26T10:22:05.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:05.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.980279+0000", 2024-04-26T10:22:05.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161903 2024-04-26T10:22:05.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:05.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.984675+0000", 2024-04-26T10:22:05.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043966159999999999 2024-04-26T10:22:05.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:05.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:02.001127+0000", 2024-04-26T10:22:05.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016452106000000001 2024-04-26T10:22:05.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:05.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:02.001177+0000", 2024-04-26T10:22:05.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9882000000000001e-05 2024-04-26T10:22:05.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:05.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:05.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:05.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:02.001226+0000", 2024-04-26T10:22:05.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8748000000000002e-05 2024-04-26T10:22:05.994 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.994 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.994 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.994 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:05.994 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:05.994 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:05.996 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:05.996 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:05.993+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:06.096 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:06.092+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:06.123 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:06.123 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:06.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.123 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:73697 5.4 5:201e4bf1:::benchmark_data_smithi052_19421_object73696:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:06.123 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:06.115026+0000", 2024-04-26T10:22:06.123 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0072560200000000002, 2024-04-26T10:22:06.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0072851089999999997, 2024-04-26T10:22:06.123 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.123 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:06.123 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.123 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.124 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 73697 2024-04-26T10:22:06.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.124 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.115026+0000", 2024-04-26T10:22:06.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.115026+0000", 2024-04-26T10:22:06.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.115025+0000", 2024-04-26T10:22:06.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:06.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.115073+0000", 2024-04-26T10:22:06.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7277000000000002e-05 2024-04-26T10:22:06.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.115082+0000", 2024-04-26T10:22:06.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7219999999999994e-06 2024-04-26T10:22:06.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.115089+0000", 2024-04-26T10:22:06.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1790000000000002e-06 2024-04-26T10:22:06.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.115140+0000", 2024-04-26T10:22:06.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0971999999999999e-05 2024-04-26T10:22:06.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.115323+0000", 2024-04-26T10:22:06.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018259999999999999 2024-04-26T10:22:06.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:06.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.115524+0000", 2024-04-26T10:22:06.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000201373 2024-04-26T10:22:06.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:06.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.118648+0000", 2024-04-26T10:22:06.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031234660000000001 2024-04-26T10:22:06.127 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.127 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.127 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.128 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:73704 5.4 5:26d25ec3:::benchmark_data_smithi052_19421_object73703:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:06.128 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:06.118818+0000", 2024-04-26T10:22:06.128 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.003464455, 2024-04-26T10:22:06.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0035821770000000002, 2024-04-26T10:22:06.128 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.128 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:06.128 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.128 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.128 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.128 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 73704 2024-04-26T10:22:06.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.129 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.118818+0000", 2024-04-26T10:22:06.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.118818+0000", 2024-04-26T10:22:06.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.118817+0000", 2024-04-26T10:22:06.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:06.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.118877+0000", 2024-04-26T10:22:06.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.965e-05 2024-04-26T10:22:06.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.118888+0000", 2024-04-26T10:22:06.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1433999999999999e-05 2024-04-26T10:22:06.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.118894+0000", 2024-04-26T10:22:06.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8119999999999996e-06 2024-04-26T10:22:06.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.118943+0000", 2024-04-26T10:22:06.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9215999999999998e-05 2024-04-26T10:22:06.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.119144+0000", 2024-04-26T10:22:06.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020072499999999999 2024-04-26T10:22:06.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:06.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.119378+0000", 2024-04-26T10:22:06.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000234224 2024-04-26T10:22:06.132 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.132 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.132 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.132 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:73706 5.e 5:7e46c657:::benchmark_data_smithi052_19421_object73705:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:06.132 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:06.119703+0000", 2024-04-26T10:22:06.132 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.002579876, 2024-04-26T10:22:06.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002772896, 2024-04-26T10:22:06.132 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.132 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:06.133 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.133 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.133 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.133 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 73706 2024-04-26T10:22:06.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.133 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.119703+0000", 2024-04-26T10:22:06.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.119703+0000", 2024-04-26T10:22:06.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.119702+0000", 2024-04-26T10:22:06.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:06.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.119765+0000", 2024-04-26T10:22:06.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2966999999999995e-05 2024-04-26T10:22:06.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.119774+0000", 2024-04-26T10:22:06.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0960000000000007e-06 2024-04-26T10:22:06.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.119779+0000", 2024-04-26T10:22:06.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6400000000000002e-06 2024-04-26T10:22:06.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.119911+0000", 2024-04-26T10:22:06.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013129400000000001 2024-04-26T10:22:06.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.120083+0000", 2024-04-26T10:22:06.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000172435 2024-04-26T10:22:06.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.136 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.136 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:73711 5.4 5:2e23427d:::benchmark_data_smithi052_19421_object73710:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:06.136 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:06.120358+0000", 2024-04-26T10:22:06.136 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0019249169999999999, 2024-04-26T10:22:06.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021852669999999999, 2024-04-26T10:22:06.136 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.136 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:06.137 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.137 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.137 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.137 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 73711 2024-04-26T10:22:06.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.137 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.120358+0000", 2024-04-26T10:22:06.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.120358+0000", 2024-04-26T10:22:06.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.120356+0000", 2024-04-26T10:22:06.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:06.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.120437+0000", 2024-04-26T10:22:06.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:06.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.120446+0000", 2024-04-26T10:22:06.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2860000000000005e-06 2024-04-26T10:22:06.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.120454+0000", 2024-04-26T10:22:06.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3100000000000003e-06 2024-04-26T10:22:06.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.121826+0000", 2024-04-26T10:22:06.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0013724480000000001 2024-04-26T10:22:06.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.121953+0000", 2024-04-26T10:22:06.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012665199999999999 2024-04-26T10:22:06.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:06.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.122101+0000", 2024-04-26T10:22:06.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014839200000000001 2024-04-26T10:22:06.140 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.140 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.140 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.141 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:73712 5.a 5:50fda50f:::benchmark_data_smithi052_19421_object73711:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:06.141 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:06.120543+0000", 2024-04-26T10:22:06.141 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0017395449999999999, 2024-04-26T10:22:06.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020719250000000001, 2024-04-26T10:22:06.141 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.141 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:06.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.141 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 73712 2024-04-26T10:22:06.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.141 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.120543+0000", 2024-04-26T10:22:06.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.120543+0000", 2024-04-26T10:22:06.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.120542+0000", 2024-04-26T10:22:06.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:06.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.120602+0000", 2024-04-26T10:22:06.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9734000000000001e-05 2024-04-26T10:22:06.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.120610+0000", 2024-04-26T10:22:06.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5450000000000003e-06 2024-04-26T10:22:06.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.120616+0000", 2024-04-26T10:22:06.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8130000000000001e-06 2024-04-26T10:22:06.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.120664+0000", 2024-04-26T10:22:06.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7666000000000001e-05 2024-04-26T10:22:06.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.120766+0000", 2024-04-26T10:22:06.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102155 2024-04-26T10:22:06.144 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.144 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.144 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.145 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop_reply(client.4722.0:73697 5.4 e38/37)", 2024-04-26T10:22:06.145 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:06.121715+0000", 2024-04-26T10:22:06.145 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00056734999999999999, 2024-04-26T10:22:06.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000959234, 2024-04-26T10:22:06.145 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.145 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:06.145 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.121715+0000", 2024-04-26T10:22:06.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.121715+0000", 2024-04-26T10:22:06.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.121714+0000", 2024-04-26T10:22:06.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:06.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.121719+0000", 2024-04-26T10:22:06.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7520000000000004e-06 2024-04-26T10:22:06.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.121727+0000", 2024-04-26T10:22:06.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8720000000000002e-06 2024-04-26T10:22:06.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.121733+0000", 2024-04-26T10:22:06.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6389999999999997e-06 2024-04-26T10:22:06.147 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.147 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.147 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.148 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop_reply(client.4722.0:73704 5.4 e38/37)", 2024-04-26T10:22:06.148 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:06.122211+0000", 2024-04-26T10:22:06.148 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.1872999999999994e-05, 2024-04-26T10:22:06.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000510748, 2024-04-26T10:22:06.148 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.148 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:06.148 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.122211+0000", 2024-04-26T10:22:06.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.122211+0000", 2024-04-26T10:22:06.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.122210+0000", 2024-04-26T10:22:06.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:06.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.122214+0000", 2024-04-26T10:22:06.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0300000000000004e-06 2024-04-26T10:22:06.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.122221+0000", 2024-04-26T10:22:06.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4459999999999998e-06 2024-04-26T10:22:06.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.122225+0000", 2024-04-26T10:22:06.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2189999999999998e-06 2024-04-26T10:22:06.150 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.150 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.150 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.150 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:73713 5.9 e38/37 5:9951f449:::benchmark_data_smithi052_19421_object73712:head v 38'4609, mlcod=38'4607)", 2024-04-26T10:22:06.151 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:06.122482+0000", 2024-04-26T10:22:06.151 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9998002, 2024-04-26T10:22:06.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00029229000000000001, 2024-04-26T10:22:06.151 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.151 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:06.151 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.122482+0000", 2024-04-26T10:22:06.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.122482+0000", 2024-04-26T10:22:06.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.122482+0000", 2024-04-26T10:22:06.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:06.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.122551+0000", 2024-04-26T10:22:06.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9017999999999995e-05 2024-04-26T10:22:06.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.122560+0000", 2024-04-26T10:22:06.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4069999999999999e-06 2024-04-26T10:22:06.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.122564+0000", 2024-04-26T10:22:06.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.602e-06 2024-04-26T10:22:06.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.122609+0000", 2024-04-26T10:22:06.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5201000000000003e-05 2024-04-26T10:22:06.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.122627+0000", 2024-04-26T10:22:06.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7527e-05 2024-04-26T10:22:06.154 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.154 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.154 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.154 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.154 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:06.154 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 8 2024-04-26T10:22:06.154 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:06.155 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:06.164 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:22:06.197 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:06.193+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:06.280 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:06.280 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:06.281 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:06.281 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:06.281 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:06.294 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:06.297 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~18s 2024-04-26T10:22:06.298 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:06.293+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:06.399 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:06.397+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:06.421 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:06.421 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:06.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:06.422 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:06.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.422 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64610 5.a 5:57daa913:::benchmark_data_smithi052_19421_object64609:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:06.422 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.211728+0000", 2024-04-26T10:22:06.422 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 6.2077557609999996, 2024-04-26T10:22:06.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020479739, 2024-04-26T10:22:06.422 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.422 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.422 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.422 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.422 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.422 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64610 2024-04-26T10:22:06.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.423 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211728+0000", 2024-04-26T10:22:06.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211728+0000", 2024-04-26T10:22:06.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211727+0000", 2024-04-26T10:22:06.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:06.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211790+0000", 2024-04-26T10:22:06.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3325999999999996e-05 2024-04-26T10:22:06.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211799+0000", 2024-04-26T10:22:06.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2790000000000004e-06 2024-04-26T10:22:06.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211808+0000", 2024-04-26T10:22:06.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0909999999999999e-06 2024-04-26T10:22:06.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.218692+0000", 2024-04-26T10:22:06.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0068833729999999999 2024-04-26T10:22:06.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.218790+0000", 2024-04-26T10:22:06.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8395999999999998e-05 2024-04-26T10:22:06.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:06.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.232078+0000", 2024-04-26T10:22:06.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01328821 2024-04-26T10:22:06.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.232130+0000", 2024-04-26T10:22:06.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1715999999999997e-05 2024-04-26T10:22:06.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.232207+0000", 2024-04-26T10:22:06.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7379999999999994e-05 2024-04-26T10:22:06.427 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.427 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.427 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.427 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:06.427 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:06.427 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.8888425360000003, 2024-04-26T10:22:06.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:06.427 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.427 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.427 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.427 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.427 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.427 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:06.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.428 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:06.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:06.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:06.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:06.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:06.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:06.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:06.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:06.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:06.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:06.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:06.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:06.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:06.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:06.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:06.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:06.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:06.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:06.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:06.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:06.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:06.431 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.431 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.432 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.432 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:06.432 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:06.432 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.8868603090000002, 2024-04-26T10:22:06.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:06.432 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.432 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.432 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.432 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.432 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.432 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:06.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.433 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:06.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:06.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:06.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:06.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:06.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:06.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:06.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:06.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:06.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:06.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:06.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:06.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:06.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:06.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:06.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:06.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:06.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:06.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:06.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:06.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:06.437 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.437 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.437 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.437 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:06.437 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:06.437 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.8866609250000002, 2024-04-26T10:22:06.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:06.437 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.437 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.437 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.437 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.437 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.438 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:06.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.438 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:06.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:06.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:06.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:06.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:06.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:06.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:06.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:06.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:06.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:06.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:06.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:06.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:06.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:06.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:06.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:06.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:06.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:06.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:06.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:06.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:06.442 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.442 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.442 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.442 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:06.442 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:06.442 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.8864423050000001, 2024-04-26T10:22:06.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:06.442 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.442 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.442 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:06.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:06.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:06.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:06.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:06.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:06.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:06.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:06.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:06.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:06.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:06.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:06.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:06.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:06.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:06.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:06.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:06.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:06.446 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.446 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.446 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.446 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:06.446 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:06.446 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.8840708670000001, 2024-04-26T10:22:06.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:06.446 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.447 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.447 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.447 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.447 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.447 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:06.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.450 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:06.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:06.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:06.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:06.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:06.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:06.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:06.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:06.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:06.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:06.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:06.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:06.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:06.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:06.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:06.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:06.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:06.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:06.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:06.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:06.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:06.454 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.454 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.454 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.454 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:06.454 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:06.454 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.8839702450000004, 2024-04-26T10:22:06.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:06.454 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.454 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.454 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.454 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.454 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.455 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:06.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.455 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:06.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:06.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:06.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:06.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:06.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:06.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:06.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:06.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:06.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:06.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:06.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:06.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:06.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:06.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:06.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:06.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:06.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:06.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:06.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:06.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:06.459 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.459 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.459 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.459 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:06.459 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:06.459 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.8838516839999997, 2024-04-26T10:22:06.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:06.459 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.459 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.459 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:06.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:06.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:06.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:06.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:06.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:06.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:06.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:06.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:06.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:06.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:06.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:06.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:06.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:06.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:06.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:06.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:06.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:06.463 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.463 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.463 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.463 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:06.464 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:06.464 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.8837492860000005, 2024-04-26T10:22:06.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:06.464 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.464 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.464 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.464 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.464 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.464 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:06.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.464 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:06.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:06.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:06.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:06.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:06.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:06.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:06.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:06.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:06.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:06.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:06.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:06.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:06.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:06.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:06.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:06.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:06.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:06.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:06.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:06.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:06.468 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.468 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.468 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.469 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65294 5.e 5:7438ad6f:::benchmark_data_smithi052_19421_object65293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:06.469 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:06.469 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.8830691689999997, 2024-04-26T10:22:06.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091965517999999996, 2024-04-26T10:22:06.469 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.469 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.469 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.469 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.469 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.469 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65294 2024-04-26T10:22:06.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.469 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:06.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:06.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536413+0000", 2024-04-26T10:22:06.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:06.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536470+0000", 2024-04-26T10:22:06.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6443999999999997e-05 2024-04-26T10:22:06.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536480+0000", 2024-04-26T10:22:06.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0652999999999999e-05 2024-04-26T10:22:06.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536488+0000", 2024-04-26T10:22:06.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7929999999999998e-06 2024-04-26T10:22:06.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536548+0000", 2024-04-26T10:22:06.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9556999999999999e-05 2024-04-26T10:22:06.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536728+0000", 2024-04-26T10:22:06.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000180958 2024-04-26T10:22:06.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:06.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628168+0000", 2024-04-26T10:22:06.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091439276999999999 2024-04-26T10:22:06.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628258+0000", 2024-04-26T10:22:06.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0158e-05 2024-04-26T10:22:06.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628380+0000", 2024-04-26T10:22:06.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012180699999999999 2024-04-26T10:22:06.473 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.473 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.473 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.474 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:06.474 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:06.474 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.8827287290000001, 2024-04-26T10:22:06.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:06.474 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.474 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.474 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.474 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.474 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.474 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:06.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.474 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:06.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:06.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:06.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:06.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:06.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:06.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:06.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:06.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:06.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:06.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:06.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:06.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:06.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:06.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:06.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:06.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:06.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:06.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:06.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:06.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:06.478 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.478 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.478 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.479 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:06.479 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:06.479 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.8815784539999996, 2024-04-26T10:22:06.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:06.479 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.479 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.479 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.479 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.479 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.479 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:06.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.479 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:06.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:06.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:06.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:06.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:06.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:06.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:06.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:06.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:06.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:06.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:06.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:06.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:06.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:06.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:06.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:06.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:06.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:06.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:06.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:06.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:06.483 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.484 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.484 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.484 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65292 5.f e34/22 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head v 34'4129, mlcod=34'4125)", 2024-04-26T10:22:06.484 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:06.484 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.8814041980000002, 2024-04-26T10:22:06.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093470155999999999, 2024-04-26T10:22:06.484 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.484 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.484 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:06.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:06.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538078+0000", 2024-04-26T10:22:06.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:06.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538140+0000", 2024-04-26T10:22:06.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1970000000000005e-05 2024-04-26T10:22:06.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538149+0000", 2024-04-26T10:22:06.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2189999999999993e-06 2024-04-26T10:22:06.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538158+0000", 2024-04-26T10:22:06.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0930000000000003e-06 2024-04-26T10:22:06.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627053+0000", 2024-04-26T10:22:06.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088895221999999996 2024-04-26T10:22:06.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627092+0000", 2024-04-26T10:22:06.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9657000000000003e-05 2024-04-26T10:22:06.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631499+0000", 2024-04-26T10:22:06.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044066560000000001 2024-04-26T10:22:06.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631549+0000", 2024-04-26T10:22:06.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0259000000000001e-05 2024-04-26T10:22:06.488 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.488 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.488 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.488 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65298 5.b 5:d51c4e52:::benchmark_data_smithi052_19421_object65297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:06.488 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:06.488 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.8806377410000001, 2024-04-26T10:22:06.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091641671999999993, 2024-04-26T10:22:06.489 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.489 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.489 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.489 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.489 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.489 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65298 2024-04-26T10:22:06.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.489 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:06.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:06.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538844+0000", 2024-04-26T10:22:06.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:06.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538919+0000", 2024-04-26T10:22:06.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4626e-05 2024-04-26T10:22:06.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626007+0000", 2024-04-26T10:22:06.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087087516000000004 2024-04-26T10:22:06.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626074+0000", 2024-04-26T10:22:06.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7077999999999997e-05 2024-04-26T10:22:06.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626150+0000", 2024-04-26T10:22:06.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5982999999999994e-05 2024-04-26T10:22:06.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626341+0000", 2024-04-26T10:22:06.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019141199999999999 2024-04-26T10:22:06.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:06.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630359+0000", 2024-04-26T10:22:06.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040175710000000002 2024-04-26T10:22:06.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630412+0000", 2024-04-26T10:22:06.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3779000000000001e-05 2024-04-26T10:22:06.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630487+0000", 2024-04-26T10:22:06.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4913999999999995e-05 2024-04-26T10:22:06.493 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.493 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.493 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.493 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:70533 5.0 5:01246de6:::benchmark_data_smithi052_19421_object70532:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:06.493 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.612488+0000", 2024-04-26T10:22:06.494 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.8069958860000002, 2024-04-26T10:22:06.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020317557, 2024-04-26T10:22:06.494 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.494 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.494 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.494 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.494 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.494 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 70533 2024-04-26T10:22:06.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.494 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.612488+0000", 2024-04-26T10:22:06.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.612488+0000", 2024-04-26T10:22:06.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.612486+0000", 2024-04-26T10:22:06.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:06.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.612542+0000", 2024-04-26T10:22:06.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5414000000000002e-05 2024-04-26T10:22:06.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.612555+0000", 2024-04-26T10:22:06.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3174e-05 2024-04-26T10:22:06.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.612562+0000", 2024-04-26T10:22:06.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2350000000000002e-06 2024-04-26T10:22:06.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616664+0000", 2024-04-26T10:22:06.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041013150000000003 2024-04-26T10:22:06.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616879+0000", 2024-04-26T10:22:06.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000214945 2024-04-26T10:22:06.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:06.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.617134+0000", 2024-04-26T10:22:06.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025564400000000002 2024-04-26T10:22:06.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:06.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.622299+0000", 2024-04-26T10:22:06.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005165289 2024-04-26T10:22:06.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:06.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.632659+0000", 2024-04-26T10:22:06.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010359515999999999 2024-04-26T10:22:06.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.632714+0000", 2024-04-26T10:22:06.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5136999999999997e-05 2024-04-26T10:22:06.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.632805+0000", 2024-04-26T10:22:06.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0946999999999995e-05 2024-04-26T10:22:06.499 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.499 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.499 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.499 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:70535 5.8 5:1871dc9c:::benchmark_data_smithi052_19421_object70534:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:06.499 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.613036+0000", 2024-04-26T10:22:06.499 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.8064475180000001, 2024-04-26T10:22:06.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021812264000000001, 2024-04-26T10:22:06.500 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.500 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.500 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.500 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.500 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.500 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 70535 2024-04-26T10:22:06.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.500 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613036+0000", 2024-04-26T10:22:06.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613036+0000", 2024-04-26T10:22:06.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613035+0000", 2024-04-26T10:22:06.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:06.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613072+0000", 2024-04-26T10:22:06.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6766e-05 2024-04-26T10:22:06.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613087+0000", 2024-04-26T10:22:06.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5349000000000002e-05 2024-04-26T10:22:06.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613094+0000", 2024-04-26T10:22:06.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8079999999999999e-06 2024-04-26T10:22:06.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.619353+0000", 2024-04-26T10:22:06.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0062593839999999998 2024-04-26T10:22:06.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.619503+0000", 2024-04-26T10:22:06.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000149715 2024-04-26T10:22:06.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:06.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.634715+0000", 2024-04-26T10:22:06.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015211875 2024-04-26T10:22:06.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.634765+0000", 2024-04-26T10:22:06.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0757000000000002e-05 2024-04-26T10:22:06.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.634848+0000", 2024-04-26T10:22:06.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2707000000000006e-05 2024-04-26T10:22:06.504 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.504 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.504 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.504 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:70544 5.0 5:009299e5:::benchmark_data_smithi052_19421_object70543:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:06.504 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.616758+0000", 2024-04-26T10:22:06.505 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.802725235, 2024-04-26T10:22:06.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020254284000000001, 2024-04-26T10:22:06.505 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.505 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.505 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.505 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.505 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.505 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 70544 2024-04-26T10:22:06.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.505 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616758+0000", 2024-04-26T10:22:06.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616758+0000", 2024-04-26T10:22:06.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616757+0000", 2024-04-26T10:22:06.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:06.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616825+0000", 2024-04-26T10:22:06.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8444999999999999e-05 2024-04-26T10:22:06.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616844+0000", 2024-04-26T10:22:06.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9216e-05 2024-04-26T10:22:06.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616853+0000", 2024-04-26T10:22:06.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8689999999999993e-06 2024-04-26T10:22:06.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.619576+0000", 2024-04-26T10:22:06.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0027225940000000001 2024-04-26T10:22:06.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.619751+0000", 2024-04-26T10:22:06.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017471899999999999 2024-04-26T10:22:06.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:06.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.619932+0000", 2024-04-26T10:22:06.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000180846 2024-04-26T10:22:06.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:06.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.627546+0000", 2024-04-26T10:22:06.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007614025 2024-04-26T10:22:06.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:06.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.636898+0000", 2024-04-26T10:22:06.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093526010000000003 2024-04-26T10:22:06.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.636946+0000", 2024-04-26T10:22:06.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7509000000000002e-05 2024-04-26T10:22:06.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.637012+0000", 2024-04-26T10:22:06.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6778000000000003e-05 2024-04-26T10:22:06.510 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.510 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.510 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.510 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:72574 5.8 5:15048263:::benchmark_data_smithi052_19421_object72573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:06.510 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:05.571056+0000", 2024-04-26T10:22:06.510 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.84842692799999997, 2024-04-26T10:22:06.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021366202000000001, 2024-04-26T10:22:06.511 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.511 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.511 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.511 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.511 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.511 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 72574 2024-04-26T10:22:06.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.511 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.571056+0000", 2024-04-26T10:22:06.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.571056+0000", 2024-04-26T10:22:06.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.571054+0000", 2024-04-26T10:22:06.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:06.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.571094+0000", 2024-04-26T10:22:06.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9740000000000002e-05 2024-04-26T10:22:06.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.571102+0000", 2024-04-26T10:22:06.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2260000000000005e-06 2024-04-26T10:22:06.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.571106+0000", 2024-04-26T10:22:06.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7469999999999999e-06 2024-04-26T10:22:06.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.580931+0000", 2024-04-26T10:22:06.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098249259999999995 2024-04-26T10:22:06.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.581075+0000", 2024-04-26T10:22:06.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014354099999999999 2024-04-26T10:22:06.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:06.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.592314+0000", 2024-04-26T10:22:06.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011239891 2024-04-26T10:22:06.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.592357+0000", 2024-04-26T10:22:06.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3034999999999997e-05 2024-04-26T10:22:06.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.592423+0000", 2024-04-26T10:22:06.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5176000000000001e-05 2024-04-26T10:22:06.515 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.515 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.515 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.515 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:72679 5.4 5:26d5239b:::benchmark_data_smithi052_19421_object72678:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:06.516 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:05.627497+0000", 2024-04-26T10:22:06.516 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.79198669799999999, 2024-04-26T10:22:06.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023380204000000002, 2024-04-26T10:22:06.516 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.516 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.516 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.516 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.516 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.516 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 72679 2024-04-26T10:22:06.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.516 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.627497+0000", 2024-04-26T10:22:06.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.627497+0000", 2024-04-26T10:22:06.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.627496+0000", 2024-04-26T10:22:06.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:06.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.627558+0000", 2024-04-26T10:22:06.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2657000000000007e-05 2024-04-26T10:22:06.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.627567+0000", 2024-04-26T10:22:06.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1640000000000001e-06 2024-04-26T10:22:06.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.627573+0000", 2024-04-26T10:22:06.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:22:06.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.632376+0000", 2024-04-26T10:22:06.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00480299 2024-04-26T10:22:06.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.632456+0000", 2024-04-26T10:22:06.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9691999999999995e-05 2024-04-26T10:22:06.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:06.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.632538+0000", 2024-04-26T10:22:06.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2596999999999995e-05 2024-04-26T10:22:06.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:06.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.637567+0000", 2024-04-26T10:22:06.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005029174 2024-04-26T10:22:06.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:06.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.650761+0000", 2024-04-26T10:22:06.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013193408 2024-04-26T10:22:06.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.650806+0000", 2024-04-26T10:22:06.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5702999999999999e-05 2024-04-26T10:22:06.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.650877+0000", 2024-04-26T10:22:06.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0463999999999995e-05 2024-04-26T10:22:06.521 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.521 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.521 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.521 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:74231 5.8 5:12982bc8:::benchmark_data_smithi052_19421_object74230:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:06.521 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:06.385415+0000", 2024-04-26T10:22:06.521 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.034068163999999998, 2024-04-26T10:22:06.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.019966806, 2024-04-26T10:22:06.522 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:06.522 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:06.522 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:06.522 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:06.522 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.522 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 74231 2024-04-26T10:22:06.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.522 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:06.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:06.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.385415+0000", 2024-04-26T10:22:06.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:06.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.385415+0000", 2024-04-26T10:22:06.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:06.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:06.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.385414+0000", 2024-04-26T10:22:06.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:06.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:06.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.385462+0000", 2024-04-26T10:22:06.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8018e-05 2024-04-26T10:22:06.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:06.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.385473+0000", 2024-04-26T10:22:06.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1347e-05 2024-04-26T10:22:06.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.385480+0000", 2024-04-26T10:22:06.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8210000000000004e-06 2024-04-26T10:22:06.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:06.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.388965+0000", 2024-04-26T10:22:06.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003485049 2024-04-26T10:22:06.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:06.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.389142+0000", 2024-04-26T10:22:06.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000176532 2024-04-26T10:22:06.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:06.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.405312+0000", 2024-04-26T10:22:06.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.016170436999999999 2024-04-26T10:22:06.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:06.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.405340+0000", 2024-04-26T10:22:06.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7903999999999999e-05 2024-04-26T10:22:06.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:06.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:06.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:06.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:06.405382+0000", 2024-04-26T10:22:06.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2150000000000001e-05 2024-04-26T10:22:06.526 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.526 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.526 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.526 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:06.526 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:06.526 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:06.527 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:22:06.528 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:06.525+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:06.529 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:06.616 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 33 16 74721 74705 141.47 128.875 0.00610632 0.00706263 2024-04-26T10:22:06.629 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:06.625+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:06.666 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:06.666 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:06.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.666 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:74826 5.f 5:f2670c94:::benchmark_data_smithi052_19421_object74825:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:06.666 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:06.661453+0000", 2024-04-26T10:22:06.666 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003319911, 2024-04-26T10:22:06.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033468550000000001, 2024-04-26T10:22:06.667 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:06.667 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:06.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:06.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:06.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.667 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74826 2024-04-26T10:22:06.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.667 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:06.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:06.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.661453+0000", 2024-04-26T10:22:06.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:06.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:06.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.661453+0000", 2024-04-26T10:22:06.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:06.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:06.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.661452+0000", 2024-04-26T10:22:06.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:06.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:06.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.661509+0000", 2024-04-26T10:22:06.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7290999999999997e-05 2024-04-26T10:22:06.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:06.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.661530+0000", 2024-04-26T10:22:06.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1274999999999999e-05 2024-04-26T10:22:06.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.661536+0000", 2024-04-26T10:22:06.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7679999999999997e-06 2024-04-26T10:22:06.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:06.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.662542+0000", 2024-04-26T10:22:06.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001005553 2024-04-26T10:22:06.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:06.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.662628+0000", 2024-04-26T10:22:06.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5803000000000005e-05 2024-04-26T10:22:06.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:06.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.662704+0000", 2024-04-26T10:22:06.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6134e-05 2024-04-26T10:22:06.670 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:06.670 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:06.670 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:06.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.671 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:74827 5.9 5:9e22249f:::benchmark_data_smithi052_19421_object74826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:06.671 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:06.661555+0000", 2024-04-26T10:22:06.671 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032179660000000001, 2024-04-26T10:22:06.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003328976, 2024-04-26T10:22:06.671 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:06.671 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:06.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:06.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:06.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.671 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74827 2024-04-26T10:22:06.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.672 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:06.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:06.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.661555+0000", 2024-04-26T10:22:06.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:06.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:06.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.661555+0000", 2024-04-26T10:22:06.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:06.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:06.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.661554+0000", 2024-04-26T10:22:06.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:06.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:06.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.661588+0000", 2024-04-26T10:22:06.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3470999999999999e-05 2024-04-26T10:22:06.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:06.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.661596+0000", 2024-04-26T10:22:06.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1620000000000008e-06 2024-04-26T10:22:06.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.661600+0000", 2024-04-26T10:22:06.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6950000000000002e-06 2024-04-26T10:22:06.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:06.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.661646+0000", 2024-04-26T10:22:06.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6007999999999997e-05 2024-04-26T10:22:06.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:06.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.661799+0000", 2024-04-26T10:22:06.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015322299999999999 2024-04-26T10:22:06.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:06.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.661974+0000", 2024-04-26T10:22:06.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017536 2024-04-26T10:22:06.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:06.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.664584+0000", 2024-04-26T10:22:06.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026097569999999999 2024-04-26T10:22:06.675 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:06.675 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:06.675 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:06.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.675 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:74830 5.6 5:6819c68f:::benchmark_data_smithi052_19421_object74829:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:06.676 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:06.662756+0000", 2024-04-26T10:22:06.676 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0020169369999999999, 2024-04-26T10:22:06.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021748729999999999, 2024-04-26T10:22:06.676 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:06.676 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:06.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:06.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:06.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.676 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74830 2024-04-26T10:22:06.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.676 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:06.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:06.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.662756+0000", 2024-04-26T10:22:06.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:06.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:06.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.662756+0000", 2024-04-26T10:22:06.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:06.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:06.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.662755+0000", 2024-04-26T10:22:06.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:06.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:06.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.662852+0000", 2024-04-26T10:22:06.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6521000000000006e-05 2024-04-26T10:22:06.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:06.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.662866+0000", 2024-04-26T10:22:06.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3859000000000001e-05 2024-04-26T10:22:06.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.662876+0000", 2024-04-26T10:22:06.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0875e-05 2024-04-26T10:22:06.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:06.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.662934+0000", 2024-04-26T10:22:06.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7667999999999997e-05 2024-04-26T10:22:06.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:06.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.663110+0000", 2024-04-26T10:22:06.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017538499999999999 2024-04-26T10:22:06.679 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:06.679 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:06.679 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:06.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.680 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:74831 5.6 5.65f30476 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:06.680 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:06.664117+0000", 2024-04-26T10:22:06.680 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00065566400000000003, 2024-04-26T10:22:06.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00084745800000000004, 2024-04-26T10:22:06.680 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:06.680 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:06.680 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:06.680 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:06.680 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.680 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74831 2024-04-26T10:22:06.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.680 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:06.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:06.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.664117+0000", 2024-04-26T10:22:06.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:06.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:06.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.664117+0000", 2024-04-26T10:22:06.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:06.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:06.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.664116+0000", 2024-04-26T10:22:06.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:06.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:06.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.664194+0000", 2024-04-26T10:22:06.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7579999999999999e-05 2024-04-26T10:22:06.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:06.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.664207+0000", 2024-04-26T10:22:06.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3200000000000001e-05 2024-04-26T10:22:06.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.664217+0000", 2024-04-26T10:22:06.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0305999999999999e-05 2024-04-26T10:22:06.683 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:06.683 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:06.683 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:06.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.683 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:74834 5.f 5:fe2c0991:::benchmark_data_smithi052_19421_object74833:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:06.683 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:06.664744+0000", 2024-04-26T10:22:06.684 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8977999999999999e-05, 2024-04-26T10:22:06.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025075199999999997, 2024-04-26T10:22:06.684 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:06.684 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-04-26T10:22:06.684 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:06.684 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:06.684 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.685 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74834 2024-04-26T10:22:06.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.685 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:06.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:06.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.664744+0000", 2024-04-26T10:22:06.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:06.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:06.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.664744+0000", 2024-04-26T10:22:06.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:06.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:06.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.664743+0000", 2024-04-26T10:22:06.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:06.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:06.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.664833+0000", 2024-04-26T10:22:06.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9702000000000003e-05 2024-04-26T10:22:06.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:06.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.664846+0000", 2024-04-26T10:22:06.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3387000000000001e-05 2024-04-26T10:22:06.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.664855+0000", 2024-04-26T10:22:06.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2330000000000006e-06 2024-04-26T10:22:06.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:06.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.664929+0000", 2024-04-26T10:22:06.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4181e-05 2024-04-26T10:22:06.688 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:06.688 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:06.688 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:06.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.688 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:74821 5.f 5:fd8a5b3e:::benchmark_data_smithi052_19421_object74820:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:06.688 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:06.658159+0000", 2024-04-26T10:22:06.688 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0066135910000000003, 2024-04-26T10:22:06.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068684849999999997, 2024-04-26T10:22:06.688 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:06.688 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:06.688 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:06.689 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:06.689 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:06.689 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 74821 2024-04-26T10:22:06.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.689 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:06.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:06.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.658159+0000", 2024-04-26T10:22:06.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:06.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:06.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.658159+0000", 2024-04-26T10:22:06.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:06.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:06.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.658159+0000", 2024-04-26T10:22:06.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:06.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:06.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.658191+0000", 2024-04-26T10:22:06.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.188e-05 2024-04-26T10:22:06.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:06.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.658203+0000", 2024-04-26T10:22:06.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2556e-05 2024-04-26T10:22:06.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:06.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.658209+0000", 2024-04-26T10:22:06.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6969999999999998e-06 2024-04-26T10:22:06.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:06.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.658258+0000", 2024-04-26T10:22:06.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9360999999999997e-05 2024-04-26T10:22:06.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:06.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.660450+0000", 2024-04-26T10:22:06.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021912239999999999 2024-04-26T10:22:06.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:06.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.660603+0000", 2024-04-26T10:22:06.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015307299999999999 2024-04-26T10:22:06.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:06.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:06.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:06.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:06.664516+0000", 2024-04-26T10:22:06.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039132919999999996 2024-04-26T10:22:06.693 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:06.693 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:06.693 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:06.693 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:06.693 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:06.693 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 6 2024-04-26T10:22:06.693 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:06.694 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:06.695 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:06.704 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:06.704 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:06.704 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:06.705 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:06.709 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:06.709 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:06.725 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T10:22:06.732 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:06.729+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:06.827 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:06.828 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:06.832 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:06.829+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:06.840 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:06.932 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:06.928+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:07.014 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:07.014 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:07.027 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:07.033 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:07.029+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:07.133 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:07.129+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:07.152 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:07.152 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:07.164 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:07.234 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:07.233+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:07.290 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:07.290 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:07.302 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:07.336 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:07.333+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:07.433 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:07.434 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:07.437 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:07.432+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:07.446 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:07.537 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:07.533+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:07.584 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:07.584 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:07.597 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:07.616 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 34 16 76787 76771 141.107 129.125 0.00601156 0.00708132 2024-04-26T10:22:07.639 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:07.637+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:07.717 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-26T10:22:07.717 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:22:07.717 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-26T10:22:07.717 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 1.000000 2024-04-26T10:22:07.717 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-26T10:22:07.723 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:07.724 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:07.737 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:07.778 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:07.777+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:07.840 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:07.836+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:07.909 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:07.909 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:07.920 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:07.963 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:07.960+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:08.042 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:08.037+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:08.056 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:08.056 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:08.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:08.143 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:08.141+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:08.202 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:08.202 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:08.216 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:08.244 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:08.240+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:08.345 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:08.341+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:08.349 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:08.349 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:08.363 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:08.445 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:08.441+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:08.498 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:08.499 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:08.511 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:08.546 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:08.544+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:08.616 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 35 16 78880 78864 140.812 130.812 0.00396244 0.00709589 2024-04-26T10:22:08.643 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:08.643 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:08.647 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:08.644+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:08.657 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:08.710 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:22:08.732 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-26T10:22:08.738 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:22:08.748 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:08.745+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:08.792 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:08.792 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:08.805 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:08.848 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:08.845+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:08.877 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:08.902 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:08.903 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:08.903 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:08.903 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:08.907 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:08.908 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:08.937 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:79534 5.0 5.ed2675e0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:08.937 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:08.935020+0000", 2024-04-26T10:22:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00167398, 2024-04-26T10:22:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016954870000000001, 2024-04-26T10:22:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 79534 2024-04-26T10:22:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935020+0000", 2024-04-26T10:22:08.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935020+0000", 2024-04-26T10:22:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935019+0000", 2024-04-26T10:22:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:08.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935094+0000", 2024-04-26T10:22:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5514999999999998e-05 2024-04-26T10:22:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935102+0000", 2024-04-26T10:22:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.763e-06 2024-04-26T10:22:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935107+0000", 2024-04-26T10:22:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5659999999999997e-06 2024-04-26T10:22:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:79535 5.4 5:252993c9:::benchmark_data_smithi052_19421_object79534:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:08.935411+0000", 2024-04-26T10:22:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.001282371, 2024-04-26T10:22:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0013484090000000001, 2024-04-26T10:22:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 79535 2024-04-26T10:22:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:08.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935411+0000", 2024-04-26T10:22:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935411+0000", 2024-04-26T10:22:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935410+0000", 2024-04-26T10:22:08.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935514+0000", 2024-04-26T10:22:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010335700000000001 2024-04-26T10:22:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935526+0000", 2024-04-26T10:22:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2716e-05 2024-04-26T10:22:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:08.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935534+0000", 2024-04-26T10:22:08.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6369999999999999e-06 2024-04-26T10:22:08.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:08.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935593+0000", 2024-04-26T10:22:08.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8693000000000002e-05 2024-04-26T10:22:08.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:08.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935799+0000", 2024-04-26T10:22:08.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020591300000000001 2024-04-26T10:22:08.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:08.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.936137+0000", 2024-04-26T10:22:08.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00033827 2024-04-26T10:22:08.945 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.945 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:08.945 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.945 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:79533 5.f e40/37 5:f05927e7:::benchmark_data_smithi052_19421_object79532:head v 40'5006, mlcod=40'5003)", 2024-04-26T10:22:08.945 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:08.935573+0000", 2024-04-26T10:22:08.945 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0011205810000000001, 2024-04-26T10:22:08.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0012243969999999999, 2024-04-26T10:22:08.945 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:08.945 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:08.945 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:08.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:08.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935573+0000", 2024-04-26T10:22:08.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:08.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935573+0000", 2024-04-26T10:22:08.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:08.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935573+0000", 2024-04-26T10:22:08.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:08.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:08.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935635+0000", 2024-04-26T10:22:08.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2776999999999999e-05 2024-04-26T10:22:08.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:08.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935645+0000", 2024-04-26T10:22:08.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7839999999999998e-06 2024-04-26T10:22:08.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:08.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935651+0000", 2024-04-26T10:22:08.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0599999999999996e-06 2024-04-26T10:22:08.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:08.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935710+0000", 2024-04-26T10:22:08.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9154000000000003e-05 2024-04-26T10:22:08.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:08.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935744+0000", 2024-04-26T10:22:08.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3297000000000003e-05 2024-04-26T10:22:08.948 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.948 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:08.948 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.949 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:79508 5.8 5:16d2ec77:::benchmark_data_smithi052_19421_object79507:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:08.949 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:08.923283+0000", 2024-04-26T10:22:08.949 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.013410907999999999, 2024-04-26T10:22:08.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013549782, 2024-04-26T10:22:08.949 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:08.949 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:08.949 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:08.949 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:08.949 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:08.949 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 79508 2024-04-26T10:22:08.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.949 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:08.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:08.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.923283+0000", 2024-04-26T10:22:08.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:08.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.923283+0000", 2024-04-26T10:22:08.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:08.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.923282+0000", 2024-04-26T10:22:08.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:08.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:08.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.923367+0000", 2024-04-26T10:22:08.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4771999999999994e-05 2024-04-26T10:22:08.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:08.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.923377+0000", 2024-04-26T10:22:08.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0464e-05 2024-04-26T10:22:08.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:08.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.923385+0000", 2024-04-26T10:22:08.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9149999999999996e-06 2024-04-26T10:22:08.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:08.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.923441+0000", 2024-04-26T10:22:08.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5578999999999998e-05 2024-04-26T10:22:08.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:08.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.923613+0000", 2024-04-26T10:22:08.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017239999999999999 2024-04-26T10:22:08.952 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.952 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:08.952 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.952 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:79512 5.0 5:00a52dc9:::benchmark_data_smithi052_19421_object79511:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:08.952 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:08.926024+0000", 2024-04-26T10:22:08.953 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.010670232999999999, 2024-04-26T10:22:08.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010845495, 2024-04-26T10:22:08.953 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:08.953 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:08.953 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:08.953 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:08.953 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:08.953 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 79512 2024-04-26T10:22:08.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.953 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:08.953 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.953 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:08.953 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.926024+0000", 2024-04-26T10:22:08.953 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.953 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:08.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.926024+0000", 2024-04-26T10:22:08.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:08.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.926023+0000", 2024-04-26T10:22:08.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:08.954 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.954 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.954 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:08.954 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.926076+0000", 2024-04-26T10:22:08.954 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2800999999999998e-05 2024-04-26T10:22:08.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:08.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.926086+0000", 2024-04-26T10:22:08.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0008e-05 2024-04-26T10:22:08.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:08.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.926093+0000", 2024-04-26T10:22:08.955 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.447e-06 2024-04-26T10:22:08.955 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.955 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.955 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:08.955 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.927271+0000", 2024-04-26T10:22:08.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00117797 2024-04-26T10:22:08.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:08.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.927369+0000", 2024-04-26T10:22:08.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7971000000000001e-05 2024-04-26T10:22:08.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:08.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.927470+0000", 2024-04-26T10:22:08.956 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100853 2024-04-26T10:22:08.956 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.956 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.956 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:08.956 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935168+0000", 2024-04-26T10:22:08.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076976700000000002 2024-04-26T10:22:08.957 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.957 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:08.957 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.957 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.957 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.957 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:79514 5.0 5:07077259:::benchmark_data_smithi052_19421_object79513:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:08.957 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:08.926100+0000", 2024-04-26T10:22:08.957 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.010593353, 2024-04-26T10:22:08.957 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010808989999999999, 2024-04-26T10:22:08.957 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:08.957 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:08.957 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:08.957 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:08.958 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:08.958 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 79514 2024-04-26T10:22:08.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.958 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:08.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:08.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.926100+0000", 2024-04-26T10:22:08.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.958 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.958 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.958 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:08.958 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.926100+0000", 2024-04-26T10:22:08.958 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:08.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.926100+0000", 2024-04-26T10:22:08.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:08.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:08.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.926148+0000", 2024-04-26T10:22:08.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7911999999999998e-05 2024-04-26T10:22:08.959 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.959 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.959 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:08.959 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.926156+0000", 2024-04-26T10:22:08.959 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.354e-06 2024-04-26T10:22:08.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:08.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.926163+0000", 2024-04-26T10:22:08.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9059999999999996e-06 2024-04-26T10:22:08.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:08.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.929677+0000", 2024-04-26T10:22:08.960 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003514442 2024-04-26T10:22:08.960 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.960 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.960 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:08.960 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.929906+0000", 2024-04-26T10:22:08.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022901900000000001 2024-04-26T10:22:08.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:08.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.930062+0000", 2024-04-26T10:22:08.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000155305 2024-04-26T10:22:08.961 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.961 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.961 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:08.961 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935282+0000", 2024-04-26T10:22:08.961 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052206960000000004 2024-04-26T10:22:08.961 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.961 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:08.961 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.962 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.962 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:79515 5.0 5:08d01225:::benchmark_data_smithi052_19421_object79514:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:08.962 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:08.926170+0000", 2024-04-26T10:22:08.962 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.010524198, 2024-04-26T10:22:08.962 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010780235000000001, 2024-04-26T10:22:08.962 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:08.962 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:08.962 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:08.962 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:08.962 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:08.962 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 79515 2024-04-26T10:22:08.962 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.962 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:08.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:08.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.926170+0000", 2024-04-26T10:22:08.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:08.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.926170+0000", 2024-04-26T10:22:08.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.963 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:08.963 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.926169+0000", 2024-04-26T10:22:08.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:08.963 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:08.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.926207+0000", 2024-04-26T10:22:08.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8275999999999997e-05 2024-04-26T10:22:08.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:08.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.926215+0000", 2024-04-26T10:22:08.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9109999999999993e-06 2024-04-26T10:22:08.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:08.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.926221+0000", 2024-04-26T10:22:08.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7640000000000002e-06 2024-04-26T10:22:08.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:08.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932547+0000", 2024-04-26T10:22:08.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0063259759999999996 2024-04-26T10:22:08.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:08.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932690+0000", 2024-04-26T10:22:08.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014265600000000001 2024-04-26T10:22:08.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:08.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932850+0000", 2024-04-26T10:22:08.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016056100000000001 2024-04-26T10:22:08.966 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.966 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:08.966 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.966 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:79520 5.8 5:1f480c6b:::benchmark_data_smithi052_19421_object79519:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:08.966 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:08.928585+0000", 2024-04-26T10:22:08.966 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0081090050000000007, 2024-04-26T10:22:08.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084091340000000004, 2024-04-26T10:22:08.966 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:08.966 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:08.966 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:08.966 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:08.966 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:08.967 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 79520 2024-04-26T10:22:08.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.967 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:08.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:08.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.928585+0000", 2024-04-26T10:22:08.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:08.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.928585+0000", 2024-04-26T10:22:08.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:08.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.928584+0000", 2024-04-26T10:22:08.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:08.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:08.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.928681+0000", 2024-04-26T10:22:08.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6285000000000004e-05 2024-04-26T10:22:08.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:08.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.928688+0000", 2024-04-26T10:22:08.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1450000000000002e-06 2024-04-26T10:22:08.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:08.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.928693+0000", 2024-04-26T10:22:08.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7230000000000001e-06 2024-04-26T10:22:08.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:08.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935200+0000", 2024-04-26T10:22:08.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0065068419999999997 2024-04-26T10:22:08.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:08.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935346+0000", 2024-04-26T10:22:08.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014564600000000001 2024-04-26T10:22:08.969 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.969 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:08.970 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.970 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:79524 5.8 5.ee4abc48 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:08.970 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:08.929540+0000", 2024-04-26T10:22:08.970 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0071540370000000002, 2024-04-26T10:22:08.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075026379999999998, 2024-04-26T10:22:08.970 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:08.970 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:08.970 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:08.970 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:08.970 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:08.970 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 79524 2024-04-26T10:22:08.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.971 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:08.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:08.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.929540+0000", 2024-04-26T10:22:08.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:08.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.929540+0000", 2024-04-26T10:22:08.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:08.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.929539+0000", 2024-04-26T10:22:08.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:08.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:08.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.929590+0000", 2024-04-26T10:22:08.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1319000000000001e-05 2024-04-26T10:22:08.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:08.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.929603+0000", 2024-04-26T10:22:08.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2813000000000001e-05 2024-04-26T10:22:08.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:08.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.929613+0000", 2024-04-26T10:22:08.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0596e-05 2024-04-26T10:22:08.973 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.973 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:08.973 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.973 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDPGPushReply(5.0 40/37 [PushReplyOp(5:02847648:::benchmark_data_smithi052_19421_object34521:head)])", 2024-04-26T10:22:08.973 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:08.931532+0000", 2024-04-26T10:22:08.973 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0051613259999999999, 2024-04-26T10:22:08.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055573410000000004, 2024-04-26T10:22:08.973 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:08.973 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:08.973 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:08.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.931532+0000", 2024-04-26T10:22:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.931532+0000", 2024-04-26T10:22:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.931532+0000", 2024-04-26T10:22:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:08.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.931537+0000", 2024-04-26T10:22:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5509999999999999e-06 2024-04-26T10:22:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.931550+0000", 2024-04-26T10:22:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3013000000000001e-05 2024-04-26T10:22:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.931557+0000", 2024-04-26T10:22:08.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9779999999999999e-06 2024-04-26T10:22:08.976 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.976 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:08.976 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.976 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop_reply(client.4722.0:79514 5.0 e40/37 ondisk, result = 0)", 2024-04-26T10:22:08.976 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:08.932134+0000", 2024-04-26T10:22:08.976 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0045596839999999996, 2024-04-26T10:22:08.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0049785589999999996, 2024-04-26T10:22:08.976 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:08.976 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:08.976 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:08.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:08.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932134+0000", 2024-04-26T10:22:08.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:08.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932134+0000", 2024-04-26T10:22:08.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:08.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932133+0000", 2024-04-26T10:22:08.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:08.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:08.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932138+0000", 2024-04-26T10:22:08.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3449999999999999e-06 2024-04-26T10:22:08.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:08.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932148+0000", 2024-04-26T10:22:08.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8849999999999994e-06 2024-04-26T10:22:08.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:08.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932153+0000", 2024-04-26T10:22:08.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3449999999999996e-06 2024-04-26T10:22:08.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:08.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935262+0000", 2024-04-26T10:22:08.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003109344 2024-04-26T10:22:08.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:08.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935273+0000", 2024-04-26T10:22:08.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0604999999999999e-05 2024-04-26T10:22:08.979 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.979 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:08.979 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.979 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:79526 5.f e40/37 5:fba824b0:::benchmark_data_smithi052_19421_object79525:head v 40'5005, mlcod=40'5002)", 2024-04-26T10:22:08.979 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:08.932393+0000", 2024-04-26T10:22:08.980 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.004300491, 2024-04-26T10:22:08.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047482160000000004, 2024-04-26T10:22:08.980 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:08.980 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:08.980 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:08.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:08.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932393+0000", 2024-04-26T10:22:08.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:08.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932393+0000", 2024-04-26T10:22:08.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:08.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932393+0000", 2024-04-26T10:22:08.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:08.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:08.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932457+0000", 2024-04-26T10:22:08.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3727999999999997e-05 2024-04-26T10:22:08.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:08.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932466+0000", 2024-04-26T10:22:08.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8369999999999992e-06 2024-04-26T10:22:08.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:08.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932473+0000", 2024-04-26T10:22:08.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2750000000000001e-06 2024-04-26T10:22:08.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:08.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932522+0000", 2024-04-26T10:22:08.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9054000000000002e-05 2024-04-26T10:22:08.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:08.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932545+0000", 2024-04-26T10:22:08.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3071e-05 2024-04-26T10:22:08.983 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.983 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:08.983 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.983 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:79531 5.0 5.d651d450 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:08.983 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:08.932342+0000", 2024-04-26T10:22:08.983 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0043523090000000004, 2024-04-26T10:22:08.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048279660000000004, 2024-04-26T10:22:08.983 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:08.983 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:08.983 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:08.983 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:08.983 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:08.984 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 79531 2024-04-26T10:22:08.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.984 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:08.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:08.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932342+0000", 2024-04-26T10:22:08.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:08.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932342+0000", 2024-04-26T10:22:08.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:08.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932341+0000", 2024-04-26T10:22:08.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:08.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:08.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.934712+0000", 2024-04-26T10:22:08.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002371845 2024-04-26T10:22:08.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:08.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.934722+0000", 2024-04-26T10:22:08.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5270000000000004e-06 2024-04-26T10:22:08.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:08.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.934729+0000", 2024-04-26T10:22:08.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3810000000000001e-06 2024-04-26T10:22:08.986 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.986 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:08.986 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.986 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:79530 5.9 e40/37 5:9665e91e:::benchmark_data_smithi052_19421_object79529:head v 40'4984, mlcod=40'4981)", 2024-04-26T10:22:08.986 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:08.934893+0000", 2024-04-26T10:22:08.986 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0018004500000000001, 2024-04-26T10:22:08.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0023025160000000001, 2024-04-26T10:22:08.986 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:08.986 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:08.986 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:08.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:08.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.934893+0000", 2024-04-26T10:22:08.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:08.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.934893+0000", 2024-04-26T10:22:08.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:08.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:08.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.934892+0000", 2024-04-26T10:22:08.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:08.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:08.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.934946+0000", 2024-04-26T10:22:08.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3687999999999998e-05 2024-04-26T10:22:08.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:08.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.934956+0000", 2024-04-26T10:22:08.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9499999999999996e-06 2024-04-26T10:22:08.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:08.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.934962+0000", 2024-04-26T10:22:08.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2899999999999999e-06 2024-04-26T10:22:08.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:08.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935033+0000", 2024-04-26T10:22:08.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0143999999999998e-05 2024-04-26T10:22:08.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:08.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:08.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:08.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.935076+0000", 2024-04-26T10:22:08.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3751000000000002e-05 2024-04-26T10:22:08.989 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.989 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:08.989 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.989 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:08.989 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:08.989 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 14 2024-04-26T10:22:08.989 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:08.991 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:08.991 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:08.989+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:09.091 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:09.089+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:09.121 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:09.121 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:09.121 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:09.121 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:09.121 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:09.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:09.192 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:09.189+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:09.268 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:64610 5.a 5:57daa913:::benchmark_data_smithi052_19421_object64609:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.211728+0000", 2024-04-26T10:22:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.0544665099999992, 2024-04-26T10:22:09.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020479739, 2024-04-26T10:22:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 64610 2024-04-26T10:22:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211728+0000", 2024-04-26T10:22:09.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211728+0000", 2024-04-26T10:22:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211727+0000", 2024-04-26T10:22:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211790+0000", 2024-04-26T10:22:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3325999999999996e-05 2024-04-26T10:22:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211799+0000", 2024-04-26T10:22:09.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2790000000000004e-06 2024-04-26T10:22:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.211808+0000", 2024-04-26T10:22:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0909999999999999e-06 2024-04-26T10:22:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.218692+0000", 2024-04-26T10:22:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0068833729999999999 2024-04-26T10:22:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.218790+0000", 2024-04-26T10:22:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8395999999999998e-05 2024-04-26T10:22:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.232078+0000", 2024-04-26T10:22:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.01328821 2024-04-26T10:22:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.232130+0000", 2024-04-26T10:22:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1715999999999997e-05 2024-04-26T10:22:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.232207+0000", 2024-04-26T10:22:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7379999999999994e-05 2024-04-26T10:22:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.275 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:09.275 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:09.276 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.7355532849999999, 2024-04-26T10:22:09.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:09.276 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:09.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:09.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:09.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:09.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:09.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:09.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.7335710580000008, 2024-04-26T10:22:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.288 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.7333716740000007, 2024-04-26T10:22:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:09.293 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:09.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.7331530540000006, 2024-04-26T10:22:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:09.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.302 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.7307816159999998, 2024-04-26T10:22:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:09.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:09.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.7306809940000001, 2024-04-26T10:22:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:09.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.7305624329999993, 2024-04-26T10:22:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.7304600350000001, 2024-04-26T10:22:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:09.320 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:09.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:09.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:09.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65294 5.e 5:7438ad6f:::benchmark_data_smithi052_19421_object65293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.7297799180000002, 2024-04-26T10:22:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091965517999999996, 2024-04-26T10:22:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:09.325 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65294 2024-04-26T10:22:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536413+0000", 2024-04-26T10:22:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536470+0000", 2024-04-26T10:22:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6443999999999997e-05 2024-04-26T10:22:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536480+0000", 2024-04-26T10:22:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0652999999999999e-05 2024-04-26T10:22:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536488+0000", 2024-04-26T10:22:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7929999999999998e-06 2024-04-26T10:22:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536548+0000", 2024-04-26T10:22:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9556999999999999e-05 2024-04-26T10:22:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536728+0000", 2024-04-26T10:22:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000180958 2024-04-26T10:22:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628168+0000", 2024-04-26T10:22:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091439276999999999 2024-04-26T10:22:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628258+0000", 2024-04-26T10:22:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0158e-05 2024-04-26T10:22:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628380+0000", 2024-04-26T10:22:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012180699999999999 2024-04-26T10:22:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.329 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.7294394779999998, 2024-04-26T10:22:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.330 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:09.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:09.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:09.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.7282892029999992, 2024-04-26T10:22:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:09.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.339 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65292 5.f e34/22 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head v 34'4129, mlcod=34'4125)", 2024-04-26T10:22:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.7281149469999999, 2024-04-26T10:22:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093470155999999999, 2024-04-26T10:22:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538078+0000", 2024-04-26T10:22:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538140+0000", 2024-04-26T10:22:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1970000000000005e-05 2024-04-26T10:22:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538149+0000", 2024-04-26T10:22:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2189999999999993e-06 2024-04-26T10:22:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538158+0000", 2024-04-26T10:22:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0930000000000003e-06 2024-04-26T10:22:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627053+0000", 2024-04-26T10:22:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088895221999999996 2024-04-26T10:22:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627092+0000", 2024-04-26T10:22:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9657000000000003e-05 2024-04-26T10:22:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631499+0000", 2024-04-26T10:22:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044066560000000001 2024-04-26T10:22:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631549+0000", 2024-04-26T10:22:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0259000000000001e-05 2024-04-26T10:22:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.343 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65298 5.b 5:d51c4e52:::benchmark_data_smithi052_19421_object65297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.7273484900000007, 2024-04-26T10:22:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091641671999999993, 2024-04-26T10:22:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65298 2024-04-26T10:22:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538844+0000", 2024-04-26T10:22:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538919+0000", 2024-04-26T10:22:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4626e-05 2024-04-26T10:22:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626007+0000", 2024-04-26T10:22:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087087516000000004 2024-04-26T10:22:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626074+0000", 2024-04-26T10:22:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7077999999999997e-05 2024-04-26T10:22:09.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626150+0000", 2024-04-26T10:22:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5982999999999994e-05 2024-04-26T10:22:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626341+0000", 2024-04-26T10:22:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019141199999999999 2024-04-26T10:22:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630359+0000", 2024-04-26T10:22:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040175710000000002 2024-04-26T10:22:09.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630412+0000", 2024-04-26T10:22:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3779000000000001e-05 2024-04-26T10:22:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630487+0000", 2024-04-26T10:22:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4913999999999995e-05 2024-04-26T10:22:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.348 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:70533 5.0 5:01246de6:::benchmark_data_smithi052_19421_object70532:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.612488+0000", 2024-04-26T10:22:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6537066349999998, 2024-04-26T10:22:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020317557, 2024-04-26T10:22:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 70533 2024-04-26T10:22:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.612488+0000", 2024-04-26T10:22:09.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.612488+0000", 2024-04-26T10:22:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.612486+0000", 2024-04-26T10:22:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.612542+0000", 2024-04-26T10:22:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5414000000000002e-05 2024-04-26T10:22:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.612555+0000", 2024-04-26T10:22:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3174e-05 2024-04-26T10:22:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.612562+0000", 2024-04-26T10:22:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2350000000000002e-06 2024-04-26T10:22:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616664+0000", 2024-04-26T10:22:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041013150000000003 2024-04-26T10:22:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.616879+0000", 2024-04-26T10:22:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000214945 2024-04-26T10:22:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.617134+0000", 2024-04-26T10:22:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025564400000000002 2024-04-26T10:22:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:09.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.622299+0000", 2024-04-26T10:22:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005165289 2024-04-26T10:22:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.632659+0000", 2024-04-26T10:22:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010359515999999999 2024-04-26T10:22:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.632714+0000", 2024-04-26T10:22:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5136999999999997e-05 2024-04-26T10:22:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.632805+0000", 2024-04-26T10:22:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0946999999999995e-05 2024-04-26T10:22:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:70535 5.8 5:1871dc9c:::benchmark_data_smithi052_19421_object70534:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.613036+0000", 2024-04-26T10:22:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6531582670000002, 2024-04-26T10:22:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021812264000000001, 2024-04-26T10:22:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.354 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 70535 2024-04-26T10:22:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613036+0000", 2024-04-26T10:22:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613036+0000", 2024-04-26T10:22:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613035+0000", 2024-04-26T10:22:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613072+0000", 2024-04-26T10:22:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6766e-05 2024-04-26T10:22:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613087+0000", 2024-04-26T10:22:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5349000000000002e-05 2024-04-26T10:22:09.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613094+0000", 2024-04-26T10:22:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8079999999999999e-06 2024-04-26T10:22:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.619353+0000", 2024-04-26T10:22:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0062593839999999998 2024-04-26T10:22:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.619503+0000", 2024-04-26T10:22:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000149715 2024-04-26T10:22:09.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.634715+0000", 2024-04-26T10:22:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015211875 2024-04-26T10:22:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.634765+0000", 2024-04-26T10:22:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0757000000000002e-05 2024-04-26T10:22:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.634848+0000", 2024-04-26T10:22:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2707000000000006e-05 2024-04-26T10:22:09.358 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:72574 5.8 5:15048263:::benchmark_data_smithi052_19421_object72573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:05.571056+0000", 2024-04-26T10:22:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.695137677, 2024-04-26T10:22:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021366202000000001, 2024-04-26T10:22:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 72574 2024-04-26T10:22:09.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.571056+0000", 2024-04-26T10:22:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.571056+0000", 2024-04-26T10:22:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.571054+0000", 2024-04-26T10:22:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.571094+0000", 2024-04-26T10:22:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9740000000000002e-05 2024-04-26T10:22:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.571102+0000", 2024-04-26T10:22:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2260000000000005e-06 2024-04-26T10:22:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.571106+0000", 2024-04-26T10:22:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7469999999999999e-06 2024-04-26T10:22:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.580931+0000", 2024-04-26T10:22:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098249259999999995 2024-04-26T10:22:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.581075+0000", 2024-04-26T10:22:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014354099999999999 2024-04-26T10:22:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.592314+0000", 2024-04-26T10:22:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011239891 2024-04-26T10:22:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.592357+0000", 2024-04-26T10:22:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3034999999999997e-05 2024-04-26T10:22:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.592423+0000", 2024-04-26T10:22:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5176000000000001e-05 2024-04-26T10:22:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.363 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:72679 5.4 5:26d5239b:::benchmark_data_smithi052_19421_object72678:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:05.627497+0000", 2024-04-26T10:22:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.6386974470000002, 2024-04-26T10:22:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023380204000000002, 2024-04-26T10:22:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 72679 2024-04-26T10:22:09.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.627497+0000", 2024-04-26T10:22:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.627497+0000", 2024-04-26T10:22:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.627496+0000", 2024-04-26T10:22:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.627558+0000", 2024-04-26T10:22:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2657000000000007e-05 2024-04-26T10:22:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.627567+0000", 2024-04-26T10:22:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1640000000000001e-06 2024-04-26T10:22:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.627573+0000", 2024-04-26T10:22:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:22:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.632376+0000", 2024-04-26T10:22:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00480299 2024-04-26T10:22:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.632456+0000", 2024-04-26T10:22:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9691999999999995e-05 2024-04-26T10:22:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.632538+0000", 2024-04-26T10:22:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2596999999999995e-05 2024-04-26T10:22:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.637567+0000", 2024-04-26T10:22:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005029174 2024-04-26T10:22:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.650761+0000", 2024-04-26T10:22:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013193408 2024-04-26T10:22:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.650806+0000", 2024-04-26T10:22:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5702999999999999e-05 2024-04-26T10:22:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.650877+0000", 2024-04-26T10:22:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0463999999999995e-05 2024-04-26T10:22:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:79524 5.8 5:123d5277:::benchmark_data_smithi052_19421_object79523:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:08.929540+0000", 2024-04-26T10:22:09.369 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.33665436399999998, 2024-04-26T10:22:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.020800453999999999, 2024-04-26T10:22:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 79524 2024-04-26T10:22:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.929540+0000", 2024-04-26T10:22:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.929540+0000", 2024-04-26T10:22:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.929539+0000", 2024-04-26T10:22:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.929590+0000", 2024-04-26T10:22:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1319000000000001e-05 2024-04-26T10:22:09.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.929603+0000", 2024-04-26T10:22:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2813000000000001e-05 2024-04-26T10:22:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.929613+0000", 2024-04-26T10:22:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0596e-05 2024-04-26T10:22:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.938221+0000", 2024-04-26T10:22:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086078390000000008 2024-04-26T10:22:09.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.938387+0000", 2024-04-26T10:22:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016560199999999999 2024-04-26T10:22:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.950154+0000", 2024-04-26T10:22:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011767578000000001 2024-04-26T10:22:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.950233+0000", 2024-04-26T10:22:09.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8244000000000005e-05 2024-04-26T10:22:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.950340+0000", 2024-04-26T10:22:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000107706 2024-04-26T10:22:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:79531 5.0 5:0a2b8a6b:::benchmark_data_smithi052_19421_object79530:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:08.932342+0000", 2024-04-26T10:22:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.33385263599999998, 2024-04-26T10:22:09.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021100879999999999, 2024-04-26T10:22:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 79531 2024-04-26T10:22:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932342+0000", 2024-04-26T10:22:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932342+0000", 2024-04-26T10:22:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.932341+0000", 2024-04-26T10:22:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.934712+0000", 2024-04-26T10:22:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002371845 2024-04-26T10:22:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.934722+0000", 2024-04-26T10:22:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5270000000000004e-06 2024-04-26T10:22:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.934729+0000", 2024-04-26T10:22:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3810000000000001e-06 2024-04-26T10:22:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.940005+0000", 2024-04-26T10:22:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052754519999999999 2024-04-26T10:22:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.940191+0000", 2024-04-26T10:22:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000186422 2024-04-26T10:22:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.940393+0000", 2024-04-26T10:22:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000201609 2024-04-26T10:22:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.946276+0000", 2024-04-26T10:22:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005882745 2024-04-26T10:22:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.953220+0000", 2024-04-26T10:22:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0069440939999999996 2024-04-26T10:22:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.953289+0000", 2024-04-26T10:22:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9367000000000002e-05 2024-04-26T10:22:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:08.953442+0000", 2024-04-26T10:22:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015335899999999999 2024-04-26T10:22:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.379 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.380 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.380 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:09.380 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:09.380 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:09.381 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:09.376+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:09.381 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:09.482 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:09.476+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:09.516 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:80754 5.3 5:c87c3149:::benchmark_data_smithi052_19421_object80753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:09.509260+0000", 2024-04-26T10:22:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0047985930000000003, 2024-04-26T10:22:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004826767, 2024-04-26T10:22:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.516 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 80754 2024-04-26T10:22:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.509260+0000", 2024-04-26T10:22:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.509260+0000", 2024-04-26T10:22:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.509260+0000", 2024-04-26T10:22:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.509296+0000", 2024-04-26T10:22:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6587000000000001e-05 2024-04-26T10:22:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.509314+0000", 2024-04-26T10:22:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7813999999999999e-05 2024-04-26T10:22:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.509320+0000", 2024-04-26T10:22:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8470000000000001e-06 2024-04-26T10:22:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.510448+0000", 2024-04-26T10:22:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011280579999999999 2024-04-26T10:22:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.510544+0000", 2024-04-26T10:22:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5755999999999996e-05 2024-04-26T10:22:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:80759 5.d 5:bcc3aa86:::benchmark_data_smithi052_19421_object80758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:09.510961+0000", 2024-04-26T10:22:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0030979829999999999, 2024-04-26T10:22:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032023329999999999, 2024-04-26T10:22:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:09.520 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 80759 2024-04-26T10:22:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.510961+0000", 2024-04-26T10:22:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.510961+0000", 2024-04-26T10:22:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.510960+0000", 2024-04-26T10:22:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.511010+0000", 2024-04-26T10:22:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0086000000000001e-05 2024-04-26T10:22:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.511019+0000", 2024-04-26T10:22:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5920000000000001e-06 2024-04-26T10:22:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.511025+0000", 2024-04-26T10:22:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2639999999999997e-06 2024-04-26T10:22:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.511107+0000", 2024-04-26T10:22:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1336999999999997e-05 2024-04-26T10:22:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.511337+0000", 2024-04-26T10:22:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023022299999999999 2024-04-26T10:22:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.511480+0000", 2024-04-26T10:22:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014343299999999999 2024-04-26T10:22:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.525 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:80760 5.3 5:c6af4e13:::benchmark_data_smithi052_19421_object80759:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:09.511195+0000", 2024-04-26T10:22:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002863666, 2024-04-26T10:22:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030444500000000002, 2024-04-26T10:22:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 80760 2024-04-26T10:22:09.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.511195+0000", 2024-04-26T10:22:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.511195+0000", 2024-04-26T10:22:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.511195+0000", 2024-04-26T10:22:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.511232+0000", 2024-04-26T10:22:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7251e-05 2024-04-26T10:22:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.511240+0000", 2024-04-26T10:22:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5099999999999998e-06 2024-04-26T10:22:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.511247+0000", 2024-04-26T10:22:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4370000000000004e-06 2024-04-26T10:22:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.512893+0000", 2024-04-26T10:22:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016465570000000001 2024-04-26T10:22:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.512999+0000", 2024-04-26T10:22:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105884 2024-04-26T10:22:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.529 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:80757 5.b e40/37 5:dad81bb0:::benchmark_data_smithi052_19421_object80756:head v 40'4953, mlcod=40'4950)", 2024-04-26T10:22:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:09.513341+0000", 2024-04-26T10:22:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00071794899999999995, 2024-04-26T10:22:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00096409399999999998, 2024-04-26T10:22:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513341+0000", 2024-04-26T10:22:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513341+0000", 2024-04-26T10:22:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513340+0000", 2024-04-26T10:22:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513346+0000", 2024-04-26T10:22:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6869999999999999e-06 2024-04-26T10:22:09.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513355+0000", 2024-04-26T10:22:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7800000000000006e-06 2024-04-26T10:22:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513359+0000", 2024-04-26T10:22:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7450000000000003e-06 2024-04-26T10:22:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513393+0000", 2024-04-26T10:22:09.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3559000000000002e-05 2024-04-26T10:22:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513412+0000", 2024-04-26T10:22:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9375e-05 2024-04-26T10:22:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:80753 5.4 e40/37 5:2ab03959:::benchmark_data_smithi052_19421_object80752:head v 40'5108, mlcod=40'5105)", 2024-04-26T10:22:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:09.513367+0000", 2024-04-26T10:22:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000692137, 2024-04-26T10:22:09.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00099743899999999992, 2024-04-26T10:22:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513367+0000", 2024-04-26T10:22:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513367+0000", 2024-04-26T10:22:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513367+0000", 2024-04-26T10:22:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-04-26T10:22:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513371+0000", 2024-04-26T10:22:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8850000000000001e-06 2024-04-26T10:22:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513376+0000", 2024-04-26T10:22:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5330000000000002e-06 2024-04-26T10:22:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513380+0000", 2024-04-26T10:22:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1629999999999998e-06 2024-04-26T10:22:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513411+0000", 2024-04-26T10:22:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0891e-05 2024-04-26T10:22:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513431+0000", 2024-04-26T10:22:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9449e-05 2024-04-26T10:22:09.536 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:80761 5.1 5:815baa7e:::benchmark_data_smithi052_19421_object80760:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:09.513449+0000", 2024-04-26T10:22:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00061026099999999996, 2024-04-26T10:22:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00097879900000000003, 2024-04-26T10:22:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.537 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 80761 2024-04-26T10:22:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513449+0000", 2024-04-26T10:22:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513449+0000", 2024-04-26T10:22:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513448+0000", 2024-04-26T10:22:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513478+0000", 2024-04-26T10:22:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0812000000000002e-05 2024-04-26T10:22:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513495+0000", 2024-04-26T10:22:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6277e-05 2024-04-26T10:22:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513501+0000", 2024-04-26T10:22:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5769999999999999e-06 2024-04-26T10:22:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513725+0000", 2024-04-26T10:22:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022388400000000001 2024-04-26T10:22:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513858+0000", 2024-04-26T10:22:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013321000000000001 2024-04-26T10:22:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.540 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:80762 5.9 5.6be6219 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:09.513864+0000", 2024-04-26T10:22:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000194981, 2024-04-26T10:22:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00062564499999999998, 2024-04-26T10:22:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 80762 2024-04-26T10:22:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.541 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513864+0000", 2024-04-26T10:22:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513864+0000", 2024-04-26T10:22:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513863+0000", 2024-04-26T10:22:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513974+0000", 2024-04-26T10:22:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011120099999999999 2024-04-26T10:22:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513985+0000", 2024-04-26T10:22:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0565e-05 2024-04-26T10:22:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.513992+0000", 2024-04-26T10:22:09.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9820000000000002e-06 2024-04-26T10:22:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:80763 5.2 5:4aab9559:::benchmark_data_smithi052_19421_object80762:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:09.514000+0000", 2024-04-26T10:22:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.8581e-05, 2024-04-26T10:22:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00055387399999999999, 2024-04-26T10:22:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.544 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 80763 2024-04-26T10:22:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514000+0000", 2024-04-26T10:22:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514000+0000", 2024-04-26T10:22:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514000+0000", 2024-04-26T10:22:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514049+0000", 2024-04-26T10:22:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9224000000000002e-05 2024-04-26T10:22:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514059+0000", 2024-04-26T10:22:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7850000000000003e-06 2024-04-26T10:22:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514065+0000", 2024-04-26T10:22:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7860000000000002e-06 2024-04-26T10:22:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514131+0000", 2024-04-26T10:22:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6801e-05 2024-04-26T10:22:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514293+0000", 2024-04-26T10:22:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161259 2024-04-26T10:22:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.547 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:80766 5.2 5.51942ed2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:09.514091+0000", 2024-04-26T10:22:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999681, 2024-04-26T10:22:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00052590600000000003, 2024-04-26T10:22:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 80766 2024-04-26T10:22:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.548 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514091+0000", 2024-04-26T10:22:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514091+0000", 2024-04-26T10:22:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514090+0000", 2024-04-26T10:22:09.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514184+0000", 2024-04-26T10:22:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3701000000000003e-05 2024-04-26T10:22:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514200+0000", 2024-04-26T10:22:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5461e-05 2024-04-26T10:22:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514205+0000", 2024-04-26T10:22:09.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7429999999999999e-06 2024-04-26T10:22:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:80767 5.f 5:f4c4cbb0:::benchmark_data_smithi052_19421_object80766:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:09.514233+0000", 2024-04-26T10:22:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9998264, 2024-04-26T10:22:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00044358899999999998, 2024-04-26T10:22:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 80767 2024-04-26T10:22:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514233+0000", 2024-04-26T10:22:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514233+0000", 2024-04-26T10:22:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514232+0000", 2024-04-26T10:22:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514271+0000", 2024-04-26T10:22:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9526000000000001e-05 2024-04-26T10:22:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514289+0000", 2024-04-26T10:22:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7677999999999999e-05 2024-04-26T10:22:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514295+0000", 2024-04-26T10:22:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8279999999999999e-06 2024-04-26T10:22:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514367+0000", 2024-04-26T10:22:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1713999999999998e-05 2024-04-26T10:22:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514511+0000", 2024-04-26T10:22:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000143984 2024-04-26T10:22:09.554 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:80768 5.7 5:ec7942ab:::benchmark_data_smithi052_19421_object80767:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:09.514307+0000", 2024-04-26T10:22:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9997516, 2024-04-26T10:22:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000433643, 2024-04-26T10:22:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 80768 2024-04-26T10:22:09.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514307+0000", 2024-04-26T10:22:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514307+0000", 2024-04-26T10:22:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514307+0000", 2024-04-26T10:22:09.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514344+0000", 2024-04-26T10:22:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7675000000000001e-05 2024-04-26T10:22:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514352+0000", 2024-04-26T10:22:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4359999999999996e-06 2024-04-26T10:22:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514357+0000", 2024-04-26T10:22:09.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2660000000000001e-06 2024-04-26T10:22:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514415+0000", 2024-04-26T10:22:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8019000000000001e-05 2024-04-26T10:22:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514523+0000", 2024-04-26T10:22:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010789399999999999 2024-04-26T10:22:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.558 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:80769 5.5 5.6187b735 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-26T10:22:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:09.514363+0000", 2024-04-26T10:22:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9996963, 2024-04-26T10:22:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00043703500000000001, 2024-04-26T10:22:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 80769 2024-04-26T10:22:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514363+0000", 2024-04-26T10:22:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514363+0000", 2024-04-26T10:22:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514362+0000", 2024-04-26T10:22:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514622+0000", 2024-04-26T10:22:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025986800000000001 2024-04-26T10:22:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514636+0000", 2024-04-26T10:22:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3908e-05 2024-04-26T10:22:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:09.514645+0000", 2024-04-26T10:22:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4290000000000007e-06 2024-04-26T10:22:09.561 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:09.562 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 12 2024-04-26T10:22:09.562 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:09.563 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:09.583 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:09.580+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:09.616 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 36 16 80974 80958 140.536 130.875 0.00642723 0.00711026 2024-04-26T10:22:09.684 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:09.680+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:09.701 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:09.701 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:09.701 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:09.701 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:09.701 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:09.715 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:09.742 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T10:22:09.785 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:09.780+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:09.847 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:09.847 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:22:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.604785747999998, 2024-04-26T10:22:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018452342, 2024-04-26T10:22:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:09.848 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115 2024-04-26T10:22:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:22:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239019+0000", 2024-04-26T10:22:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239018+0000", 2024-04-26T10:22:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239152+0000", 2024-04-26T10:22:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013414699999999999 2024-04-26T10:22:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239169+0000", 2024-04-26T10:22:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7013000000000001e-05 2024-04-26T10:22:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239190+0000", 2024-04-26T10:22:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1302999999999999e-05 2024-04-26T10:22:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252181+0000", 2024-04-26T10:22:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012990213 2024-04-26T10:22:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252411+0000", 2024-04-26T10:22:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023010199999999999 2024-04-26T10:22:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.252687+0000", 2024-04-26T10:22:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000276063 2024-04-26T10:22:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254694+0000", 2024-04-26T10:22:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020072879999999999 2024-04-26T10:22:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257399+0000", 2024-04-26T10:22:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027051670000000001 2024-04-26T10:22:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257442+0000", 2024-04-26T10:22:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2966000000000002e-05 2024-04-26T10:22:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257471+0000", 2024-04-26T10:22:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.889e-05 2024-04-26T10:22:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:09.853 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:22:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.604605219000007, 2024-04-26T10:22:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018350615000000001, 2024-04-26T10:22:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 116 2024-04-26T10:22:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:22:09.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239199+0000", 2024-04-26T10:22:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239198+0000", 2024-04-26T10:22:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239213+0000", 2024-04-26T10:22:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4965e-05 2024-04-26T10:22:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239235+0000", 2024-04-26T10:22:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.156e-05 2024-04-26T10:22:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239243+0000", 2024-04-26T10:22:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9470000000000003e-06 2024-04-26T10:22:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253284+0000", 2024-04-26T10:22:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014041392999999999 2024-04-26T10:22:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253376+0000", 2024-04-26T10:22:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1198000000000003e-05 2024-04-26T10:22:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.253508+0000", 2024-04-26T10:22:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013220199999999999 2024-04-26T10:22:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:09.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.255474+0000", 2024-04-26T10:22:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019665590000000001 2024-04-26T10:22:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257480+0000", 2024-04-26T10:22:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00200599 2024-04-26T10:22:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257515+0000", 2024-04-26T10:22:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5126000000000002e-05 2024-04-26T10:22:09.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257550+0000", 2024-04-26T10:22:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4394000000000003e-05 2024-04-26T10:22:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:22:09.859 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.604551662999995, 2024-04-26T10:22:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018369330999999999, 2024-04-26T10:22:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117 2024-04-26T10:22:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:22:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239253+0000", 2024-04-26T10:22:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239252+0000", 2024-04-26T10:22:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239267+0000", 2024-04-26T10:22:09.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4562999999999999e-05 2024-04-26T10:22:09.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239281+0000", 2024-04-26T10:22:09.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4e-05 2024-04-26T10:22:09.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.239296+0000", 2024-04-26T10:22:09.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5492999999999999e-05 2024-04-26T10:22:09.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254076+0000", 2024-04-26T10:22:09.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014779814 2024-04-26T10:22:09.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254159+0000", 2024-04-26T10:22:09.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2923999999999994e-05 2024-04-26T10:22:09.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:09.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.254279+0000", 2024-04-26T10:22:09.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011964300000000001 2024-04-26T10:22:09.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:09.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.256043+0000", 2024-04-26T10:22:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001764353 2024-04-26T10:22:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257559+0000", 2024-04-26T10:22:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015159189999999999 2024-04-26T10:22:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257597+0000", 2024-04-26T10:22:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8031999999999998e-05 2024-04-26T10:22:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.257622+0000", 2024-04-26T10:22:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5213999999999999e-05 2024-04-26T10:22:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.193812989999998, 2024-04-26T10:22:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019547338000000001, 2024-04-26T10:22:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.865 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165 2024-04-26T10:22:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649991+0000", 2024-04-26T10:22:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.649996+0000", 2024-04-26T10:22:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5269999999999998e-06 2024-04-26T10:22:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650021+0000", 2024-04-26T10:22:09.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5179999999999999e-05 2024-04-26T10:22:09.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.650030+0000", 2024-04-26T10:22:09.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3459999999999994e-06 2024-04-26T10:22:09.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664733+0000", 2024-04-26T10:22:09.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014703097 2024-04-26T10:22:09.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664821+0000", 2024-04-26T10:22:09.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7918999999999996e-05 2024-04-26T10:22:09.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:09.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.664953+0000", 2024-04-26T10:22:09.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132662 2024-04-26T10:22:09.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:09.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.666776+0000", 2024-04-26T10:22:09.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018225509999999999 2024-04-26T10:22:09.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669480+0000", 2024-04-26T10:22:09.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00270382 2024-04-26T10:22:09.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669515+0000", 2024-04-26T10:22:09.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4885000000000002e-05 2024-04-26T10:22:09.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.669539+0000", 2024-04-26T10:22:09.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4121000000000002e-05 2024-04-26T10:22:09.870 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.870 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.870 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.871 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:186 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:09.871 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:22:09.871 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.00416353, 2024-04-26T10:22:09.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.018757273000000001, 2024-04-26T10:22:09.871 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.871 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:09.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:09.871 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 186 2024-04-26T10:22:09.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.871 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:22:09.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839641+0000", 2024-04-26T10:22:09.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839640+0000", 2024-04-26T10:22:09.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839646+0000", 2024-04-26T10:22:09.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:22:09.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839654+0000", 2024-04-26T10:22:09.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:22:09.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839661+0000", 2024-04-26T10:22:09.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.64e-06 2024-04-26T10:22:09.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852328+0000", 2024-04-26T10:22:09.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012667151 2024-04-26T10:22:09.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852538+0000", 2024-04-26T10:22:09.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020961100000000001 2024-04-26T10:22:09.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:09.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.852945+0000", 2024-04-26T10:22:09.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00040712099999999998 2024-04-26T10:22:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857372+0000", 2024-04-26T10:22:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044268049999999998 2024-04-26T10:22:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858321+0000", 2024-04-26T10:22:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094932999999999997 2024-04-26T10:22:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858367+0000", 2024-04-26T10:22:09.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5534000000000001e-05 2024-04-26T10:22:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.858398+0000", 2024-04-26T10:22:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1562e-05 2024-04-26T10:22:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:187 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:22:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.004136364000004, 2024-04-26T10:22:09.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019669504000000001, 2024-04-26T10:22:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 187 2024-04-26T10:22:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:22:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839668+0000", 2024-04-26T10:22:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839667+0000", 2024-04-26T10:22:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839677+0000", 2024-04-26T10:22:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3270000000000007e-06 2024-04-26T10:22:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839685+0000", 2024-04-26T10:22:09.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2670000000000006e-06 2024-04-26T10:22:09.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839692+0000", 2024-04-26T10:22:09.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7129999999999999e-06 2024-04-26T10:22:09.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853685+0000", 2024-04-26T10:22:09.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013993716999999999 2024-04-26T10:22:09.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853876+0000", 2024-04-26T10:22:09.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019097100000000001 2024-04-26T10:22:09.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:09.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.853989+0000", 2024-04-26T10:22:09.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011275199999999999 2024-04-26T10:22:09.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857377+0000", 2024-04-26T10:22:09.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033882489999999999 2024-04-26T10:22:09.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:09.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859222+0000", 2024-04-26T10:22:09.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001844233 2024-04-26T10:22:09.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859291+0000", 2024-04-26T10:22:09.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9575999999999999e-05 2024-04-26T10:22:09.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859338+0000", 2024-04-26T10:22:09.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6366000000000003e-05 2024-04-26T10:22:09.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.882 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.882 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.882 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:09.882 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:22:09.882 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.004105498000001, 2024-04-26T10:22:09.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019837468, 2024-04-26T10:22:09.882 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.882 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.882 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.882 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:09.882 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:09.882 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 188 2024-04-26T10:22:09.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.883 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:22:09.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839699+0000", 2024-04-26T10:22:09.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839698+0000", 2024-04-26T10:22:09.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:09.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839829+0000", 2024-04-26T10:22:09.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013061099999999999 2024-04-26T10:22:09.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839853+0000", 2024-04-26T10:22:09.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3736000000000001e-05 2024-04-26T10:22:09.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839863+0000", 2024-04-26T10:22:09.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:22:09.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854869+0000", 2024-04-26T10:22:09.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015005978 2024-04-26T10:22:09.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.854959+0000", 2024-04-26T10:22:09.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9468999999999993e-05 2024-04-26T10:22:09.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:09.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855114+0000", 2024-04-26T10:22:09.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015563799999999999 2024-04-26T10:22:09.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857386+0000", 2024-04-26T10:22:09.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002271852 2024-04-26T10:22:09.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:09.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859406+0000", 2024-04-26T10:22:09.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002019936 2024-04-26T10:22:09.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859461+0000", 2024-04-26T10:22:09.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4826e-05 2024-04-26T10:22:09.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859536+0000", 2024-04-26T10:22:09.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5566000000000001e-05 2024-04-26T10:22:09.887 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.887 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.887 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.887 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4176.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-26T10:22:09.887 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:22:09.888 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 67.003931635000001, 2024-04-26T10:22:09.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019826496999999998, 2024-04-26T10:22:09.888 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.888 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.888 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.888 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4176", 2024-04-26T10:22:09.888 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/161330574", 2024-04-26T10:22:09.888 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 189 2024-04-26T10:22:09.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.888 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:22:09.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839873+0000", 2024-04-26T10:22:09.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839872+0000", 2024-04-26T10:22:09.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839882+0000", 2024-04-26T10:22:09.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0475999999999999e-05 2024-04-26T10:22:09.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839892+0000", 2024-04-26T10:22:09.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.217e-06 2024-04-26T10:22:09.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.839900+0000", 2024-04-26T10:22:09.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5469999999999997e-06 2024-04-26T10:22:09.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.855903+0000", 2024-04-26T10:22:09.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016002590000000001 2024-04-26T10:22:09.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856110+0000", 2024-04-26T10:22:09.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020711199999999999 2024-04-26T10:22:09.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:09.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.856421+0000", 2024-04-26T10:22:09.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031128500000000001 2024-04-26T10:22:09.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.857643+0000", 2024-04-26T10:22:09.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012215520000000001 2024-04-26T10:22:09.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:09.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859603+0000", 2024-04-26T10:22:09.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019600350000000002 2024-04-26T10:22:09.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859660+0000", 2024-04-26T10:22:09.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6857999999999997e-05 2024-04-26T10:22:09.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:02.859699+0000", 2024-04-26T10:22:09.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9641999999999998e-05 2024-04-26T10:22:09.893 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.893 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.893 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.893 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:34427 5.7 5:ef7d83e6:::benchmark_data_smithi052_19421_object34426:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-26T10:22:09.893 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:22:09.893 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.211725976, 2024-04-26T10:22:09.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.02010443, 2024-04-26T10:22:09.893 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.893 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.894 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.894 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 34427 2024-04-26T10:22:09.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.894 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:22:09.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632078+0000", 2024-04-26T10:22:09.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632077+0000", 2024-04-26T10:22:09.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:09.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632139+0000", 2024-04-26T10:22:09.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2527999999999995e-05 2024-04-26T10:22:09.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632153+0000", 2024-04-26T10:22:09.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3608000000000001e-05 2024-04-26T10:22:09.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.632165+0000", 2024-04-26T10:22:09.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2592000000000001e-05 2024-04-26T10:22:09.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635907+0000", 2024-04-26T10:22:09.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037419789999999999 2024-04-26T10:22:09.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:09.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.635919+0000", 2024-04-26T10:22:09.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1511999999999999e-05 2024-04-26T10:22:09.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641616+0000", 2024-04-26T10:22:09.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056974770000000003 2024-04-26T10:22:09.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.641772+0000", 2024-04-26T10:22:09.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155799 2024-04-26T10:22:09.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.651965+0000", 2024-04-26T10:22:09.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010193254000000001 2024-04-26T10:22:09.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652039+0000", 2024-04-26T10:22:09.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4031999999999999e-05 2024-04-26T10:22:09.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:47.652183+0000", 2024-04-26T10:22:09.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014342599999999999 2024-04-26T10:22:09.898 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.898 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.898 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.899 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:45130 5.5 5:a1beca5f:::benchmark_data_smithi052_19421_object45129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-26T10:22:09.899 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:22:09.899 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.158242352999999, 2024-04-26T10:22:09.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019561411000000001, 2024-04-26T10:22:09.899 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.899 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.899 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 45130 2024-04-26T10:22:09.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.899 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:22:09.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685562+0000", 2024-04-26T10:22:09.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685561+0000", 2024-04-26T10:22:09.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685648+0000", 2024-04-26T10:22:09.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6552999999999996e-05 2024-04-26T10:22:09.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685657+0000", 2024-04-26T10:22:09.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1330000000000005e-06 2024-04-26T10:22:09.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.685664+0000", 2024-04-26T10:22:09.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1069999999999999e-06 2024-04-26T10:22:09.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.691613+0000", 2024-04-26T10:22:09.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059489199999999999 2024-04-26T10:22:09.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.691779+0000", 2024-04-26T10:22:09.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016567700000000001 2024-04-26T10:22:09.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705021+0000", 2024-04-26T10:22:09.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013242812 2024-04-26T10:22:09.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705054+0000", 2024-04-26T10:22:09.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2709999999999997e-05 2024-04-26T10:22:09.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:51.705123+0000", 2024-04-26T10:22:09.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9246999999999996e-05 2024-04-26T10:22:09.903 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.903 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.903 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.904 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:49103 5.f 5:f082f091:::benchmark_data_smithi052_19421_object49102:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:22:09.904 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:22:09.904 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.515636485999998, 2024-04-26T10:22:09.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.019587917, 2024-04-26T10:22:09.904 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.904 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.904 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49103 2024-04-26T10:22:09.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.904 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:22:09.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328168+0000", 2024-04-26T10:22:09.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328167+0000", 2024-04-26T10:22:09.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:09.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328207+0000", 2024-04-26T10:22:09.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0275999999999999e-05 2024-04-26T10:22:09.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328220+0000", 2024-04-26T10:22:09.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2968e-05 2024-04-26T10:22:09.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.328233+0000", 2024-04-26T10:22:09.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2203e-05 2024-04-26T10:22:09.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.333946+0000", 2024-04-26T10:22:09.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057135110000000001 2024-04-26T10:22:09.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.335894+0000", 2024-04-26T10:22:09.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019474959999999999 2024-04-26T10:22:09.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:09.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.336030+0000", 2024-04-26T10:22:09.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013601999999999999 2024-04-26T10:22:09.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.340794+0000", 2024-04-26T10:22:09.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047643800000000004 2024-04-26T10:22:09.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:09.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347659+0000", 2024-04-26T10:22:09.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068648800000000003 2024-04-26T10:22:09.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347713+0000", 2024-04-26T10:22:09.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3736000000000002e-05 2024-04-26T10:22:09.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.347756+0000", 2024-04-26T10:22:09.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3155000000000003e-05 2024-04-26T10:22:09.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.909 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.909 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:49261 5.5 5:a449de5e:::benchmark_data_smithi052_19421_object49260:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-26T10:22:09.909 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:22:09.909 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.451632440000001, 2024-04-26T10:22:09.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020598741, 2024-04-26T10:22:09.910 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.910 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.910 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 49261 2024-04-26T10:22:09.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.910 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:22:09.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392172+0000", 2024-04-26T10:22:09.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392171+0000", 2024-04-26T10:22:09.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:09.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392212+0000", 2024-04-26T10:22:09.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0889000000000001e-05 2024-04-26T10:22:09.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392221+0000", 2024-04-26T10:22:09.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1970000000000002e-06 2024-04-26T10:22:09.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.392228+0000", 2024-04-26T10:22:09.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:09.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.397869+0000", 2024-04-26T10:22:09.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056403180000000001 2024-04-26T10:22:09.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.398010+0000", 2024-04-26T10:22:09.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014105300000000001 2024-04-26T10:22:09.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412532+0000", 2024-04-26T10:22:09.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.014522431000000001 2024-04-26T10:22:09.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412692+0000", 2024-04-26T10:22:09.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015970700000000001 2024-04-26T10:22:09.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:21:53.412771+0000", 2024-04-26T10:22:09.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8980000000000006e-05 2024-04-26T10:22:09.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.914 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.914 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:09.914 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:09.914 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.3144581960000004, 2024-04-26T10:22:09.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:09.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.914 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.915 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:09.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.915 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:09.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:09.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:09.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:09.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:09.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:09.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:09.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:09.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:09.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:09.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:09.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:09.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:09.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:09.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:09.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:09.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:09.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:09.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:09.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:09.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:09.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:09.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:09.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:09.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:09.919 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.919 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.920 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.920 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:09.920 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:09.920 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.309922984, 2024-04-26T10:22:09.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:09.920 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.920 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.920 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:09.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.921 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:09.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:09.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:09.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:09.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:09.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:09.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:09.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:09.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:09.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:09.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:09.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:09.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:09.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:09.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:09.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:09.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:09.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:09.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:09.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:09.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:09.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:09.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:09.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:09.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:09.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:09.925 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.925 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.925 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.925 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:09.925 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:09.925 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.3092916920000004, 2024-04-26T10:22:09.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:09.926 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.926 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.926 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.926 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.926 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.926 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:09.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.926 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:09.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:09.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:09.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:09.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:09.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:09.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:09.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:09.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:09.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:09.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:09.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:09.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:09.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:09.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:09.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:09.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:09.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:09.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:09.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:09.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:09.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:09.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:09.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:09.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:09.934 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.934 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.934 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.935 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65604 5.9 5:9c239c32:::benchmark_data_smithi052_19421_object65603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:09.935 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:09.935 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.0741888080000006, 2024-04-26T10:22:09.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025897677000000001, 2024-04-26T10:22:09.935 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.935 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.935 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.935 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.936 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65604 2024-04-26T10:22:09.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.936 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:09.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:09.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769615+0000", 2024-04-26T10:22:09.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:09.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769694+0000", 2024-04-26T10:22:09.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9087999999999999e-05 2024-04-26T10:22:09.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769702+0000", 2024-04-26T10:22:09.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8150000000000006e-06 2024-04-26T10:22:09.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769709+0000", 2024-04-26T10:22:09.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:22:09.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772336+0000", 2024-04-26T10:22:09.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002626836 2024-04-26T10:22:09.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772470+0000", 2024-04-26T10:22:09.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013453299999999999 2024-04-26T10:22:09.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:09.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772605+0000", 2024-04-26T10:22:09.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013428499999999999 2024-04-26T10:22:09.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:09.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779374+0000", 2024-04-26T10:22:09.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067694000000000001 2024-04-26T10:22:09.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795401+0000", 2024-04-26T10:22:09.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016026543000000001 2024-04-26T10:22:09.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795461+0000", 2024-04-26T10:22:09.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9923999999999998e-05 2024-04-26T10:22:09.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795513+0000", 2024-04-26T10:22:09.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2737e-05 2024-04-26T10:22:09.941 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.941 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.941 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.941 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65613 5.1 5:85cc6530:::benchmark_data_smithi052_19421_object65612:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:09.941 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:09.941 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.0718157619999999, 2024-04-26T10:22:09.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023662843999999999, 2024-04-26T10:22:09.941 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.941 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.941 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.941 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.942 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65613 2024-04-26T10:22:09.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.942 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:09.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:09.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771988+0000", 2024-04-26T10:22:09.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772053+0000", 2024-04-26T10:22:09.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5067000000000006e-05 2024-04-26T10:22:09.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772065+0000", 2024-04-26T10:22:09.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2252999999999999e-05 2024-04-26T10:22:09.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772072+0000", 2024-04-26T10:22:09.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1400000000000002e-06 2024-04-26T10:22:09.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779354+0000", 2024-04-26T10:22:09.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072818120000000004 2024-04-26T10:22:09.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779455+0000", 2024-04-26T10:22:09.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101109 2024-04-26T10:22:09.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795526+0000", 2024-04-26T10:22:09.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016071203999999999 2024-04-26T10:22:09.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795572+0000", 2024-04-26T10:22:09.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5865999999999998e-05 2024-04-26T10:22:09.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795651+0000", 2024-04-26T10:22:09.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9192999999999999e-05 2024-04-26T10:22:09.946 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.946 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.946 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.946 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65614 5.9 5:993a4fbe:::benchmark_data_smithi052_19421_object65613:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:09.946 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:09.946 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.0717235709999997, 2024-04-26T10:22:09.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023664145000000001, 2024-04-26T10:22:09.946 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.946 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.947 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65614 2024-04-26T10:22:09.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.947 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:09.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:09.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772080+0000", 2024-04-26T10:22:09.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:09.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772117+0000", 2024-04-26T10:22:09.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6418000000000003e-05 2024-04-26T10:22:09.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772124+0000", 2024-04-26T10:22:09.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4730000000000003e-06 2024-04-26T10:22:09.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772132+0000", 2024-04-26T10:22:09.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3900000000000004e-06 2024-04-26T10:22:09.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781379+0000", 2024-04-26T10:22:09.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092471059999999997 2024-04-26T10:22:09.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781495+0000", 2024-04-26T10:22:09.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001159 2024-04-26T10:22:09.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:09.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781581+0000", 2024-04-26T10:22:09.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6087000000000004e-05 2024-04-26T10:22:09.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:09.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.785948+0000", 2024-04-26T10:22:09.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043671669999999999 2024-04-26T10:22:09.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795661+0000", 2024-04-26T10:22:09.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097130310000000004 2024-04-26T10:22:09.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795710+0000", 2024-04-26T10:22:09.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8959000000000003e-05 2024-04-26T10:22:09.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795745+0000", 2024-04-26T10:22:09.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5172000000000001e-05 2024-04-26T10:22:09.952 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.952 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.952 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.952 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65619 5.1 5:89edbbcc:::benchmark_data_smithi052_19421_object65618:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:09.952 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.775377+0000", 2024-04-26T10:22:09.953 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.0684276730000004, 2024-04-26T10:22:09.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.020492052, 2024-04-26T10:22:09.953 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.953 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.953 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65619 2024-04-26T10:22:09.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.953 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775377+0000", 2024-04-26T10:22:09.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775377+0000", 2024-04-26T10:22:09.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775376+0000", 2024-04-26T10:22:09.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:09.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775450+0000", 2024-04-26T10:22:09.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3485000000000005e-05 2024-04-26T10:22:09.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775459+0000", 2024-04-26T10:22:09.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1030000000000008e-06 2024-04-26T10:22:09.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.775463+0000", 2024-04-26T10:22:09.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0060000000000003e-06 2024-04-26T10:22:09.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.783840+0000", 2024-04-26T10:22:09.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083774339999999996 2024-04-26T10:22:09.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.783963+0000", 2024-04-26T10:22:09.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012291900000000001 2024-04-26T10:22:09.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795755+0000", 2024-04-26T10:22:09.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011791793 2024-04-26T10:22:09.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795798+0000", 2024-04-26T10:22:09.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3597999999999998e-05 2024-04-26T10:22:09.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795869+0000", 2024-04-26T10:22:09.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0413000000000005e-05 2024-04-26T10:22:09.957 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.957 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.957 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.957 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:68218 5.9 5:9d226c09:::benchmark_data_smithi052_19421_object68217:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-26T10:22:09.957 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:01.979822+0000", 2024-04-26T10:22:09.957 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 7.8639819170000003, 2024-04-26T10:22:09.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.021403591, 2024-04-26T10:22:09.958 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:09.958 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:09.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:09.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:09.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:09.958 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 68218 2024-04-26T10:22:09.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.958 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:09.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:09.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979822+0000", 2024-04-26T10:22:09.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:09.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979822+0000", 2024-04-26T10:22:09.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:09.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:09.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979822+0000", 2024-04-26T10:22:09.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:09.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:09.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979889+0000", 2024-04-26T10:22:09.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7892000000000007e-05 2024-04-26T10:22:09.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:09.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979902+0000", 2024-04-26T10:22:09.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2668e-05 2024-04-26T10:22:09.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:09.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979912+0000", 2024-04-26T10:22:09.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5599999999999999e-06 2024-04-26T10:22:09.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:09.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.979959+0000", 2024-04-26T10:22:09.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6980000000000001e-05 2024-04-26T10:22:09.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:09.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.980117+0000", 2024-04-26T10:22:09.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015815499999999999 2024-04-26T10:22:09.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:09.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.980279+0000", 2024-04-26T10:22:09.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000161903 2024-04-26T10:22:09.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:09.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:01.984675+0000", 2024-04-26T10:22:09.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043966159999999999 2024-04-26T10:22:09.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:09.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:02.001127+0000", 2024-04-26T10:22:09.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016452106000000001 2024-04-26T10:22:09.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:09.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:02.001177+0000", 2024-04-26T10:22:09.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9882000000000001e-05 2024-04-26T10:22:09.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:09.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:09.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:09.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:02.001226+0000", 2024-04-26T10:22:09.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8748000000000002e-05 2024-04-26T10:22:09.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.963 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:09.963 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:09.963 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:09.964 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:09.960+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:09.965 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:10.065 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:10.060+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:10.095 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:10.095 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:10.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.096 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:81950 5.f e41/37 5:fe8245d5:::benchmark_data_smithi052_19421_object81949:head v 41'5159, mlcod=41'5155)", 2024-04-26T10:22:10.096 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.092227+0000", 2024-04-26T10:22:10.096 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0031293060000000001, 2024-04-26T10:22:10.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00315315, 2024-04-26T10:22:10.096 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.096 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:10.096 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.092227+0000", 2024-04-26T10:22:10.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.092227+0000", 2024-04-26T10:22:10.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.092227+0000", 2024-04-26T10:22:10.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:10.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.092287+0000", 2024-04-26T10:22:10.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0355000000000001e-05 2024-04-26T10:22:10.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.092298+0000", 2024-04-26T10:22:10.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1107999999999999e-05 2024-04-26T10:22:10.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.092304+0000", 2024-04-26T10:22:10.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1229999999999997e-06 2024-04-26T10:22:10.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.092369+0000", 2024-04-26T10:22:10.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4942000000000003e-05 2024-04-26T10:22:10.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.092385+0000", 2024-04-26T10:22:10.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.611e-05 2024-04-26T10:22:10.099 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.099 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.099 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.099 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:81953 5.4 5:28c44b2e:::benchmark_data_smithi052_19421_object81952:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:10.099 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.093070+0000", 2024-04-26T10:22:10.099 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.002286803, 2024-04-26T10:22:10.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0023799630000000001, 2024-04-26T10:22:10.100 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.100 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:10.100 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.100 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.100 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.100 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 81953 2024-04-26T10:22:10.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.100 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093070+0000", 2024-04-26T10:22:10.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093070+0000", 2024-04-26T10:22:10.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093068+0000", 2024-04-26T10:22:10.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:10.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093159+0000", 2024-04-26T10:22:10.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0693999999999996e-05 2024-04-26T10:22:10.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093170+0000", 2024-04-26T10:22:10.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0468e-05 2024-04-26T10:22:10.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093174+0000", 2024-04-26T10:22:10.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.921e-06 2024-04-26T10:22:10.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093212+0000", 2024-04-26T10:22:10.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7524000000000002e-05 2024-04-26T10:22:10.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093308+0000", 2024-04-26T10:22:10.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6053999999999999e-05 2024-04-26T10:22:10.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:10.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093396+0000", 2024-04-26T10:22:10.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7715999999999998e-05 2024-04-26T10:22:10.105 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.105 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.106 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.106 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:81954 5.e 5:756f3b19:::benchmark_data_smithi052_19421_object81953:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:10.106 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.093462+0000", 2024-04-26T10:22:10.106 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0018946430000000001, 2024-04-26T10:22:10.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020643749999999998, 2024-04-26T10:22:10.106 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.106 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:10.106 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.106 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.106 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.106 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 81954 2024-04-26T10:22:10.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.107 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093462+0000", 2024-04-26T10:22:10.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093462+0000", 2024-04-26T10:22:10.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093461+0000", 2024-04-26T10:22:10.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:10.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093566+0000", 2024-04-26T10:22:10.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010485 2024-04-26T10:22:10.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093575+0000", 2024-04-26T10:22:10.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.499e-06 2024-04-26T10:22:10.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093582+0000", 2024-04-26T10:22:10.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6159999999999998e-06 2024-04-26T10:22:10.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093622+0000", 2024-04-26T10:22:10.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9731000000000003e-05 2024-04-26T10:22:10.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093726+0000", 2024-04-26T10:22:10.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103934 2024-04-26T10:22:10.109 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.109 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.110 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.110 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:81951 5.9 e41/37 5:90df9600:::benchmark_data_smithi052_19421_object81950:head v 41'5136, mlcod=41'5134)", 2024-04-26T10:22:10.110 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.093785+0000", 2024-04-26T10:22:10.110 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0015711410000000001, 2024-04-26T10:22:10.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0018046550000000001, 2024-04-26T10:22:10.110 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.110 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:10.110 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093785+0000", 2024-04-26T10:22:10.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093785+0000", 2024-04-26T10:22:10.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093785+0000", 2024-04-26T10:22:10.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:10.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093850+0000", 2024-04-26T10:22:10.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5290000000000007e-05 2024-04-26T10:22:10.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093858+0000", 2024-04-26T10:22:10.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9799999999999998e-06 2024-04-26T10:22:10.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093864+0000", 2024-04-26T10:22:10.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9229999999999999e-06 2024-04-26T10:22:10.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093900+0000", 2024-04-26T10:22:10.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5972000000000001e-05 2024-04-26T10:22:10.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.093918+0000", 2024-04-26T10:22:10.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8487000000000001e-05 2024-04-26T10:22:10.115 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.115 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.115 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.116 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:81937 5.4 5:2be7185b:::benchmark_data_smithi052_19421_object81936:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:10.116 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.084446+0000", 2024-04-26T10:22:10.116 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.01091086, 2024-04-26T10:22:10.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011205768, 2024-04-26T10:22:10.116 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.116 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.116 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.116 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.117 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.117 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 81937 2024-04-26T10:22:10.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.117 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.084446+0000", 2024-04-26T10:22:10.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.084446+0000", 2024-04-26T10:22:10.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.084444+0000", 2024-04-26T10:22:10.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:10.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.084517+0000", 2024-04-26T10:22:10.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2619000000000004e-05 2024-04-26T10:22:10.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.084528+0000", 2024-04-26T10:22:10.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0925e-05 2024-04-26T10:22:10.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.084534+0000", 2024-04-26T10:22:10.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1360000000000002e-06 2024-04-26T10:22:10.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.088398+0000", 2024-04-26T10:22:10.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038634870000000001 2024-04-26T10:22:10.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.088559+0000", 2024-04-26T10:22:10.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016097 2024-04-26T10:22:10.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:10.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.088752+0000", 2024-04-26T10:22:10.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000193599 2024-04-26T10:22:10.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:10.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.092840+0000", 2024-04-26T10:22:10.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040880159999999999 2024-04-26T10:22:10.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.095540+0000", 2024-04-26T10:22:10.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0026998450000000002 2024-04-26T10:22:10.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.095631+0000", 2024-04-26T10:22:10.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0538999999999995e-05 2024-04-26T10:22:10.121 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.122 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.122 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.122 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:81947 5.b 5:d0037b6b:::benchmark_data_smithi052_19421_object81946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:10.122 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.090112+0000", 2024-04-26T10:22:10.122 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0052446350000000001, 2024-04-26T10:22:10.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056396390000000001, 2024-04-26T10:22:10.122 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.122 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:10.122 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.122 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.122 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.122 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 81947 2024-04-26T10:22:10.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.123 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.090112+0000", 2024-04-26T10:22:10.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.090112+0000", 2024-04-26T10:22:10.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.090111+0000", 2024-04-26T10:22:10.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:10.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.090259+0000", 2024-04-26T10:22:10.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014772400000000001 2024-04-26T10:22:10.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.090270+0000", 2024-04-26T10:22:10.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1749000000000001e-05 2024-04-26T10:22:10.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.090277+0000", 2024-04-26T10:22:10.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4239999999999998e-06 2024-04-26T10:22:10.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.090344+0000", 2024-04-26T10:22:10.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7485999999999997e-05 2024-04-26T10:22:10.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.090519+0000", 2024-04-26T10:22:10.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017447299999999999 2024-04-26T10:22:10.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:10.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.090689+0000", 2024-04-26T10:22:10.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017014499999999999 2024-04-26T10:22:10.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.095458+0000", 2024-04-26T10:22:10.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047690689999999999 2024-04-26T10:22:10.126 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.126 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.126 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.126 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.126 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:10.126 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 6 2024-04-26T10:22:10.126 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:10.128 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:10.166 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:10.160+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:10.253 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:10.254 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:10.254 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:10.254 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:10.254 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:10.267 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:10.269 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:10.264+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:10.367 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:10.364+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:10.395 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:10.395 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:10.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:10.395 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:10.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.395 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:10.395 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:10.395 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.8629140809999996, 2024-04-26T10:22:10.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:10.396 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.396 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.396 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.396 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.396 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.396 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:10.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.396 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:10.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:10.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:10.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:10.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:10.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:10.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:10.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:10.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:10.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:10.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:10.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:10.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:10.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:10.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:10.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:10.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:10.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:10.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:10.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:10.401 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.401 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.401 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.401 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:10.401 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:10.401 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.8609318540000004, 2024-04-26T10:22:10.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:10.401 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.401 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.401 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.401 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.401 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.402 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:10.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.402 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:10.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:10.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:10.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:10.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:10.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:10.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:10.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:10.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:10.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:10.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:10.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:10.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:10.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:10.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:10.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:10.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:10.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:10.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:10.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:10.406 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.406 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.406 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.406 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:10.406 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:10.406 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.8607324700000003, 2024-04-26T10:22:10.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:10.406 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.406 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.407 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.407 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.407 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.407 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:10.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.408 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:10.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:10.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:10.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:10.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:10.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:10.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:10.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:10.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:10.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:10.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:10.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:10.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:10.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:10.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:10.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:10.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:10.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:10.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:10.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:10.417 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.417 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.417 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.418 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:10.418 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:10.418 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.8605138500000002, 2024-04-26T10:22:10.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:10.418 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.418 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.419 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:10.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:10.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:10.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:10.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:10.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:10.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:10.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:10.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:10.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:10.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:10.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:10.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:10.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:10.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:10.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:10.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:10.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:10.425 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.425 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.425 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.426 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:10.426 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:10.426 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.8581424119999994, 2024-04-26T10:22:10.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:10.426 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.426 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.426 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.426 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.426 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.426 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:10.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.426 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:10.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:10.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:10.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:10.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:10.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:10.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:10.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:10.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:10.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:10.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:10.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:10.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:10.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:10.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:10.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:10.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:10.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:10.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:10.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:10.430 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.430 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.430 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.431 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:10.431 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:10.431 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.8580417899999997, 2024-04-26T10:22:10.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:10.431 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.431 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.431 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.431 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.431 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.432 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:10.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.432 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:10.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:10.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:10.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:10.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:10.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:10.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:10.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:10.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:10.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:10.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:10.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:10.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:10.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:10.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:10.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:10.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:10.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:10.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:10.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:10.436 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.436 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.436 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.436 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:10.436 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:10.436 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.8579232290000007, 2024-04-26T10:22:10.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:10.436 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.436 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.436 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:10.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:10.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:10.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:10.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:10.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:10.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:10.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:10.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:10.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:10.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:10.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:10.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:10.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:10.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:10.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:10.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:10.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:10.441 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.441 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.441 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.442 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:10.442 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:10.442 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.8578208309999997, 2024-04-26T10:22:10.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:10.442 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.442 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.442 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.442 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.442 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.442 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:10.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.443 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:10.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:10.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:10.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:10.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:10.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:10.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:10.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:10.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:10.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:10.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:10.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:10.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:10.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:10.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:10.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:10.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:10.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:10.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:10.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:10.446 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.446 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.447 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.447 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65294 5.e 5:7438ad6f:::benchmark_data_smithi052_19421_object65293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:10.447 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:10.447 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.8571407139999998, 2024-04-26T10:22:10.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091965517999999996, 2024-04-26T10:22:10.447 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.447 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.447 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.447 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.447 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.447 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65294 2024-04-26T10:22:10.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.447 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:10.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:10.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536413+0000", 2024-04-26T10:22:10.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:10.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536470+0000", 2024-04-26T10:22:10.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6443999999999997e-05 2024-04-26T10:22:10.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536480+0000", 2024-04-26T10:22:10.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0652999999999999e-05 2024-04-26T10:22:10.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536488+0000", 2024-04-26T10:22:10.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7929999999999998e-06 2024-04-26T10:22:10.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536548+0000", 2024-04-26T10:22:10.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9556999999999999e-05 2024-04-26T10:22:10.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536728+0000", 2024-04-26T10:22:10.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000180958 2024-04-26T10:22:10.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628168+0000", 2024-04-26T10:22:10.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091439276999999999 2024-04-26T10:22:10.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628258+0000", 2024-04-26T10:22:10.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0158e-05 2024-04-26T10:22:10.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628380+0000", 2024-04-26T10:22:10.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012180699999999999 2024-04-26T10:22:10.455 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.455 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.455 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.456 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:10.456 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:10.456 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.8568002739999994, 2024-04-26T10:22:10.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:10.456 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.457 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.457 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.457 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.457 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.457 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:10.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.457 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:10.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:10.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:10.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:10.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:10.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:10.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:10.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:10.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:10.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:10.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:10.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:10.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:10.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:10.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:10.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:10.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:10.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:10.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:10.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:10.466 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.466 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.466 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.467 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:10.467 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:10.467 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.8556499990000006, 2024-04-26T10:22:10.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:10.468 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.468 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.468 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.468 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.468 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.468 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:10.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.469 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:10.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:10.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:10.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:10.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:10.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:10.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:10.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:10.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:10.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:10.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:10.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:10.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:10.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:10.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:10.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:10.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:10.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:10.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:10.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:10.478 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.478 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.478 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.479 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65292 5.f e34/22 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head v 34'4129, mlcod=34'4125)", 2024-04-26T10:22:10.479 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:10.479 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.8554757429999995, 2024-04-26T10:22:10.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093470155999999999, 2024-04-26T10:22:10.479 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.479 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.479 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:10.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:10.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538078+0000", 2024-04-26T10:22:10.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:10.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538140+0000", 2024-04-26T10:22:10.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1970000000000005e-05 2024-04-26T10:22:10.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538149+0000", 2024-04-26T10:22:10.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2189999999999993e-06 2024-04-26T10:22:10.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538158+0000", 2024-04-26T10:22:10.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0930000000000003e-06 2024-04-26T10:22:10.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627053+0000", 2024-04-26T10:22:10.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088895221999999996 2024-04-26T10:22:10.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627092+0000", 2024-04-26T10:22:10.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9657000000000003e-05 2024-04-26T10:22:10.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631499+0000", 2024-04-26T10:22:10.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044066560000000001 2024-04-26T10:22:10.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631549+0000", 2024-04-26T10:22:10.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0259000000000001e-05 2024-04-26T10:22:10.483 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.483 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.483 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.483 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65298 5.b 5:d51c4e52:::benchmark_data_smithi052_19421_object65297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:10.483 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:10.483 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.8547092860000003, 2024-04-26T10:22:10.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091641671999999993, 2024-04-26T10:22:10.483 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.483 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.483 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.483 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.483 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.484 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65298 2024-04-26T10:22:10.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.484 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:10.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:10.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538844+0000", 2024-04-26T10:22:10.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:10.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538919+0000", 2024-04-26T10:22:10.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4626e-05 2024-04-26T10:22:10.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626007+0000", 2024-04-26T10:22:10.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087087516000000004 2024-04-26T10:22:10.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626074+0000", 2024-04-26T10:22:10.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7077999999999997e-05 2024-04-26T10:22:10.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626150+0000", 2024-04-26T10:22:10.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5982999999999994e-05 2024-04-26T10:22:10.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626341+0000", 2024-04-26T10:22:10.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019141199999999999 2024-04-26T10:22:10.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630359+0000", 2024-04-26T10:22:10.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040175710000000002 2024-04-26T10:22:10.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630412+0000", 2024-04-26T10:22:10.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3779000000000001e-05 2024-04-26T10:22:10.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630487+0000", 2024-04-26T10:22:10.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4913999999999995e-05 2024-04-26T10:22:10.491 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.491 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.491 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.492 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:70535 5.8 5:1871dc9c:::benchmark_data_smithi052_19421_object70534:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:10.492 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:04.613036+0000", 2024-04-26T10:22:10.492 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.7805190629999998, 2024-04-26T10:22:10.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021812264000000001, 2024-04-26T10:22:10.492 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.492 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.492 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.492 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.493 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.493 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 70535 2024-04-26T10:22:10.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.493 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613036+0000", 2024-04-26T10:22:10.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613036+0000", 2024-04-26T10:22:10.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613035+0000", 2024-04-26T10:22:10.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:10.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613072+0000", 2024-04-26T10:22:10.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6766e-05 2024-04-26T10:22:10.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613087+0000", 2024-04-26T10:22:10.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5349000000000002e-05 2024-04-26T10:22:10.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.613094+0000", 2024-04-26T10:22:10.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8079999999999999e-06 2024-04-26T10:22:10.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.619353+0000", 2024-04-26T10:22:10.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0062593839999999998 2024-04-26T10:22:10.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.619503+0000", 2024-04-26T10:22:10.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000149715 2024-04-26T10:22:10.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.634715+0000", 2024-04-26T10:22:10.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.015211875 2024-04-26T10:22:10.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.634765+0000", 2024-04-26T10:22:10.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0757000000000002e-05 2024-04-26T10:22:10.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:04.634848+0000", 2024-04-26T10:22:10.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2707000000000006e-05 2024-04-26T10:22:10.501 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.501 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.501 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.502 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:72679 5.4 5:26d5239b:::benchmark_data_smithi052_19421_object72678:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-26T10:22:10.502 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:05.627497+0000", 2024-04-26T10:22:10.502 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.7660582429999998, 2024-04-26T10:22:10.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.023380204000000002, 2024-04-26T10:22:10.502 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.503 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.503 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 72679 2024-04-26T10:22:10.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.503 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.627497+0000", 2024-04-26T10:22:10.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.627497+0000", 2024-04-26T10:22:10.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.627496+0000", 2024-04-26T10:22:10.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:10.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.627558+0000", 2024-04-26T10:22:10.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2657000000000007e-05 2024-04-26T10:22:10.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.627567+0000", 2024-04-26T10:22:10.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1640000000000001e-06 2024-04-26T10:22:10.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.627573+0000", 2024-04-26T10:22:10.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3230000000000003e-06 2024-04-26T10:22:10.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.632376+0000", 2024-04-26T10:22:10.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00480299 2024-04-26T10:22:10.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.632456+0000", 2024-04-26T10:22:10.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9691999999999995e-05 2024-04-26T10:22:10.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:10.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.632538+0000", 2024-04-26T10:22:10.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2596999999999995e-05 2024-04-26T10:22:10.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.637567+0000", 2024-04-26T10:22:10.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005029174 2024-04-26T10:22:10.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:10.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.650761+0000", 2024-04-26T10:22:10.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013193408 2024-04-26T10:22:10.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.650806+0000", 2024-04-26T10:22:10.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5702999999999999e-05 2024-04-26T10:22:10.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:05.650877+0000", 2024-04-26T10:22:10.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0463999999999995e-05 2024-04-26T10:22:10.509 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.509 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.509 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.509 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:81351 5.8 5:179c4590:::benchmark_data_smithi052_19421_object81350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:10.509 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:09.806763+0000", 2024-04-26T10:22:10.509 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.586791913, 2024-04-26T10:22:10.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022932286, 2024-04-26T10:22:10.509 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.509 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.510 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.510 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.510 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.510 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 81351 2024-04-26T10:22:10.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.510 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.806763+0000", 2024-04-26T10:22:10.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.806763+0000", 2024-04-26T10:22:10.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.806762+0000", 2024-04-26T10:22:10.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:10.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.806826+0000", 2024-04-26T10:22:10.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4177999999999994e-05 2024-04-26T10:22:10.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.806837+0000", 2024-04-26T10:22:10.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0822000000000001e-05 2024-04-26T10:22:10.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.806843+0000", 2024-04-26T10:22:10.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5949999999999998e-06 2024-04-26T10:22:10.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.820511+0000", 2024-04-26T10:22:10.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013668421 2024-04-26T10:22:10.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.820610+0000", 2024-04-26T10:22:10.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8348000000000001e-05 2024-04-26T10:22:10.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.829591+0000", 2024-04-26T10:22:10.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0089809309999999993 2024-04-26T10:22:10.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.829636+0000", 2024-04-26T10:22:10.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5009999999999998e-05 2024-04-26T10:22:10.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.829695+0000", 2024-04-26T10:22:10.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9775999999999998e-05 2024-04-26T10:22:10.514 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.514 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.514 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.514 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:81355 5.8 5:14f6458e:::benchmark_data_smithi052_19421_object81354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:10.514 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:10.514 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.58427228600000003, 2024-04-26T10:22:10.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027247422, 2024-04-26T10:22:10.514 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.514 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.515 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.515 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.515 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.515 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 81355 2024-04-26T10:22:10.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.515 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:10.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:10.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809281+0000", 2024-04-26T10:22:10.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:10.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809337+0000", 2024-04-26T10:22:10.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5627999999999997e-05 2024-04-26T10:22:10.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809349+0000", 2024-04-26T10:22:10.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1554e-05 2024-04-26T10:22:10.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809355+0000", 2024-04-26T10:22:10.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2559999999999999e-06 2024-04-26T10:22:10.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.823233+0000", 2024-04-26T10:22:10.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013877647999999999 2024-04-26T10:22:10.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.823361+0000", 2024-04-26T10:22:10.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012813500000000001 2024-04-26T10:22:10.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836404+0000", 2024-04-26T10:22:10.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013043592999999999 2024-04-26T10:22:10.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836468+0000", 2024-04-26T10:22:10.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3734999999999999e-05 2024-04-26T10:22:10.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836530+0000", 2024-04-26T10:22:10.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2065999999999998e-05 2024-04-26T10:22:10.519 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.519 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.519 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.519 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:81376 5.0 5:0ae416d1:::benchmark_data_smithi052_19421_object81375:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:10.519 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:09.820305+0000", 2024-04-26T10:22:10.519 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.57324956000000005, 2024-04-26T10:22:10.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021606335000000001, 2024-04-26T10:22:10.519 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.520 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.520 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.520 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.520 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.520 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 81376 2024-04-26T10:22:10.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.520 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.820305+0000", 2024-04-26T10:22:10.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.820305+0000", 2024-04-26T10:22:10.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.820304+0000", 2024-04-26T10:22:10.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:10.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.820408+0000", 2024-04-26T10:22:10.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010343100000000001 2024-04-26T10:22:10.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.820429+0000", 2024-04-26T10:22:10.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0775999999999999e-05 2024-04-26T10:22:10.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.820438+0000", 2024-04-26T10:22:10.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5619999999999993e-06 2024-04-26T10:22:10.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.829900+0000", 2024-04-26T10:22:10.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0094619490000000007 2024-04-26T10:22:10.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.830051+0000", 2024-04-26T10:22:10.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015115800000000001 2024-04-26T10:22:10.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:10.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.830177+0000", 2024-04-26T10:22:10.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000126024 2024-04-26T10:22:10.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:10.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836421+0000", 2024-04-26T10:22:10.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0062434179999999997 2024-04-26T10:22:10.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.841758+0000", 2024-04-26T10:22:10.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053372560000000003 2024-04-26T10:22:10.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.841798+0000", 2024-04-26T10:22:10.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9745e-05 2024-04-26T10:22:10.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.841912+0000", 2024-04-26T10:22:10.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000113992 2024-04-26T10:22:10.525 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.525 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.525 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.525 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:81390 5.0 5:02b6c9d7:::benchmark_data_smithi052_19421_object81389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:10.525 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:09.827119+0000", 2024-04-26T10:22:10.525 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.56643637400000002, 2024-04-26T10:22:10.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.022100505999999999, 2024-04-26T10:22:10.525 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.525 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.525 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.525 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.525 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.526 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 81390 2024-04-26T10:22:10.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.526 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.827119+0000", 2024-04-26T10:22:10.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.827119+0000", 2024-04-26T10:22:10.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.827118+0000", 2024-04-26T10:22:10.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:10.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.827162+0000", 2024-04-26T10:22:10.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4249000000000003e-05 2024-04-26T10:22:10.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.827171+0000", 2024-04-26T10:22:10.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3030000000000005e-06 2024-04-26T10:22:10.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.827178+0000", 2024-04-26T10:22:10.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3369999999999996e-06 2024-04-26T10:22:10.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.839318+0000", 2024-04-26T10:22:10.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012139840000000001 2024-04-26T10:22:10.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.839470+0000", 2024-04-26T10:22:10.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015215500000000001 2024-04-26T10:22:10.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:10.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.839656+0000", 2024-04-26T10:22:10.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018578 2024-04-26T10:22:10.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.843189+0000", 2024-04-26T10:22:10.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0035330650000000002 2024-04-26T10:22:10.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:10.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.849110+0000", 2024-04-26T10:22:10.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059214630000000001 2024-04-26T10:22:10.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.849154+0000", 2024-04-26T10:22:10.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4264000000000002e-05 2024-04-26T10:22:10.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.849219+0000", 2024-04-26T10:22:10.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4665999999999994e-05 2024-04-26T10:22:10.530 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.530 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.530 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.531 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:82102 5.8 5:120c37d7:::benchmark_data_smithi052_19421_object82101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:10.531 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.159788+0000", 2024-04-26T10:22:10.531 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.23376660299999999, 2024-04-26T10:22:10.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.021856965999999999, 2024-04-26T10:22:10.531 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:10.531 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:10.531 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:10.531 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:10.531 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.531 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 82102 2024-04-26T10:22:10.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.531 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:10.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:10.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.159788+0000", 2024-04-26T10:22:10.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:10.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.159788+0000", 2024-04-26T10:22:10.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:10.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:10.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.159788+0000", 2024-04-26T10:22:10.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:10.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:10.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.159822+0000", 2024-04-26T10:22:10.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4323999999999999e-05 2024-04-26T10:22:10.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:10.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.159828+0000", 2024-04-26T10:22:10.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1800000000000001e-06 2024-04-26T10:22:10.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.159833+0000", 2024-04-26T10:22:10.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.78e-06 2024-04-26T10:22:10.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:10.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.171458+0000", 2024-04-26T10:22:10.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011624608 2024-04-26T10:22:10.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:10.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.171639+0000", 2024-04-26T10:22:10.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000180872 2024-04-26T10:22:10.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:10.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.181498+0000", 2024-04-26T10:22:10.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0098594029999999992 2024-04-26T10:22:10.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:10.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.181560+0000", 2024-04-26T10:22:10.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2082000000000006e-05 2024-04-26T10:22:10.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:10.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:10.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:10.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.181645+0000", 2024-04-26T10:22:10.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5168999999999997e-05 2024-04-26T10:22:10.535 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.535 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.535 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.536 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:10.536 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:10.536 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:10.537 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:10.538 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:10.532+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:10.616 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 37 16 83108 83092 140.342 133.375 0.00306613 0.00712003 2024-04-26T10:22:10.640 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:10.636+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:10.678 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:10.678 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:10.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.678 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83223 5.0 e41/37 5:0460c4b2:::benchmark_data_smithi052_19421_object83222:head v 41'5163, mlcod=41'5159)", 2024-04-26T10:22:10.678 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.672267+0000", 2024-04-26T10:22:10.678 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0036672290000000001, 2024-04-26T10:22:10.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036907400000000001, 2024-04-26T10:22:10.678 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:10.678 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:10.678 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:10.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:10.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.672267+0000", 2024-04-26T10:22:10.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:10.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:10.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.672267+0000", 2024-04-26T10:22:10.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:10.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:10.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.672267+0000", 2024-04-26T10:22:10.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:10.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:10.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.672273+0000", 2024-04-26T10:22:10.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8969999999999996e-06 2024-04-26T10:22:10.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:10.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.672281+0000", 2024-04-26T10:22:10.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0909999999999993e-06 2024-04-26T10:22:10.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.672287+0000", 2024-04-26T10:22:10.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.156e-06 2024-04-26T10:22:10.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:10.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.672322+0000", 2024-04-26T10:22:10.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5468e-05 2024-04-26T10:22:10.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:10.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.672342+0000", 2024-04-26T10:22:10.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0035e-05 2024-04-26T10:22:10.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.681 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:10.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.681 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83229 5.7 5:e5635a3f:::benchmark_data_smithi052_19421_object83228:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:10.682 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.674016+0000", 2024-04-26T10:22:10.682 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0019188600000000001, 2024-04-26T10:22:10.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020093950000000002, 2024-04-26T10:22:10.682 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:10.682 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:10.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:10.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:10.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.682 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83229 2024-04-26T10:22:10.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.682 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:10.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:10.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674016+0000", 2024-04-26T10:22:10.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:10.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:10.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674016+0000", 2024-04-26T10:22:10.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:10.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:10.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674014+0000", 2024-04-26T10:22:10.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:10.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:10.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674113+0000", 2024-04-26T10:22:10.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8675e-05 2024-04-26T10:22:10.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:10.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674124+0000", 2024-04-26T10:22:10.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0492999999999999e-05 2024-04-26T10:22:10.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674131+0000", 2024-04-26T10:22:10.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3390000000000004e-06 2024-04-26T10:22:10.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:10.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674174+0000", 2024-04-26T10:22:10.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3319000000000003e-05 2024-04-26T10:22:10.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:10.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674293+0000", 2024-04-26T10:22:10.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119065 2024-04-26T10:22:10.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.685 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:10.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.685 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83231 5.f 5:fb119c02:::benchmark_data_smithi052_19421_object83230:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:10.686 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.674145+0000", 2024-04-26T10:22:10.686 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0017892769999999999, 2024-04-26T10:22:10.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001952498, 2024-04-26T10:22:10.686 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:10.686 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:10.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:10.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:10.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.686 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83231 2024-04-26T10:22:10.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.686 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:10.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:10.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674145+0000", 2024-04-26T10:22:10.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:10.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:10.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674145+0000", 2024-04-26T10:22:10.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:10.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:10.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674145+0000", 2024-04-26T10:22:10.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:10.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:10.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674186+0000", 2024-04-26T10:22:10.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1505000000000003e-05 2024-04-26T10:22:10.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:10.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674199+0000", 2024-04-26T10:22:10.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2639999999999999e-05 2024-04-26T10:22:10.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674205+0000", 2024-04-26T10:22:10.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2840000000000003e-06 2024-04-26T10:22:10.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:10.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674233+0000", 2024-04-26T10:22:10.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8444000000000001e-05 2024-04-26T10:22:10.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:10.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674328+0000", 2024-04-26T10:22:10.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4696000000000003e-05 2024-04-26T10:22:10.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:10.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674408+0000", 2024-04-26T10:22:10.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9895000000000007e-05 2024-04-26T10:22:10.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.690 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:10.690 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.690 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83232 5.7 5:ee020e8d:::benchmark_data_smithi052_19421_object83231:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:10.690 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.674215+0000", 2024-04-26T10:22:10.690 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0017196220000000001, 2024-04-26T10:22:10.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001954866, 2024-04-26T10:22:10.690 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:10.690 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:10.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:10.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:10.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.690 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83232 2024-04-26T10:22:10.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.691 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:10.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:10.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674215+0000", 2024-04-26T10:22:10.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:10.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:10.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674215+0000", 2024-04-26T10:22:10.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:10.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:10.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674214+0000", 2024-04-26T10:22:10.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:10.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:10.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674253+0000", 2024-04-26T10:22:10.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9183000000000001e-05 2024-04-26T10:22:10.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:10.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674263+0000", 2024-04-26T10:22:10.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8570000000000007e-06 2024-04-26T10:22:10.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.674270+0000", 2024-04-26T10:22:10.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7399999999999998e-06 2024-04-26T10:22:10.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:10.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675808+0000", 2024-04-26T10:22:10.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015375950000000001 2024-04-26T10:22:10.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:10.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675929+0000", 2024-04-26T10:22:10.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120962 2024-04-26T10:22:10.693 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.693 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:10.694 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.694 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83233 5.d 5:b53d3285:::benchmark_data_smithi052_19421_object83232:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:10.694 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.675048+0000", 2024-04-26T10:22:10.694 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00088632499999999998, 2024-04-26T10:22:10.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011869339999999999, 2024-04-26T10:22:10.694 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:10.694 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:10.694 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:10.694 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:10.694 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.694 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83233 2024-04-26T10:22:10.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.695 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:10.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:10.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675048+0000", 2024-04-26T10:22:10.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:10.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:10.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675048+0000", 2024-04-26T10:22:10.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:10.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:10.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675048+0000", 2024-04-26T10:22:10.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:10.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:10.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675116+0000", 2024-04-26T10:22:10.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8343000000000006e-05 2024-04-26T10:22:10.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:10.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675126+0000", 2024-04-26T10:22:10.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8230000000000006e-06 2024-04-26T10:22:10.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675132+0000", 2024-04-26T10:22:10.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7259999999999996e-06 2024-04-26T10:22:10.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:10.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675181+0000", 2024-04-26T10:22:10.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.833e-05 2024-04-26T10:22:10.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:10.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675321+0000", 2024-04-26T10:22:10.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140359 2024-04-26T10:22:10.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:10.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675477+0000", 2024-04-26T10:22:10.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000156057 2024-04-26T10:22:10.698 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.698 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:10.698 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.698 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83230 5.0 e41/37 5:02529e4c:::benchmark_data_smithi052_19421_object83229:head v 41'5164, mlcod=41'5160)", 2024-04-26T10:22:10.698 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.675650+0000", 2024-04-26T10:22:10.698 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00028470999999999998, 2024-04-26T10:22:10.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00064757900000000001, 2024-04-26T10:22:10.698 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:10.699 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:10.699 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:10.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:10.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675650+0000", 2024-04-26T10:22:10.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:10.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:10.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675650+0000", 2024-04-26T10:22:10.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:10.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:10.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675649+0000", 2024-04-26T10:22:10.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:10.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:10.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675723+0000", 2024-04-26T10:22:10.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3835e-05 2024-04-26T10:22:10.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:10.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675738+0000", 2024-04-26T10:22:10.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4765e-05 2024-04-26T10:22:10.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675745+0000", 2024-04-26T10:22:10.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9450000000000004e-06 2024-04-26T10:22:10.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:10.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675787+0000", 2024-04-26T10:22:10.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2548e-05 2024-04-26T10:22:10.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:10.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675806+0000", 2024-04-26T10:22:10.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9153000000000001e-05 2024-04-26T10:22:10.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.701 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:10.702 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.702 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83236 5.2 5:4b75e3c3:::benchmark_data_smithi052_19421_object83235:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:10.702 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.675790+0000", 2024-04-26T10:22:10.702 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00014455699999999999, 2024-04-26T10:22:10.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00056256500000000001, 2024-04-26T10:22:10.702 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:10.702 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:10.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:10.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:10.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.702 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83236 2024-04-26T10:22:10.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.703 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:10.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:10.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675790+0000", 2024-04-26T10:22:10.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:10.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:10.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675790+0000", 2024-04-26T10:22:10.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:10.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:10.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675789+0000", 2024-04-26T10:22:10.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:10.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:10.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675820+0000", 2024-04-26T10:22:10.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1059999999999997e-05 2024-04-26T10:22:10.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:10.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675829+0000", 2024-04-26T10:22:10.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2660000000000001e-06 2024-04-26T10:22:10.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675837+0000", 2024-04-26T10:22:10.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3760000000000008e-06 2024-04-26T10:22:10.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:10.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675892+0000", 2024-04-26T10:22:10.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4660999999999997e-05 2024-04-26T10:22:10.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:10.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.676037+0000", 2024-04-26T10:22:10.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000145816 2024-04-26T10:22:10.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.706 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:10.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.706 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83237 5.5 5.25a982f5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:10.706 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.675854+0000", 2024-04-26T10:22:10.706 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0416999999999999e-05, 2024-04-26T10:22:10.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00055719999999999999, 2024-04-26T10:22:10.706 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:10.706 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:10.706 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:10.706 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:10.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.707 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83237 2024-04-26T10:22:10.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.707 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:10.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:10.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675854+0000", 2024-04-26T10:22:10.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:10.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:10.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675854+0000", 2024-04-26T10:22:10.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:10.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:10.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675854+0000", 2024-04-26T10:22:10.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:10.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:10.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675889+0000", 2024-04-26T10:22:10.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5373999999999997e-05 2024-04-26T10:22:10.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:10.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675896+0000", 2024-04-26T10:22:10.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3200000000000002e-06 2024-04-26T10:22:10.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.675902+0000", 2024-04-26T10:22:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6389999999999997e-06 2024-04-26T10:22:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83228 5.6 5:6369f3fc:::benchmark_data_smithi052_19421_object83227:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.671181+0000", 2024-04-26T10:22:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0047537660000000004, 2024-04-26T10:22:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005282068, 2024-04-26T10:22:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:10.709 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:10.710 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:10.710 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:10.710 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:10.710 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83228 2024-04-26T10:22:10.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.710 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:10.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:10.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.671181+0000", 2024-04-26T10:22:10.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:10.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:10.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.671181+0000", 2024-04-26T10:22:10.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:10.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:10.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.671180+0000", 2024-04-26T10:22:10.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:10.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:10.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.671217+0000", 2024-04-26T10:22:10.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6479000000000001e-05 2024-04-26T10:22:10.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:10.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.671224+0000", 2024-04-26T10:22:10.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3180000000000001e-06 2024-04-26T10:22:10.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:10.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.671229+0000", 2024-04-26T10:22:10.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3600000000000004e-06 2024-04-26T10:22:10.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:10.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.671269+0000", 2024-04-26T10:22:10.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9539999999999998e-05 2024-04-26T10:22:10.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:10.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:10.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:10.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.671371+0000", 2024-04-26T10:22:10.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010208999999999999 2024-04-26T10:22:10.713 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.713 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:10.713 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.713 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:10.713 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:10.713 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 9 2024-04-26T10:22:10.713 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:10.714 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:10.758 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:10.756+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:10.840 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:10.836+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:10.878 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:10.879 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:10.879 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:10.879 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:10.879 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:10.888 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:10.909 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:22:10.941 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:10.936+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:11.021 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.487995088, 2024-04-26T10:22:11.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:11.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:11.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:11.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:11.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:11.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.483459876, 2024-04-26T10:22:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:11.027 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:11.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:11.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.482828584, 2024-04-26T10:22:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:11.033 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:11.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65604 5.9 5:9c239c32:::benchmark_data_smithi052_19421_object65603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:11.039 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.2477257, 2024-04-26T10:22:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025897677000000001, 2024-04-26T10:22:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65604 2024-04-26T10:22:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:11.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769615+0000", 2024-04-26T10:22:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769694+0000", 2024-04-26T10:22:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9087999999999999e-05 2024-04-26T10:22:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769702+0000", 2024-04-26T10:22:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8150000000000006e-06 2024-04-26T10:22:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769709+0000", 2024-04-26T10:22:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:22:11.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772336+0000", 2024-04-26T10:22:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002626836 2024-04-26T10:22:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772470+0000", 2024-04-26T10:22:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013453299999999999 2024-04-26T10:22:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:11.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772605+0000", 2024-04-26T10:22:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013428499999999999 2024-04-26T10:22:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779374+0000", 2024-04-26T10:22:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067694000000000001 2024-04-26T10:22:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:11.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795401+0000", 2024-04-26T10:22:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016026543000000001 2024-04-26T10:22:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795461+0000", 2024-04-26T10:22:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9923999999999998e-05 2024-04-26T10:22:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795513+0000", 2024-04-26T10:22:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2737e-05 2024-04-26T10:22:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.046 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65613 5.1 5:85cc6530:::benchmark_data_smithi052_19421_object65612:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:11.046 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:11.046 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.245352654, 2024-04-26T10:22:11.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023662843999999999, 2024-04-26T10:22:11.046 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.046 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.046 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:11.046 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:11.046 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:11.046 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65613 2024-04-26T10:22:11.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.046 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:11.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:11.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771988+0000", 2024-04-26T10:22:11.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:11.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772053+0000", 2024-04-26T10:22:11.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5067000000000006e-05 2024-04-26T10:22:11.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772065+0000", 2024-04-26T10:22:11.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2252999999999999e-05 2024-04-26T10:22:11.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772072+0000", 2024-04-26T10:22:11.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1400000000000002e-06 2024-04-26T10:22:11.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779354+0000", 2024-04-26T10:22:11.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072818120000000004 2024-04-26T10:22:11.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779455+0000", 2024-04-26T10:22:11.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101109 2024-04-26T10:22:11.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:11.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795526+0000", 2024-04-26T10:22:11.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016071203999999999 2024-04-26T10:22:11.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795572+0000", 2024-04-26T10:22:11.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5865999999999998e-05 2024-04-26T10:22:11.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795651+0000", 2024-04-26T10:22:11.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9192999999999999e-05 2024-04-26T10:22:11.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.051 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.051 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65614 5.9 5:993a4fbe:::benchmark_data_smithi052_19421_object65613:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:11.051 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:11.051 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 10.245260462999999, 2024-04-26T10:22:11.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023664145000000001, 2024-04-26T10:22:11.051 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.051 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:11.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:11.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:11.051 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65614 2024-04-26T10:22:11.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.052 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:11.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:11.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772080+0000", 2024-04-26T10:22:11.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:11.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772117+0000", 2024-04-26T10:22:11.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6418000000000003e-05 2024-04-26T10:22:11.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772124+0000", 2024-04-26T10:22:11.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4730000000000003e-06 2024-04-26T10:22:11.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772132+0000", 2024-04-26T10:22:11.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3900000000000004e-06 2024-04-26T10:22:11.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781379+0000", 2024-04-26T10:22:11.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092471059999999997 2024-04-26T10:22:11.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781495+0000", 2024-04-26T10:22:11.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001159 2024-04-26T10:22:11.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:11.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781581+0000", 2024-04-26T10:22:11.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6087000000000004e-05 2024-04-26T10:22:11.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:11.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.785948+0000", 2024-04-26T10:22:11.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043671669999999999 2024-04-26T10:22:11.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:11.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795661+0000", 2024-04-26T10:22:11.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097130310000000004 2024-04-26T10:22:11.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795710+0000", 2024-04-26T10:22:11.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8959000000000003e-05 2024-04-26T10:22:11.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795745+0000", 2024-04-26T10:22:11.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5172000000000001e-05 2024-04-26T10:22:11.056 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.057 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.057 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.057 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83591 5.4 e41/37 5:204a1b6d:::benchmark_data_smithi052_19421_object83590:head v 41'5271, mlcod=41'5268)", 2024-04-26T10:22:11.057 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:11.057 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.17035318099999999, 2024-04-26T10:22:11.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.046802200000000002, 2024-04-26T10:22:11.057 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.057 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.057 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:11.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:11.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846987+0000", 2024-04-26T10:22:11.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:11.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846995+0000", 2024-04-26T10:22:11.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7549999999999994e-06 2024-04-26T10:22:11.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847004+0000", 2024-04-26T10:22:11.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3190000000000001e-06 2024-04-26T10:22:11.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847011+0000", 2024-04-26T10:22:11.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5039999999999999e-06 2024-04-26T10:22:11.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847048+0000", 2024-04-26T10:22:11.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7052999999999999e-05 2024-04-26T10:22:11.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847066+0000", 2024-04-26T10:22:11.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8468999999999999e-05 2024-04-26T10:22:11.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893707+0000", 2024-04-26T10:22:11.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.046641123999999999 2024-04-26T10:22:11.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893790+0000", 2024-04-26T10:22:11.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2806999999999995e-05 2024-04-26T10:22:11.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.061 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.061 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83592 5.3 5:c96af6b1:::benchmark_data_smithi052_19421_object83591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:11.061 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:11.061 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.16902003700000001, 2024-04-26T10:22:11.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045543839000000003, 2024-04-26T10:22:11.062 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.062 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:11.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:11.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:11.062 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83592 2024-04-26T10:22:11.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.062 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:11.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:11.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848320+0000", 2024-04-26T10:22:11.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:11.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848465+0000", 2024-04-26T10:22:11.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000145291 2024-04-26T10:22:11.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848475+0000", 2024-04-26T10:22:11.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6709999999999994e-06 2024-04-26T10:22:11.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848482+0000", 2024-04-26T10:22:11.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2910000000000002e-06 2024-04-26T10:22:11.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848532+0000", 2024-04-26T10:22:11.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9199000000000001e-05 2024-04-26T10:22:11.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848676+0000", 2024-04-26T10:22:11.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014493399999999999 2024-04-26T10:22:11.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:11.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893707+0000", 2024-04-26T10:22:11.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045030857000000001 2024-04-26T10:22:11.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893772+0000", 2024-04-26T10:22:11.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4203999999999997e-05 2024-04-26T10:22:11.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893865+0000", 2024-04-26T10:22:11.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3577000000000002e-05 2024-04-26T10:22:11.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.066 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.067 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83593 5.0 e41/37 5:044bb3ac:::benchmark_data_smithi052_19421_object83592:head v 41'5187, mlcod=41'5184)", 2024-04-26T10:22:11.067 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:11.067 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.16852262000000001, 2024-04-26T10:22:11.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044951738999999998, 2024-04-26T10:22:11.067 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.067 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.067 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:11.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:11.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848818+0000", 2024-04-26T10:22:11.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:11.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848824+0000", 2024-04-26T10:22:11.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-04-26T10:22:11.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848895+0000", 2024-04-26T10:22:11.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1468000000000001e-05 2024-04-26T10:22:11.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848902+0000", 2024-04-26T10:22:11.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6229999999999999e-06 2024-04-26T10:22:11.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848955+0000", 2024-04-26T10:22:11.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3106000000000003e-05 2024-04-26T10:22:11.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848974+0000", 2024-04-26T10:22:11.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9598000000000001e-05 2024-04-26T10:22:11.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893703+0000", 2024-04-26T10:22:11.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044728315999999997 2024-04-26T10:22:11.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893770+0000", 2024-04-26T10:22:11.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7683999999999998e-05 2024-04-26T10:22:11.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.071 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.071 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83594 5.b e41/37 5:d024b819:::benchmark_data_smithi052_19421_object83593:head v 41'5142, mlcod=41'5140)", 2024-04-26T10:22:11.071 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:11.071 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.16841261099999999, 2024-04-26T10:22:11.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044760763000000002, 2024-04-26T10:22:11.071 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.071 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.071 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:11.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:11.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848928+0000", 2024-04-26T10:22:11.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:11.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848933+0000", 2024-04-26T10:22:11.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:11.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848952+0000", 2024-04-26T10:22:11.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8884000000000001e-05 2024-04-26T10:22:11.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848957+0000", 2024-04-26T10:22:11.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8470000000000003e-06 2024-04-26T10:22:11.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848980+0000", 2024-04-26T10:22:11.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2946999999999999e-05 2024-04-26T10:22:11.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848992+0000", 2024-04-26T10:22:11.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1882000000000001e-05 2024-04-26T10:22:11.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893623+0000", 2024-04-26T10:22:11.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044631381999999997 2024-04-26T10:22:11.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893689+0000", 2024-04-26T10:22:11.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6285999999999995e-05 2024-04-26T10:22:11.075 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.075 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.075 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.075 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83595 5.1 5:829f4097:::benchmark_data_smithi052_19421_object83594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:11.075 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:11.075 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.16832375199999999, 2024-04-26T10:22:11.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048599369000000003, 2024-04-26T10:22:11.076 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.076 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.076 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:11.076 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:11.076 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:11.076 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83595 2024-04-26T10:22:11.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.076 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:11.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:11.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849017+0000", 2024-04-26T10:22:11.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:11.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849041+0000", 2024-04-26T10:22:11.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4239999999999998e-05 2024-04-26T10:22:11.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849048+0000", 2024-04-26T10:22:11.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4669999999999998e-06 2024-04-26T10:22:11.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849053+0000", 2024-04-26T10:22:11.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3839999999999999e-06 2024-04-26T10:22:11.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849099+0000", 2024-04-26T10:22:11.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6579999999999998e-05 2024-04-26T10:22:11.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849246+0000", 2024-04-26T10:22:11.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014681899999999999 2024-04-26T10:22:11.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:11.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897498+0000", 2024-04-26T10:22:11.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048252002000000002 2024-04-26T10:22:11.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897544+0000", 2024-04-26T10:22:11.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5497999999999997e-05 2024-04-26T10:22:11.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897617+0000", 2024-04-26T10:22:11.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3143000000000001e-05 2024-04-26T10:22:11.080 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.080 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.080 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.080 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83597 5.d 5:b4b0a3ad:::benchmark_data_smithi052_19421_object83596:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:11.080 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:11.081 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.16805831299999999, 2024-04-26T10:22:11.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.047933286999999998, 2024-04-26T10:22:11.081 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.081 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.081 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:11.081 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:11.081 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:11.081 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83597 2024-04-26T10:22:11.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.081 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:11.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:11.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849282+0000", 2024-04-26T10:22:11.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:11.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849384+0000", 2024-04-26T10:22:11.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010128600000000001 2024-04-26T10:22:11.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849392+0000", 2024-04-26T10:22:11.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4290000000000001e-06 2024-04-26T10:22:11.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849398+0000", 2024-04-26T10:22:11.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8969999999999996e-06 2024-04-26T10:22:11.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849481+0000", 2024-04-26T10:22:11.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3088000000000001e-05 2024-04-26T10:22:11.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849639+0000", 2024-04-26T10:22:11.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015797200000000001 2024-04-26T10:22:11.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:11.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849782+0000", 2024-04-26T10:22:11.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014353599999999999 2024-04-26T10:22:11.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:11.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894335+0000", 2024-04-26T10:22:11.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044552500000000002 2024-04-26T10:22:11.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:11.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896955+0000", 2024-04-26T10:22:11.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002620229 2024-04-26T10:22:11.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897051+0000", 2024-04-26T10:22:11.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5847999999999994e-05 2024-04-26T10:22:11.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897216+0000", 2024-04-26T10:22:11.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016519700000000001 2024-04-26T10:22:11.086 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.086 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.086 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.087 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83598 5.7 5:e1984dee:::benchmark_data_smithi052_19421_object83597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:11.087 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:11.087 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.16793228299999999, 2024-04-26T10:22:11.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.049315405999999999, 2024-04-26T10:22:11.087 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.087 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.087 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:11.087 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:11.087 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:11.087 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83598 2024-04-26T10:22:11.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.087 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:11.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:11.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849408+0000", 2024-04-26T10:22:11.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:11.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849466+0000", 2024-04-26T10:22:11.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7302000000000001e-05 2024-04-26T10:22:11.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849473+0000", 2024-04-26T10:22:11.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4900000000000003e-06 2024-04-26T10:22:11.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849479+0000", 2024-04-26T10:22:11.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3539999999999999e-06 2024-04-26T10:22:11.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849526+0000", 2024-04-26T10:22:11.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7246999999999997e-05 2024-04-26T10:22:11.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849677+0000", 2024-04-26T10:22:11.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000151218 2024-04-26T10:22:11.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:11.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898591+0000", 2024-04-26T10:22:11.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048914343999999998 2024-04-26T10:22:11.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898650+0000", 2024-04-26T10:22:11.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8288999999999997e-05 2024-04-26T10:22:11.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898724+0000", 2024-04-26T10:22:11.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4782000000000003e-05 2024-04-26T10:22:11.092 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.092 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.092 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.092 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83599 5.3 5:c6d96bef:::benchmark_data_smithi052_19421_object83598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:11.092 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:11.092 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.16592880199999999, 2024-04-26T10:22:11.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050758893999999999, 2024-04-26T10:22:11.092 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.092 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.092 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:11.092 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:11.092 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83599 2024-04-26T10:22:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851411+0000", 2024-04-26T10:22:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851465+0000", 2024-04-26T10:22:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3943999999999997e-05 2024-04-26T10:22:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851475+0000", 2024-04-26T10:22:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0220999999999999e-05 2024-04-26T10:22:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851482+0000", 2024-04-26T10:22:11.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3259999999999998e-06 2024-04-26T10:22:11.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851525+0000", 2024-04-26T10:22:11.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2255000000000001e-05 2024-04-26T10:22:11.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851617+0000", 2024-04-26T10:22:11.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2436999999999996e-05 2024-04-26T10:22:11.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:11.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902102+0000", 2024-04-26T10:22:11.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050485163 2024-04-26T10:22:11.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902130+0000", 2024-04-26T10:22:11.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8177000000000001e-05 2024-04-26T10:22:11.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902171+0000", 2024-04-26T10:22:11.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1091999999999999e-05 2024-04-26T10:22:11.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.097 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.097 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83596 5.b e41/37 5:d54e48a0:::benchmark_data_smithi052_19421_object83595:head v 41'5143, mlcod=41'5140)", 2024-04-26T10:22:11.097 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:11.097 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.16571847200000001, 2024-04-26T10:22:11.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050472416999999999, 2024-04-26T10:22:11.097 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.098 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.098 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:11.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:11.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851621+0000", 2024-04-26T10:22:11.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:11.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851628+0000", 2024-04-26T10:22:11.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:22:11.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851635+0000", 2024-04-26T10:22:11.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6009999999999997e-06 2024-04-26T10:22:11.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851646+0000", 2024-04-26T10:22:11.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1248e-05 2024-04-26T10:22:11.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851687+0000", 2024-04-26T10:22:11.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1004999999999998e-05 2024-04-26T10:22:11.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851706+0000", 2024-04-26T10:22:11.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8994000000000001e-05 2024-04-26T10:22:11.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902062+0000", 2024-04-26T10:22:11.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050355957999999999 2024-04-26T10:22:11.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902095+0000", 2024-04-26T10:22:11.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2882000000000001e-05 2024-04-26T10:22:11.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.101 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.101 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83601 5.d 5:b32b06d1:::benchmark_data_smithi052_19421_object83600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:11.101 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:11.101 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.16541175599999999, 2024-04-26T10:22:11.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045519045000000001, 2024-04-26T10:22:11.102 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.102 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:11.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:11.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:11.102 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83601 2024-04-26T10:22:11.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.102 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:11.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:11.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851929+0000", 2024-04-26T10:22:11.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:11.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852104+0000", 2024-04-26T10:22:11.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175234 2024-04-26T10:22:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852110+0000", 2024-04-26T10:22:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.66e-06 2024-04-26T10:22:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852114+0000", 2024-04-26T10:22:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7809999999999999e-06 2024-04-26T10:22:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852153+0000", 2024-04-26T10:22:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9576000000000002e-05 2024-04-26T10:22:11.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852283+0000", 2024-04-26T10:22:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012946600000000001 2024-04-26T10:22:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852415+0000", 2024-04-26T10:22:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132719 2024-04-26T10:22:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894427+0000", 2024-04-26T10:22:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042011497000000002 2024-04-26T10:22:11.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897231+0000", 2024-04-26T10:22:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002804239 2024-04-26T10:22:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897306+0000", 2024-04-26T10:22:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4771999999999995e-05 2024-04-26T10:22:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897449+0000", 2024-04-26T10:22:11.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142707 2024-04-26T10:22:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83604 5.2 5:41ebe09c:::benchmark_data_smithi052_19421_object83603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.16521876899999999, 2024-04-26T10:22:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044923596000000003, 2024-04-26T10:22:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:11.107 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83604 2024-04-26T10:22:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852122+0000", 2024-04-26T10:22:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852149+0000", 2024-04-26T10:22:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7596000000000001e-05 2024-04-26T10:22:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852154+0000", 2024-04-26T10:22:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0889999999999999e-06 2024-04-26T10:22:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852158+0000", 2024-04-26T10:22:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2830000000000002e-06 2024-04-26T10:22:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852194+0000", 2024-04-26T10:22:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6062000000000001e-05 2024-04-26T10:22:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852276+0000", 2024-04-26T10:22:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1891000000000006e-05 2024-04-26T10:22:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896782+0000", 2024-04-26T10:22:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044506271 2024-04-26T10:22:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896875+0000", 2024-04-26T10:22:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3499999999999996e-05 2024-04-26T10:22:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897046+0000", 2024-04-26T10:22:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017065200000000001 2024-04-26T10:22:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.111 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83606 5.1 5:81602529:::benchmark_data_smithi052_19421_object83605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.16490113200000001, 2024-04-26T10:22:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045300391000000002, 2024-04-26T10:22:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83606 2024-04-26T10:22:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852439+0000", 2024-04-26T10:22:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852535+0000", 2024-04-26T10:22:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6025000000000003e-05 2024-04-26T10:22:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852545+0000", 2024-04-26T10:22:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3619999999999995e-06 2024-04-26T10:22:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852551+0000", 2024-04-26T10:22:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4500000000000001e-06 2024-04-26T10:22:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852588+0000", 2024-04-26T10:22:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6785000000000001e-05 2024-04-26T10:22:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852668+0000", 2024-04-26T10:22:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0008999999999999e-05 2024-04-26T10:22:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897625+0000", 2024-04-26T10:22:11.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044956744999999999 2024-04-26T10:22:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897667+0000", 2024-04-26T10:22:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1887000000000001e-05 2024-04-26T10:22:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897741+0000", 2024-04-26T10:22:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4023000000000006e-05 2024-04-26T10:22:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83605 5.4 e41/37 5:2eb72b61:::benchmark_data_smithi052_19421_object83604:head v 41'5272, mlcod=41'5269)", 2024-04-26T10:22:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.16449380399999999, 2024-04-26T10:22:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044651192999999999, 2024-04-26T10:22:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852851+0000", 2024-04-26T10:22:11.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4560000000000002e-06 2024-04-26T10:22:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852859+0000", 2024-04-26T10:22:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2169999999999997e-06 2024-04-26T10:22:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852864+0000", 2024-04-26T10:22:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-04-26T10:22:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852899+0000", 2024-04-26T10:22:11.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4987000000000002e-05 2024-04-26T10:22:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852916+0000", 2024-04-26T10:22:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7563000000000001e-05 2024-04-26T10:22:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897449+0000", 2024-04-26T10:22:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044532644000000003 2024-04-26T10:22:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897499+0000", 2024-04-26T10:22:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9734999999999997e-05 2024-04-26T10:22:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83607 5.6 5:66b4c91d:::benchmark_data_smithi052_19421_object83606:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.16236334999999999, 2024-04-26T10:22:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048173940999999998, 2024-04-26T10:22:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:11.121 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83607 2024-04-26T10:22:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854976+0000", 2024-04-26T10:22:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.855030+0000", 2024-04-26T10:22:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3436000000000001e-05 2024-04-26T10:22:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893759+0000", 2024-04-26T10:22:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.038729302 2024-04-26T10:22:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893777+0000", 2024-04-26T10:22:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7343e-05 2024-04-26T10:22:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893880+0000", 2024-04-26T10:22:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103285 2024-04-26T10:22:11.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894161+0000", 2024-04-26T10:22:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000280704 2024-04-26T10:22:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902948+0000", 2024-04-26T10:22:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087876059999999999 2024-04-26T10:22:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.903028+0000", 2024-04-26T10:22:11.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9486000000000004e-05 2024-04-26T10:22:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.903152+0000", 2024-04-26T10:22:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012426599999999999 2024-04-26T10:22:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:11.126 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:11.126 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:11.128 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:11.128 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:11.129 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:11.129 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:11.124+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:11.129 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:11.130 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:11.130 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:11.130 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:11.130 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:11.228 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:11.224+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:11.263 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:11.263 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:11.277 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:11.329 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:11.324+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:11.403 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:11.403 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:11.416 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:11.459 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:11.456+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:11.530 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:11.528+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:11.580 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:11.580 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:11.592 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:11.617 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 38 16 85118 85102 139.954 125.625 0.00624379 0.00713948 2024-04-26T10:22:11.632 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:11.628+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:11.725 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:11.726 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:11.732 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:11.728+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:11.739 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:11.755 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:22:11.832 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:11.828+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:11.874 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:11.875 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:11.888 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:11.933 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:11.928+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:12.022 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:12.022 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:12.034 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:12.028+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:12.037 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:12.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~24s 2024-04-26T10:22:12.137 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:12.132+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:12.168 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:12.168 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:12.181 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:12.236 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:12.232+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:12.303 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:12.303 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:12.316 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:12.337 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:12.332+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:12.438 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:12.432+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:12.448 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:12.448 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:12.460 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:12.539 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:12.536+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:12.592 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:12.592 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:12.606 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:12.617 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 39 16 87206 87190 139.711 130.5 0.00490887 0.00715166 2024-04-26T10:22:12.641 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:12.636+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:12.738 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:12.738 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:12.742 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:12.736+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:12.752 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:12.766 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T10:22:12.842 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:12.836+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:12.935 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:12.935 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:12.943 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:12.940+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:12.951 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:13.044 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:13.040+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:13.079 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:13.079 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:13.092 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:13.131 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:22:13.144 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:13.140+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:13.214 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:13.215 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:13.227 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:13.245 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:13.240+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:13.277 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:13.299 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:13.299 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:13.299 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:13.300 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:13.304 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:13.304 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:13.346 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:13.340+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:13.354 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.821479162999999, 2024-04-26T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:13.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:13.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:13.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.819496936, 2024-04-26T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:13.360 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:13.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:13.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.365 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.819297552, 2024-04-26T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:13.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.819078932, 2024-04-26T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:13.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:13.375 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.816707493999999, 2024-04-26T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:13.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:13.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:13.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:13.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:13.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:13.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:13.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:13.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:13.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:13.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:13.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:13.380 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.380 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.380 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.380 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:13.380 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:13.381 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.816606871999999, 2024-04-26T10:22:13.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:13.381 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.381 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.381 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:13.381 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:13.381 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.381 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:13.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.381 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:13.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:13.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.816488311000001, 2024-04-26T10:22:13.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:13.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.816385913, 2024-04-26T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65294 5.e 5:7438ad6f:::benchmark_data_smithi052_19421_object65293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:13.395 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.815705796, 2024-04-26T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091965517999999996, 2024-04-26T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65294 2024-04-26T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536413+0000", 2024-04-26T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536470+0000", 2024-04-26T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6443999999999997e-05 2024-04-26T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536480+0000", 2024-04-26T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0652999999999999e-05 2024-04-26T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536488+0000", 2024-04-26T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7929999999999998e-06 2024-04-26T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536548+0000", 2024-04-26T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9556999999999999e-05 2024-04-26T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536728+0000", 2024-04-26T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000180958 2024-04-26T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628168+0000", 2024-04-26T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091439276999999999 2024-04-26T10:22:13.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628258+0000", 2024-04-26T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0158e-05 2024-04-26T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628380+0000", 2024-04-26T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012180699999999999 2024-04-26T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.815365356000001, 2024-04-26T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:13.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:13.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.814215081, 2024-04-26T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.406 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:13.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:13.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:13.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:13.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:13.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:13.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65292 5.f e34/22 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head v 34'4129, mlcod=34'4125)", 2024-04-26T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.814040824999999, 2024-04-26T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093470155999999999, 2024-04-26T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.413 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538078+0000", 2024-04-26T10:22:13.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538140+0000", 2024-04-26T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1970000000000005e-05 2024-04-26T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538149+0000", 2024-04-26T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2189999999999993e-06 2024-04-26T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538158+0000", 2024-04-26T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0930000000000003e-06 2024-04-26T10:22:13.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627053+0000", 2024-04-26T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088895221999999996 2024-04-26T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627092+0000", 2024-04-26T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9657000000000003e-05 2024-04-26T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631499+0000", 2024-04-26T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044066560000000001 2024-04-26T10:22:13.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631549+0000", 2024-04-26T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0259000000000001e-05 2024-04-26T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65298 5.b 5:d51c4e52:::benchmark_data_smithi052_19421_object65297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.813274368, 2024-04-26T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091641671999999993, 2024-04-26T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.417 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65298 2024-04-26T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538844+0000", 2024-04-26T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538919+0000", 2024-04-26T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4626e-05 2024-04-26T10:22:13.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626007+0000", 2024-04-26T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087087516000000004 2024-04-26T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626074+0000", 2024-04-26T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7077999999999997e-05 2024-04-26T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626150+0000", 2024-04-26T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5982999999999994e-05 2024-04-26T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626341+0000", 2024-04-26T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019141199999999999 2024-04-26T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630359+0000", 2024-04-26T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040175710000000002 2024-04-26T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630412+0000", 2024-04-26T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3779000000000001e-05 2024-04-26T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630487+0000", 2024-04-26T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4913999999999995e-05 2024-04-26T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:81355 5.8 5:14f6458e:::benchmark_data_smithi052_19421_object81354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:13.422 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.5428373679999998, 2024-04-26T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027247422, 2024-04-26T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 81355 2024-04-26T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809281+0000", 2024-04-26T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809337+0000", 2024-04-26T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5627999999999997e-05 2024-04-26T10:22:13.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809349+0000", 2024-04-26T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1554e-05 2024-04-26T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809355+0000", 2024-04-26T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2559999999999999e-06 2024-04-26T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.823233+0000", 2024-04-26T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013877647999999999 2024-04-26T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.823361+0000", 2024-04-26T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012813500000000001 2024-04-26T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836404+0000", 2024-04-26T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013043592999999999 2024-04-26T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836468+0000", 2024-04-26T10:22:13.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3734999999999999e-05 2024-04-26T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836530+0000", 2024-04-26T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2065999999999998e-05 2024-04-26T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83591 5.4 5:204a1b6d:::benchmark_data_smithi052_19421_object83590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 2.5044061329999998, 2024-04-26T10:22:13.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.047988034999999998, 2024-04-26T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83591 2024-04-26T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847713+0000", 2024-04-26T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847784+0000", 2024-04-26T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0723999999999996e-05 2024-04-26T10:22:13.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847795+0000", 2024-04-26T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1538e-05 2024-04-26T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847810+0000", 2024-04-26T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4354e-05 2024-04-26T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847850+0000", 2024-04-26T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0750000000000001e-05 2024-04-26T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847974+0000", 2024-04-26T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012394899999999999 2024-04-26T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.848089+0000", 2024-04-26T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114527 2024-04-26T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852900+0000", 2024-04-26T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048110779999999999 2024-04-26T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895562+0000", 2024-04-26T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042662053999999998 2024-04-26T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895622+0000", 2024-04-26T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0470000000000002e-05 2024-04-26T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895702+0000", 2024-04-26T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9541000000000003e-05 2024-04-26T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83593 5.0 5:044bb3ac:::benchmark_data_smithi052_19421_object83592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 2.50251928, 2024-04-26T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.046164161000000002, 2024-04-26T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.433 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83593 2024-04-26T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849600+0000", 2024-04-26T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849655+0000", 2024-04-26T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5148999999999997e-05 2024-04-26T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849666+0000", 2024-04-26T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1494999999999999e-05 2024-04-26T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849677+0000", 2024-04-26T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0985000000000001e-05 2024-04-26T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849716+0000", 2024-04-26T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8698000000000001e-05 2024-04-26T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849822+0000", 2024-04-26T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000106173 2024-04-26T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849938+0000", 2024-04-26T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115738 2024-04-26T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853416+0000", 2024-04-26T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034777440000000001 2024-04-26T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895540+0000", 2024-04-26T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042124704999999998 2024-04-26T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895619+0000", 2024-04-26T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8697999999999998e-05 2024-04-26T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895765+0000", 2024-04-26T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014579299999999999 2024-04-26T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.438 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83594 5.b 5:d024b819:::benchmark_data_smithi052_19421_object83593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 2.5024270419999999, 2024-04-26T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045938635999999998, 2024-04-26T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83594 2024-04-26T10:22:13.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849692+0000", 2024-04-26T10:22:13.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849730+0000", 2024-04-26T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7415e-05 2024-04-26T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849735+0000", 2024-04-26T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6350000000000003e-06 2024-04-26T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849740+0000", 2024-04-26T10:22:13.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4209999999999997e-06 2024-04-26T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849787+0000", 2024-04-26T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7166000000000002e-05 2024-04-26T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849915+0000", 2024-04-26T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012823700000000001 2024-04-26T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850038+0000", 2024-04-26T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012317 2024-04-26T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855812+0000", 2024-04-26T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057731340000000001 2024-04-26T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895504+0000", 2024-04-26T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.039692540999999998 2024-04-26T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895569+0000", 2024-04-26T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4443999999999995e-05 2024-04-26T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895632+0000", 2024-04-26T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3109999999999997e-05 2024-04-26T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83596 5.b 5:d54e48a0:::benchmark_data_smithi052_19421_object83595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:13.444 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 2.5016069610000002, 2024-04-26T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.053210201999999998, 2024-04-26T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83596 2024-04-26T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850512+0000", 2024-04-26T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850622+0000", 2024-04-26T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010927 2024-04-26T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850629+0000", 2024-04-26T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1690000000000003e-06 2024-04-26T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850633+0000", 2024-04-26T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4800000000000003e-06 2024-04-26T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852134+0000", 2024-04-26T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015011099999999999 2024-04-26T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852446+0000", 2024-04-26T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031107999999999998 2024-04-26T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852723+0000", 2024-04-26T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027751499999999999 2024-04-26T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861229+0000", 2024-04-26T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085055960000000007 2024-04-26T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903523+0000", 2024-04-26T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042294683999999999 2024-04-26T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903579+0000", 2024-04-26T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5751999999999997e-05 2024-04-26T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903723+0000", 2024-04-26T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014414199999999999 2024-04-26T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83603 5.b 5:d4896044:::benchmark_data_smithi052_19421_object83602:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 2.4986800740000001, 2024-04-26T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.053974093000000001, 2024-04-26T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.450 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83603 2024-04-26T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853439+0000", 2024-04-26T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853492+0000", 2024-04-26T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2265000000000002e-05 2024-04-26T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853504+0000", 2024-04-26T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2354999999999999e-05 2024-04-26T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853512+0000", 2024-04-26T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8630000000000008e-06 2024-04-26T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855839+0000", 2024-04-26T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002326776 2024-04-26T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855993+0000", 2024-04-26T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015428300000000001 2024-04-26T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.856138+0000", 2024-04-26T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000145427 2024-04-26T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:13.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861318+0000", 2024-04-26T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051795160000000003 2024-04-26T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907178+0000", 2024-04-26T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045859882999999997 2024-04-26T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907260+0000", 2024-04-26T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2133999999999997e-05 2024-04-26T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907414+0000", 2024-04-26T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015427400000000001 2024-04-26T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83605 5.4 5:2eb72b61:::benchmark_data_smithi052_19421_object83604:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 2.498600626, 2024-04-26T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045576089, 2024-04-26T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:13.456 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83605 2024-04-26T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:13.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853557+0000", 2024-04-26T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8423000000000001e-05 2024-04-26T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853573+0000", 2024-04-26T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6201e-05 2024-04-26T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853583+0000", 2024-04-26T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9129999999999998e-06 2024-04-26T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853625+0000", 2024-04-26T10:22:13.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1965000000000002e-05 2024-04-26T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853795+0000", 2024-04-26T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169946 2024-04-26T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853980+0000", 2024-04-26T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018517100000000001 2024-04-26T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861356+0000", 2024-04-26T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073759389999999998 2024-04-26T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.898899+0000", 2024-04-26T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.037542786000000002 2024-04-26T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.898963+0000", 2024-04-26T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3652999999999995e-05 2024-04-26T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:13.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:13.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.899095+0000", 2024-04-26T10:22:13.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013286999999999999 2024-04-26T10:22:13.462 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.462 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.462 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.462 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:13.462 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:13.462 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:13.463 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:13.460+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:13.464 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:13.564 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:13.560+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:13.596 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:89230 5.2 5:49ea53e1:::benchmark_data_smithi052_19421_object89229:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:13.588077+0000", 2024-04-26T10:22:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0063921530000000002, 2024-04-26T10:22:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064134179999999997, 2024-04-26T10:22:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:13.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 89230 2024-04-26T10:22:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.588077+0000", 2024-04-26T10:22:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.588077+0000", 2024-04-26T10:22:13.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.588076+0000", 2024-04-26T10:22:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.588138+0000", 2024-04-26T10:22:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1323999999999998e-05 2024-04-26T10:22:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.588156+0000", 2024-04-26T10:22:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8556e-05 2024-04-26T10:22:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.588163+0000", 2024-04-26T10:22:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7460000000000003e-06 2024-04-26T10:22:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.589641+0000", 2024-04-26T10:22:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001478236 2024-04-26T10:22:13.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.589733+0000", 2024-04-26T10:22:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1685000000000001e-05 2024-04-26T10:22:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:89231 5.c 5:365e5e91:::benchmark_data_smithi052_19421_object89230:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:13.588192+0000", 2024-04-26T10:22:13.600 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0062779639999999996, 2024-04-26T10:22:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063419210000000004, 2024-04-26T10:22:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 89231 2024-04-26T10:22:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.588192+0000", 2024-04-26T10:22:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.588192+0000", 2024-04-26T10:22:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.588191+0000", 2024-04-26T10:22:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.588225+0000", 2024-04-26T10:22:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4212999999999999e-05 2024-04-26T10:22:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.588236+0000", 2024-04-26T10:22:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0924000000000001e-05 2024-04-26T10:22:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.588241+0000", 2024-04-26T10:22:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3630000000000002e-06 2024-04-26T10:22:13.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.588299+0000", 2024-04-26T10:22:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7219000000000002e-05 2024-04-26T10:22:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.588438+0000", 2024-04-26T10:22:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013948699999999999 2024-04-26T10:22:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.604 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:89232 5.b e42/37 5:d5cf9c2f:::benchmark_data_smithi052_19421_object89231:head v 42'5518, mlcod=42'5514)", 2024-04-26T10:22:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:13.590624+0000", 2024-04-26T10:22:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003845106, 2024-04-26T10:22:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039523750000000002, 2024-04-26T10:22:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.590624+0000", 2024-04-26T10:22:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.590624+0000", 2024-04-26T10:22:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.590624+0000", 2024-04-26T10:22:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.590630+0000", 2024-04-26T10:22:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7179999999999999e-06 2024-04-26T10:22:13.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.590642+0000", 2024-04-26T10:22:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2136999999999999e-05 2024-04-26T10:22:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.590651+0000", 2024-04-26T10:22:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7630000000000006e-06 2024-04-26T10:22:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.590700+0000", 2024-04-26T10:22:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9082000000000002e-05 2024-04-26T10:22:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.590722+0000", 2024-04-26T10:22:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1988999999999999e-05 2024-04-26T10:22:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.608 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:89225 5.0 e42/37 5:0fcf1d32:::benchmark_data_smithi052_19421_object89224:head v 42'5547, mlcod=42'5542)", 2024-04-26T10:22:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:13.590941+0000", 2024-04-26T10:22:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003528841, 2024-04-26T10:22:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036675620000000001, 2024-04-26T10:22:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.590941+0000", 2024-04-26T10:22:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.590941+0000", 2024-04-26T10:22:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.590940+0000", 2024-04-26T10:22:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.590946+0000", 2024-04-26T10:22:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1310000000000003e-06 2024-04-26T10:22:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.590960+0000", 2024-04-26T10:22:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4124999999999999e-05 2024-04-26T10:22:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.590966+0000", 2024-04-26T10:22:13.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8760000000000002e-06 2024-04-26T10:22:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.591018+0000", 2024-04-26T10:22:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2326e-05 2024-04-26T10:22:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.591034+0000", 2024-04-26T10:22:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5852e-05 2024-04-26T10:22:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:89234 5.1 5:89ab5ef7:::benchmark_data_smithi052_19421_object89233:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:13.591791+0000", 2024-04-26T10:22:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0026783620000000001, 2024-04-26T10:22:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028507110000000001, 2024-04-26T10:22:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 89234 2024-04-26T10:22:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.591791+0000", 2024-04-26T10:22:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.591791+0000", 2024-04-26T10:22:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.591790+0000", 2024-04-26T10:22:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:13.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.591818+0000", 2024-04-26T10:22:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8187999999999998e-05 2024-04-26T10:22:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.591832+0000", 2024-04-26T10:22:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3494e-05 2024-04-26T10:22:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.591839+0000", 2024-04-26T10:22:13.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9569999999999996e-06 2024-04-26T10:22:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.591883+0000", 2024-04-26T10:22:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4849999999999999e-05 2024-04-26T10:22:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.592034+0000", 2024-04-26T10:22:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015105300000000001 2024-04-26T10:22:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:89235 5.4 e42/37 5:2e3917b5:::benchmark_data_smithi052_19421_object89234:head v 42'5617, mlcod=42'5615)", 2024-04-26T10:22:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:13.592167+0000", 2024-04-26T10:22:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0023025900000000002, 2024-04-26T10:22:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025080079999999999, 2024-04-26T10:22:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.592167+0000", 2024-04-26T10:22:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.592167+0000", 2024-04-26T10:22:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.592166+0000", 2024-04-26T10:22:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.592172+0000", 2024-04-26T10:22:13.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.254e-06 2024-04-26T10:22:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.592179+0000", 2024-04-26T10:22:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3069999999999997e-06 2024-04-26T10:22:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.592184+0000", 2024-04-26T10:22:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0010000000000001e-06 2024-04-26T10:22:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.592225+0000", 2024-04-26T10:22:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0609999999999999e-05 2024-04-26T10:22:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.592237+0000", 2024-04-26T10:22:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2344000000000001e-05 2024-04-26T10:22:13.620 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:89237 5.7 5:ed89e4ec:::benchmark_data_smithi052_19421_object89236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:13.592547+0000", 2024-04-26T10:22:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0019224310000000001, 2024-04-26T10:22:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002158938, 2024-04-26T10:22:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.621 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 89237 2024-04-26T10:22:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.592547+0000", 2024-04-26T10:22:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.592547+0000", 2024-04-26T10:22:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.592546+0000", 2024-04-26T10:22:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.592612+0000", 2024-04-26T10:22:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5345999999999994e-05 2024-04-26T10:22:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.592620+0000", 2024-04-26T10:22:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.636e-06 2024-04-26T10:22:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.592625+0000", 2024-04-26T10:22:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3379999999999998e-06 2024-04-26T10:22:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.592675+0000", 2024-04-26T10:22:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0361000000000001e-05 2024-04-26T10:22:13.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.592816+0000", 2024-04-26T10:22:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014125800000000001 2024-04-26T10:22:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:89238 5.c 5:37187759:::benchmark_data_smithi052_19421_object89237:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:13.593167+0000", 2024-04-26T10:22:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0013026769999999999, 2024-04-26T10:22:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00157891, 2024-04-26T10:22:13.625 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 89238 2024-04-26T10:22:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.593167+0000", 2024-04-26T10:22:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.593167+0000", 2024-04-26T10:22:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.593166+0000", 2024-04-26T10:22:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.593258+0000", 2024-04-26T10:22:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2143000000000002e-05 2024-04-26T10:22:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.593267+0000", 2024-04-26T10:22:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.602e-06 2024-04-26T10:22:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.593271+0000", 2024-04-26T10:22:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2300000000000002e-06 2024-04-26T10:22:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.593297+0000", 2024-04-26T10:22:13.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5707e-05 2024-04-26T10:22:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.593395+0000", 2024-04-26T10:22:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8510000000000004e-05 2024-04-26T10:22:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:89233 5.0 e42/37 5:0bef5a8d:::benchmark_data_smithi052_19421_object89232:head v 42'5548, mlcod=42'5543)", 2024-04-26T10:22:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:13.594057+0000", 2024-04-26T10:22:13.629 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00041265200000000001, 2024-04-26T10:22:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00072197299999999999, 2024-04-26T10:22:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594057+0000", 2024-04-26T10:22:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594057+0000", 2024-04-26T10:22:13.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594056+0000", 2024-04-26T10:22:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594062+0000", 2024-04-26T10:22:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9719999999999997e-06 2024-04-26T10:22:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594069+0000", 2024-04-26T10:22:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7599999999999997e-06 2024-04-26T10:22:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594074+0000", 2024-04-26T10:22:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3310000000000003e-06 2024-04-26T10:22:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594108+0000", 2024-04-26T10:22:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3331999999999999e-05 2024-04-26T10:22:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594126+0000", 2024-04-26T10:22:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8732e-05 2024-04-26T10:22:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:89239 5.1 5:85cf09c3:::benchmark_data_smithi052_19421_object89238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:13.594558+0000", 2024-04-26T10:22:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999118, 2024-04-26T10:22:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026155800000000001, 2024-04-26T10:22:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-04-26T10:22:13.633 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 89239 2024-04-26T10:22:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594558+0000", 2024-04-26T10:22:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594558+0000", 2024-04-26T10:22:13.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594557+0000", 2024-04-26T10:22:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594669+0000", 2024-04-26T10:22:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112692 2024-04-26T10:22:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594683+0000", 2024-04-26T10:22:13.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3125000000000001e-05 2024-04-26T10:22:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594689+0000", 2024-04-26T10:22:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4579999999999998e-06 2024-04-26T10:22:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594722+0000", 2024-04-26T10:22:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2663999999999998e-05 2024-04-26T10:22:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:89241 5.c 5.4ca6052c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:13.594700+0000", 2024-04-26T10:22:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9997697, 2024-04-26T10:22:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015259299999999999, 2024-04-26T10:22:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 89241 2024-04-26T10:22:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594700+0000", 2024-04-26T10:22:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594700+0000", 2024-04-26T10:22:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594699+0000", 2024-04-26T10:22:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594762+0000", 2024-04-26T10:22:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2606000000000003e-05 2024-04-26T10:22:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594775+0000", 2024-04-26T10:22:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3508e-05 2024-04-26T10:22:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:13.594790+0000", 2024-04-26T10:22:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4569999999999999e-05 2024-04-26T10:22:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.639 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.640 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.640 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.640 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:13.640 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 11 2024-04-26T10:22:13.640 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:13.640 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:2024-04-26T10:22:13.616613+0000 min lat: 0.00175409 max lat: 1.59487 avg lat: 0.00716447 2024-04-26T10:22:13.641 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-26T10:22:13.641 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 40 16 89284 89268 139.465 129.875 0.0109784 0.00716447 2024-04-26T10:22:13.641 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:13.665 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:13.660+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:13.745 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2024-04-26T10:22:13.746 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-26T10:22:13.746 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2024-04-26T10:22:13.746 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi164.front.sepia.ceph.com 2024-04-26T10:22:13.746 INFO:teuthology.orchestra.console.smithi164:Power on 2024-04-26T10:22:13.746 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-26T10:22:13.766 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:13.760+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:13.771 DEBUG:teuthology.orchestra.console.smithi164:power on output: Chassis Power Control: Up/On 2024-04-26T10:22:13.771 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T10:22:13.780 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:13.780 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:13.780 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:13.780 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:13.781 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:13.791 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:13.797 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-04-26T10:22:13.867 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:13.860+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:13.924 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:13.924 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.391782882999999, 2024-04-26T10:22:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:13.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:13.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:13.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.387247671000001, 2024-04-26T10:22:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:13.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:13.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:13.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:13.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.386616378999999, 2024-04-26T10:22:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:13.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:13.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65604 5.9 5:9c239c32:::benchmark_data_smithi052_19421_object65603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.151513495, 2024-04-26T10:22:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025897677000000001, 2024-04-26T10:22:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65604 2024-04-26T10:22:13.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769615+0000", 2024-04-26T10:22:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769694+0000", 2024-04-26T10:22:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9087999999999999e-05 2024-04-26T10:22:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769702+0000", 2024-04-26T10:22:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8150000000000006e-06 2024-04-26T10:22:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769709+0000", 2024-04-26T10:22:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:22:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772336+0000", 2024-04-26T10:22:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002626836 2024-04-26T10:22:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772470+0000", 2024-04-26T10:22:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013453299999999999 2024-04-26T10:22:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772605+0000", 2024-04-26T10:22:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013428499999999999 2024-04-26T10:22:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779374+0000", 2024-04-26T10:22:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067694000000000001 2024-04-26T10:22:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795401+0000", 2024-04-26T10:22:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016026543000000001 2024-04-26T10:22:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795461+0000", 2024-04-26T10:22:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9923999999999998e-05 2024-04-26T10:22:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795513+0000", 2024-04-26T10:22:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2737e-05 2024-04-26T10:22:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65613 5.1 5:85cc6530:::benchmark_data_smithi052_19421_object65612:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:13.948 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.149140449000001, 2024-04-26T10:22:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023662843999999999, 2024-04-26T10:22:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65613 2024-04-26T10:22:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771988+0000", 2024-04-26T10:22:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772053+0000", 2024-04-26T10:22:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5067000000000006e-05 2024-04-26T10:22:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772065+0000", 2024-04-26T10:22:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2252999999999999e-05 2024-04-26T10:22:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772072+0000", 2024-04-26T10:22:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1400000000000002e-06 2024-04-26T10:22:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779354+0000", 2024-04-26T10:22:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072818120000000004 2024-04-26T10:22:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779455+0000", 2024-04-26T10:22:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101109 2024-04-26T10:22:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795526+0000", 2024-04-26T10:22:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016071203999999999 2024-04-26T10:22:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795572+0000", 2024-04-26T10:22:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5865999999999998e-05 2024-04-26T10:22:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795651+0000", 2024-04-26T10:22:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9192999999999999e-05 2024-04-26T10:22:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65614 5.9 5:993a4fbe:::benchmark_data_smithi052_19421_object65613:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:13.953 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.149048258000001, 2024-04-26T10:22:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023664145000000001, 2024-04-26T10:22:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65614 2024-04-26T10:22:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:13.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772080+0000", 2024-04-26T10:22:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772117+0000", 2024-04-26T10:22:13.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6418000000000003e-05 2024-04-26T10:22:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772124+0000", 2024-04-26T10:22:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4730000000000003e-06 2024-04-26T10:22:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772132+0000", 2024-04-26T10:22:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3900000000000004e-06 2024-04-26T10:22:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781379+0000", 2024-04-26T10:22:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092471059999999997 2024-04-26T10:22:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781495+0000", 2024-04-26T10:22:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001159 2024-04-26T10:22:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781581+0000", 2024-04-26T10:22:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6087000000000004e-05 2024-04-26T10:22:13.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.785948+0000", 2024-04-26T10:22:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043671669999999999 2024-04-26T10:22:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795661+0000", 2024-04-26T10:22:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097130310000000004 2024-04-26T10:22:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:13.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795710+0000", 2024-04-26T10:22:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8959000000000003e-05 2024-04-26T10:22:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795745+0000", 2024-04-26T10:22:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5172000000000001e-05 2024-04-26T10:22:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83591 5.4 e41/37 5:204a1b6d:::benchmark_data_smithi052_19421_object83590:head v 41'5271, mlcod=41'5268)", 2024-04-26T10:22:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:13.959 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.0741409759999998, 2024-04-26T10:22:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.046802200000000002, 2024-04-26T10:22:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846987+0000", 2024-04-26T10:22:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846995+0000", 2024-04-26T10:22:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7549999999999994e-06 2024-04-26T10:22:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847004+0000", 2024-04-26T10:22:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3190000000000001e-06 2024-04-26T10:22:13.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847011+0000", 2024-04-26T10:22:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5039999999999999e-06 2024-04-26T10:22:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847048+0000", 2024-04-26T10:22:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7052999999999999e-05 2024-04-26T10:22:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847066+0000", 2024-04-26T10:22:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8468999999999999e-05 2024-04-26T10:22:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893707+0000", 2024-04-26T10:22:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.046641123999999999 2024-04-26T10:22:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893790+0000", 2024-04-26T10:22:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2806999999999995e-05 2024-04-26T10:22:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83592 5.3 5:c96af6b1:::benchmark_data_smithi052_19421_object83591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.0728078320000001, 2024-04-26T10:22:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045543839000000003, 2024-04-26T10:22:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83592 2024-04-26T10:22:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848320+0000", 2024-04-26T10:22:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848465+0000", 2024-04-26T10:22:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000145291 2024-04-26T10:22:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848475+0000", 2024-04-26T10:22:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6709999999999994e-06 2024-04-26T10:22:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848482+0000", 2024-04-26T10:22:13.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2910000000000002e-06 2024-04-26T10:22:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848532+0000", 2024-04-26T10:22:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9199000000000001e-05 2024-04-26T10:22:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848676+0000", 2024-04-26T10:22:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014493399999999999 2024-04-26T10:22:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893707+0000", 2024-04-26T10:22:13.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045030857000000001 2024-04-26T10:22:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893772+0000", 2024-04-26T10:22:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4203999999999997e-05 2024-04-26T10:22:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893865+0000", 2024-04-26T10:22:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3577000000000002e-05 2024-04-26T10:22:13.968 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83593 5.0 e41/37 5:044bb3ac:::benchmark_data_smithi052_19421_object83592:head v 41'5187, mlcod=41'5184)", 2024-04-26T10:22:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.072310415, 2024-04-26T10:22:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044951738999999998, 2024-04-26T10:22:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:13.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848818+0000", 2024-04-26T10:22:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848824+0000", 2024-04-26T10:22:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-04-26T10:22:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848895+0000", 2024-04-26T10:22:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1468000000000001e-05 2024-04-26T10:22:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848902+0000", 2024-04-26T10:22:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6229999999999999e-06 2024-04-26T10:22:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848955+0000", 2024-04-26T10:22:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3106000000000003e-05 2024-04-26T10:22:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848974+0000", 2024-04-26T10:22:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9598000000000001e-05 2024-04-26T10:22:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893703+0000", 2024-04-26T10:22:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044728315999999997 2024-04-26T10:22:13.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893770+0000", 2024-04-26T10:22:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7683999999999998e-05 2024-04-26T10:22:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83594 5.b e41/37 5:d024b819:::benchmark_data_smithi052_19421_object83593:head v 41'5142, mlcod=41'5140)", 2024-04-26T10:22:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.0722004059999999, 2024-04-26T10:22:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044760763000000002, 2024-04-26T10:22:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.973 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848928+0000", 2024-04-26T10:22:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848933+0000", 2024-04-26T10:22:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848952+0000", 2024-04-26T10:22:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8884000000000001e-05 2024-04-26T10:22:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848957+0000", 2024-04-26T10:22:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8470000000000003e-06 2024-04-26T10:22:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848980+0000", 2024-04-26T10:22:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2946999999999999e-05 2024-04-26T10:22:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848992+0000", 2024-04-26T10:22:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1882000000000001e-05 2024-04-26T10:22:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893623+0000", 2024-04-26T10:22:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044631381999999997 2024-04-26T10:22:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893689+0000", 2024-04-26T10:22:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6285999999999995e-05 2024-04-26T10:22:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83595 5.1 5:829f4097:::benchmark_data_smithi052_19421_object83594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.072111547, 2024-04-26T10:22:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048599369000000003, 2024-04-26T10:22:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83595 2024-04-26T10:22:13.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849017+0000", 2024-04-26T10:22:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849041+0000", 2024-04-26T10:22:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4239999999999998e-05 2024-04-26T10:22:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849048+0000", 2024-04-26T10:22:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4669999999999998e-06 2024-04-26T10:22:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849053+0000", 2024-04-26T10:22:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3839999999999999e-06 2024-04-26T10:22:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849099+0000", 2024-04-26T10:22:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6579999999999998e-05 2024-04-26T10:22:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849246+0000", 2024-04-26T10:22:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014681899999999999 2024-04-26T10:22:13.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897498+0000", 2024-04-26T10:22:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048252002000000002 2024-04-26T10:22:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897544+0000", 2024-04-26T10:22:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5497999999999997e-05 2024-04-26T10:22:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897617+0000", 2024-04-26T10:22:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3143000000000001e-05 2024-04-26T10:22:13.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83597 5.d 5:b4b0a3ad:::benchmark_data_smithi052_19421_object83596:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.0718461079999999, 2024-04-26T10:22:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.047933286999999998, 2024-04-26T10:22:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.983 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83597 2024-04-26T10:22:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849282+0000", 2024-04-26T10:22:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849384+0000", 2024-04-26T10:22:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010128600000000001 2024-04-26T10:22:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849392+0000", 2024-04-26T10:22:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4290000000000001e-06 2024-04-26T10:22:13.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849398+0000", 2024-04-26T10:22:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8969999999999996e-06 2024-04-26T10:22:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849481+0000", 2024-04-26T10:22:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3088000000000001e-05 2024-04-26T10:22:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849639+0000", 2024-04-26T10:22:13.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015797200000000001 2024-04-26T10:22:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849782+0000", 2024-04-26T10:22:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014353599999999999 2024-04-26T10:22:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894335+0000", 2024-04-26T10:22:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044552500000000002 2024-04-26T10:22:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896955+0000", 2024-04-26T10:22:13.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002620229 2024-04-26T10:22:13.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:13.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897051+0000", 2024-04-26T10:22:13.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5847999999999994e-05 2024-04-26T10:22:13.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:13.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897216+0000", 2024-04-26T10:22:13.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016519700000000001 2024-04-26T10:22:13.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.988 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.989 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83598 5.7 5:e1984dee:::benchmark_data_smithi052_19421_object83597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:13.989 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:13.989 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.0717200779999998, 2024-04-26T10:22:13.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.049315405999999999, 2024-04-26T10:22:13.989 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.989 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:13.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:13.989 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.989 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83598 2024-04-26T10:22:13.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.989 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:13.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:13.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849408+0000", 2024-04-26T10:22:13.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:13.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849466+0000", 2024-04-26T10:22:13.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7302000000000001e-05 2024-04-26T10:22:13.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849473+0000", 2024-04-26T10:22:13.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4900000000000003e-06 2024-04-26T10:22:13.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849479+0000", 2024-04-26T10:22:13.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3539999999999999e-06 2024-04-26T10:22:13.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849526+0000", 2024-04-26T10:22:13.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7246999999999997e-05 2024-04-26T10:22:13.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849677+0000", 2024-04-26T10:22:13.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000151218 2024-04-26T10:22:13.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:13.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898591+0000", 2024-04-26T10:22:13.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048914343999999998 2024-04-26T10:22:13.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:13.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898650+0000", 2024-04-26T10:22:13.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8288999999999997e-05 2024-04-26T10:22:13.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:13.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898724+0000", 2024-04-26T10:22:13.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4782000000000003e-05 2024-04-26T10:22:13.993 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.993 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.993 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.994 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83599 5.3 5:c6d96bef:::benchmark_data_smithi052_19421_object83598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:13.994 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:13.994 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.0697165970000002, 2024-04-26T10:22:13.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050758893999999999, 2024-04-26T10:22:13.994 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.994 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.994 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:13.994 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:13.994 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:13.994 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83599 2024-04-26T10:22:13.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.994 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:13.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:13.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:13.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:13.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851411+0000", 2024-04-26T10:22:13.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:13.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:13.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851465+0000", 2024-04-26T10:22:13.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3943999999999997e-05 2024-04-26T10:22:13.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:13.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851475+0000", 2024-04-26T10:22:13.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0220999999999999e-05 2024-04-26T10:22:13.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:13.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851482+0000", 2024-04-26T10:22:13.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3259999999999998e-06 2024-04-26T10:22:13.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:13.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851525+0000", 2024-04-26T10:22:13.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2255000000000001e-05 2024-04-26T10:22:13.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:13.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851617+0000", 2024-04-26T10:22:13.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2436999999999996e-05 2024-04-26T10:22:13.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:13.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902102+0000", 2024-04-26T10:22:13.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050485163 2024-04-26T10:22:13.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:13.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902130+0000", 2024-04-26T10:22:13.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8177000000000001e-05 2024-04-26T10:22:13.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:13.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902171+0000", 2024-04-26T10:22:13.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1091999999999999e-05 2024-04-26T10:22:13.998 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.998 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:13.998 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:13.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:13.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.999 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83596 5.b e41/37 5:d54e48a0:::benchmark_data_smithi052_19421_object83595:head v 41'5143, mlcod=41'5140)", 2024-04-26T10:22:13.999 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:13.999 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.069506267, 2024-04-26T10:22:13.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050472416999999999, 2024-04-26T10:22:13.999 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:13.999 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:13.999 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:13.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:13.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:13.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:13.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:13.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:14.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851621+0000", 2024-04-26T10:22:14.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:14.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851628+0000", 2024-04-26T10:22:14.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:22:14.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851635+0000", 2024-04-26T10:22:14.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6009999999999997e-06 2024-04-26T10:22:14.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851646+0000", 2024-04-26T10:22:14.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1248e-05 2024-04-26T10:22:14.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851687+0000", 2024-04-26T10:22:14.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1004999999999998e-05 2024-04-26T10:22:14.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851706+0000", 2024-04-26T10:22:14.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8994000000000001e-05 2024-04-26T10:22:14.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:14.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902062+0000", 2024-04-26T10:22:14.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050355957999999999 2024-04-26T10:22:14.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:14.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902095+0000", 2024-04-26T10:22:14.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2882000000000001e-05 2024-04-26T10:22:14.003 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.003 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.003 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.003 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83601 5.d 5:b32b06d1:::benchmark_data_smithi052_19421_object83600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:14.003 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:14.003 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.0691995510000001, 2024-04-26T10:22:14.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045519045000000001, 2024-04-26T10:22:14.003 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.003 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:14.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:14.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.004 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83601 2024-04-26T10:22:14.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.004 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:14.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:14.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851929+0000", 2024-04-26T10:22:14.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:14.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852104+0000", 2024-04-26T10:22:14.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175234 2024-04-26T10:22:14.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852110+0000", 2024-04-26T10:22:14.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.66e-06 2024-04-26T10:22:14.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852114+0000", 2024-04-26T10:22:14.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7809999999999999e-06 2024-04-26T10:22:14.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852153+0000", 2024-04-26T10:22:14.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9576000000000002e-05 2024-04-26T10:22:14.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852283+0000", 2024-04-26T10:22:14.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012946600000000001 2024-04-26T10:22:14.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:14.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852415+0000", 2024-04-26T10:22:14.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132719 2024-04-26T10:22:14.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:14.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894427+0000", 2024-04-26T10:22:14.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042011497000000002 2024-04-26T10:22:14.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:14.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897231+0000", 2024-04-26T10:22:14.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002804239 2024-04-26T10:22:14.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:14.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897306+0000", 2024-04-26T10:22:14.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4771999999999995e-05 2024-04-26T10:22:14.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:14.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897449+0000", 2024-04-26T10:22:14.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142707 2024-04-26T10:22:14.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.008 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.009 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.009 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83604 5.2 5:41ebe09c:::benchmark_data_smithi052_19421_object83603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:14.009 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:14.009 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.0690065639999999, 2024-04-26T10:22:14.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044923596000000003, 2024-04-26T10:22:14.009 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.009 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:14.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:14.009 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.009 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83604 2024-04-26T10:22:14.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.009 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:14.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:14.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852122+0000", 2024-04-26T10:22:14.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852149+0000", 2024-04-26T10:22:14.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7596000000000001e-05 2024-04-26T10:22:14.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852154+0000", 2024-04-26T10:22:14.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0889999999999999e-06 2024-04-26T10:22:14.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852158+0000", 2024-04-26T10:22:14.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2830000000000002e-06 2024-04-26T10:22:14.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852194+0000", 2024-04-26T10:22:14.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6062000000000001e-05 2024-04-26T10:22:14.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852276+0000", 2024-04-26T10:22:14.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1891000000000006e-05 2024-04-26T10:22:14.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:14.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896782+0000", 2024-04-26T10:22:14.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044506271 2024-04-26T10:22:14.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:14.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896875+0000", 2024-04-26T10:22:14.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3499999999999996e-05 2024-04-26T10:22:14.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:14.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897046+0000", 2024-04-26T10:22:14.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017065200000000001 2024-04-26T10:22:14.013 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.014 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.014 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83606 5.1 5:81602529:::benchmark_data_smithi052_19421_object83605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:14.014 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:14.014 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.0686889270000002, 2024-04-26T10:22:14.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045300391000000002, 2024-04-26T10:22:14.014 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.014 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.014 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:14.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:14.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.015 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83606 2024-04-26T10:22:14.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.015 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:14.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:14.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852439+0000", 2024-04-26T10:22:14.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852535+0000", 2024-04-26T10:22:14.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6025000000000003e-05 2024-04-26T10:22:14.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852545+0000", 2024-04-26T10:22:14.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3619999999999995e-06 2024-04-26T10:22:14.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852551+0000", 2024-04-26T10:22:14.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4500000000000001e-06 2024-04-26T10:22:14.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852588+0000", 2024-04-26T10:22:14.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6785000000000001e-05 2024-04-26T10:22:14.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852668+0000", 2024-04-26T10:22:14.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0008999999999999e-05 2024-04-26T10:22:14.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:14.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897625+0000", 2024-04-26T10:22:14.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044956744999999999 2024-04-26T10:22:14.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:14.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897667+0000", 2024-04-26T10:22:14.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1887000000000001e-05 2024-04-26T10:22:14.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:14.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897741+0000", 2024-04-26T10:22:14.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4023000000000006e-05 2024-04-26T10:22:14.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.019 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.019 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83605 5.4 e41/37 5:2eb72b61:::benchmark_data_smithi052_19421_object83604:head v 41'5272, mlcod=41'5269)", 2024-04-26T10:22:14.019 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:14.019 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.0682815990000001, 2024-04-26T10:22:14.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044651192999999999, 2024-04-26T10:22:14.019 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.019 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.019 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:14.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:14.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:14.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:14.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852851+0000", 2024-04-26T10:22:14.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4560000000000002e-06 2024-04-26T10:22:14.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852859+0000", 2024-04-26T10:22:14.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2169999999999997e-06 2024-04-26T10:22:14.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852864+0000", 2024-04-26T10:22:14.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-04-26T10:22:14.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852899+0000", 2024-04-26T10:22:14.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4987000000000002e-05 2024-04-26T10:22:14.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852916+0000", 2024-04-26T10:22:14.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7563000000000001e-05 2024-04-26T10:22:14.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:14.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897449+0000", 2024-04-26T10:22:14.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044532644000000003 2024-04-26T10:22:14.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:14.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897499+0000", 2024-04-26T10:22:14.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9734999999999997e-05 2024-04-26T10:22:14.023 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.023 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.023 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.023 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83607 5.6 5:66b4c91d:::benchmark_data_smithi052_19421_object83606:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:14.024 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:14.024 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 3.0661511450000001, 2024-04-26T10:22:14.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048173940999999998, 2024-04-26T10:22:14.024 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.024 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.024 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:14.024 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:14.024 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.024 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83607 2024-04-26T10:22:14.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.024 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:14.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854976+0000", 2024-04-26T10:22:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.855030+0000", 2024-04-26T10:22:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3436000000000001e-05 2024-04-26T10:22:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893759+0000", 2024-04-26T10:22:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.038729302 2024-04-26T10:22:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893777+0000", 2024-04-26T10:22:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7343e-05 2024-04-26T10:22:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893880+0000", 2024-04-26T10:22:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103285 2024-04-26T10:22:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894161+0000", 2024-04-26T10:22:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000280704 2024-04-26T10:22:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902948+0000", 2024-04-26T10:22:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087876059999999999 2024-04-26T10:22:14.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:14.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.903028+0000", 2024-04-26T10:22:14.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9486000000000004e-05 2024-04-26T10:22:14.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:14.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.903152+0000", 2024-04-26T10:22:14.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012426599999999999 2024-04-26T10:22:14.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.028 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.028 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.029 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:14.030 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:14.024+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:14.030 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:14.131 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:14.128+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:14.160 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:14.160 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:14.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.160 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:90353 5.e 5:79b65868:::benchmark_data_smithi052_19421_object90352:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:14.160 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:14.151875+0000", 2024-04-26T10:22:14.160 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0070247759999999999, 2024-04-26T10:22:14.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0070445610000000004, 2024-04-26T10:22:14.160 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.160 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:14.161 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.161 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.161 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.161 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 90353 2024-04-26T10:22:14.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.161 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.151875+0000", 2024-04-26T10:22:14.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.151875+0000", 2024-04-26T10:22:14.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.151874+0000", 2024-04-26T10:22:14.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:14.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.151907+0000", 2024-04-26T10:22:14.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3087999999999999e-05 2024-04-26T10:22:14.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.151917+0000", 2024-04-26T10:22:14.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0416e-05 2024-04-26T10:22:14.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.151925+0000", 2024-04-26T10:22:14.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9750000000000007e-06 2024-04-26T10:22:14.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.152906+0000", 2024-04-26T10:22:14.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00098114500000000011 2024-04-26T10:22:14.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153078+0000", 2024-04-26T10:22:14.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017141300000000001 2024-04-26T10:22:14.164 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.164 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.164 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.164 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:90360 5.b 5:d7ea576c:::benchmark_data_smithi052_19421_object90359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:14.164 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:14.153041+0000", 2024-04-26T10:22:14.164 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0058584839999999997, 2024-04-26T10:22:14.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059243400000000002, 2024-04-26T10:22:14.165 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.165 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:14.165 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.165 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.165 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.165 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 90360 2024-04-26T10:22:14.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.165 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153041+0000", 2024-04-26T10:22:14.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153041+0000", 2024-04-26T10:22:14.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153040+0000", 2024-04-26T10:22:14.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153175+0000", 2024-04-26T10:22:14.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013443799999999999 2024-04-26T10:22:14.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153186+0000", 2024-04-26T10:22:14.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1260999999999999e-05 2024-04-26T10:22:14.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153200+0000", 2024-04-26T10:22:14.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.393e-05 2024-04-26T10:22:14.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153253+0000", 2024-04-26T10:22:14.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2803999999999998e-05 2024-04-26T10:22:14.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153381+0000", 2024-04-26T10:22:14.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012857299999999999 2024-04-26T10:22:14.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:14.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153526+0000", 2024-04-26T10:22:14.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014458599999999999 2024-04-26T10:22:14.168 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.168 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.169 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.169 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:90361 5.e 5:73472073:::benchmark_data_smithi052_19421_object90360:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:14.169 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:14.153215+0000", 2024-04-26T10:22:14.169 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0056843639999999999, 2024-04-26T10:22:14.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057912950000000001, 2024-04-26T10:22:14.169 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.169 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:14.169 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.169 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.169 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.169 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 90361 2024-04-26T10:22:14.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.170 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153215+0000", 2024-04-26T10:22:14.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153215+0000", 2024-04-26T10:22:14.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153215+0000", 2024-04-26T10:22:14.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:14.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153260+0000", 2024-04-26T10:22:14.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4943e-05 2024-04-26T10:22:14.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153268+0000", 2024-04-26T10:22:14.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8159999999999994e-06 2024-04-26T10:22:14.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153274+0000", 2024-04-26T10:22:14.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0440000000000001e-06 2024-04-26T10:22:14.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.155332+0000", 2024-04-26T10:22:14.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020584679999999999 2024-04-26T10:22:14.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.155451+0000", 2024-04-26T10:22:14.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119306 2024-04-26T10:22:14.172 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.172 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.173 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.173 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:90362 5.a 5:5c9ca74c:::benchmark_data_smithi052_19421_object90361:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:14.173 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:14.153285+0000", 2024-04-26T10:22:14.173 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0056151619999999999, 2024-04-26T10:22:14.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057586970000000001, 2024-04-26T10:22:14.173 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.173 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:14.173 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.173 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.173 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.173 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 90362 2024-04-26T10:22:14.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.173 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153285+0000", 2024-04-26T10:22:14.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153285+0000", 2024-04-26T10:22:14.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153284+0000", 2024-04-26T10:22:14.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:14.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153321+0000", 2024-04-26T10:22:14.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6925999999999998e-05 2024-04-26T10:22:14.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153328+0000", 2024-04-26T10:22:14.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3889999999999999e-06 2024-04-26T10:22:14.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153334+0000", 2024-04-26T10:22:14.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9270000000000002e-06 2024-04-26T10:22:14.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153377+0000", 2024-04-26T10:22:14.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3028999999999997e-05 2024-04-26T10:22:14.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.153456+0000", 2024-04-26T10:22:14.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8695000000000005e-05 2024-04-26T10:22:14.176 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.176 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.176 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.177 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:90358 5.9 e42/37 5:97ae6f61:::benchmark_data_smithi052_19421_object90357:head v 42'5673, mlcod=42'5671)", 2024-04-26T10:22:14.177 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:14.155330+0000", 2024-04-26T10:22:14.177 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0035696669999999999, 2024-04-26T10:22:14.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0037481649999999999, 2024-04-26T10:22:14.177 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.177 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:14.177 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.155330+0000", 2024-04-26T10:22:14.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.155330+0000", 2024-04-26T10:22:14.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.155323+0000", 2024-04-26T10:22:14.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999924 2024-04-26T10:22:14.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.155371+0000", 2024-04-26T10:22:14.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8140999999999999e-05 2024-04-26T10:22:14.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.155380+0000", 2024-04-26T10:22:14.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1949999999999992e-06 2024-04-26T10:22:14.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.155386+0000", 2024-04-26T10:22:14.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3280000000000002e-06 2024-04-26T10:22:14.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.155433+0000", 2024-04-26T10:22:14.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6196000000000003e-05 2024-04-26T10:22:14.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.155456+0000", 2024-04-26T10:22:14.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3666999999999999e-05 2024-04-26T10:22:14.180 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.180 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.180 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.180 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:90364 5.b 5:dc84f772:::benchmark_data_smithi052_19421_object90363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:14.180 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:14.155552+0000", 2024-04-26T10:22:14.180 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0033481829999999998, 2024-04-26T10:22:14.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0035593690000000002, 2024-04-26T10:22:14.180 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.180 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:14.181 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.181 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.181 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.181 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 90364 2024-04-26T10:22:14.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.181 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.155552+0000", 2024-04-26T10:22:14.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.155552+0000", 2024-04-26T10:22:14.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.155550+0000", 2024-04-26T10:22:14.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:14.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.155694+0000", 2024-04-26T10:22:14.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000143261 2024-04-26T10:22:14.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.155705+0000", 2024-04-26T10:22:14.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1609e-05 2024-04-26T10:22:14.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.155718+0000", 2024-04-26T10:22:14.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:22:14.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.155832+0000", 2024-04-26T10:22:14.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011394 2024-04-26T10:22:14.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.155983+0000", 2024-04-26T10:22:14.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015186999999999999 2024-04-26T10:22:14.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:14.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.156156+0000", 2024-04-26T10:22:14.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017259799999999999 2024-04-26T10:22:14.184 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.184 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.184 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.184 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:90363 5.9 e42/37 5:924b56f4:::benchmark_data_smithi052_19421_object90362:head v 42'5674, mlcod=42'5671)", 2024-04-26T10:22:14.184 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:14.156050+0000", 2024-04-26T10:22:14.184 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0028500090000000001, 2024-04-26T10:22:14.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030980130000000002, 2024-04-26T10:22:14.185 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.185 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:14.185 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.156050+0000", 2024-04-26T10:22:14.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.156050+0000", 2024-04-26T10:22:14.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.156049+0000", 2024-04-26T10:22:14.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.156107+0000", 2024-04-26T10:22:14.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7504999999999999e-05 2024-04-26T10:22:14.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.156114+0000", 2024-04-26T10:22:14.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1389999999999998e-06 2024-04-26T10:22:14.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.156118+0000", 2024-04-26T10:22:14.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5809999999999998e-06 2024-04-26T10:22:14.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.157241+0000", 2024-04-26T10:22:14.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001123048 2024-04-26T10:22:14.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.157259+0000", 2024-04-26T10:22:14.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7382999999999999e-05 2024-04-26T10:22:14.188 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.188 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.188 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.188 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:90371 5.b 5:daa7e83d:::benchmark_data_smithi052_19421_object90370:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:14.188 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:14.157986+0000", 2024-04-26T10:22:14.188 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00091385200000000005, 2024-04-26T10:22:14.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001196463, 2024-04-26T10:22:14.188 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.188 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:14.189 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.189 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.189 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.189 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 90371 2024-04-26T10:22:14.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.189 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.157986+0000", 2024-04-26T10:22:14.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.157986+0000", 2024-04-26T10:22:14.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.157985+0000", 2024-04-26T10:22:14.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.158016+0000", 2024-04-26T10:22:14.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1272000000000001e-05 2024-04-26T10:22:14.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.158029+0000", 2024-04-26T10:22:14.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2629000000000001e-05 2024-04-26T10:22:14.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.158036+0000", 2024-04-26T10:22:14.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3069999999999997e-06 2024-04-26T10:22:14.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.158158+0000", 2024-04-26T10:22:14.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000121425 2024-04-26T10:22:14.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.158337+0000", 2024-04-26T10:22:14.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000179455 2024-04-26T10:22:14.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:14.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.158513+0000", 2024-04-26T10:22:14.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017556599999999999 2024-04-26T10:22:14.192 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.192 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.192 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.193 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:90367 5.d e42/37 5:b24a16ab:::benchmark_data_smithi052_19421_object90366:head v 42'5675, mlcod=42'5673)", 2024-04-26T10:22:14.193 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:14.158341+0000", 2024-04-26T10:22:14.193 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00055848599999999997, 2024-04-26T10:22:14.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00087750899999999995, 2024-04-26T10:22:14.193 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.193 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:14.193 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.158341+0000", 2024-04-26T10:22:14.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.158341+0000", 2024-04-26T10:22:14.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.158340+0000", 2024-04-26T10:22:14.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.158390+0000", 2024-04-26T10:22:14.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9740999999999997e-05 2024-04-26T10:22:14.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.158396+0000", 2024-04-26T10:22:14.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0279999999999997e-06 2024-04-26T10:22:14.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.158400+0000", 2024-04-26T10:22:14.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1540000000000004e-06 2024-04-26T10:22:14.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.158435+0000", 2024-04-26T10:22:14.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4326000000000003e-05 2024-04-26T10:22:14.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:14.158449+0000", 2024-04-26T10:22:14.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4718e-05 2024-04-26T10:22:14.196 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.196 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.196 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.196 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.196 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:14.196 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 9 2024-04-26T10:22:14.196 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:14.197 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:14.231 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:14.228+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:14.323 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:14.323 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:14.323 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:14.323 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:14.323 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:14.333 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:14.328+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:14.335 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:14.434 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:14.428+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:14.466 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:14.466 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:14.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:14.466 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:14.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.467 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:14.467 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:14.467 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.934053206, 2024-04-26T10:22:14.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:14.467 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.467 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.467 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.467 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.467 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.467 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:14.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.467 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:14.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:14.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:14.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:14.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:14.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:14.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:14.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:14.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:14.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:14.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:14.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:14.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:14.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:14.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:14.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:14.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:14.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:14.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:14.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:14.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:14.471 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.471 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.471 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.472 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:14.472 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:14.472 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.932070979000001, 2024-04-26T10:22:14.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:14.472 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.472 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.472 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.472 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.472 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.472 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:14.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.472 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:14.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:14.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:14.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:14.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:14.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:14.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:14.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:14.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:14.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:14.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:14.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:14.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:14.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:14.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:14.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:14.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:14.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:14.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:14.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:14.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:14.476 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.477 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.477 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.477 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:14.477 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:14.477 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.931871595, 2024-04-26T10:22:14.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:14.477 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.477 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.477 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.477 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.477 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.477 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:14.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.478 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:14.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:14.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:14.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:14.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:14.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:14.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:14.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:14.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:14.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:14.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:14.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:14.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:14.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:14.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:14.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:14.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:14.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:14.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:14.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:14.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:14.482 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.482 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.482 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.482 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:14.482 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:14.482 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.931652975, 2024-04-26T10:22:14.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:14.482 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.482 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.482 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:14.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:14.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:14.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:14.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:14.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:14.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:14.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:14.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:14.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:14.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:14.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:14.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:14.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:14.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:14.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:14.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:14.486 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.486 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.486 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.486 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:14.487 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:14.487 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.929281537, 2024-04-26T10:22:14.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:14.487 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.487 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.487 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.487 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.487 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.487 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:14.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.487 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:14.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:14.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:14.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:14.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:14.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:14.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:14.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:14.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:14.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:14.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:14.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:14.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:14.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:14.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:14.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:14.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:14.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:14.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:14.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:14.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:14.491 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.492 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.492 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.492 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:14.492 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:14.492 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.929180915, 2024-04-26T10:22:14.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:14.492 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.492 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.492 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.492 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.493 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.493 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:14.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.493 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:14.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:14.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:14.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:14.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:14.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:14.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:14.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:14.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:14.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:14.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:14.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:14.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:14.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:14.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:14.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:14.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:14.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:14.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:14.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:14.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:14.497 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.497 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.497 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.497 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:14.497 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:14.497 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.929062353999999, 2024-04-26T10:22:14.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:14.497 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.497 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.498 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:14.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:14.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:14.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:14.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:14.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:14.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:14.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:14.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:14.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:14.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:14.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:14.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:14.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:14.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:14.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:14.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:14.501 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.501 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.501 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.502 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:14.502 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:14.502 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.928959956, 2024-04-26T10:22:14.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:14.502 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.502 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.502 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.502 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.502 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.502 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:14.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.502 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:14.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:14.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:14.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:14.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:14.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:14.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:14.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:14.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:14.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:14.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:14.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:14.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:14.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:14.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:14.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:14.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:14.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:14.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:14.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:14.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:14.506 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.506 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.506 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.507 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65294 5.e 5:7438ad6f:::benchmark_data_smithi052_19421_object65293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:14.507 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:14.507 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.928279839, 2024-04-26T10:22:14.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091965517999999996, 2024-04-26T10:22:14.507 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.507 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.507 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.507 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.507 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.507 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65294 2024-04-26T10:22:14.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.507 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:14.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:14.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536413+0000", 2024-04-26T10:22:14.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536470+0000", 2024-04-26T10:22:14.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6443999999999997e-05 2024-04-26T10:22:14.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536480+0000", 2024-04-26T10:22:14.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0652999999999999e-05 2024-04-26T10:22:14.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536488+0000", 2024-04-26T10:22:14.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7929999999999998e-06 2024-04-26T10:22:14.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536548+0000", 2024-04-26T10:22:14.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9556999999999999e-05 2024-04-26T10:22:14.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536728+0000", 2024-04-26T10:22:14.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000180958 2024-04-26T10:22:14.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:14.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628168+0000", 2024-04-26T10:22:14.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091439276999999999 2024-04-26T10:22:14.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628258+0000", 2024-04-26T10:22:14.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0158e-05 2024-04-26T10:22:14.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628380+0000", 2024-04-26T10:22:14.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012180699999999999 2024-04-26T10:22:14.511 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.511 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.511 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.512 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:14.512 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:14.512 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.927939399, 2024-04-26T10:22:14.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:14.512 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.512 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.512 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.512 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.512 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.512 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:14.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.512 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:14.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:14.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:14.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:14.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:14.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:14.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:14.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:14.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:14.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:14.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:14.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:14.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:14.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:14.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:14.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:14.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:14.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:14.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:14.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:14.516 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.516 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.516 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.517 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:14.517 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:14.517 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.926789124000001, 2024-04-26T10:22:14.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:14.517 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.517 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.517 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.517 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.517 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.517 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:14.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.518 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:14.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:14.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:14.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:14.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:14.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:14.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:14.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:14.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:14.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:14.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:14.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:14.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:14.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:14.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:14.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:14.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:14.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:14.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:14.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:14.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:14.522 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.522 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.522 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.522 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65292 5.f e34/22 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head v 34'4129, mlcod=34'4125)", 2024-04-26T10:22:14.522 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:14.522 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.926614868, 2024-04-26T10:22:14.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093470155999999999, 2024-04-26T10:22:14.522 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.522 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.522 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:14.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:14.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538078+0000", 2024-04-26T10:22:14.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538140+0000", 2024-04-26T10:22:14.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1970000000000005e-05 2024-04-26T10:22:14.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538149+0000", 2024-04-26T10:22:14.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2189999999999993e-06 2024-04-26T10:22:14.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538158+0000", 2024-04-26T10:22:14.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0930000000000003e-06 2024-04-26T10:22:14.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627053+0000", 2024-04-26T10:22:14.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088895221999999996 2024-04-26T10:22:14.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627092+0000", 2024-04-26T10:22:14.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9657000000000003e-05 2024-04-26T10:22:14.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631499+0000", 2024-04-26T10:22:14.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044066560000000001 2024-04-26T10:22:14.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631549+0000", 2024-04-26T10:22:14.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0259000000000001e-05 2024-04-26T10:22:14.526 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.526 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.526 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.526 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65298 5.b 5:d51c4e52:::benchmark_data_smithi052_19421_object65297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:14.526 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:14.526 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.925848411, 2024-04-26T10:22:14.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091641671999999993, 2024-04-26T10:22:14.527 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.527 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.527 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.527 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.527 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.527 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65298 2024-04-26T10:22:14.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.527 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:14.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:14.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538844+0000", 2024-04-26T10:22:14.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:14.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538919+0000", 2024-04-26T10:22:14.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4626e-05 2024-04-26T10:22:14.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626007+0000", 2024-04-26T10:22:14.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087087516000000004 2024-04-26T10:22:14.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626074+0000", 2024-04-26T10:22:14.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7077999999999997e-05 2024-04-26T10:22:14.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626150+0000", 2024-04-26T10:22:14.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5982999999999994e-05 2024-04-26T10:22:14.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626341+0000", 2024-04-26T10:22:14.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019141199999999999 2024-04-26T10:22:14.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:14.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630359+0000", 2024-04-26T10:22:14.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040175710000000002 2024-04-26T10:22:14.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630412+0000", 2024-04-26T10:22:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3779000000000001e-05 2024-04-26T10:22:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630487+0000", 2024-04-26T10:22:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4913999999999995e-05 2024-04-26T10:22:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:81355 5.8 5:14f6458e:::benchmark_data_smithi052_19421_object81354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:14.531 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:14.532 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.6554114110000002, 2024-04-26T10:22:14.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027247422, 2024-04-26T10:22:14.532 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.532 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.532 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 81355 2024-04-26T10:22:14.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.532 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:14.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:14.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809281+0000", 2024-04-26T10:22:14.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:14.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809337+0000", 2024-04-26T10:22:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5627999999999997e-05 2024-04-26T10:22:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809349+0000", 2024-04-26T10:22:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1554e-05 2024-04-26T10:22:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809355+0000", 2024-04-26T10:22:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2559999999999999e-06 2024-04-26T10:22:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.823233+0000", 2024-04-26T10:22:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013877647999999999 2024-04-26T10:22:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.823361+0000", 2024-04-26T10:22:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012813500000000001 2024-04-26T10:22:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836404+0000", 2024-04-26T10:22:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013043592999999999 2024-04-26T10:22:14.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836468+0000", 2024-04-26T10:22:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3734999999999999e-05 2024-04-26T10:22:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836530+0000", 2024-04-26T10:22:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2065999999999998e-05 2024-04-26T10:22:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.536 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83591 5.4 5:204a1b6d:::benchmark_data_smithi052_19421_object83590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.6169801760000002, 2024-04-26T10:22:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.047988034999999998, 2024-04-26T10:22:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83591 2024-04-26T10:22:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:14.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:14.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847713+0000", 2024-04-26T10:22:14.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847784+0000", 2024-04-26T10:22:14.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0723999999999996e-05 2024-04-26T10:22:14.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847795+0000", 2024-04-26T10:22:14.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1538e-05 2024-04-26T10:22:14.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847810+0000", 2024-04-26T10:22:14.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4354e-05 2024-04-26T10:22:14.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847850+0000", 2024-04-26T10:22:14.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0750000000000001e-05 2024-04-26T10:22:14.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847974+0000", 2024-04-26T10:22:14.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012394899999999999 2024-04-26T10:22:14.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:14.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.848089+0000", 2024-04-26T10:22:14.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114527 2024-04-26T10:22:14.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:14.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852900+0000", 2024-04-26T10:22:14.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048110779999999999 2024-04-26T10:22:14.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:14.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895562+0000", 2024-04-26T10:22:14.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042662053999999998 2024-04-26T10:22:14.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895622+0000", 2024-04-26T10:22:14.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0470000000000002e-05 2024-04-26T10:22:14.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895702+0000", 2024-04-26T10:22:14.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9541000000000003e-05 2024-04-26T10:22:14.542 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.542 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.542 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.542 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83593 5.0 5:044bb3ac:::benchmark_data_smithi052_19421_object83592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:14.542 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:14.542 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.615093323, 2024-04-26T10:22:14.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.046164161000000002, 2024-04-26T10:22:14.543 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.543 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.543 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.543 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.543 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.543 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83593 2024-04-26T10:22:14.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.543 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:14.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:14.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849600+0000", 2024-04-26T10:22:14.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849655+0000", 2024-04-26T10:22:14.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5148999999999997e-05 2024-04-26T10:22:14.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849666+0000", 2024-04-26T10:22:14.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1494999999999999e-05 2024-04-26T10:22:14.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849677+0000", 2024-04-26T10:22:14.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0985000000000001e-05 2024-04-26T10:22:14.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849716+0000", 2024-04-26T10:22:14.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8698000000000001e-05 2024-04-26T10:22:14.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849822+0000", 2024-04-26T10:22:14.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000106173 2024-04-26T10:22:14.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:14.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849938+0000", 2024-04-26T10:22:14.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115738 2024-04-26T10:22:14.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:14.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853416+0000", 2024-04-26T10:22:14.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034777440000000001 2024-04-26T10:22:14.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:14.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895540+0000", 2024-04-26T10:22:14.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042124704999999998 2024-04-26T10:22:14.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895619+0000", 2024-04-26T10:22:14.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8697999999999998e-05 2024-04-26T10:22:14.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895765+0000", 2024-04-26T10:22:14.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014579299999999999 2024-04-26T10:22:14.548 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.548 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.548 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.548 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83594 5.b 5:d024b819:::benchmark_data_smithi052_19421_object83593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:14.548 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:14.548 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.6150010849999998, 2024-04-26T10:22:14.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045938635999999998, 2024-04-26T10:22:14.548 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.548 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.548 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.548 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.549 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.549 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83594 2024-04-26T10:22:14.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.549 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:14.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:14.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849692+0000", 2024-04-26T10:22:14.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:14.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849730+0000", 2024-04-26T10:22:14.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7415e-05 2024-04-26T10:22:14.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849735+0000", 2024-04-26T10:22:14.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6350000000000003e-06 2024-04-26T10:22:14.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849740+0000", 2024-04-26T10:22:14.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4209999999999997e-06 2024-04-26T10:22:14.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849787+0000", 2024-04-26T10:22:14.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7166000000000002e-05 2024-04-26T10:22:14.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849915+0000", 2024-04-26T10:22:14.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012823700000000001 2024-04-26T10:22:14.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:14.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850038+0000", 2024-04-26T10:22:14.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012317 2024-04-26T10:22:14.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:14.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855812+0000", 2024-04-26T10:22:14.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057731340000000001 2024-04-26T10:22:14.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:14.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895504+0000", 2024-04-26T10:22:14.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.039692540999999998 2024-04-26T10:22:14.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895569+0000", 2024-04-26T10:22:14.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4443999999999995e-05 2024-04-26T10:22:14.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895632+0000", 2024-04-26T10:22:14.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3109999999999997e-05 2024-04-26T10:22:14.553 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.553 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.553 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.554 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83596 5.b 5:d54e48a0:::benchmark_data_smithi052_19421_object83595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:14.554 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:14.554 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.6141810039999998, 2024-04-26T10:22:14.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.053210201999999998, 2024-04-26T10:22:14.554 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.554 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.554 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.554 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.554 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.554 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83596 2024-04-26T10:22:14.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.555 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:14.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:14.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850512+0000", 2024-04-26T10:22:14.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:14.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850622+0000", 2024-04-26T10:22:14.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010927 2024-04-26T10:22:14.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850629+0000", 2024-04-26T10:22:14.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1690000000000003e-06 2024-04-26T10:22:14.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850633+0000", 2024-04-26T10:22:14.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4800000000000003e-06 2024-04-26T10:22:14.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852134+0000", 2024-04-26T10:22:14.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015011099999999999 2024-04-26T10:22:14.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852446+0000", 2024-04-26T10:22:14.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031107999999999998 2024-04-26T10:22:14.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:14.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852723+0000", 2024-04-26T10:22:14.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027751499999999999 2024-04-26T10:22:14.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:14.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861229+0000", 2024-04-26T10:22:14.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085055960000000007 2024-04-26T10:22:14.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:14.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903523+0000", 2024-04-26T10:22:14.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042294683999999999 2024-04-26T10:22:14.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903579+0000", 2024-04-26T10:22:14.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5751999999999997e-05 2024-04-26T10:22:14.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903723+0000", 2024-04-26T10:22:14.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014414199999999999 2024-04-26T10:22:14.559 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.559 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.559 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.560 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83603 5.b 5:d4896044:::benchmark_data_smithi052_19421_object83602:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:14.560 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:14.560 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.6112541170000001, 2024-04-26T10:22:14.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.053974093000000001, 2024-04-26T10:22:14.560 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.560 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.560 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.560 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.560 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.560 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83603 2024-04-26T10:22:14.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.560 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:14.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:14.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853439+0000", 2024-04-26T10:22:14.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:14.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853492+0000", 2024-04-26T10:22:14.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2265000000000002e-05 2024-04-26T10:22:14.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853504+0000", 2024-04-26T10:22:14.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2354999999999999e-05 2024-04-26T10:22:14.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853512+0000", 2024-04-26T10:22:14.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8630000000000008e-06 2024-04-26T10:22:14.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855839+0000", 2024-04-26T10:22:14.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002326776 2024-04-26T10:22:14.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855993+0000", 2024-04-26T10:22:14.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015428300000000001 2024-04-26T10:22:14.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:14.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.856138+0000", 2024-04-26T10:22:14.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000145427 2024-04-26T10:22:14.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:14.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861318+0000", 2024-04-26T10:22:14.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051795160000000003 2024-04-26T10:22:14.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:14.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907178+0000", 2024-04-26T10:22:14.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045859882999999997 2024-04-26T10:22:14.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907260+0000", 2024-04-26T10:22:14.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2133999999999997e-05 2024-04-26T10:22:14.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907414+0000", 2024-04-26T10:22:14.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015427400000000001 2024-04-26T10:22:14.565 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.565 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.565 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.566 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83605 5.4 5:2eb72b61:::benchmark_data_smithi052_19421_object83604:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:14.566 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:14.566 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.6111746689999999, 2024-04-26T10:22:14.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045576089, 2024-04-26T10:22:14.566 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:14.566 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:14.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:14.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:14.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.566 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83605 2024-04-26T10:22:14.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.566 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:14.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:14.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:14.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:14.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:14.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:14.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:14.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:14.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:14.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853557+0000", 2024-04-26T10:22:14.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8423000000000001e-05 2024-04-26T10:22:14.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:14.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853573+0000", 2024-04-26T10:22:14.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6201e-05 2024-04-26T10:22:14.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853583+0000", 2024-04-26T10:22:14.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9129999999999998e-06 2024-04-26T10:22:14.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:14.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853625+0000", 2024-04-26T10:22:14.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1965000000000002e-05 2024-04-26T10:22:14.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:14.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853795+0000", 2024-04-26T10:22:14.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169946 2024-04-26T10:22:14.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:14.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853980+0000", 2024-04-26T10:22:14.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018517100000000001 2024-04-26T10:22:14.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:14.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861356+0000", 2024-04-26T10:22:14.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073759389999999998 2024-04-26T10:22:14.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:14.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.898899+0000", 2024-04-26T10:22:14.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.037542786000000002 2024-04-26T10:22:14.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:14.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.898963+0000", 2024-04-26T10:22:14.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3652999999999995e-05 2024-04-26T10:22:14.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:14.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:14.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:14.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.899095+0000", 2024-04-26T10:22:14.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013286999999999999 2024-04-26T10:22:14.571 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.571 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.571 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.571 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:14.571 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:14.571 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:14.573 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:14.573 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:14.568+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:14.617 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 41 16 91347 91331 139.208 128.938 0.0077432 0.00717797 2024-04-26T10:22:14.678 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:14.676+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:14.716 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:91532 5.c 5:3843ea71:::benchmark_data_smithi052_19421_object91531:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:14.708910+0000", 2024-04-26T10:22:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032024200000000001, 2024-04-26T10:22:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003222688, 2024-04-26T10:22:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:14.716 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91532 2024-04-26T10:22:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708910+0000", 2024-04-26T10:22:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708910+0000", 2024-04-26T10:22:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708910+0000", 2024-04-26T10:22:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709110+0000", 2024-04-26T10:22:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000200533 2024-04-26T10:22:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709118+0000", 2024-04-26T10:22:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.337e-06 2024-04-26T10:22:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709126+0000", 2024-04-26T10:22:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3900000000000004e-06 2024-04-26T10:22:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709166+0000", 2024-04-26T10:22:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9959000000000001e-05 2024-04-26T10:22:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709290+0000", 2024-04-26T10:22:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012388000000000001 2024-04-26T10:22:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:91533 5.f 5:f83b1687:::benchmark_data_smithi052_19421_object91532:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:14.709138+0000", 2024-04-26T10:22:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0029748769999999999, 2024-04-26T10:22:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030372860000000002, 2024-04-26T10:22:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.720 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91533 2024-04-26T10:22:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709138+0000", 2024-04-26T10:22:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709138+0000", 2024-04-26T10:22:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709137+0000", 2024-04-26T10:22:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709166+0000", 2024-04-26T10:22:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9077999999999998e-05 2024-04-26T10:22:14.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709174+0000", 2024-04-26T10:22:14.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1810000000000004e-06 2024-04-26T10:22:14.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709180+0000", 2024-04-26T10:22:14.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9460000000000003e-06 2024-04-26T10:22:14.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709221+0000", 2024-04-26T10:22:14.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1495999999999997e-05 2024-04-26T10:22:14.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709354+0000", 2024-04-26T10:22:14.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132929 2024-04-26T10:22:14.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:14.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709518+0000", 2024-04-26T10:22:14.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163809 2024-04-26T10:22:14.724 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.724 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.724 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.725 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:91534 5.c 5:3c83ad6b:::benchmark_data_smithi052_19421_object91533:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:14.725 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:14.709814+0000", 2024-04-26T10:22:14.725 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002299242, 2024-04-26T10:22:14.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023997290000000002, 2024-04-26T10:22:14.725 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.725 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:14.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:14.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:14.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.725 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91534 2024-04-26T10:22:14.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.725 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709814+0000", 2024-04-26T10:22:14.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709814+0000", 2024-04-26T10:22:14.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709813+0000", 2024-04-26T10:22:14.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709890+0000", 2024-04-26T10:22:14.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7659999999999998e-05 2024-04-26T10:22:14.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709900+0000", 2024-04-26T10:22:14.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0069e-05 2024-04-26T10:22:14.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.709908+0000", 2024-04-26T10:22:14.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2710000000000003e-06 2024-04-26T10:22:14.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.710837+0000", 2024-04-26T10:22:14.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00092952400000000004 2024-04-26T10:22:14.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.710988+0000", 2024-04-26T10:22:14.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015075099999999999 2024-04-26T10:22:14.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.729 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.729 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.729 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:91535 5.7 5:eb2a8474:::benchmark_data_smithi052_19421_object91534:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:14.729 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:14.710603+0000", 2024-04-26T10:22:14.729 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001509423, 2024-04-26T10:22:14.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001643273, 2024-04-26T10:22:14.729 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.729 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:14.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:14.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:14.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.729 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91535 2024-04-26T10:22:14.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.730 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.710603+0000", 2024-04-26T10:22:14.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.710603+0000", 2024-04-26T10:22:14.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.710603+0000", 2024-04-26T10:22:14.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:14.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.710629+0000", 2024-04-26T10:22:14.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6693999999999999e-05 2024-04-26T10:22:14.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.710652+0000", 2024-04-26T10:22:14.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2376000000000001e-05 2024-04-26T10:22:14.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.710657+0000", 2024-04-26T10:22:14.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.429e-06 2024-04-26T10:22:14.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.710869+0000", 2024-04-26T10:22:14.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000211709 2024-04-26T10:22:14.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.711030+0000", 2024-04-26T10:22:14.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016063000000000001 2024-04-26T10:22:14.733 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.733 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.733 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.733 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:91537 5.2 5:4eec7a7b:::benchmark_data_smithi052_19421_object91536:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:14.733 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:14.710663+0000", 2024-04-26T10:22:14.733 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0014499820000000001, 2024-04-26T10:22:14.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001624988, 2024-04-26T10:22:14.733 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.733 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:14.733 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:14.733 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:14.733 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.734 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91537 2024-04-26T10:22:14.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.734 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.710663+0000", 2024-04-26T10:22:14.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.710663+0000", 2024-04-26T10:22:14.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.710662+0000", 2024-04-26T10:22:14.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:14.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.710688+0000", 2024-04-26T10:22:14.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5880999999999998e-05 2024-04-26T10:22:14.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.710695+0000", 2024-04-26T10:22:14.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5400000000000001e-06 2024-04-26T10:22:14.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.710698+0000", 2024-04-26T10:22:14.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.309e-06 2024-04-26T10:22:14.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.710758+0000", 2024-04-26T10:22:14.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9614000000000002e-05 2024-04-26T10:22:14.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.710902+0000", 2024-04-26T10:22:14.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144225 2024-04-26T10:22:14.737 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.737 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.737 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.737 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:91538 5.9 5:9ddd35ea:::benchmark_data_smithi052_19421_object91537:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:14.737 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:14.711057+0000", 2024-04-26T10:22:14.737 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0010561170000000001, 2024-04-26T10:22:14.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012950889999999999, 2024-04-26T10:22:14.737 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.737 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:14.737 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:14.738 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:14.738 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.738 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91538 2024-04-26T10:22:14.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.738 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.711057+0000", 2024-04-26T10:22:14.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.711057+0000", 2024-04-26T10:22:14.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.711056+0000", 2024-04-26T10:22:14.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.711150+0000", 2024-04-26T10:22:14.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4204999999999997e-05 2024-04-26T10:22:14.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.711167+0000", 2024-04-26T10:22:14.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7459e-05 2024-04-26T10:22:14.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.711175+0000", 2024-04-26T10:22:14.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0940000000000008e-06 2024-04-26T10:22:14.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.711221+0000", 2024-04-26T10:22:14.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5485000000000002e-05 2024-04-26T10:22:14.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.711529+0000", 2024-04-26T10:22:14.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030846500000000001 2024-04-26T10:22:14.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:14.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.711617+0000", 2024-04-26T10:22:14.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7861999999999993e-05 2024-04-26T10:22:14.741 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.741 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.741 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.741 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:91539 5.0 e42/37 5:0c4a84ee:::benchmark_data_smithi052_19421_object91538:head v 42'5691, mlcod=42'5689)", 2024-04-26T10:22:14.741 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:14.712289+0000", 2024-04-26T10:22:14.742 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9998231, 2024-04-26T10:22:14.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019982999999999999, 2024-04-26T10:22:14.742 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.742 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:14.742 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.712289+0000", 2024-04-26T10:22:14.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.712289+0000", 2024-04-26T10:22:14.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.712289+0000", 2024-04-26T10:22:14.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.712296+0000", 2024-04-26T10:22:14.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0659999999999998e-06 2024-04-26T10:22:14.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.712310+0000", 2024-04-26T10:22:14.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4588e-05 2024-04-26T10:22:14.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.712317+0000", 2024-04-26T10:22:14.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6989999999999997e-06 2024-04-26T10:22:14.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.712383+0000", 2024-04-26T10:22:14.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5982999999999995e-05 2024-04-26T10:22:14.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.712404+0000", 2024-04-26T10:22:14.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0965999999999999e-05 2024-04-26T10:22:14.745 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.745 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.745 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.745 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:91524 5.c 5:3d0f600e:::benchmark_data_smithi052_19421_object91523:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:14.745 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:14.705429+0000", 2024-04-26T10:22:14.745 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.006684059, 2024-04-26T10:22:14.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071024069999999998, 2024-04-26T10:22:14.745 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.746 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:14.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:14.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:14.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.746 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91524 2024-04-26T10:22:14.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.746 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.705429+0000", 2024-04-26T10:22:14.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.705429+0000", 2024-04-26T10:22:14.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.705428+0000", 2024-04-26T10:22:14.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.705492+0000", 2024-04-26T10:22:14.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4521000000000001e-05 2024-04-26T10:22:14.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.705505+0000", 2024-04-26T10:22:14.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3200000000000001e-05 2024-04-26T10:22:14.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.705511+0000", 2024-04-26T10:22:14.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2680000000000002e-06 2024-04-26T10:22:14.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.705541+0000", 2024-04-26T10:22:14.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0158000000000002e-05 2024-04-26T10:22:14.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.705627+0000", 2024-04-26T10:22:14.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6355999999999998e-05 2024-04-26T10:22:14.749 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.749 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.749 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.749 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:91525 5.c 5:361193b9:::benchmark_data_smithi052_19421_object91524:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:14.749 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:14.705520+0000", 2024-04-26T10:22:14.749 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.006593163, 2024-04-26T10:22:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070764419999999996, 2024-04-26T10:22:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91525 2024-04-26T10:22:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.705520+0000", 2024-04-26T10:22:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.705520+0000", 2024-04-26T10:22:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.705519+0000", 2024-04-26T10:22:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.705547+0000", 2024-04-26T10:22:14.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8129000000000001e-05 2024-04-26T10:22:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.705552+0000", 2024-04-26T10:22:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.685e-06 2024-04-26T10:22:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.705555+0000", 2024-04-26T10:22:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.208e-06 2024-04-26T10:22:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.707025+0000", 2024-04-26T10:22:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014700850000000001 2024-04-26T10:22:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.707131+0000", 2024-04-26T10:22:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106204 2024-04-26T10:22:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:91526 5.9 5:9e6744cf:::benchmark_data_smithi052_19421_object91525:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:14.753 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:14.706816+0000", 2024-04-26T10:22:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0052970739999999997, 2024-04-26T10:22:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058508869999999999, 2024-04-26T10:22:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91526 2024-04-26T10:22:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.706816+0000", 2024-04-26T10:22:14.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.706816+0000", 2024-04-26T10:22:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.706815+0000", 2024-04-26T10:22:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.706919+0000", 2024-04-26T10:22:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104058 2024-04-26T10:22:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.706936+0000", 2024-04-26T10:22:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6752000000000002e-05 2024-04-26T10:22:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.706941+0000", 2024-04-26T10:22:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5280000000000003e-06 2024-04-26T10:22:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.706986+0000", 2024-04-26T10:22:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4812999999999999e-05 2024-04-26T10:22:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.707086+0000", 2024-04-26T10:22:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9740000000000004e-05 2024-04-26T10:22:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.707177+0000", 2024-04-26T10:22:14.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1016999999999999e-05 2024-04-26T10:22:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.710959+0000", 2024-04-26T10:22:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037822060000000002 2024-04-26T10:22:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.758 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:91529 5.7 5:eacd0845:::benchmark_data_smithi052_19421_object91528:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:14.706951+0000", 2024-04-26T10:22:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.005162112, 2024-04-26T10:22:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057917410000000004, 2024-04-26T10:22:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91529 2024-04-26T10:22:14.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.706951+0000", 2024-04-26T10:22:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.706951+0000", 2024-04-26T10:22:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.706950+0000", 2024-04-26T10:22:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.707038+0000", 2024-04-26T10:22:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7986999999999996e-05 2024-04-26T10:22:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.707045+0000", 2024-04-26T10:22:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.187e-06 2024-04-26T10:22:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.707051+0000", 2024-04-26T10:22:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7250000000000002e-06 2024-04-26T10:22:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.707088+0000", 2024-04-26T10:22:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7113999999999997e-05 2024-04-26T10:22:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.707169+0000", 2024-04-26T10:22:14.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1182999999999998e-05 2024-04-26T10:22:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:91527 5.b e42/37 5:d30b0503:::benchmark_data_smithi052_19421_object91526:head v 42'5668, mlcod=42'5665)", 2024-04-26T10:22:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:14.707511+0000", 2024-04-26T10:22:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0046015819999999999, 2024-04-26T10:22:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052929359999999998, 2024-04-26T10:22:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.707511+0000", 2024-04-26T10:22:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.707511+0000", 2024-04-26T10:22:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.707511+0000", 2024-04-26T10:22:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:14.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.707520+0000", 2024-04-26T10:22:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2969999999999992e-06 2024-04-26T10:22:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.707543+0000", 2024-04-26T10:22:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3003999999999999e-05 2024-04-26T10:22:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.707549+0000", 2024-04-26T10:22:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1040000000000003e-06 2024-04-26T10:22:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.707778+0000", 2024-04-26T10:22:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022867699999999999 2024-04-26T10:22:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.707803+0000", 2024-04-26T10:22:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5211e-05 2024-04-26T10:22:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.766 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:91530 5.5 5:a23ee542:::benchmark_data_smithi052_19421_object91529:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:14.708035+0000", 2024-04-26T10:22:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0040774239999999996, 2024-04-26T10:22:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048273939999999996, 2024-04-26T10:22:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91530 2024-04-26T10:22:14.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708035+0000", 2024-04-26T10:22:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708035+0000", 2024-04-26T10:22:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708034+0000", 2024-04-26T10:22:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708112+0000", 2024-04-26T10:22:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8121000000000006e-05 2024-04-26T10:22:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708128+0000", 2024-04-26T10:22:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.543e-05 2024-04-26T10:22:14.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708136+0000", 2024-04-26T10:22:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0930000000000003e-06 2024-04-26T10:22:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708188+0000", 2024-04-26T10:22:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2484000000000001e-05 2024-04-26T10:22:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708316+0000", 2024-04-26T10:22:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012780199999999999 2024-04-26T10:22:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:91531 5.1 5:84d66a00:::benchmark_data_smithi052_19421_object91530:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:14.708161+0000", 2024-04-26T10:22:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0039518890000000001, 2024-04-26T10:22:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047673760000000003, 2024-04-26T10:22:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:14.771 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 91531 2024-04-26T10:22:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708161+0000", 2024-04-26T10:22:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708161+0000", 2024-04-26T10:22:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:14.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708160+0000", 2024-04-26T10:22:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708228+0000", 2024-04-26T10:22:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7954999999999996e-05 2024-04-26T10:22:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708237+0000", 2024-04-26T10:22:14.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0229999999999998e-06 2024-04-26T10:22:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708244+0000", 2024-04-26T10:22:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4180000000000002e-06 2024-04-26T10:22:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708285+0000", 2024-04-26T10:22:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1644000000000003e-05 2024-04-26T10:22:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:14.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:14.708417+0000", 2024-04-26T10:22:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013222400000000001 2024-04-26T10:22:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:14.775 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 14 2024-04-26T10:22:14.775 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:14.777 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:14.777 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:14.772+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:14.783 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:22:14.878 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:14.871+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:14.916 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:14.916 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:14.916 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:14.916 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:14.917 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:14.930 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:14.978 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:14.976+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.066 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.534008045, 2024-04-26T10:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.529472833, 2024-04-26T10:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.528841541, 2024-04-26T10:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65604 5.9 5:9c239c32:::benchmark_data_smithi052_19421_object65603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.293738657, 2024-04-26T10:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025897677000000001, 2024-04-26T10:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65604 2024-04-26T10:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769615+0000", 2024-04-26T10:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769694+0000", 2024-04-26T10:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9087999999999999e-05 2024-04-26T10:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769702+0000", 2024-04-26T10:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8150000000000006e-06 2024-04-26T10:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769709+0000", 2024-04-26T10:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772336+0000", 2024-04-26T10:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002626836 2024-04-26T10:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772470+0000", 2024-04-26T10:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013453299999999999 2024-04-26T10:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772605+0000", 2024-04-26T10:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013428499999999999 2024-04-26T10:22:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779374+0000", 2024-04-26T10:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067694000000000001 2024-04-26T10:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795401+0000", 2024-04-26T10:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016026543000000001 2024-04-26T10:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795461+0000", 2024-04-26T10:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9923999999999998e-05 2024-04-26T10:22:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795513+0000", 2024-04-26T10:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2737e-05 2024-04-26T10:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65613 5.1 5:85cc6530:::benchmark_data_smithi052_19421_object65612:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.291365611, 2024-04-26T10:22:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023662843999999999, 2024-04-26T10:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65613 2024-04-26T10:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771988+0000", 2024-04-26T10:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772053+0000", 2024-04-26T10:22:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5067000000000006e-05 2024-04-26T10:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772065+0000", 2024-04-26T10:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2252999999999999e-05 2024-04-26T10:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772072+0000", 2024-04-26T10:22:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1400000000000002e-06 2024-04-26T10:22:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779354+0000", 2024-04-26T10:22:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072818120000000004 2024-04-26T10:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779455+0000", 2024-04-26T10:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101109 2024-04-26T10:22:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795526+0000", 2024-04-26T10:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016071203999999999 2024-04-26T10:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795572+0000", 2024-04-26T10:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5865999999999998e-05 2024-04-26T10:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795651+0000", 2024-04-26T10:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9192999999999999e-05 2024-04-26T10:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65614 5.9 5:993a4fbe:::benchmark_data_smithi052_19421_object65613:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.29127342, 2024-04-26T10:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023664145000000001, 2024-04-26T10:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65614 2024-04-26T10:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772080+0000", 2024-04-26T10:22:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772117+0000", 2024-04-26T10:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6418000000000003e-05 2024-04-26T10:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772124+0000", 2024-04-26T10:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4730000000000003e-06 2024-04-26T10:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772132+0000", 2024-04-26T10:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3900000000000004e-06 2024-04-26T10:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781379+0000", 2024-04-26T10:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092471059999999997 2024-04-26T10:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781495+0000", 2024-04-26T10:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001159 2024-04-26T10:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781581+0000", 2024-04-26T10:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6087000000000004e-05 2024-04-26T10:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.785948+0000", 2024-04-26T10:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043671669999999999 2024-04-26T10:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795661+0000", 2024-04-26T10:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097130310000000004 2024-04-26T10:22:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795710+0000", 2024-04-26T10:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8959000000000003e-05 2024-04-26T10:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795745+0000", 2024-04-26T10:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5172000000000001e-05 2024-04-26T10:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83591 5.4 e41/37 5:204a1b6d:::benchmark_data_smithi052_19421_object83590:head v 41'5271, mlcod=41'5268)", 2024-04-26T10:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2163661379999997, 2024-04-26T10:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.046802200000000002, 2024-04-26T10:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846987+0000", 2024-04-26T10:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846995+0000", 2024-04-26T10:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7549999999999994e-06 2024-04-26T10:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847004+0000", 2024-04-26T10:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3190000000000001e-06 2024-04-26T10:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847011+0000", 2024-04-26T10:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5039999999999999e-06 2024-04-26T10:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847048+0000", 2024-04-26T10:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7052999999999999e-05 2024-04-26T10:22:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847066+0000", 2024-04-26T10:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8468999999999999e-05 2024-04-26T10:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893707+0000", 2024-04-26T10:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.046641123999999999 2024-04-26T10:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893790+0000", 2024-04-26T10:22:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2806999999999995e-05 2024-04-26T10:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83592 5.3 5:c96af6b1:::benchmark_data_smithi052_19421_object83591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2150329940000004, 2024-04-26T10:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045543839000000003, 2024-04-26T10:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83592 2024-04-26T10:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848320+0000", 2024-04-26T10:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848465+0000", 2024-04-26T10:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000145291 2024-04-26T10:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848475+0000", 2024-04-26T10:22:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6709999999999994e-06 2024-04-26T10:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848482+0000", 2024-04-26T10:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2910000000000002e-06 2024-04-26T10:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848532+0000", 2024-04-26T10:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9199000000000001e-05 2024-04-26T10:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848676+0000", 2024-04-26T10:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014493399999999999 2024-04-26T10:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893707+0000", 2024-04-26T10:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045030857000000001 2024-04-26T10:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893772+0000", 2024-04-26T10:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4203999999999997e-05 2024-04-26T10:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893865+0000", 2024-04-26T10:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3577000000000002e-05 2024-04-26T10:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83593 5.0 e41/37 5:044bb3ac:::benchmark_data_smithi052_19421_object83592:head v 41'5187, mlcod=41'5184)", 2024-04-26T10:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2145355770000004, 2024-04-26T10:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044951738999999998, 2024-04-26T10:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848818+0000", 2024-04-26T10:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848824+0000", 2024-04-26T10:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-04-26T10:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848895+0000", 2024-04-26T10:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1468000000000001e-05 2024-04-26T10:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848902+0000", 2024-04-26T10:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6229999999999999e-06 2024-04-26T10:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848955+0000", 2024-04-26T10:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3106000000000003e-05 2024-04-26T10:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848974+0000", 2024-04-26T10:22:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9598000000000001e-05 2024-04-26T10:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893703+0000", 2024-04-26T10:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044728315999999997 2024-04-26T10:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893770+0000", 2024-04-26T10:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7683999999999998e-05 2024-04-26T10:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83594 5.b e41/37 5:d024b819:::benchmark_data_smithi052_19421_object83593:head v 41'5142, mlcod=41'5140)", 2024-04-26T10:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2144255680000002, 2024-04-26T10:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044760763000000002, 2024-04-26T10:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848928+0000", 2024-04-26T10:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848933+0000", 2024-04-26T10:22:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848952+0000", 2024-04-26T10:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8884000000000001e-05 2024-04-26T10:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848957+0000", 2024-04-26T10:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8470000000000003e-06 2024-04-26T10:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848980+0000", 2024-04-26T10:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2946999999999999e-05 2024-04-26T10:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848992+0000", 2024-04-26T10:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1882000000000001e-05 2024-04-26T10:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893623+0000", 2024-04-26T10:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044631381999999997 2024-04-26T10:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893689+0000", 2024-04-26T10:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6285999999999995e-05 2024-04-26T10:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83595 5.1 5:829f4097:::benchmark_data_smithi052_19421_object83594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2143367090000003, 2024-04-26T10:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048599369000000003, 2024-04-26T10:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83595 2024-04-26T10:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849017+0000", 2024-04-26T10:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849041+0000", 2024-04-26T10:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4239999999999998e-05 2024-04-26T10:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849048+0000", 2024-04-26T10:22:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4669999999999998e-06 2024-04-26T10:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849053+0000", 2024-04-26T10:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3839999999999999e-06 2024-04-26T10:22:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849099+0000", 2024-04-26T10:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6579999999999998e-05 2024-04-26T10:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849246+0000", 2024-04-26T10:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014681899999999999 2024-04-26T10:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897498+0000", 2024-04-26T10:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048252002000000002 2024-04-26T10:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897544+0000", 2024-04-26T10:22:15.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5497999999999997e-05 2024-04-26T10:22:15.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897617+0000", 2024-04-26T10:22:15.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3143000000000001e-05 2024-04-26T10:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.131 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83597 5.d 5:b4b0a3ad:::benchmark_data_smithi052_19421_object83596:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2140712699999998, 2024-04-26T10:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.047933286999999998, 2024-04-26T10:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:15.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83597 2024-04-26T10:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849282+0000", 2024-04-26T10:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849384+0000", 2024-04-26T10:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010128600000000001 2024-04-26T10:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849392+0000", 2024-04-26T10:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4290000000000001e-06 2024-04-26T10:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849398+0000", 2024-04-26T10:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8969999999999996e-06 2024-04-26T10:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849481+0000", 2024-04-26T10:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3088000000000001e-05 2024-04-26T10:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849639+0000", 2024-04-26T10:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015797200000000001 2024-04-26T10:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849782+0000", 2024-04-26T10:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014353599999999999 2024-04-26T10:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894335+0000", 2024-04-26T10:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044552500000000002 2024-04-26T10:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896955+0000", 2024-04-26T10:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002620229 2024-04-26T10:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897051+0000", 2024-04-26T10:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5847999999999994e-05 2024-04-26T10:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897216+0000", 2024-04-26T10:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016519700000000001 2024-04-26T10:22:15.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83598 5.7 5:e1984dee:::benchmark_data_smithi052_19421_object83597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2139452400000001, 2024-04-26T10:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.049315405999999999, 2024-04-26T10:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.138 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83598 2024-04-26T10:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849408+0000", 2024-04-26T10:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849466+0000", 2024-04-26T10:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7302000000000001e-05 2024-04-26T10:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849473+0000", 2024-04-26T10:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4900000000000003e-06 2024-04-26T10:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849479+0000", 2024-04-26T10:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3539999999999999e-06 2024-04-26T10:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849526+0000", 2024-04-26T10:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7246999999999997e-05 2024-04-26T10:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849677+0000", 2024-04-26T10:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000151218 2024-04-26T10:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898591+0000", 2024-04-26T10:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048914343999999998 2024-04-26T10:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898650+0000", 2024-04-26T10:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8288999999999997e-05 2024-04-26T10:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898724+0000", 2024-04-26T10:22:15.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4782000000000003e-05 2024-04-26T10:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83599 5.3 5:c6d96bef:::benchmark_data_smithi052_19421_object83598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2119417590000001, 2024-04-26T10:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050758893999999999, 2024-04-26T10:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:15.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83599 2024-04-26T10:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851411+0000", 2024-04-26T10:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851465+0000", 2024-04-26T10:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3943999999999997e-05 2024-04-26T10:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851475+0000", 2024-04-26T10:22:15.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0220999999999999e-05 2024-04-26T10:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851482+0000", 2024-04-26T10:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3259999999999998e-06 2024-04-26T10:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851525+0000", 2024-04-26T10:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2255000000000001e-05 2024-04-26T10:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851617+0000", 2024-04-26T10:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2436999999999996e-05 2024-04-26T10:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902102+0000", 2024-04-26T10:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050485163 2024-04-26T10:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902130+0000", 2024-04-26T10:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8177000000000001e-05 2024-04-26T10:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902171+0000", 2024-04-26T10:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1091999999999999e-05 2024-04-26T10:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83596 5.b e41/37 5:d54e48a0:::benchmark_data_smithi052_19421_object83595:head v 41'5143, mlcod=41'5140)", 2024-04-26T10:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2117314290000003, 2024-04-26T10:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050472416999999999, 2024-04-26T10:22:15.148 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851621+0000", 2024-04-26T10:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851628+0000", 2024-04-26T10:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851635+0000", 2024-04-26T10:22:15.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6009999999999997e-06 2024-04-26T10:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851646+0000", 2024-04-26T10:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1248e-05 2024-04-26T10:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851687+0000", 2024-04-26T10:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1004999999999998e-05 2024-04-26T10:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851706+0000", 2024-04-26T10:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8994000000000001e-05 2024-04-26T10:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902062+0000", 2024-04-26T10:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050355957999999999 2024-04-26T10:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902095+0000", 2024-04-26T10:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2882000000000001e-05 2024-04-26T10:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83601 5.d 5:b32b06d1:::benchmark_data_smithi052_19421_object83600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2114247129999995, 2024-04-26T10:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045519045000000001, 2024-04-26T10:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83601 2024-04-26T10:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851929+0000", 2024-04-26T10:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:15.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852104+0000", 2024-04-26T10:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175234 2024-04-26T10:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852110+0000", 2024-04-26T10:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.66e-06 2024-04-26T10:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852114+0000", 2024-04-26T10:22:15.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7809999999999999e-06 2024-04-26T10:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852153+0000", 2024-04-26T10:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9576000000000002e-05 2024-04-26T10:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852283+0000", 2024-04-26T10:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012946600000000001 2024-04-26T10:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852415+0000", 2024-04-26T10:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132719 2024-04-26T10:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894427+0000", 2024-04-26T10:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042011497000000002 2024-04-26T10:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897231+0000", 2024-04-26T10:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002804239 2024-04-26T10:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897306+0000", 2024-04-26T10:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4771999999999995e-05 2024-04-26T10:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897449+0000", 2024-04-26T10:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142707 2024-04-26T10:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83604 5.2 5:41ebe09c:::benchmark_data_smithi052_19421_object83603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2112317260000003, 2024-04-26T10:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044923596000000003, 2024-04-26T10:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83604 2024-04-26T10:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852122+0000", 2024-04-26T10:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852149+0000", 2024-04-26T10:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7596000000000001e-05 2024-04-26T10:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852154+0000", 2024-04-26T10:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0889999999999999e-06 2024-04-26T10:22:15.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852158+0000", 2024-04-26T10:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2830000000000002e-06 2024-04-26T10:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852194+0000", 2024-04-26T10:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6062000000000001e-05 2024-04-26T10:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852276+0000", 2024-04-26T10:22:15.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1891000000000006e-05 2024-04-26T10:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896782+0000", 2024-04-26T10:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044506271 2024-04-26T10:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896875+0000", 2024-04-26T10:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3499999999999996e-05 2024-04-26T10:22:15.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897046+0000", 2024-04-26T10:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017065200000000001 2024-04-26T10:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83606 5.1 5:81602529:::benchmark_data_smithi052_19421_object83605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2109140890000001, 2024-04-26T10:22:15.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045300391000000002, 2024-04-26T10:22:15.165 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.165 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:15.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:15.165 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.165 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83606 2024-04-26T10:22:15.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.165 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:15.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:15.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852439+0000", 2024-04-26T10:22:15.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:15.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852535+0000", 2024-04-26T10:22:15.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6025000000000003e-05 2024-04-26T10:22:15.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852545+0000", 2024-04-26T10:22:15.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3619999999999995e-06 2024-04-26T10:22:15.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852551+0000", 2024-04-26T10:22:15.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4500000000000001e-06 2024-04-26T10:22:15.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852588+0000", 2024-04-26T10:22:15.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6785000000000001e-05 2024-04-26T10:22:15.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852668+0000", 2024-04-26T10:22:15.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0008999999999999e-05 2024-04-26T10:22:15.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:15.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897625+0000", 2024-04-26T10:22:15.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044956744999999999 2024-04-26T10:22:15.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897667+0000", 2024-04-26T10:22:15.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1887000000000001e-05 2024-04-26T10:22:15.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897741+0000", 2024-04-26T10:22:15.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4023000000000006e-05 2024-04-26T10:22:15.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.169 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.169 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83605 5.4 e41/37 5:2eb72b61:::benchmark_data_smithi052_19421_object83604:head v 41'5272, mlcod=41'5269)", 2024-04-26T10:22:15.169 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:15.170 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.2105067609999995, 2024-04-26T10:22:15.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044651192999999999, 2024-04-26T10:22:15.170 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.170 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.170 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:15.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:15.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:15.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:15.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852851+0000", 2024-04-26T10:22:15.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4560000000000002e-06 2024-04-26T10:22:15.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852859+0000", 2024-04-26T10:22:15.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2169999999999997e-06 2024-04-26T10:22:15.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852864+0000", 2024-04-26T10:22:15.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-04-26T10:22:15.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852899+0000", 2024-04-26T10:22:15.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4987000000000002e-05 2024-04-26T10:22:15.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852916+0000", 2024-04-26T10:22:15.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7563000000000001e-05 2024-04-26T10:22:15.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897449+0000", 2024-04-26T10:22:15.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044532644000000003 2024-04-26T10:22:15.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897499+0000", 2024-04-26T10:22:15.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9734999999999997e-05 2024-04-26T10:22:15.173 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.174 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.174 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83607 5.6 5:66b4c91d:::benchmark_data_smithi052_19421_object83606:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:15.174 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:15.174 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.208376307, 2024-04-26T10:22:15.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048173940999999998, 2024-04-26T10:22:15.174 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:15.174 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:15.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:15.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:15.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.175 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83607 2024-04-26T10:22:15.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.175 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:15.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:15.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:15.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:15.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:15.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:15.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:15.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854976+0000", 2024-04-26T10:22:15.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:15.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:15.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.855030+0000", 2024-04-26T10:22:15.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3436000000000001e-05 2024-04-26T10:22:15.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:15.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893759+0000", 2024-04-26T10:22:15.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.038729302 2024-04-26T10:22:15.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893777+0000", 2024-04-26T10:22:15.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7343e-05 2024-04-26T10:22:15.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:15.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893880+0000", 2024-04-26T10:22:15.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103285 2024-04-26T10:22:15.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:15.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894161+0000", 2024-04-26T10:22:15.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000280704 2024-04-26T10:22:15.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:15.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902948+0000", 2024-04-26T10:22:15.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087876059999999999 2024-04-26T10:22:15.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:15.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.903028+0000", 2024-04-26T10:22:15.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9486000000000004e-05 2024-04-26T10:22:15.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:15.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:15.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:15.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.903152+0000", 2024-04-26T10:22:15.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012426599999999999 2024-04-26T10:22:15.178 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.179 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:15.179 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:15.179 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:15.180 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:15.181 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:15.175+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:15.281 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:15.276+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:15.305 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:22:15.306 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:92727 5.0 5:023cb3ad:::benchmark_data_smithi052_19421_object92726:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:15.297872+0000", 2024-04-26T10:22:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0081045739999999998, 2024-04-26T10:22:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0081267010000000001, 2024-04-26T10:22:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.307 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 92727 2024-04-26T10:22:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.297872+0000", 2024-04-26T10:22:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.297872+0000", 2024-04-26T10:22:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.297871+0000", 2024-04-26T10:22:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.297946+0000", 2024-04-26T10:22:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5724999999999997e-05 2024-04-26T10:22:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.297956+0000", 2024-04-26T10:22:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3379999999999994e-06 2024-04-26T10:22:15.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.297960+0000", 2024-04-26T10:22:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4279999999999998e-06 2024-04-26T10:22:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.298022+0000", 2024-04-26T10:22:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1305999999999999e-05 2024-04-26T10:22:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:15.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.298208+0000", 2024-04-26T10:22:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018634000000000001 2024-04-26T10:22:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.298439+0000", 2024-04-26T10:22:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023144100000000001 2024-04-26T10:22:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:92729 5.8 5:1fe3878c:::benchmark_data_smithi052_19421_object92728:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:15.298602+0000", 2024-04-26T10:22:15.311 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0073746999999999997, 2024-04-26T10:22:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0074564940000000001, 2024-04-26T10:22:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 92729 2024-04-26T10:22:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.298602+0000", 2024-04-26T10:22:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:15.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.298602+0000", 2024-04-26T10:22:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.298600+0000", 2024-04-26T10:22:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:15.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.298655+0000", 2024-04-26T10:22:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4830999999999997e-05 2024-04-26T10:22:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.298669+0000", 2024-04-26T10:22:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3244999999999999e-05 2024-04-26T10:22:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.298678+0000", 2024-04-26T10:22:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5810000000000003e-06 2024-04-26T10:22:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.300864+0000", 2024-04-26T10:22:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021860790000000001 2024-04-26T10:22:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.301000+0000", 2024-04-26T10:22:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013586800000000001 2024-04-26T10:22:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.315 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:92734 5.b 5:dc79bbea:::benchmark_data_smithi052_19421_object92733:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:15.298867+0000", 2024-04-26T10:22:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0071095389999999998, 2024-04-26T10:22:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0072387049999999998, 2024-04-26T10:22:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 92734 2024-04-26T10:22:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:15.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.298867+0000", 2024-04-26T10:22:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.298867+0000", 2024-04-26T10:22:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.298866+0000", 2024-04-26T10:22:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.298974+0000", 2024-04-26T10:22:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010808500000000001 2024-04-26T10:22:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.298985+0000", 2024-04-26T10:22:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0468e-05 2024-04-26T10:22:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.298990+0000", 2024-04-26T10:22:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4940000000000003e-06 2024-04-26T10:22:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.299044+0000", 2024-04-26T10:22:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3681999999999999e-05 2024-04-26T10:22:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.299223+0000", 2024-04-26T10:22:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017932000000000001 2024-04-26T10:22:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.299433+0000", 2024-04-26T10:22:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020982299999999999 2024-04-26T10:22:15.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.304787+0000", 2024-04-26T10:22:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053545270000000004 2024-04-26T10:22:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:92736 5.b 5:de56e8aa:::benchmark_data_smithi052_19421_object92735:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:15.301159+0000", 2024-04-26T10:22:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0048172620000000001, 2024-04-26T10:22:15.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050013690000000003, 2024-04-26T10:22:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 92736 2024-04-26T10:22:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.301159+0000", 2024-04-26T10:22:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.301159+0000", 2024-04-26T10:22:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.301158+0000", 2024-04-26T10:22:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.301191+0000", 2024-04-26T10:22:15.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2619000000000001e-05 2024-04-26T10:22:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.301200+0000", 2024-04-26T10:22:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6360000000000006e-06 2024-04-26T10:22:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.301207+0000", 2024-04-26T10:22:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9809999999999997e-06 2024-04-26T10:22:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:15.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302013+0000", 2024-04-26T10:22:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00080558500000000005 2024-04-26T10:22:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302201+0000", 2024-04-26T10:22:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000188381 2024-04-26T10:22:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302426+0000", 2024-04-26T10:22:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022437499999999999 2024-04-26T10:22:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:15.324 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop_reply(client.4722.0:92727 5.0 e42/37)", 2024-04-26T10:22:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:15.302331+0000", 2024-04-26T10:22:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.003645681, 2024-04-26T10:22:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038748099999999998, 2024-04-26T10:22:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302331+0000", 2024-04-26T10:22:15.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302331+0000", 2024-04-26T10:22:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302330+0000", 2024-04-26T10:22:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302335+0000", 2024-04-26T10:22:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8960000000000002e-06 2024-04-26T10:22:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302345+0000", 2024-04-26T10:22:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8740000000000007e-06 2024-04-26T10:22:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302351+0000", 2024-04-26T10:22:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.567e-06 2024-04-26T10:22:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:15.327 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:92738 5.9 e42/37 5:93c3add5:::benchmark_data_smithi052_19421_object92737:head v 42'5838, mlcod=42'5836)", 2024-04-26T10:22:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:15.302358+0000", 2024-04-26T10:22:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.003618483, 2024-04-26T10:22:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003879984, 2024-04-26T10:22:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302358+0000", 2024-04-26T10:22:15.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302358+0000", 2024-04-26T10:22:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302357+0000", 2024-04-26T10:22:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:15.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302401+0000", 2024-04-26T10:22:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3856999999999997e-05 2024-04-26T10:22:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302408+0000", 2024-04-26T10:22:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3339999999999998e-06 2024-04-26T10:22:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302413+0000", 2024-04-26T10:22:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1850000000000003e-06 2024-04-26T10:22:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302457+0000", 2024-04-26T10:22:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3965999999999999e-05 2024-04-26T10:22:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302474+0000", 2024-04-26T10:22:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6718000000000002e-05 2024-04-26T10:22:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.331 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:92741 5.8 5.df8d51c8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:15.302654+0000", 2024-04-26T10:22:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0033219259999999998, 2024-04-26T10:22:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003621188, 2024-04-26T10:22:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 92741 2024-04-26T10:22:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:15.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302654+0000", 2024-04-26T10:22:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302654+0000", 2024-04-26T10:22:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302653+0000", 2024-04-26T10:22:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302731+0000", 2024-04-26T10:22:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7330000000000007e-05 2024-04-26T10:22:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302742+0000", 2024-04-26T10:22:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1547e-05 2024-04-26T10:22:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.302748+0000", 2024-04-26T10:22:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4419999999999997e-06 2024-04-26T10:22:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:15.334 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:92746 5.4 5:2da956b4:::benchmark_data_smithi052_19421_object92745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-26T10:22:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:15.304813+0000", 2024-04-26T10:22:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.001163608, 2024-04-26T10:22:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00150219, 2024-04-26T10:22:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 92746 2024-04-26T10:22:15.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.304813+0000", 2024-04-26T10:22:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.304813+0000", 2024-04-26T10:22:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:15.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.304811+0000", 2024-04-26T10:22:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.304907+0000", 2024-04-26T10:22:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5847000000000006e-05 2024-04-26T10:22:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.304920+0000", 2024-04-26T10:22:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2748999999999999e-05 2024-04-26T10:22:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.304929+0000", 2024-04-26T10:22:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.132e-06 2024-04-26T10:22:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.304976+0000", 2024-04-26T10:22:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6371e-05 2024-04-26T10:22:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.305125+0000", 2024-04-26T10:22:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014996200000000001 2024-04-26T10:22:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:15.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:15.305293+0000", 2024-04-26T10:22:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000167271 2024-04-26T10:22:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:15.339 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 8 2024-04-26T10:22:15.339 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:15.341 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:15.382 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:15.380+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:15.468 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:15.468 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:15.468 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:15.468 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:15.468 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:15.481 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:15.483 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:15.480+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:15.499 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:15.522 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:15.522 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:15.522 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:15.522 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:15.527 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:15.527 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:15.584 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:15.579+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:15.613 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:15.613 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:15.617 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 42 16 93380 93364 138.918 127.062 0.0069558 0.00719278 2024-04-26T10:22:15.626 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:15.685 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:15.680+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:15.760 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:15.760 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:15.768 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T10:22:15.774 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:15.786 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:15.784+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:15.888 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:15.888 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:15.896 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:15.933 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:15.884+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:15.990 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:15.983+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:16.072 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:16.072 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:16.086 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:16.089 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:16.083+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:16.190 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:16.188+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:16.216 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:16.216 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:16.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:16.291 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:16.287+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:16.355 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:16.355 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:16.366 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:16.391 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:16.387+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:16.492 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:16.488+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:16.496 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:16.496 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:16.508 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:16.593 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:16.587+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:16.617 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 43 16 95217 95201 138.357 114.812 0.00408983 0.00722174 2024-04-26T10:22:16.643 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:16.643 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:16.656 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:16.694 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:16.687+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:16.787 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:16.787 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:16.795 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:16.792+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:16.800 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:16.898 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:16.892+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:16.932 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:16.932 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:16.944 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:16.998 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:16.992+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:17.074 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:17.074 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:17.086 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:17.098 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:17.096+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:17.199 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:17.195+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:17.214 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:17.214 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:17.226 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:17.302 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:17.296+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:17.356 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:17.356 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:17.370 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:17.402 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:17.395+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:17.504 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:17.500+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:17.505 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:17.505 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:17.516 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:17.528 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:22:17.604 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:17.599+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:17.617 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 44 16 97258 97242 138.112 127.562 0.00584582 0.00723495 2024-04-26T10:22:17.647 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:17.647 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:17.660 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:17.686 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:17.706 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:17.699+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:17.707 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:17.708 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:17.708 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:17.708 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:17.712 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:17.713 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:17.780 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:22:17.798 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:17.798 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:17.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:17.798 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:17.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.798 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:17.798 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:17.798 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.264960950999999, 2024-04-26T10:22:17.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:17.798 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.799 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.799 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:17.799 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:17.799 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:17.799 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:17.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.799 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:17.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:17.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:17.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:17.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:17.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:17.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:17.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:17.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:17.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:17.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:17.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:17.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:17.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:17.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:17.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:17.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:17.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:17.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:17.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:17.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:17.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:17.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:17.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:17.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:17.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:17.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:17.804 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.804 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.804 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.805 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:17.805 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:17.805 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.260425738999999, 2024-04-26T10:22:17.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:17.805 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.805 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.805 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:17.805 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:17.805 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:17.805 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:17.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.805 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:17.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:17.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:17.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:17.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:17.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:17.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:17.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:17.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:17.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:17.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:17.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:17.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:17.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:17.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:17.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:17.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:17.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:17.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:17.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:17.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:17.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:17.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:17.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:17.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:17.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:17.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:17.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.810 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.810 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:17.810 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:17.811 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.259794447000001, 2024-04-26T10:22:17.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:17.811 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.811 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:17.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:17.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:17.811 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:17.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.811 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:17.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:17.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:17.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:17.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:17.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:17.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:17.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:17.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:17.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:17.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:17.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:17.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:17.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:17.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:17.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:17.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:17.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:17.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:17.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:17.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:17.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:17.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:17.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:17.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:17.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:17.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:17.816 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.816 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.816 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.816 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65604 5.9 5:9c239c32:::benchmark_data_smithi052_19421_object65603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:17.816 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:17.816 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.024691563000001, 2024-04-26T10:22:17.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025897677000000001, 2024-04-26T10:22:17.817 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.817 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.817 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:17.817 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:17.817 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:17.817 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65604 2024-04-26T10:22:17.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.817 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:17.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:17.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769615+0000", 2024-04-26T10:22:17.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:17.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769694+0000", 2024-04-26T10:22:17.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9087999999999999e-05 2024-04-26T10:22:17.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769702+0000", 2024-04-26T10:22:17.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8150000000000006e-06 2024-04-26T10:22:17.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769709+0000", 2024-04-26T10:22:17.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:22:17.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772336+0000", 2024-04-26T10:22:17.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002626836 2024-04-26T10:22:17.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772470+0000", 2024-04-26T10:22:17.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013453299999999999 2024-04-26T10:22:17.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:17.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772605+0000", 2024-04-26T10:22:17.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013428499999999999 2024-04-26T10:22:17.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:17.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779374+0000", 2024-04-26T10:22:17.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067694000000000001 2024-04-26T10:22:17.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:17.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795401+0000", 2024-04-26T10:22:17.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016026543000000001 2024-04-26T10:22:17.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795461+0000", 2024-04-26T10:22:17.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9923999999999998e-05 2024-04-26T10:22:17.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795513+0000", 2024-04-26T10:22:17.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2737e-05 2024-04-26T10:22:17.822 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.822 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.822 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.822 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65613 5.1 5:85cc6530:::benchmark_data_smithi052_19421_object65612:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:17.822 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:17.822 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.022318516999999, 2024-04-26T10:22:17.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023662843999999999, 2024-04-26T10:22:17.822 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.822 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.823 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:17.823 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:17.823 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:17.823 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65613 2024-04-26T10:22:17.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.823 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:17.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771989+0000", 2024-04-26T10:22:17.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.771988+0000", 2024-04-26T10:22:17.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:17.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772053+0000", 2024-04-26T10:22:17.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5067000000000006e-05 2024-04-26T10:22:17.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772065+0000", 2024-04-26T10:22:17.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2252999999999999e-05 2024-04-26T10:22:17.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772072+0000", 2024-04-26T10:22:17.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1400000000000002e-06 2024-04-26T10:22:17.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779354+0000", 2024-04-26T10:22:17.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072818120000000004 2024-04-26T10:22:17.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779455+0000", 2024-04-26T10:22:17.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101109 2024-04-26T10:22:17.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:17.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795526+0000", 2024-04-26T10:22:17.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016071203999999999 2024-04-26T10:22:17.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795572+0000", 2024-04-26T10:22:17.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5865999999999998e-05 2024-04-26T10:22:17.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795651+0000", 2024-04-26T10:22:17.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9192999999999999e-05 2024-04-26T10:22:17.828 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.828 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.828 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.828 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65614 5.9 5:993a4fbe:::benchmark_data_smithi052_19421_object65613:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:17.828 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:17.828 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.022226325999998, 2024-04-26T10:22:17.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023664145000000001, 2024-04-26T10:22:17.828 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.829 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:17.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:17.829 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:17.829 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65614 2024-04-26T10:22:17.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.829 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:17.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:17.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772080+0000", 2024-04-26T10:22:17.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:17.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772117+0000", 2024-04-26T10:22:17.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6418000000000003e-05 2024-04-26T10:22:17.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772124+0000", 2024-04-26T10:22:17.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4730000000000003e-06 2024-04-26T10:22:17.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772132+0000", 2024-04-26T10:22:17.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3900000000000004e-06 2024-04-26T10:22:17.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781379+0000", 2024-04-26T10:22:17.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092471059999999997 2024-04-26T10:22:17.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781495+0000", 2024-04-26T10:22:17.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001159 2024-04-26T10:22:17.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:17.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781581+0000", 2024-04-26T10:22:17.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6087000000000004e-05 2024-04-26T10:22:17.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:17.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.785948+0000", 2024-04-26T10:22:17.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043671669999999999 2024-04-26T10:22:17.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:17.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795661+0000", 2024-04-26T10:22:17.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097130310000000004 2024-04-26T10:22:17.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795710+0000", 2024-04-26T10:22:17.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8959000000000003e-05 2024-04-26T10:22:17.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795745+0000", 2024-04-26T10:22:17.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5172000000000001e-05 2024-04-26T10:22:17.835 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.835 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.836 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83591 5.4 e41/37 5:204a1b6d:::benchmark_data_smithi052_19421_object83590:head v 41'5271, mlcod=41'5268)", 2024-04-26T10:22:17.836 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:17.836 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.9473190440000003, 2024-04-26T10:22:17.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.046802200000000002, 2024-04-26T10:22:17.836 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.836 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.836 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:17.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:17.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846987+0000", 2024-04-26T10:22:17.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:17.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846995+0000", 2024-04-26T10:22:17.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7549999999999994e-06 2024-04-26T10:22:17.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847004+0000", 2024-04-26T10:22:17.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3190000000000001e-06 2024-04-26T10:22:17.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847011+0000", 2024-04-26T10:22:17.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5039999999999999e-06 2024-04-26T10:22:17.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847048+0000", 2024-04-26T10:22:17.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7052999999999999e-05 2024-04-26T10:22:17.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847066+0000", 2024-04-26T10:22:17.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8468999999999999e-05 2024-04-26T10:22:17.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893707+0000", 2024-04-26T10:22:17.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.046641123999999999 2024-04-26T10:22:17.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893790+0000", 2024-04-26T10:22:17.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2806999999999995e-05 2024-04-26T10:22:17.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.840 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.840 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.840 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83592 5.3 5:c96af6b1:::benchmark_data_smithi052_19421_object83591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:17.840 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:17.840 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.9459859000000002, 2024-04-26T10:22:17.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045543839000000003, 2024-04-26T10:22:17.841 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.841 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:17.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:17.841 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:17.841 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83592 2024-04-26T10:22:17.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.841 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848320+0000", 2024-04-26T10:22:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848465+0000", 2024-04-26T10:22:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000145291 2024-04-26T10:22:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848475+0000", 2024-04-26T10:22:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6709999999999994e-06 2024-04-26T10:22:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848482+0000", 2024-04-26T10:22:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2910000000000002e-06 2024-04-26T10:22:17.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848532+0000", 2024-04-26T10:22:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9199000000000001e-05 2024-04-26T10:22:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848676+0000", 2024-04-26T10:22:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014493399999999999 2024-04-26T10:22:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893707+0000", 2024-04-26T10:22:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045030857000000001 2024-04-26T10:22:17.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893772+0000", 2024-04-26T10:22:17.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4203999999999997e-05 2024-04-26T10:22:17.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893865+0000", 2024-04-26T10:22:17.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3577000000000002e-05 2024-04-26T10:22:17.845 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.845 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.845 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.846 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83593 5.0 e41/37 5:044bb3ac:::benchmark_data_smithi052_19421_object83592:head v 41'5187, mlcod=41'5184)", 2024-04-26T10:22:17.846 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:17.846 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.9454884830000001, 2024-04-26T10:22:17.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044951738999999998, 2024-04-26T10:22:17.846 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.846 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.846 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:17.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:17.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848818+0000", 2024-04-26T10:22:17.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:17.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848824+0000", 2024-04-26T10:22:17.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-04-26T10:22:17.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848895+0000", 2024-04-26T10:22:17.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1468000000000001e-05 2024-04-26T10:22:17.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848902+0000", 2024-04-26T10:22:17.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6229999999999999e-06 2024-04-26T10:22:17.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848955+0000", 2024-04-26T10:22:17.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3106000000000003e-05 2024-04-26T10:22:17.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848974+0000", 2024-04-26T10:22:17.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9598000000000001e-05 2024-04-26T10:22:17.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893703+0000", 2024-04-26T10:22:17.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044728315999999997 2024-04-26T10:22:17.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893770+0000", 2024-04-26T10:22:17.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7683999999999998e-05 2024-04-26T10:22:17.850 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.850 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.850 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.850 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83594 5.b e41/37 5:d024b819:::benchmark_data_smithi052_19421_object83593:head v 41'5142, mlcod=41'5140)", 2024-04-26T10:22:17.850 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:17.850 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.945378474, 2024-04-26T10:22:17.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044760763000000002, 2024-04-26T10:22:17.850 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.850 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.851 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:17.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:17.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848928+0000", 2024-04-26T10:22:17.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:17.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848933+0000", 2024-04-26T10:22:17.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:17.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848952+0000", 2024-04-26T10:22:17.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8884000000000001e-05 2024-04-26T10:22:17.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848957+0000", 2024-04-26T10:22:17.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8470000000000003e-06 2024-04-26T10:22:17.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848980+0000", 2024-04-26T10:22:17.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2946999999999999e-05 2024-04-26T10:22:17.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848992+0000", 2024-04-26T10:22:17.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1882000000000001e-05 2024-04-26T10:22:17.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893623+0000", 2024-04-26T10:22:17.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044631381999999997 2024-04-26T10:22:17.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893689+0000", 2024-04-26T10:22:17.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6285999999999995e-05 2024-04-26T10:22:17.858 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.858 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.858 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.858 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83595 5.1 5:829f4097:::benchmark_data_smithi052_19421_object83594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:17.858 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:17.858 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.9452896150000001, 2024-04-26T10:22:17.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048599369000000003, 2024-04-26T10:22:17.859 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.859 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:17.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:17.859 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:17.859 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83595 2024-04-26T10:22:17.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.860 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:17.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:17.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849017+0000", 2024-04-26T10:22:17.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:17.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849041+0000", 2024-04-26T10:22:17.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4239999999999998e-05 2024-04-26T10:22:17.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849048+0000", 2024-04-26T10:22:17.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4669999999999998e-06 2024-04-26T10:22:17.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849053+0000", 2024-04-26T10:22:17.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3839999999999999e-06 2024-04-26T10:22:17.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849099+0000", 2024-04-26T10:22:17.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6579999999999998e-05 2024-04-26T10:22:17.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849246+0000", 2024-04-26T10:22:17.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014681899999999999 2024-04-26T10:22:17.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:17.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897498+0000", 2024-04-26T10:22:17.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048252002000000002 2024-04-26T10:22:17.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897544+0000", 2024-04-26T10:22:17.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5497999999999997e-05 2024-04-26T10:22:17.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897617+0000", 2024-04-26T10:22:17.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3143000000000001e-05 2024-04-26T10:22:17.864 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.864 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.865 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83597 5.d 5:b4b0a3ad:::benchmark_data_smithi052_19421_object83596:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:17.865 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:17.865 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.9450241760000004, 2024-04-26T10:22:17.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.047933286999999998, 2024-04-26T10:22:17.865 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.865 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.865 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:17.865 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:17.865 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:17.865 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83597 2024-04-26T10:22:17.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.865 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:17.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:17.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849282+0000", 2024-04-26T10:22:17.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:17.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849384+0000", 2024-04-26T10:22:17.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010128600000000001 2024-04-26T10:22:17.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849392+0000", 2024-04-26T10:22:17.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4290000000000001e-06 2024-04-26T10:22:17.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849398+0000", 2024-04-26T10:22:17.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8969999999999996e-06 2024-04-26T10:22:17.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849481+0000", 2024-04-26T10:22:17.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3088000000000001e-05 2024-04-26T10:22:17.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849639+0000", 2024-04-26T10:22:17.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015797200000000001 2024-04-26T10:22:17.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:17.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849782+0000", 2024-04-26T10:22:17.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014353599999999999 2024-04-26T10:22:17.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:17.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894335+0000", 2024-04-26T10:22:17.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044552500000000002 2024-04-26T10:22:17.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:17.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896955+0000", 2024-04-26T10:22:17.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002620229 2024-04-26T10:22:17.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897051+0000", 2024-04-26T10:22:17.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5847999999999994e-05 2024-04-26T10:22:17.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897216+0000", 2024-04-26T10:22:17.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016519700000000001 2024-04-26T10:22:17.870 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.871 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.871 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.871 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83598 5.7 5:e1984dee:::benchmark_data_smithi052_19421_object83597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:17.871 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:17.871 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.9448981459999999, 2024-04-26T10:22:17.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.049315405999999999, 2024-04-26T10:22:17.871 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.871 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:17.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:17.871 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:17.871 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83598 2024-04-26T10:22:17.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.872 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:17.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:17.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849408+0000", 2024-04-26T10:22:17.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:17.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849466+0000", 2024-04-26T10:22:17.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7302000000000001e-05 2024-04-26T10:22:17.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849473+0000", 2024-04-26T10:22:17.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4900000000000003e-06 2024-04-26T10:22:17.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849479+0000", 2024-04-26T10:22:17.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3539999999999999e-06 2024-04-26T10:22:17.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849526+0000", 2024-04-26T10:22:17.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7246999999999997e-05 2024-04-26T10:22:17.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849677+0000", 2024-04-26T10:22:17.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000151218 2024-04-26T10:22:17.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:17.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898591+0000", 2024-04-26T10:22:17.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048914343999999998 2024-04-26T10:22:17.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898650+0000", 2024-04-26T10:22:17.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8288999999999997e-05 2024-04-26T10:22:17.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898724+0000", 2024-04-26T10:22:17.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4782000000000003e-05 2024-04-26T10:22:17.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.876 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.876 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83599 5.3 5:c6d96bef:::benchmark_data_smithi052_19421_object83598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:17.876 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:17.876 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.9428946649999999, 2024-04-26T10:22:17.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050758893999999999, 2024-04-26T10:22:17.876 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.876 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:17.876 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:17.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:17.877 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83599 2024-04-26T10:22:17.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.877 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:17.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:17.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851411+0000", 2024-04-26T10:22:17.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:17.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851465+0000", 2024-04-26T10:22:17.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3943999999999997e-05 2024-04-26T10:22:17.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851475+0000", 2024-04-26T10:22:17.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0220999999999999e-05 2024-04-26T10:22:17.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851482+0000", 2024-04-26T10:22:17.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3259999999999998e-06 2024-04-26T10:22:17.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851525+0000", 2024-04-26T10:22:17.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2255000000000001e-05 2024-04-26T10:22:17.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851617+0000", 2024-04-26T10:22:17.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2436999999999996e-05 2024-04-26T10:22:17.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:17.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902102+0000", 2024-04-26T10:22:17.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050485163 2024-04-26T10:22:17.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902130+0000", 2024-04-26T10:22:17.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8177000000000001e-05 2024-04-26T10:22:17.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902171+0000", 2024-04-26T10:22:17.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1091999999999999e-05 2024-04-26T10:22:17.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.881 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.881 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83596 5.b e41/37 5:d54e48a0:::benchmark_data_smithi052_19421_object83595:head v 41'5143, mlcod=41'5140)", 2024-04-26T10:22:17.881 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:17.881 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.942684335, 2024-04-26T10:22:17.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050472416999999999, 2024-04-26T10:22:17.881 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.881 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.881 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:17.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:17.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851621+0000", 2024-04-26T10:22:17.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:17.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851628+0000", 2024-04-26T10:22:17.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:22:17.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851635+0000", 2024-04-26T10:22:17.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6009999999999997e-06 2024-04-26T10:22:17.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851646+0000", 2024-04-26T10:22:17.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1248e-05 2024-04-26T10:22:17.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851687+0000", 2024-04-26T10:22:17.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1004999999999998e-05 2024-04-26T10:22:17.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851706+0000", 2024-04-26T10:22:17.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8994000000000001e-05 2024-04-26T10:22:17.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902062+0000", 2024-04-26T10:22:17.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050355957999999999 2024-04-26T10:22:17.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902095+0000", 2024-04-26T10:22:17.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2882000000000001e-05 2024-04-26T10:22:17.887 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.888 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.888 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.888 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83601 5.d 5:b32b06d1:::benchmark_data_smithi052_19421_object83600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:17.888 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:17.888 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.9423776190000002, 2024-04-26T10:22:17.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045519045000000001, 2024-04-26T10:22:17.888 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.888 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:17.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:17.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:17.889 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83601 2024-04-26T10:22:17.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.889 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:17.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:17.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851929+0000", 2024-04-26T10:22:17.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:17.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852104+0000", 2024-04-26T10:22:17.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175234 2024-04-26T10:22:17.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852110+0000", 2024-04-26T10:22:17.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.66e-06 2024-04-26T10:22:17.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852114+0000", 2024-04-26T10:22:17.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7809999999999999e-06 2024-04-26T10:22:17.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852153+0000", 2024-04-26T10:22:17.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9576000000000002e-05 2024-04-26T10:22:17.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852283+0000", 2024-04-26T10:22:17.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012946600000000001 2024-04-26T10:22:17.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:17.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852415+0000", 2024-04-26T10:22:17.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132719 2024-04-26T10:22:17.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:17.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894427+0000", 2024-04-26T10:22:17.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042011497000000002 2024-04-26T10:22:17.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:17.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897231+0000", 2024-04-26T10:22:17.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002804239 2024-04-26T10:22:17.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897306+0000", 2024-04-26T10:22:17.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4771999999999995e-05 2024-04-26T10:22:17.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897449+0000", 2024-04-26T10:22:17.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142707 2024-04-26T10:22:17.895 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.895 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.895 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.895 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83604 5.2 5:41ebe09c:::benchmark_data_smithi052_19421_object83603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:17.895 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:17.895 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.942184632, 2024-04-26T10:22:17.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044923596000000003, 2024-04-26T10:22:17.895 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.895 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:17.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:17.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:17.896 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83604 2024-04-26T10:22:17.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.896 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:17.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:17.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852122+0000", 2024-04-26T10:22:17.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:17.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852149+0000", 2024-04-26T10:22:17.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7596000000000001e-05 2024-04-26T10:22:17.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852154+0000", 2024-04-26T10:22:17.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0889999999999999e-06 2024-04-26T10:22:17.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852158+0000", 2024-04-26T10:22:17.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2830000000000002e-06 2024-04-26T10:22:17.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852194+0000", 2024-04-26T10:22:17.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6062000000000001e-05 2024-04-26T10:22:17.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852276+0000", 2024-04-26T10:22:17.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1891000000000006e-05 2024-04-26T10:22:17.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:17.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896782+0000", 2024-04-26T10:22:17.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044506271 2024-04-26T10:22:17.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896875+0000", 2024-04-26T10:22:17.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3499999999999996e-05 2024-04-26T10:22:17.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897046+0000", 2024-04-26T10:22:17.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017065200000000001 2024-04-26T10:22:17.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.900 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.900 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83606 5.1 5:81602529:::benchmark_data_smithi052_19421_object83605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:17.900 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:17.900 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.9418669949999998, 2024-04-26T10:22:17.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045300391000000002, 2024-04-26T10:22:17.900 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.900 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:17.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:17.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:17.901 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83606 2024-04-26T10:22:17.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.901 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:17.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:17.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852439+0000", 2024-04-26T10:22:17.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:17.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852535+0000", 2024-04-26T10:22:17.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6025000000000003e-05 2024-04-26T10:22:17.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852545+0000", 2024-04-26T10:22:17.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3619999999999995e-06 2024-04-26T10:22:17.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852551+0000", 2024-04-26T10:22:17.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4500000000000001e-06 2024-04-26T10:22:17.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852588+0000", 2024-04-26T10:22:17.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6785000000000001e-05 2024-04-26T10:22:17.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852668+0000", 2024-04-26T10:22:17.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0008999999999999e-05 2024-04-26T10:22:17.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:17.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897625+0000", 2024-04-26T10:22:17.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044956744999999999 2024-04-26T10:22:17.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897667+0000", 2024-04-26T10:22:17.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1887000000000001e-05 2024-04-26T10:22:17.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897741+0000", 2024-04-26T10:22:17.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4023000000000006e-05 2024-04-26T10:22:17.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.905 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.905 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83605 5.4 e41/37 5:2eb72b61:::benchmark_data_smithi052_19421_object83604:head v 41'5272, mlcod=41'5269)", 2024-04-26T10:22:17.905 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:17.905 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.9414596670000002, 2024-04-26T10:22:17.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044651192999999999, 2024-04-26T10:22:17.905 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.905 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.905 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:17.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:17.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:17.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:17.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852851+0000", 2024-04-26T10:22:17.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4560000000000002e-06 2024-04-26T10:22:17.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852859+0000", 2024-04-26T10:22:17.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2169999999999997e-06 2024-04-26T10:22:17.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852864+0000", 2024-04-26T10:22:17.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-04-26T10:22:17.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852899+0000", 2024-04-26T10:22:17.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4987000000000002e-05 2024-04-26T10:22:17.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852916+0000", 2024-04-26T10:22:17.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7563000000000001e-05 2024-04-26T10:22:17.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897449+0000", 2024-04-26T10:22:17.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044532644000000003 2024-04-26T10:22:17.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897499+0000", 2024-04-26T10:22:17.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9734999999999997e-05 2024-04-26T10:22:17.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.909 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.909 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83607 5.6 5:66b4c91d:::benchmark_data_smithi052_19421_object83606:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:17.909 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:17.909 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.9393292129999997, 2024-04-26T10:22:17.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048173940999999998, 2024-04-26T10:22:17.909 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:17.909 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:17.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:17.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:17.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:17.910 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83607 2024-04-26T10:22:17.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.910 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:17.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:17.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:17.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:17.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:17.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:17.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:17.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854976+0000", 2024-04-26T10:22:17.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:17.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:17.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.855030+0000", 2024-04-26T10:22:17.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3436000000000001e-05 2024-04-26T10:22:17.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:17.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893759+0000", 2024-04-26T10:22:17.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.038729302 2024-04-26T10:22:17.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:17.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893777+0000", 2024-04-26T10:22:17.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7343e-05 2024-04-26T10:22:17.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:17.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893880+0000", 2024-04-26T10:22:17.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103285 2024-04-26T10:22:17.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:17.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894161+0000", 2024-04-26T10:22:17.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000280704 2024-04-26T10:22:17.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:17.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902948+0000", 2024-04-26T10:22:17.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087876059999999999 2024-04-26T10:22:17.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:17.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.903028+0000", 2024-04-26T10:22:17.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9486000000000004e-05 2024-04-26T10:22:17.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:17.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:17.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:17.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.903152+0000", 2024-04-26T10:22:17.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012426599999999999 2024-04-26T10:22:17.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.914 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:17.914 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:17.914 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:17.914 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T10:22:17.925 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:17.926 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:17.920+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:18.025 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~29s 2024-04-26T10:22:18.025 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-04-26T10:22:18.026 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:18.020+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:18.057 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:18.058 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:18.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.058 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:98159 5.4 5:264e7248:::benchmark_data_smithi052_19421_object98158:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.058 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:18.049471+0000", 2024-04-26T10:22:18.058 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0067736610000000003, 2024-04-26T10:22:18.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0068002959999999999, 2024-04-26T10:22:18.058 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.058 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:18.058 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.058 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.058 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.059 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 98159 2024-04-26T10:22:18.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.059 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.049471+0000", 2024-04-26T10:22:18.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.049471+0000", 2024-04-26T10:22:18.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.049471+0000", 2024-04-26T10:22:18.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:18.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.049502+0000", 2024-04-26T10:22:18.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1267999999999999e-05 2024-04-26T10:22:18.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.049507+0000", 2024-04-26T10:22:18.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7520000000000004e-06 2024-04-26T10:22:18.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.049510+0000", 2024-04-26T10:22:18.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4659999999999999e-06 2024-04-26T10:22:18.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.051803+0000", 2024-04-26T10:22:18.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002292901 2024-04-26T10:22:18.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.051903+0000", 2024-04-26T10:22:18.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9783000000000003e-05 2024-04-26T10:22:18.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:18.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.052018+0000", 2024-04-26T10:22:18.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115585 2024-04-26T10:22:18.062 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.062 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.062 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.063 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:98161 5.8 5:1094f4ac:::benchmark_data_smithi052_19421_object98160:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.063 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:18.049518+0000", 2024-04-26T10:22:18.063 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0067266660000000001, 2024-04-26T10:22:18.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0068353169999999996, 2024-04-26T10:22:18.063 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.063 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:18.063 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.063 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.063 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.063 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 98161 2024-04-26T10:22:18.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.063 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.049518+0000", 2024-04-26T10:22:18.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.049518+0000", 2024-04-26T10:22:18.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.049518+0000", 2024-04-26T10:22:18.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:18.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.049576+0000", 2024-04-26T10:22:18.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8508999999999998e-05 2024-04-26T10:22:18.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.049581+0000", 2024-04-26T10:22:18.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7149999999999997e-06 2024-04-26T10:22:18.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.049584+0000", 2024-04-26T10:22:18.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.337e-06 2024-04-26T10:22:18.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050392+0000", 2024-04-26T10:22:18.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00080763299999999998 2024-04-26T10:22:18.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050536+0000", 2024-04-26T10:22:18.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000144394 2024-04-26T10:22:18.066 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.066 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.066 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.067 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:98164 5.4 5:2a29f7d3:::benchmark_data_smithi052_19421_object98163:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.067 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:18.050166+0000", 2024-04-26T10:22:18.067 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.006079058, 2024-04-26T10:22:18.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0062564099999999996, 2024-04-26T10:22:18.067 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.067 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:18.067 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.067 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.067 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.067 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 98164 2024-04-26T10:22:18.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.068 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050166+0000", 2024-04-26T10:22:18.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050166+0000", 2024-04-26T10:22:18.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050165+0000", 2024-04-26T10:22:18.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050235+0000", 2024-04-26T10:22:18.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0797999999999995e-05 2024-04-26T10:22:18.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050248+0000", 2024-04-26T10:22:18.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2079000000000001e-05 2024-04-26T10:22:18.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050256+0000", 2024-04-26T10:22:18.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1380000000000007e-06 2024-04-26T10:22:18.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.054130+0000", 2024-04-26T10:22:18.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038748039999999999 2024-04-26T10:22:18.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.054268+0000", 2024-04-26T10:22:18.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013781199999999999 2024-04-26T10:22:18.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:18.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.054427+0000", 2024-04-26T10:22:18.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015874199999999999 2024-04-26T10:22:18.071 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.071 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.071 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.071 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:98156 5.d e43/37 5:b151451a:::benchmark_data_smithi052_19421_object98155:head v 43'6156, mlcod=43'6154)", 2024-04-26T10:22:18.071 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:18.050233+0000", 2024-04-26T10:22:18.071 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0060116400000000004, 2024-04-26T10:22:18.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0062570400000000002, 2024-04-26T10:22:18.071 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.071 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:18.072 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050233+0000", 2024-04-26T10:22:18.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050233+0000", 2024-04-26T10:22:18.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050232+0000", 2024-04-26T10:22:18.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050313+0000", 2024-04-26T10:22:18.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0422999999999999e-05 2024-04-26T10:22:18.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050340+0000", 2024-04-26T10:22:18.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7004000000000001e-05 2024-04-26T10:22:18.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050350+0000", 2024-04-26T10:22:18.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9620000000000005e-06 2024-04-26T10:22:18.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050410+0000", 2024-04-26T10:22:18.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9873000000000001e-05 2024-04-26T10:22:18.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050437+0000", 2024-04-26T10:22:18.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7708999999999998e-05 2024-04-26T10:22:18.074 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.075 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.075 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.075 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:98166 5.b 5:d6f5e51a:::benchmark_data_smithi052_19421_object98165:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.075 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:18.050576+0000", 2024-04-26T10:22:18.075 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0056690589999999997, 2024-04-26T10:22:18.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0059764420000000002, 2024-04-26T10:22:18.075 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.075 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:18.075 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.075 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.075 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.075 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 98166 2024-04-26T10:22:18.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.076 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050576+0000", 2024-04-26T10:22:18.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050576+0000", 2024-04-26T10:22:18.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050575+0000", 2024-04-26T10:22:18.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050631+0000", 2024-04-26T10:22:18.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6159000000000002e-05 2024-04-26T10:22:18.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050644+0000", 2024-04-26T10:22:18.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3568e-05 2024-04-26T10:22:18.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050653+0000", 2024-04-26T10:22:18.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.439e-06 2024-04-26T10:22:18.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050702+0000", 2024-04-26T10:22:18.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9431000000000002e-05 2024-04-26T10:22:18.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.050858+0000", 2024-04-26T10:22:18.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000155334 2024-04-26T10:22:18.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:18.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.051036+0000", 2024-04-26T10:22:18.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000178562 2024-04-26T10:22:18.079 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.079 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.079 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.079 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop_reply(client.4722.0:98154 5.4 e43/37 ondisk, result = 0)", 2024-04-26T10:22:18.079 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:18.051993+0000", 2024-04-26T10:22:18.079 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0042518709999999999, 2024-04-26T10:22:18.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046240960000000003, 2024-04-26T10:22:18.080 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.080 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:18.080 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.051993+0000", 2024-04-26T10:22:18.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.051993+0000", 2024-04-26T10:22:18.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.051992+0000", 2024-04-26T10:22:18.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:18.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.051997+0000", 2024-04-26T10:22:18.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5870000000000003e-06 2024-04-26T10:22:18.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.052008+0000", 2024-04-26T10:22:18.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0774999999999999e-05 2024-04-26T10:22:18.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.052014+0000", 2024-04-26T10:22:18.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2380000000000002e-06 2024-04-26T10:22:18.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056524+0000", 2024-04-26T10:22:18.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045098020000000003 2024-04-26T10:22:18.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056528+0000", 2024-04-26T10:22:18.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7149999999999997e-06 2024-04-26T10:22:18.083 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.083 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.083 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.083 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:98162 5.9 e43/37 5:95b7647b:::benchmark_data_smithi052_19421_object98161:head v 43'6200, mlcod=43'6198)", 2024-04-26T10:22:18.083 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:18.052248+0000", 2024-04-26T10:22:18.083 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0039969910000000001, 2024-04-26T10:22:18.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044307260000000003, 2024-04-26T10:22:18.083 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.084 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:18.084 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.052248+0000", 2024-04-26T10:22:18.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.052248+0000", 2024-04-26T10:22:18.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.052247+0000", 2024-04-26T10:22:18.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:18.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.052320+0000", 2024-04-26T10:22:18.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2682999999999995e-05 2024-04-26T10:22:18.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.052328+0000", 2024-04-26T10:22:18.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1159999999999999e-06 2024-04-26T10:22:18.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.052333+0000", 2024-04-26T10:22:18.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5709999999999997e-06 2024-04-26T10:22:18.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.052380+0000", 2024-04-26T10:22:18.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6507e-05 2024-04-26T10:22:18.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.052399+0000", 2024-04-26T10:22:18.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9313e-05 2024-04-26T10:22:18.086 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.087 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.087 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.087 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:98169 5.b 5:d271c16b:::benchmark_data_smithi052_19421_object98168:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.087 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:18.053290+0000", 2024-04-26T10:22:18.087 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0029546580000000002, 2024-04-26T10:22:18.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034506879999999999, 2024-04-26T10:22:18.087 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.087 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:18.087 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.087 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.087 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.087 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 98169 2024-04-26T10:22:18.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.088 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.053290+0000", 2024-04-26T10:22:18.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.053290+0000", 2024-04-26T10:22:18.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.053289+0000", 2024-04-26T10:22:18.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:18.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.053341+0000", 2024-04-26T10:22:18.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2351000000000001e-05 2024-04-26T10:22:18.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.053353+0000", 2024-04-26T10:22:18.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.202e-05 2024-04-26T10:22:18.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.053358+0000", 2024-04-26T10:22:18.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2510000000000002e-06 2024-04-26T10:22:18.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.053395+0000", 2024-04-26T10:22:18.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6248999999999998e-05 2024-04-26T10:22:18.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.053490+0000", 2024-04-26T10:22:18.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4988999999999995e-05 2024-04-26T10:22:18.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:18.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.053580+0000", 2024-04-26T10:22:18.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0673000000000004e-05 2024-04-26T10:22:18.091 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.091 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.091 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.091 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:98163 5.d e43/37 5:b65d06fc:::benchmark_data_smithi052_19421_object98162:head v 43'6157, mlcod=43'6154)", 2024-04-26T10:22:18.091 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:18.053893+0000", 2024-04-26T10:22:18.091 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0023522840000000001, 2024-04-26T10:22:18.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029140910000000002, 2024-04-26T10:22:18.092 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.092 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:18.092 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.053893+0000", 2024-04-26T10:22:18.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.053893+0000", 2024-04-26T10:22:18.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.053892+0000", 2024-04-26T10:22:18.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:18.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.053928+0000", 2024-04-26T10:22:18.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6220000000000002e-05 2024-04-26T10:22:18.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.053937+0000", 2024-04-26T10:22:18.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3540000000000006e-06 2024-04-26T10:22:18.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.053944+0000", 2024-04-26T10:22:18.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2110000000000003e-06 2024-04-26T10:22:18.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.053986+0000", 2024-04-26T10:22:18.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2485999999999999e-05 2024-04-26T10:22:18.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.054006+0000", 2024-04-26T10:22:18.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9419000000000002e-05 2024-04-26T10:22:18.095 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.095 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.095 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.095 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop_reply(client.4722.0:98158 5.4 e43/37 ondisk, result = 0)", 2024-04-26T10:22:18.095 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:18.054046+0000", 2024-04-26T10:22:18.095 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0021989140000000002, 2024-04-26T10:22:18.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002810515, 2024-04-26T10:22:18.095 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.095 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:18.095 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.054046+0000", 2024-04-26T10:22:18.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.054046+0000", 2024-04-26T10:22:18.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.054045+0000", 2024-04-26T10:22:18.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:18.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.054049+0000", 2024-04-26T10:22:18.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5860000000000001e-06 2024-04-26T10:22:18.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.054056+0000", 2024-04-26T10:22:18.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:18.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.054063+0000", 2024-04-26T10:22:18.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0249999999999997e-06 2024-04-26T10:22:18.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056669+0000", 2024-04-26T10:22:18.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002605577 2024-04-26T10:22:18.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056676+0000", 2024-04-26T10:22:18.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3409999999999997e-06 2024-04-26T10:22:18.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056856+0000", 2024-04-26T10:22:18.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000180373 2024-04-26T10:22:18.099 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.099 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.099 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.099 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:98170 5.e 5:75c04eee:::benchmark_data_smithi052_19421_object98169:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.099 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:18.055471+0000", 2024-04-26T10:22:18.099 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00077335399999999997, 2024-04-26T10:22:18.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014531819999999999, 2024-04-26T10:22:18.099 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.099 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:18.099 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.100 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.100 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.100 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 98170 2024-04-26T10:22:18.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.100 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.055471+0000", 2024-04-26T10:22:18.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.055471+0000", 2024-04-26T10:22:18.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.055470+0000", 2024-04-26T10:22:18.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.055521+0000", 2024-04-26T10:22:18.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0869999999999999e-05 2024-04-26T10:22:18.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.055532+0000", 2024-04-26T10:22:18.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1014e-05 2024-04-26T10:22:18.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.055537+0000", 2024-04-26T10:22:18.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1080000000000001e-06 2024-04-26T10:22:18.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.055575+0000", 2024-04-26T10:22:18.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7737000000000001e-05 2024-04-26T10:22:18.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.055685+0000", 2024-04-26T10:22:18.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110151 2024-04-26T10:22:18.103 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.103 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.103 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.103 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:98171 5.8 5:119d2785:::benchmark_data_smithi052_19421_object98170:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.103 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:18.056152+0000", 2024-04-26T10:22:18.103 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.2837000000000006e-05, 2024-04-26T10:22:18.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00083642000000000005, 2024-04-26T10:22:18.103 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.103 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:18.103 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.104 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.104 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.104 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 98171 2024-04-26T10:22:18.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.104 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056152+0000", 2024-04-26T10:22:18.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056152+0000", 2024-04-26T10:22:18.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056151+0000", 2024-04-26T10:22:18.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056190+0000", 2024-04-26T10:22:18.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9208999999999997e-05 2024-04-26T10:22:18.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056201+0000", 2024-04-26T10:22:18.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0618999999999999e-05 2024-04-26T10:22:18.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056210+0000", 2024-04-26T10:22:18.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4190000000000008e-06 2024-04-26T10:22:18.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056247+0000", 2024-04-26T10:22:18.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7228999999999999e-05 2024-04-26T10:22:18.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056409+0000", 2024-04-26T10:22:18.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016167800000000001 2024-04-26T10:22:18.107 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.107 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.107 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.107 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:98174 5.0 5.21044df0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.107 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:18.056723+0000", 2024-04-26T10:22:18.107 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9995213, 2024-04-26T10:22:18.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032407099999999999, 2024-04-26T10:22:18.107 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.107 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:18.108 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.108 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.108 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.108 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 98174 2024-04-26T10:22:18.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.108 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056723+0000", 2024-04-26T10:22:18.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056723+0000", 2024-04-26T10:22:18.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056722+0000", 2024-04-26T10:22:18.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056757+0000", 2024-04-26T10:22:18.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4372000000000002e-05 2024-04-26T10:22:18.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056768+0000", 2024-04-26T10:22:18.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1107000000000001e-05 2024-04-26T10:22:18.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056774+0000", 2024-04-26T10:22:18.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.596e-06 2024-04-26T10:22:18.110 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.110 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.110 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.110 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:98175 5.0 5.57748cb0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.111 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:18.056817+0000", 2024-04-26T10:22:18.111 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9994278, 2024-04-26T10:22:18.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027998600000000003, 2024-04-26T10:22:18.111 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.111 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:18.111 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.111 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.111 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.111 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 98175 2024-04-26T10:22:18.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.111 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056817+0000", 2024-04-26T10:22:18.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056817+0000", 2024-04-26T10:22:18.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056816+0000", 2024-04-26T10:22:18.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:18.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056958+0000", 2024-04-26T10:22:18.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014170900000000001 2024-04-26T10:22:18.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056973+0000", 2024-04-26T10:22:18.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4812e-05 2024-04-26T10:22:18.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:18.056990+0000", 2024-04-26T10:22:18.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7659000000000002e-05 2024-04-26T10:22:18.113 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.113 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.113 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.114 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.114 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:18.114 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 14 2024-04-26T10:22:18.114 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:18.115 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:18.126 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:18.120+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:18.227 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:18.224+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:18.246 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:18.246 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:18.246 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:18.259 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:18.327 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:18.323+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:18.382 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:18.382 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:18.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:18.382 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:18.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.383 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:18.383 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:18.383 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.849910365, 2024-04-26T10:22:18.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:18.383 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.383 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.383 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.383 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.383 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.383 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:18.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.383 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:18.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:18.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:18.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:18.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:18.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:18.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:18.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:18.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:18.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:18.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:18.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:18.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:18.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:18.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:18.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:18.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:18.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:18.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:18.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:18.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:18.387 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.387 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.387 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.388 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:18.388 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:18.388 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.847928138, 2024-04-26T10:22:18.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:18.388 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.388 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.388 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.388 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.388 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.388 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:18.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.388 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:18.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:18.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:18.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:18.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:18.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:18.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:18.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:18.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:18.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:18.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:18.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:18.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:18.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:18.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:18.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:18.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:18.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:18.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:18.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:18.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:18.392 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.392 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.392 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.393 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:18.393 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:18.393 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.847728753999998, 2024-04-26T10:22:18.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:18.393 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.393 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.393 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.393 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.393 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.393 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:18.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.393 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:18.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:18.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:18.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:18.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:18.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:18.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:18.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:18.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:18.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:18.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:18.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:18.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:18.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:18.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:18.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:18.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:18.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:18.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:18.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:18.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:18.397 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.398 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.398 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.398 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:18.398 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:18.398 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.847510134, 2024-04-26T10:22:18.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:18.398 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.398 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.398 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:18.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:18.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:18.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:18.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:18.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:18.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:18.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:18.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:18.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:18.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:18.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:18.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:18.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:18.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:18.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:18.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:18.402 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.402 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.402 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.402 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:18.402 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:18.403 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.845138695999999, 2024-04-26T10:22:18.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:18.403 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.403 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.403 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.403 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.403 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.403 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:18.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.403 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:18.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:18.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:18.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:18.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:18.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:18.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:18.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:18.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:18.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:18.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:18.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:18.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:18.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:18.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:18.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:18.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:18.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:18.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:18.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:18.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:18.407 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.407 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.407 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.408 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:18.408 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:18.408 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.845038074000001, 2024-04-26T10:22:18.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:18.408 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.408 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.408 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.408 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.408 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.408 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:18.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.408 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:18.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:18.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:18.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:18.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:18.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:18.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:18.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:18.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:18.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:18.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:18.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:18.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:18.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:18.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:18.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:18.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:18.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:18.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:18.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:18.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:18.412 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.412 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.412 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.412 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:18.413 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:18.413 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.844919513000001, 2024-04-26T10:22:18.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:18.413 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.413 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.413 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:18.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:18.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:18.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:18.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:18.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:18.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:18.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:18.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:18.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:18.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:18.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:18.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:18.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:18.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:18.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:18.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:18.417 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.417 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.417 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.417 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:18.417 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:18.417 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.844817115000001, 2024-04-26T10:22:18.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:18.417 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.417 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.417 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.417 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.417 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.418 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:18.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.418 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:18.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:18.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:18.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:18.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:18.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:18.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:18.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:18.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:18.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:18.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:18.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:18.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:18.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:18.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:18.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:18.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:18.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:18.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:18.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:18.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:18.422 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.422 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.422 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.422 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65294 5.e 5:7438ad6f:::benchmark_data_smithi052_19421_object65293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:18.422 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:18.422 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.844136998, 2024-04-26T10:22:18.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091965517999999996, 2024-04-26T10:22:18.422 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.422 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.422 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.422 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.423 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.423 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65294 2024-04-26T10:22:18.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.423 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:18.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:18.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536413+0000", 2024-04-26T10:22:18.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536470+0000", 2024-04-26T10:22:18.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6443999999999997e-05 2024-04-26T10:22:18.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536480+0000", 2024-04-26T10:22:18.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0652999999999999e-05 2024-04-26T10:22:18.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536488+0000", 2024-04-26T10:22:18.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7929999999999998e-06 2024-04-26T10:22:18.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536548+0000", 2024-04-26T10:22:18.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9556999999999999e-05 2024-04-26T10:22:18.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536728+0000", 2024-04-26T10:22:18.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000180958 2024-04-26T10:22:18.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:18.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628168+0000", 2024-04-26T10:22:18.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091439276999999999 2024-04-26T10:22:18.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628258+0000", 2024-04-26T10:22:18.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0158e-05 2024-04-26T10:22:18.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628380+0000", 2024-04-26T10:22:18.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012180699999999999 2024-04-26T10:22:18.427 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.427 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.427 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.427 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:18.427 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:18.427 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.843796558000001, 2024-04-26T10:22:18.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:18.428 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.428 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.428 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.428 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.428 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.428 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:18.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.428 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:18.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:18.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:18.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:18.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:18.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:18.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:18.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:18.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:18.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:18.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:18.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:18.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:18.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:18.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:18.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:18.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:18.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:18.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:18.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:18.432 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.432 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.432 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.432 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:18.432 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:18.432 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.842646283000001, 2024-04-26T10:22:18.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:18.433 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.433 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.433 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.433 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.433 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.433 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:18.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.433 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:18.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:18.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:18.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:18.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:18.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:18.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:18.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:18.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:18.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:18.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:18.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:18.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:18.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:18.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:18.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:18.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:18.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:18.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:18.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:18.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:18.437 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.437 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.437 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.437 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65292 5.f e34/22 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head v 34'4129, mlcod=34'4125)", 2024-04-26T10:22:18.437 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:18.438 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.842472026999999, 2024-04-26T10:22:18.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093470155999999999, 2024-04-26T10:22:18.438 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.438 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.438 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:18.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:18.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538078+0000", 2024-04-26T10:22:18.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538140+0000", 2024-04-26T10:22:18.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1970000000000005e-05 2024-04-26T10:22:18.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538149+0000", 2024-04-26T10:22:18.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2189999999999993e-06 2024-04-26T10:22:18.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538158+0000", 2024-04-26T10:22:18.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0930000000000003e-06 2024-04-26T10:22:18.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627053+0000", 2024-04-26T10:22:18.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088895221999999996 2024-04-26T10:22:18.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627092+0000", 2024-04-26T10:22:18.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9657000000000003e-05 2024-04-26T10:22:18.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631499+0000", 2024-04-26T10:22:18.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044066560000000001 2024-04-26T10:22:18.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631549+0000", 2024-04-26T10:22:18.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0259000000000001e-05 2024-04-26T10:22:18.441 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.441 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.442 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.442 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65298 5.b 5:d51c4e52:::benchmark_data_smithi052_19421_object65297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:18.442 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:18.442 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.841705569999998, 2024-04-26T10:22:18.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091641671999999993, 2024-04-26T10:22:18.442 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.442 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.442 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.442 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.442 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.442 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65298 2024-04-26T10:22:18.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.443 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:18.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:18.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538844+0000", 2024-04-26T10:22:18.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:18.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538919+0000", 2024-04-26T10:22:18.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4626e-05 2024-04-26T10:22:18.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626007+0000", 2024-04-26T10:22:18.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087087516000000004 2024-04-26T10:22:18.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626074+0000", 2024-04-26T10:22:18.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7077999999999997e-05 2024-04-26T10:22:18.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626150+0000", 2024-04-26T10:22:18.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5982999999999994e-05 2024-04-26T10:22:18.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626341+0000", 2024-04-26T10:22:18.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019141199999999999 2024-04-26T10:22:18.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:18.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630359+0000", 2024-04-26T10:22:18.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040175710000000002 2024-04-26T10:22:18.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630412+0000", 2024-04-26T10:22:18.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3779000000000001e-05 2024-04-26T10:22:18.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630487+0000", 2024-04-26T10:22:18.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4913999999999995e-05 2024-04-26T10:22:18.447 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.447 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.447 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.447 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:81355 5.8 5:14f6458e:::benchmark_data_smithi052_19421_object81354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:18.447 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:18.447 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.5712685700000009, 2024-04-26T10:22:18.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027247422, 2024-04-26T10:22:18.447 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.447 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.447 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.447 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.448 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.448 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 81355 2024-04-26T10:22:18.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.448 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:18.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:18.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809281+0000", 2024-04-26T10:22:18.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:18.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809337+0000", 2024-04-26T10:22:18.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5627999999999997e-05 2024-04-26T10:22:18.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809349+0000", 2024-04-26T10:22:18.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1554e-05 2024-04-26T10:22:18.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809355+0000", 2024-04-26T10:22:18.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2559999999999999e-06 2024-04-26T10:22:18.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.823233+0000", 2024-04-26T10:22:18.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013877647999999999 2024-04-26T10:22:18.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.823361+0000", 2024-04-26T10:22:18.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012813500000000001 2024-04-26T10:22:18.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:18.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836404+0000", 2024-04-26T10:22:18.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013043592999999999 2024-04-26T10:22:18.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836468+0000", 2024-04-26T10:22:18.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3734999999999999e-05 2024-04-26T10:22:18.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836530+0000", 2024-04-26T10:22:18.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2065999999999998e-05 2024-04-26T10:22:18.452 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.452 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.452 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.452 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83591 5.4 5:204a1b6d:::benchmark_data_smithi052_19421_object83590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:18.452 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:18.452 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.532837335, 2024-04-26T10:22:18.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.047988034999999998, 2024-04-26T10:22:18.452 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.452 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.453 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.453 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.453 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.453 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83591 2024-04-26T10:22:18.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.453 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:18.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:18.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847713+0000", 2024-04-26T10:22:18.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847784+0000", 2024-04-26T10:22:18.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0723999999999996e-05 2024-04-26T10:22:18.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847795+0000", 2024-04-26T10:22:18.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1538e-05 2024-04-26T10:22:18.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847810+0000", 2024-04-26T10:22:18.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4354e-05 2024-04-26T10:22:18.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847850+0000", 2024-04-26T10:22:18.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0750000000000001e-05 2024-04-26T10:22:18.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847974+0000", 2024-04-26T10:22:18.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012394899999999999 2024-04-26T10:22:18.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:18.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.848089+0000", 2024-04-26T10:22:18.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114527 2024-04-26T10:22:18.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:18.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852900+0000", 2024-04-26T10:22:18.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048110779999999999 2024-04-26T10:22:18.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:18.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895562+0000", 2024-04-26T10:22:18.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042662053999999998 2024-04-26T10:22:18.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895622+0000", 2024-04-26T10:22:18.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0470000000000002e-05 2024-04-26T10:22:18.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895702+0000", 2024-04-26T10:22:18.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9541000000000003e-05 2024-04-26T10:22:18.458 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.458 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.458 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.458 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83593 5.0 5:044bb3ac:::benchmark_data_smithi052_19421_object83592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:18.458 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:18.458 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.5309504819999997, 2024-04-26T10:22:18.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.046164161000000002, 2024-04-26T10:22:18.458 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.458 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.458 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.458 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.459 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.459 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83593 2024-04-26T10:22:18.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.459 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:18.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:18.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849600+0000", 2024-04-26T10:22:18.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849655+0000", 2024-04-26T10:22:18.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5148999999999997e-05 2024-04-26T10:22:18.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849666+0000", 2024-04-26T10:22:18.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1494999999999999e-05 2024-04-26T10:22:18.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849677+0000", 2024-04-26T10:22:18.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0985000000000001e-05 2024-04-26T10:22:18.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849716+0000", 2024-04-26T10:22:18.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8698000000000001e-05 2024-04-26T10:22:18.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849822+0000", 2024-04-26T10:22:18.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000106173 2024-04-26T10:22:18.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:18.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849938+0000", 2024-04-26T10:22:18.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115738 2024-04-26T10:22:18.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:18.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853416+0000", 2024-04-26T10:22:18.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034777440000000001 2024-04-26T10:22:18.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:18.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895540+0000", 2024-04-26T10:22:18.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042124704999999998 2024-04-26T10:22:18.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895619+0000", 2024-04-26T10:22:18.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8697999999999998e-05 2024-04-26T10:22:18.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895765+0000", 2024-04-26T10:22:18.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014579299999999999 2024-04-26T10:22:18.463 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.463 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.463 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.464 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83594 5.b 5:d024b819:::benchmark_data_smithi052_19421_object83593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:18.464 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:18.464 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.530858244, 2024-04-26T10:22:18.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045938635999999998, 2024-04-26T10:22:18.464 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.464 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.464 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.464 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.464 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.464 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83594 2024-04-26T10:22:18.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.465 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:18.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:18.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849692+0000", 2024-04-26T10:22:18.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:18.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849730+0000", 2024-04-26T10:22:18.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7415e-05 2024-04-26T10:22:18.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849735+0000", 2024-04-26T10:22:18.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6350000000000003e-06 2024-04-26T10:22:18.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849740+0000", 2024-04-26T10:22:18.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4209999999999997e-06 2024-04-26T10:22:18.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849787+0000", 2024-04-26T10:22:18.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7166000000000002e-05 2024-04-26T10:22:18.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849915+0000", 2024-04-26T10:22:18.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012823700000000001 2024-04-26T10:22:18.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:18.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850038+0000", 2024-04-26T10:22:18.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012317 2024-04-26T10:22:18.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:18.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855812+0000", 2024-04-26T10:22:18.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057731340000000001 2024-04-26T10:22:18.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:18.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895504+0000", 2024-04-26T10:22:18.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.039692540999999998 2024-04-26T10:22:18.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895569+0000", 2024-04-26T10:22:18.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4443999999999995e-05 2024-04-26T10:22:18.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895632+0000", 2024-04-26T10:22:18.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3109999999999997e-05 2024-04-26T10:22:18.469 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.469 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.469 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.470 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83596 5.b 5:d54e48a0:::benchmark_data_smithi052_19421_object83595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:18.470 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:18.470 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.5300381630000004, 2024-04-26T10:22:18.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.053210201999999998, 2024-04-26T10:22:18.470 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.470 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.470 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.470 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.470 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.470 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83596 2024-04-26T10:22:18.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.471 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:18.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:18.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850512+0000", 2024-04-26T10:22:18.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:18.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850622+0000", 2024-04-26T10:22:18.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010927 2024-04-26T10:22:18.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850629+0000", 2024-04-26T10:22:18.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1690000000000003e-06 2024-04-26T10:22:18.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850633+0000", 2024-04-26T10:22:18.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4800000000000003e-06 2024-04-26T10:22:18.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852134+0000", 2024-04-26T10:22:18.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015011099999999999 2024-04-26T10:22:18.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852446+0000", 2024-04-26T10:22:18.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031107999999999998 2024-04-26T10:22:18.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:18.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852723+0000", 2024-04-26T10:22:18.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027751499999999999 2024-04-26T10:22:18.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:18.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861229+0000", 2024-04-26T10:22:18.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085055960000000007 2024-04-26T10:22:18.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:18.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903523+0000", 2024-04-26T10:22:18.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042294683999999999 2024-04-26T10:22:18.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903579+0000", 2024-04-26T10:22:18.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5751999999999997e-05 2024-04-26T10:22:18.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903723+0000", 2024-04-26T10:22:18.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014414199999999999 2024-04-26T10:22:18.475 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.475 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.475 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.476 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83603 5.b 5:d4896044:::benchmark_data_smithi052_19421_object83602:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:18.476 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:18.476 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.5271112760000003, 2024-04-26T10:22:18.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.053974093000000001, 2024-04-26T10:22:18.476 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.476 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.476 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.476 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.476 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.476 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83603 2024-04-26T10:22:18.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.476 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:18.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:18.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853439+0000", 2024-04-26T10:22:18.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:18.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853492+0000", 2024-04-26T10:22:18.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2265000000000002e-05 2024-04-26T10:22:18.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853504+0000", 2024-04-26T10:22:18.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2354999999999999e-05 2024-04-26T10:22:18.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853512+0000", 2024-04-26T10:22:18.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8630000000000008e-06 2024-04-26T10:22:18.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855839+0000", 2024-04-26T10:22:18.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002326776 2024-04-26T10:22:18.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855993+0000", 2024-04-26T10:22:18.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015428300000000001 2024-04-26T10:22:18.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:18.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.856138+0000", 2024-04-26T10:22:18.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000145427 2024-04-26T10:22:18.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:18.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861318+0000", 2024-04-26T10:22:18.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051795160000000003 2024-04-26T10:22:18.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:18.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907178+0000", 2024-04-26T10:22:18.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045859882999999997 2024-04-26T10:22:18.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907260+0000", 2024-04-26T10:22:18.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2133999999999997e-05 2024-04-26T10:22:18.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907414+0000", 2024-04-26T10:22:18.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015427400000000001 2024-04-26T10:22:18.481 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.481 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.481 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.482 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83605 5.4 5:2eb72b61:::benchmark_data_smithi052_19421_object83604:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:18.482 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:18.482 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.5270318280000001, 2024-04-26T10:22:18.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045576089, 2024-04-26T10:22:18.482 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:18.482 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:18.482 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:18.482 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:18.482 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.482 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83605 2024-04-26T10:22:18.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.482 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:18.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:18.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:18.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:18.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:18.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:18.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:18.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:18.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:18.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853557+0000", 2024-04-26T10:22:18.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8423000000000001e-05 2024-04-26T10:22:18.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:18.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853573+0000", 2024-04-26T10:22:18.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6201e-05 2024-04-26T10:22:18.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853583+0000", 2024-04-26T10:22:18.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9129999999999998e-06 2024-04-26T10:22:18.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:18.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853625+0000", 2024-04-26T10:22:18.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1965000000000002e-05 2024-04-26T10:22:18.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:18.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853795+0000", 2024-04-26T10:22:18.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169946 2024-04-26T10:22:18.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:18.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853980+0000", 2024-04-26T10:22:18.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018517100000000001 2024-04-26T10:22:18.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:18.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861356+0000", 2024-04-26T10:22:18.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073759389999999998 2024-04-26T10:22:18.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:18.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.898899+0000", 2024-04-26T10:22:18.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.037542786000000002 2024-04-26T10:22:18.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:18.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.898963+0000", 2024-04-26T10:22:18.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3652999999999995e-05 2024-04-26T10:22:18.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:18.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:18.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:18.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.899095+0000", 2024-04-26T10:22:18.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013286999999999999 2024-04-26T10:22:18.487 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.487 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.487 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.487 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:18.487 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:18.487 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:18.489 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:18.483+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:18.489 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:18.589 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:18.584+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:18.617 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 45 16 99354 99338 137.953 131 0.00975013 0.00724327 2024-04-26T10:22:18.629 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:18.629 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:99370 5.9 5:96e13e46:::benchmark_data_smithi052_19421_object99369:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:18.626590+0000", 2024-04-26T10:22:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0012024290000000001, 2024-04-26T10:22:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00122708, 2024-04-26T10:22:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 99370 2024-04-26T10:22:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.630 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626590+0000", 2024-04-26T10:22:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626590+0000", 2024-04-26T10:22:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626589+0000", 2024-04-26T10:22:18.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626627+0000", 2024-04-26T10:22:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7762999999999997e-05 2024-04-26T10:22:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626634+0000", 2024-04-26T10:22:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.725e-06 2024-04-26T10:22:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626638+0000", 2024-04-26T10:22:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:22:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626949+0000", 2024-04-26T10:22:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000311453 2024-04-26T10:22:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627059+0000", 2024-04-26T10:22:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010948 2024-04-26T10:22:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627235+0000", 2024-04-26T10:22:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017604099999999999 2024-04-26T10:22:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:99371 5.5 5:a2738940:::benchmark_data_smithi052_19421_object99370:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:18.626643+0000", 2024-04-26T10:22:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0011489670000000001, 2024-04-26T10:22:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001248355, 2024-04-26T10:22:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:18.634 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 99371 2024-04-26T10:22:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626643+0000", 2024-04-26T10:22:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626643+0000", 2024-04-26T10:22:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626643+0000", 2024-04-26T10:22:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626710+0000", 2024-04-26T10:22:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7069000000000004e-05 2024-04-26T10:22:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626717+0000", 2024-04-26T10:22:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.951e-06 2024-04-26T10:22:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626723+0000", 2024-04-26T10:22:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0070000000000003e-06 2024-04-26T10:22:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626784+0000", 2024-04-26T10:22:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0850000000000002e-05 2024-04-26T10:22:18.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626882+0000", 2024-04-26T10:22:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7804000000000001e-05 2024-04-26T10:22:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:99372 5.7 5:eb16e417:::benchmark_data_smithi052_19421_object99371:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:18.626747+0000", 2024-04-26T10:22:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001045336, 2024-04-26T10:22:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00120724, 2024-04-26T10:22:18.638 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 99372 2024-04-26T10:22:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626747+0000", 2024-04-26T10:22:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626747+0000", 2024-04-26T10:22:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626746+0000", 2024-04-26T10:22:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626815+0000", 2024-04-26T10:22:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8288999999999996e-05 2024-04-26T10:22:18.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626824+0000", 2024-04-26T10:22:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1239999999999994e-06 2024-04-26T10:22:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626838+0000", 2024-04-26T10:22:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4171999999999999e-05 2024-04-26T10:22:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627370+0000", 2024-04-26T10:22:18.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00053256099999999997 2024-04-26T10:22:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627481+0000", 2024-04-26T10:22:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110989 2024-04-26T10:22:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:99373 5.9 5.b12f07f9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:18.626850+0000", 2024-04-26T10:22:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00094193, 2024-04-26T10:22:18.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011582420000000001, 2024-04-26T10:22:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 99373 2024-04-26T10:22:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626850+0000", 2024-04-26T10:22:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626850+0000", 2024-04-26T10:22:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626850+0000", 2024-04-26T10:22:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626884+0000", 2024-04-26T10:22:18.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4737000000000003e-05 2024-04-26T10:22:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626892+0000", 2024-04-26T10:22:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5530000000000004e-06 2024-04-26T10:22:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626898+0000", 2024-04-26T10:22:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8340000000000004e-06 2024-04-26T10:22:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:99374 5.5 5.deab0675 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:18.627070+0000", 2024-04-26T10:22:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0007224, 2024-04-26T10:22:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00098489200000000002, 2024-04-26T10:22:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 99374 2024-04-26T10:22:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:18.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627070+0000", 2024-04-26T10:22:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627070+0000", 2024-04-26T10:22:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627069+0000", 2024-04-26T10:22:18.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627142+0000", 2024-04-26T10:22:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2978000000000005e-05 2024-04-26T10:22:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627211+0000", 2024-04-26T10:22:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9206000000000001e-05 2024-04-26T10:22:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627230+0000", 2024-04-26T10:22:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8751000000000001e-05 2024-04-26T10:22:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:99376 5.d 5.6b3da9dd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:18.627243+0000", 2024-04-26T10:22:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00054919799999999998, 2024-04-26T10:22:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00085559600000000003, 2024-04-26T10:22:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:18.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 99376 2024-04-26T10:22:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627243+0000", 2024-04-26T10:22:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:18.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627243+0000", 2024-04-26T10:22:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627242+0000", 2024-04-26T10:22:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627315+0000", 2024-04-26T10:22:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2622999999999999e-05 2024-04-26T10:22:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627326+0000", 2024-04-26T10:22:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0604e-05 2024-04-26T10:22:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627332+0000", 2024-04-26T10:22:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4509999999999997e-06 2024-04-26T10:22:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.652 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:99377 5.6 5.7ab3a706 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:18.627354+0000", 2024-04-26T10:22:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00043794800000000002, 2024-04-26T10:22:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00078881700000000003, 2024-04-26T10:22:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 99377 2024-04-26T10:22:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:18.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627354+0000", 2024-04-26T10:22:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627354+0000", 2024-04-26T10:22:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627354+0000", 2024-04-26T10:22:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627579+0000", 2024-04-26T10:22:18.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022578600000000001 2024-04-26T10:22:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627588+0000", 2024-04-26T10:22:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8149999999999995e-06 2024-04-26T10:22:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.627594+0000", 2024-04-26T10:22:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3380000000000001e-06 2024-04-26T10:22:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:99363 5.9 5:9d6b32eb:::benchmark_data_smithi052_19421_object99362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:18.622231+0000", 2024-04-26T10:22:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0055613169999999996, 2024-04-26T10:22:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059631420000000003, 2024-04-26T10:22:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:18.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 99363 2024-04-26T10:22:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622231+0000", 2024-04-26T10:22:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622231+0000", 2024-04-26T10:22:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622230+0000", 2024-04-26T10:22:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622285+0000", 2024-04-26T10:22:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5203e-05 2024-04-26T10:22:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622295+0000", 2024-04-26T10:22:18.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.662e-06 2024-04-26T10:22:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622303+0000", 2024-04-26T10:22:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0010000000000001e-06 2024-04-26T10:22:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622339+0000", 2024-04-26T10:22:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5961999999999999e-05 2024-04-26T10:22:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622454+0000", 2024-04-26T10:22:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115513 2024-04-26T10:22:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622579+0000", 2024-04-26T10:22:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012421399999999999 2024-04-26T10:22:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626936+0000", 2024-04-26T10:22:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043573889999999997 2024-04-26T10:22:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.711 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:99364 5.d 5:bd507d96:::benchmark_data_smithi052_19421_object99363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:18.622440+0000", 2024-04-26T10:22:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0053521100000000002, 2024-04-26T10:22:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058288610000000003, 2024-04-26T10:22:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 99364 2024-04-26T10:22:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.712 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622440+0000", 2024-04-26T10:22:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622440+0000", 2024-04-26T10:22:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622439+0000", 2024-04-26T10:22:18.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622548+0000", 2024-04-26T10:22:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109144 2024-04-26T10:22:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622562+0000", 2024-04-26T10:22:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3484e-05 2024-04-26T10:22:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622569+0000", 2024-04-26T10:22:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0820000000000001e-06 2024-04-26T10:22:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622614+0000", 2024-04-26T10:22:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4904000000000002e-05 2024-04-26T10:22:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622731+0000", 2024-04-26T10:22:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011699 2024-04-26T10:22:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:18.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622890+0000", 2024-04-26T10:22:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015944700000000001 2024-04-26T10:22:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626169+0000", 2024-04-26T10:22:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032784559999999999 2024-04-26T10:22:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:99366 5.9 5:94532a76:::benchmark_data_smithi052_19421_object99365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:18.622898+0000", 2024-04-26T10:22:18.716 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0048940570000000003, 2024-04-26T10:22:18.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0054443119999999998, 2024-04-26T10:22:18.717 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:18.717 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:18.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:18.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:18.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.717 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 99366 2024-04-26T10:22:18.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.717 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:18.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:18.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622898+0000", 2024-04-26T10:22:18.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:18.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622898+0000", 2024-04-26T10:22:18.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:18.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622897+0000", 2024-04-26T10:22:18.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:18.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.622993+0000", 2024-04-26T10:22:18.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5820000000000001e-05 2024-04-26T10:22:18.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:18.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.623005+0000", 2024-04-26T10:22:18.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2078e-05 2024-04-26T10:22:18.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.623013+0000", 2024-04-26T10:22:18.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0909999999999993e-06 2024-04-26T10:22:18.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:18.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.624669+0000", 2024-04-26T10:22:18.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016553710000000001 2024-04-26T10:22:18.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:18.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.624788+0000", 2024-04-26T10:22:18.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011901200000000001 2024-04-26T10:22:18.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:18.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.624929+0000", 2024-04-26T10:22:18.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140889 2024-04-26T10:22:18.720 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.720 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:18.720 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.721 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:99367 5.6 5:66f63805:::benchmark_data_smithi052_19421_object99366:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.721 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:18.623112+0000", 2024-04-26T10:22:18.721 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0046798650000000001, 2024-04-26T10:22:18.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052993329999999998, 2024-04-26T10:22:18.721 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:18.721 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:18.721 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:18.721 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:18.721 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.721 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 99367 2024-04-26T10:22:18.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.721 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:18.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:18.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.623112+0000", 2024-04-26T10:22:18.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:18.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.623112+0000", 2024-04-26T10:22:18.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:18.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.623111+0000", 2024-04-26T10:22:18.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:18.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.623193+0000", 2024-04-26T10:22:18.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1991999999999997e-05 2024-04-26T10:22:18.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:18.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.623208+0000", 2024-04-26T10:22:18.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4361e-05 2024-04-26T10:22:18.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.623215+0000", 2024-04-26T10:22:18.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7209999999999994e-06 2024-04-26T10:22:18.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:18.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.623270+0000", 2024-04-26T10:22:18.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4836000000000001e-05 2024-04-26T10:22:18.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:18.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.623426+0000", 2024-04-26T10:22:18.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000155799 2024-04-26T10:22:18.724 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.724 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:18.724 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.725 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:99369 5.2 5:46c5c786:::benchmark_data_smithi052_19421_object99368:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:18.725 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:18.626476+0000", 2024-04-26T10:22:18.725 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0013162219999999999, 2024-04-26T10:22:18.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001999327, 2024-04-26T10:22:18.725 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:18.725 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:18.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:18.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:18.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:18.725 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 99369 2024-04-26T10:22:18.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.725 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:18.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:18.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626476+0000", 2024-04-26T10:22:18.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:18.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626476+0000", 2024-04-26T10:22:18.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:18.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:18.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626475+0000", 2024-04-26T10:22:18.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:18.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:18.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626563+0000", 2024-04-26T10:22:18.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7978000000000004e-05 2024-04-26T10:22:18.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:18.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626576+0000", 2024-04-26T10:22:18.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2986999999999999e-05 2024-04-26T10:22:18.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:18.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626581+0000", 2024-04-26T10:22:18.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6859999999999997e-06 2024-04-26T10:22:18.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:18.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626627+0000", 2024-04-26T10:22:18.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6554000000000002e-05 2024-04-26T10:22:18.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:18.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:18.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:18.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.626751+0000", 2024-04-26T10:22:18.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012404500000000001 2024-04-26T10:22:18.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.728 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:18.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:18.728 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:18.728 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 12 2024-04-26T10:22:18.728 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:18.730 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:18.730 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:18.724+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:18.792 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T10:22:18.831 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:18.828+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:18.867 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:18.867 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:18.867 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:18.867 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:18.867 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:18.879 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:18.933 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:18.928+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:19.017 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:19.017 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:19.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:19.017 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:19.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.017 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:19.017 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:19.018 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.484980672999999, 2024-04-26T10:22:19.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:19.018 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.018 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.018 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.018 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.018 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.018 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:19.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.018 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:19.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:19.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:19.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:19.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:19.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:19.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:19.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:19.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:19.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:19.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:19.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:19.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:19.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:19.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:19.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:19.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:19.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:19.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:19.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:19.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:19.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:19.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:19.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:19.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:19.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:19.023 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.023 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.023 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.023 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:19.023 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:19.023 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.480445460999999, 2024-04-26T10:22:19.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:19.023 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.023 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.024 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.024 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:19.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.024 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:19.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:19.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:19.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:19.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:19.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:19.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:19.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:19.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:19.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:19.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:19.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:19.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:19.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:19.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:19.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:19.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:19.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:19.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:19.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:19.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:19.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:19.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:19.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:19.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:19.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:19.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:19.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.029 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.029 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.029 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:19.029 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:19.029 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.479814169000001, 2024-04-26T10:22:19.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:19.029 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.029 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.029 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:19.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.030 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:19.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:19.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:19.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:19.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:19.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:19.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:19.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:19.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:19.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:19.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:19.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:19.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:19.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:19.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:19.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:19.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:19.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:19.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:19.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:19.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:19.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:19.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:19.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:19.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:19.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:19.034 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.034 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.034 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.034 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65604 5.9 5:9c239c32:::benchmark_data_smithi052_19421_object65603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:19.034 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:19.035 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.244711285000001, 2024-04-26T10:22:19.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025897677000000001, 2024-04-26T10:22:19.035 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.035 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.035 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.035 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.035 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.035 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65604 2024-04-26T10:22:19.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.035 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:19.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:19.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769615+0000", 2024-04-26T10:22:19.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769694+0000", 2024-04-26T10:22:19.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9087999999999999e-05 2024-04-26T10:22:19.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769702+0000", 2024-04-26T10:22:19.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8150000000000006e-06 2024-04-26T10:22:19.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769709+0000", 2024-04-26T10:22:19.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:22:19.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772336+0000", 2024-04-26T10:22:19.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002626836 2024-04-26T10:22:19.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772470+0000", 2024-04-26T10:22:19.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013453299999999999 2024-04-26T10:22:19.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:19.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772605+0000", 2024-04-26T10:22:19.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013428499999999999 2024-04-26T10:22:19.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:19.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779374+0000", 2024-04-26T10:22:19.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067694000000000001 2024-04-26T10:22:19.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:19.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795401+0000", 2024-04-26T10:22:19.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016026543000000001 2024-04-26T10:22:19.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795461+0000", 2024-04-26T10:22:19.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9923999999999998e-05 2024-04-26T10:22:19.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795513+0000", 2024-04-26T10:22:19.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2737e-05 2024-04-26T10:22:19.040 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.040 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.040 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.040 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65614 5.9 5:993a4fbe:::benchmark_data_smithi052_19421_object65613:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:19.040 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:19.040 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.242246047999998, 2024-04-26T10:22:19.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023664145000000001, 2024-04-26T10:22:19.040 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.040 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.041 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.041 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.041 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65614 2024-04-26T10:22:19.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.041 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:19.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:19.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772080+0000", 2024-04-26T10:22:19.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772117+0000", 2024-04-26T10:22:19.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6418000000000003e-05 2024-04-26T10:22:19.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772124+0000", 2024-04-26T10:22:19.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4730000000000003e-06 2024-04-26T10:22:19.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772132+0000", 2024-04-26T10:22:19.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3900000000000004e-06 2024-04-26T10:22:19.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781379+0000", 2024-04-26T10:22:19.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092471059999999997 2024-04-26T10:22:19.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781495+0000", 2024-04-26T10:22:19.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001159 2024-04-26T10:22:19.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:19.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781581+0000", 2024-04-26T10:22:19.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6087000000000004e-05 2024-04-26T10:22:19.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:19.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.785948+0000", 2024-04-26T10:22:19.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043671669999999999 2024-04-26T10:22:19.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:19.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795661+0000", 2024-04-26T10:22:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097130310000000004 2024-04-26T10:22:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795710+0000", 2024-04-26T10:22:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8959000000000003e-05 2024-04-26T10:22:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795745+0000", 2024-04-26T10:22:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5172000000000001e-05 2024-04-26T10:22:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.045 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83591 5.4 e41/37 5:204a1b6d:::benchmark_data_smithi052_19421_object83590:head v 41'5271, mlcod=41'5268)", 2024-04-26T10:22:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.1673387660000003, 2024-04-26T10:22:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.046802200000000002, 2024-04-26T10:22:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:19.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846987+0000", 2024-04-26T10:22:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846995+0000", 2024-04-26T10:22:19.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7549999999999994e-06 2024-04-26T10:22:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847004+0000", 2024-04-26T10:22:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3190000000000001e-06 2024-04-26T10:22:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847011+0000", 2024-04-26T10:22:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5039999999999999e-06 2024-04-26T10:22:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847048+0000", 2024-04-26T10:22:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7052999999999999e-05 2024-04-26T10:22:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847066+0000", 2024-04-26T10:22:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8468999999999999e-05 2024-04-26T10:22:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893707+0000", 2024-04-26T10:22:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.046641123999999999 2024-04-26T10:22:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893790+0000", 2024-04-26T10:22:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2806999999999995e-05 2024-04-26T10:22:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83592 5.3 5:c96af6b1:::benchmark_data_smithi052_19421_object83591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.1660056220000001, 2024-04-26T10:22:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045543839000000003, 2024-04-26T10:22:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.050 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83592 2024-04-26T10:22:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848320+0000", 2024-04-26T10:22:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848465+0000", 2024-04-26T10:22:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000145291 2024-04-26T10:22:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848475+0000", 2024-04-26T10:22:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6709999999999994e-06 2024-04-26T10:22:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848482+0000", 2024-04-26T10:22:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2910000000000002e-06 2024-04-26T10:22:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848532+0000", 2024-04-26T10:22:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9199000000000001e-05 2024-04-26T10:22:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848676+0000", 2024-04-26T10:22:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014493399999999999 2024-04-26T10:22:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893707+0000", 2024-04-26T10:22:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045030857000000001 2024-04-26T10:22:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893772+0000", 2024-04-26T10:22:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4203999999999997e-05 2024-04-26T10:22:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893865+0000", 2024-04-26T10:22:19.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3577000000000002e-05 2024-04-26T10:22:19.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.055 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.055 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.055 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83593 5.0 e41/37 5:044bb3ac:::benchmark_data_smithi052_19421_object83592:head v 41'5187, mlcod=41'5184)", 2024-04-26T10:22:19.055 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:19.055 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.1655082050000001, 2024-04-26T10:22:19.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044951738999999998, 2024-04-26T10:22:19.055 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.055 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.055 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:19.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:19.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848818+0000", 2024-04-26T10:22:19.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848824+0000", 2024-04-26T10:22:19.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-04-26T10:22:19.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848895+0000", 2024-04-26T10:22:19.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1468000000000001e-05 2024-04-26T10:22:19.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848902+0000", 2024-04-26T10:22:19.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6229999999999999e-06 2024-04-26T10:22:19.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848955+0000", 2024-04-26T10:22:19.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3106000000000003e-05 2024-04-26T10:22:19.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848974+0000", 2024-04-26T10:22:19.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9598000000000001e-05 2024-04-26T10:22:19.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893703+0000", 2024-04-26T10:22:19.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044728315999999997 2024-04-26T10:22:19.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893770+0000", 2024-04-26T10:22:19.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7683999999999998e-05 2024-04-26T10:22:19.059 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.059 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.059 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.059 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83594 5.b e41/37 5:d024b819:::benchmark_data_smithi052_19421_object83593:head v 41'5142, mlcod=41'5140)", 2024-04-26T10:22:19.059 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:19.059 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.1653981959999999, 2024-04-26T10:22:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044760763000000002, 2024-04-26T10:22:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848928+0000", 2024-04-26T10:22:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848933+0000", 2024-04-26T10:22:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848952+0000", 2024-04-26T10:22:19.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8884000000000001e-05 2024-04-26T10:22:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848957+0000", 2024-04-26T10:22:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8470000000000003e-06 2024-04-26T10:22:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848980+0000", 2024-04-26T10:22:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2946999999999999e-05 2024-04-26T10:22:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848992+0000", 2024-04-26T10:22:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1882000000000001e-05 2024-04-26T10:22:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893623+0000", 2024-04-26T10:22:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044631381999999997 2024-04-26T10:22:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893689+0000", 2024-04-26T10:22:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6285999999999995e-05 2024-04-26T10:22:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83595 5.1 5:829f4097:::benchmark_data_smithi052_19421_object83594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.1653093370000001, 2024-04-26T10:22:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048599369000000003, 2024-04-26T10:22:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83595 2024-04-26T10:22:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.064 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849017+0000", 2024-04-26T10:22:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849041+0000", 2024-04-26T10:22:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4239999999999998e-05 2024-04-26T10:22:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849048+0000", 2024-04-26T10:22:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4669999999999998e-06 2024-04-26T10:22:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849053+0000", 2024-04-26T10:22:19.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3839999999999999e-06 2024-04-26T10:22:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849099+0000", 2024-04-26T10:22:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6579999999999998e-05 2024-04-26T10:22:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849246+0000", 2024-04-26T10:22:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014681899999999999 2024-04-26T10:22:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897498+0000", 2024-04-26T10:22:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048252002000000002 2024-04-26T10:22:19.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897544+0000", 2024-04-26T10:22:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5497999999999997e-05 2024-04-26T10:22:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897617+0000", 2024-04-26T10:22:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3143000000000001e-05 2024-04-26T10:22:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83597 5.d 5:b4b0a3ad:::benchmark_data_smithi052_19421_object83596:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.1650438980000004, 2024-04-26T10:22:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.047933286999999998, 2024-04-26T10:22:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83597 2024-04-26T10:22:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:19.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849282+0000", 2024-04-26T10:22:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849384+0000", 2024-04-26T10:22:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010128600000000001 2024-04-26T10:22:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849392+0000", 2024-04-26T10:22:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4290000000000001e-06 2024-04-26T10:22:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849398+0000", 2024-04-26T10:22:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8969999999999996e-06 2024-04-26T10:22:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849481+0000", 2024-04-26T10:22:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3088000000000001e-05 2024-04-26T10:22:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849639+0000", 2024-04-26T10:22:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015797200000000001 2024-04-26T10:22:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849782+0000", 2024-04-26T10:22:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014353599999999999 2024-04-26T10:22:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894335+0000", 2024-04-26T10:22:19.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044552500000000002 2024-04-26T10:22:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896955+0000", 2024-04-26T10:22:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002620229 2024-04-26T10:22:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897051+0000", 2024-04-26T10:22:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5847999999999994e-05 2024-04-26T10:22:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897216+0000", 2024-04-26T10:22:19.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016519700000000001 2024-04-26T10:22:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83598 5.7 5:e1984dee:::benchmark_data_smithi052_19421_object83597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.1649178679999999, 2024-04-26T10:22:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.049315405999999999, 2024-04-26T10:22:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.074 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83598 2024-04-26T10:22:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849408+0000", 2024-04-26T10:22:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849466+0000", 2024-04-26T10:22:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7302000000000001e-05 2024-04-26T10:22:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849473+0000", 2024-04-26T10:22:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4900000000000003e-06 2024-04-26T10:22:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849479+0000", 2024-04-26T10:22:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3539999999999999e-06 2024-04-26T10:22:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849526+0000", 2024-04-26T10:22:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7246999999999997e-05 2024-04-26T10:22:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849677+0000", 2024-04-26T10:22:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000151218 2024-04-26T10:22:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898591+0000", 2024-04-26T10:22:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048914343999999998 2024-04-26T10:22:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898650+0000", 2024-04-26T10:22:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8288999999999997e-05 2024-04-26T10:22:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898724+0000", 2024-04-26T10:22:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4782000000000003e-05 2024-04-26T10:22:19.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83599 5.3 5:c6d96bef:::benchmark_data_smithi052_19421_object83598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.1629143870000007, 2024-04-26T10:22:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050758893999999999, 2024-04-26T10:22:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83599 2024-04-26T10:22:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851411+0000", 2024-04-26T10:22:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851465+0000", 2024-04-26T10:22:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3943999999999997e-05 2024-04-26T10:22:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851475+0000", 2024-04-26T10:22:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0220999999999999e-05 2024-04-26T10:22:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851482+0000", 2024-04-26T10:22:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3259999999999998e-06 2024-04-26T10:22:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851525+0000", 2024-04-26T10:22:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2255000000000001e-05 2024-04-26T10:22:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851617+0000", 2024-04-26T10:22:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2436999999999996e-05 2024-04-26T10:22:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902102+0000", 2024-04-26T10:22:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050485163 2024-04-26T10:22:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902130+0000", 2024-04-26T10:22:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8177000000000001e-05 2024-04-26T10:22:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902171+0000", 2024-04-26T10:22:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1091999999999999e-05 2024-04-26T10:22:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83596 5.b e41/37 5:d54e48a0:::benchmark_data_smithi052_19421_object83595:head v 41'5143, mlcod=41'5140)", 2024-04-26T10:22:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.1627040569999991, 2024-04-26T10:22:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050472416999999999, 2024-04-26T10:22:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.084 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851621+0000", 2024-04-26T10:22:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:19.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851628+0000", 2024-04-26T10:22:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:22:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851635+0000", 2024-04-26T10:22:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6009999999999997e-06 2024-04-26T10:22:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851646+0000", 2024-04-26T10:22:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1248e-05 2024-04-26T10:22:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851687+0000", 2024-04-26T10:22:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1004999999999998e-05 2024-04-26T10:22:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851706+0000", 2024-04-26T10:22:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8994000000000001e-05 2024-04-26T10:22:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902062+0000", 2024-04-26T10:22:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050355957999999999 2024-04-26T10:22:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902095+0000", 2024-04-26T10:22:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2882000000000001e-05 2024-04-26T10:22:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83601 5.d 5:b32b06d1:::benchmark_data_smithi052_19421_object83600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.1623973410000001, 2024-04-26T10:22:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045519045000000001, 2024-04-26T10:22:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83601 2024-04-26T10:22:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851929+0000", 2024-04-26T10:22:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852104+0000", 2024-04-26T10:22:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175234 2024-04-26T10:22:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852110+0000", 2024-04-26T10:22:19.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.66e-06 2024-04-26T10:22:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852114+0000", 2024-04-26T10:22:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7809999999999999e-06 2024-04-26T10:22:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852153+0000", 2024-04-26T10:22:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9576000000000002e-05 2024-04-26T10:22:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852283+0000", 2024-04-26T10:22:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012946600000000001 2024-04-26T10:22:19.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852415+0000", 2024-04-26T10:22:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132719 2024-04-26T10:22:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894427+0000", 2024-04-26T10:22:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042011497000000002 2024-04-26T10:22:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897231+0000", 2024-04-26T10:22:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002804239 2024-04-26T10:22:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897306+0000", 2024-04-26T10:22:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4771999999999995e-05 2024-04-26T10:22:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897449+0000", 2024-04-26T10:22:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142707 2024-04-26T10:22:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83604 5.2 5:41ebe09c:::benchmark_data_smithi052_19421_object83603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:19.093 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.162204354, 2024-04-26T10:22:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044923596000000003, 2024-04-26T10:22:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83604 2024-04-26T10:22:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852122+0000", 2024-04-26T10:22:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852149+0000", 2024-04-26T10:22:19.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7596000000000001e-05 2024-04-26T10:22:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852154+0000", 2024-04-26T10:22:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0889999999999999e-06 2024-04-26T10:22:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852158+0000", 2024-04-26T10:22:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2830000000000002e-06 2024-04-26T10:22:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852194+0000", 2024-04-26T10:22:19.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6062000000000001e-05 2024-04-26T10:22:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852276+0000", 2024-04-26T10:22:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1891000000000006e-05 2024-04-26T10:22:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896782+0000", 2024-04-26T10:22:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044506271 2024-04-26T10:22:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896875+0000", 2024-04-26T10:22:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3499999999999996e-05 2024-04-26T10:22:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897046+0000", 2024-04-26T10:22:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017065200000000001 2024-04-26T10:22:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83606 5.1 5:81602529:::benchmark_data_smithi052_19421_object83605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:19.098 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.1618867169999998, 2024-04-26T10:22:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045300391000000002, 2024-04-26T10:22:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83606 2024-04-26T10:22:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852439+0000", 2024-04-26T10:22:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852535+0000", 2024-04-26T10:22:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6025000000000003e-05 2024-04-26T10:22:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852545+0000", 2024-04-26T10:22:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3619999999999995e-06 2024-04-26T10:22:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852551+0000", 2024-04-26T10:22:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4500000000000001e-06 2024-04-26T10:22:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852588+0000", 2024-04-26T10:22:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6785000000000001e-05 2024-04-26T10:22:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852668+0000", 2024-04-26T10:22:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0008999999999999e-05 2024-04-26T10:22:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897625+0000", 2024-04-26T10:22:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044956744999999999 2024-04-26T10:22:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897667+0000", 2024-04-26T10:22:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1887000000000001e-05 2024-04-26T10:22:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897741+0000", 2024-04-26T10:22:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4023000000000006e-05 2024-04-26T10:22:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83605 5.4 e41/37 5:2eb72b61:::benchmark_data_smithi052_19421_object83604:head v 41'5272, mlcod=41'5269)", 2024-04-26T10:22:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:19.103 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.1614793890000001, 2024-04-26T10:22:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044651192999999999, 2024-04-26T10:22:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:19.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852851+0000", 2024-04-26T10:22:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4560000000000002e-06 2024-04-26T10:22:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852859+0000", 2024-04-26T10:22:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2169999999999997e-06 2024-04-26T10:22:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852864+0000", 2024-04-26T10:22:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-04-26T10:22:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852899+0000", 2024-04-26T10:22:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4987000000000002e-05 2024-04-26T10:22:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852916+0000", 2024-04-26T10:22:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7563000000000001e-05 2024-04-26T10:22:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897449+0000", 2024-04-26T10:22:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044532644000000003 2024-04-26T10:22:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897499+0000", 2024-04-26T10:22:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9734999999999997e-05 2024-04-26T10:22:19.107 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83607 5.6 5:66b4c91d:::benchmark_data_smithi052_19421_object83606:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.1593489350000006, 2024-04-26T10:22:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048173940999999998, 2024-04-26T10:22:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.108 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83607 2024-04-26T10:22:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854976+0000", 2024-04-26T10:22:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.855030+0000", 2024-04-26T10:22:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3436000000000001e-05 2024-04-26T10:22:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893759+0000", 2024-04-26T10:22:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.038729302 2024-04-26T10:22:19.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893777+0000", 2024-04-26T10:22:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7343e-05 2024-04-26T10:22:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893880+0000", 2024-04-26T10:22:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103285 2024-04-26T10:22:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894161+0000", 2024-04-26T10:22:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000280704 2024-04-26T10:22:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902948+0000", 2024-04-26T10:22:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087876059999999999 2024-04-26T10:22:19.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.903028+0000", 2024-04-26T10:22:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9486000000000004e-05 2024-04-26T10:22:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.903152+0000", 2024-04-26T10:22:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012426599999999999 2024-04-26T10:22:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:99120 5.3 5:cec65b6a:::benchmark_data_smithi052_19421_object99119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:18.504626+0000", 2024-04-26T10:22:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50970103600000005, 2024-04-26T10:22:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024740605999999998, 2024-04-26T10:22:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 99120 2024-04-26T10:22:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.114 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504626+0000", 2024-04-26T10:22:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504626+0000", 2024-04-26T10:22:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504625+0000", 2024-04-26T10:22:19.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504705+0000", 2024-04-26T10:22:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9901000000000006e-05 2024-04-26T10:22:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504711+0000", 2024-04-26T10:22:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9170000000000003e-06 2024-04-26T10:22:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504715+0000", 2024-04-26T10:22:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7249999999999999e-06 2024-04-26T10:22:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504749+0000", 2024-04-26T10:22:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4635000000000003e-05 2024-04-26T10:22:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504841+0000", 2024-04-26T10:22:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1166000000000001e-05 2024-04-26T10:22:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:19.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.529252+0000", 2024-04-26T10:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024411651999999999 2024-04-26T10:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.529296+0000", 2024-04-26T10:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3343000000000002e-05 2024-04-26T10:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.529366+0000", 2024-04-26T10:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0780999999999999e-05 2024-04-26T10:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.118 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.119 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.119 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:19.120 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:19.121 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:19.116+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:19.221 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:19.216+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:19.241 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:19.241 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:19.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.241 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:100600 5.4 5:22f6ae0c:::benchmark_data_smithi052_19421_object100599:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T10:22:19.241 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:19.236737+0000", 2024-04-26T10:22:19.241 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0041210439999999999, 2024-04-26T10:22:19.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041797609999999997, 2024-04-26T10:22:19.242 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.242 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:19.242 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.242 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.242 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.242 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 100600 2024-04-26T10:22:19.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.242 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.236737+0000", 2024-04-26T10:22:19.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.236737+0000", 2024-04-26T10:22:19.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.236736+0000", 2024-04-26T10:22:19.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.236819+0000", 2024-04-26T10:22:19.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2406999999999999e-05 2024-04-26T10:22:19.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.236825+0000", 2024-04-26T10:22:19.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.759e-06 2024-04-26T10:22:19.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.236830+0000", 2024-04-26T10:22:19.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7779999999999998e-06 2024-04-26T10:22:19.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.236872+0000", 2024-04-26T10:22:19.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1603000000000001e-05 2024-04-26T10:22:19.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.236980+0000", 2024-04-26T10:22:19.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000107797 2024-04-26T10:22:19.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:19.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.237082+0000", 2024-04-26T10:22:19.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102013 2024-04-26T10:22:19.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:19.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240703+0000", 2024-04-26T10:22:19.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00362101 2024-04-26T10:22:19.246 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.246 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.246 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.246 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:100588 5.f e44/37 5:f3fbd79c:::benchmark_data_smithi052_19421_object100587:head v 44'6330, mlcod=44'6325)", 2024-04-26T10:22:19.246 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:19.238362+0000", 2024-04-26T10:22:19.246 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0024959969999999998, 2024-04-26T10:22:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0027139429999999999, 2024-04-26T10:22:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.238362+0000", 2024-04-26T10:22:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.238362+0000", 2024-04-26T10:22:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.238362+0000", 2024-04-26T10:22:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.238447+0000", 2024-04-26T10:22:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5358000000000005e-05 2024-04-26T10:22:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.238456+0000", 2024-04-26T10:22:19.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3329999999999997e-06 2024-04-26T10:22:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.238462+0000", 2024-04-26T10:22:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1720000000000004e-06 2024-04-26T10:22:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.238512+0000", 2024-04-26T10:22:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9823000000000001e-05 2024-04-26T10:22:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.238525+0000", 2024-04-26T10:22:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3575e-05 2024-04-26T10:22:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:100606 5.a 5:5ca928d7:::benchmark_data_smithi052_19421_object100605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T10:22:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:19.240509+0000", 2024-04-26T10:22:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00034966899999999999, 2024-04-26T10:22:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00065403399999999995, 2024-04-26T10:22:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:19.250 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 100606 2024-04-26T10:22:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240509+0000", 2024-04-26T10:22:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240509+0000", 2024-04-26T10:22:19.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240508+0000", 2024-04-26T10:22:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240632+0000", 2024-04-26T10:22:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012445499999999999 2024-04-26T10:22:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240642+0000", 2024-04-26T10:22:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0049e-05 2024-04-26T10:22:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240649+0000", 2024-04-26T10:22:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2910000000000004e-06 2024-04-26T10:22:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240696+0000", 2024-04-26T10:22:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7660000000000001e-05 2024-04-26T10:22:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240852+0000", 2024-04-26T10:22:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000155465 2024-04-26T10:22:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:100607 5.0 5:0fc7346a:::benchmark_data_smithi052_19421_object100606:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T10:22:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:19.240673+0000", 2024-04-26T10:22:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00018565199999999999, 2024-04-26T10:22:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00056364800000000004, 2024-04-26T10:22:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.254 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 100607 2024-04-26T10:22:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240673+0000", 2024-04-26T10:22:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240673+0000", 2024-04-26T10:22:19.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240672+0000", 2024-04-26T10:22:19.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240809+0000", 2024-04-26T10:22:19.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000137341 2024-04-26T10:22:19.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240819+0000", 2024-04-26T10:22:19.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2140000000000002e-06 2024-04-26T10:22:19.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240826+0000", 2024-04-26T10:22:19.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1149999999999996e-06 2024-04-26T10:22:19.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240857+0000", 2024-04-26T10:22:19.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1343000000000001e-05 2024-04-26T10:22:19.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240941+0000", 2024-04-26T10:22:19.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4277000000000006e-05 2024-04-26T10:22:19.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:19.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.241031+0000", 2024-04-26T10:22:19.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9637999999999998e-05 2024-04-26T10:22:19.258 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.258 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.258 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.258 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:100608 5.b 5:d4ddde3f:::benchmark_data_smithi052_19421_object100607:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T10:22:19.258 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:19.240840+0000", 2024-04-26T10:22:19.259 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.8597000000000002e-05, 2024-04-26T10:22:19.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000478099, 2024-04-26T10:22:19.259 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.259 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:19.259 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.259 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.259 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.259 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 100608 2024-04-26T10:22:19.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.259 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240840+0000", 2024-04-26T10:22:19.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240840+0000", 2024-04-26T10:22:19.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240839+0000", 2024-04-26T10:22:19.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240912+0000", 2024-04-26T10:22:19.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2504999999999998e-05 2024-04-26T10:22:19.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240920+0000", 2024-04-26T10:22:19.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4489999999999999e-06 2024-04-26T10:22:19.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240926+0000", 2024-04-26T10:22:19.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2899999999999999e-06 2024-04-26T10:22:19.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240970+0000", 2024-04-26T10:22:19.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3727999999999999e-05 2024-04-26T10:22:19.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.241058+0000", 2024-04-26T10:22:19.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7899999999999995e-05 2024-04-26T10:22:19.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:19.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.241161+0000", 2024-04-26T10:22:19.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102834 2024-04-26T10:22:19.262 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.262 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.263 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.263 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:100609 5.8 5:18116735:::benchmark_data_smithi052_19421_object100608:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T10:22:19.263 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:19.240985+0000", 2024-04-26T10:22:19.263 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9998732, 2024-04-26T10:22:19.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000415778, 2024-04-26T10:22:19.263 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.263 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:19.263 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.263 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.263 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.263 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 100609 2024-04-26T10:22:19.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240985+0000", 2024-04-26T10:22:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240985+0000", 2024-04-26T10:22:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.240984+0000", 2024-04-26T10:22:19.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.241117+0000", 2024-04-26T10:22:19.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013224999999999999 2024-04-26T10:22:19.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.241129+0000", 2024-04-26T10:22:19.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2244e-05 2024-04-26T10:22:19.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.241136+0000", 2024-04-26T10:22:19.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9129999999999997e-06 2024-04-26T10:22:19.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.241171+0000", 2024-04-26T10:22:19.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5117000000000003e-05 2024-04-26T10:22:19.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:19.241293+0000", 2024-04-26T10:22:19.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012179 2024-04-26T10:22:19.266 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.266 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.266 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.267 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.267 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:19.267 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 6 2024-04-26T10:22:19.267 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:19.268 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:19.321 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:19.316+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:19.399 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:19.399 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:19.399 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:19.399 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:19.399 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:19.411 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:19.422 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:19.420+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:19.523 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:19.519+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:19.539 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:19.539 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:19.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:19.539 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:19.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.539 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:19.540 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:19.540 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.006380839999998, 2024-04-26T10:22:19.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:19.540 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.540 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.540 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.540 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.540 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.540 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:19.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.540 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:19.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:19.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:19.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:19.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:19.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:19.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:19.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:19.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:19.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:19.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:19.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:19.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:19.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:19.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:19.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:19.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:19.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:19.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:19.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:19.545 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.545 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.545 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.545 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:19.545 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:19.545 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.004398612999999, 2024-04-26T10:22:19.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:19.545 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.545 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.545 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.545 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.546 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.546 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:19.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.546 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:19.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:19.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:19.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:19.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:19.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:19.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:19.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:19.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:19.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:19.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:19.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:19.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:19.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:19.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:19.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:19.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:19.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:19.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:19.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:19.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:19.550 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.550 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.550 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.550 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:19.550 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:19.550 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.004199229000001, 2024-04-26T10:22:19.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:19.550 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.550 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.550 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.550 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.551 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.551 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:19.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.551 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:19.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:19.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:19.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:19.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:19.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:19.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:19.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:19.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:19.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:19.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:19.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:19.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:19.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:19.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:19.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:19.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:19.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:19.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:19.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:19.555 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.555 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.555 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.555 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:19.555 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:19.555 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.003980608999999, 2024-04-26T10:22:19.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:19.555 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.555 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.555 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:19.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:19.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:19.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:19.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:19.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:19.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:19.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:19.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:19.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:19.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:19.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:19.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:19.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:19.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:19.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:19.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:19.559 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.559 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.559 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.559 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:19.559 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:19.560 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.001609170999998, 2024-04-26T10:22:19.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:19.560 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.560 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.560 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.561 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.561 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.561 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:19.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.561 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:19.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:19.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:19.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:19.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:19.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:19.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:19.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:19.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:19.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:19.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:19.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:19.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:19.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:19.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:19.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:19.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:19.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:19.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:19.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:19.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:19.565 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.565 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.565 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.565 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:19.565 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:19.565 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.001508549, 2024-04-26T10:22:19.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:19.566 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.566 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.566 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.566 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:19.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.566 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:19.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:19.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:19.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:19.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:19.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:19.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:19.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:19.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:19.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:19.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:19.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:19.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:19.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:19.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:19.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:19.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:19.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:19.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:19.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:19.570 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.570 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.570 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.570 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:19.570 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:19.570 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.001389988, 2024-04-26T10:22:19.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:19.571 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.571 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.571 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:19.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:19.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:19.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:19.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:19.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:19.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:19.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:19.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:19.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:19.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:19.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:19.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:19.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:19.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:19.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:19.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:19.575 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.575 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.575 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.575 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:19.575 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:19.575 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.00128759, 2024-04-26T10:22:19.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:19.575 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.575 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.575 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.576 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.576 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.576 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:19.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.576 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:19.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:19.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:19.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:19.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:19.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:19.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:19.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:19.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:19.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:19.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:19.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:19.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:19.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:19.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:19.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:19.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:19.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.580 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.580 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65294 5.e 5:7438ad6f:::benchmark_data_smithi052_19421_object65293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:19.580 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:19.580 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.000607472999999, 2024-04-26T10:22:19.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091965517999999996, 2024-04-26T10:22:19.580 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.580 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.580 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.581 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65294 2024-04-26T10:22:19.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.581 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:19.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:19.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536413+0000", 2024-04-26T10:22:19.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536470+0000", 2024-04-26T10:22:19.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6443999999999997e-05 2024-04-26T10:22:19.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536480+0000", 2024-04-26T10:22:19.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0652999999999999e-05 2024-04-26T10:22:19.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536488+0000", 2024-04-26T10:22:19.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7929999999999998e-06 2024-04-26T10:22:19.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536548+0000", 2024-04-26T10:22:19.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9556999999999999e-05 2024-04-26T10:22:19.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536728+0000", 2024-04-26T10:22:19.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000180958 2024-04-26T10:22:19.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:19.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628168+0000", 2024-04-26T10:22:19.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091439276999999999 2024-04-26T10:22:19.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628258+0000", 2024-04-26T10:22:19.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0158e-05 2024-04-26T10:22:19.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628380+0000", 2024-04-26T10:22:19.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012180699999999999 2024-04-26T10:22:19.585 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.585 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.585 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.585 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:19.585 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:19.585 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.000267033, 2024-04-26T10:22:19.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:19.586 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.586 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.586 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.586 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.586 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.586 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:19.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.586 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:19.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:19.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:19.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:19.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:19.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:19.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:19.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:19.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:19.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:19.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:19.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:19.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:19.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:19.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:19.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:19.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:19.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:19.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:19.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:19.590 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.590 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.590 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.591 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:19.591 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:19.591 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.999116758, 2024-04-26T10:22:19.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:19.591 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.591 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.591 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.591 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.591 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.591 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:19.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.591 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:19.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:19.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:19.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:19.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:19.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:19.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:19.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:19.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:19.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:19.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:19.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:19.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:19.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:19.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:19.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:19.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:19.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:19.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:19.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:19.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:19.595 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.595 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.595 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.596 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65292 5.f e34/22 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head v 34'4129, mlcod=34'4125)", 2024-04-26T10:22:19.596 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:19.596 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.998942501999998, 2024-04-26T10:22:19.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093470155999999999, 2024-04-26T10:22:19.596 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.596 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.596 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:19.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:19.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538078+0000", 2024-04-26T10:22:19.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538140+0000", 2024-04-26T10:22:19.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1970000000000005e-05 2024-04-26T10:22:19.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538149+0000", 2024-04-26T10:22:19.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2189999999999993e-06 2024-04-26T10:22:19.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538158+0000", 2024-04-26T10:22:19.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0930000000000003e-06 2024-04-26T10:22:19.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627053+0000", 2024-04-26T10:22:19.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088895221999999996 2024-04-26T10:22:19.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627092+0000", 2024-04-26T10:22:19.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9657000000000003e-05 2024-04-26T10:22:19.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631499+0000", 2024-04-26T10:22:19.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044066560000000001 2024-04-26T10:22:19.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631549+0000", 2024-04-26T10:22:19.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0259000000000001e-05 2024-04-26T10:22:19.600 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.600 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.600 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.600 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65298 5.b 5:d51c4e52:::benchmark_data_smithi052_19421_object65297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:19.600 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:19.600 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.998176045000001, 2024-04-26T10:22:19.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091641671999999993, 2024-04-26T10:22:19.600 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.600 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.600 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.601 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.601 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.601 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65298 2024-04-26T10:22:19.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.601 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:19.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:19.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538844+0000", 2024-04-26T10:22:19.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:19.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538919+0000", 2024-04-26T10:22:19.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4626e-05 2024-04-26T10:22:19.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626007+0000", 2024-04-26T10:22:19.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087087516000000004 2024-04-26T10:22:19.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626074+0000", 2024-04-26T10:22:19.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7077999999999997e-05 2024-04-26T10:22:19.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626150+0000", 2024-04-26T10:22:19.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5982999999999994e-05 2024-04-26T10:22:19.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626341+0000", 2024-04-26T10:22:19.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019141199999999999 2024-04-26T10:22:19.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:19.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630359+0000", 2024-04-26T10:22:19.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040175710000000002 2024-04-26T10:22:19.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630412+0000", 2024-04-26T10:22:19.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3779000000000001e-05 2024-04-26T10:22:19.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630487+0000", 2024-04-26T10:22:19.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4913999999999995e-05 2024-04-26T10:22:19.605 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.605 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.605 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.605 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:81355 5.8 5:14f6458e:::benchmark_data_smithi052_19421_object81354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:19.605 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:19.605 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.7277390449999999, 2024-04-26T10:22:19.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027247422, 2024-04-26T10:22:19.606 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.606 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.606 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.606 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.606 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.606 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 81355 2024-04-26T10:22:19.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.606 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:19.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:19.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809281+0000", 2024-04-26T10:22:19.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:19.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809337+0000", 2024-04-26T10:22:19.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5627999999999997e-05 2024-04-26T10:22:19.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809349+0000", 2024-04-26T10:22:19.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1554e-05 2024-04-26T10:22:19.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809355+0000", 2024-04-26T10:22:19.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2559999999999999e-06 2024-04-26T10:22:19.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.823233+0000", 2024-04-26T10:22:19.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013877647999999999 2024-04-26T10:22:19.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.823361+0000", 2024-04-26T10:22:19.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012813500000000001 2024-04-26T10:22:19.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:19.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836404+0000", 2024-04-26T10:22:19.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013043592999999999 2024-04-26T10:22:19.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836468+0000", 2024-04-26T10:22:19.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3734999999999999e-05 2024-04-26T10:22:19.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836530+0000", 2024-04-26T10:22:19.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2065999999999998e-05 2024-04-26T10:22:19.610 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.611 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.611 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.611 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83591 5.4 5:204a1b6d:::benchmark_data_smithi052_19421_object83590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:19.611 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:19.611 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.6893078100000007, 2024-04-26T10:22:19.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.047988034999999998, 2024-04-26T10:22:19.611 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.611 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.611 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.611 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.611 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.611 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83591 2024-04-26T10:22:19.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.612 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:19.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:19.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847713+0000", 2024-04-26T10:22:19.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847784+0000", 2024-04-26T10:22:19.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0723999999999996e-05 2024-04-26T10:22:19.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847795+0000", 2024-04-26T10:22:19.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1538e-05 2024-04-26T10:22:19.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847810+0000", 2024-04-26T10:22:19.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4354e-05 2024-04-26T10:22:19.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847850+0000", 2024-04-26T10:22:19.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0750000000000001e-05 2024-04-26T10:22:19.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847974+0000", 2024-04-26T10:22:19.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012394899999999999 2024-04-26T10:22:19.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:19.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.848089+0000", 2024-04-26T10:22:19.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114527 2024-04-26T10:22:19.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:19.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852900+0000", 2024-04-26T10:22:19.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048110779999999999 2024-04-26T10:22:19.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:19.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895562+0000", 2024-04-26T10:22:19.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042662053999999998 2024-04-26T10:22:19.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895622+0000", 2024-04-26T10:22:19.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0470000000000002e-05 2024-04-26T10:22:19.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895702+0000", 2024-04-26T10:22:19.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9541000000000003e-05 2024-04-26T10:22:19.616 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.617 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.617 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.617 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83593 5.0 5:044bb3ac:::benchmark_data_smithi052_19421_object83592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:19.617 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:19.617 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.6874209570000005, 2024-04-26T10:22:19.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.046164161000000002, 2024-04-26T10:22:19.617 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.617 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.617 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.617 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.617 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.618 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83593 2024-04-26T10:22:19.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.618 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:19.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:19.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849600+0000", 2024-04-26T10:22:19.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849655+0000", 2024-04-26T10:22:19.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5148999999999997e-05 2024-04-26T10:22:19.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849666+0000", 2024-04-26T10:22:19.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1494999999999999e-05 2024-04-26T10:22:19.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849677+0000", 2024-04-26T10:22:19.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0985000000000001e-05 2024-04-26T10:22:19.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849716+0000", 2024-04-26T10:22:19.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8698000000000001e-05 2024-04-26T10:22:19.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849822+0000", 2024-04-26T10:22:19.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000106173 2024-04-26T10:22:19.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:19.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849938+0000", 2024-04-26T10:22:19.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115738 2024-04-26T10:22:19.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:19.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853416+0000", 2024-04-26T10:22:19.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034777440000000001 2024-04-26T10:22:19.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:19.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895540+0000", 2024-04-26T10:22:19.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042124704999999998 2024-04-26T10:22:19.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895619+0000", 2024-04-26T10:22:19.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8697999999999998e-05 2024-04-26T10:22:19.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895765+0000", 2024-04-26T10:22:19.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014579299999999999 2024-04-26T10:22:19.622 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.622 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.622 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.623 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83594 5.b 5:d024b819:::benchmark_data_smithi052_19421_object83593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:19.623 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:19.623 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.6873287189999999, 2024-04-26T10:22:19.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045938635999999998, 2024-04-26T10:22:19.623 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.623 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.623 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.623 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.623 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.623 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83594 2024-04-26T10:22:19.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.623 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:19.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:19.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849692+0000", 2024-04-26T10:22:19.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849730+0000", 2024-04-26T10:22:19.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7415e-05 2024-04-26T10:22:19.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849735+0000", 2024-04-26T10:22:19.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6350000000000003e-06 2024-04-26T10:22:19.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849740+0000", 2024-04-26T10:22:19.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4209999999999997e-06 2024-04-26T10:22:19.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849787+0000", 2024-04-26T10:22:19.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7166000000000002e-05 2024-04-26T10:22:19.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849915+0000", 2024-04-26T10:22:19.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012823700000000001 2024-04-26T10:22:19.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:19.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850038+0000", 2024-04-26T10:22:19.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012317 2024-04-26T10:22:19.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:19.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855812+0000", 2024-04-26T10:22:19.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057731340000000001 2024-04-26T10:22:19.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:19.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895504+0000", 2024-04-26T10:22:19.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.039692540999999998 2024-04-26T10:22:19.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895569+0000", 2024-04-26T10:22:19.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4443999999999995e-05 2024-04-26T10:22:19.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895632+0000", 2024-04-26T10:22:19.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3109999999999997e-05 2024-04-26T10:22:19.628 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.628 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.628 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.629 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83596 5.b 5:d54e48a0:::benchmark_data_smithi052_19421_object83595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:19.629 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:19.629 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.6865086379999994, 2024-04-26T10:22:19.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.053210201999999998, 2024-04-26T10:22:19.629 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.629 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.629 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83596 2024-04-26T10:22:19.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.629 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:19.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:19.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850512+0000", 2024-04-26T10:22:19.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850622+0000", 2024-04-26T10:22:19.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010927 2024-04-26T10:22:19.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850629+0000", 2024-04-26T10:22:19.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1690000000000003e-06 2024-04-26T10:22:19.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850633+0000", 2024-04-26T10:22:19.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4800000000000003e-06 2024-04-26T10:22:19.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852134+0000", 2024-04-26T10:22:19.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015011099999999999 2024-04-26T10:22:19.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852446+0000", 2024-04-26T10:22:19.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031107999999999998 2024-04-26T10:22:19.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:19.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852723+0000", 2024-04-26T10:22:19.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027751499999999999 2024-04-26T10:22:19.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:19.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861229+0000", 2024-04-26T10:22:19.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085055960000000007 2024-04-26T10:22:19.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:19.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903523+0000", 2024-04-26T10:22:19.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042294683999999999 2024-04-26T10:22:19.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903579+0000", 2024-04-26T10:22:19.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5751999999999997e-05 2024-04-26T10:22:19.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903723+0000", 2024-04-26T10:22:19.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014414199999999999 2024-04-26T10:22:19.634 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.634 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.635 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.635 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83603 5.b 5:d4896044:::benchmark_data_smithi052_19421_object83602:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:19.635 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:19.635 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.6835817510000002, 2024-04-26T10:22:19.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.053974093000000001, 2024-04-26T10:22:19.635 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.635 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.635 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.635 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.635 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.635 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83603 2024-04-26T10:22:19.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.636 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:19.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:19.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853439+0000", 2024-04-26T10:22:19.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853492+0000", 2024-04-26T10:22:19.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2265000000000002e-05 2024-04-26T10:22:19.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853504+0000", 2024-04-26T10:22:19.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2354999999999999e-05 2024-04-26T10:22:19.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853512+0000", 2024-04-26T10:22:19.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8630000000000008e-06 2024-04-26T10:22:19.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855839+0000", 2024-04-26T10:22:19.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002326776 2024-04-26T10:22:19.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855993+0000", 2024-04-26T10:22:19.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015428300000000001 2024-04-26T10:22:19.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:19.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.856138+0000", 2024-04-26T10:22:19.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000145427 2024-04-26T10:22:19.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:19.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861318+0000", 2024-04-26T10:22:19.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051795160000000003 2024-04-26T10:22:19.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:19.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907178+0000", 2024-04-26T10:22:19.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045859882999999997 2024-04-26T10:22:19.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907260+0000", 2024-04-26T10:22:19.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2133999999999997e-05 2024-04-26T10:22:19.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907414+0000", 2024-04-26T10:22:19.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015427400000000001 2024-04-26T10:22:19.640 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.641 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.641 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.641 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83605 5.4 5:2eb72b61:::benchmark_data_smithi052_19421_object83604:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:19.641 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:19.641 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.6835023030000009, 2024-04-26T10:22:19.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045576089, 2024-04-26T10:22:19.641 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:19.641 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:19.641 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:19.641 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:19.641 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.641 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83605 2024-04-26T10:22:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:19.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:19.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:19.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853557+0000", 2024-04-26T10:22:19.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8423000000000001e-05 2024-04-26T10:22:19.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:19.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853573+0000", 2024-04-26T10:22:19.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6201e-05 2024-04-26T10:22:19.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853583+0000", 2024-04-26T10:22:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9129999999999998e-06 2024-04-26T10:22:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853625+0000", 2024-04-26T10:22:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1965000000000002e-05 2024-04-26T10:22:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853795+0000", 2024-04-26T10:22:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169946 2024-04-26T10:22:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853980+0000", 2024-04-26T10:22:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018517100000000001 2024-04-26T10:22:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861356+0000", 2024-04-26T10:22:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073759389999999998 2024-04-26T10:22:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.898899+0000", 2024-04-26T10:22:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.037542786000000002 2024-04-26T10:22:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:19.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.898963+0000", 2024-04-26T10:22:19.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3652999999999995e-05 2024-04-26T10:22:19.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:19.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:19.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:19.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.899095+0000", 2024-04-26T10:22:19.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013286999999999999 2024-04-26T10:22:19.646 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.646 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.646 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.646 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:19.646 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:19.646 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:19.648 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 46 16 101407 101391 137.743 128.312 0.00806313 0.00725423 2024-04-26T10:22:19.648 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:19.644+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:19.649 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:19.714 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:22:19.749 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:19.744+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:19.783 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:19.784 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:19.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.784 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:101746 5.7 5:e2cf1f73:::benchmark_data_smithi052_19421_object101745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T10:22:19.784 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:19.774669+0000", 2024-04-26T10:22:19.784 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0074434560000000002, 2024-04-26T10:22:19.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0074618979999999998, 2024-04-26T10:22:19.784 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.784 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:19.784 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.784 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.784 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.784 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 101746 2024-04-26T10:22:19.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.784 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.774669+0000", 2024-04-26T10:22:19.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.774669+0000", 2024-04-26T10:22:19.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.774668+0000", 2024-04-26T10:22:19.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.774703+0000", 2024-04-26T10:22:19.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5157999999999998e-05 2024-04-26T10:22:19.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.774711+0000", 2024-04-26T10:22:19.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4590000000000001e-06 2024-04-26T10:22:19.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.774717+0000", 2024-04-26T10:22:19.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.229e-06 2024-04-26T10:22:19.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.776765+0000", 2024-04-26T10:22:19.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020484470000000001 2024-04-26T10:22:19.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.776853+0000", 2024-04-26T10:22:19.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8078000000000006e-05 2024-04-26T10:22:19.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.788 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.788 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:101747 5.f 5:fb1a67f9:::benchmark_data_smithi052_19421_object101746:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T10:22:19.788 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:19.777555+0000", 2024-04-26T10:22:19.788 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0045569390000000003, 2024-04-26T10:22:19.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046174240000000002, 2024-04-26T10:22:19.788 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.788 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:19.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.789 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 101747 2024-04-26T10:22:19.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.789 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.777555+0000", 2024-04-26T10:22:19.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.777555+0000", 2024-04-26T10:22:19.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.777554+0000", 2024-04-26T10:22:19.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:19.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.777673+0000", 2024-04-26T10:22:19.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011931599999999999 2024-04-26T10:22:19.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.777684+0000", 2024-04-26T10:22:19.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.06e-05 2024-04-26T10:22:19.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.777691+0000", 2024-04-26T10:22:19.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3549999999999999e-06 2024-04-26T10:22:19.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.777743+0000", 2024-04-26T10:22:19.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1496999999999998e-05 2024-04-26T10:22:19.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.777857+0000", 2024-04-26T10:22:19.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114131 2024-04-26T10:22:19.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:19.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.777956+0000", 2024-04-26T10:22:19.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8967000000000003e-05 2024-04-26T10:22:19.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:19.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.780892+0000", 2024-04-26T10:22:19.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002936588 2024-04-26T10:22:19.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.792 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.793 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:101752 5.2 5:492aed74:::benchmark_data_smithi052_19421_object101751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T10:22:19.793 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:19.778576+0000", 2024-04-26T10:22:19.793 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003536249, 2024-04-26T10:22:19.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036385469999999998, 2024-04-26T10:22:19.793 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.793 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:19.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.793 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 101752 2024-04-26T10:22:19.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.794 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778576+0000", 2024-04-26T10:22:19.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778576+0000", 2024-04-26T10:22:19.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778575+0000", 2024-04-26T10:22:19.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778705+0000", 2024-04-26T10:22:19.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013014100000000001 2024-04-26T10:22:19.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778711+0000", 2024-04-26T10:22:19.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8599999999999998e-06 2024-04-26T10:22:19.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778715+0000", 2024-04-26T10:22:19.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0409999999999999e-06 2024-04-26T10:22:19.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778755+0000", 2024-04-26T10:22:19.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0321000000000002e-05 2024-04-26T10:22:19.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778867+0000", 2024-04-26T10:22:19.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011204099999999999 2024-04-26T10:22:19.796 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.796 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.797 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.797 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:101753 5.c 5:3028c671:::benchmark_data_smithi052_19421_object101752:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T10:22:19.797 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:19.778744+0000", 2024-04-26T10:22:19.797 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0033684460000000002, 2024-04-26T10:22:19.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035240710000000001, 2024-04-26T10:22:19.797 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.797 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:19.797 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.797 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.797 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.797 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 101753 2024-04-26T10:22:19.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.798 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778744+0000", 2024-04-26T10:22:19.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778744+0000", 2024-04-26T10:22:19.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778743+0000", 2024-04-26T10:22:19.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778839+0000", 2024-04-26T10:22:19.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6373999999999996e-05 2024-04-26T10:22:19.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778844+0000", 2024-04-26T10:22:19.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7480000000000001e-06 2024-04-26T10:22:19.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778847+0000", 2024-04-26T10:22:19.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.196e-06 2024-04-26T10:22:19.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778884+0000", 2024-04-26T10:22:19.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6566000000000002e-05 2024-04-26T10:22:19.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.779013+0000", 2024-04-26T10:22:19.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129135 2024-04-26T10:22:19.800 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.801 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.801 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:101754 5.9 5:9f769e2f:::benchmark_data_smithi052_19421_object101753:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T10:22:19.801 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:19.778856+0000", 2024-04-26T10:22:19.801 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032563240000000001, 2024-04-26T10:22:19.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034580560000000002, 2024-04-26T10:22:19.801 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.801 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:19.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.801 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 101754 2024-04-26T10:22:19.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.802 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778856+0000", 2024-04-26T10:22:19.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778856+0000", 2024-04-26T10:22:19.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778855+0000", 2024-04-26T10:22:19.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778883+0000", 2024-04-26T10:22:19.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8167999999999999e-05 2024-04-26T10:22:19.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778889+0000", 2024-04-26T10:22:19.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.767e-06 2024-04-26T10:22:19.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.778894+0000", 2024-04-26T10:22:19.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.741e-06 2024-04-26T10:22:19.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.779726+0000", 2024-04-26T10:22:19.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00083231899999999998 2024-04-26T10:22:19.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.779888+0000", 2024-04-26T10:22:19.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016201200000000001 2024-04-26T10:22:19.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:19.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.780064+0000", 2024-04-26T10:22:19.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017580699999999999 2024-04-26T10:22:19.805 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.805 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.805 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.805 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:101749 5.b e44/37 5:dadc6a24:::benchmark_data_smithi052_19421_object101748:head v 44'6302, mlcod=44'6300)", 2024-04-26T10:22:19.805 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:19.779014+0000", 2024-04-26T10:22:19.805 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003098094, 2024-04-26T10:22:19.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003335714, 2024-04-26T10:22:19.805 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.806 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:19.806 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.779014+0000", 2024-04-26T10:22:19.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.779014+0000", 2024-04-26T10:22:19.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.779014+0000", 2024-04-26T10:22:19.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.779017+0000", 2024-04-26T10:22:19.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5209999999999998e-06 2024-04-26T10:22:19.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.779021+0000", 2024-04-26T10:22:19.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2880000000000003e-06 2024-04-26T10:22:19.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.779024+0000", 2024-04-26T10:22:19.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8890000000000002e-06 2024-04-26T10:22:19.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.779061+0000", 2024-04-26T10:22:19.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7002000000000002e-05 2024-04-26T10:22:19.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.779075+0000", 2024-04-26T10:22:19.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3485999999999999e-05 2024-04-26T10:22:19.809 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.809 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.809 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.809 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:101750 5.0 e44/37 5:02d1f049:::benchmark_data_smithi052_19421_object101749:head v 44'6361, mlcod=44'6358)", 2024-04-26T10:22:19.809 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:19.781006+0000", 2024-04-26T10:22:19.809 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0011062960000000001, 2024-04-26T10:22:19.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013800819999999999, 2024-04-26T10:22:19.809 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.809 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:19.809 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.781006+0000", 2024-04-26T10:22:19.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.781006+0000", 2024-04-26T10:22:19.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.781005+0000", 2024-04-26T10:22:19.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:19.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.781119+0000", 2024-04-26T10:22:19.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113632 2024-04-26T10:22:19.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.781127+0000", 2024-04-26T10:22:19.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2470000000000008e-06 2024-04-26T10:22:19.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.781132+0000", 2024-04-26T10:22:19.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4519999999999999e-06 2024-04-26T10:22:19.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.781172+0000", 2024-04-26T10:22:19.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0342000000000001e-05 2024-04-26T10:22:19.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.781190+0000", 2024-04-26T10:22:19.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8289000000000001e-05 2024-04-26T10:22:19.812 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.813 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.813 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.813 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:101756 5.f 5:fb7e6e46:::benchmark_data_smithi052_19421_object101755:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T10:22:19.813 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:19.780968+0000", 2024-04-26T10:22:19.813 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001143678, 2024-04-26T10:22:19.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014506129999999999, 2024-04-26T10:22:19.813 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.813 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:19.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.813 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.814 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 101756 2024-04-26T10:22:19.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.814 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.780968+0000", 2024-04-26T10:22:19.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.780968+0000", 2024-04-26T10:22:19.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.780967+0000", 2024-04-26T10:22:19.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.781159+0000", 2024-04-26T10:22:19.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019141399999999999 2024-04-26T10:22:19.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.781169+0000", 2024-04-26T10:22:19.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.024e-05 2024-04-26T10:22:19.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.781173+0000", 2024-04-26T10:22:19.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4360000000000004e-06 2024-04-26T10:22:19.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.781213+0000", 2024-04-26T10:22:19.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9705e-05 2024-04-26T10:22:19.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.781324+0000", 2024-04-26T10:22:19.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110969 2024-04-26T10:22:19.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:19.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.781586+0000", 2024-04-26T10:22:19.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026147099999999999 2024-04-26T10:22:19.817 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.817 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.817 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.817 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:101759 5.1 5:807b1a7a:::benchmark_data_smithi052_19421_object101758:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T10:22:19.817 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:19.782252+0000", 2024-04-26T10:22:19.817 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9998603, 2024-04-26T10:22:19.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0002052, 2024-04-26T10:22:19.817 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.818 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-04-26T10:22:19.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.818 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 101759 2024-04-26T10:22:19.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.818 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.782252+0000", 2024-04-26T10:22:19.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.782252+0000", 2024-04-26T10:22:19.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.782251+0000", 2024-04-26T10:22:19.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.782314+0000", 2024-04-26T10:22:19.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3256000000000006e-05 2024-04-26T10:22:19.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.782328+0000", 2024-04-26T10:22:19.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3526999999999999e-05 2024-04-26T10:22:19.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.782337+0000", 2024-04-26T10:22:19.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7610000000000002e-06 2024-04-26T10:22:19.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.782386+0000", 2024-04-26T10:22:19.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8789999999999999e-05 2024-04-26T10:22:19.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.821 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.821 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.821 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:101744 5.9 5:967e2fb1:::benchmark_data_smithi052_19421_object101743:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-26T10:22:19.821 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:19.774497+0000", 2024-04-26T10:22:19.821 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0076145409999999998, 2024-04-26T10:22:19.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079915690000000005, 2024-04-26T10:22:19.821 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:19.821 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:19.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:19.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:19.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:19.821 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 101744 2024-04-26T10:22:19.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.822 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:19.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:19.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.774497+0000", 2024-04-26T10:22:19.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:19.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.774497+0000", 2024-04-26T10:22:19.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:19.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:19.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.774497+0000", 2024-04-26T10:22:19.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:19.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:19.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.774557+0000", 2024-04-26T10:22:19.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0055e-05 2024-04-26T10:22:19.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:19.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.774570+0000", 2024-04-26T10:22:19.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3824e-05 2024-04-26T10:22:19.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:19.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.774577+0000", 2024-04-26T10:22:19.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7139999999999996e-06 2024-04-26T10:22:19.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:19.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.774663+0000", 2024-04-26T10:22:19.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5811999999999998e-05 2024-04-26T10:22:19.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:19.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.774833+0000", 2024-04-26T10:22:19.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017043900000000001 2024-04-26T10:22:19.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:19.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.774996+0000", 2024-04-26T10:22:19.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016303199999999999 2024-04-26T10:22:19.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:19.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:19.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:19.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:19.779692+0000", 2024-04-26T10:22:19.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046952549999999997 2024-04-26T10:22:19.825 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.825 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:19.825 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.825 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:19.826 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:19.826 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 10 2024-04-26T10:22:19.826 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:19.827 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:19.850 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:19.844+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:19.871 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:19.894 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:19.895 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:19.895 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:19.895 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:19.900 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:19.900 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:19.951 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:19.947+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:19.960 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:19.960 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:19.974 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:20.053 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:20.048+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:20.147 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:20.147 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:20.153 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:20.148+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:20.160 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:20.254 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:20.252+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:20.287 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:20.287 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:20.299 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:20.355 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:20.351+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:20.428 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:20.428 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:20.442 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:20.456 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:20.452+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:20.557 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:20.552+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:20.568 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:20.568 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:20.584 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:20.618 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 47 16 103488 103472 137.58 130.062 0.00519496 0.00726279 2024-04-26T10:22:20.658 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:20.652+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:20.723 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:20.723 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:20.735 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:20.759 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:20.755+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:20.806 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:22:20.859 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:20.856+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:20.867 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:20.867 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:20.879 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:20.960 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:20.955+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:21.048 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:21.048 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:21.061 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:21.062 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:21.055+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:21.162 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:21.156+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:21.189 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:21.189 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:21.203 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:21.263 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:21.259+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:21.326 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:21.326 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:21.338 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:21.383 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:21.379+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:21.461 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:21.462 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:21.465 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:21.459+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:21.474 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:21.565 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:21.560+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:21.610 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:21.610 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:21.617 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 48 16 105552 105536 137.4 129 0.010048 0.00727275 2024-04-26T10:22:21.622 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:21.667 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:21.663+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:21.756 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:21.756 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:21.767 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:21.763+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:21.768 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:21.805 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T10:22:21.869 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:21.864+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:21.900 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:22:21.905 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:21.905 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:21.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:21.970 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:21.968+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:22.026 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-26T10:22:22.044 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:22.044 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:22.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:22.060 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:22.075 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:22.068+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:22.080 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:22.081 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:22.081 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:22.081 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:22.085 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:22.086 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:22.137 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-04-26T10:22:22.172 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:22.167+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:22.186 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:22.186 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:22.187 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:22.187 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:22.187 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:22.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:22.238 INFO:teuthology.orchestra.console.smithi164:Power on completed 2024-04-26T10:22:22.273 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:22.267+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:22.326 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:22.327 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:22.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:22.327 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:22.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.327 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:22.327 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:22.327 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.794239833999999, 2024-04-26T10:22:22.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:22.327 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.327 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.327 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:22.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:22.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:22.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:22.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:22.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:22.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:22.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:22.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:22.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:22.332 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.332 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.332 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.333 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:22.333 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:22.333 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.792257607, 2024-04-26T10:22:22.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:22.333 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.333 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.333 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:22.333 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:22.333 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.333 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:22.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.333 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:22.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:22.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:22.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:22.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:22.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:22.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:22.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:22.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:22.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:22.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:22.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:22.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:22.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:22.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:22.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:22.338 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.338 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.338 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.338 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:22.338 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:22.338 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.792058223000002, 2024-04-26T10:22:22.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:22.338 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.338 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.338 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:22.338 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:22.339 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.339 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:22.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.339 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:22.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:22.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:22.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:22.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:22.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:22.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:22.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:22.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:22.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:22.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:22.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:22.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:22.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:22.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:22.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:22.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:22.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:22.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:22.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:22.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:22.343 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.343 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.343 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.343 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:22.343 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:22.343 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.791839603, 2024-04-26T10:22:22.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:22.343 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.343 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.344 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:22.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:22.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:22.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:22.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:22.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:22.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:22.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:22.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:22.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:22.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:22.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:22.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:22.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:22.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:22.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:22.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:22.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:22.347 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.347 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.347 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.347 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:22.348 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:22.348 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.789468164999999, 2024-04-26T10:22:22.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:22.348 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.348 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:22.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:22.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.348 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:22.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.348 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:22.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:22.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:22.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:22.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:22.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:22.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:22.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:22.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:22.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:22.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:22.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:22.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:22.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:22.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:22.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:22.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:22.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:22.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:22.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:22.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:22.353 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.353 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.353 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.353 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:22.353 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:22.353 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.789367543000001, 2024-04-26T10:22:22.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:22.353 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.353 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.353 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:22.353 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:22.354 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.354 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:22.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.354 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:22.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:22.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:22.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:22.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:22.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:22.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:22.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:22.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:22.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:22.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:22.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:22.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:22.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:22.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:22.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:22.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:22.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:22.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:22.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:22.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:22.358 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.358 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.358 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.359 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:22.359 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:22.359 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.789248982, 2024-04-26T10:22:22.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:22.359 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.359 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.359 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:22.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:22.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:22.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:22.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:22.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:22.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:22.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:22.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:22.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:22.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:22.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:22.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:22.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:22.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:22.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:22.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:22.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:22.363 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.363 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.363 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.363 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:22.363 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:22.363 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.789146584000001, 2024-04-26T10:22:22.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:22.363 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.364 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.364 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:22.364 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:22.364 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.364 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:22.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.364 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:22.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:22.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:22.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:22.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:22.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:22.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:22.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:22.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:22.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:22.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:22.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:22.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:22.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:22.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:22.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:22.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:22.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:22.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:22.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:22.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:22.368 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.368 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.368 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.368 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65294 5.e 5:7438ad6f:::benchmark_data_smithi052_19421_object65293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:22.369 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:22.369 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.788466466999999, 2024-04-26T10:22:22.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091965517999999996, 2024-04-26T10:22:22.369 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.369 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.369 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:22.369 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:22.369 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.369 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65294 2024-04-26T10:22:22.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.369 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:22.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:22.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536413+0000", 2024-04-26T10:22:22.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:22.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536470+0000", 2024-04-26T10:22:22.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6443999999999997e-05 2024-04-26T10:22:22.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536480+0000", 2024-04-26T10:22:22.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0652999999999999e-05 2024-04-26T10:22:22.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536488+0000", 2024-04-26T10:22:22.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7929999999999998e-06 2024-04-26T10:22:22.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536548+0000", 2024-04-26T10:22:22.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9556999999999999e-05 2024-04-26T10:22:22.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536728+0000", 2024-04-26T10:22:22.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000180958 2024-04-26T10:22:22.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:22.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628168+0000", 2024-04-26T10:22:22.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091439276999999999 2024-04-26T10:22:22.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628258+0000", 2024-04-26T10:22:22.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0158e-05 2024-04-26T10:22:22.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628380+0000", 2024-04-26T10:22:22.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012180699999999999 2024-04-26T10:22:22.373 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.373 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.373 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.374 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:22.374 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:22.374 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.788126027000001, 2024-04-26T10:22:22.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:22.374 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.374 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.374 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:22.374 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:22.374 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.374 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:22.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.374 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:22.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:22.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:22.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:22.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:22.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:22.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:22.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:22.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:22.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:22.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:22.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:22.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:22.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:22.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:22.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:22.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:22.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:22.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:22.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:22.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:22.378 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.378 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.379 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.379 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:22.379 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:22.379 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.786975752, 2024-04-26T10:22:22.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:22.379 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.379 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.379 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:22.379 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:22.379 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.379 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:22.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.379 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:22.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:22.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:22.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:22.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:22.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:22.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:22.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:22.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:22.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:22.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:22.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:22.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:22.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:22.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:22.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:22.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:22.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:22.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:22.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:22.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:22.384 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.384 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.384 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.384 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65292 5.f e34/22 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head v 34'4129, mlcod=34'4125)", 2024-04-26T10:22:22.384 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:22.384 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.786801495999999, 2024-04-26T10:22:22.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093470155999999999, 2024-04-26T10:22:22.384 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538078+0000", 2024-04-26T10:22:22.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:22.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538140+0000", 2024-04-26T10:22:22.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1970000000000005e-05 2024-04-26T10:22:22.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538149+0000", 2024-04-26T10:22:22.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2189999999999993e-06 2024-04-26T10:22:22.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538158+0000", 2024-04-26T10:22:22.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0930000000000003e-06 2024-04-26T10:22:22.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627053+0000", 2024-04-26T10:22:22.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088895221999999996 2024-04-26T10:22:22.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627092+0000", 2024-04-26T10:22:22.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9657000000000003e-05 2024-04-26T10:22:22.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631499+0000", 2024-04-26T10:22:22.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044066560000000001 2024-04-26T10:22:22.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631549+0000", 2024-04-26T10:22:22.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0259000000000001e-05 2024-04-26T10:22:22.388 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.388 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.388 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.389 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65298 5.b 5:d51c4e52:::benchmark_data_smithi052_19421_object65297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:22.389 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:22.389 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.786035039000001, 2024-04-26T10:22:22.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091641671999999993, 2024-04-26T10:22:22.389 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.389 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.389 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:22.389 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:22.389 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.389 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65298 2024-04-26T10:22:22.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.389 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:22.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:22.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538844+0000", 2024-04-26T10:22:22.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:22.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538919+0000", 2024-04-26T10:22:22.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4626e-05 2024-04-26T10:22:22.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626007+0000", 2024-04-26T10:22:22.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087087516000000004 2024-04-26T10:22:22.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626074+0000", 2024-04-26T10:22:22.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7077999999999997e-05 2024-04-26T10:22:22.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626150+0000", 2024-04-26T10:22:22.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5982999999999994e-05 2024-04-26T10:22:22.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626341+0000", 2024-04-26T10:22:22.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019141199999999999 2024-04-26T10:22:22.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:22.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630359+0000", 2024-04-26T10:22:22.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040175710000000002 2024-04-26T10:22:22.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630412+0000", 2024-04-26T10:22:22.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3779000000000001e-05 2024-04-26T10:22:22.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630487+0000", 2024-04-26T10:22:22.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4913999999999995e-05 2024-04-26T10:22:22.393 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.393 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.393 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.394 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:81355 5.8 5:14f6458e:::benchmark_data_smithi052_19421_object81354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:22.394 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:22.394 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.515598039, 2024-04-26T10:22:22.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027247422, 2024-04-26T10:22:22.394 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.394 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.394 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:22.394 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:22.394 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.394 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 81355 2024-04-26T10:22:22.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.394 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:22.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:22.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809281+0000", 2024-04-26T10:22:22.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:22.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809337+0000", 2024-04-26T10:22:22.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5627999999999997e-05 2024-04-26T10:22:22.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809349+0000", 2024-04-26T10:22:22.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1554e-05 2024-04-26T10:22:22.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809355+0000", 2024-04-26T10:22:22.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2559999999999999e-06 2024-04-26T10:22:22.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.823233+0000", 2024-04-26T10:22:22.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013877647999999999 2024-04-26T10:22:22.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.823361+0000", 2024-04-26T10:22:22.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012813500000000001 2024-04-26T10:22:22.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:22.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836404+0000", 2024-04-26T10:22:22.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013043592999999999 2024-04-26T10:22:22.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836468+0000", 2024-04-26T10:22:22.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3734999999999999e-05 2024-04-26T10:22:22.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836530+0000", 2024-04-26T10:22:22.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2065999999999998e-05 2024-04-26T10:22:22.398 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.398 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.399 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.399 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83591 5.4 5:204a1b6d:::benchmark_data_smithi052_19421_object83590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:22.399 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:22.399 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 11.477166803999999, 2024-04-26T10:22:22.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.047988034999999998, 2024-04-26T10:22:22.399 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.399 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.399 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:22.399 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:22.399 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.401 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83591 2024-04-26T10:22:22.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.401 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:22.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:22.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847713+0000", 2024-04-26T10:22:22.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:22.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847784+0000", 2024-04-26T10:22:22.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0723999999999996e-05 2024-04-26T10:22:22.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847795+0000", 2024-04-26T10:22:22.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1538e-05 2024-04-26T10:22:22.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847810+0000", 2024-04-26T10:22:22.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4354e-05 2024-04-26T10:22:22.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847850+0000", 2024-04-26T10:22:22.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0750000000000001e-05 2024-04-26T10:22:22.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847974+0000", 2024-04-26T10:22:22.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012394899999999999 2024-04-26T10:22:22.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:22.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.848089+0000", 2024-04-26T10:22:22.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114527 2024-04-26T10:22:22.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:22.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852900+0000", 2024-04-26T10:22:22.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048110779999999999 2024-04-26T10:22:22.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:22.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895562+0000", 2024-04-26T10:22:22.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042662053999999998 2024-04-26T10:22:22.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895622+0000", 2024-04-26T10:22:22.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0470000000000002e-05 2024-04-26T10:22:22.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895702+0000", 2024-04-26T10:22:22.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9541000000000003e-05 2024-04-26T10:22:22.406 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.406 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.406 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.406 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83593 5.0 5:044bb3ac:::benchmark_data_smithi052_19421_object83592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:22.406 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:22.406 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 11.475279950999999, 2024-04-26T10:22:22.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.046164161000000002, 2024-04-26T10:22:22.406 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.406 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.406 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:22.406 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:22.406 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.407 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83593 2024-04-26T10:22:22.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.407 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:22.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:22.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849600+0000", 2024-04-26T10:22:22.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:22.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849655+0000", 2024-04-26T10:22:22.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5148999999999997e-05 2024-04-26T10:22:22.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849666+0000", 2024-04-26T10:22:22.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1494999999999999e-05 2024-04-26T10:22:22.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849677+0000", 2024-04-26T10:22:22.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0985000000000001e-05 2024-04-26T10:22:22.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849716+0000", 2024-04-26T10:22:22.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8698000000000001e-05 2024-04-26T10:22:22.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849822+0000", 2024-04-26T10:22:22.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000106173 2024-04-26T10:22:22.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:22.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849938+0000", 2024-04-26T10:22:22.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115738 2024-04-26T10:22:22.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:22.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853416+0000", 2024-04-26T10:22:22.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034777440000000001 2024-04-26T10:22:22.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:22.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895540+0000", 2024-04-26T10:22:22.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042124704999999998 2024-04-26T10:22:22.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895619+0000", 2024-04-26T10:22:22.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8697999999999998e-05 2024-04-26T10:22:22.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895765+0000", 2024-04-26T10:22:22.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014579299999999999 2024-04-26T10:22:22.412 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.412 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.412 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.412 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83594 5.b 5:d024b819:::benchmark_data_smithi052_19421_object83593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:22.412 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:22.412 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 11.475187713, 2024-04-26T10:22:22.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045938635999999998, 2024-04-26T10:22:22.412 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.412 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.412 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:22.412 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:22.413 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.413 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83594 2024-04-26T10:22:22.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.413 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:22.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:22.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849692+0000", 2024-04-26T10:22:22.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:22.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849730+0000", 2024-04-26T10:22:22.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7415e-05 2024-04-26T10:22:22.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849735+0000", 2024-04-26T10:22:22.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6350000000000003e-06 2024-04-26T10:22:22.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849740+0000", 2024-04-26T10:22:22.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4209999999999997e-06 2024-04-26T10:22:22.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849787+0000", 2024-04-26T10:22:22.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7166000000000002e-05 2024-04-26T10:22:22.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849915+0000", 2024-04-26T10:22:22.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012823700000000001 2024-04-26T10:22:22.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:22.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850038+0000", 2024-04-26T10:22:22.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012317 2024-04-26T10:22:22.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:22.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855812+0000", 2024-04-26T10:22:22.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057731340000000001 2024-04-26T10:22:22.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:22.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895504+0000", 2024-04-26T10:22:22.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.039692540999999998 2024-04-26T10:22:22.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895569+0000", 2024-04-26T10:22:22.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4443999999999995e-05 2024-04-26T10:22:22.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895632+0000", 2024-04-26T10:22:22.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3109999999999997e-05 2024-04-26T10:22:22.417 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.417 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.417 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.418 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83596 5.b 5:d54e48a0:::benchmark_data_smithi052_19421_object83595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:22.418 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:22.418 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 11.474367632, 2024-04-26T10:22:22.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.053210201999999998, 2024-04-26T10:22:22.418 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.418 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.418 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:22.418 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:22.418 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.418 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83596 2024-04-26T10:22:22.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.419 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:22.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:22.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850512+0000", 2024-04-26T10:22:22.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:22.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850622+0000", 2024-04-26T10:22:22.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010927 2024-04-26T10:22:22.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850629+0000", 2024-04-26T10:22:22.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1690000000000003e-06 2024-04-26T10:22:22.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850633+0000", 2024-04-26T10:22:22.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4800000000000003e-06 2024-04-26T10:22:22.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852134+0000", 2024-04-26T10:22:22.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015011099999999999 2024-04-26T10:22:22.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852446+0000", 2024-04-26T10:22:22.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031107999999999998 2024-04-26T10:22:22.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:22.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852723+0000", 2024-04-26T10:22:22.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027751499999999999 2024-04-26T10:22:22.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:22.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861229+0000", 2024-04-26T10:22:22.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085055960000000007 2024-04-26T10:22:22.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:22.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903523+0000", 2024-04-26T10:22:22.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042294683999999999 2024-04-26T10:22:22.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903579+0000", 2024-04-26T10:22:22.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5751999999999997e-05 2024-04-26T10:22:22.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903723+0000", 2024-04-26T10:22:22.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014414199999999999 2024-04-26T10:22:22.424 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.424 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.424 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.424 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83603 5.b 5:d4896044:::benchmark_data_smithi052_19421_object83602:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:22.424 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:22.424 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 11.471440745000001, 2024-04-26T10:22:22.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.053974093000000001, 2024-04-26T10:22:22.424 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.424 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.424 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:22.424 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:22.424 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.425 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83603 2024-04-26T10:22:22.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.425 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:22.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:22.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853439+0000", 2024-04-26T10:22:22.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:22.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853492+0000", 2024-04-26T10:22:22.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2265000000000002e-05 2024-04-26T10:22:22.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853504+0000", 2024-04-26T10:22:22.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2354999999999999e-05 2024-04-26T10:22:22.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853512+0000", 2024-04-26T10:22:22.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8630000000000008e-06 2024-04-26T10:22:22.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855839+0000", 2024-04-26T10:22:22.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002326776 2024-04-26T10:22:22.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855993+0000", 2024-04-26T10:22:22.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015428300000000001 2024-04-26T10:22:22.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:22.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.856138+0000", 2024-04-26T10:22:22.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000145427 2024-04-26T10:22:22.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:22.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861318+0000", 2024-04-26T10:22:22.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051795160000000003 2024-04-26T10:22:22.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:22.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907178+0000", 2024-04-26T10:22:22.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045859882999999997 2024-04-26T10:22:22.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907260+0000", 2024-04-26T10:22:22.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2133999999999997e-05 2024-04-26T10:22:22.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907414+0000", 2024-04-26T10:22:22.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015427400000000001 2024-04-26T10:22:22.429 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.429 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.430 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.430 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83605 5.4 5:2eb72b61:::benchmark_data_smithi052_19421_object83604:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:22.430 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:22.430 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 11.471361297, 2024-04-26T10:22:22.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045576089, 2024-04-26T10:22:22.430 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:22.430 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.430 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:22.430 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:22.430 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.430 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83605 2024-04-26T10:22:22.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.431 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:22.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:22.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:22.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:22.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:22.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:22.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:22.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:22.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:22.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:22.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853557+0000", 2024-04-26T10:22:22.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8423000000000001e-05 2024-04-26T10:22:22.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:22.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853573+0000", 2024-04-26T10:22:22.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6201e-05 2024-04-26T10:22:22.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853583+0000", 2024-04-26T10:22:22.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9129999999999998e-06 2024-04-26T10:22:22.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:22.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853625+0000", 2024-04-26T10:22:22.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1965000000000002e-05 2024-04-26T10:22:22.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:22.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853795+0000", 2024-04-26T10:22:22.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169946 2024-04-26T10:22:22.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:22.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853980+0000", 2024-04-26T10:22:22.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018517100000000001 2024-04-26T10:22:22.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:22.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861356+0000", 2024-04-26T10:22:22.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073759389999999998 2024-04-26T10:22:22.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:22.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.898899+0000", 2024-04-26T10:22:22.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.037542786000000002 2024-04-26T10:22:22.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:22.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.898963+0000", 2024-04-26T10:22:22.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3652999999999995e-05 2024-04-26T10:22:22.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:22.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:22.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:22.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.899095+0000", 2024-04-26T10:22:22.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013286999999999999 2024-04-26T10:22:22.435 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.435 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.435 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.435 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:22.436 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:22.436 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:22.436 DEBUG:teuthology.orchestra.console.smithi164:Waiting for login prompt 2024-04-26T10:22:22.436 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi164 2024-04-26T10:22:22.447 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:22.444+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:22.448 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:22.550 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:22.544+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:22.586 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:22.586 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:22.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.586 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:107526 5.d 5:b12c87a5:::benchmark_data_smithi052_19421_object107525:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:22.586 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:22.578353+0000", 2024-04-26T10:22:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0062650479999999996, 2024-04-26T10:22:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006283907, 2024-04-26T10:22:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 107526 2024-04-26T10:22:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.578353+0000", 2024-04-26T10:22:22.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.578353+0000", 2024-04-26T10:22:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.578352+0000", 2024-04-26T10:22:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.578383+0000", 2024-04-26T10:22:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1127999999999997e-05 2024-04-26T10:22:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.578390+0000", 2024-04-26T10:22:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-04-26T10:22:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.578395+0000", 2024-04-26T10:22:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3460000000000001e-06 2024-04-26T10:22:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.578461+0000", 2024-04-26T10:22:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5778000000000006e-05 2024-04-26T10:22:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.578601+0000", 2024-04-26T10:22:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140538 2024-04-26T10:22:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.578802+0000", 2024-04-26T10:22:22.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020084399999999999 2024-04-26T10:22:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.581477+0000", 2024-04-26T10:22:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002674765 2024-04-26T10:22:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:107528 5.9 5:98879ae3:::benchmark_data_smithi052_19421_object107527:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:22.582024+0000", 2024-04-26T10:22:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0025933520000000002, 2024-04-26T10:22:22.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026607549999999999, 2024-04-26T10:22:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 107528 2024-04-26T10:22:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582024+0000", 2024-04-26T10:22:22.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582024+0000", 2024-04-26T10:22:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582023+0000", 2024-04-26T10:22:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582066+0000", 2024-04-26T10:22:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2409e-05 2024-04-26T10:22:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582077+0000", 2024-04-26T10:22:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1072e-05 2024-04-26T10:22:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582084+0000", 2024-04-26T10:22:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5480000000000004e-06 2024-04-26T10:22:22.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582308+0000", 2024-04-26T10:22:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00022391300000000001 2024-04-26T10:22:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582476+0000", 2024-04-26T10:22:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016714599999999999 2024-04-26T10:22:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582637+0000", 2024-04-26T10:22:22.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016195599999999999 2024-04-26T10:22:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:107529 5.c 5:33849a50:::benchmark_data_smithi052_19421_object107528:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:22.582092+0000", 2024-04-26T10:22:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0025260159999999999, 2024-04-26T10:22:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026353879999999998, 2024-04-26T10:22:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:22.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 107529 2024-04-26T10:22:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582092+0000", 2024-04-26T10:22:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582092+0000", 2024-04-26T10:22:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582091+0000", 2024-04-26T10:22:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582122+0000", 2024-04-26T10:22:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1361e-05 2024-04-26T10:22:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582130+0000", 2024-04-26T10:22:22.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7489999999999998e-06 2024-04-26T10:22:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582136+0000", 2024-04-26T10:22:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5629999999999999e-06 2024-04-26T10:22:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582186+0000", 2024-04-26T10:22:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0114999999999997e-05 2024-04-26T10:22:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582327+0000", 2024-04-26T10:22:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014149599999999999 2024-04-26T10:22:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:107525 5.b e45/37 5:de78f7b8:::benchmark_data_smithi052_19421_object107524:head v 45'6679, mlcod=45'6676)", 2024-04-26T10:22:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:22.582229+0000", 2024-04-26T10:22:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00238843, 2024-04-26T10:22:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002533806, 2024-04-26T10:22:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.600 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582229+0000", 2024-04-26T10:22:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582229+0000", 2024-04-26T10:22:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582229+0000", 2024-04-26T10:22:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582235+0000", 2024-04-26T10:22:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1539999999999999e-06 2024-04-26T10:22:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582252+0000", 2024-04-26T10:22:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6875999999999999e-05 2024-04-26T10:22:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582259+0000", 2024-04-26T10:22:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7530000000000001e-06 2024-04-26T10:22:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582316+0000", 2024-04-26T10:22:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6752000000000001e-05 2024-04-26T10:22:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582338+0000", 2024-04-26T10:22:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1515999999999999e-05 2024-04-26T10:22:22.603 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:107534 5.1 5:8b231b99:::benchmark_data_smithi052_19421_object107533:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:22.582643+0000", 2024-04-26T10:22:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0019743569999999999, 2024-04-26T10:22:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021509599999999999, 2024-04-26T10:22:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.604 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 107534 2024-04-26T10:22:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582643+0000", 2024-04-26T10:22:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582643+0000", 2024-04-26T10:22:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582642+0000", 2024-04-26T10:22:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582777+0000", 2024-04-26T10:22:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013448999999999999 2024-04-26T10:22:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582787+0000", 2024-04-26T10:22:22.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0312999999999999e-05 2024-04-26T10:22:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582794+0000", 2024-04-26T10:22:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3509999999999998e-06 2024-04-26T10:22:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.584472+0000", 2024-04-26T10:22:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001678698 2024-04-26T10:22:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.584632+0000", 2024-04-26T10:22:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160011 2024-04-26T10:22:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:107535 5.f 5:f28aaf9f:::benchmark_data_smithi052_19421_object107534:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:22.582988+0000", 2024-04-26T10:22:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00162955, 2024-04-26T10:22:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001840529, 2024-04-26T10:22:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:22.608 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 107535 2024-04-26T10:22:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582988+0000", 2024-04-26T10:22:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582988+0000", 2024-04-26T10:22:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.582987+0000", 2024-04-26T10:22:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583092+0000", 2024-04-26T10:22:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010464200000000001 2024-04-26T10:22:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583098+0000", 2024-04-26T10:22:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9030000000000001e-06 2024-04-26T10:22:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583102+0000", 2024-04-26T10:22:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9709999999999998e-06 2024-04-26T10:22:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583256+0000", 2024-04-26T10:22:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000154053 2024-04-26T10:22:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583402+0000", 2024-04-26T10:22:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000145971 2024-04-26T10:22:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583548+0000", 2024-04-26T10:22:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014618899999999999 2024-04-26T10:22:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:107536 5.6 5:64b7e2be:::benchmark_data_smithi052_19421_object107535:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:22.612 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:22.583180+0000", 2024-04-26T10:22:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001437242, 2024-04-26T10:22:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001685066, 2024-04-26T10:22:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 107536 2024-04-26T10:22:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583180+0000", 2024-04-26T10:22:22.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583180+0000", 2024-04-26T10:22:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583180+0000", 2024-04-26T10:22:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583249+0000", 2024-04-26T10:22:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9653999999999994e-05 2024-04-26T10:22:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583257+0000", 2024-04-26T10:22:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3370000000000002e-06 2024-04-26T10:22:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583262+0000", 2024-04-26T10:22:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6640000000000003e-06 2024-04-26T10:22:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583315+0000", 2024-04-26T10:22:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2218e-05 2024-04-26T10:22:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583448+0000", 2024-04-26T10:22:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013328099999999999 2024-04-26T10:22:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:107533 5.4 e45/37 5:284801d5:::benchmark_data_smithi052_19421_object107532:head v 45'6761, mlcod=45'6759)", 2024-04-26T10:22:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:22.583420+0000", 2024-04-26T10:22:22.617 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001197191, 2024-04-26T10:22:22.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001479043, 2024-04-26T10:22:22.618 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.618 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:22.618 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583420+0000", 2024-04-26T10:22:22.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583420+0000", 2024-04-26T10:22:22.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583420+0000", 2024-04-26T10:22:22.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:22.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583425+0000", 2024-04-26T10:22:22.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3870000000000003e-06 2024-04-26T10:22:22.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583433+0000", 2024-04-26T10:22:22.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8620000000000003e-06 2024-04-26T10:22:22.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583439+0000", 2024-04-26T10:22:22.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.344e-06 2024-04-26T10:22:22.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583475+0000", 2024-04-26T10:22:22.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6844000000000002e-05 2024-04-26T10:22:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.583496+0000", 2024-04-26T10:22:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0115e-05 2024-04-26T10:22:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:107524 5.9 5:9551b185:::benchmark_data_smithi052_19421_object107523:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:22.578283+0000", 2024-04-26T10:22:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0063344910000000003, 2024-04-26T10:22:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066476069999999998, 2024-04-26T10:22:22.621 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.622 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:22.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:22.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:22.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.622 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 107524 2024-04-26T10:22:22.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.622 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.578283+0000", 2024-04-26T10:22:22.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.578283+0000", 2024-04-26T10:22:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.578283+0000", 2024-04-26T10:22:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.578329+0000", 2024-04-26T10:22:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6916999999999998e-05 2024-04-26T10:22:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.578337+0000", 2024-04-26T10:22:22.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5329999999999997e-06 2024-04-26T10:22:22.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.578343+0000", 2024-04-26T10:22:22.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8390000000000003e-06 2024-04-26T10:22:22.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.578381+0000", 2024-04-26T10:22:22.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7747000000000003e-05 2024-04-26T10:22:22.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.580512+0000", 2024-04-26T10:22:22.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021313930000000001 2024-04-26T10:22:22.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:22.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:22.580704+0000", 2024-04-26T10:22:22.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019153599999999999 2024-04-26T10:22:22.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.625 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.625 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.625 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:22.625 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 9 2024-04-26T10:22:22.626 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:22.626 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 49 16 107599 107583 137.207 127.938 0.00608059 0.00728257 2024-04-26T10:22:22.627 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:22.648 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:22.644+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:22.749 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:22.744+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:22.755 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:22.755 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:22.755 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:22.755 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:22.755 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:22.769 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:22.850 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:22.843+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:22.946 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:22.947 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:22.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:22.947 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:22.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.947 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:22.947 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:22.947 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.414017508000001, 2024-04-26T10:22:22.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:22.947 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.947 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:22.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:22.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.948 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:22.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.948 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:22.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:22.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:22.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:22.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:22.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:22.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:22.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:22.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:22.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:22.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:22.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:22.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:22.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:22.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:22.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:22.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:22.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:22.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:22.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:22.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:22.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:22.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:22.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:22.953 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.953 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.953 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.953 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:22.953 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:22.953 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.409482296, 2024-04-26T10:22:22.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:22.954 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.954 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:22.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:22.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.954 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:22.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.954 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:22.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:22.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:22.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:22.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:22.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:22.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:22.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:22.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:22.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:22.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:22.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:22.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:22.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:22.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:22.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:22.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:22.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:22.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:22.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:22.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:22.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:22.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:22.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:22.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:22.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:22.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:22.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:22.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:22.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.959 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.959 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:22.959 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:22.959 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.408851003999999, 2024-04-26T10:22:22.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:22.959 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.959 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:22.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:22.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.960 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:22.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.960 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:22.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:22.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:22.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:22.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:22.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:22.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:22.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:22.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:22.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:22.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:22.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:22.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:22.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:22.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:22.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:22.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:22.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:22.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:22.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:22.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:22.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:22.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:22.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:22.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:22.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:22.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:22.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:22.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:22.964 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.964 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.964 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.965 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65604 5.9 5:9c239c32:::benchmark_data_smithi052_19421_object65603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:22.965 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:22.965 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.173748119999999, 2024-04-26T10:22:22.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025897677000000001, 2024-04-26T10:22:22.965 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.965 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:22.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:22.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.965 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65604 2024-04-26T10:22:22.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.965 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:22.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:22.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769615+0000", 2024-04-26T10:22:22.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:22.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769694+0000", 2024-04-26T10:22:22.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9087999999999999e-05 2024-04-26T10:22:22.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769702+0000", 2024-04-26T10:22:22.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8150000000000006e-06 2024-04-26T10:22:22.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769709+0000", 2024-04-26T10:22:22.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:22:22.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772336+0000", 2024-04-26T10:22:22.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002626836 2024-04-26T10:22:22.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772470+0000", 2024-04-26T10:22:22.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013453299999999999 2024-04-26T10:22:22.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:22.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772605+0000", 2024-04-26T10:22:22.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013428499999999999 2024-04-26T10:22:22.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:22.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779374+0000", 2024-04-26T10:22:22.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067694000000000001 2024-04-26T10:22:22.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:22.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795401+0000", 2024-04-26T10:22:22.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016026543000000001 2024-04-26T10:22:22.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:22.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795461+0000", 2024-04-26T10:22:22.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9923999999999998e-05 2024-04-26T10:22:22.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:22.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795513+0000", 2024-04-26T10:22:22.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2737e-05 2024-04-26T10:22:22.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.970 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.971 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65614 5.9 5:993a4fbe:::benchmark_data_smithi052_19421_object65613:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:22.971 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:22.971 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.171282883, 2024-04-26T10:22:22.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023664145000000001, 2024-04-26T10:22:22.971 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.971 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.971 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:22.971 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:22.971 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.971 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65614 2024-04-26T10:22:22.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.971 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:22.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:22.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772080+0000", 2024-04-26T10:22:22.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:22.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772117+0000", 2024-04-26T10:22:22.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6418000000000003e-05 2024-04-26T10:22:22.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772124+0000", 2024-04-26T10:22:22.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4730000000000003e-06 2024-04-26T10:22:22.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772132+0000", 2024-04-26T10:22:22.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3900000000000004e-06 2024-04-26T10:22:22.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781379+0000", 2024-04-26T10:22:22.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092471059999999997 2024-04-26T10:22:22.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781495+0000", 2024-04-26T10:22:22.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001159 2024-04-26T10:22:22.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:22.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781581+0000", 2024-04-26T10:22:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6087000000000004e-05 2024-04-26T10:22:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.785948+0000", 2024-04-26T10:22:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043671669999999999 2024-04-26T10:22:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795661+0000", 2024-04-26T10:22:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097130310000000004 2024-04-26T10:22:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795710+0000", 2024-04-26T10:22:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8959000000000003e-05 2024-04-26T10:22:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795745+0000", 2024-04-26T10:22:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5172000000000001e-05 2024-04-26T10:22:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83591 5.4 e41/37 5:204a1b6d:::benchmark_data_smithi052_19421_object83590:head v 41'5271, mlcod=41'5268)", 2024-04-26T10:22:22.976 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.096375601, 2024-04-26T10:22:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.046802200000000002, 2024-04-26T10:22:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846987+0000", 2024-04-26T10:22:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846995+0000", 2024-04-26T10:22:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7549999999999994e-06 2024-04-26T10:22:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847004+0000", 2024-04-26T10:22:22.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3190000000000001e-06 2024-04-26T10:22:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847011+0000", 2024-04-26T10:22:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5039999999999999e-06 2024-04-26T10:22:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847048+0000", 2024-04-26T10:22:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7052999999999999e-05 2024-04-26T10:22:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847066+0000", 2024-04-26T10:22:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8468999999999999e-05 2024-04-26T10:22:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893707+0000", 2024-04-26T10:22:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.046641123999999999 2024-04-26T10:22:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893790+0000", 2024-04-26T10:22:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2806999999999995e-05 2024-04-26T10:22:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.980 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83592 5.3 5:c96af6b1:::benchmark_data_smithi052_19421_object83591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.095042457, 2024-04-26T10:22:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045543839000000003, 2024-04-26T10:22:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83592 2024-04-26T10:22:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.981 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848320+0000", 2024-04-26T10:22:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:22.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848465+0000", 2024-04-26T10:22:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000145291 2024-04-26T10:22:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848475+0000", 2024-04-26T10:22:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6709999999999994e-06 2024-04-26T10:22:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848482+0000", 2024-04-26T10:22:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2910000000000002e-06 2024-04-26T10:22:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848532+0000", 2024-04-26T10:22:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9199000000000001e-05 2024-04-26T10:22:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848676+0000", 2024-04-26T10:22:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014493399999999999 2024-04-26T10:22:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:22.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893707+0000", 2024-04-26T10:22:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045030857000000001 2024-04-26T10:22:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893772+0000", 2024-04-26T10:22:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4203999999999997e-05 2024-04-26T10:22:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893865+0000", 2024-04-26T10:22:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3577000000000002e-05 2024-04-26T10:22:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.985 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83593 5.0 e41/37 5:044bb3ac:::benchmark_data_smithi052_19421_object83592:head v 41'5187, mlcod=41'5184)", 2024-04-26T10:22:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.09454504, 2024-04-26T10:22:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044951738999999998, 2024-04-26T10:22:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848818+0000", 2024-04-26T10:22:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848824+0000", 2024-04-26T10:22:22.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-04-26T10:22:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848895+0000", 2024-04-26T10:22:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1468000000000001e-05 2024-04-26T10:22:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848902+0000", 2024-04-26T10:22:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6229999999999999e-06 2024-04-26T10:22:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848955+0000", 2024-04-26T10:22:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3106000000000003e-05 2024-04-26T10:22:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848974+0000", 2024-04-26T10:22:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9598000000000001e-05 2024-04-26T10:22:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893703+0000", 2024-04-26T10:22:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044728315999999997 2024-04-26T10:22:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893770+0000", 2024-04-26T10:22:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7683999999999998e-05 2024-04-26T10:22:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83594 5.b e41/37 5:d024b819:::benchmark_data_smithi052_19421_object83593:head v 41'5142, mlcod=41'5140)", 2024-04-26T10:22:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.094435031, 2024-04-26T10:22:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044760763000000002, 2024-04-26T10:22:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.990 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848928+0000", 2024-04-26T10:22:22.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848933+0000", 2024-04-26T10:22:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848952+0000", 2024-04-26T10:22:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8884000000000001e-05 2024-04-26T10:22:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848957+0000", 2024-04-26T10:22:22.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8470000000000003e-06 2024-04-26T10:22:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848980+0000", 2024-04-26T10:22:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2946999999999999e-05 2024-04-26T10:22:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848992+0000", 2024-04-26T10:22:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1882000000000001e-05 2024-04-26T10:22:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:22.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893623+0000", 2024-04-26T10:22:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044631381999999997 2024-04-26T10:22:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893689+0000", 2024-04-26T10:22:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6285999999999995e-05 2024-04-26T10:22:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83595 5.1 5:829f4097:::benchmark_data_smithi052_19421_object83594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:22.994 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.094346172, 2024-04-26T10:22:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048599369000000003, 2024-04-26T10:22:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83595 2024-04-26T10:22:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849017+0000", 2024-04-26T10:22:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849041+0000", 2024-04-26T10:22:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4239999999999998e-05 2024-04-26T10:22:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849048+0000", 2024-04-26T10:22:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4669999999999998e-06 2024-04-26T10:22:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849053+0000", 2024-04-26T10:22:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3839999999999999e-06 2024-04-26T10:22:22.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849099+0000", 2024-04-26T10:22:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6579999999999998e-05 2024-04-26T10:22:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849246+0000", 2024-04-26T10:22:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014681899999999999 2024-04-26T10:22:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897498+0000", 2024-04-26T10:22:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048252002000000002 2024-04-26T10:22:22.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897544+0000", 2024-04-26T10:22:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5497999999999997e-05 2024-04-26T10:22:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897617+0000", 2024-04-26T10:22:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3143000000000001e-05 2024-04-26T10:22:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:22.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83597 5.d 5:b4b0a3ad:::benchmark_data_smithi052_19421_object83596:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.094080733, 2024-04-26T10:22:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.047933286999999998, 2024-04-26T10:22:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83597 2024-04-26T10:22:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849282+0000", 2024-04-26T10:22:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849384+0000", 2024-04-26T10:22:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010128600000000001 2024-04-26T10:22:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849392+0000", 2024-04-26T10:22:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4290000000000001e-06 2024-04-26T10:22:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849398+0000", 2024-04-26T10:22:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8969999999999996e-06 2024-04-26T10:22:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849481+0000", 2024-04-26T10:22:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3088000000000001e-05 2024-04-26T10:22:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849639+0000", 2024-04-26T10:22:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015797200000000001 2024-04-26T10:22:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849782+0000", 2024-04-26T10:22:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014353599999999999 2024-04-26T10:22:23.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894335+0000", 2024-04-26T10:22:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044552500000000002 2024-04-26T10:22:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896955+0000", 2024-04-26T10:22:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002620229 2024-04-26T10:22:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897051+0000", 2024-04-26T10:22:23.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5847999999999994e-05 2024-04-26T10:22:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897216+0000", 2024-04-26T10:22:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016519700000000001 2024-04-26T10:22:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83598 5.7 5:e1984dee:::benchmark_data_smithi052_19421_object83597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.093954703, 2024-04-26T10:22:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.049315405999999999, 2024-04-26T10:22:23.005 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83598 2024-04-26T10:22:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849408+0000", 2024-04-26T10:22:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849466+0000", 2024-04-26T10:22:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7302000000000001e-05 2024-04-26T10:22:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849473+0000", 2024-04-26T10:22:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4900000000000003e-06 2024-04-26T10:22:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849479+0000", 2024-04-26T10:22:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3539999999999999e-06 2024-04-26T10:22:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849526+0000", 2024-04-26T10:22:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7246999999999997e-05 2024-04-26T10:22:23.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849677+0000", 2024-04-26T10:22:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000151218 2024-04-26T10:22:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898591+0000", 2024-04-26T10:22:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048914343999999998 2024-04-26T10:22:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898650+0000", 2024-04-26T10:22:23.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8288999999999997e-05 2024-04-26T10:22:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898724+0000", 2024-04-26T10:22:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4782000000000003e-05 2024-04-26T10:22:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83599 5.3 5:c6d96bef:::benchmark_data_smithi052_19421_object83598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.091951222, 2024-04-26T10:22:23.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050758893999999999, 2024-04-26T10:22:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83599 2024-04-26T10:22:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851411+0000", 2024-04-26T10:22:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851465+0000", 2024-04-26T10:22:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3943999999999997e-05 2024-04-26T10:22:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851475+0000", 2024-04-26T10:22:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0220999999999999e-05 2024-04-26T10:22:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851482+0000", 2024-04-26T10:22:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3259999999999998e-06 2024-04-26T10:22:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851525+0000", 2024-04-26T10:22:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2255000000000001e-05 2024-04-26T10:22:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851617+0000", 2024-04-26T10:22:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2436999999999996e-05 2024-04-26T10:22:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902102+0000", 2024-04-26T10:22:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050485163 2024-04-26T10:22:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902130+0000", 2024-04-26T10:22:23.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8177000000000001e-05 2024-04-26T10:22:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902171+0000", 2024-04-26T10:22:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1091999999999999e-05 2024-04-26T10:22:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83596 5.b e41/37 5:d54e48a0:::benchmark_data_smithi052_19421_object83595:head v 41'5143, mlcod=41'5140)", 2024-04-26T10:22:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.091740892000001, 2024-04-26T10:22:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050472416999999999, 2024-04-26T10:22:23.015 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851621+0000", 2024-04-26T10:22:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851628+0000", 2024-04-26T10:22:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:22:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851635+0000", 2024-04-26T10:22:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6009999999999997e-06 2024-04-26T10:22:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851646+0000", 2024-04-26T10:22:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1248e-05 2024-04-26T10:22:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851687+0000", 2024-04-26T10:22:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1004999999999998e-05 2024-04-26T10:22:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851706+0000", 2024-04-26T10:22:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8994000000000001e-05 2024-04-26T10:22:23.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902062+0000", 2024-04-26T10:22:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050355957999999999 2024-04-26T10:22:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902095+0000", 2024-04-26T10:22:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2882000000000001e-05 2024-04-26T10:22:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83601 5.d 5:b32b06d1:::benchmark_data_smithi052_19421_object83600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.091434176, 2024-04-26T10:22:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045519045000000001, 2024-04-26T10:22:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83601 2024-04-26T10:22:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851929+0000", 2024-04-26T10:22:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852104+0000", 2024-04-26T10:22:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175234 2024-04-26T10:22:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852110+0000", 2024-04-26T10:22:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.66e-06 2024-04-26T10:22:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852114+0000", 2024-04-26T10:22:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7809999999999999e-06 2024-04-26T10:22:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852153+0000", 2024-04-26T10:22:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9576000000000002e-05 2024-04-26T10:22:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852283+0000", 2024-04-26T10:22:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012946600000000001 2024-04-26T10:22:23.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852415+0000", 2024-04-26T10:22:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132719 2024-04-26T10:22:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894427+0000", 2024-04-26T10:22:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042011497000000002 2024-04-26T10:22:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897231+0000", 2024-04-26T10:22:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002804239 2024-04-26T10:22:23.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897306+0000", 2024-04-26T10:22:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4771999999999995e-05 2024-04-26T10:22:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897449+0000", 2024-04-26T10:22:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142707 2024-04-26T10:22:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83604 5.2 5:41ebe09c:::benchmark_data_smithi052_19421_object83603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.091241189, 2024-04-26T10:22:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044923596000000003, 2024-04-26T10:22:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83604 2024-04-26T10:22:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852122+0000", 2024-04-26T10:22:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852149+0000", 2024-04-26T10:22:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7596000000000001e-05 2024-04-26T10:22:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852154+0000", 2024-04-26T10:22:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0889999999999999e-06 2024-04-26T10:22:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852158+0000", 2024-04-26T10:22:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2830000000000002e-06 2024-04-26T10:22:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852194+0000", 2024-04-26T10:22:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6062000000000001e-05 2024-04-26T10:22:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852276+0000", 2024-04-26T10:22:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1891000000000006e-05 2024-04-26T10:22:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896782+0000", 2024-04-26T10:22:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044506271 2024-04-26T10:22:23.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896875+0000", 2024-04-26T10:22:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3499999999999996e-05 2024-04-26T10:22:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897046+0000", 2024-04-26T10:22:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017065200000000001 2024-04-26T10:22:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83606 5.1 5:81602529:::benchmark_data_smithi052_19421_object83605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.090923552, 2024-04-26T10:22:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045300391000000002, 2024-04-26T10:22:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83606 2024-04-26T10:22:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852439+0000", 2024-04-26T10:22:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852535+0000", 2024-04-26T10:22:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6025000000000003e-05 2024-04-26T10:22:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852545+0000", 2024-04-26T10:22:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3619999999999995e-06 2024-04-26T10:22:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852551+0000", 2024-04-26T10:22:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4500000000000001e-06 2024-04-26T10:22:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852588+0000", 2024-04-26T10:22:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6785000000000001e-05 2024-04-26T10:22:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852668+0000", 2024-04-26T10:22:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0008999999999999e-05 2024-04-26T10:22:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897625+0000", 2024-04-26T10:22:23.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044956744999999999 2024-04-26T10:22:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897667+0000", 2024-04-26T10:22:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1887000000000001e-05 2024-04-26T10:22:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897741+0000", 2024-04-26T10:22:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4023000000000006e-05 2024-04-26T10:22:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83605 5.4 e41/37 5:2eb72b61:::benchmark_data_smithi052_19421_object83604:head v 41'5272, mlcod=41'5269)", 2024-04-26T10:22:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.090516224, 2024-04-26T10:22:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044651192999999999, 2024-04-26T10:22:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852851+0000", 2024-04-26T10:22:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4560000000000002e-06 2024-04-26T10:22:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852859+0000", 2024-04-26T10:22:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2169999999999997e-06 2024-04-26T10:22:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852864+0000", 2024-04-26T10:22:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-04-26T10:22:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852899+0000", 2024-04-26T10:22:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4987000000000002e-05 2024-04-26T10:22:23.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852916+0000", 2024-04-26T10:22:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7563000000000001e-05 2024-04-26T10:22:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897449+0000", 2024-04-26T10:22:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044532644000000003 2024-04-26T10:22:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897499+0000", 2024-04-26T10:22:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9734999999999997e-05 2024-04-26T10:22:23.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83607 5.6 5:66b4c91d:::benchmark_data_smithi052_19421_object83606:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 12.08838577, 2024-04-26T10:22:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048173940999999998, 2024-04-26T10:22:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.040 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83607 2024-04-26T10:22:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854976+0000", 2024-04-26T10:22:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.855030+0000", 2024-04-26T10:22:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3436000000000001e-05 2024-04-26T10:22:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893759+0000", 2024-04-26T10:22:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.038729302 2024-04-26T10:22:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893777+0000", 2024-04-26T10:22:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7343e-05 2024-04-26T10:22:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893880+0000", 2024-04-26T10:22:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103285 2024-04-26T10:22:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894161+0000", 2024-04-26T10:22:23.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000280704 2024-04-26T10:22:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902948+0000", 2024-04-26T10:22:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087876059999999999 2024-04-26T10:22:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.903028+0000", 2024-04-26T10:22:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9486000000000004e-05 2024-04-26T10:22:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:23.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.903152+0000", 2024-04-26T10:22:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012426599999999999 2024-04-26T10:22:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:99120 5.3 5:cec65b6a:::benchmark_data_smithi052_19421_object99119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:18.504626+0000", 2024-04-26T10:22:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.4387378709999998, 2024-04-26T10:22:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024740605999999998, 2024-04-26T10:22:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 99120 2024-04-26T10:22:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504626+0000", 2024-04-26T10:22:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504626+0000", 2024-04-26T10:22:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504625+0000", 2024-04-26T10:22:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504705+0000", 2024-04-26T10:22:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9901000000000006e-05 2024-04-26T10:22:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504711+0000", 2024-04-26T10:22:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9170000000000003e-06 2024-04-26T10:22:23.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504715+0000", 2024-04-26T10:22:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7249999999999999e-06 2024-04-26T10:22:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504749+0000", 2024-04-26T10:22:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4635000000000003e-05 2024-04-26T10:22:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504841+0000", 2024-04-26T10:22:23.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1166000000000001e-05 2024-04-26T10:22:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.529252+0000", 2024-04-26T10:22:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024411651999999999 2024-04-26T10:22:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.529296+0000", 2024-04-26T10:22:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3343000000000002e-05 2024-04-26T10:22:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.529366+0000", 2024-04-26T10:22:23.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0780999999999999e-05 2024-04-26T10:22:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.050 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.050 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:23.052 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:23.052 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:23.048+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:23.152 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:23.148+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:23.175 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:23.175 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:23.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.175 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:108741 5.8 5:150ff9bc:::benchmark_data_smithi052_19421_object108740:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.175 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:23.166609+0000", 2024-04-26T10:22:23.175 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0076727360000000003, 2024-04-26T10:22:23.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0076933640000000003, 2024-04-26T10:22:23.176 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.176 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:23.176 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.176 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.176 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.176 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 108741 2024-04-26T10:22:23.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.176 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.166609+0000", 2024-04-26T10:22:23.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.166609+0000", 2024-04-26T10:22:23.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.166608+0000", 2024-04-26T10:22:23.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.166767+0000", 2024-04-26T10:22:23.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159164 2024-04-26T10:22:23.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.166774+0000", 2024-04-26T10:22:23.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.469e-06 2024-04-26T10:22:23.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.166779+0000", 2024-04-26T10:22:23.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7339999999999999e-06 2024-04-26T10:22:23.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.168588+0000", 2024-04-26T10:22:23.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0018082840000000001 2024-04-26T10:22:23.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.168754+0000", 2024-04-26T10:22:23.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016608000000000001 2024-04-26T10:22:23.179 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.179 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.179 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.179 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:108742 5.b 5:d58d7c88:::benchmark_data_smithi052_19421_object108741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.179 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:23.167146+0000", 2024-04-26T10:22:23.179 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0071350270000000004, 2024-04-26T10:22:23.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007199525, 2024-04-26T10:22:23.179 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.180 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:23.180 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.180 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.180 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.180 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 108742 2024-04-26T10:22:23.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.180 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.167146+0000", 2024-04-26T10:22:23.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.167146+0000", 2024-04-26T10:22:23.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.167146+0000", 2024-04-26T10:22:23.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.167295+0000", 2024-04-26T10:22:23.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000149534 2024-04-26T10:22:23.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.167304+0000", 2024-04-26T10:22:23.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5399999999999996e-06 2024-04-26T10:22:23.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.167308+0000", 2024-04-26T10:22:23.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0690000000000003e-06 2024-04-26T10:22:23.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.167358+0000", 2024-04-26T10:22:23.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9802000000000002e-05 2024-04-26T10:22:23.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.167492+0000", 2024-04-26T10:22:23.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134585 2024-04-26T10:22:23.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:23.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.167656+0000", 2024-04-26T10:22:23.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016395099999999999 2024-04-26T10:22:23.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:23.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.169810+0000", 2024-04-26T10:22:23.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021532420000000001 2024-04-26T10:22:23.183 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.183 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.184 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.184 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:108743 5.8 5:1498d3d8:::benchmark_data_smithi052_19421_object108742:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.184 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:23.167916+0000", 2024-04-26T10:22:23.184 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0063652279999999997, 2024-04-26T10:22:23.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0064784109999999999, 2024-04-26T10:22:23.184 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.184 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:23.184 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.184 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.184 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.184 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 108743 2024-04-26T10:22:23.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.184 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.167916+0000", 2024-04-26T10:22:23.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.167916+0000", 2024-04-26T10:22:23.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.167915+0000", 2024-04-26T10:22:23.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.168071+0000", 2024-04-26T10:22:23.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015587899999999999 2024-04-26T10:22:23.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.168080+0000", 2024-04-26T10:22:23.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8580000000000006e-06 2024-04-26T10:22:23.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.168085+0000", 2024-04-26T10:22:23.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8879999999999996e-06 2024-04-26T10:22:23.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170698+0000", 2024-04-26T10:22:23.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0026128060000000001 2024-04-26T10:22:23.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170840+0000", 2024-04-26T10:22:23.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014221500000000001 2024-04-26T10:22:23.187 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.187 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.187 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.188 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:108745 5.8 5:17f1c1ba:::benchmark_data_smithi052_19421_object108744:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.188 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:23.168090+0000", 2024-04-26T10:22:23.188 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0061917930000000001, 2024-04-26T10:22:23.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0063678210000000001, 2024-04-26T10:22:23.188 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.188 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:23.188 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.188 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.188 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.188 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 108745 2024-04-26T10:22:23.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.188 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.168090+0000", 2024-04-26T10:22:23.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.168090+0000", 2024-04-26T10:22:23.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.168089+0000", 2024-04-26T10:22:23.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.168117+0000", 2024-04-26T10:22:23.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7797000000000002e-05 2024-04-26T10:22:23.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.168124+0000", 2024-04-26T10:22:23.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4819999999999999e-06 2024-04-26T10:22:23.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.168127+0000", 2024-04-26T10:22:23.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8530000000000002e-06 2024-04-26T10:22:23.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.173415+0000", 2024-04-26T10:22:23.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052874059999999997 2024-04-26T10:22:23.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.173498+0000", 2024-04-26T10:22:23.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3016999999999995e-05 2024-04-26T10:22:23.191 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.191 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.191 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.192 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:108740 5.f e45/37 5:f6e11a8e:::benchmark_data_smithi052_19421_object108739:head v 45'6863, mlcod=45'6861)", 2024-04-26T10:22:23.192 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:23.167262+0000", 2024-04-26T10:22:23.192 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0070191689999999996, 2024-04-26T10:22:23.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007259761, 2024-04-26T10:22:23.192 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.192 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:23.192 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.167262+0000", 2024-04-26T10:22:23.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.167262+0000", 2024-04-26T10:22:23.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.167262+0000", 2024-04-26T10:22:23.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.169392+0000", 2024-04-26T10:22:23.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021299959999999999 2024-04-26T10:22:23.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.169400+0000", 2024-04-26T10:22:23.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9710000000000004e-06 2024-04-26T10:22:23.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.169405+0000", 2024-04-26T10:22:23.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1109999999999999e-06 2024-04-26T10:22:23.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.169450+0000", 2024-04-26T10:22:23.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5423000000000002e-05 2024-04-26T10:22:23.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.169472+0000", 2024-04-26T10:22:23.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1642e-05 2024-04-26T10:22:23.195 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.195 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.195 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.195 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:108748 5.d e45/37 5:b851d25c:::benchmark_data_smithi052_19421_object108747:head v 45'6849, mlcod=45'6847)", 2024-04-26T10:22:23.195 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:23.170775+0000", 2024-04-26T10:22:23.195 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0035063220000000001, 2024-04-26T10:22:23.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003798142, 2024-04-26T10:22:23.196 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.196 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:23.196 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170775+0000", 2024-04-26T10:22:23.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170775+0000", 2024-04-26T10:22:23.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170774+0000", 2024-04-26T10:22:23.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170828+0000", 2024-04-26T10:22:23.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3729e-05 2024-04-26T10:22:23.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170837+0000", 2024-04-26T10:22:23.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.507e-06 2024-04-26T10:22:23.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170843+0000", 2024-04-26T10:22:23.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5139999999999998e-06 2024-04-26T10:22:23.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170890+0000", 2024-04-26T10:22:23.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6458000000000001e-05 2024-04-26T10:22:23.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170912+0000", 2024-04-26T10:22:23.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2595999999999998e-05 2024-04-26T10:22:23.199 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.199 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.199 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.199 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:108749 5.0 5.2fc24ad0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.199 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:23.170897+0000", 2024-04-26T10:22:23.199 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0033849359999999998, 2024-04-26T10:22:23.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0037326569999999999, 2024-04-26T10:22:23.199 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.199 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:23.199 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.199 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.199 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.200 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 108749 2024-04-26T10:22:23.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.200 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170897+0000", 2024-04-26T10:22:23.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170897+0000", 2024-04-26T10:22:23.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170895+0000", 2024-04-26T10:22:23.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:23.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170943+0000", 2024-04-26T10:22:23.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7719000000000002e-05 2024-04-26T10:22:23.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170960+0000", 2024-04-26T10:22:23.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6858e-05 2024-04-26T10:22:23.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170970+0000", 2024-04-26T10:22:23.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0458e-05 2024-04-26T10:22:23.202 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.202 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.202 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.202 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:108750 5.a 5:561c51de:::benchmark_data_smithi052_19421_object108749:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.202 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:23.170980+0000", 2024-04-26T10:22:23.202 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0033018879999999998, 2024-04-26T10:22:23.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0037083699999999999, 2024-04-26T10:22:23.202 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.202 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:23.202 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.203 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.203 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.203 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 108750 2024-04-26T10:22:23.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.203 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170980+0000", 2024-04-26T10:22:23.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170980+0000", 2024-04-26T10:22:23.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.170979+0000", 2024-04-26T10:22:23.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.171018+0000", 2024-04-26T10:22:23.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9174999999999997e-05 2024-04-26T10:22:23.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.171043+0000", 2024-04-26T10:22:23.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5392e-05 2024-04-26T10:22:23.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.171052+0000", 2024-04-26T10:22:23.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5120000000000008e-06 2024-04-26T10:22:23.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.171101+0000", 2024-04-26T10:22:23.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9085000000000002e-05 2024-04-26T10:22:23.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.171181+0000", 2024-04-26T10:22:23.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9853999999999998e-05 2024-04-26T10:22:23.206 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.206 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.206 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.206 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:108751 5.4 5:2ad30959:::benchmark_data_smithi052_19421_object108750:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.206 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:23.172307+0000", 2024-04-26T10:22:23.206 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0019742280000000002, 2024-04-26T10:22:23.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024459629999999998, 2024-04-26T10:22:23.206 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.206 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:23.206 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.206 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.206 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.207 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 108751 2024-04-26T10:22:23.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.207 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172307+0000", 2024-04-26T10:22:23.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172307+0000", 2024-04-26T10:22:23.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172306+0000", 2024-04-26T10:22:23.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:23.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172372+0000", 2024-04-26T10:22:23.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5888000000000003e-05 2024-04-26T10:22:23.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172388+0000", 2024-04-26T10:22:23.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6152999999999999e-05 2024-04-26T10:22:23.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172395+0000", 2024-04-26T10:22:23.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1040000000000001e-06 2024-04-26T10:22:23.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172449+0000", 2024-04-26T10:22:23.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4196000000000001e-05 2024-04-26T10:22:23.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172624+0000", 2024-04-26T10:22:23.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174926 2024-04-26T10:22:23.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:23.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172832+0000", 2024-04-26T10:22:23.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020782799999999999 2024-04-26T10:22:23.210 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.210 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.210 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.210 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:108752 5.a 5:5d3c95d7:::benchmark_data_smithi052_19421_object108751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.210 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:23.172409+0000", 2024-04-26T10:22:23.210 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0018721269999999999, 2024-04-26T10:22:23.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024143620000000002, 2024-04-26T10:22:23.210 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.210 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:23.211 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.211 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.211 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.211 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 108752 2024-04-26T10:22:23.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.211 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172409+0000", 2024-04-26T10:22:23.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172409+0000", 2024-04-26T10:22:23.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172409+0000", 2024-04-26T10:22:23.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172447+0000", 2024-04-26T10:22:23.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8343000000000002e-05 2024-04-26T10:22:23.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172459+0000", 2024-04-26T10:22:23.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1813e-05 2024-04-26T10:22:23.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172465+0000", 2024-04-26T10:22:23.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7780000000000004e-06 2024-04-26T10:22:23.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.173223+0000", 2024-04-26T10:22:23.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00075863000000000005 2024-04-26T10:22:23.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.173371+0000", 2024-04-26T10:22:23.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014773400000000001 2024-04-26T10:22:23.214 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.214 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.214 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.214 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:108754 5.0 5.2cc312b0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.214 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:23.172772+0000", 2024-04-26T10:22:23.214 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.001509633, 2024-04-26T10:22:23.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021106480000000001, 2024-04-26T10:22:23.214 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.214 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:23.214 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.214 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.214 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.215 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 108754 2024-04-26T10:22:23.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.215 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172772+0000", 2024-04-26T10:22:23.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172772+0000", 2024-04-26T10:22:23.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172771+0000", 2024-04-26T10:22:23.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172840+0000", 2024-04-26T10:22:23.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9496e-05 2024-04-26T10:22:23.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172850+0000", 2024-04-26T10:22:23.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4579999999999999e-06 2024-04-26T10:22:23.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.172856+0000", 2024-04-26T10:22:23.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.088e-06 2024-04-26T10:22:23.217 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.217 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.217 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.217 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:108755 5.0 5.bf844c80 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.217 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:23.173661+0000", 2024-04-26T10:22:23.217 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00062050699999999996, 2024-04-26T10:22:23.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001267231, 2024-04-26T10:22:23.218 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.218 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:23.218 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.218 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.218 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.218 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 108755 2024-04-26T10:22:23.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.218 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.173661+0000", 2024-04-26T10:22:23.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.173661+0000", 2024-04-26T10:22:23.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.173660+0000", 2024-04-26T10:22:23.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.173730+0000", 2024-04-26T10:22:23.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9911000000000002e-05 2024-04-26T10:22:23.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.173744+0000", 2024-04-26T10:22:23.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4676e-05 2024-04-26T10:22:23.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.173752+0000", 2024-04-26T10:22:23.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7649999999999993e-06 2024-04-26T10:22:23.220 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.220 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.220 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.220 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:108756 5.e 5:7a3d1e9c:::benchmark_data_smithi052_19421_object108755:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.220 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:23.174279+0000", 2024-04-26T10:22:23.221 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 2.464e-06, 2024-04-26T10:22:23.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00069899800000000005, 2024-04-26T10:22:23.221 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.221 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:23.221 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.221 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.221 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.221 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 108756 2024-04-26T10:22:23.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.221 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.174279+0000", 2024-04-26T10:22:23.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.174279+0000", 2024-04-26T10:22:23.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.174278+0000", 2024-04-26T10:22:23.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.174355+0000", 2024-04-26T10:22:23.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6648000000000002e-05 2024-04-26T10:22:23.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.174364+0000", 2024-04-26T10:22:23.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8009999999999993e-06 2024-04-26T10:22:23.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.174370+0000", 2024-04-26T10:22:23.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2539999999999998e-06 2024-04-26T10:22:23.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.174449+0000", 2024-04-26T10:22:23.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9139000000000002e-05 2024-04-26T10:22:23.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:23.174620+0000", 2024-04-26T10:22:23.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017074200000000001 2024-04-26T10:22:23.224 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.224 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.224 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.224 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.224 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:23.224 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 13 2024-04-26T10:22:23.224 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:23.225 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:23.253 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:23.248+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:23.353 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:23.347+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:23.354 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:23.354 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:23.354 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:23.354 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:23.354 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:23.368 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:23.454 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:23.447+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:23.540 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.007916517000002, 2024-04-26T10:22:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.541 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:23.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.005934289999999, 2024-04-26T10:22:23.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:23.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.551 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.005734906000001, 2024-04-26T10:22:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.552 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:23.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.556 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.005516285999999, 2024-04-26T10:22:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:23.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.003144848000002, 2024-04-26T10:22:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.561 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:23.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:23.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:23.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:23.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:23.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:23.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:23.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:23.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:23.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:23.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:23.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:23.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:23.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:23.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:23.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:23.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:23.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:23.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:23.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:23.566 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.566 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.566 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.566 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:23.566 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:23.566 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.003044226, 2024-04-26T10:22:23.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:23.567 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.567 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.567 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.567 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.567 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.567 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:23.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.567 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:23.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:23.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:23.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:23.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:23.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:23.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:23.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:23.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:23.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:23.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:23.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:23.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:23.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:23.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:23.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:23.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:23.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:23.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:23.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:23.571 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.571 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.571 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.571 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:23.572 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:23.572 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.002925664999999, 2024-04-26T10:22:23.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:23.572 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.572 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.572 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:23.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:23.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:23.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:23.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:23.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:23.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:23.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:23.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:23.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:23.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:23.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:23.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:23.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:23.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:23.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:23.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:23.575 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.576 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.576 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.576 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:23.576 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:23.576 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.002823267, 2024-04-26T10:22:23.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:23.576 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.576 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.576 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.576 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.576 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.576 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:23.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.577 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:23.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:23.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:23.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:23.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:23.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:23.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:23.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:23.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:23.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:23.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:23.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:23.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:23.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:23.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:23.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:23.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:23.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:23.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:23.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:23.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:23.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.581 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.581 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.581 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65294 5.e 5:7438ad6f:::benchmark_data_smithi052_19421_object65293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:23.581 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:23.581 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.002143149999998, 2024-04-26T10:22:23.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091965517999999996, 2024-04-26T10:22:23.581 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.581 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.581 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65294 2024-04-26T10:22:23.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.582 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:23.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:23.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536413+0000", 2024-04-26T10:22:23.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536470+0000", 2024-04-26T10:22:23.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6443999999999997e-05 2024-04-26T10:22:23.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536480+0000", 2024-04-26T10:22:23.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0652999999999999e-05 2024-04-26T10:22:23.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536488+0000", 2024-04-26T10:22:23.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7929999999999998e-06 2024-04-26T10:22:23.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536548+0000", 2024-04-26T10:22:23.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9556999999999999e-05 2024-04-26T10:22:23.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536728+0000", 2024-04-26T10:22:23.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000180958 2024-04-26T10:22:23.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:23.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628168+0000", 2024-04-26T10:22:23.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091439276999999999 2024-04-26T10:22:23.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628258+0000", 2024-04-26T10:22:23.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0158e-05 2024-04-26T10:22:23.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628380+0000", 2024-04-26T10:22:23.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012180699999999999 2024-04-26T10:22:23.586 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.586 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.586 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.586 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:23.586 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:23.586 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.00180271, 2024-04-26T10:22:23.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:23.586 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.586 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.586 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.586 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.586 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.587 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:23.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.587 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:23.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:23.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:23.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:23.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:23.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:23.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:23.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:23.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:23.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:23.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:23.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:23.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:23.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:23.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:23.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:23.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:23.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:23.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:23.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:23.591 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.591 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.591 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.591 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:23.591 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:23.591 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.000652434999999, 2024-04-26T10:22:23.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:23.591 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.591 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.591 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.591 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.592 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.592 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:23.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.592 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:23.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:23.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:23.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:23.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:23.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:23.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:23.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:23.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:23.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:23.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:23.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:23.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:23.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:23.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:23.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:23.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:23.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:23.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:23.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:23.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:23.596 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.596 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.596 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.596 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65292 5.f e34/22 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head v 34'4129, mlcod=34'4125)", 2024-04-26T10:22:23.596 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:23.596 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.000478179000002, 2024-04-26T10:22:23.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093470155999999999, 2024-04-26T10:22:23.596 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.596 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.597 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:23.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:23.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538078+0000", 2024-04-26T10:22:23.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538140+0000", 2024-04-26T10:22:23.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1970000000000005e-05 2024-04-26T10:22:23.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538149+0000", 2024-04-26T10:22:23.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2189999999999993e-06 2024-04-26T10:22:23.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538158+0000", 2024-04-26T10:22:23.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0930000000000003e-06 2024-04-26T10:22:23.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627053+0000", 2024-04-26T10:22:23.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088895221999999996 2024-04-26T10:22:23.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627092+0000", 2024-04-26T10:22:23.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9657000000000003e-05 2024-04-26T10:22:23.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631499+0000", 2024-04-26T10:22:23.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044066560000000001 2024-04-26T10:22:23.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631549+0000", 2024-04-26T10:22:23.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0259000000000001e-05 2024-04-26T10:22:23.600 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.600 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.600 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.601 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65298 5.b 5:d51c4e52:::benchmark_data_smithi052_19421_object65297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:23.601 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:23.601 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.999711722000001, 2024-04-26T10:22:23.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091641671999999993, 2024-04-26T10:22:23.601 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.601 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.601 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.601 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.601 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.601 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65298 2024-04-26T10:22:23.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.601 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:23.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:23.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538844+0000", 2024-04-26T10:22:23.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:23.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538919+0000", 2024-04-26T10:22:23.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4626e-05 2024-04-26T10:22:23.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626007+0000", 2024-04-26T10:22:23.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087087516000000004 2024-04-26T10:22:23.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626074+0000", 2024-04-26T10:22:23.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7077999999999997e-05 2024-04-26T10:22:23.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626150+0000", 2024-04-26T10:22:23.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5982999999999994e-05 2024-04-26T10:22:23.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626341+0000", 2024-04-26T10:22:23.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019141199999999999 2024-04-26T10:22:23.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:23.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630359+0000", 2024-04-26T10:22:23.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040175710000000002 2024-04-26T10:22:23.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630412+0000", 2024-04-26T10:22:23.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3779000000000001e-05 2024-04-26T10:22:23.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630487+0000", 2024-04-26T10:22:23.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4913999999999995e-05 2024-04-26T10:22:23.605 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.605 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.605 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.606 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:81355 5.8 5:14f6458e:::benchmark_data_smithi052_19421_object81354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:23.606 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:23.606 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.729274722, 2024-04-26T10:22:23.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.027247422, 2024-04-26T10:22:23.606 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.606 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.606 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.606 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.606 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.606 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 81355 2024-04-26T10:22:23.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.606 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:23.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809283+0000", 2024-04-26T10:22:23.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809281+0000", 2024-04-26T10:22:23.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:23.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809337+0000", 2024-04-26T10:22:23.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5627999999999997e-05 2024-04-26T10:22:23.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809349+0000", 2024-04-26T10:22:23.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1554e-05 2024-04-26T10:22:23.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.809355+0000", 2024-04-26T10:22:23.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2559999999999999e-06 2024-04-26T10:22:23.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.823233+0000", 2024-04-26T10:22:23.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013877647999999999 2024-04-26T10:22:23.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.823361+0000", 2024-04-26T10:22:23.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012813500000000001 2024-04-26T10:22:23.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:23.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836404+0000", 2024-04-26T10:22:23.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013043592999999999 2024-04-26T10:22:23.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836468+0000", 2024-04-26T10:22:23.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3734999999999999e-05 2024-04-26T10:22:23.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:09.836530+0000", 2024-04-26T10:22:23.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2065999999999998e-05 2024-04-26T10:22:23.610 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.610 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.610 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.610 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83591 5.4 5:204a1b6d:::benchmark_data_smithi052_19421_object83590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:23.611 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:23.611 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.690843487, 2024-04-26T10:22:23.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.047988034999999998, 2024-04-26T10:22:23.611 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.611 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.611 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.611 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.611 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.611 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83591 2024-04-26T10:22:23.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.611 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:23.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:23.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847713+0000", 2024-04-26T10:22:23.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847784+0000", 2024-04-26T10:22:23.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0723999999999996e-05 2024-04-26T10:22:23.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847795+0000", 2024-04-26T10:22:23.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1538e-05 2024-04-26T10:22:23.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847810+0000", 2024-04-26T10:22:23.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4354e-05 2024-04-26T10:22:23.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847850+0000", 2024-04-26T10:22:23.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0750000000000001e-05 2024-04-26T10:22:23.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847974+0000", 2024-04-26T10:22:23.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012394899999999999 2024-04-26T10:22:23.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:23.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.848089+0000", 2024-04-26T10:22:23.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114527 2024-04-26T10:22:23.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:23.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852900+0000", 2024-04-26T10:22:23.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048110779999999999 2024-04-26T10:22:23.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:23.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895562+0000", 2024-04-26T10:22:23.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042662053999999998 2024-04-26T10:22:23.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895622+0000", 2024-04-26T10:22:23.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0470000000000002e-05 2024-04-26T10:22:23.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895702+0000", 2024-04-26T10:22:23.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9541000000000003e-05 2024-04-26T10:22:23.616 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.616 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.616 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.616 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83593 5.0 5:044bb3ac:::benchmark_data_smithi052_19421_object83592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:23.616 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:23.616 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.688956634, 2024-04-26T10:22:23.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.046164161000000002, 2024-04-26T10:22:23.616 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.617 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.617 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.617 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.617 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.617 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83593 2024-04-26T10:22:23.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.617 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:23.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:23.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849600+0000", 2024-04-26T10:22:23.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849655+0000", 2024-04-26T10:22:23.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5148999999999997e-05 2024-04-26T10:22:23.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849666+0000", 2024-04-26T10:22:23.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1494999999999999e-05 2024-04-26T10:22:23.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849677+0000", 2024-04-26T10:22:23.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0985000000000001e-05 2024-04-26T10:22:23.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849716+0000", 2024-04-26T10:22:23.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8698000000000001e-05 2024-04-26T10:22:23.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849822+0000", 2024-04-26T10:22:23.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000106173 2024-04-26T10:22:23.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:23.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849938+0000", 2024-04-26T10:22:23.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115738 2024-04-26T10:22:23.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:23.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853416+0000", 2024-04-26T10:22:23.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034777440000000001 2024-04-26T10:22:23.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:23.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895540+0000", 2024-04-26T10:22:23.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042124704999999998 2024-04-26T10:22:23.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895619+0000", 2024-04-26T10:22:23.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8697999999999998e-05 2024-04-26T10:22:23.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895765+0000", 2024-04-26T10:22:23.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014579299999999999 2024-04-26T10:22:23.622 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.622 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.622 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.622 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83594 5.b 5:d024b819:::benchmark_data_smithi052_19421_object83593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:23.622 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:23.622 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.688864396, 2024-04-26T10:22:23.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045938635999999998, 2024-04-26T10:22:23.622 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.623 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.623 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.623 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.623 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.623 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83594 2024-04-26T10:22:23.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.623 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:23.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:23.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849692+0000", 2024-04-26T10:22:23.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849730+0000", 2024-04-26T10:22:23.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7415e-05 2024-04-26T10:22:23.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849735+0000", 2024-04-26T10:22:23.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6350000000000003e-06 2024-04-26T10:22:23.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849740+0000", 2024-04-26T10:22:23.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4209999999999997e-06 2024-04-26T10:22:23.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849787+0000", 2024-04-26T10:22:23.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7166000000000002e-05 2024-04-26T10:22:23.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849915+0000", 2024-04-26T10:22:23.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012823700000000001 2024-04-26T10:22:23.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:23.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850038+0000", 2024-04-26T10:22:23.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012317 2024-04-26T10:22:23.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:23.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855812+0000", 2024-04-26T10:22:23.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057731340000000001 2024-04-26T10:22:23.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:23.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895504+0000", 2024-04-26T10:22:23.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.039692540999999998 2024-04-26T10:22:23.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895569+0000", 2024-04-26T10:22:23.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4443999999999995e-05 2024-04-26T10:22:23.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895632+0000", 2024-04-26T10:22:23.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3109999999999997e-05 2024-04-26T10:22:23.628 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.628 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.628 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.628 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83596 5.b 5:d54e48a0:::benchmark_data_smithi052_19421_object83595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:23.628 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:23.628 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.688044314999999, 2024-04-26T10:22:23.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.053210201999999998, 2024-04-26T10:22:23.628 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.628 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.628 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.629 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.629 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83596 2024-04-26T10:22:23.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.629 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:23.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:23.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850512+0000", 2024-04-26T10:22:23.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850622+0000", 2024-04-26T10:22:23.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010927 2024-04-26T10:22:23.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850629+0000", 2024-04-26T10:22:23.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1690000000000003e-06 2024-04-26T10:22:23.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850633+0000", 2024-04-26T10:22:23.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4800000000000003e-06 2024-04-26T10:22:23.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852134+0000", 2024-04-26T10:22:23.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015011099999999999 2024-04-26T10:22:23.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852446+0000", 2024-04-26T10:22:23.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031107999999999998 2024-04-26T10:22:23.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:23.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852723+0000", 2024-04-26T10:22:23.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027751499999999999 2024-04-26T10:22:23.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:23.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861229+0000", 2024-04-26T10:22:23.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085055960000000007 2024-04-26T10:22:23.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:23.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903523+0000", 2024-04-26T10:22:23.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042294683999999999 2024-04-26T10:22:23.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903579+0000", 2024-04-26T10:22:23.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5751999999999997e-05 2024-04-26T10:22:23.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903723+0000", 2024-04-26T10:22:23.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014414199999999999 2024-04-26T10:22:23.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.633 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.634 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83603 5.b 5:d4896044:::benchmark_data_smithi052_19421_object83602:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:23.634 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:23.634 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.685117428, 2024-04-26T10:22:23.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.053974093000000001, 2024-04-26T10:22:23.634 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.634 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.634 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83603 2024-04-26T10:22:23.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.634 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:23.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:23.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853439+0000", 2024-04-26T10:22:23.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853492+0000", 2024-04-26T10:22:23.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2265000000000002e-05 2024-04-26T10:22:23.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853504+0000", 2024-04-26T10:22:23.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2354999999999999e-05 2024-04-26T10:22:23.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853512+0000", 2024-04-26T10:22:23.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8630000000000008e-06 2024-04-26T10:22:23.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855839+0000", 2024-04-26T10:22:23.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002326776 2024-04-26T10:22:23.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855993+0000", 2024-04-26T10:22:23.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015428300000000001 2024-04-26T10:22:23.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:23.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.856138+0000", 2024-04-26T10:22:23.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000145427 2024-04-26T10:22:23.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:23.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861318+0000", 2024-04-26T10:22:23.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051795160000000003 2024-04-26T10:22:23.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:23.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907178+0000", 2024-04-26T10:22:23.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045859882999999997 2024-04-26T10:22:23.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907260+0000", 2024-04-26T10:22:23.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2133999999999997e-05 2024-04-26T10:22:23.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907414+0000", 2024-04-26T10:22:23.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015427400000000001 2024-04-26T10:22:23.639 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.639 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.639 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.639 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83605 5.4 5:2eb72b61:::benchmark_data_smithi052_19421_object83604:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:23.640 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:23.640 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.685037980000001, 2024-04-26T10:22:23.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045576089, 2024-04-26T10:22:23.640 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:23.640 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:23.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:23.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:23.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.640 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83605 2024-04-26T10:22:23.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.640 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:23.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:23.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:23.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:23.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:23.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:23.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:23.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853519+0000", 2024-04-26T10:22:23.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:23.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853557+0000", 2024-04-26T10:22:23.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8423000000000001e-05 2024-04-26T10:22:23.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:23.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853573+0000", 2024-04-26T10:22:23.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6201e-05 2024-04-26T10:22:23.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853583+0000", 2024-04-26T10:22:23.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9129999999999998e-06 2024-04-26T10:22:23.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:23.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853625+0000", 2024-04-26T10:22:23.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1965000000000002e-05 2024-04-26T10:22:23.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:23.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853795+0000", 2024-04-26T10:22:23.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000169946 2024-04-26T10:22:23.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:23.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853980+0000", 2024-04-26T10:22:23.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018517100000000001 2024-04-26T10:22:23.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:23.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861356+0000", 2024-04-26T10:22:23.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0073759389999999998 2024-04-26T10:22:23.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:23.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.898899+0000", 2024-04-26T10:22:23.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.037542786000000002 2024-04-26T10:22:23.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:23.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.898963+0000", 2024-04-26T10:22:23.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3652999999999995e-05 2024-04-26T10:22:23.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:23.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:23.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:23.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.899095+0000", 2024-04-26T10:22:23.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013286999999999999 2024-04-26T10:22:23.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.645 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:23.645 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:23.645 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:23.646 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 50 16 109690 109674 137.076 130.688 0.00433169 0.00728966 2024-04-26T10:22:23.647 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:23.639+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:23.647 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:23.750 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:23.743+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:23.778 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:109995 5.5 5:ad8b405e:::benchmark_data_smithi052_19421_object109994:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:23.768552+0000", 2024-04-26T10:22:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0082057759999999997, 2024-04-26T10:22:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082275149999999995, 2024-04-26T10:22:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 109995 2024-04-26T10:22:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.768552+0000", 2024-04-26T10:22:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.768552+0000", 2024-04-26T10:22:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.768552+0000", 2024-04-26T10:22:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.768592+0000", 2024-04-26T10:22:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0411000000000003e-05 2024-04-26T10:22:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.768600+0000", 2024-04-26T10:22:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.259e-06 2024-04-26T10:22:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.768606+0000", 2024-04-26T10:22:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0589999999999999e-06 2024-04-26T10:22:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.768646+0000", 2024-04-26T10:22:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9458000000000001e-05 2024-04-26T10:22:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.768893+0000", 2024-04-26T10:22:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024662000000000002 2024-04-26T10:22:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:109997 5.9 5:9c405544:::benchmark_data_smithi052_19421_object109996:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:23.770048+0000", 2024-04-26T10:22:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0067099689999999997, 2024-04-26T10:22:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068042700000000003, 2024-04-26T10:22:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 109997 2024-04-26T10:22:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770048+0000", 2024-04-26T10:22:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770048+0000", 2024-04-26T10:22:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770047+0000", 2024-04-26T10:22:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770081+0000", 2024-04-26T10:22:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3757999999999998e-05 2024-04-26T10:22:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770092+0000", 2024-04-26T10:22:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1141999999999999e-05 2024-04-26T10:22:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770100+0000", 2024-04-26T10:22:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9640000000000003e-06 2024-04-26T10:22:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770376+0000", 2024-04-26T10:22:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027647799999999998 2024-04-26T10:22:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770505+0000", 2024-04-26T10:22:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000128312 2024-04-26T10:22:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770640+0000", 2024-04-26T10:22:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013485999999999999 2024-04-26T10:22:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:109998 5.1 5:8be228d8:::benchmark_data_smithi052_19421_object109997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:23.770108+0000", 2024-04-26T10:22:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0066503380000000004, 2024-04-26T10:22:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068153060000000001, 2024-04-26T10:22:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 109998 2024-04-26T10:22:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770108+0000", 2024-04-26T10:22:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770108+0000", 2024-04-26T10:22:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770107+0000", 2024-04-26T10:22:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770138+0000", 2024-04-26T10:22:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0670999999999998e-05 2024-04-26T10:22:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770145+0000", 2024-04-26T10:22:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.559e-06 2024-04-26T10:22:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770151+0000", 2024-04-26T10:22:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5940000000000001e-06 2024-04-26T10:22:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770451+0000", 2024-04-26T10:22:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030024099999999997 2024-04-26T10:22:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770579+0000", 2024-04-26T10:22:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012764699999999999 2024-04-26T10:22:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110001 5.3 5:c40fa225:::benchmark_data_smithi052_19421_object110000:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:23.770649+0000", 2024-04-26T10:22:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.006109069, 2024-04-26T10:22:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063394439999999996, 2024-04-26T10:22:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110001 2024-04-26T10:22:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770649+0000", 2024-04-26T10:22:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770649+0000", 2024-04-26T10:22:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770648+0000", 2024-04-26T10:22:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770795+0000", 2024-04-26T10:22:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014658 2024-04-26T10:22:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770819+0000", 2024-04-26T10:22:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4689e-05 2024-04-26T10:22:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770846+0000", 2024-04-26T10:22:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6502000000000001e-05 2024-04-26T10:22:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770978+0000", 2024-04-26T10:22:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013245600000000001 2024-04-26T10:22:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.771102+0000", 2024-04-26T10:22:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123936 2024-04-26T10:22:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110003 5.9 5:98d428e5:::benchmark_data_smithi052_19421_object110002:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:23.770862+0000", 2024-04-26T10:22:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0058957230000000003, 2024-04-26T10:22:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006196086, 2024-04-26T10:22:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110003 2024-04-26T10:22:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770862+0000", 2024-04-26T10:22:23.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770862+0000", 2024-04-26T10:22:23.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770862+0000", 2024-04-26T10:22:23.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770898+0000", 2024-04-26T10:22:23.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6792000000000003e-05 2024-04-26T10:22:23.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770906+0000", 2024-04-26T10:22:23.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7780000000000007e-06 2024-04-26T10:22:23.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770913+0000", 2024-04-26T10:22:23.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8539999999999999e-06 2024-04-26T10:22:23.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.772665+0000", 2024-04-26T10:22:23.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017517660000000001 2024-04-26T10:22:23.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.772789+0000", 2024-04-26T10:22:23.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012459400000000001 2024-04-26T10:22:23.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:23.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.772952+0000", 2024-04-26T10:22:23.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000162332 2024-04-26T10:22:23.800 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.801 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.801 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110004 5.5 5:a1a2ba88:::benchmark_data_smithi052_19421_object110003:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.801 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:23.770919+0000", 2024-04-26T10:22:23.802 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0058390500000000001, 2024-04-26T10:22:23.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062107409999999997, 2024-04-26T10:22:23.802 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.802 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:23.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.803 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110004 2024-04-26T10:22:23.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.803 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770919+0000", 2024-04-26T10:22:23.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770919+0000", 2024-04-26T10:22:23.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770919+0000", 2024-04-26T10:22:23.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770947+0000", 2024-04-26T10:22:23.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7974999999999999e-05 2024-04-26T10:22:23.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770954+0000", 2024-04-26T10:22:23.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2479999999999999e-06 2024-04-26T10:22:23.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.770959+0000", 2024-04-26T10:22:23.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5310000000000001e-06 2024-04-26T10:22:23.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.772371+0000", 2024-04-26T10:22:23.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014114869999999999 2024-04-26T10:22:23.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.772508+0000", 2024-04-26T10:22:23.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013671199999999999 2024-04-26T10:22:23.809 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.810 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.810 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.810 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110005 5.d 5:b99287a9:::benchmark_data_smithi052_19421_object110004:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.810 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:23.771207+0000", 2024-04-26T10:22:23.811 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0055511919999999999, 2024-04-26T10:22:23.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059696569999999997, 2024-04-26T10:22:23.811 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.811 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:23.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.811 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.812 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.812 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110005 2024-04-26T10:22:23.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.812 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.771207+0000", 2024-04-26T10:22:23.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.771207+0000", 2024-04-26T10:22:23.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.771206+0000", 2024-04-26T10:22:23.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.771272+0000", 2024-04-26T10:22:23.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5576999999999999e-05 2024-04-26T10:22:23.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.771282+0000", 2024-04-26T10:22:23.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0251999999999999e-05 2024-04-26T10:22:23.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.771288+0000", 2024-04-26T10:22:23.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6030000000000001e-06 2024-04-26T10:22:23.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.772360+0000", 2024-04-26T10:22:23.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001071914 2024-04-26T10:22:23.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774266+0000", 2024-04-26T10:22:23.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019059540000000001 2024-04-26T10:22:23.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:23.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774409+0000", 2024-04-26T10:22:23.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000143151 2024-04-26T10:22:23.819 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.819 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.820 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110006 5.2 5:4ef33535:::benchmark_data_smithi052_19421_object110005:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.820 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:23.771365+0000", 2024-04-26T10:22:23.820 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0053931450000000002, 2024-04-26T10:22:23.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058749320000000002, 2024-04-26T10:22:23.821 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.821 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:23.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.821 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.822 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110006 2024-04-26T10:22:23.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.822 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.771365+0000", 2024-04-26T10:22:23.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.771365+0000", 2024-04-26T10:22:23.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.771364+0000", 2024-04-26T10:22:23.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.771442+0000", 2024-04-26T10:22:23.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7310000000000004e-05 2024-04-26T10:22:23.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.771451+0000", 2024-04-26T10:22:23.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1260000000000004e-06 2024-04-26T10:22:23.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.771457+0000", 2024-04-26T10:22:23.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3219999999999998e-06 2024-04-26T10:22:23.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.772394+0000", 2024-04-26T10:22:23.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00093749100000000004 2024-04-26T10:22:23.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.772527+0000", 2024-04-26T10:22:23.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013232200000000001 2024-04-26T10:22:23.827 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.827 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.828 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.828 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110002 5.0 e45/37 5:00277f8c:::benchmark_data_smithi052_19421_object110001:head v 45'6871, mlcod=45'6869)", 2024-04-26T10:22:23.828 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:23.774309+0000", 2024-04-26T10:22:23.828 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0024491500000000002, 2024-04-26T10:22:23.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029944189999999999, 2024-04-26T10:22:23.828 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.828 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:23.828 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774309+0000", 2024-04-26T10:22:23.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774309+0000", 2024-04-26T10:22:23.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774309+0000", 2024-04-26T10:22:23.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774342+0000", 2024-04-26T10:22:23.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.29e-05 2024-04-26T10:22:23.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774354+0000", 2024-04-26T10:22:23.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2745000000000001e-05 2024-04-26T10:22:23.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774360+0000", 2024-04-26T10:22:23.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5230000000000003e-06 2024-04-26T10:22:23.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774403+0000", 2024-04-26T10:22:23.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3367e-05 2024-04-26T10:22:23.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774436+0000", 2024-04-26T10:22:23.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2403000000000001e-05 2024-04-26T10:22:23.831 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.831 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.832 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.832 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110007 5.5 5:a8d4e674:::benchmark_data_smithi052_19421_object110006:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.832 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:23.774743+0000", 2024-04-26T10:22:23.832 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002015598, 2024-04-26T10:22:23.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026038290000000002, 2024-04-26T10:22:23.832 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.832 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:23.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.832 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.832 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110007 2024-04-26T10:22:23.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.833 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774743+0000", 2024-04-26T10:22:23.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774743+0000", 2024-04-26T10:22:23.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774741+0000", 2024-04-26T10:22:23.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:23.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774812+0000", 2024-04-26T10:22:23.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0802000000000004e-05 2024-04-26T10:22:23.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774827+0000", 2024-04-26T10:22:23.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4979e-05 2024-04-26T10:22:23.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774835+0000", 2024-04-26T10:22:23.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9049999999999997e-06 2024-04-26T10:22:23.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.775037+0000", 2024-04-26T10:22:23.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000202306 2024-04-26T10:22:23.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.775121+0000", 2024-04-26T10:22:23.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3766999999999999e-05 2024-04-26T10:22:23.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.836 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.836 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.836 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110008 5.2 5:437f4468:::benchmark_data_smithi052_19421_object110007:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.836 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:23.774843+0000", 2024-04-26T10:22:23.836 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0019150149999999999, 2024-04-26T10:22:23.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025373990000000001, 2024-04-26T10:22:23.837 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.837 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:23.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.837 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110008 2024-04-26T10:22:23.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.838 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774843+0000", 2024-04-26T10:22:23.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774843+0000", 2024-04-26T10:22:23.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774842+0000", 2024-04-26T10:22:23.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774883+0000", 2024-04-26T10:22:23.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0596999999999998e-05 2024-04-26T10:22:23.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774893+0000", 2024-04-26T10:22:23.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6520000000000001e-06 2024-04-26T10:22:23.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774899+0000", 2024-04-26T10:22:23.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.071e-06 2024-04-26T10:22:23.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.775188+0000", 2024-04-26T10:22:23.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000289332 2024-04-26T10:22:23.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.775302+0000", 2024-04-26T10:22:23.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114152 2024-04-26T10:22:23.843 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.844 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.844 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.844 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110009 5.3 5:c69b68b3:::benchmark_data_smithi052_19421_object110008:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.845 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:23.774921+0000", 2024-04-26T10:22:23.845 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0018372250000000001, 2024-04-26T10:22:23.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024926670000000001, 2024-04-26T10:22:23.845 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.845 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:23.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.845 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110009 2024-04-26T10:22:23.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.846 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774921+0000", 2024-04-26T10:22:23.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774921+0000", 2024-04-26T10:22:23.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774920+0000", 2024-04-26T10:22:23.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774971+0000", 2024-04-26T10:22:23.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0775000000000001e-05 2024-04-26T10:22:23.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774986+0000", 2024-04-26T10:22:23.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4552000000000001e-05 2024-04-26T10:22:23.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.774993+0000", 2024-04-26T10:22:23.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2370000000000003e-06 2024-04-26T10:22:23.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.775036+0000", 2024-04-26T10:22:23.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3495999999999998e-05 2024-04-26T10:22:23.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.775170+0000", 2024-04-26T10:22:23.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013333400000000001 2024-04-26T10:22:23.849 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.849 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.849 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.849 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110012 5.c 5:395ce547:::benchmark_data_smithi052_19421_object110011:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:23.849 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:23.776839+0000", 2024-04-26T10:22:23.849 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999194, 2024-04-26T10:22:23.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00060787799999999996, 2024-04-26T10:22:23.849 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.849 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:23.849 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:23.849 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:23.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:23.850 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110012 2024-04-26T10:22:23.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.850 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.776839+0000", 2024-04-26T10:22:23.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.776839+0000", 2024-04-26T10:22:23.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.776838+0000", 2024-04-26T10:22:23.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:23.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.776870+0000", 2024-04-26T10:22:23.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2533000000000002e-05 2024-04-26T10:22:23.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.776890+0000", 2024-04-26T10:22:23.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9338e-05 2024-04-26T10:22:23.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.776898+0000", 2024-04-26T10:22:23.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6119999999999999e-06 2024-04-26T10:22:23.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:23.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.776954+0000", 2024-04-26T10:22:23.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5364000000000001e-05 2024-04-26T10:22:23.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:23.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.777119+0000", 2024-04-26T10:22:23.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016546700000000001 2024-04-26T10:22:23.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.853 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.853 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110010 5.0 e45/37)", 2024-04-26T10:22:23.853 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:23.776969+0000", 2024-04-26T10:22:23.853 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9997892, 2024-04-26T10:22:23.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00050720699999999997, 2024-04-26T10:22:23.853 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:23.853 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:23.853 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:23.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:23.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.776969+0000", 2024-04-26T10:22:23.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:23.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.776969+0000", 2024-04-26T10:22:23.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:23.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:23.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.776968+0000", 2024-04-26T10:22:23.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:23.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:23.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.776999+0000", 2024-04-26T10:22:23.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0216e-05 2024-04-26T10:22:23.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:23.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.777004+0000", 2024-04-26T10:22:23.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6890000000000001e-06 2024-04-26T10:22:23.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:23.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:23.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:23.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:23.777008+0000", 2024-04-26T10:22:23.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1180000000000002e-06 2024-04-26T10:22:23.857 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.857 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:23.857 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.857 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:23.857 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:23.857 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 14 2024-04-26T10:22:23.857 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:23.858 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:22:23.860 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:23.861 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:23.856+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:23.960 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2024-04-26T10:22:23.966 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:23.956+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:23.998 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:23.999 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:23.999 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:23.999 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:23.999 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:24.012 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:24.087 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:22:24.116 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.583288952, 2024-04-26T10:22:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.57875374, 2024-04-26T10:22:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.578122447999998, 2024-04-26T10:22:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65604 5.9 5:9c239c32:::benchmark_data_smithi052_19421_object65603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.343019563999999, 2024-04-26T10:22:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.025897677000000001, 2024-04-26T10:22:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65604 2024-04-26T10:22:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769616+0000", 2024-04-26T10:22:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769615+0000", 2024-04-26T10:22:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769694+0000", 2024-04-26T10:22:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9087999999999999e-05 2024-04-26T10:22:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769702+0000", 2024-04-26T10:22:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8150000000000006e-06 2024-04-26T10:22:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.769709+0000", 2024-04-26T10:22:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0790000000000003e-06 2024-04-26T10:22:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772336+0000", 2024-04-26T10:22:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002626836 2024-04-26T10:22:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772470+0000", 2024-04-26T10:22:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013453299999999999 2024-04-26T10:22:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772605+0000", 2024-04-26T10:22:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013428499999999999 2024-04-26T10:22:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.779374+0000", 2024-04-26T10:22:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067694000000000001 2024-04-26T10:22:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795401+0000", 2024-04-26T10:22:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016026543000000001 2024-04-26T10:22:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795461+0000", 2024-04-26T10:22:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9923999999999998e-05 2024-04-26T10:22:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795513+0000", 2024-04-26T10:22:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2737e-05 2024-04-26T10:22:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65614 5.9 5:993a4fbe:::benchmark_data_smithi052_19421_object65613:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 23.340554327, 2024-04-26T10:22:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.023664145000000001, 2024-04-26T10:22:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65614 2024-04-26T10:22:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772081+0000", 2024-04-26T10:22:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772080+0000", 2024-04-26T10:22:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772117+0000", 2024-04-26T10:22:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6418000000000003e-05 2024-04-26T10:22:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772124+0000", 2024-04-26T10:22:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4730000000000003e-06 2024-04-26T10:22:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.772132+0000", 2024-04-26T10:22:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3900000000000004e-06 2024-04-26T10:22:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781379+0000", 2024-04-26T10:22:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092471059999999997 2024-04-26T10:22:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781495+0000", 2024-04-26T10:22:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001159 2024-04-26T10:22:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.781581+0000", 2024-04-26T10:22:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6087000000000004e-05 2024-04-26T10:22:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.785948+0000", 2024-04-26T10:22:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043671669999999999 2024-04-26T10:22:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795661+0000", 2024-04-26T10:22:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097130310000000004 2024-04-26T10:22:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795710+0000", 2024-04-26T10:22:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8959000000000003e-05 2024-04-26T10:22:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.795745+0000", 2024-04-26T10:22:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5172000000000001e-05 2024-04-26T10:22:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83591 5.4 e41/37 5:204a1b6d:::benchmark_data_smithi052_19421_object83590:head v 41'5271, mlcod=41'5268)", 2024-04-26T10:22:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.265647045, 2024-04-26T10:22:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.046802200000000002, 2024-04-26T10:22:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846988+0000", 2024-04-26T10:22:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846987+0000", 2024-04-26T10:22:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.846995+0000", 2024-04-26T10:22:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7549999999999994e-06 2024-04-26T10:22:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847004+0000", 2024-04-26T10:22:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3190000000000001e-06 2024-04-26T10:22:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847011+0000", 2024-04-26T10:22:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5039999999999999e-06 2024-04-26T10:22:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847048+0000", 2024-04-26T10:22:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7052999999999999e-05 2024-04-26T10:22:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.847066+0000", 2024-04-26T10:22:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8468999999999999e-05 2024-04-26T10:22:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893707+0000", 2024-04-26T10:22:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.046641123999999999 2024-04-26T10:22:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893790+0000", 2024-04-26T10:22:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2806999999999995e-05 2024-04-26T10:22:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83592 5.3 5:c96af6b1:::benchmark_data_smithi052_19421_object83591:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.264313901, 2024-04-26T10:22:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045543839000000003, 2024-04-26T10:22:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83592 2024-04-26T10:22:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848321+0000", 2024-04-26T10:22:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848320+0000", 2024-04-26T10:22:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848465+0000", 2024-04-26T10:22:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000145291 2024-04-26T10:22:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848475+0000", 2024-04-26T10:22:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6709999999999994e-06 2024-04-26T10:22:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848482+0000", 2024-04-26T10:22:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2910000000000002e-06 2024-04-26T10:22:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848532+0000", 2024-04-26T10:22:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9199000000000001e-05 2024-04-26T10:22:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848676+0000", 2024-04-26T10:22:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014493399999999999 2024-04-26T10:22:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893707+0000", 2024-04-26T10:22:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045030857000000001 2024-04-26T10:22:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893772+0000", 2024-04-26T10:22:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4203999999999997e-05 2024-04-26T10:22:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893865+0000", 2024-04-26T10:22:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3577000000000002e-05 2024-04-26T10:22:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83593 5.0 e41/37 5:044bb3ac:::benchmark_data_smithi052_19421_object83592:head v 41'5187, mlcod=41'5184)", 2024-04-26T10:22:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.263816483999999, 2024-04-26T10:22:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044951738999999998, 2024-04-26T10:22:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848819+0000", 2024-04-26T10:22:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848818+0000", 2024-04-26T10:22:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848824+0000", 2024-04-26T10:22:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5260000000000001e-06 2024-04-26T10:22:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848895+0000", 2024-04-26T10:22:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1468000000000001e-05 2024-04-26T10:22:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848902+0000", 2024-04-26T10:22:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6229999999999999e-06 2024-04-26T10:22:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848955+0000", 2024-04-26T10:22:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3106000000000003e-05 2024-04-26T10:22:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848974+0000", 2024-04-26T10:22:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9598000000000001e-05 2024-04-26T10:22:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893703+0000", 2024-04-26T10:22:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044728315999999997 2024-04-26T10:22:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893770+0000", 2024-04-26T10:22:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7683999999999998e-05 2024-04-26T10:22:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83594 5.b e41/37 5:d024b819:::benchmark_data_smithi052_19421_object83593:head v 41'5142, mlcod=41'5140)", 2024-04-26T10:22:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.263706474999999, 2024-04-26T10:22:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044760763000000002, 2024-04-26T10:22:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848929+0000", 2024-04-26T10:22:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848928+0000", 2024-04-26T10:22:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848933+0000", 2024-04-26T10:22:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848952+0000", 2024-04-26T10:22:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8884000000000001e-05 2024-04-26T10:22:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848957+0000", 2024-04-26T10:22:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8470000000000003e-06 2024-04-26T10:22:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848980+0000", 2024-04-26T10:22:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2946999999999999e-05 2024-04-26T10:22:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.848992+0000", 2024-04-26T10:22:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1882000000000001e-05 2024-04-26T10:22:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893623+0000", 2024-04-26T10:22:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044631381999999997 2024-04-26T10:22:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893689+0000", 2024-04-26T10:22:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6285999999999995e-05 2024-04-26T10:22:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83595 5.1 5:829f4097:::benchmark_data_smithi052_19421_object83594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.263617615999999, 2024-04-26T10:22:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048599369000000003, 2024-04-26T10:22:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83595 2024-04-26T10:22:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849018+0000", 2024-04-26T10:22:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849017+0000", 2024-04-26T10:22:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849041+0000", 2024-04-26T10:22:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4239999999999998e-05 2024-04-26T10:22:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849048+0000", 2024-04-26T10:22:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4669999999999998e-06 2024-04-26T10:22:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849053+0000", 2024-04-26T10:22:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3839999999999999e-06 2024-04-26T10:22:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849099+0000", 2024-04-26T10:22:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6579999999999998e-05 2024-04-26T10:22:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849246+0000", 2024-04-26T10:22:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014681899999999999 2024-04-26T10:22:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897498+0000", 2024-04-26T10:22:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048252002000000002 2024-04-26T10:22:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897544+0000", 2024-04-26T10:22:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5497999999999997e-05 2024-04-26T10:22:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897617+0000", 2024-04-26T10:22:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3143000000000001e-05 2024-04-26T10:22:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83597 5.d 5:b4b0a3ad:::benchmark_data_smithi052_19421_object83596:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.263352177, 2024-04-26T10:22:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.047933286999999998, 2024-04-26T10:22:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83597 2024-04-26T10:22:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849283+0000", 2024-04-26T10:22:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849282+0000", 2024-04-26T10:22:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849384+0000", 2024-04-26T10:22:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010128600000000001 2024-04-26T10:22:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849392+0000", 2024-04-26T10:22:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4290000000000001e-06 2024-04-26T10:22:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849398+0000", 2024-04-26T10:22:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8969999999999996e-06 2024-04-26T10:22:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849481+0000", 2024-04-26T10:22:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3088000000000001e-05 2024-04-26T10:22:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849639+0000", 2024-04-26T10:22:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015797200000000001 2024-04-26T10:22:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849782+0000", 2024-04-26T10:22:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014353599999999999 2024-04-26T10:22:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894335+0000", 2024-04-26T10:22:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044552500000000002 2024-04-26T10:22:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896955+0000", 2024-04-26T10:22:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002620229 2024-04-26T10:22:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897051+0000", 2024-04-26T10:22:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5847999999999994e-05 2024-04-26T10:22:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897216+0000", 2024-04-26T10:22:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016519700000000001 2024-04-26T10:22:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83598 5.7 5:e1984dee:::benchmark_data_smithi052_19421_object83597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.263226146999999, 2024-04-26T10:22:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.049315405999999999, 2024-04-26T10:22:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83598 2024-04-26T10:22:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849409+0000", 2024-04-26T10:22:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849408+0000", 2024-04-26T10:22:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849466+0000", 2024-04-26T10:22:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7302000000000001e-05 2024-04-26T10:22:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849473+0000", 2024-04-26T10:22:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4900000000000003e-06 2024-04-26T10:22:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849479+0000", 2024-04-26T10:22:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3539999999999999e-06 2024-04-26T10:22:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849526+0000", 2024-04-26T10:22:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7246999999999997e-05 2024-04-26T10:22:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.849677+0000", 2024-04-26T10:22:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000151218 2024-04-26T10:22:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898591+0000", 2024-04-26T10:22:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048914343999999998 2024-04-26T10:22:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898650+0000", 2024-04-26T10:22:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8288999999999997e-05 2024-04-26T10:22:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.898724+0000", 2024-04-26T10:22:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4782000000000003e-05 2024-04-26T10:22:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83599 5.3 5:c6d96bef:::benchmark_data_smithi052_19421_object83598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.261222666, 2024-04-26T10:22:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050758893999999999, 2024-04-26T10:22:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83599 2024-04-26T10:22:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851411+0000", 2024-04-26T10:22:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851465+0000", 2024-04-26T10:22:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3943999999999997e-05 2024-04-26T10:22:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851475+0000", 2024-04-26T10:22:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0220999999999999e-05 2024-04-26T10:22:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851482+0000", 2024-04-26T10:22:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3259999999999998e-06 2024-04-26T10:22:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851525+0000", 2024-04-26T10:22:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2255000000000001e-05 2024-04-26T10:22:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851617+0000", 2024-04-26T10:22:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2436999999999996e-05 2024-04-26T10:22:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902102+0000", 2024-04-26T10:22:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050485163 2024-04-26T10:22:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902130+0000", 2024-04-26T10:22:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8177000000000001e-05 2024-04-26T10:22:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902171+0000", 2024-04-26T10:22:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1091999999999999e-05 2024-04-26T10:22:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83596 5.b e41/37 5:d54e48a0:::benchmark_data_smithi052_19421_object83595:head v 41'5143, mlcod=41'5140)", 2024-04-26T10:22:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.261012336, 2024-04-26T10:22:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050472416999999999, 2024-04-26T10:22:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851623+0000", 2024-04-26T10:22:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851621+0000", 2024-04-26T10:22:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851628+0000", 2024-04-26T10:22:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1059999999999996e-06 2024-04-26T10:22:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851635+0000", 2024-04-26T10:22:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6009999999999997e-06 2024-04-26T10:22:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851646+0000", 2024-04-26T10:22:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1248e-05 2024-04-26T10:22:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851687+0000", 2024-04-26T10:22:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1004999999999998e-05 2024-04-26T10:22:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851706+0000", 2024-04-26T10:22:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8994000000000001e-05 2024-04-26T10:22:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902062+0000", 2024-04-26T10:22:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050355957999999999 2024-04-26T10:22:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902095+0000", 2024-04-26T10:22:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2882000000000001e-05 2024-04-26T10:22:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83601 5.d 5:b32b06d1:::benchmark_data_smithi052_19421_object83600:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.26070562, 2024-04-26T10:22:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045519045000000001, 2024-04-26T10:22:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83601 2024-04-26T10:22:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851930+0000", 2024-04-26T10:22:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851929+0000", 2024-04-26T10:22:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852104+0000", 2024-04-26T10:22:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175234 2024-04-26T10:22:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852110+0000", 2024-04-26T10:22:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.66e-06 2024-04-26T10:22:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852114+0000", 2024-04-26T10:22:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7809999999999999e-06 2024-04-26T10:22:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852153+0000", 2024-04-26T10:22:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9576000000000002e-05 2024-04-26T10:22:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852283+0000", 2024-04-26T10:22:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012946600000000001 2024-04-26T10:22:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852415+0000", 2024-04-26T10:22:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132719 2024-04-26T10:22:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894427+0000", 2024-04-26T10:22:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.042011497000000002 2024-04-26T10:22:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897231+0000", 2024-04-26T10:22:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002804239 2024-04-26T10:22:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897306+0000", 2024-04-26T10:22:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4771999999999995e-05 2024-04-26T10:22:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897449+0000", 2024-04-26T10:22:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000142707 2024-04-26T10:22:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83604 5.2 5:41ebe09c:::benchmark_data_smithi052_19421_object83603:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.260512632999999, 2024-04-26T10:22:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044923596000000003, 2024-04-26T10:22:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83604 2024-04-26T10:22:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852123+0000", 2024-04-26T10:22:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852122+0000", 2024-04-26T10:22:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852149+0000", 2024-04-26T10:22:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7596000000000001e-05 2024-04-26T10:22:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852154+0000", 2024-04-26T10:22:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0889999999999999e-06 2024-04-26T10:22:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852158+0000", 2024-04-26T10:22:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2830000000000002e-06 2024-04-26T10:22:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852194+0000", 2024-04-26T10:22:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6062000000000001e-05 2024-04-26T10:22:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852276+0000", 2024-04-26T10:22:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1891000000000006e-05 2024-04-26T10:22:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896782+0000", 2024-04-26T10:22:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044506271 2024-04-26T10:22:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.896875+0000", 2024-04-26T10:22:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3499999999999996e-05 2024-04-26T10:22:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897046+0000", 2024-04-26T10:22:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017065200000000001 2024-04-26T10:22:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83606 5.1 5:81602529:::benchmark_data_smithi052_19421_object83605:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.260194995999999, 2024-04-26T10:22:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.045300391000000002, 2024-04-26T10:22:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83606 2024-04-26T10:22:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852440+0000", 2024-04-26T10:22:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852439+0000", 2024-04-26T10:22:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852535+0000", 2024-04-26T10:22:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6025000000000003e-05 2024-04-26T10:22:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852545+0000", 2024-04-26T10:22:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3619999999999995e-06 2024-04-26T10:22:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852551+0000", 2024-04-26T10:22:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4500000000000001e-06 2024-04-26T10:22:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852588+0000", 2024-04-26T10:22:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6785000000000001e-05 2024-04-26T10:22:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852668+0000", 2024-04-26T10:22:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0008999999999999e-05 2024-04-26T10:22:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897625+0000", 2024-04-26T10:22:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044956744999999999 2024-04-26T10:22:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897667+0000", 2024-04-26T10:22:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1887000000000001e-05 2024-04-26T10:22:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897741+0000", 2024-04-26T10:22:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4023000000000006e-05 2024-04-26T10:22:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:83605 5.4 e41/37 5:2eb72b61:::benchmark_data_smithi052_19421_object83604:head v 41'5272, mlcod=41'5269)", 2024-04-26T10:22:24.210 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:24.210 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.259787668, 2024-04-26T10:22:24.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044651192999999999, 2024-04-26T10:22:24.210 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.210 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.210 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:24.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:24.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852847+0000", 2024-04-26T10:22:24.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:24.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852851+0000", 2024-04-26T10:22:24.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4560000000000002e-06 2024-04-26T10:22:24.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852859+0000", 2024-04-26T10:22:24.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2169999999999997e-06 2024-04-26T10:22:24.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852864+0000", 2024-04-26T10:22:24.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-04-26T10:22:24.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852899+0000", 2024-04-26T10:22:24.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4987000000000002e-05 2024-04-26T10:22:24.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.852916+0000", 2024-04-26T10:22:24.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7563000000000001e-05 2024-04-26T10:22:24.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897449+0000", 2024-04-26T10:22:24.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.044532644000000003 2024-04-26T10:22:24.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.897499+0000", 2024-04-26T10:22:24.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9734999999999997e-05 2024-04-26T10:22:24.214 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.214 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.214 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.214 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83607 5.6 5:66b4c91d:::benchmark_data_smithi052_19421_object83606:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:24.214 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:24.214 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.257657214, 2024-04-26T10:22:24.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.048173940999999998, 2024-04-26T10:22:24.214 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.214 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.214 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:24.214 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:24.215 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:24.215 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83607 2024-04-26T10:22:24.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.215 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:24.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854978+0000", 2024-04-26T10:22:24.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.854976+0000", 2024-04-26T10:22:24.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:24.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.855030+0000", 2024-04-26T10:22:24.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3436000000000001e-05 2024-04-26T10:22:24.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.216 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.216 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893759+0000", 2024-04-26T10:22:24.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.038729302 2024-04-26T10:22:24.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893777+0000", 2024-04-26T10:22:24.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7343e-05 2024-04-26T10:22:24.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.893880+0000", 2024-04-26T10:22:24.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103285 2024-04-26T10:22:24.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.894161+0000", 2024-04-26T10:22:24.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000280704 2024-04-26T10:22:24.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:24.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902948+0000", 2024-04-26T10:22:24.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087876059999999999 2024-04-26T10:22:24.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.903028+0000", 2024-04-26T10:22:24.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9486000000000004e-05 2024-04-26T10:22:24.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.903152+0000", 2024-04-26T10:22:24.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012426599999999999 2024-04-26T10:22:24.219 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.219 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.219 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.219 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:99120 5.3 5:cec65b6a:::benchmark_data_smithi052_19421_object99119:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-26T10:22:24.219 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:18.504626+0000", 2024-04-26T10:22:24.219 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.6080093150000003, 2024-04-26T10:22:24.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024740605999999998, 2024-04-26T10:22:24.220 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:24.220 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:24.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:24.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:24.220 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:24.220 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 99120 2024-04-26T10:22:24.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.220 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:24.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:24.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504626+0000", 2024-04-26T10:22:24.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:24.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504626+0000", 2024-04-26T10:22:24.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:24.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:24.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504625+0000", 2024-04-26T10:22:24.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:24.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:24.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504705+0000", 2024-04-26T10:22:24.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9901000000000006e-05 2024-04-26T10:22:24.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:24.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504711+0000", 2024-04-26T10:22:24.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9170000000000003e-06 2024-04-26T10:22:24.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:24.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504715+0000", 2024-04-26T10:22:24.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7249999999999999e-06 2024-04-26T10:22:24.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:24.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504749+0000", 2024-04-26T10:22:24.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4635000000000003e-05 2024-04-26T10:22:24.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:24.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.504841+0000", 2024-04-26T10:22:24.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1166000000000001e-05 2024-04-26T10:22:24.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:24.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.529252+0000", 2024-04-26T10:22:24.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.024411651999999999 2024-04-26T10:22:24.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:24.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.529296+0000", 2024-04-26T10:22:24.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3343000000000002e-05 2024-04-26T10:22:24.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:24.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:24.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:24.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:18.529366+0000", 2024-04-26T10:22:24.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0780999999999999e-05 2024-04-26T10:22:24.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.224 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.224 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:24.224 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:24.225 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:24.226 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:24.219+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:24.227 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:24.227 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:24.060+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:24.228 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:24.251 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:24.252 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:24.252 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:24.252 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:24.256 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:24.257 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:24.326 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:24.319+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:24.355 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:24.355 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:24.365 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:24.427 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:24.424+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:24.493 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:24.493 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:24.505 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:24.528 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:24.524+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:24.618 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 51 16 111485 111469 136.588 112.188 0.00572471 0.00731554 2024-04-26T10:22:24.629 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:24.623+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:24.631 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:24.631 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:24.643 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:24.730 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:24.723+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:24.782 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:24.782 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:24.794 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:24.826 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T10:22:24.832 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:24.827+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:24.926 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:24.926 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:24.932 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:24.928+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:24.938 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:25.033 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:25.028+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:25.076 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:25.076 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:25.088 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:25.134 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:25.127+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:25.218 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:25.219 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:25.231 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:25.235 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:25.231+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:25.336 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:25.332+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:25.361 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:25.361 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:25.373 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:25.437 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:25.431+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:25.500 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:25.500 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:25.514 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:25.558 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:25.556+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:25.618 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 52 16 113497 113481 136.379 125.75 0.00406507 0.00732702 2024-04-26T10:22:25.639 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:25.635+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:25.649 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:25.649 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:25.663 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:25.740 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:25.736+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:25.790 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:25.790 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:25.804 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:25.840 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:25.835+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:25.925 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:25.925 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:25.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:25.941 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:25.935+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:26.042 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:26.035+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:26.073 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:26.073 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:26.085 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:26.143 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:26.139+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:26.210 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:26.210 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:26.223 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:26.258 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:22:26.271 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:26.267+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:26.345 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:26.339+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:26.399 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:26.399 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:26.411 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:26.413 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:26.431 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:26.433 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:26.433 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:26.434 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:26.437 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:26.437 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:26.446 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:26.439+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:26.547 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:26.543+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:26.550 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:26.550 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:26.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.551 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:115368 5.7 5:e7e7f02f:::benchmark_data_smithi052_19421_object115367:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:26.551 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:26.546270+0000", 2024-04-26T10:22:26.551 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0026272959999999999, 2024-04-26T10:22:26.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026481510000000001, 2024-04-26T10:22:26.551 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.551 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:26.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.551 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.551 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115368 2024-04-26T10:22:26.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.551 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546270+0000", 2024-04-26T10:22:26.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546270+0000", 2024-04-26T10:22:26.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546270+0000", 2024-04-26T10:22:26.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:26.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546298+0000", 2024-04-26T10:22:26.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8591000000000001e-05 2024-04-26T10:22:26.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546305+0000", 2024-04-26T10:22:26.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6969999999999996e-06 2024-04-26T10:22:26.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546314+0000", 2024-04-26T10:22:26.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2590000000000006e-06 2024-04-26T10:22:26.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546357+0000", 2024-04-26T10:22:26.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2463999999999999e-05 2024-04-26T10:22:26.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546495+0000", 2024-04-26T10:22:26.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000138515 2024-04-26T10:22:26.554 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.555 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.555 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.555 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:115371 5.f 5:f1ffbb92:::benchmark_data_smithi052_19421_object115370:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:26.555 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:26.547997+0000", 2024-04-26T10:22:26.555 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00090108899999999999, 2024-04-26T10:22:26.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00096526299999999995, 2024-04-26T10:22:26.555 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.555 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:26.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.555 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115371 2024-04-26T10:22:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.547997+0000", 2024-04-26T10:22:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.547997+0000", 2024-04-26T10:22:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.547996+0000", 2024-04-26T10:22:26.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:26.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548023+0000", 2024-04-26T10:22:26.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7583e-05 2024-04-26T10:22:26.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548034+0000", 2024-04-26T10:22:26.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0722e-05 2024-04-26T10:22:26.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548039+0000", 2024-04-26T10:22:26.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.339e-06 2024-04-26T10:22:26.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548087+0000", 2024-04-26T10:22:26.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7734000000000001e-05 2024-04-26T10:22:26.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548209+0000", 2024-04-26T10:22:26.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012174 2024-04-26T10:22:26.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:26.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548298+0000", 2024-04-26T10:22:26.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8789999999999995e-05 2024-04-26T10:22:26.559 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.559 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.559 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.559 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "pg_backfill(progress 5.0 e 46/46 lb 5:09097caa:::benchmark_data_smithi052_19421_object99924:head)", 2024-04-26T10:22:26.559 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:26.548149+0000", 2024-04-26T10:22:26.559 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00074908600000000004, 2024-04-26T10:22:26.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00085098900000000002, 2024-04-26T10:22:26.560 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.560 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:26.560 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548149+0000", 2024-04-26T10:22:26.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548149+0000", 2024-04-26T10:22:26.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548148+0000", 2024-04-26T10:22:26.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:26.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548157+0000", 2024-04-26T10:22:26.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6750000000000008e-06 2024-04-26T10:22:26.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548170+0000", 2024-04-26T10:22:26.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3066e-05 2024-04-26T10:22:26.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548178+0000", 2024-04-26T10:22:26.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.729e-06 2024-04-26T10:22:26.563 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.563 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.563 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.563 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:115357 5.f e46/37)", 2024-04-26T10:22:26.563 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:26.548202+0000", 2024-04-26T10:22:26.563 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00069547900000000004, 2024-04-26T10:22:26.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00082031300000000003, 2024-04-26T10:22:26.563 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.563 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:26.563 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548202+0000", 2024-04-26T10:22:26.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548202+0000", 2024-04-26T10:22:26.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548202+0000", 2024-04-26T10:22:26.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:26.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548205+0000", 2024-04-26T10:22:26.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2030000000000001e-06 2024-04-26T10:22:26.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548211+0000", 2024-04-26T10:22:26.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0390000000000001e-06 2024-04-26T10:22:26.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548217+0000", 2024-04-26T10:22:26.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7620000000000001e-06 2024-04-26T10:22:26.566 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.566 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.566 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.566 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:115359 5.f e46/37)", 2024-04-26T10:22:26.566 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:26.548221+0000", 2024-04-26T10:22:26.566 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00067659299999999996, 2024-04-26T10:22:26.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00082498999999999995, 2024-04-26T10:22:26.566 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.566 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:26.567 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548221+0000", 2024-04-26T10:22:26.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548221+0000", 2024-04-26T10:22:26.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548221+0000", 2024-04-26T10:22:26.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-04-26T10:22:26.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548223+0000", 2024-04-26T10:22:26.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1749999999999999e-06 2024-04-26T10:22:26.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548228+0000", 2024-04-26T10:22:26.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7419999999999997e-06 2024-04-26T10:22:26.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548231+0000", 2024-04-26T10:22:26.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.641e-06 2024-04-26T10:22:26.569 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.569 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.569 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.569 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:115361 5.4 e46/37 5:2ef0aa76:::benchmark_data_smithi052_19421_object115360:head v 46'7256, mlcod=46'7253)", 2024-04-26T10:22:26.569 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:26.548455+0000", 2024-04-26T10:22:26.569 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00044226999999999998, 2024-04-26T10:22:26.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00063261800000000005, 2024-04-26T10:22:26.569 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.569 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:26.570 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548455+0000", 2024-04-26T10:22:26.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548455+0000", 2024-04-26T10:22:26.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548455+0000", 2024-04-26T10:22:26.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:26.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548461+0000", 2024-04-26T10:22:26.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6879999999999996e-06 2024-04-26T10:22:26.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548468+0000", 2024-04-26T10:22:26.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8420000000000005e-06 2024-04-26T10:22:26.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548476+0000", 2024-04-26T10:22:26.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.712e-06 2024-04-26T10:22:26.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548517+0000", 2024-04-26T10:22:26.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0711999999999999e-05 2024-04-26T10:22:26.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.548561+0000", 2024-04-26T10:22:26.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4635000000000002e-05 2024-04-26T10:22:26.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.573 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.573 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:115357 5.f 5:fe6cb311:::benchmark_data_smithi052_19421_object115356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:26.573 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:26.542743+0000", 2024-04-26T10:22:26.573 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0061548729999999999, 2024-04-26T10:22:26.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064073849999999998, 2024-04-26T10:22:26.574 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.574 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:26.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.574 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115357 2024-04-26T10:22:26.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.574 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.542743+0000", 2024-04-26T10:22:26.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.542743+0000", 2024-04-26T10:22:26.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.542742+0000", 2024-04-26T10:22:26.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:26.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.542841+0000", 2024-04-26T10:22:26.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9190000000000004e-05 2024-04-26T10:22:26.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.542848+0000", 2024-04-26T10:22:26.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5060000000000001e-06 2024-04-26T10:22:26.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.542852+0000", 2024-04-26T10:22:26.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1819999999999999e-06 2024-04-26T10:22:26.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.542907+0000", 2024-04-26T10:22:26.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5056000000000003e-05 2024-04-26T10:22:26.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.543044+0000", 2024-04-26T10:22:26.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000137119 2024-04-26T10:22:26.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:26.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.543185+0000", 2024-04-26T10:22:26.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014057300000000001 2024-04-26T10:22:26.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546927+0000", 2024-04-26T10:22:26.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003742521 2024-04-26T10:22:26.578 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.578 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.578 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.578 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:115359 5.f 5:f346b847:::benchmark_data_smithi052_19421_object115358:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:26.578 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:26.542948+0000", 2024-04-26T10:22:26.578 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0059498540000000001, 2024-04-26T10:22:26.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062714880000000004, 2024-04-26T10:22:26.578 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.578 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:26.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.579 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115359 2024-04-26T10:22:26.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.579 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.542948+0000", 2024-04-26T10:22:26.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.542948+0000", 2024-04-26T10:22:26.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.542947+0000", 2024-04-26T10:22:26.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:26.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.542976+0000", 2024-04-26T10:22:26.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8297999999999999e-05 2024-04-26T10:22:26.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.542987+0000", 2024-04-26T10:22:26.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1763000000000001e-05 2024-04-26T10:22:26.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.542991+0000", 2024-04-26T10:22:26.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4079999999999998e-06 2024-04-26T10:22:26.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545069+0000", 2024-04-26T10:22:26.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020784129999999999 2024-04-26T10:22:26.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545192+0000", 2024-04-26T10:22:26.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012283300000000001 2024-04-26T10:22:26.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:26.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545293+0000", 2024-04-26T10:22:26.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101331 2024-04-26T10:22:26.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.582 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.583 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:115364 5.6 5:6278dfb2:::benchmark_data_smithi052_19421_object115363:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:26.583 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:26.545307+0000", 2024-04-26T10:22:26.583 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0035904470000000001, 2024-04-26T10:22:26.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039522949999999998, 2024-04-26T10:22:26.583 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.583 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.583 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.583 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115364 2024-04-26T10:22:26.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.584 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545307+0000", 2024-04-26T10:22:26.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545307+0000", 2024-04-26T10:22:26.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545306+0000", 2024-04-26T10:22:26.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:26.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545400+0000", 2024-04-26T10:22:26.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3527000000000001e-05 2024-04-26T10:22:26.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545410+0000", 2024-04-26T10:22:26.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7839999999999998e-06 2024-04-26T10:22:26.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545417+0000", 2024-04-26T10:22:26.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2660000000000004e-06 2024-04-26T10:22:26.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545481+0000", 2024-04-26T10:22:26.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4566999999999994e-05 2024-04-26T10:22:26.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545562+0000", 2024-04-26T10:22:26.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0808000000000003e-05 2024-04-26T10:22:26.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.549184+0000", 2024-04-26T10:22:26.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036217829999999999 2024-04-26T10:22:26.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.549239+0000", 2024-04-26T10:22:26.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5256000000000001e-05 2024-04-26T10:22:26.587 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.587 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.587 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.587 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:115360 5.4 e46/37 5:2974c444:::benchmark_data_smithi052_19421_object115359:head v 46'7255, mlcod=46'7253)", 2024-04-26T10:22:26.588 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:26.545465+0000", 2024-04-26T10:22:26.588 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0034331909999999999, 2024-04-26T10:22:26.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038376159999999999, 2024-04-26T10:22:26.588 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.588 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:26.588 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545465+0000", 2024-04-26T10:22:26.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545465+0000", 2024-04-26T10:22:26.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545464+0000", 2024-04-26T10:22:26.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:26.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545470+0000", 2024-04-26T10:22:26.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8850000000000004e-06 2024-04-26T10:22:26.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545478+0000", 2024-04-26T10:22:26.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1920000000000005e-06 2024-04-26T10:22:26.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545484+0000", 2024-04-26T10:22:26.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7599999999999999e-06 2024-04-26T10:22:26.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545535+0000", 2024-04-26T10:22:26.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1280999999999999e-05 2024-04-26T10:22:26.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545555+0000", 2024-04-26T10:22:26.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9721999999999999e-05 2024-04-26T10:22:26.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.591 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.591 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:115365 5.5 5:ae741de0:::benchmark_data_smithi052_19421_object115364:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:26.592 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:26.545431+0000", 2024-04-26T10:22:26.592 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003466621, 2024-04-26T10:22:26.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039036740000000002, 2024-04-26T10:22:26.592 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.592 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:26.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.592 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115365 2024-04-26T10:22:26.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.592 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545431+0000", 2024-04-26T10:22:26.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545431+0000", 2024-04-26T10:22:26.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.545430+0000", 2024-04-26T10:22:26.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:26.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546172+0000", 2024-04-26T10:22:26.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00074111100000000003 2024-04-26T10:22:26.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546186+0000", 2024-04-26T10:22:26.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4154e-05 2024-04-26T10:22:26.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546193+0000", 2024-04-26T10:22:26.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.199e-06 2024-04-26T10:22:26.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546248+0000", 2024-04-26T10:22:26.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5427000000000003e-05 2024-04-26T10:22:26.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546415+0000", 2024-04-26T10:22:26.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016639199999999999 2024-04-26T10:22:26.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.595 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.595 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.596 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:115366 5.d 5:b6f91189:::benchmark_data_smithi052_19421_object115365:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:26.596 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:26.546211+0000", 2024-04-26T10:22:26.596 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0026864150000000002, 2024-04-26T10:22:26.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031603109999999998, 2024-04-26T10:22:26.596 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.596 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:26.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.596 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.596 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 115366 2024-04-26T10:22:26.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.596 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546211+0000", 2024-04-26T10:22:26.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546211+0000", 2024-04-26T10:22:26.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546210+0000", 2024-04-26T10:22:26.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:26.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546243+0000", 2024-04-26T10:22:26.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2824000000000003e-05 2024-04-26T10:22:26.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546250+0000", 2024-04-26T10:22:26.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9859999999999997e-06 2024-04-26T10:22:26.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546262+0000", 2024-04-26T10:22:26.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1983e-05 2024-04-26T10:22:26.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546425+0000", 2024-04-26T10:22:26.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000162941 2024-04-26T10:22:26.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546547+0000", 2024-04-26T10:22:26.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012205 2024-04-26T10:22:26.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:26.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:26.546685+0000", 2024-04-26T10:22:26.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013779600000000001 2024-04-26T10:22:26.600 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.600 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.600 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.600 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.600 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:26.600 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 12 2024-04-26T10:22:26.600 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:26.601 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:26.618 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 53 16 115509 115493 136.178 125.75 0.0050253 0.00733765 2024-04-26T10:22:26.648 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:26.643+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:26.738 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:26.738 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:26.739 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:26.750 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:26.743+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:26.753 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:26.839 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:22:26.850 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:26.848+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:26.882 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:26.882 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.350458700000001, 2024-04-26T10:22:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:26.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:26.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:26.888 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.345923488, 2024-04-26T10:22:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:26.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:26.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.345292195999999, 2024-04-26T10:22:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:26.894 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:26.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:26.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:26.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.899 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.900 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83599 5.3 5:c6d96bef:::benchmark_data_smithi052_19421_object83598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:26.900 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:26.900 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.028392413999999, 2024-04-26T10:22:26.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050758893999999999, 2024-04-26T10:22:26.900 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.900 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.900 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83599 2024-04-26T10:22:26.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.900 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851411+0000", 2024-04-26T10:22:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:26.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851465+0000", 2024-04-26T10:22:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3943999999999997e-05 2024-04-26T10:22:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851475+0000", 2024-04-26T10:22:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0220999999999999e-05 2024-04-26T10:22:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851482+0000", 2024-04-26T10:22:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3259999999999998e-06 2024-04-26T10:22:26.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851525+0000", 2024-04-26T10:22:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2255000000000001e-05 2024-04-26T10:22:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851617+0000", 2024-04-26T10:22:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2436999999999996e-05 2024-04-26T10:22:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902102+0000", 2024-04-26T10:22:26.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050485163 2024-04-26T10:22:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902130+0000", 2024-04-26T10:22:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8177000000000001e-05 2024-04-26T10:22:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902171+0000", 2024-04-26T10:22:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1091999999999999e-05 2024-04-26T10:22:26.904 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110555 5.9 5:919989b3:::benchmark_data_smithi052_19421_object110554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8464949910000001, 2024-04-26T10:22:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129736717, 2024-04-26T10:22:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.905 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110555 2024-04-26T10:22:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033309+0000", 2024-04-26T10:22:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033393+0000", 2024-04-26T10:22:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3690999999999995e-05 2024-04-26T10:22:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033401+0000", 2024-04-26T10:22:26.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4319999999999999e-06 2024-04-26T10:22:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033406+0000", 2024-04-26T10:22:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2340000000000002e-06 2024-04-26T10:22:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033467+0000", 2024-04-26T10:22:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0915999999999997e-05 2024-04-26T10:22:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033550+0000", 2024-04-26T10:22:26.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3057000000000001e-05 2024-04-26T10:22:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033676+0000", 2024-04-26T10:22:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126162 2024-04-26T10:22:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037902+0000", 2024-04-26T10:22:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042255720000000004 2024-04-26T10:22:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162728+0000", 2024-04-26T10:22:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12482583799999999 2024-04-26T10:22:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162839+0000", 2024-04-26T10:22:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111222 2024-04-26T10:22:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163047+0000", 2024-04-26T10:22:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207686 2024-04-26T10:22:26.910 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110556 5.1 5:822c74bd:::benchmark_data_smithi052_19421_object110555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.846385884, 2024-04-26T10:22:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129274783, 2024-04-26T10:22:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.911 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110556 2024-04-26T10:22:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033418+0000", 2024-04-26T10:22:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033472+0000", 2024-04-26T10:22:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3780999999999999e-05 2024-04-26T10:22:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033478+0000", 2024-04-26T10:22:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6049999999999997e-06 2024-04-26T10:22:26.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033482+0000", 2024-04-26T10:22:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9110000000000001e-06 2024-04-26T10:22:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033509+0000", 2024-04-26T10:22:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6415e-05 2024-04-26T10:22:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033650+0000", 2024-04-26T10:22:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014088999999999999 2024-04-26T10:22:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161877+0000", 2024-04-26T10:22:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128227707 2024-04-26T10:22:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162541+0000", 2024-04-26T10:22:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000663863 2024-04-26T10:22:26.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162694+0000", 2024-04-26T10:22:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015245699999999999 2024-04-26T10:22:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110558 5.3 5:c73f56b6:::benchmark_data_smithi052_19421_object110557:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.846189249, 2024-04-26T10:22:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12864012999999999, 2024-04-26T10:22:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.916 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110558 2024-04-26T10:22:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:26.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033615+0000", 2024-04-26T10:22:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033717+0000", 2024-04-26T10:22:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102298 2024-04-26T10:22:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033725+0000", 2024-04-26T10:22:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0090000000000007e-06 2024-04-26T10:22:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033731+0000", 2024-04-26T10:22:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8919999999999997e-06 2024-04-26T10:22:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033769+0000", 2024-04-26T10:22:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7682999999999998e-05 2024-04-26T10:22:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033891+0000", 2024-04-26T10:22:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121718 2024-04-26T10:22:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161912+0000", 2024-04-26T10:22:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128021512 2024-04-26T10:22:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162043+0000", 2024-04-26T10:22:26.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130588 2024-04-26T10:22:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162256+0000", 2024-04-26T10:22:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021311499999999999 2024-04-26T10:22:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110557 5.b e45/37 5:d659544e:::benchmark_data_smithi052_19421_object110556:head v 45'6862, mlcod=45'6860)", 2024-04-26T10:22:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8452850160000001, 2024-04-26T10:22:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12783012499999999, 2024-04-26T10:22:26.921 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034519+0000", 2024-04-26T10:22:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034526+0000", 2024-04-26T10:22:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0380000000000002e-06 2024-04-26T10:22:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034539+0000", 2024-04-26T10:22:26.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.27e-05 2024-04-26T10:22:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034545+0000", 2024-04-26T10:22:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3369999999999996e-06 2024-04-26T10:22:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034606+0000", 2024-04-26T10:22:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0752999999999999e-05 2024-04-26T10:22:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034627+0000", 2024-04-26T10:22:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.088e-05 2024-04-26T10:22:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162272+0000", 2024-04-26T10:22:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12764540199999999 2024-04-26T10:22:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162350+0000", 2024-04-26T10:22:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7835000000000003e-05 2024-04-26T10:22:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110554 5.0 e45/37 5:04324c12:::benchmark_data_smithi052_19421_object110553:head v 45'6903, mlcod=45'6898)", 2024-04-26T10:22:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8435255939999999, 2024-04-26T10:22:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12566923499999999, 2024-04-26T10:22:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.927 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036278+0000", 2024-04-26T10:22:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036313+0000", 2024-04-26T10:22:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5247999999999999e-05 2024-04-26T10:22:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036324+0000", 2024-04-26T10:22:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0496000000000001e-05 2024-04-26T10:22:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036329+0000", 2024-04-26T10:22:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3070000000000002e-06 2024-04-26T10:22:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036364+0000", 2024-04-26T10:22:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4391000000000003e-05 2024-04-26T10:22:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036377+0000", 2024-04-26T10:22:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3706999999999999e-05 2024-04-26T10:22:26.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042032+0000", 2024-04-26T10:22:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056547120000000001 2024-04-26T10:22:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161949+0000", 2024-04-26T10:22:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119916482 2024-04-26T10:22:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110559 5.2 5:44c3f174:::benchmark_data_smithi052_19421_object110558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.841906984, 2024-04-26T10:22:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12530391299999999, 2024-04-26T10:22:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110559 2024-04-26T10:22:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037897+0000", 2024-04-26T10:22:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037922+0000", 2024-04-26T10:22:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5004e-05 2024-04-26T10:22:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037931+0000", 2024-04-26T10:22:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-04-26T10:22:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037937+0000", 2024-04-26T10:22:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6749999999999999e-06 2024-04-26T10:22:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037972+0000", 2024-04-26T10:22:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4678000000000002e-05 2024-04-26T10:22:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038108+0000", 2024-04-26T10:22:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013689099999999999 2024-04-26T10:22:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162887+0000", 2024-04-26T10:22:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124778258 2024-04-26T10:22:26.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163010+0000", 2024-04-26T10:22:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122924 2024-04-26T10:22:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163202+0000", 2024-04-26T10:22:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192203 2024-04-26T10:22:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.936 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110560 5.3 5:caf5a141:::benchmark_data_smithi052_19421_object110559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8418563830000001, 2024-04-26T10:22:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12888738299999999, 2024-04-26T10:22:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110560 2024-04-26T10:22:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037948+0000", 2024-04-26T10:22:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037973+0000", 2024-04-26T10:22:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5187000000000001e-05 2024-04-26T10:22:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037978+0000", 2024-04-26T10:22:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4120000000000003e-06 2024-04-26T10:22:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037981+0000", 2024-04-26T10:22:26.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6689999999999999e-06 2024-04-26T10:22:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038041+0000", 2024-04-26T10:22:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9324999999999999e-05 2024-04-26T10:22:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038179+0000", 2024-04-26T10:22:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013832499999999999 2024-04-26T10:22:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166427+0000", 2024-04-26T10:22:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128248165 2024-04-26T10:22:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166539+0000", 2024-04-26T10:22:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111538 2024-04-26T10:22:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166836+0000", 2024-04-26T10:22:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029714100000000001 2024-04-26T10:22:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.941 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110561 5.d 5:b143edec:::benchmark_data_smithi052_19421_object110560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8418143250000001, 2024-04-26T10:22:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.125215574, 2024-04-26T10:22:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.942 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110561 2024-04-26T10:22:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037990+0000", 2024-04-26T10:22:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038028+0000", 2024-04-26T10:22:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7802999999999997e-05 2024-04-26T10:22:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038035+0000", 2024-04-26T10:22:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-06 2024-04-26T10:22:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038040+0000", 2024-04-26T10:22:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.147e-06 2024-04-26T10:22:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038077+0000", 2024-04-26T10:22:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7166999999999998e-05 2024-04-26T10:22:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038192+0000", 2024-04-26T10:22:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115565 2024-04-26T10:22:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038319+0000", 2024-04-26T10:22:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012697699999999999 2024-04-26T10:22:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162690+0000", 2024-04-26T10:22:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12437065 2024-04-26T10:22:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162878+0000", 2024-04-26T10:22:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000188173 2024-04-26T10:22:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162992+0000", 2024-04-26T10:22:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114008 2024-04-26T10:22:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163206+0000", 2024-04-26T10:22:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021394900000000001 2024-04-26T10:22:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.947 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8417537209999999, 2024-04-26T10:22:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:22:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:22:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:22:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:22:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:22:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:22:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:22:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:22:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:22:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:22:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:22:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:22:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:22:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:22:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:22:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:22:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:22:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:22:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110564 5.3 5:c09e33cb:::benchmark_data_smithi052_19421_object110563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:26.952 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8417010629999999, 2024-04-26T10:22:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128984614, 2024-04-26T10:22:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110564 2024-04-26T10:22:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038103+0000", 2024-04-26T10:22:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038136+0000", 2024-04-26T10:22:26.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.243e-05 2024-04-26T10:22:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038143+0000", 2024-04-26T10:22:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0870000000000001e-06 2024-04-26T10:22:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038151+0000", 2024-04-26T10:22:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:22:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039813+0000", 2024-04-26T10:22:26.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001661844 2024-04-26T10:22:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039970+0000", 2024-04-26T10:22:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015712699999999999 2024-04-26T10:22:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166854+0000", 2024-04-26T10:22:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.126883788 2024-04-26T10:22:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166976+0000", 2024-04-26T10:22:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012231399999999999 2024-04-26T10:22:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167088+0000", 2024-04-26T10:22:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011243699999999999 2024-04-26T10:22:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:26.957 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8416444699999999, 2024-04-26T10:22:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:22:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:22:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:22:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:22:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:22:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:22:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:22:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:22:26.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:22:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:22:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:22:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:22:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:22:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:22:26.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:22:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:22:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:22:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:22:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110566 5.c 5:34145698:::benchmark_data_smithi052_19421_object110565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8415946930000002, 2024-04-26T10:22:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12673530699999999, 2024-04-26T10:22:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110566 2024-04-26T10:22:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:26.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038246+0000", 2024-04-26T10:22:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5759000000000001e-05 2024-04-26T10:22:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038252+0000", 2024-04-26T10:22:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5300000000000002e-06 2024-04-26T10:22:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038257+0000", 2024-04-26T10:22:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038312+0000", 2024-04-26T10:22:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5108000000000002e-05 2024-04-26T10:22:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038480+0000", 2024-04-26T10:22:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016751099999999999 2024-04-26T10:22:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164651+0000", 2024-04-26T10:22:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12617115600000001 2024-04-26T10:22:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164770+0000", 2024-04-26T10:22:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118748 2024-04-26T10:22:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164946+0000", 2024-04-26T10:22:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175966 2024-04-26T10:22:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.968 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8392470579999998, 2024-04-26T10:22:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:22:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:22:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:26.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:22:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:22:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:22:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:22:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:22:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:22:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:22:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:22:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:22:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:22:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:22:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:22:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:22:26.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:22:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:22:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:22:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:22:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:22:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:22:26.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:22:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:22:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110568 5.c 5:34af8ad3:::benchmark_data_smithi052_19421_object110567:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:26.974 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8391294330000001, 2024-04-26T10:22:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124943661, 2024-04-26T10:22:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110568 2024-04-26T10:22:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040711+0000", 2024-04-26T10:22:26.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6531e-05 2024-04-26T10:22:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040719+0000", 2024-04-26T10:22:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6120000000000001e-06 2024-04-26T10:22:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040724+0000", 2024-04-26T10:22:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2100000000000001e-06 2024-04-26T10:22:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040771+0000", 2024-04-26T10:22:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7123000000000003e-05 2024-04-26T10:22:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040984+0000", 2024-04-26T10:22:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021227400000000001 2024-04-26T10:22:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165350+0000", 2024-04-26T10:22:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124366738 2024-04-26T10:22:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165459+0000", 2024-04-26T10:22:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108168 2024-04-26T10:22:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165619+0000", 2024-04-26T10:22:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160564 2024-04-26T10:22:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.979 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.839061134, 2024-04-26T10:22:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:22:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:22:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:22:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:22:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:22:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:22:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:22:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:22:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:22:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:22:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:22:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:22:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:22:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:22:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:22:26.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:22:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:22:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:22:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:22:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:22:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:22:26.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:22:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:22:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110570 5.1 5:876a468c:::benchmark_data_smithi052_19421_object110569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.8377585889999999, 2024-04-26T10:22:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12851437099999999, 2024-04-26T10:22:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:26.985 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:26.986 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:26.986 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:26.986 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:26.986 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110570 2024-04-26T10:22:26.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.986 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:26.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:26.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:26.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042045+0000", 2024-04-26T10:22:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042083+0000", 2024-04-26T10:22:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8064e-05 2024-04-26T10:22:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161855+0000", 2024-04-26T10:22:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119771934 2024-04-26T10:22:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161882+0000", 2024-04-26T10:22:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7083000000000001e-05 2024-04-26T10:22:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163117+0000", 2024-04-26T10:22:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001234509 2024-04-26T10:22:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163507+0000", 2024-04-26T10:22:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038998400000000001 2024-04-26T10:22:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170347+0000", 2024-04-26T10:22:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006840952 2024-04-26T10:22:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170488+0000", 2024-04-26T10:22:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140393 2024-04-26T10:22:26.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170561+0000", 2024-04-26T10:22:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2809e-05 2024-04-26T10:22:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:26.990 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:26.990 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:26.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:26.992 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:26.988+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:27.092 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:27.087+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:27.123 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:27.123 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:27.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.124 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:116532 5.e 5:729efad3:::benchmark_data_smithi052_19421_object116531:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:27.124 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:27.122883+0000", 2024-04-26T10:22:27.124 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00051456600000000005, 2024-04-26T10:22:27.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00054071100000000003, 2024-04-26T10:22:27.124 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.124 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:27.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.125 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116532 2024-04-26T10:22:27.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.125 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.122883+0000", 2024-04-26T10:22:27.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.122883+0000", 2024-04-26T10:22:27.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.122882+0000", 2024-04-26T10:22:27.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:27.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.122946+0000", 2024-04-26T10:22:27.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4236e-05 2024-04-26T10:22:27.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.122954+0000", 2024-04-26T10:22:27.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.571e-06 2024-04-26T10:22:27.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.122960+0000", 2024-04-26T10:22:27.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9429999999999997e-06 2024-04-26T10:22:27.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.123006+0000", 2024-04-26T10:22:27.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6140999999999998e-05 2024-04-26T10:22:27.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.123100+0000", 2024-04-26T10:22:27.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3925999999999995e-05 2024-04-26T10:22:27.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.128 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.128 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:116533 5.0 5.5ffb1f70 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:27.129 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:27.122972+0000", 2024-04-26T10:22:27.129 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00042545499999999998, 2024-04-26T10:22:27.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00052344999999999996, 2024-04-26T10:22:27.129 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.129 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:27.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.129 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116533 2024-04-26T10:22:27.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.129 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.122972+0000", 2024-04-26T10:22:27.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.122972+0000", 2024-04-26T10:22:27.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.122972+0000", 2024-04-26T10:22:27.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:27.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.123056+0000", 2024-04-26T10:22:27.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4240999999999995e-05 2024-04-26T10:22:27.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.123066+0000", 2024-04-26T10:22:27.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:22:27.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.123074+0000", 2024-04-26T10:22:27.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3799999999999994e-06 2024-04-26T10:22:27.132 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.132 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.132 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.132 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:116523 5.b 5:d43ecd70:::benchmark_data_smithi052_19421_object116522:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:27.132 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:27.118759+0000", 2024-04-26T10:22:27.132 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0046385929999999999, 2024-04-26T10:22:27.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048026689999999999, 2024-04-26T10:22:27.132 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.132 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:27.132 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.132 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.133 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.133 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116523 2024-04-26T10:22:27.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.133 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.118759+0000", 2024-04-26T10:22:27.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.118759+0000", 2024-04-26T10:22:27.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.118758+0000", 2024-04-26T10:22:27.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:27.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.118812+0000", 2024-04-26T10:22:27.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4316e-05 2024-04-26T10:22:27.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.118827+0000", 2024-04-26T10:22:27.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4423999999999999e-05 2024-04-26T10:22:27.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.118837+0000", 2024-04-26T10:22:27.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0312999999999999e-05 2024-04-26T10:22:27.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.118891+0000", 2024-04-26T10:22:27.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4344e-05 2024-04-26T10:22:27.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.119055+0000", 2024-04-26T10:22:27.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000163416 2024-04-26T10:22:27.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:27.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.119307+0000", 2024-04-26T10:22:27.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025228400000000003 2024-04-26T10:22:27.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.121785+0000", 2024-04-26T10:22:27.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002478526 2024-04-26T10:22:27.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.136 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.137 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:116526 5.4 5:2f73b55c:::benchmark_data_smithi052_19421_object116525:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:27.137 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:27.119572+0000", 2024-04-26T10:22:27.137 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.003825822, 2024-04-26T10:22:27.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040692790000000003, 2024-04-26T10:22:27.137 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.137 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:27.137 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.137 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.138 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.138 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116526 2024-04-26T10:22:27.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.138 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.119572+0000", 2024-04-26T10:22:27.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.119572+0000", 2024-04-26T10:22:27.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.119571+0000", 2024-04-26T10:22:27.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:27.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.119678+0000", 2024-04-26T10:22:27.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010742 2024-04-26T10:22:27.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.119690+0000", 2024-04-26T10:22:27.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2319e-05 2024-04-26T10:22:27.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.119696+0000", 2024-04-26T10:22:27.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8279999999999999e-06 2024-04-26T10:22:27.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.119758+0000", 2024-04-26T10:22:27.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2107999999999996e-05 2024-04-26T10:22:27.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.119886+0000", 2024-04-26T10:22:27.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012762799999999999 2024-04-26T10:22:27.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:27.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.120018+0000", 2024-04-26T10:22:27.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013220199999999999 2024-04-26T10:22:27.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.122941+0000", 2024-04-26T10:22:27.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029226759999999999 2024-04-26T10:22:27.141 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.142 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.142 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.142 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:116528 5.0 5:019ede80:::benchmark_data_smithi052_19421_object116527:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:27.142 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:27.120323+0000", 2024-04-26T10:22:27.142 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0030741259999999999, 2024-04-26T10:22:27.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034071029999999999, 2024-04-26T10:22:27.142 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.142 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:27.142 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.142 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.143 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.143 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 116528 2024-04-26T10:22:27.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.143 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.120323+0000", 2024-04-26T10:22:27.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.120323+0000", 2024-04-26T10:22:27.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.120322+0000", 2024-04-26T10:22:27.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:27.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.120385+0000", 2024-04-26T10:22:27.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2767000000000004e-05 2024-04-26T10:22:27.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.120398+0000", 2024-04-26T10:22:27.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2892e-05 2024-04-26T10:22:27.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.120403+0000", 2024-04-26T10:22:27.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1839999999999998e-06 2024-04-26T10:22:27.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.120458+0000", 2024-04-26T10:22:27.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4546000000000003e-05 2024-04-26T10:22:27.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.120654+0000", 2024-04-26T10:22:27.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000195923 2024-04-26T10:22:27.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:27.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:27.120809+0000", 2024-04-26T10:22:27.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000154754 2024-04-26T10:22:27.146 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.146 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.146 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.146 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.146 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:27.147 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 5 2024-04-26T10:22:27.147 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:27.148 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:27.194 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:27.187+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:27.278 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:27.279 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:27.279 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:27.279 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:27.279 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:27.290 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:27.335 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:27.331+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:27.394 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:27.392+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:27.469 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:27.469 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:27.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:27.469 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:27.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.469 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:27.469 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:27.469 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 26.936703579, 2024-04-26T10:22:27.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:27.470 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.470 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.470 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.470 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.470 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.470 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:27.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.470 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:27.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:27.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:27.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:27.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:27.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:27.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:27.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:27.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:27.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:27.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:27.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:27.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:27.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:27.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:27.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:27.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:27.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:27.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:27.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:27.474 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.474 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.474 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.474 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:27.475 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:27.475 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 26.934721352, 2024-04-26T10:22:27.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:27.475 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.475 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.475 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.475 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.475 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.475 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:27.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.475 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:27.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:27.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:27.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:27.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:27.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:27.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:27.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:27.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:27.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:27.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:27.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:27.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:27.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:27.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:27.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:27.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:27.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:27.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:27.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:27.480 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.480 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.480 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.480 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:27.480 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:27.480 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 26.934521967999999, 2024-04-26T10:22:27.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:27.480 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.480 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.480 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.481 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.481 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.481 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:27.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.481 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:27.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:27.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:27.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:27.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:27.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:27.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:27.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:27.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:27.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:27.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:27.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:27.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:27.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:27.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:27.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:27.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:27.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:27.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:27.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:27.485 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.485 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.485 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.485 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:27.485 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:27.485 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 26.934303348, 2024-04-26T10:22:27.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:27.485 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.485 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.485 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:27.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:27.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:27.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 26.931931909999999, 2024-04-26T10:22:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:27.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:27.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:27.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.494 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 26.931831288000001, 2024-04-26T10:22:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.495 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:27.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 26.931712727000001, 2024-04-26T10:22:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.500 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:27.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:27.504 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 26.931610329000002, 2024-04-26T10:22:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:27.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.509 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65294 5.e 5:7438ad6f:::benchmark_data_smithi052_19421_object65293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 26.930930212, 2024-04-26T10:22:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091965517999999996, 2024-04-26T10:22:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65294 2024-04-26T10:22:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536413+0000", 2024-04-26T10:22:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536470+0000", 2024-04-26T10:22:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6443999999999997e-05 2024-04-26T10:22:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536480+0000", 2024-04-26T10:22:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0652999999999999e-05 2024-04-26T10:22:27.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536488+0000", 2024-04-26T10:22:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7929999999999998e-06 2024-04-26T10:22:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536548+0000", 2024-04-26T10:22:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9556999999999999e-05 2024-04-26T10:22:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536728+0000", 2024-04-26T10:22:27.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000180958 2024-04-26T10:22:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628168+0000", 2024-04-26T10:22:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091439276999999999 2024-04-26T10:22:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628258+0000", 2024-04-26T10:22:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0158e-05 2024-04-26T10:22:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628380+0000", 2024-04-26T10:22:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012180699999999999 2024-04-26T10:22:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 26.930589772000001, 2024-04-26T10:22:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.515 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:27.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:27.519 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 26.929439497000001, 2024-04-26T10:22:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.520 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:27.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:27.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:27.524 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65292 5.f e34/22 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head v 34'4129, mlcod=34'4125)", 2024-04-26T10:22:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 26.929265241, 2024-04-26T10:22:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093470155999999999, 2024-04-26T10:22:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538078+0000", 2024-04-26T10:22:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538140+0000", 2024-04-26T10:22:27.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1970000000000005e-05 2024-04-26T10:22:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538149+0000", 2024-04-26T10:22:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2189999999999993e-06 2024-04-26T10:22:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538158+0000", 2024-04-26T10:22:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0930000000000003e-06 2024-04-26T10:22:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627053+0000", 2024-04-26T10:22:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088895221999999996 2024-04-26T10:22:27.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627092+0000", 2024-04-26T10:22:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9657000000000003e-05 2024-04-26T10:22:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631499+0000", 2024-04-26T10:22:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044066560000000001 2024-04-26T10:22:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631549+0000", 2024-04-26T10:22:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0259000000000001e-05 2024-04-26T10:22:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65298 5.b 5:d51c4e52:::benchmark_data_smithi052_19421_object65297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 26.928498783999999, 2024-04-26T10:22:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091641671999999993, 2024-04-26T10:22:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.529 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65298 2024-04-26T10:22:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538844+0000", 2024-04-26T10:22:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538919+0000", 2024-04-26T10:22:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4626e-05 2024-04-26T10:22:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626007+0000", 2024-04-26T10:22:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087087516000000004 2024-04-26T10:22:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626074+0000", 2024-04-26T10:22:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7077999999999997e-05 2024-04-26T10:22:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626150+0000", 2024-04-26T10:22:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5982999999999994e-05 2024-04-26T10:22:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626341+0000", 2024-04-26T10:22:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019141199999999999 2024-04-26T10:22:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630359+0000", 2024-04-26T10:22:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040175710000000002 2024-04-26T10:22:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630412+0000", 2024-04-26T10:22:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3779000000000001e-05 2024-04-26T10:22:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630487+0000", 2024-04-26T10:22:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4913999999999995e-05 2024-04-26T10:22:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83591 5.4 5:204a1b6d:::benchmark_data_smithi052_19421_object83590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 16.619630549, 2024-04-26T10:22:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.047988034999999998, 2024-04-26T10:22:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.534 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83591 2024-04-26T10:22:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847713+0000", 2024-04-26T10:22:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847784+0000", 2024-04-26T10:22:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0723999999999996e-05 2024-04-26T10:22:27.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847795+0000", 2024-04-26T10:22:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1538e-05 2024-04-26T10:22:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847810+0000", 2024-04-26T10:22:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4354e-05 2024-04-26T10:22:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847850+0000", 2024-04-26T10:22:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0750000000000001e-05 2024-04-26T10:22:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847974+0000", 2024-04-26T10:22:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012394899999999999 2024-04-26T10:22:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.848089+0000", 2024-04-26T10:22:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114527 2024-04-26T10:22:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852900+0000", 2024-04-26T10:22:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048110779999999999 2024-04-26T10:22:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895562+0000", 2024-04-26T10:22:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042662053999999998 2024-04-26T10:22:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895622+0000", 2024-04-26T10:22:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0470000000000002e-05 2024-04-26T10:22:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895702+0000", 2024-04-26T10:22:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9541000000000003e-05 2024-04-26T10:22:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83593 5.0 5:044bb3ac:::benchmark_data_smithi052_19421_object83592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:27.541 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 16.617743696000002, 2024-04-26T10:22:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.046164161000000002, 2024-04-26T10:22:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83593 2024-04-26T10:22:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:27.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849600+0000", 2024-04-26T10:22:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849655+0000", 2024-04-26T10:22:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5148999999999997e-05 2024-04-26T10:22:27.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849666+0000", 2024-04-26T10:22:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1494999999999999e-05 2024-04-26T10:22:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849677+0000", 2024-04-26T10:22:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0985000000000001e-05 2024-04-26T10:22:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849716+0000", 2024-04-26T10:22:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8698000000000001e-05 2024-04-26T10:22:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849822+0000", 2024-04-26T10:22:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000106173 2024-04-26T10:22:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849938+0000", 2024-04-26T10:22:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115738 2024-04-26T10:22:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853416+0000", 2024-04-26T10:22:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034777440000000001 2024-04-26T10:22:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895540+0000", 2024-04-26T10:22:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042124704999999998 2024-04-26T10:22:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895619+0000", 2024-04-26T10:22:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8697999999999998e-05 2024-04-26T10:22:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895765+0000", 2024-04-26T10:22:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014579299999999999 2024-04-26T10:22:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83594 5.b 5:d024b819:::benchmark_data_smithi052_19421_object83593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 16.617651458000001, 2024-04-26T10:22:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045938635999999998, 2024-04-26T10:22:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83594 2024-04-26T10:22:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849692+0000", 2024-04-26T10:22:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849730+0000", 2024-04-26T10:22:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7415e-05 2024-04-26T10:22:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849735+0000", 2024-04-26T10:22:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6350000000000003e-06 2024-04-26T10:22:27.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849740+0000", 2024-04-26T10:22:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4209999999999997e-06 2024-04-26T10:22:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849787+0000", 2024-04-26T10:22:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7166000000000002e-05 2024-04-26T10:22:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849915+0000", 2024-04-26T10:22:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012823700000000001 2024-04-26T10:22:27.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850038+0000", 2024-04-26T10:22:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012317 2024-04-26T10:22:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855812+0000", 2024-04-26T10:22:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057731340000000001 2024-04-26T10:22:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895504+0000", 2024-04-26T10:22:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.039692540999999998 2024-04-26T10:22:27.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895569+0000", 2024-04-26T10:22:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4443999999999995e-05 2024-04-26T10:22:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895632+0000", 2024-04-26T10:22:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3109999999999997e-05 2024-04-26T10:22:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.552 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83596 5.b 5:d54e48a0:::benchmark_data_smithi052_19421_object83595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 16.616831377, 2024-04-26T10:22:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.053210201999999998, 2024-04-26T10:22:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83596 2024-04-26T10:22:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:27.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850512+0000", 2024-04-26T10:22:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850622+0000", 2024-04-26T10:22:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010927 2024-04-26T10:22:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850629+0000", 2024-04-26T10:22:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1690000000000003e-06 2024-04-26T10:22:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850633+0000", 2024-04-26T10:22:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4800000000000003e-06 2024-04-26T10:22:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852134+0000", 2024-04-26T10:22:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015011099999999999 2024-04-26T10:22:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852446+0000", 2024-04-26T10:22:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031107999999999998 2024-04-26T10:22:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852723+0000", 2024-04-26T10:22:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027751499999999999 2024-04-26T10:22:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861229+0000", 2024-04-26T10:22:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085055960000000007 2024-04-26T10:22:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903523+0000", 2024-04-26T10:22:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042294683999999999 2024-04-26T10:22:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903579+0000", 2024-04-26T10:22:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5751999999999997e-05 2024-04-26T10:22:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903723+0000", 2024-04-26T10:22:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014414199999999999 2024-04-26T10:22:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83603 5.b 5:d4896044:::benchmark_data_smithi052_19421_object83602:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 16.613904489999999, 2024-04-26T10:22:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.053974093000000001, 2024-04-26T10:22:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.558 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83603 2024-04-26T10:22:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853439+0000", 2024-04-26T10:22:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853492+0000", 2024-04-26T10:22:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2265000000000002e-05 2024-04-26T10:22:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853504+0000", 2024-04-26T10:22:27.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2354999999999999e-05 2024-04-26T10:22:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853512+0000", 2024-04-26T10:22:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8630000000000008e-06 2024-04-26T10:22:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855839+0000", 2024-04-26T10:22:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002326776 2024-04-26T10:22:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855993+0000", 2024-04-26T10:22:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015428300000000001 2024-04-26T10:22:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.856138+0000", 2024-04-26T10:22:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000145427 2024-04-26T10:22:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861318+0000", 2024-04-26T10:22:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051795160000000003 2024-04-26T10:22:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907178+0000", 2024-04-26T10:22:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045859882999999997 2024-04-26T10:22:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907260+0000", 2024-04-26T10:22:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2133999999999997e-05 2024-04-26T10:22:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907414+0000", 2024-04-26T10:22:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015427400000000001 2024-04-26T10:22:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.4327402550000001, 2024-04-26T10:22:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:22:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:22:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:22:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:22:27.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:22:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:22:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:22:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:22:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:22:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:22:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:22:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:22:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:22:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:22:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:22:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:22:27.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:22:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:22:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:22:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:22:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:22:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:22:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:22:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 3.432516659, 2024-04-26T10:22:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:22:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:27.569 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:22:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:27.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:22:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:22:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:22:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:22:27.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:22:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:22:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:22:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:22:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:22:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:27.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:22:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:22:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:22:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:22:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:22:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:22:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:22:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:22:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:22:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:22:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:22:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:22:27.574 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.575 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.575 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.575 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:27.575 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:27.575 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:27.576 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:27.572+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:27.577 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:27.618 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 54 16 117590 117574 136.065 130.062 0.00700593 0.00734392 2024-04-26T10:22:27.677 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:27.672+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:27.718 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:27.718 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:27.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.719 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:117773 5.d 5:be57b868:::benchmark_data_smithi052_19421_object117772:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:27.719 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:27.710695+0000", 2024-04-26T10:22:27.719 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0049830009999999999, 2024-04-26T10:22:27.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050095890000000001, 2024-04-26T10:22:27.719 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:27.719 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:27.719 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:27.719 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:27.719 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.719 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117773 2024-04-26T10:22:27.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.719 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:27.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:27.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.710695+0000", 2024-04-26T10:22:27.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:27.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.710695+0000", 2024-04-26T10:22:27.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:27.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.710694+0000", 2024-04-26T10:22:27.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:27.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:27.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.710735+0000", 2024-04-26T10:22:27.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0039000000000001e-05 2024-04-26T10:22:27.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:27.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.710744+0000", 2024-04-26T10:22:27.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9250000000000007e-06 2024-04-26T10:22:27.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.710751+0000", 2024-04-26T10:22:27.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.024e-06 2024-04-26T10:22:27.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:27.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.712049+0000", 2024-04-26T10:22:27.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012970970000000001 2024-04-26T10:22:27.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:27.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.712180+0000", 2024-04-26T10:22:27.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013098999999999999 2024-04-26T10:22:27.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:27.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.712325+0000", 2024-04-26T10:22:27.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014556500000000001 2024-04-26T10:22:27.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:27.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714825+0000", 2024-04-26T10:22:27.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025000349999999998 2024-04-26T10:22:27.723 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.723 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:27.723 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.724 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:117776 5.1 5:8256d7b3:::benchmark_data_smithi052_19421_object117775:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:27.724 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:27.711152+0000", 2024-04-26T10:22:27.724 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0045258529999999998, 2024-04-26T10:22:27.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046360689999999996, 2024-04-26T10:22:27.724 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:27.724 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:27.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:27.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:27.725 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.725 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117776 2024-04-26T10:22:27.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.725 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:27.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:27.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.711152+0000", 2024-04-26T10:22:27.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:27.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.711152+0000", 2024-04-26T10:22:27.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:27.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.711151+0000", 2024-04-26T10:22:27.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:27.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:27.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.711218+0000", 2024-04-26T10:22:27.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7123000000000001e-05 2024-04-26T10:22:27.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:27.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.711227+0000", 2024-04-26T10:22:27.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9900000000000003e-06 2024-04-26T10:22:27.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.711234+0000", 2024-04-26T10:22:27.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8689999999999998e-06 2024-04-26T10:22:27.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:27.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714206+0000", 2024-04-26T10:22:27.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029720240000000002 2024-04-26T10:22:27.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:27.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714374+0000", 2024-04-26T10:22:27.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016756799999999999 2024-04-26T10:22:27.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.728 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:27.729 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.729 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:117752 5.9 5:93d9f47c:::benchmark_data_smithi052_19421_object117751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:27.729 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:27.699066+0000", 2024-04-26T10:22:27.729 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.016611872, 2024-04-26T10:22:27.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.016787804999999999, 2024-04-26T10:22:27.729 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:27.729 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:27.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:27.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:27.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.729 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117752 2024-04-26T10:22:27.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.730 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:27.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:27.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.699066+0000", 2024-04-26T10:22:27.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:27.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.699066+0000", 2024-04-26T10:22:27.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:27.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.699065+0000", 2024-04-26T10:22:27.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:27.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:27.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.699127+0000", 2024-04-26T10:22:27.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1759000000000003e-05 2024-04-26T10:22:27.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:27.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.699138+0000", 2024-04-26T10:22:27.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1266e-05 2024-04-26T10:22:27.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.699143+0000", 2024-04-26T10:22:27.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6580000000000001e-06 2024-04-26T10:22:27.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:27.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.701227+0000", 2024-04-26T10:22:27.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00208435 2024-04-26T10:22:27.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:27.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.701639+0000", 2024-04-26T10:22:27.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000411226 2024-04-26T10:22:27.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:27.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.701832+0000", 2024-04-26T10:22:27.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019349800000000001 2024-04-26T10:22:27.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:27.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.709625+0000", 2024-04-26T10:22:27.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007792663 2024-04-26T10:22:27.733 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.733 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:27.733 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.733 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:117777 5.2 5:4509efe1:::benchmark_data_smithi052_19421_object117776:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:27.734 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:27.714416+0000", 2024-04-26T10:22:27.734 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00126212, 2024-04-26T10:22:27.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015141849999999999, 2024-04-26T10:22:27.734 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:27.734 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:27.734 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:27.734 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:27.734 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.734 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117777 2024-04-26T10:22:27.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.734 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:27.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:27.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714416+0000", 2024-04-26T10:22:27.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:27.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714416+0000", 2024-04-26T10:22:27.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:27.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714415+0000", 2024-04-26T10:22:27.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:27.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:27.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714469+0000", 2024-04-26T10:22:27.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4354999999999997e-05 2024-04-26T10:22:27.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:27.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714477+0000", 2024-04-26T10:22:27.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8960000000000003e-06 2024-04-26T10:22:27.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714482+0000", 2024-04-26T10:22:27.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1769999999999997e-06 2024-04-26T10:22:27.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:27.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714530+0000", 2024-04-26T10:22:27.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7692999999999999e-05 2024-04-26T10:22:27.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:27.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714656+0000", 2024-04-26T10:22:27.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012584 2024-04-26T10:22:27.737 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.737 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:27.737 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.737 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:117778 5.3 5:cc947953:::benchmark_data_smithi052_19421_object117777:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:27.737 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:27.714498+0000", 2024-04-26T10:22:27.738 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001179975, 2024-04-26T10:22:27.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014952089999999999, 2024-04-26T10:22:27.738 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:27.738 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:27.738 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:27.738 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:27.738 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.738 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117778 2024-04-26T10:22:27.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.738 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:27.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:27.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714498+0000", 2024-04-26T10:22:27.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:27.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714498+0000", 2024-04-26T10:22:27.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:27.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714498+0000", 2024-04-26T10:22:27.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:27.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:27.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714537+0000", 2024-04-26T10:22:27.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8958999999999997e-05 2024-04-26T10:22:27.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:27.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714546+0000", 2024-04-26T10:22:27.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9679999999999995e-06 2024-04-26T10:22:27.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714552+0000", 2024-04-26T10:22:27.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0390000000000001e-06 2024-04-26T10:22:27.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:27.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714598+0000", 2024-04-26T10:22:27.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6570999999999998e-05 2024-04-26T10:22:27.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:27.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714749+0000", 2024-04-26T10:22:27.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000150832 2024-04-26T10:22:27.741 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.741 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:27.741 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.741 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:117780 5.3 5.ff07d2e3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:27.742 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:27.715917+0000", 2024-04-26T10:22:27.742 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9997616, 2024-04-26T10:22:27.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013860700000000001, 2024-04-26T10:22:27.742 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:27.742 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:27.742 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:27.742 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:27.742 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.742 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117780 2024-04-26T10:22:27.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.742 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:27.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:27.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.715917+0000", 2024-04-26T10:22:27.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:27.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.715917+0000", 2024-04-26T10:22:27.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:27.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.715916+0000", 2024-04-26T10:22:27.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:27.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:27.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.715941+0000", 2024-04-26T10:22:27.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5599999999999999e-05 2024-04-26T10:22:27.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:27.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.715958+0000", 2024-04-26T10:22:27.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6639000000000001e-05 2024-04-26T10:22:27.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.715964+0000", 2024-04-26T10:22:27.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6890000000000001e-06 2024-04-26T10:22:27.744 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.744 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:27.745 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.745 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:117781 5.6 5:6fd31528:::benchmark_data_smithi052_19421_object117780:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:27.745 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:27.715974+0000", 2024-04-26T10:22:27.745 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9997048, 2024-04-26T10:22:27.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013700799999999999, 2024-04-26T10:22:27.745 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:27.745 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-04-26T10:22:27.745 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:27.745 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:27.745 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.745 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117781 2024-04-26T10:22:27.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.745 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:27.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:27.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.715974+0000", 2024-04-26T10:22:27.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:27.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.715974+0000", 2024-04-26T10:22:27.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:27.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.715973+0000", 2024-04-26T10:22:27.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:27.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:27.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.715994+0000", 2024-04-26T10:22:27.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1333000000000001e-05 2024-04-26T10:22:27.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:27.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716009+0000", 2024-04-26T10:22:27.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4408e-05 2024-04-26T10:22:27.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716012+0000", 2024-04-26T10:22:27.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4079999999999998e-06 2024-04-26T10:22:27.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:27.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716058+0000", 2024-04-26T10:22:27.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6109999999999997e-05 2024-04-26T10:22:27.748 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.748 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:27.748 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.748 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:117768 5.9 e46/37)", 2024-04-26T10:22:27.748 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:27.716035+0000", 2024-04-26T10:22:27.749 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9996428, 2024-04-26T10:22:27.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013156299999999999, 2024-04-26T10:22:27.749 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:27.749 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:27.749 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:27.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:27.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716035+0000", 2024-04-26T10:22:27.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:27.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716035+0000", 2024-04-26T10:22:27.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:27.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716035+0000", 2024-04-26T10:22:27.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:27.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:27.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716038+0000", 2024-04-26T10:22:27.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7840000000000001e-06 2024-04-26T10:22:27.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:27.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716045+0000", 2024-04-26T10:22:27.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9e-06 2024-04-26T10:22:27.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716067+0000", 2024-04-26T10:22:27.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2069000000000002e-05 2024-04-26T10:22:27.751 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.751 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:27.751 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.751 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:117779 5.b e46/37)", 2024-04-26T10:22:27.751 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:27.716076+0000", 2024-04-26T10:22:27.751 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9996028, 2024-04-26T10:22:27.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013814599999999999, 2024-04-26T10:22:27.752 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:27.752 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:27.752 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:27.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:27.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716076+0000", 2024-04-26T10:22:27.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:27.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716076+0000", 2024-04-26T10:22:27.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:27.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716075+0000", 2024-04-26T10:22:27.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:27.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:27.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716080+0000", 2024-04-26T10:22:27.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9790000000000001e-06 2024-04-26T10:22:27.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:27.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716086+0000", 2024-04-26T10:22:27.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0929999999999999e-06 2024-04-26T10:22:27.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716092+0000", 2024-04-26T10:22:27.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1089999999999997e-06 2024-04-26T10:22:27.754 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.754 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:27.754 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.754 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:117773 5.d e46/37)", 2024-04-26T10:22:27.754 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:27.716096+0000", 2024-04-26T10:22:27.754 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9995828, 2024-04-26T10:22:27.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163874, 2024-04-26T10:22:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716096+0000", 2024-04-26T10:22:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716096+0000", 2024-04-26T10:22:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:27.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716095+0000", 2024-04-26T10:22:27.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-04-26T10:22:27.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:27.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716098+0000", 2024-04-26T10:22:27.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2369999999999999e-06 2024-04-26T10:22:27.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:27.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716103+0000", 2024-04-26T10:22:27.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1889999999999998e-06 2024-04-26T10:22:27.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716107+0000", 2024-04-26T10:22:27.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2889999999999999e-06 2024-04-26T10:22:27.757 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.757 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:27.757 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.757 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "MOSDPGPush(5.0 46/37 [PushOp(5:096fa75b:::benchmark_data_smithi052_19421_object59649:head, version: 33'3666, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:096fa75b:::benchmark_data_smithi052_19421_object59649:head@33'3666, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-04-26T10:22:27.757 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:27.716117+0000", 2024-04-26T10:22:27.757 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9995618, 2024-04-26T10:22:27.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021174900000000001, 2024-04-26T10:22:27.757 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:27.757 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:27.758 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:27.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:27.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716117+0000", 2024-04-26T10:22:27.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:27.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716117+0000", 2024-04-26T10:22:27.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:27.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716116+0000", 2024-04-26T10:22:27.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-04-26T10:22:27.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:27.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716155+0000", 2024-04-26T10:22:27.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8501999999999998e-05 2024-04-26T10:22:27.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:27.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716167+0000", 2024-04-26T10:22:27.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2403e-05 2024-04-26T10:22:27.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716188+0000", 2024-04-26T10:22:27.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0443999999999999e-05 2024-04-26T10:22:27.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:27.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716248+0000", 2024-04-26T10:22:27.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0761000000000003e-05 2024-04-26T10:22:27.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:27.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716255+0000", 2024-04-26T10:22:27.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7710000000000001e-06 2024-04-26T10:22:27.761 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.761 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:27.761 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.761 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:117762 5.9 5:95c02d88:::benchmark_data_smithi052_19421_object117761:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:27.761 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:27.703632+0000", 2024-04-26T10:22:27.761 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012046390000000001, 2024-04-26T10:22:27.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.012757271000000001, 2024-04-26T10:22:27.761 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:27.761 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:27.762 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:27.762 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:27.762 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.762 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117762 2024-04-26T10:22:27.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.762 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:27.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:27.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.703632+0000", 2024-04-26T10:22:27.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:27.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.703632+0000", 2024-04-26T10:22:27.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:27.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.703631+0000", 2024-04-26T10:22:27.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:27.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:27.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.703661+0000", 2024-04-26T10:22:27.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9391999999999999e-05 2024-04-26T10:22:27.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:27.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.703668+0000", 2024-04-26T10:22:27.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5179999999999998e-06 2024-04-26T10:22:27.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.703675+0000", 2024-04-26T10:22:27.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9979999999999997e-06 2024-04-26T10:22:27.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:27.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.706548+0000", 2024-04-26T10:22:27.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028732100000000002 2024-04-26T10:22:27.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:27.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.706677+0000", 2024-04-26T10:22:27.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012843899999999999 2024-04-26T10:22:27.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:27.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.706831+0000", 2024-04-26T10:22:27.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015370800000000001 2024-04-26T10:22:27.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:27.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.709674+0000", 2024-04-26T10:22:27.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028434799999999998 2024-04-26T10:22:27.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:27.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716267+0000", 2024-04-26T10:22:27.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065934180000000002 2024-04-26T10:22:27.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:27.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716323+0000", 2024-04-26T10:22:27.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5840000000000001e-05 2024-04-26T10:22:27.766 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.767 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:27.767 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.767 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "pg_backfill(progress 5.0 e 46/46 lb 5:096e477e:::benchmark_data_smithi052_19421_object8682:head)", 2024-04-26T10:22:27.767 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:27.716206+0000", 2024-04-26T10:22:27.767 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9994726, 2024-04-26T10:22:27.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029268000000000002, 2024-04-26T10:22:27.767 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:27.767 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:27.767 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:27.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:27.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716206+0000", 2024-04-26T10:22:27.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:27.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716206+0000", 2024-04-26T10:22:27.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:27.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716205+0000", 2024-04-26T10:22:27.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:27.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:27.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716213+0000", 2024-04-26T10:22:27.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7910000000000005e-06 2024-04-26T10:22:27.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:27.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716221+0000", 2024-04-26T10:22:27.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0139999999999998e-06 2024-04-26T10:22:27.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716227+0000", 2024-04-26T10:22:27.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8119999999999996e-06 2024-04-26T10:22:27.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.769 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:27.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.770 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:117764 5.9 5:9e9ec027:::benchmark_data_smithi052_19421_object117763:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:27.770 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:27.707268+0000", 2024-04-26T10:22:27.770 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0084102889999999996, 2024-04-26T10:22:27.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092923869999999992, 2024-04-26T10:22:27.770 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:27.770 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:27.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:27.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:27.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.770 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117764 2024-04-26T10:22:27.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.771 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:27.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:27.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.707268+0000", 2024-04-26T10:22:27.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:27.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.707268+0000", 2024-04-26T10:22:27.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:27.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.707267+0000", 2024-04-26T10:22:27.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:27.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:27.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.707306+0000", 2024-04-26T10:22:27.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8892e-05 2024-04-26T10:22:27.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:27.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.707322+0000", 2024-04-26T10:22:27.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5634e-05 2024-04-26T10:22:27.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.707328+0000", 2024-04-26T10:22:27.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6779999999999997e-06 2024-04-26T10:22:27.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:27.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.709694+0000", 2024-04-26T10:22:27.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023666 2024-04-26T10:22:27.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:27.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.709798+0000", 2024-04-26T10:22:27.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103732 2024-04-26T10:22:27.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:27.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.709889+0000", 2024-04-26T10:22:27.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1365000000000004e-05 2024-04-26T10:22:27.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:27.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.714226+0000", 2024-04-26T10:22:27.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0043362799999999996 2024-04-26T10:22:27.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:27.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.716561+0000", 2024-04-26T10:22:27.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023359660000000001 2024-04-26T10:22:27.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.775 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:27.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.775 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:117768 5.9 5:991ff4ac:::benchmark_data_smithi052_19421_object117767:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-26T10:22:27.775 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:27.707615+0000", 2024-04-26T10:22:27.775 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0080635629999999993, 2024-04-26T10:22:27.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091786799999999998, 2024-04-26T10:22:27.775 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:27.775 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:27.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:27.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:27.776 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:27.776 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 117768 2024-04-26T10:22:27.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.776 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:27.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:27.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.707615+0000", 2024-04-26T10:22:27.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:27.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.707615+0000", 2024-04-26T10:22:27.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:27.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:27.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.707614+0000", 2024-04-26T10:22:27.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:27.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:27.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.707699+0000", 2024-04-26T10:22:27.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4555999999999995e-05 2024-04-26T10:22:27.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:27.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.707708+0000", 2024-04-26T10:22:27.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4709999999999996e-06 2024-04-26T10:22:27.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:27.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.707715+0000", 2024-04-26T10:22:27.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4849999999999997e-06 2024-04-26T10:22:27.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:27.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.711641+0000", 2024-04-26T10:22:27.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039266209999999999 2024-04-26T10:22:27.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:27.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.711818+0000", 2024-04-26T10:22:27.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017644199999999999 2024-04-26T10:22:27.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:27.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:27.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:27.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:27.711967+0000", 2024-04-26T10:22:27.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000148863 2024-04-26T10:22:27.779 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.779 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:27.779 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.779 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:27.779 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:27.779 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 15 2024-04-26T10:22:27.779 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:27.781 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:27.781 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:27.776+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:27.842 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T10:22:27.881 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:27.875+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:27.915 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:27.915 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:27.915 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:27.929 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:27.982 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:27.980+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:28.065 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:28.065 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:28.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:28.065 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:28.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.065 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:28.066 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:28.066 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.532701418999999, 2024-04-26T10:22:28.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:28.066 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.066 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:28.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:28.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.066 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:28.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.066 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:28.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:28.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:28.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:28.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:28.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:28.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:28.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:28.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:28.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:28.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:28.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:28.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:28.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:28.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:28.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:28.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:28.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:28.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:28.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:28.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:28.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:28.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:28.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:28.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:28.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:28.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:28.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.071 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.072 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:28.072 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:28.072 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.528166207000002, 2024-04-26T10:22:28.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:28.072 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.072 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:28.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:28.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.072 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:28.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.072 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:28.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:28.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:28.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:28.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:28.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:28.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:28.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:28.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:28.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:28.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:28.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:28.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:28.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:28.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:28.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.077 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.077 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:28.077 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:28.078 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.527534915, 2024-04-26T10:22:28.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:28.078 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.078 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:28.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:28.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.078 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:28.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.078 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:28.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:28.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:28.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:28.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:28.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:28.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:28.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:28.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:28.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:28.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:28.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:28.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:28.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:28.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:28.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:28.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:28.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:28.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:28.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:28.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:28.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:28.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:28.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:28.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:28.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:28.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:28.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.084 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.084 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83599 5.3 5:c6d96bef:::benchmark_data_smithi052_19421_object83598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:28.084 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:28.084 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.210635133, 2024-04-26T10:22:28.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050758893999999999, 2024-04-26T10:22:28.085 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.085 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.085 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:28.085 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:28.085 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.085 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83599 2024-04-26T10:22:28.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.085 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:28.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:28.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851411+0000", 2024-04-26T10:22:28.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:28.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851465+0000", 2024-04-26T10:22:28.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3943999999999997e-05 2024-04-26T10:22:28.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851475+0000", 2024-04-26T10:22:28.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0220999999999999e-05 2024-04-26T10:22:28.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851482+0000", 2024-04-26T10:22:28.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3259999999999998e-06 2024-04-26T10:22:28.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851525+0000", 2024-04-26T10:22:28.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2255000000000001e-05 2024-04-26T10:22:28.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851617+0000", 2024-04-26T10:22:28.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2436999999999996e-05 2024-04-26T10:22:28.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:28.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902102+0000", 2024-04-26T10:22:28.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050485163 2024-04-26T10:22:28.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902130+0000", 2024-04-26T10:22:28.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8177000000000001e-05 2024-04-26T10:22:28.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902171+0000", 2024-04-26T10:22:28.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1091999999999999e-05 2024-04-26T10:22:28.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.089 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.089 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110555 5.9 5:919989b3:::benchmark_data_smithi052_19421_object110554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:28.089 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:28.089 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.0287377099999997, 2024-04-26T10:22:28.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129736717, 2024-04-26T10:22:28.090 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.090 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:28.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:28.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.090 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110555 2024-04-26T10:22:28.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.090 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:28.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:28.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033309+0000", 2024-04-26T10:22:28.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:28.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033393+0000", 2024-04-26T10:22:28.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3690999999999995e-05 2024-04-26T10:22:28.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033401+0000", 2024-04-26T10:22:28.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4319999999999999e-06 2024-04-26T10:22:28.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033406+0000", 2024-04-26T10:22:28.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2340000000000002e-06 2024-04-26T10:22:28.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033467+0000", 2024-04-26T10:22:28.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0915999999999997e-05 2024-04-26T10:22:28.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033550+0000", 2024-04-26T10:22:28.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3057000000000001e-05 2024-04-26T10:22:28.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:28.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033676+0000", 2024-04-26T10:22:28.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126162 2024-04-26T10:22:28.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:28.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037902+0000", 2024-04-26T10:22:28.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042255720000000004 2024-04-26T10:22:28.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:28.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162728+0000", 2024-04-26T10:22:28.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12482583799999999 2024-04-26T10:22:28.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162839+0000", 2024-04-26T10:22:28.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111222 2024-04-26T10:22:28.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163047+0000", 2024-04-26T10:22:28.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207686 2024-04-26T10:22:28.095 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.095 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.095 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.095 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110556 5.1 5:822c74bd:::benchmark_data_smithi052_19421_object110555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:28.095 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:28.095 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.0286286029999996, 2024-04-26T10:22:28.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129274783, 2024-04-26T10:22:28.095 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.095 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.095 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:28.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:28.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.096 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110556 2024-04-26T10:22:28.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.096 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:28.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:28.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033418+0000", 2024-04-26T10:22:28.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:28.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033472+0000", 2024-04-26T10:22:28.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3780999999999999e-05 2024-04-26T10:22:28.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033478+0000", 2024-04-26T10:22:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6049999999999997e-06 2024-04-26T10:22:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033482+0000", 2024-04-26T10:22:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9110000000000001e-06 2024-04-26T10:22:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033509+0000", 2024-04-26T10:22:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6415e-05 2024-04-26T10:22:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033650+0000", 2024-04-26T10:22:28.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014088999999999999 2024-04-26T10:22:28.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:28.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161877+0000", 2024-04-26T10:22:28.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128227707 2024-04-26T10:22:28.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162541+0000", 2024-04-26T10:22:28.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000663863 2024-04-26T10:22:28.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162694+0000", 2024-04-26T10:22:28.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015245699999999999 2024-04-26T10:22:28.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.100 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.100 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.100 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110558 5.3 5:c73f56b6:::benchmark_data_smithi052_19421_object110557:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:28.100 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:28.100 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.0284319679999996, 2024-04-26T10:22:28.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12864012999999999, 2024-04-26T10:22:28.100 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.100 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:28.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:28.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.101 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110558 2024-04-26T10:22:28.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.101 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:28.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:28.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033615+0000", 2024-04-26T10:22:28.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033717+0000", 2024-04-26T10:22:28.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102298 2024-04-26T10:22:28.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033725+0000", 2024-04-26T10:22:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0090000000000007e-06 2024-04-26T10:22:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033731+0000", 2024-04-26T10:22:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8919999999999997e-06 2024-04-26T10:22:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033769+0000", 2024-04-26T10:22:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7682999999999998e-05 2024-04-26T10:22:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033891+0000", 2024-04-26T10:22:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121718 2024-04-26T10:22:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161912+0000", 2024-04-26T10:22:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128021512 2024-04-26T10:22:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162043+0000", 2024-04-26T10:22:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130588 2024-04-26T10:22:28.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162256+0000", 2024-04-26T10:22:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021311499999999999 2024-04-26T10:22:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110557 5.b e45/37 5:d659544e:::benchmark_data_smithi052_19421_object110556:head v 45'6862, mlcod=45'6860)", 2024-04-26T10:22:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.0275277349999996, 2024-04-26T10:22:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12783012499999999, 2024-04-26T10:22:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.105 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.106 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:28.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:28.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034519+0000", 2024-04-26T10:22:28.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:28.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034526+0000", 2024-04-26T10:22:28.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0380000000000002e-06 2024-04-26T10:22:28.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034539+0000", 2024-04-26T10:22:28.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.27e-05 2024-04-26T10:22:28.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034545+0000", 2024-04-26T10:22:28.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3369999999999996e-06 2024-04-26T10:22:28.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034606+0000", 2024-04-26T10:22:28.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0752999999999999e-05 2024-04-26T10:22:28.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034627+0000", 2024-04-26T10:22:28.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.088e-05 2024-04-26T10:22:28.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162272+0000", 2024-04-26T10:22:28.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12764540199999999 2024-04-26T10:22:28.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162350+0000", 2024-04-26T10:22:28.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7835000000000003e-05 2024-04-26T10:22:28.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.109 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.109 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110554 5.0 e45/37 5:04324c12:::benchmark_data_smithi052_19421_object110553:head v 45'6903, mlcod=45'6898)", 2024-04-26T10:22:28.110 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:28.110 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.0257683130000004, 2024-04-26T10:22:28.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12566923499999999, 2024-04-26T10:22:28.110 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.110 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.110 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:28.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:28.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036278+0000", 2024-04-26T10:22:28.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:28.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036313+0000", 2024-04-26T10:22:28.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5247999999999999e-05 2024-04-26T10:22:28.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036324+0000", 2024-04-26T10:22:28.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0496000000000001e-05 2024-04-26T10:22:28.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036329+0000", 2024-04-26T10:22:28.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3070000000000002e-06 2024-04-26T10:22:28.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036364+0000", 2024-04-26T10:22:28.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4391000000000003e-05 2024-04-26T10:22:28.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036377+0000", 2024-04-26T10:22:28.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3706999999999999e-05 2024-04-26T10:22:28.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042032+0000", 2024-04-26T10:22:28.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056547120000000001 2024-04-26T10:22:28.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161949+0000", 2024-04-26T10:22:28.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119916482 2024-04-26T10:22:28.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.114 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.114 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110559 5.2 5:44c3f174:::benchmark_data_smithi052_19421_object110558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:28.114 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:28.114 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.024149703, 2024-04-26T10:22:28.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12530391299999999, 2024-04-26T10:22:28.115 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.115 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:28.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:28.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.115 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110559 2024-04-26T10:22:28.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.115 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:28.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:28.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037897+0000", 2024-04-26T10:22:28.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:28.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037922+0000", 2024-04-26T10:22:28.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5004e-05 2024-04-26T10:22:28.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037931+0000", 2024-04-26T10:22:28.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-04-26T10:22:28.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037937+0000", 2024-04-26T10:22:28.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6749999999999999e-06 2024-04-26T10:22:28.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037972+0000", 2024-04-26T10:22:28.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4678000000000002e-05 2024-04-26T10:22:28.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038108+0000", 2024-04-26T10:22:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013689099999999999 2024-04-26T10:22:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162887+0000", 2024-04-26T10:22:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124778258 2024-04-26T10:22:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163010+0000", 2024-04-26T10:22:28.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122924 2024-04-26T10:22:28.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163202+0000", 2024-04-26T10:22:28.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192203 2024-04-26T10:22:28.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.119 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.119 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110560 5.3 5:caf5a141:::benchmark_data_smithi052_19421_object110559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:28.119 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:28.119 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.0240991020000001, 2024-04-26T10:22:28.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12888738299999999, 2024-04-26T10:22:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110560 2024-04-26T10:22:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:28.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037948+0000", 2024-04-26T10:22:28.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037973+0000", 2024-04-26T10:22:28.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5187000000000001e-05 2024-04-26T10:22:28.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037978+0000", 2024-04-26T10:22:28.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4120000000000003e-06 2024-04-26T10:22:28.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037981+0000", 2024-04-26T10:22:28.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6689999999999999e-06 2024-04-26T10:22:28.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038041+0000", 2024-04-26T10:22:28.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9324999999999999e-05 2024-04-26T10:22:28.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038179+0000", 2024-04-26T10:22:28.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013832499999999999 2024-04-26T10:22:28.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:28.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166427+0000", 2024-04-26T10:22:28.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128248165 2024-04-26T10:22:28.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166539+0000", 2024-04-26T10:22:28.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111538 2024-04-26T10:22:28.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166836+0000", 2024-04-26T10:22:28.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029714100000000001 2024-04-26T10:22:28.124 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.124 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.124 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.124 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110561 5.d 5:b143edec:::benchmark_data_smithi052_19421_object110560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:28.124 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:28.124 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.0240570440000001, 2024-04-26T10:22:28.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.125215574, 2024-04-26T10:22:28.125 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.125 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:28.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:28.125 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.125 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110561 2024-04-26T10:22:28.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.125 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:28.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:28.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037990+0000", 2024-04-26T10:22:28.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:28.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038028+0000", 2024-04-26T10:22:28.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7802999999999997e-05 2024-04-26T10:22:28.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038035+0000", 2024-04-26T10:22:28.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-06 2024-04-26T10:22:28.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038040+0000", 2024-04-26T10:22:28.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.147e-06 2024-04-26T10:22:28.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038077+0000", 2024-04-26T10:22:28.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7166999999999998e-05 2024-04-26T10:22:28.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038192+0000", 2024-04-26T10:22:28.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115565 2024-04-26T10:22:28.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:28.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038319+0000", 2024-04-26T10:22:28.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012697699999999999 2024-04-26T10:22:28.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:28.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162690+0000", 2024-04-26T10:22:28.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12437065 2024-04-26T10:22:28.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:28.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162878+0000", 2024-04-26T10:22:28.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000188173 2024-04-26T10:22:28.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162992+0000", 2024-04-26T10:22:28.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114008 2024-04-26T10:22:28.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163206+0000", 2024-04-26T10:22:28.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021394900000000001 2024-04-26T10:22:28.130 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.130 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.130 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.130 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:28.130 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:28.130 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.0239964400000003, 2024-04-26T10:22:28.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:22:28.130 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.130 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.131 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:28.131 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:28.131 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.131 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:22:28.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.131 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:28.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:28.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:28.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:22:28.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:22:28.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:22:28.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:22:28.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:22:28.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:22:28.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:22:28.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:22:28.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:22:28.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:22:28.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:28.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:22:28.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:22:28.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:22:28.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:22:28.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:22:28.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:22:28.135 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.135 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.135 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.135 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110564 5.3 5:c09e33cb:::benchmark_data_smithi052_19421_object110563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:28.135 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:28.135 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.0239437819999999, 2024-04-26T10:22:28.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128984614, 2024-04-26T10:22:28.135 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.135 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.136 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:28.136 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:28.136 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.136 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110564 2024-04-26T10:22:28.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.136 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:28.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:28.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038103+0000", 2024-04-26T10:22:28.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038136+0000", 2024-04-26T10:22:28.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.243e-05 2024-04-26T10:22:28.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038143+0000", 2024-04-26T10:22:28.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0870000000000001e-06 2024-04-26T10:22:28.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038151+0000", 2024-04-26T10:22:28.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:22:28.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039813+0000", 2024-04-26T10:22:28.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001661844 2024-04-26T10:22:28.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039970+0000", 2024-04-26T10:22:28.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015712699999999999 2024-04-26T10:22:28.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:28.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166854+0000", 2024-04-26T10:22:28.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.126883788 2024-04-26T10:22:28.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166976+0000", 2024-04-26T10:22:28.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012231399999999999 2024-04-26T10:22:28.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167088+0000", 2024-04-26T10:22:28.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011243699999999999 2024-04-26T10:22:28.140 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.140 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.140 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.140 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:28.140 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:28.140 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.0238871889999999, 2024-04-26T10:22:28.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:22:28.140 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.141 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:28.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:28.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.141 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:22:28.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.141 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:28.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:28.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:28.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:22:28.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:22:28.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:22:28.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:22:28.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:22:28.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:22:28.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:22:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:22:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:22:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:22:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:22:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:22:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:22:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:22:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:22:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:22:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110566 5.c 5:34145698:::benchmark_data_smithi052_19421_object110565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:28.145 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.0238374119999998, 2024-04-26T10:22:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12673530699999999, 2024-04-26T10:22:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110566 2024-04-26T10:22:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038246+0000", 2024-04-26T10:22:28.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5759000000000001e-05 2024-04-26T10:22:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038252+0000", 2024-04-26T10:22:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5300000000000002e-06 2024-04-26T10:22:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038257+0000", 2024-04-26T10:22:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038312+0000", 2024-04-26T10:22:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5108000000000002e-05 2024-04-26T10:22:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038480+0000", 2024-04-26T10:22:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016751099999999999 2024-04-26T10:22:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164651+0000", 2024-04-26T10:22:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12617115600000001 2024-04-26T10:22:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164770+0000", 2024-04-26T10:22:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118748 2024-04-26T10:22:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164946+0000", 2024-04-26T10:22:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175966 2024-04-26T10:22:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.150 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.0214897770000002, 2024-04-26T10:22:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:22:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:22:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:22:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:22:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:22:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:22:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:22:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:22:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:22:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:22:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:22:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:22:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:22:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:22:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:22:28.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:22:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:22:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:22:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:22:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:22:28.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:22:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:22:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:22:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110568 5.c 5:34af8ad3:::benchmark_data_smithi052_19421_object110567:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.0213721519999996, 2024-04-26T10:22:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124943661, 2024-04-26T10:22:28.156 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110568 2024-04-26T10:22:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040711+0000", 2024-04-26T10:22:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6531e-05 2024-04-26T10:22:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040719+0000", 2024-04-26T10:22:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6120000000000001e-06 2024-04-26T10:22:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040724+0000", 2024-04-26T10:22:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2100000000000001e-06 2024-04-26T10:22:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040771+0000", 2024-04-26T10:22:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7123000000000003e-05 2024-04-26T10:22:28.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040984+0000", 2024-04-26T10:22:28.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021227400000000001 2024-04-26T10:22:28.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:28.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165350+0000", 2024-04-26T10:22:28.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124366738 2024-04-26T10:22:28.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165459+0000", 2024-04-26T10:22:28.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108168 2024-04-26T10:22:28.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165619+0000", 2024-04-26T10:22:28.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160564 2024-04-26T10:22:28.161 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.161 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.161 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.161 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:28.161 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:28.161 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.021303853, 2024-04-26T10:22:28.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:22:28.162 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.162 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:28.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:28.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.162 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:22:28.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.162 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:28.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:28.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:22:28.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:22:28.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:22:28.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:22:28.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:22:28.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:22:28.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:22:28.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:22:28.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:22:28.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:22:28.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:22:28.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:28.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:22:28.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:22:28.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:28.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:22:28.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:22:28.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:28.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:22:28.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:22:28.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:22:28.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:22:28.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:22:28.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:22:28.167 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.167 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.167 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.167 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110570 5.1 5:876a468c:::benchmark_data_smithi052_19421_object110569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:28.167 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:28.167 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.0200013080000003, 2024-04-26T10:22:28.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12851437099999999, 2024-04-26T10:22:28.168 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:28.168 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.168 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:28.168 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:28.168 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.168 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110570 2024-04-26T10:22:28.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.168 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:28.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:28.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:28.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:28.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:28.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:28.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:28.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042045+0000", 2024-04-26T10:22:28.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:28.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:28.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042083+0000", 2024-04-26T10:22:28.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8064e-05 2024-04-26T10:22:28.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:28.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161855+0000", 2024-04-26T10:22:28.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119771934 2024-04-26T10:22:28.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161882+0000", 2024-04-26T10:22:28.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7083000000000001e-05 2024-04-26T10:22:28.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:28.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163117+0000", 2024-04-26T10:22:28.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001234509 2024-04-26T10:22:28.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:28.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163507+0000", 2024-04-26T10:22:28.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038998400000000001 2024-04-26T10:22:28.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:28.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170347+0000", 2024-04-26T10:22:28.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006840952 2024-04-26T10:22:28.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:28.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170488+0000", 2024-04-26T10:22:28.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140393 2024-04-26T10:22:28.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:28.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:28.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:28.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170561+0000", 2024-04-26T10:22:28.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2809e-05 2024-04-26T10:22:28.172 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.172 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.172 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.172 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:28.172 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:28.172 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:28.173 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:28.167+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:28.174 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:28.274 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:28.272+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:28.305 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:118954 5.f e47/37 5:f1ba71a0:::benchmark_data_smithi052_19421_object118953:head v 47'7509, mlcod=47'7507)", 2024-04-26T10:22:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:28.304693+0000", 2024-04-26T10:22:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00038289699999999999, 2024-04-26T10:22:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00040340999999999999, 2024-04-26T10:22:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304693+0000", 2024-04-26T10:22:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304693+0000", 2024-04-26T10:22:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304693+0000", 2024-04-26T10:22:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304787+0000", 2024-04-26T10:22:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4462000000000005e-05 2024-04-26T10:22:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304796+0000", 2024-04-26T10:22:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5290000000000008e-06 2024-04-26T10:22:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304802+0000", 2024-04-26T10:22:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2709999999999998e-06 2024-04-26T10:22:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304844+0000", 2024-04-26T10:22:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1965999999999998e-05 2024-04-26T10:22:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304867+0000", 2024-04-26T10:22:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2796999999999999e-05 2024-04-26T10:22:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:118944 5.9 e47/37 5:93bc544b:::benchmark_data_smithi052_19421_object118943:head v 47'7485, mlcod=47'7482)", 2024-04-26T10:22:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:28.299910+0000", 2024-04-26T10:22:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0051663630000000002, 2024-04-26T10:22:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0052410240000000004, 2024-04-26T10:22:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.299910+0000", 2024-04-26T10:22:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.299910+0000", 2024-04-26T10:22:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.299909+0000", 2024-04-26T10:22:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.299971+0000", 2024-04-26T10:22:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2195999999999999e-05 2024-04-26T10:22:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.299982+0000", 2024-04-26T10:22:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0112000000000001e-05 2024-04-26T10:22:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.299986+0000", 2024-04-26T10:22:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4179999999999999e-06 2024-04-26T10:22:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.300018+0000", 2024-04-26T10:22:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1958999999999997e-05 2024-04-26T10:22:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.300032+0000", 2024-04-26T10:22:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4059999999999999e-05 2024-04-26T10:22:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:118947 5.0 5:05f4157e:::benchmark_data_smithi052_19421_object118946:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T10:22:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:28.301224+0000", 2024-04-26T10:22:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0038516729999999999, 2024-04-26T10:22:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0039662689999999997, 2024-04-26T10:22:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 118947 2024-04-26T10:22:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.301224+0000", 2024-04-26T10:22:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.301224+0000", 2024-04-26T10:22:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.301224+0000", 2024-04-26T10:22:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.301276+0000", 2024-04-26T10:22:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2596999999999998e-05 2024-04-26T10:22:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.301288+0000", 2024-04-26T10:22:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2135e-05 2024-04-26T10:22:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.301296+0000", 2024-04-26T10:22:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4630000000000004e-06 2024-04-26T10:22:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.301348+0000", 2024-04-26T10:22:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1916999999999998e-05 2024-04-26T10:22:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.301521+0000", 2024-04-26T10:22:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000173213 2024-04-26T10:22:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.301729+0000", 2024-04-26T10:22:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020759399999999999 2024-04-26T10:22:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:118948 5.9 e47/37 5:93ea3dcb:::benchmark_data_smithi052_19421_object118947:head v 47'7486, mlcod=47'7482)", 2024-04-26T10:22:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:28.303522+0000", 2024-04-26T10:22:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.001554073, 2024-04-26T10:22:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0017218820000000001, 2024-04-26T10:22:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.303522+0000", 2024-04-26T10:22:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.303522+0000", 2024-04-26T10:22:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.303521+0000", 2024-04-26T10:22:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.303589+0000", 2024-04-26T10:22:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7794999999999997e-05 2024-04-26T10:22:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.303603+0000", 2024-04-26T10:22:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3767e-05 2024-04-26T10:22:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.303614+0000", 2024-04-26T10:22:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0528e-05 2024-04-26T10:22:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.303704+0000", 2024-04-26T10:22:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0494999999999993e-05 2024-04-26T10:22:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.303723+0000", 2024-04-26T10:22:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9133000000000001e-05 2024-04-26T10:22:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:118951 5.4 5:2dd75c73:::benchmark_data_smithi052_19421_object118950:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T10:22:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:28.303799+0000", 2024-04-26T10:22:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0012774049999999999, 2024-04-26T10:22:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014850830000000001, 2024-04-26T10:22:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 118951 2024-04-26T10:22:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.303799+0000", 2024-04-26T10:22:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.303799+0000", 2024-04-26T10:22:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.303798+0000", 2024-04-26T10:22:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.303893+0000", 2024-04-26T10:22:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5112999999999996e-05 2024-04-26T10:22:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.303901+0000", 2024-04-26T10:22:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1440000000000003e-06 2024-04-26T10:22:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.303906+0000", 2024-04-26T10:22:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4829999999999999e-06 2024-04-26T10:22:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.303952+0000", 2024-04-26T10:22:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5624999999999998e-05 2024-04-26T10:22:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304086+0000", 2024-04-26T10:22:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000134179 2024-04-26T10:22:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304250+0000", 2024-04-26T10:22:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016387899999999999 2024-04-26T10:22:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:118956 5.8 5:15857f42:::benchmark_data_smithi052_19421_object118955:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T10:22:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:28.303917+0000", 2024-04-26T10:22:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.001158854, 2024-04-26T10:22:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014078179999999999, 2024-04-26T10:22:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 118956 2024-04-26T10:22:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.303917+0000", 2024-04-26T10:22:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.303917+0000", 2024-04-26T10:22:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.303917+0000", 2024-04-26T10:22:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304019+0000", 2024-04-26T10:22:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101888 2024-04-26T10:22:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304025+0000", 2024-04-26T10:22:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.669e-06 2024-04-26T10:22:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304029+0000", 2024-04-26T10:22:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0929999999999996e-06 2024-04-26T10:22:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304073+0000", 2024-04-26T10:22:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3693000000000003e-05 2024-04-26T10:22:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304232+0000", 2024-04-26T10:22:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015880000000000001 2024-04-26T10:22:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop_reply(client.4722.0:118947 5.0 e47/37)", 2024-04-26T10:22:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:28.304318+0000", 2024-04-26T10:22:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00075777600000000004, 2024-04-26T10:22:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010401239999999999, 2024-04-26T10:22:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304318+0000", 2024-04-26T10:22:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304318+0000", 2024-04-26T10:22:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304318+0000", 2024-04-26T10:22:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304322+0000", 2024-04-26T10:22:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6589999999999998e-06 2024-04-26T10:22:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304331+0000", 2024-04-26T10:22:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7269999999999996e-06 2024-04-26T10:22:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304337+0000", 2024-04-26T10:22:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1360000000000002e-06 2024-04-26T10:22:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDPGPushReply(5.0 47/37 [PushReplyOp(5:0995d75e:::benchmark_data_smithi052_19421_object97334:head)])", 2024-04-26T10:22:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:28.304344+0000", 2024-04-26T10:22:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00073190699999999996, 2024-04-26T10:22:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00104418, 2024-04-26T10:22:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304344+0000", 2024-04-26T10:22:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304344+0000", 2024-04-26T10:22:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304344+0000", 2024-04-26T10:22:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304348+0000", 2024-04-26T10:22:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6859999999999999e-06 2024-04-26T10:22:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304354+0000", 2024-04-26T10:22:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5100000000000004e-06 2024-04-26T10:22:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304360+0000", 2024-04-26T10:22:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5999999999999997e-06 2024-04-26T10:22:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:118959 5.b 5:d62bcecb:::benchmark_data_smithi052_19421_object118958:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-26T10:22:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:28.304501+0000", 2024-04-26T10:22:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00057500599999999998, 2024-04-26T10:22:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00091860499999999996, 2024-04-26T10:22:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 118959 2024-04-26T10:22:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304501+0000", 2024-04-26T10:22:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304501+0000", 2024-04-26T10:22:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304500+0000", 2024-04-26T10:22:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304583+0000", 2024-04-26T10:22:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2552999999999994e-05 2024-04-26T10:22:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304592+0000", 2024-04-26T10:22:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0769999999999997e-06 2024-04-26T10:22:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304597+0000", 2024-04-26T10:22:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2379999999999997e-06 2024-04-26T10:22:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304638+0000", 2024-04-26T10:22:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0874999999999997e-05 2024-04-26T10:22:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.304847+0000", 2024-04-26T10:22:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020866999999999999 2024-04-26T10:22:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:28.305035+0000", 2024-04-26T10:22:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018842300000000001 2024-04-26T10:22:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.340 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.340 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.340 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:28.340 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 9 2024-04-26T10:22:28.340 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:28.341 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:28.375 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:28.372+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:28.438 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:22:28.470 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:28.470 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:28.470 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:28.470 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:28.470 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:28.475 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:28.472+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:28.481 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:28.578 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:28.572+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:28.597 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:28.613 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:28.613 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:28.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:28.613 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:28.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.080689699000001, 2024-04-26T10:22:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:28.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:28.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.618 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.078707472000001, 2024-04-26T10:22:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:28.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:28.623 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.078508088, 2024-04-26T10:22:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:28.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:28.628 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.078289468000001, 2024-04-26T10:22:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:28.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.07591803, 2024-04-26T10:22:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:28.633 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:28.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:28.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.075817407999999, 2024-04-26T10:22:28.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:28.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:28.643 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.075698847000002, 2024-04-26T10:22:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:28.647 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.075596448999999, 2024-04-26T10:22:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.648 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:28.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:28.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65294 5.e 5:7438ad6f:::benchmark_data_smithi052_19421_object65293:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.074916332000001, 2024-04-26T10:22:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091965517999999996, 2024-04-26T10:22:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.653 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65294 2024-04-26T10:22:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536414+0000", 2024-04-26T10:22:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536413+0000", 2024-04-26T10:22:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536470+0000", 2024-04-26T10:22:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6443999999999997e-05 2024-04-26T10:22:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536480+0000", 2024-04-26T10:22:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0652999999999999e-05 2024-04-26T10:22:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536488+0000", 2024-04-26T10:22:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7929999999999998e-06 2024-04-26T10:22:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536548+0000", 2024-04-26T10:22:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9556999999999999e-05 2024-04-26T10:22:28.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536728+0000", 2024-04-26T10:22:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000180958 2024-04-26T10:22:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628168+0000", 2024-04-26T10:22:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091439276999999999 2024-04-26T10:22:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628258+0000", 2024-04-26T10:22:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0158e-05 2024-04-26T10:22:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.628380+0000", 2024-04-26T10:22:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012180699999999999 2024-04-26T10:22:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:28.658 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.074575891999999, 2024-04-26T10:22:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:28.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.073425617000002, 2024-04-26T10:22:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.668 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65292 5.f e34/22 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head v 34'4129, mlcod=34'4125)", 2024-04-26T10:22:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.073251361000001, 2024-04-26T10:22:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093470155999999999, 2024-04-26T10:22:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:28.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538079+0000", 2024-04-26T10:22:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538078+0000", 2024-04-26T10:22:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538140+0000", 2024-04-26T10:22:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1970000000000005e-05 2024-04-26T10:22:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538149+0000", 2024-04-26T10:22:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2189999999999993e-06 2024-04-26T10:22:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538158+0000", 2024-04-26T10:22:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0930000000000003e-06 2024-04-26T10:22:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627053+0000", 2024-04-26T10:22:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088895221999999996 2024-04-26T10:22:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627092+0000", 2024-04-26T10:22:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9657000000000003e-05 2024-04-26T10:22:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631499+0000", 2024-04-26T10:22:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044066560000000001 2024-04-26T10:22:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631549+0000", 2024-04-26T10:22:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0259000000000001e-05 2024-04-26T10:22:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65298 5.b 5:d51c4e52:::benchmark_data_smithi052_19421_object65297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.072484904, 2024-04-26T10:22:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.091641671999999993, 2024-04-26T10:22:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.673 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65298 2024-04-26T10:22:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538846+0000", 2024-04-26T10:22:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538844+0000", 2024-04-26T10:22:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538919+0000", 2024-04-26T10:22:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4626e-05 2024-04-26T10:22:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626007+0000", 2024-04-26T10:22:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087087516000000004 2024-04-26T10:22:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626074+0000", 2024-04-26T10:22:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7077999999999997e-05 2024-04-26T10:22:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626150+0000", 2024-04-26T10:22:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5982999999999994e-05 2024-04-26T10:22:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.626341+0000", 2024-04-26T10:22:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019141199999999999 2024-04-26T10:22:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630359+0000", 2024-04-26T10:22:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040175710000000002 2024-04-26T10:22:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630412+0000", 2024-04-26T10:22:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3779000000000001e-05 2024-04-26T10:22:28.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630487+0000", 2024-04-26T10:22:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4913999999999995e-05 2024-04-26T10:22:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83591 5.4 5:204a1b6d:::benchmark_data_smithi052_19421_object83590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.763616669000001, 2024-04-26T10:22:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.047988034999999998, 2024-04-26T10:22:28.678 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83591 2024-04-26T10:22:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847714+0000", 2024-04-26T10:22:28.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847713+0000", 2024-04-26T10:22:28.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:28.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847784+0000", 2024-04-26T10:22:28.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0723999999999996e-05 2024-04-26T10:22:28.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847795+0000", 2024-04-26T10:22:28.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1538e-05 2024-04-26T10:22:28.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847810+0000", 2024-04-26T10:22:28.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4354e-05 2024-04-26T10:22:28.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847850+0000", 2024-04-26T10:22:28.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0750000000000001e-05 2024-04-26T10:22:28.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.847974+0000", 2024-04-26T10:22:28.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012394899999999999 2024-04-26T10:22:28.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:28.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.848089+0000", 2024-04-26T10:22:28.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000114527 2024-04-26T10:22:28.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:28.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852900+0000", 2024-04-26T10:22:28.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048110779999999999 2024-04-26T10:22:28.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:28.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895562+0000", 2024-04-26T10:22:28.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042662053999999998 2024-04-26T10:22:28.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895622+0000", 2024-04-26T10:22:28.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0470000000000002e-05 2024-04-26T10:22:28.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895702+0000", 2024-04-26T10:22:28.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9541000000000003e-05 2024-04-26T10:22:28.684 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.684 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.684 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.684 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83593 5.0 5:044bb3ac:::benchmark_data_smithi052_19421_object83592:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:28.684 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:28.684 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.761729815999999, 2024-04-26T10:22:28.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.046164161000000002, 2024-04-26T10:22:28.684 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.684 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.684 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.685 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.685 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.685 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83593 2024-04-26T10:22:28.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.685 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:28.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849601+0000", 2024-04-26T10:22:28.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849600+0000", 2024-04-26T10:22:28.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:28.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849655+0000", 2024-04-26T10:22:28.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5148999999999997e-05 2024-04-26T10:22:28.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849666+0000", 2024-04-26T10:22:28.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1494999999999999e-05 2024-04-26T10:22:28.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849677+0000", 2024-04-26T10:22:28.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0985000000000001e-05 2024-04-26T10:22:28.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849716+0000", 2024-04-26T10:22:28.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8698000000000001e-05 2024-04-26T10:22:28.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849822+0000", 2024-04-26T10:22:28.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000106173 2024-04-26T10:22:28.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:28.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849938+0000", 2024-04-26T10:22:28.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115738 2024-04-26T10:22:28.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:28.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853416+0000", 2024-04-26T10:22:28.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034777440000000001 2024-04-26T10:22:28.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:28.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895540+0000", 2024-04-26T10:22:28.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042124704999999998 2024-04-26T10:22:28.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895619+0000", 2024-04-26T10:22:28.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8697999999999998e-05 2024-04-26T10:22:28.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895765+0000", 2024-04-26T10:22:28.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014579299999999999 2024-04-26T10:22:28.690 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.690 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.690 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.690 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83594 5.b 5:d024b819:::benchmark_data_smithi052_19421_object83593:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:28.690 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:28.690 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.761637577999998, 2024-04-26T10:22:28.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045938635999999998, 2024-04-26T10:22:28.690 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.690 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.690 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.690 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.691 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.691 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83594 2024-04-26T10:22:28.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.691 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:28.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849693+0000", 2024-04-26T10:22:28.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849692+0000", 2024-04-26T10:22:28.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849730+0000", 2024-04-26T10:22:28.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7415e-05 2024-04-26T10:22:28.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849735+0000", 2024-04-26T10:22:28.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6350000000000003e-06 2024-04-26T10:22:28.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849740+0000", 2024-04-26T10:22:28.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4209999999999997e-06 2024-04-26T10:22:28.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849787+0000", 2024-04-26T10:22:28.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7166000000000002e-05 2024-04-26T10:22:28.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.849915+0000", 2024-04-26T10:22:28.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012823700000000001 2024-04-26T10:22:28.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:28.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850038+0000", 2024-04-26T10:22:28.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012317 2024-04-26T10:22:28.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:28.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855812+0000", 2024-04-26T10:22:28.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057731340000000001 2024-04-26T10:22:28.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:28.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895504+0000", 2024-04-26T10:22:28.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.039692540999999998 2024-04-26T10:22:28.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895569+0000", 2024-04-26T10:22:28.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4443999999999995e-05 2024-04-26T10:22:28.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.895632+0000", 2024-04-26T10:22:28.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3109999999999997e-05 2024-04-26T10:22:28.696 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.696 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.696 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.696 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83596 5.b 5:d54e48a0:::benchmark_data_smithi052_19421_object83595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:28.696 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:28.696 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.760817497000001, 2024-04-26T10:22:28.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.053210201999999998, 2024-04-26T10:22:28.696 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.696 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.696 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.697 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.697 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.697 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83596 2024-04-26T10:22:28.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.697 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:28.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850513+0000", 2024-04-26T10:22:28.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850512+0000", 2024-04-26T10:22:28.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850622+0000", 2024-04-26T10:22:28.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010927 2024-04-26T10:22:28.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850629+0000", 2024-04-26T10:22:28.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1690000000000003e-06 2024-04-26T10:22:28.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.850633+0000", 2024-04-26T10:22:28.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4800000000000003e-06 2024-04-26T10:22:28.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852134+0000", 2024-04-26T10:22:28.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015011099999999999 2024-04-26T10:22:28.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852446+0000", 2024-04-26T10:22:28.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00031107999999999998 2024-04-26T10:22:28.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:28.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.852723+0000", 2024-04-26T10:22:28.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00027751499999999999 2024-04-26T10:22:28.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:28.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861229+0000", 2024-04-26T10:22:28.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085055960000000007 2024-04-26T10:22:28.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:28.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903523+0000", 2024-04-26T10:22:28.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042294683999999999 2024-04-26T10:22:28.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903579+0000", 2024-04-26T10:22:28.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5751999999999997e-05 2024-04-26T10:22:28.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.903723+0000", 2024-04-26T10:22:28.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014414199999999999 2024-04-26T10:22:28.702 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.702 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.702 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.702 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:83603 5.b 5:d4896044:::benchmark_data_smithi052_19421_object83602:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:28.702 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:28.702 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.75789061, 2024-04-26T10:22:28.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.053974093000000001, 2024-04-26T10:22:28.702 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.702 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.702 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.702 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.702 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.703 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 83603 2024-04-26T10:22:28.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.703 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:28.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853440+0000", 2024-04-26T10:22:28.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853439+0000", 2024-04-26T10:22:28.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853492+0000", 2024-04-26T10:22:28.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2265000000000002e-05 2024-04-26T10:22:28.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853504+0000", 2024-04-26T10:22:28.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2354999999999999e-05 2024-04-26T10:22:28.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.853512+0000", 2024-04-26T10:22:28.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8630000000000008e-06 2024-04-26T10:22:28.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855839+0000", 2024-04-26T10:22:28.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002326776 2024-04-26T10:22:28.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.855993+0000", 2024-04-26T10:22:28.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015428300000000001 2024-04-26T10:22:28.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:28.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.856138+0000", 2024-04-26T10:22:28.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000145427 2024-04-26T10:22:28.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:28.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.861318+0000", 2024-04-26T10:22:28.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051795160000000003 2024-04-26T10:22:28.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:28.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907178+0000", 2024-04-26T10:22:28.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.045859882999999997 2024-04-26T10:22:28.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907260+0000", 2024-04-26T10:22:28.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2133999999999997e-05 2024-04-26T10:22:28.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:10.907414+0000", 2024-04-26T10:22:28.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015427400000000001 2024-04-26T10:22:28.707 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.707 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.707 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.708 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:28.708 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:28.708 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.5767263749999998, 2024-04-26T10:22:28.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:22:28.708 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.708 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.708 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.708 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.708 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.708 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:22:28.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.708 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:28.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:28.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:22:28.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:28.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:22:28.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:22:28.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:22:28.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:22:28.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:22:28.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:22:28.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:22:28.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:22:28.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:22:28.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:22:28.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:28.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:22:28.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:22:28.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:28.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:22:28.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:22:28.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:28.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:22:28.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:22:28.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:22:28.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:22:28.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:22:28.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:22:28.713 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.713 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.713 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.714 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:28.714 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:28.714 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.5765027790000001, 2024-04-26T10:22:28.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:22:28.714 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:28.714 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:28.714 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:28.714 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:28.714 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:28.714 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:22:28.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.714 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:28.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:28.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:28.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:28.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:28.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:28.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:28.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:22:28.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:28.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:28.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:22:28.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:22:28.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:28.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:22:28.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:22:28.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:28.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:22:28.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:22:28.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:28.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:22:28.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:22:28.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:28.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:22:28.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:22:28.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:28.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:22:28.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:22:28.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:28.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:22:28.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:22:28.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:28.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:22:28.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:22:28.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:28.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:22:28.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:22:28.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:28.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:28.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:28.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:22:28.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:22:28.719 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.719 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.719 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.719 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:28.719 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:28.719 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:28.720 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:28.721 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:28.716+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:28.721 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:28.721 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:28.721 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:28.722 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 55 16 119654 119638 135.936 129 0.00332989 0.00735098 2024-04-26T10:22:28.722 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:28.723 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:28.723 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:28.821 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:28.819+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:28.860 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:28.860 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:28.874 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:28.922 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:28.916+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:29.004 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:29.005 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:29.017 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:29.066 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:29.064+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:29.124 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:29.123+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:29.158 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:29.158 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:29.173 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:29.226 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:29.223+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:29.300 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:29.300 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:29.312 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:29.326 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:29.320+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:29.426 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:29.427+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:29.435 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:29.435 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:29.451 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:29.527 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:29.524+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:29.582 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:29.582 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:29.595 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:29.618 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 56 16 121540 121524 135.613 117.875 0.00406944 0.00736829 2024-04-26T10:22:29.639 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:29.636+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:29.728 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:29.727+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:29.731 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:29.731 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:29.745 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:29.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~41s 2024-04-26T10:22:29.830 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:29.827+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:29.856 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:22:29.874 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:29.874 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:29.889 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:29.931 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:29.928+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:30.022 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:30.022 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:30.032 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:30.028+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:30.036 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:30.133 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:30.128+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:30.171 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:30.171 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:30.185 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:30.234 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:30.231+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:30.314 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:30.314 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:30.327 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:30.336 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:30.332+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:30.436 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:30.435+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:30.459 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:30.459 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:30.472 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:30.537 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:30.535+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:30.607 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:30.607 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:30.619 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 57 16 123545 123529 135.432 125.312 0.00699809 0.00737812 2024-04-26T10:22:30.620 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:30.638 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:30.635+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:30.724 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:22:30.739 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:30.739+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:30.749 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:30.749 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:30.761 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:30.840 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:30.839+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:30.883 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:30.900 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:30.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.368089464000001, 2024-04-26T10:22:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:30.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:30.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.906 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.363554252, 2024-04-26T10:22:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.907 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.362922959999999, 2024-04-26T10:22:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:30.912 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.917 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:83599 5.3 5:c6d96bef:::benchmark_data_smithi052_19421_object83598:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-26T10:22:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.046023177999999, 2024-04-26T10:22:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050758893999999999, 2024-04-26T10:22:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 83599 2024-04-26T10:22:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:30.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851412+0000", 2024-04-26T10:22:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851411+0000", 2024-04-26T10:22:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851465+0000", 2024-04-26T10:22:30.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3943999999999997e-05 2024-04-26T10:22:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851475+0000", 2024-04-26T10:22:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0220999999999999e-05 2024-04-26T10:22:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851482+0000", 2024-04-26T10:22:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3259999999999998e-06 2024-04-26T10:22:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851525+0000", 2024-04-26T10:22:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2255000000000001e-05 2024-04-26T10:22:30.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.851617+0000", 2024-04-26T10:22:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2436999999999996e-05 2024-04-26T10:22:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902102+0000", 2024-04-26T10:22:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.050485163 2024-04-26T10:22:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902130+0000", 2024-04-26T10:22:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8177000000000001e-05 2024-04-26T10:22:30.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:10.902171+0000", 2024-04-26T10:22:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1091999999999999e-05 2024-04-26T10:22:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110555 5.9 5:919989b3:::benchmark_data_smithi052_19421_object110554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.8641257549999999, 2024-04-26T10:22:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129736717, 2024-04-26T10:22:30.922 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110555 2024-04-26T10:22:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033309+0000", 2024-04-26T10:22:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033393+0000", 2024-04-26T10:22:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3690999999999995e-05 2024-04-26T10:22:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033401+0000", 2024-04-26T10:22:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4319999999999999e-06 2024-04-26T10:22:30.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033406+0000", 2024-04-26T10:22:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2340000000000002e-06 2024-04-26T10:22:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033467+0000", 2024-04-26T10:22:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0915999999999997e-05 2024-04-26T10:22:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033550+0000", 2024-04-26T10:22:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3057000000000001e-05 2024-04-26T10:22:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033676+0000", 2024-04-26T10:22:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126162 2024-04-26T10:22:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037902+0000", 2024-04-26T10:22:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042255720000000004 2024-04-26T10:22:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162728+0000", 2024-04-26T10:22:30.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12482583799999999 2024-04-26T10:22:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162839+0000", 2024-04-26T10:22:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111222 2024-04-26T10:22:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163047+0000", 2024-04-26T10:22:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207686 2024-04-26T10:22:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110556 5.1 5:822c74bd:::benchmark_data_smithi052_19421_object110555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.8640166479999998, 2024-04-26T10:22:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129274783, 2024-04-26T10:22:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110556 2024-04-26T10:22:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033418+0000", 2024-04-26T10:22:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033472+0000", 2024-04-26T10:22:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3780999999999999e-05 2024-04-26T10:22:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033478+0000", 2024-04-26T10:22:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6049999999999997e-06 2024-04-26T10:22:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033482+0000", 2024-04-26T10:22:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9110000000000001e-06 2024-04-26T10:22:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033509+0000", 2024-04-26T10:22:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6415e-05 2024-04-26T10:22:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033650+0000", 2024-04-26T10:22:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014088999999999999 2024-04-26T10:22:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161877+0000", 2024-04-26T10:22:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128227707 2024-04-26T10:22:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162541+0000", 2024-04-26T10:22:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000663863 2024-04-26T10:22:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162694+0000", 2024-04-26T10:22:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015245699999999999 2024-04-26T10:22:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.932 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110558 5.3 5:c73f56b6:::benchmark_data_smithi052_19421_object110557:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.8638200129999998, 2024-04-26T10:22:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12864012999999999, 2024-04-26T10:22:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110558 2024-04-26T10:22:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033615+0000", 2024-04-26T10:22:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033717+0000", 2024-04-26T10:22:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102298 2024-04-26T10:22:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033725+0000", 2024-04-26T10:22:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0090000000000007e-06 2024-04-26T10:22:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033731+0000", 2024-04-26T10:22:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8919999999999997e-06 2024-04-26T10:22:30.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033769+0000", 2024-04-26T10:22:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7682999999999998e-05 2024-04-26T10:22:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033891+0000", 2024-04-26T10:22:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121718 2024-04-26T10:22:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161912+0000", 2024-04-26T10:22:30.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128021512 2024-04-26T10:22:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162043+0000", 2024-04-26T10:22:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130588 2024-04-26T10:22:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162256+0000", 2024-04-26T10:22:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021311499999999999 2024-04-26T10:22:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110557 5.b e45/37 5:d659544e:::benchmark_data_smithi052_19421_object110556:head v 45'6862, mlcod=45'6860)", 2024-04-26T10:22:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.8629157799999998, 2024-04-26T10:22:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12783012499999999, 2024-04-26T10:22:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034519+0000", 2024-04-26T10:22:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034526+0000", 2024-04-26T10:22:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0380000000000002e-06 2024-04-26T10:22:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034539+0000", 2024-04-26T10:22:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.27e-05 2024-04-26T10:22:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034545+0000", 2024-04-26T10:22:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3369999999999996e-06 2024-04-26T10:22:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034606+0000", 2024-04-26T10:22:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0752999999999999e-05 2024-04-26T10:22:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034627+0000", 2024-04-26T10:22:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.088e-05 2024-04-26T10:22:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162272+0000", 2024-04-26T10:22:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12764540199999999 2024-04-26T10:22:30.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162350+0000", 2024-04-26T10:22:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7835000000000003e-05 2024-04-26T10:22:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110554 5.0 e45/37 5:04324c12:::benchmark_data_smithi052_19421_object110553:head v 45'6903, mlcod=45'6898)", 2024-04-26T10:22:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.8611563579999997, 2024-04-26T10:22:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12566923499999999, 2024-04-26T10:22:30.942 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036278+0000", 2024-04-26T10:22:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036313+0000", 2024-04-26T10:22:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5247999999999999e-05 2024-04-26T10:22:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036324+0000", 2024-04-26T10:22:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0496000000000001e-05 2024-04-26T10:22:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036329+0000", 2024-04-26T10:22:30.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3070000000000002e-06 2024-04-26T10:22:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036364+0000", 2024-04-26T10:22:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4391000000000003e-05 2024-04-26T10:22:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036377+0000", 2024-04-26T10:22:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3706999999999999e-05 2024-04-26T10:22:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042032+0000", 2024-04-26T10:22:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056547120000000001 2024-04-26T10:22:30.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161949+0000", 2024-04-26T10:22:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119916482 2024-04-26T10:22:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110559 5.2 5:44c3f174:::benchmark_data_smithi052_19421_object110558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.8595377480000002, 2024-04-26T10:22:30.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12530391299999999, 2024-04-26T10:22:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110559 2024-04-26T10:22:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037897+0000", 2024-04-26T10:22:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037922+0000", 2024-04-26T10:22:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5004e-05 2024-04-26T10:22:30.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037931+0000", 2024-04-26T10:22:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-04-26T10:22:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037937+0000", 2024-04-26T10:22:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6749999999999999e-06 2024-04-26T10:22:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037972+0000", 2024-04-26T10:22:30.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4678000000000002e-05 2024-04-26T10:22:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038108+0000", 2024-04-26T10:22:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013689099999999999 2024-04-26T10:22:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162887+0000", 2024-04-26T10:22:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124778258 2024-04-26T10:22:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163010+0000", 2024-04-26T10:22:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122924 2024-04-26T10:22:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163202+0000", 2024-04-26T10:22:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192203 2024-04-26T10:22:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110560 5.3 5:caf5a141:::benchmark_data_smithi052_19421_object110559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.8594871470000003, 2024-04-26T10:22:30.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12888738299999999, 2024-04-26T10:22:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110560 2024-04-26T10:22:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037948+0000", 2024-04-26T10:22:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037973+0000", 2024-04-26T10:22:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5187000000000001e-05 2024-04-26T10:22:30.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037978+0000", 2024-04-26T10:22:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4120000000000003e-06 2024-04-26T10:22:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037981+0000", 2024-04-26T10:22:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6689999999999999e-06 2024-04-26T10:22:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038041+0000", 2024-04-26T10:22:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9324999999999999e-05 2024-04-26T10:22:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038179+0000", 2024-04-26T10:22:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013832499999999999 2024-04-26T10:22:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166427+0000", 2024-04-26T10:22:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128248165 2024-04-26T10:22:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166539+0000", 2024-04-26T10:22:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111538 2024-04-26T10:22:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166836+0000", 2024-04-26T10:22:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029714100000000001 2024-04-26T10:22:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110561 5.d 5:b143edec:::benchmark_data_smithi052_19421_object110560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:30.956 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.8594450890000003, 2024-04-26T10:22:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.125215574, 2024-04-26T10:22:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110561 2024-04-26T10:22:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037990+0000", 2024-04-26T10:22:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038028+0000", 2024-04-26T10:22:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7802999999999997e-05 2024-04-26T10:22:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038035+0000", 2024-04-26T10:22:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-06 2024-04-26T10:22:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038040+0000", 2024-04-26T10:22:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.147e-06 2024-04-26T10:22:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038077+0000", 2024-04-26T10:22:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7166999999999998e-05 2024-04-26T10:22:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038192+0000", 2024-04-26T10:22:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115565 2024-04-26T10:22:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038319+0000", 2024-04-26T10:22:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012697699999999999 2024-04-26T10:22:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162690+0000", 2024-04-26T10:22:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12437065 2024-04-26T10:22:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162878+0000", 2024-04-26T10:22:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000188173 2024-04-26T10:22:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162992+0000", 2024-04-26T10:22:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114008 2024-04-26T10:22:30.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163206+0000", 2024-04-26T10:22:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021394900000000001 2024-04-26T10:22:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.8593844849999996, 2024-04-26T10:22:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:22:30.962 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:22:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:22:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:22:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:22:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:22:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:22:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:22:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:22:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:22:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:22:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:22:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:22:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:22:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:22:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:22:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:22:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:22:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110564 5.3 5:c09e33cb:::benchmark_data_smithi052_19421_object110563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.8593318270000001, 2024-04-26T10:22:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128984614, 2024-04-26T10:22:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:30.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110564 2024-04-26T10:22:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038103+0000", 2024-04-26T10:22:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038136+0000", 2024-04-26T10:22:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.243e-05 2024-04-26T10:22:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038143+0000", 2024-04-26T10:22:30.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0870000000000001e-06 2024-04-26T10:22:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038151+0000", 2024-04-26T10:22:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:22:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039813+0000", 2024-04-26T10:22:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001661844 2024-04-26T10:22:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039970+0000", 2024-04-26T10:22:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015712699999999999 2024-04-26T10:22:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166854+0000", 2024-04-26T10:22:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.126883788 2024-04-26T10:22:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166976+0000", 2024-04-26T10:22:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012231399999999999 2024-04-26T10:22:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167088+0000", 2024-04-26T10:22:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011243699999999999 2024-04-26T10:22:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.8592752340000001, 2024-04-26T10:22:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:22:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.972 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:22:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:22:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:22:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:22:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:22:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:22:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:22:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:22:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:22:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:22:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:22:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:22:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:22:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:22:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:22:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:22:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:22:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110566 5.c 5:34145698:::benchmark_data_smithi052_19421_object110565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.859225457, 2024-04-26T10:22:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12673530699999999, 2024-04-26T10:22:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:30.977 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110566 2024-04-26T10:22:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038246+0000", 2024-04-26T10:22:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5759000000000001e-05 2024-04-26T10:22:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038252+0000", 2024-04-26T10:22:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5300000000000002e-06 2024-04-26T10:22:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038257+0000", 2024-04-26T10:22:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038312+0000", 2024-04-26T10:22:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5108000000000002e-05 2024-04-26T10:22:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038480+0000", 2024-04-26T10:22:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016751099999999999 2024-04-26T10:22:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164651+0000", 2024-04-26T10:22:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12617115600000001 2024-04-26T10:22:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164770+0000", 2024-04-26T10:22:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118748 2024-04-26T10:22:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164946+0000", 2024-04-26T10:22:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175966 2024-04-26T10:22:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.8568778219999995, 2024-04-26T10:22:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:22:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.982 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:22:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:22:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:22:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:22:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:22:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:22:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:22:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:22:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:22:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:22:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:22:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:22:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:22:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:22:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:22:30.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:22:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:22:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:22:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:22:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:22:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:22:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:22:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110568 5.c 5:34af8ad3:::benchmark_data_smithi052_19421_object110567:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.8567601969999998, 2024-04-26T10:22:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124943661, 2024-04-26T10:22:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:30.988 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110568 2024-04-26T10:22:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040711+0000", 2024-04-26T10:22:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6531e-05 2024-04-26T10:22:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040719+0000", 2024-04-26T10:22:30.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6120000000000001e-06 2024-04-26T10:22:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040724+0000", 2024-04-26T10:22:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2100000000000001e-06 2024-04-26T10:22:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040771+0000", 2024-04-26T10:22:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7123000000000003e-05 2024-04-26T10:22:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040984+0000", 2024-04-26T10:22:30.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021227400000000001 2024-04-26T10:22:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165350+0000", 2024-04-26T10:22:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124366738 2024-04-26T10:22:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165459+0000", 2024-04-26T10:22:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108168 2024-04-26T10:22:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165619+0000", 2024-04-26T10:22:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160564 2024-04-26T10:22:30.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.8566918980000002, 2024-04-26T10:22:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:22:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:30.993 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:22:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:30.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:22:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:22:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:22:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:22:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:22:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:22:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:22:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:22:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:22:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:22:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:22:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:22:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:22:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:22:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:22:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:22:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:22:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:22:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:22:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:22:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:22:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110570 5.1 5:876a468c:::benchmark_data_smithi052_19421_object110569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:30.998 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.8553893529999996, 2024-04-26T10:22:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12851437099999999, 2024-04-26T10:22:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110570 2024-04-26T10:22:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:30.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042045+0000", 2024-04-26T10:22:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:31.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042083+0000", 2024-04-26T10:22:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8064e-05 2024-04-26T10:22:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161855+0000", 2024-04-26T10:22:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119771934 2024-04-26T10:22:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161882+0000", 2024-04-26T10:22:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7083000000000001e-05 2024-04-26T10:22:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:31.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163117+0000", 2024-04-26T10:22:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001234509 2024-04-26T10:22:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163507+0000", 2024-04-26T10:22:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038998400000000001 2024-04-26T10:22:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170347+0000", 2024-04-26T10:22:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006840952 2024-04-26T10:22:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170488+0000", 2024-04-26T10:22:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140393 2024-04-26T10:22:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170561+0000", 2024-04-26T10:22:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2809e-05 2024-04-26T10:22:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.003 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:31.003 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:31.004 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:31.005 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:31.006 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:31.006 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:31.000+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:31.006 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:31.007 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:31.007 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:31.007 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:31.042 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T10:22:31.124 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:31.124 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:31.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.124 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124470 5.8 5:11fbe45f:::benchmark_data_smithi052_19421_object124469:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.124 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.076120+0000", 2024-04-26T10:22:31.124 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.047276460999999999, 2024-04-26T10:22:31.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.047312462, 2024-04-26T10:22:31.125 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.125 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:31.125 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.125 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.125 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.125 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124470 2024-04-26T10:22:31.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.125 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.076120+0000", 2024-04-26T10:22:31.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.076120+0000", 2024-04-26T10:22:31.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.076119+0000", 2024-04-26T10:22:31.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.076171+0000", 2024-04-26T10:22:31.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1323000000000003e-05 2024-04-26T10:22:31.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.076180+0000", 2024-04-26T10:22:31.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6709999999999994e-06 2024-04-26T10:22:31.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.076185+0000", 2024-04-26T10:22:31.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8969999999999999e-06 2024-04-26T10:22:31.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080465+0000", 2024-04-26T10:22:31.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042795000000000003 2024-04-26T10:22:31.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080629+0000", 2024-04-26T10:22:31.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016487300000000001 2024-04-26T10:22:31.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.128 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.129 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.129 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:31.129 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.044833260999999999, 2024-04-26T10:22:31.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.044934204999999998, 2024-04-26T10:22:31.129 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.129 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:31.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.129 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:22:31.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.130 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:31.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:31.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:22:31.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:31.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:22:31.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:22:31.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:22:31.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:22:31.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:22:31.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:22:31.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:22:31.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:22:31.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:22:31.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:22:31.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:31.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:22:31.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:22:31.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.133 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.133 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124476 5.e 5:7ad6fa8a:::benchmark_data_smithi052_19421_object124475:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.133 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078826+0000", 2024-04-26T10:22:31.133 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.044570907999999999, 2024-04-26T10:22:31.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.044731792999999999, 2024-04-26T10:22:31.134 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.134 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:31.134 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.134 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.134 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.134 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124476 2024-04-26T10:22:31.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.134 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078826+0000", 2024-04-26T10:22:31.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078826+0000", 2024-04-26T10:22:31.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078825+0000", 2024-04-26T10:22:31.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:31.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078887+0000", 2024-04-26T10:22:31.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1926000000000003e-05 2024-04-26T10:22:31.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078895+0000", 2024-04-26T10:22:31.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1410000000000005e-06 2024-04-26T10:22:31.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078901+0000", 2024-04-26T10:22:31.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9719999999999997e-06 2024-04-26T10:22:31.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081823+0000", 2024-04-26T10:22:31.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029216480000000002 2024-04-26T10:22:31.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081964+0000", 2024-04-26T10:22:31.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014101000000000001 2024-04-26T10:22:31.137 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.137 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.137 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.138 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5.eb62b8b0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.138 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:31.138 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.042152042000000001, 2024-04-26T10:22:31.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042361940000000001, 2024-04-26T10:22:31.138 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.138 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:31.138 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.138 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.138 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.138 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:22:31.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.138 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:31.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:31.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:22:31.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:31.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:22:31.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:22:31.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:22:31.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:22:31.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:22:31.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:22:31.141 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.141 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.141 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.141 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5.9ecaca08 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.141 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:31.141 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.041784966999999999, 2024-04-26T10:22:31.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042036460999999997, 2024-04-26T10:22:31.141 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.142 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:31.142 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.142 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.142 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.142 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:22:31.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.142 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:31.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:31.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:22:31.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:22:31.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:22:31.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:22:31.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:22:31.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:22:31.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:22:31.144 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5.9ec57ef8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.041720714999999998, 2024-04-26T10:22:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.042023155999999999, 2024-04-26T10:22:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.145 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:22:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:22:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:22:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:22:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:22:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:22:31.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:22:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:22:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.057722468999999998, 2024-04-26T10:22:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.058088038000000002, 2024-04-26T10:22:31.148 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:22:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:22:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:22:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:22:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:22:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:22:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:22:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:22:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:22:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:22:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:22:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:22:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:22:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:22:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:22:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:22:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.152 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:124481 5.d e48/37 5:b507cdbb:::benchmark_data_smithi052_19421_object124480:head v 48'7882, mlcod=48'7879)", 2024-04-26T10:22:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.082120+0000", 2024-04-26T10:22:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.041276862999999997, 2024-04-26T10:22:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.041722857000000002, 2024-04-26T10:22:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.082120+0000", 2024-04-26T10:22:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.082120+0000", 2024-04-26T10:22:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.082119+0000", 2024-04-26T10:22:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.082176+0000", 2024-04-26T10:22:31.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6768999999999998e-05 2024-04-26T10:22:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.082184+0000", 2024-04-26T10:22:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1159999999999999e-06 2024-04-26T10:22:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.082190+0000", 2024-04-26T10:22:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3099999999999997e-06 2024-04-26T10:22:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.082226+0000", 2024-04-26T10:22:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5723999999999999e-05 2024-04-26T10:22:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.082247+0000", 2024-04-26T10:22:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1409000000000001e-05 2024-04-26T10:22:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124483 5.b 5:d36744a3:::benchmark_data_smithi052_19421_object124482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.082909+0000", 2024-04-26T10:22:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.040487812999999997, 2024-04-26T10:22:31.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.040997051999999999, 2024-04-26T10:22:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124483 2024-04-26T10:22:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.082909+0000", 2024-04-26T10:22:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.082909+0000", 2024-04-26T10:22:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.082908+0000", 2024-04-26T10:22:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.082986+0000", 2024-04-26T10:22:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8139000000000005e-05 2024-04-26T10:22:31.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.082994+0000", 2024-04-26T10:22:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4740000000000005e-06 2024-04-26T10:22:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083000+0000", 2024-04-26T10:22:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3329999999999996e-06 2024-04-26T10:22:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083046+0000", 2024-04-26T10:22:31.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6406000000000003e-05 2024-04-26T10:22:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083168+0000", 2024-04-26T10:22:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012213099999999999 2024-04-26T10:22:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083310+0000", 2024-04-26T10:22:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014188800000000001 2024-04-26T10:22:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:31.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.085988+0000", 2024-04-26T10:22:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002677479 2024-04-26T10:22:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124485 5.e 5:7a30cadf:::benchmark_data_smithi052_19421_object124484:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.084264+0000", 2024-04-26T10:22:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.039132562000000003, 2024-04-26T10:22:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.039721205000000002, 2024-04-26T10:22:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.161 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124485 2024-04-26T10:22:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.084264+0000", 2024-04-26T10:22:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.084264+0000", 2024-04-26T10:22:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.084263+0000", 2024-04-26T10:22:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.084364+0000", 2024-04-26T10:22:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010100899999999999 2024-04-26T10:22:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.084371+0000", 2024-04-26T10:22:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.233e-06 2024-04-26T10:22:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.084376+0000", 2024-04-26T10:22:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9169999999999997e-06 2024-04-26T10:22:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.084427+0000", 2024-04-26T10:22:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0940999999999999e-05 2024-04-26T10:22:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.084539+0000", 2024-04-26T10:22:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111563 2024-04-26T10:22:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.164 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.055711365999999998, 2024-04-26T10:22:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.056367804000000001, 2024-04-26T10:22:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:22:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.165 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:31.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:22:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:22:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:22:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:22:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:22:31.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:22:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:22:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:22:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:22:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:22:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:22:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:22:31.168 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop_reply(client.4722.0:124451 5.0 e48/37)", 2024-04-26T10:22:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.085863+0000", 2024-04-26T10:22:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.037533285, 2024-04-26T10:22:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.038257719000000003, 2024-04-26T10:22:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.085863+0000", 2024-04-26T10:22:31.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.085863+0000", 2024-04-26T10:22:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.085863+0000", 2024-04-26T10:22:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.085867+0000", 2024-04-26T10:22:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8439999999999997e-06 2024-04-26T10:22:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.085875+0000", 2024-04-26T10:22:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5599999999999996e-06 2024-04-26T10:22:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.085879+0000", 2024-04-26T10:22:31.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0069999999999999e-06 2024-04-26T10:22:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124488 5.a 5:5cccd8eb:::benchmark_data_smithi052_19421_object124487:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.085977+0000", 2024-04-26T10:22:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.037419308999999998, 2024-04-26T10:22:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.038196069999999999, 2024-04-26T10:22:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.172 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124488 2024-04-26T10:22:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.085977+0000", 2024-04-26T10:22:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.085977+0000", 2024-04-26T10:22:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.085976+0000", 2024-04-26T10:22:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086017+0000", 2024-04-26T10:22:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0485999999999998e-05 2024-04-26T10:22:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086025+0000", 2024-04-26T10:22:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3699999999999995e-06 2024-04-26T10:22:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086030+0000", 2024-04-26T10:22:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0359999999999997e-06 2024-04-26T10:22:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086064+0000", 2024-04-26T10:22:31.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3441000000000001e-05 2024-04-26T10:22:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086145+0000", 2024-04-26T10:22:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0972999999999999e-05 2024-04-26T10:22:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5.14d4e238 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.037322042, 2024-04-26T10:22:31.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.038161414999999997, 2024-04-26T10:22:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:22:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:22:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:22:31.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:22:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:22:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:22:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:22:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:22:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop_reply(client.4722.0:124472 5.0 e48/37)", 2024-04-26T10:22:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086332+0000", 2024-04-26T10:22:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.037064106999999999, 2024-04-26T10:22:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.037953606000000001, 2024-04-26T10:22:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086332+0000", 2024-04-26T10:22:31.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086332+0000", 2024-04-26T10:22:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086332+0000", 2024-04-26T10:22:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086335+0000", 2024-04-26T10:22:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.517e-06 2024-04-26T10:22:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086340+0000", 2024-04-26T10:22:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5369999999999999e-06 2024-04-26T10:22:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086344+0000", 2024-04-26T10:22:31.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8720000000000004e-06 2024-04-26T10:22:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:31.183 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 15 2024-04-26T10:22:31.183 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:31.184 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:31.185 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:31.103+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:31.206 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:31.200+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:31.307 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:31.307+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:31.315 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:31.315 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:31.315 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:31.315 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:31.315 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:31.328 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:31.407 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:31.404+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:31.498 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:31.499 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:31.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:31.499 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:31.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.499 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:31.499 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:31.499 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.966730026, 2024-04-26T10:22:31.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:31.499 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.499 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.499 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.499 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.500 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.500 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:31.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.500 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:31.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:31.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:31.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:31.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:31.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:31.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:31.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:31.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:31.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:31.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:31.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:31.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:31.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:31.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:31.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:31.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:31.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:31.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:31.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:31.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:31.503 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.504 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.504 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.504 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:31.504 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:31.504 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.964747799000001, 2024-04-26T10:22:31.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:31.504 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.504 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.504 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.504 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.504 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.504 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:31.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.505 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:31.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:31.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:31.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:31.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:31.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:31.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:31.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:31.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:31.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:31.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:31.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:31.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:31.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:31.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:31.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:31.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:31.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:31.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:31.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:31.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:31.508 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.509 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.509 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.509 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:31.509 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:31.509 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.964548414999999, 2024-04-26T10:22:31.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:31.509 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.509 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.509 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.509 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.509 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.509 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:31.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.510 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:31.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:31.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:31.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:31.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:31.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:31.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:31.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:31.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:31.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:31.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:31.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:31.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:31.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:31.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:31.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:31.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:31.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:31.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:31.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:31.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:31.513 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.513 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.513 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.514 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:31.514 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:31.514 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.964329795000001, 2024-04-26T10:22:31.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:31.514 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.514 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.514 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:31.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:31.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:31.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:31.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:31.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:31.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:31.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:31.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:31.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:31.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:31.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:31.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:31.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:31.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:31.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:31.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:31.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.517 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.518 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.518 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:31.518 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:31.518 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.961958357, 2024-04-26T10:22:31.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:31.518 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.518 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.518 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.518 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.518 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.518 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:31.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.519 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:31.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:31.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:31.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:31.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:31.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:31.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:31.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:31.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:31.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:31.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:31.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:31.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:31.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:31.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:31.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:31.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:31.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:31.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:31.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:31.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:31.523 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.523 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.523 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.523 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:31.523 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:31.523 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.961857734999999, 2024-04-26T10:22:31.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:31.523 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.523 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.523 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:31.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.524 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:31.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:31.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:31.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:31.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:31.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:31.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:31.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:31.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:31.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:31.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:31.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:31.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:31.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:31.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:31.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:31.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:31.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:31.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:31.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:31.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:31.527 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.527 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.527 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.528 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:31.528 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:31.528 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.961739174000002, 2024-04-26T10:22:31.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:31.528 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.528 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.528 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:31.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:31.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:31.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:31.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:31.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:31.531 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.961636775999999, 2024-04-26T10:22:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.532 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.536 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.960616218999998, 2024-04-26T10:22:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.537 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:31.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:31.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:31.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.959465944000002, 2024-04-26T10:22:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.546 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.4627667019999997, 2024-04-26T10:22:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:22:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:22:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:22:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:22:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:22:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:22:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:22:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:22:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:22:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:22:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:22:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:22:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:22:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:22:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:22:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:22:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:22:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:22:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:22:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:22:31.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:22:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:22:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:22:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 7.462543106, 2024-04-26T10:22:31.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:22:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:22:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:22:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:22:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:22:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:22:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:22:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:22:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:22:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:22:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:22:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:22:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:22:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:22:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:22:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:22:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:22:31.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:22:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:22:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:22:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:22:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:22:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:22:31.557 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.431696786, 2024-04-26T10:22:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:22:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.558 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:22:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:22:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:22:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:22:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:22:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:22:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:22:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:22:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:22:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:22:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:22:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:22:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:22:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:22:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:22:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:22:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:22:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:22:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:22:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:22:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:22:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:22:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.563 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.42968568299999998, 2024-04-26T10:22:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:22:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:22:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:31.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:22:31.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:22:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:22:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:22:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:22:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:22:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:22:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:22:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:22:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:22:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:22:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:22:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:31.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:22:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:22:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:22:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:22:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:22:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:22:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:22:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:22:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.41880757800000001, 2024-04-26T10:22:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:22:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.569 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:22:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:22:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:22:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:22:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:22:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:22:31.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:22:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:22:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:22:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:22:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:22:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:22:31.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:22:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:22:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:22:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:22:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:22:31.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:22:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:22:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:22:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:22:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:22:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.416126359, 2024-04-26T10:22:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:22:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:22:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:22:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:22:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:22:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:22:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:22:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:22:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:22:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:22:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:22:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:22:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:22:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:22:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:22:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:22:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:22:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:22:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:22:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:22:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:22:31.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:22:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:22:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.41575928400000001, 2024-04-26T10:22:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:22:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.580 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:22:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:31.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:22:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:22:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:22:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:22:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:22:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:22:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:22:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:22:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:22:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:22:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:22:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:22:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:22:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:22:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:22:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:22:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:22:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.41569503200000002, 2024-04-26T10:22:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:22:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.585 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:22:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:22:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:22:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:22:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:22:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:22:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:22:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:22:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:22:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:22:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:22:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:22:31.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:22:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:22:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:22:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:22:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:22:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:22:31.589 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.411296359, 2024-04-26T10:22:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:22:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.590 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:22:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:22:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:22:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:22:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:22:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:22:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:22:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:22:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:22:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:22:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:22:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:22:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:31.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:22:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:22:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:22:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:22:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:22:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:22:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.594 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.40953837599999998, 2024-04-26T10:22:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:22:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:22:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.595 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:22:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:22:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:22:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:22:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:22:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:22:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:22:31.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:22:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:22:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:22:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:22:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:22:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:22:31.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:22:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:22:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:22:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:22:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:22:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:22:31.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:22:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:22:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:31.600 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:31.600 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:31.602 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:31.599+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:31.602 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:31.619 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 58 16 125430 125414 135.128 117.812 0.00469815 0.0073948 2024-04-26T10:22:31.702 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:31.696+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:31.735 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:31.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:125633 5.6 5:682c2a14:::benchmark_data_smithi052_19421_object125632:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.727232+0000", 2024-04-26T10:22:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0066813469999999998, 2024-04-26T10:22:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0067078160000000001, 2024-04-26T10:22:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 125633 2024-04-26T10:22:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.727232+0000", 2024-04-26T10:22:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.727232+0000", 2024-04-26T10:22:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.727230+0000", 2024-04-26T10:22:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.727316+0000", 2024-04-26T10:22:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5986e-05 2024-04-26T10:22:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.727333+0000", 2024-04-26T10:22:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6545000000000002e-05 2024-04-26T10:22:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.727343+0000", 2024-04-26T10:22:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0261000000000001e-05 2024-04-26T10:22:31.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.727396+0000", 2024-04-26T10:22:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3177999999999998e-05 2024-04-26T10:22:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.727523+0000", 2024-04-26T10:22:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012699099999999999 2024-04-26T10:22:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:31.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:125634 5.2 5:43a06d1b:::benchmark_data_smithi052_19421_object125633:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.727359+0000", 2024-04-26T10:22:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0065542480000000004, 2024-04-26T10:22:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066602220000000004, 2024-04-26T10:22:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 125634 2024-04-26T10:22:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.740 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.727359+0000", 2024-04-26T10:22:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.727359+0000", 2024-04-26T10:22:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.727358+0000", 2024-04-26T10:22:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:31.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.727394+0000", 2024-04-26T10:22:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5855000000000001e-05 2024-04-26T10:22:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.727403+0000", 2024-04-26T10:22:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5900000000000008e-06 2024-04-26T10:22:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.727412+0000", 2024-04-26T10:22:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7350000000000008e-06 2024-04-26T10:22:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.727474+0000", 2024-04-26T10:22:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1203000000000003e-05 2024-04-26T10:22:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.727630+0000", 2024-04-26T10:22:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015680199999999999 2024-04-26T10:22:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:31.743 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:125636 5.b e48/37 5:de5a85f6:::benchmark_data_smithi052_19421_object125635:head v 48'7806, mlcod=48'7803)", 2024-04-26T10:22:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.729367+0000", 2024-04-26T10:22:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0045462280000000002, 2024-04-26T10:22:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047125600000000002, 2024-04-26T10:22:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729367+0000", 2024-04-26T10:22:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729367+0000", 2024-04-26T10:22:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729366+0000", 2024-04-26T10:22:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729372+0000", 2024-04-26T10:22:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0399999999999998e-06 2024-04-26T10:22:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729382+0000", 2024-04-26T10:22:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0332999999999999e-05 2024-04-26T10:22:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729390+0000", 2024-04-26T10:22:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1539999999999996e-06 2024-04-26T10:22:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729422+0000", 2024-04-26T10:22:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2042000000000003e-05 2024-04-26T10:22:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729433+0000", 2024-04-26T10:22:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.145e-05 2024-04-26T10:22:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:125637 5.6 5:6d55d401:::benchmark_data_smithi052_19421_object125636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.729578+0000", 2024-04-26T10:22:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0043346449999999998, 2024-04-26T10:22:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045571630000000004, 2024-04-26T10:22:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:31.747 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 125637 2024-04-26T10:22:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729578+0000", 2024-04-26T10:22:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729578+0000", 2024-04-26T10:22:31.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729577+0000", 2024-04-26T10:22:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729619+0000", 2024-04-26T10:22:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1700999999999999e-05 2024-04-26T10:22:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729633+0000", 2024-04-26T10:22:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4185999999999999e-05 2024-04-26T10:22:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729643+0000", 2024-04-26T10:22:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0376e-05 2024-04-26T10:22:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729678+0000", 2024-04-26T10:22:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4313000000000002e-05 2024-04-26T10:22:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729773+0000", 2024-04-26T10:22:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4965999999999998e-05 2024-04-26T10:22:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:125638 5.1 5:868cb8fe:::benchmark_data_smithi052_19421_object125637:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.729793+0000", 2024-04-26T10:22:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0041196119999999999, 2024-04-26T10:22:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044051280000000003, 2024-04-26T10:22:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:31.751 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 125638 2024-04-26T10:22:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729793+0000", 2024-04-26T10:22:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:31.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729793+0000", 2024-04-26T10:22:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729793+0000", 2024-04-26T10:22:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729824+0000", 2024-04-26T10:22:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1449000000000003e-05 2024-04-26T10:22:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729840+0000", 2024-04-26T10:22:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6367000000000001e-05 2024-04-26T10:22:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729850+0000", 2024-04-26T10:22:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5179999999999993e-06 2024-04-26T10:22:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.729913+0000", 2024-04-26T10:22:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2807999999999999e-05 2024-04-26T10:22:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.730078+0000", 2024-04-26T10:22:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016536400000000001 2024-04-26T10:22:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:125642 5.c 5:385924c3:::benchmark_data_smithi052_19421_object125641:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.730692+0000", 2024-04-26T10:22:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032212120000000002, 2024-04-26T10:22:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035652969999999998, 2024-04-26T10:22:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:31.755 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 125642 2024-04-26T10:22:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.730692+0000", 2024-04-26T10:22:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:31.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.730692+0000", 2024-04-26T10:22:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.730691+0000", 2024-04-26T10:22:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.730739+0000", 2024-04-26T10:22:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7936999999999999e-05 2024-04-26T10:22:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.730753+0000", 2024-04-26T10:22:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3806e-05 2024-04-26T10:22:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.730761+0000", 2024-04-26T10:22:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9570000000000002e-06 2024-04-26T10:22:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.730811+0000", 2024-04-26T10:22:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0430999999999999e-05 2024-04-26T10:22:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.731005+0000", 2024-04-26T10:22:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000193616 2024-04-26T10:22:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:125643 5.9 5:913b6836:::benchmark_data_smithi052_19421_object125642:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.732053+0000", 2024-04-26T10:22:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0018599860000000001, 2024-04-26T10:22:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022635289999999998, 2024-04-26T10:22:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:31.759 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 125643 2024-04-26T10:22:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.732053+0000", 2024-04-26T10:22:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.732053+0000", 2024-04-26T10:22:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.732052+0000", 2024-04-26T10:22:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.732112+0000", 2024-04-26T10:22:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9627999999999999e-05 2024-04-26T10:22:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.732127+0000", 2024-04-26T10:22:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5685e-05 2024-04-26T10:22:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.732136+0000", 2024-04-26T10:22:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3760000000000008e-06 2024-04-26T10:22:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.732171+0000", 2024-04-26T10:22:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5892999999999997e-05 2024-04-26T10:22:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.732271+0000", 2024-04-26T10:22:31.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9443000000000003e-05 2024-04-26T10:22:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.732385+0000", 2024-04-26T10:22:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113662 2024-04-26T10:22:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:125644 5.3 5:c5ffcf4c:::benchmark_data_smithi052_19421_object125643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.732303+0000", 2024-04-26T10:22:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00161013, 2024-04-26T10:22:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002081884, 2024-04-26T10:22:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:31.763 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 125644 2024-04-26T10:22:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.732303+0000", 2024-04-26T10:22:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.732303+0000", 2024-04-26T10:22:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.732302+0000", 2024-04-26T10:22:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.732382+0000", 2024-04-26T10:22:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0148999999999994e-05 2024-04-26T10:22:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.732398+0000", 2024-04-26T10:22:31.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5727e-05 2024-04-26T10:22:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.732405+0000", 2024-04-26T10:22:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0090000000000001e-06 2024-04-26T10:22:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.732462+0000", 2024-04-26T10:22:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7089000000000002e-05 2024-04-26T10:22:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.732548+0000", 2024-04-26T10:22:31.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5778000000000004e-05 2024-04-26T10:22:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:125646 5.d 5:b07ee314:::benchmark_data_smithi052_19421_object125645:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.733268+0000", 2024-04-26T10:22:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00064469099999999997, 2024-04-26T10:22:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011746770000000001, 2024-04-26T10:22:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:31.767 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 125646 2024-04-26T10:22:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.733268+0000", 2024-04-26T10:22:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.733268+0000", 2024-04-26T10:22:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.733267+0000", 2024-04-26T10:22:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.733370+0000", 2024-04-26T10:22:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102593 2024-04-26T10:22:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.733384+0000", 2024-04-26T10:22:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4338999999999999e-05 2024-04-26T10:22:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.733392+0000", 2024-04-26T10:22:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7449999999999995e-06 2024-04-26T10:22:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.733434+0000", 2024-04-26T10:22:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1745000000000001e-05 2024-04-26T10:22:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.733573+0000", 2024-04-26T10:22:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013912199999999999 2024-04-26T10:22:31.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.733729+0000", 2024-04-26T10:22:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015639500000000001 2024-04-26T10:22:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:125647 5.7 5:e6100747:::benchmark_data_smithi052_19421_object125646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.733831+0000", 2024-04-26T10:22:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.2081000000000002e-05, 2024-04-26T10:22:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00067814100000000005, 2024-04-26T10:22:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:31.771 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 125647 2024-04-26T10:22:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.733831+0000", 2024-04-26T10:22:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.733831+0000", 2024-04-26T10:22:31.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.733830+0000", 2024-04-26T10:22:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.733898+0000", 2024-04-26T10:22:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7819999999999998e-05 2024-04-26T10:22:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.733908+0000", 2024-04-26T10:22:31.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0042e-05 2024-04-26T10:22:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.733915+0000", 2024-04-26T10:22:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0550000000000002e-06 2024-04-26T10:22:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.733964+0000", 2024-04-26T10:22:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8730999999999998e-05 2024-04-26T10:22:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.734145+0000", 2024-04-26T10:22:31.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000181099 2024-04-26T10:22:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:31.775 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 10 2024-04-26T10:22:31.775 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:31.776 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:31.803 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:31.800+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:31.904 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:31.900+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:31.913 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:31.913 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:31.913 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:31.913 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:31.913 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:31.926 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:32.005 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:32.003+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:32.105 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.573264217999998, 2024-04-26T10:22:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:32.111 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.568729006000002, 2024-04-26T10:22:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.112 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:32.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.117 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.568097714, 2024-04-26T10:22:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:32.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110555 5.9 5:919989b3:::benchmark_data_smithi052_19421_object110554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:32.123 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0693005089999996, 2024-04-26T10:22:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129736717, 2024-04-26T10:22:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110555 2024-04-26T10:22:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033309+0000", 2024-04-26T10:22:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033393+0000", 2024-04-26T10:22:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3690999999999995e-05 2024-04-26T10:22:32.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033401+0000", 2024-04-26T10:22:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4319999999999999e-06 2024-04-26T10:22:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033406+0000", 2024-04-26T10:22:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2340000000000002e-06 2024-04-26T10:22:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033467+0000", 2024-04-26T10:22:32.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0915999999999997e-05 2024-04-26T10:22:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033550+0000", 2024-04-26T10:22:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3057000000000001e-05 2024-04-26T10:22:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033676+0000", 2024-04-26T10:22:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126162 2024-04-26T10:22:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:32.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037902+0000", 2024-04-26T10:22:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042255720000000004 2024-04-26T10:22:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162728+0000", 2024-04-26T10:22:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12482583799999999 2024-04-26T10:22:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162839+0000", 2024-04-26T10:22:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111222 2024-04-26T10:22:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163047+0000", 2024-04-26T10:22:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207686 2024-04-26T10:22:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110556 5.1 5:822c74bd:::benchmark_data_smithi052_19421_object110555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0691914019999995, 2024-04-26T10:22:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129274783, 2024-04-26T10:22:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110556 2024-04-26T10:22:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:32.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033418+0000", 2024-04-26T10:22:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033472+0000", 2024-04-26T10:22:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3780999999999999e-05 2024-04-26T10:22:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033478+0000", 2024-04-26T10:22:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6049999999999997e-06 2024-04-26T10:22:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033482+0000", 2024-04-26T10:22:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9110000000000001e-06 2024-04-26T10:22:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033509+0000", 2024-04-26T10:22:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6415e-05 2024-04-26T10:22:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033650+0000", 2024-04-26T10:22:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014088999999999999 2024-04-26T10:22:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161877+0000", 2024-04-26T10:22:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128227707 2024-04-26T10:22:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162541+0000", 2024-04-26T10:22:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000663863 2024-04-26T10:22:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162694+0000", 2024-04-26T10:22:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015245699999999999 2024-04-26T10:22:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110558 5.3 5:c73f56b6:::benchmark_data_smithi052_19421_object110557:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0689947669999995, 2024-04-26T10:22:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12864012999999999, 2024-04-26T10:22:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.134 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110558 2024-04-26T10:22:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033615+0000", 2024-04-26T10:22:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033717+0000", 2024-04-26T10:22:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102298 2024-04-26T10:22:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033725+0000", 2024-04-26T10:22:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0090000000000007e-06 2024-04-26T10:22:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033731+0000", 2024-04-26T10:22:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8919999999999997e-06 2024-04-26T10:22:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033769+0000", 2024-04-26T10:22:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7682999999999998e-05 2024-04-26T10:22:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033891+0000", 2024-04-26T10:22:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121718 2024-04-26T10:22:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161912+0000", 2024-04-26T10:22:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128021512 2024-04-26T10:22:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162043+0000", 2024-04-26T10:22:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130588 2024-04-26T10:22:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162256+0000", 2024-04-26T10:22:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021311499999999999 2024-04-26T10:22:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110557 5.b e45/37 5:d659544e:::benchmark_data_smithi052_19421_object110556:head v 45'6862, mlcod=45'6860)", 2024-04-26T10:22:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0680905339999995, 2024-04-26T10:22:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12783012499999999, 2024-04-26T10:22:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.139 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034519+0000", 2024-04-26T10:22:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034526+0000", 2024-04-26T10:22:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0380000000000002e-06 2024-04-26T10:22:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034539+0000", 2024-04-26T10:22:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.27e-05 2024-04-26T10:22:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034545+0000", 2024-04-26T10:22:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3369999999999996e-06 2024-04-26T10:22:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034606+0000", 2024-04-26T10:22:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0752999999999999e-05 2024-04-26T10:22:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034627+0000", 2024-04-26T10:22:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.088e-05 2024-04-26T10:22:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162272+0000", 2024-04-26T10:22:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12764540199999999 2024-04-26T10:22:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162350+0000", 2024-04-26T10:22:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7835000000000003e-05 2024-04-26T10:22:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110554 5.0 e45/37 5:04324c12:::benchmark_data_smithi052_19421_object110553:head v 45'6903, mlcod=45'6898)", 2024-04-26T10:22:32.143 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0663311120000003, 2024-04-26T10:22:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12566923499999999, 2024-04-26T10:22:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036278+0000", 2024-04-26T10:22:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036313+0000", 2024-04-26T10:22:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5247999999999999e-05 2024-04-26T10:22:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036324+0000", 2024-04-26T10:22:32.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0496000000000001e-05 2024-04-26T10:22:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036329+0000", 2024-04-26T10:22:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3070000000000002e-06 2024-04-26T10:22:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036364+0000", 2024-04-26T10:22:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4391000000000003e-05 2024-04-26T10:22:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036377+0000", 2024-04-26T10:22:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3706999999999999e-05 2024-04-26T10:22:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042032+0000", 2024-04-26T10:22:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056547120000000001 2024-04-26T10:22:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161949+0000", 2024-04-26T10:22:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119916482 2024-04-26T10:22:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.147 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110559 5.2 5:44c3f174:::benchmark_data_smithi052_19421_object110558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0647125020000008, 2024-04-26T10:22:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12530391299999999, 2024-04-26T10:22:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110559 2024-04-26T10:22:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037897+0000", 2024-04-26T10:22:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037922+0000", 2024-04-26T10:22:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5004e-05 2024-04-26T10:22:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037931+0000", 2024-04-26T10:22:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-04-26T10:22:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037937+0000", 2024-04-26T10:22:32.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6749999999999999e-06 2024-04-26T10:22:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037972+0000", 2024-04-26T10:22:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4678000000000002e-05 2024-04-26T10:22:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038108+0000", 2024-04-26T10:22:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013689099999999999 2024-04-26T10:22:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:32.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162887+0000", 2024-04-26T10:22:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124778258 2024-04-26T10:22:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163010+0000", 2024-04-26T10:22:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122924 2024-04-26T10:22:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163202+0000", 2024-04-26T10:22:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192203 2024-04-26T10:22:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.152 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110560 5.3 5:caf5a141:::benchmark_data_smithi052_19421_object110559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0646619009999991, 2024-04-26T10:22:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12888738299999999, 2024-04-26T10:22:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110560 2024-04-26T10:22:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037948+0000", 2024-04-26T10:22:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037973+0000", 2024-04-26T10:22:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5187000000000001e-05 2024-04-26T10:22:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037978+0000", 2024-04-26T10:22:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4120000000000003e-06 2024-04-26T10:22:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037981+0000", 2024-04-26T10:22:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6689999999999999e-06 2024-04-26T10:22:32.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038041+0000", 2024-04-26T10:22:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9324999999999999e-05 2024-04-26T10:22:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038179+0000", 2024-04-26T10:22:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013832499999999999 2024-04-26T10:22:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166427+0000", 2024-04-26T10:22:32.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128248165 2024-04-26T10:22:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166539+0000", 2024-04-26T10:22:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111538 2024-04-26T10:22:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166836+0000", 2024-04-26T10:22:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029714100000000001 2024-04-26T10:22:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110561 5.d 5:b143edec:::benchmark_data_smithi052_19421_object110560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0646198429999991, 2024-04-26T10:22:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.125215574, 2024-04-26T10:22:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110561 2024-04-26T10:22:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037990+0000", 2024-04-26T10:22:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038028+0000", 2024-04-26T10:22:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7802999999999997e-05 2024-04-26T10:22:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038035+0000", 2024-04-26T10:22:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-06 2024-04-26T10:22:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038040+0000", 2024-04-26T10:22:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.147e-06 2024-04-26T10:22:32.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038077+0000", 2024-04-26T10:22:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7166999999999998e-05 2024-04-26T10:22:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038192+0000", 2024-04-26T10:22:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115565 2024-04-26T10:22:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038319+0000", 2024-04-26T10:22:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012697699999999999 2024-04-26T10:22:32.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162690+0000", 2024-04-26T10:22:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12437065 2024-04-26T10:22:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162878+0000", 2024-04-26T10:22:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000188173 2024-04-26T10:22:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162992+0000", 2024-04-26T10:22:32.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114008 2024-04-26T10:22:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163206+0000", 2024-04-26T10:22:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021394900000000001 2024-04-26T10:22:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0645592389999994, 2024-04-26T10:22:32.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:22:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:22:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:22:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:22:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:22:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:22:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:22:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:22:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:22:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:22:32.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:22:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:22:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:22:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:22:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:22:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:22:32.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:22:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:22:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110564 5.3 5:c09e33cb:::benchmark_data_smithi052_19421_object110563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0645065809999998, 2024-04-26T10:22:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128984614, 2024-04-26T10:22:32.168 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110564 2024-04-26T10:22:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038103+0000", 2024-04-26T10:22:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038136+0000", 2024-04-26T10:22:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.243e-05 2024-04-26T10:22:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038143+0000", 2024-04-26T10:22:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0870000000000001e-06 2024-04-26T10:22:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038151+0000", 2024-04-26T10:22:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:22:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039813+0000", 2024-04-26T10:22:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001661844 2024-04-26T10:22:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039970+0000", 2024-04-26T10:22:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015712699999999999 2024-04-26T10:22:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166854+0000", 2024-04-26T10:22:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.126883788 2024-04-26T10:22:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166976+0000", 2024-04-26T10:22:32.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012231399999999999 2024-04-26T10:22:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167088+0000", 2024-04-26T10:22:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011243699999999999 2024-04-26T10:22:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0644499879999998, 2024-04-26T10:22:32.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:22:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:22:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:22:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:22:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:22:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:22:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:22:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:22:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:22:32.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:22:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:22:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:22:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:22:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:22:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:22:32.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:22:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:22:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:22:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110566 5.c 5:34145698:::benchmark_data_smithi052_19421_object110565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:32.178 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0644002110000006, 2024-04-26T10:22:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12673530699999999, 2024-04-26T10:22:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110566 2024-04-26T10:22:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038246+0000", 2024-04-26T10:22:32.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5759000000000001e-05 2024-04-26T10:22:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038252+0000", 2024-04-26T10:22:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5300000000000002e-06 2024-04-26T10:22:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038257+0000", 2024-04-26T10:22:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038312+0000", 2024-04-26T10:22:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5108000000000002e-05 2024-04-26T10:22:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038480+0000", 2024-04-26T10:22:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016751099999999999 2024-04-26T10:22:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164651+0000", 2024-04-26T10:22:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12617115600000001 2024-04-26T10:22:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164770+0000", 2024-04-26T10:22:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118748 2024-04-26T10:22:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164946+0000", 2024-04-26T10:22:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175966 2024-04-26T10:22:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.183 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0620525759999992, 2024-04-26T10:22:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:22:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:22:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:32.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:22:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:22:32.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:22:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:22:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:22:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:22:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:22:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:22:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:22:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:22:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:22:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:22:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:22:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:22:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:22:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:22:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:22:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:22:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:22:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:22:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:22:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110568 5.c 5:34af8ad3:::benchmark_data_smithi052_19421_object110567:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0619349509999996, 2024-04-26T10:22:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124943661, 2024-04-26T10:22:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.189 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110568 2024-04-26T10:22:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040711+0000", 2024-04-26T10:22:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6531e-05 2024-04-26T10:22:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040719+0000", 2024-04-26T10:22:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6120000000000001e-06 2024-04-26T10:22:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040724+0000", 2024-04-26T10:22:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2100000000000001e-06 2024-04-26T10:22:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040771+0000", 2024-04-26T10:22:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7123000000000003e-05 2024-04-26T10:22:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040984+0000", 2024-04-26T10:22:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021227400000000001 2024-04-26T10:22:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165350+0000", 2024-04-26T10:22:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124366738 2024-04-26T10:22:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165459+0000", 2024-04-26T10:22:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108168 2024-04-26T10:22:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165619+0000", 2024-04-26T10:22:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160564 2024-04-26T10:22:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0618666520000009, 2024-04-26T10:22:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:22:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.194 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:22:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:32.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:22:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:22:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:22:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:22:32.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:22:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:22:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:22:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:22:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:22:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:22:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:22:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:22:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:22:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:22:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:22:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:32.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:22:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:22:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:22:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:22:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:22:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:22:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.199 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110570 5.1 5:876a468c:::benchmark_data_smithi052_19421_object110569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.0605641069999994, 2024-04-26T10:22:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12851437099999999, 2024-04-26T10:22:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110570 2024-04-26T10:22:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042045+0000", 2024-04-26T10:22:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:32.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042083+0000", 2024-04-26T10:22:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8064e-05 2024-04-26T10:22:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161855+0000", 2024-04-26T10:22:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119771934 2024-04-26T10:22:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161882+0000", 2024-04-26T10:22:32.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7083000000000001e-05 2024-04-26T10:22:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163117+0000", 2024-04-26T10:22:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001234509 2024-04-26T10:22:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163507+0000", 2024-04-26T10:22:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038998400000000001 2024-04-26T10:22:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170347+0000", 2024-04-26T10:22:32.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006840952 2024-04-26T10:22:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170488+0000", 2024-04-26T10:22:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140393 2024-04-26T10:22:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170561+0000", 2024-04-26T10:22:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2809e-05 2024-04-26T10:22:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:124481 5.d 5:b507cdbb:::benchmark_data_smithi052_19421_object124480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 1.0221991850000001, 2024-04-26T10:22:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.087933879000000006, 2024-04-26T10:22:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124481 2024-04-26T10:22:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080410+0000", 2024-04-26T10:22:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080523+0000", 2024-04-26T10:22:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112501 2024-04-26T10:22:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080528+0000", 2024-04-26T10:22:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1789999999999999e-06 2024-04-26T10:22:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080532+0000", 2024-04-26T10:22:32.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.805e-06 2024-04-26T10:22:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080562+0000", 2024-04-26T10:22:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0241000000000001e-05 2024-04-26T10:22:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080645+0000", 2024-04-26T10:22:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2816000000000001e-05 2024-04-26T10:22:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:32.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080786+0000", 2024-04-26T10:22:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014129400000000001 2024-04-26T10:22:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.084288+0000", 2024-04-26T10:22:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035017920000000001 2024-04-26T10:22:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.167975+0000", 2024-04-26T10:22:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.083686673000000003 2024-04-26T10:22:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:32.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.168092+0000", 2024-04-26T10:22:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117607 2024-04-26T10:22:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.168345+0000", 2024-04-26T10:22:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025299200000000001 2024-04-26T10:22:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.210 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.210 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:32.212 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:32.212 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:32.208+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:32.312 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:32.308+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:32.343 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:126895 5.0 5:000501ab:::benchmark_data_smithi052_19421_object126894:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:32.335428+0000", 2024-04-26T10:22:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0067993970000000004, 2024-04-26T10:22:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006827039, 2024-04-26T10:22:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.343 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 126895 2024-04-26T10:22:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.335428+0000", 2024-04-26T10:22:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.335428+0000", 2024-04-26T10:22:32.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.335427+0000", 2024-04-26T10:22:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.335471+0000", 2024-04-26T10:22:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4155e-05 2024-04-26T10:22:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.335490+0000", 2024-04-26T10:22:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9008000000000002e-05 2024-04-26T10:22:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.335495+0000", 2024-04-26T10:22:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1150000000000002e-06 2024-04-26T10:22:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.335541+0000", 2024-04-26T10:22:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5809000000000001e-05 2024-04-26T10:22:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.335690+0000", 2024-04-26T10:22:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014959899999999999 2024-04-26T10:22:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.335792+0000", 2024-04-26T10:22:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000101265 2024-04-26T10:22:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.338450+0000", 2024-04-26T10:22:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002658559 2024-04-26T10:22:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.347 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:126900 5.e 5:7b181332:::benchmark_data_smithi052_19421_object126899:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:32.337181+0000", 2024-04-26T10:22:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0050461560000000004, 2024-04-26T10:22:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051606200000000003, 2024-04-26T10:22:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 126900 2024-04-26T10:22:32.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.337181+0000", 2024-04-26T10:22:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.337181+0000", 2024-04-26T10:22:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.337180+0000", 2024-04-26T10:22:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.337233+0000", 2024-04-26T10:22:32.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3319000000000002e-05 2024-04-26T10:22:32.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.337249+0000", 2024-04-26T10:22:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5569e-05 2024-04-26T10:22:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.337256+0000", 2024-04-26T10:22:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8170000000000001e-06 2024-04-26T10:22:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.337319+0000", 2024-04-26T10:22:32.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3446000000000002e-05 2024-04-26T10:22:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.337476+0000", 2024-04-26T10:22:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015654300000000001 2024-04-26T10:22:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.342311+0000", 2024-04-26T10:22:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048358919999999996 2024-04-26T10:22:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.354 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:126902 5.8 5:12303caa:::benchmark_data_smithi052_19421_object126901:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:32.337432+0000", 2024-04-26T10:22:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0047949330000000004, 2024-04-26T10:22:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0049883970000000003, 2024-04-26T10:22:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 126902 2024-04-26T10:22:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.355 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.337432+0000", 2024-04-26T10:22:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.337432+0000", 2024-04-26T10:22:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.337431+0000", 2024-04-26T10:22:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.339700+0000", 2024-04-26T10:22:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022683109999999999 2024-04-26T10:22:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.339708+0000", 2024-04-26T10:22:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0530000000000007e-06 2024-04-26T10:22:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.339713+0000", 2024-04-26T10:22:32.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4920000000000001e-06 2024-04-26T10:22:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.339749+0000", 2024-04-26T10:22:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5290999999999998e-05 2024-04-26T10:22:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.339883+0000", 2024-04-26T10:22:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013413699999999999 2024-04-26T10:22:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:126903 5.0 5:0b0f620d:::benchmark_data_smithi052_19421_object126902:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:32.339725+0000", 2024-04-26T10:22:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0025022070000000002, 2024-04-26T10:22:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002752858, 2024-04-26T10:22:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 126903 2024-04-26T10:22:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.339725+0000", 2024-04-26T10:22:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.339725+0000", 2024-04-26T10:22:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.339724+0000", 2024-04-26T10:22:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.339752+0000", 2024-04-26T10:22:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8166000000000001e-05 2024-04-26T10:22:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.339760+0000", 2024-04-26T10:22:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4549999999999998e-06 2024-04-26T10:22:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.339765+0000", 2024-04-26T10:22:32.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6210000000000001e-06 2024-04-26T10:22:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.340885+0000", 2024-04-26T10:22:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011194709999999999 2024-04-26T10:22:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.341237+0000", 2024-04-26T10:22:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035171900000000001 2024-04-26T10:22:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.341422+0000", 2024-04-26T10:22:32.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185062 2024-04-26T10:22:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:126899 5.f e48/37 5:fa611dae:::benchmark_data_smithi052_19421_object126898:head v 48'8006, mlcod=48'8002)", 2024-04-26T10:22:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:32.339995+0000", 2024-04-26T10:22:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0022324480000000002, 2024-04-26T10:22:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025507030000000001, 2024-04-26T10:22:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.339995+0000", 2024-04-26T10:22:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.339995+0000", 2024-04-26T10:22:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.339994+0000", 2024-04-26T10:22:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.340068+0000", 2024-04-26T10:22:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3728999999999998e-05 2024-04-26T10:22:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.340077+0000", 2024-04-26T10:22:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.482e-06 2024-04-26T10:22:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.340084+0000", 2024-04-26T10:22:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5100000000000004e-06 2024-04-26T10:22:32.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.340131+0000", 2024-04-26T10:22:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7307e-05 2024-04-26T10:22:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.340152+0000", 2024-04-26T10:22:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1047e-05 2024-04-26T10:22:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:126907 5.a 5:540fb8ee:::benchmark_data_smithi052_19421_object126906:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:32.340210+0000", 2024-04-26T10:22:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0020167549999999998, 2024-04-26T10:22:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0023941570000000001, 2024-04-26T10:22:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 126907 2024-04-26T10:22:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.340210+0000", 2024-04-26T10:22:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.340210+0000", 2024-04-26T10:22:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.340209+0000", 2024-04-26T10:22:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.340359+0000", 2024-04-26T10:22:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014992599999999999 2024-04-26T10:22:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.340369+0000", 2024-04-26T10:22:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7499999999999998e-06 2024-04-26T10:22:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.340379+0000", 2024-04-26T10:22:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6430000000000007e-06 2024-04-26T10:22:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.340433+0000", 2024-04-26T10:22:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4517e-05 2024-04-26T10:22:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.340582+0000", 2024-04-26T10:22:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000148842 2024-04-26T10:22:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:126909 5.9 e48/37 5:9bb5f8ac:::benchmark_data_smithi052_19421_object126908:head v 48'7977, mlcod=48'7975)", 2024-04-26T10:22:32.370 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:32.340951+0000", 2024-04-26T10:22:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.001276016, 2024-04-26T10:22:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0017121510000000001, 2024-04-26T10:22:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.340951+0000", 2024-04-26T10:22:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.340951+0000", 2024-04-26T10:22:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.340950+0000", 2024-04-26T10:22:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.340995+0000", 2024-04-26T10:22:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4248000000000001e-05 2024-04-26T10:22:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.341007+0000", 2024-04-26T10:22:32.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2386e-05 2024-04-26T10:22:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.341013+0000", 2024-04-26T10:22:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2960000000000004e-06 2024-04-26T10:22:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.341061+0000", 2024-04-26T10:22:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7259000000000003e-05 2024-04-26T10:22:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.341089+0000", 2024-04-26T10:22:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8133e-05 2024-04-26T10:22:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:126910 5.0 5.56583510 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:32.342063+0000", 2024-04-26T10:22:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.000163859, 2024-04-26T10:22:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00066266399999999998, 2024-04-26T10:22:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.374 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 126910 2024-04-26T10:22:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.342063+0000", 2024-04-26T10:22:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.342063+0000", 2024-04-26T10:22:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.342062+0000", 2024-04-26T10:22:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.342133+0000", 2024-04-26T10:22:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0607999999999999e-05 2024-04-26T10:22:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.342143+0000", 2024-04-26T10:22:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0382e-05 2024-04-26T10:22:32.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:32.342150+0000", 2024-04-26T10:22:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1960000000000002e-06 2024-04-26T10:22:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:32.377 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 8 2024-04-26T10:22:32.377 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:32.378 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:32.413 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:32.411+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:32.513 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:32.513 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:32.513 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:32.513 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:32.513 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:32.514 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:32.511+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:32.524 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:32.615 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:32.615+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:32.621 INFO:tasks.radosbench.radosbench.0.smithi052.stdout: 59 16 127480 127464 135.009 128.125 0.0123114 0.00740135 2024-04-26T10:22:32.657 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:32.658 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:32.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:32.658 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:32.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.658 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:32.658 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:32.658 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.122304276000001, 2024-04-26T10:22:32.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:32.658 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.658 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.659 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.659 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:32.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.659 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:32.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:32.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:32.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:32.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:32.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:32.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:32.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:32.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:32.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:32.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:32.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:32.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:32.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:32.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:32.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:32.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:32.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:32.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:32.663 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.664 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.664 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.664 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:32.664 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:32.664 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.120322049000002, 2024-04-26T10:22:32.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:32.664 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.665 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.665 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.665 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.665 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.665 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:32.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.665 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:32.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:32.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:32.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:32.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:32.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:32.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:32.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:32.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:32.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:32.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:32.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:32.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:32.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:32.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:32.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:32.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:32.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:32.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:32.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:32.669 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.669 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.669 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.670 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:32.670 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:32.670 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.120122664999997, 2024-04-26T10:22:32.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:32.670 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.670 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.670 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.670 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.670 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.671 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:32.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.671 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:32.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:32.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:32.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:32.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:32.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:32.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:32.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:32.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:32.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:32.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:32.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:32.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:32.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:32.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:32.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:32.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:32.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:32.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:32.676 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.676 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.676 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.676 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:32.676 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:32.676 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.119904044999998, 2024-04-26T10:22:32.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:32.676 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.676 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.676 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:32.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:32.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:32.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:32.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:32.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:32.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:32.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:32.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:32.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:32.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:32.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:32.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:32.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:32.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:32.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:32.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:32.680 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.680 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.680 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.681 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:32.681 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:32.681 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.117532607000001, 2024-04-26T10:22:32.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:32.681 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.681 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.681 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.681 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.681 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.682 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:32.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.682 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:32.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:32.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:32.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:32.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:32.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:32.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:32.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:32.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:32.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:32.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:32.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:32.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:32.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:32.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:32.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:32.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:32.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:32.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:32.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:32.686 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.686 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.686 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.686 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:32.686 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:32.686 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.117431985000003, 2024-04-26T10:22:32.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:32.686 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.687 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.687 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.687 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.687 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.687 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:32.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.687 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:32.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:32.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:32.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:32.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:32.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:32.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:32.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:32.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:32.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:32.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:32.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:32.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:32.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:32.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:32.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:32.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:32.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:32.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:32.692 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.692 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.692 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.692 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:32.692 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:32.692 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.117313424000002, 2024-04-26T10:22:32.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:32.692 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.692 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.693 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:32.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:32.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:32.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:32.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:32.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:32.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:32.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:32.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:32.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:32.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:32.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:32.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:32.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:32.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:32.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:32.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:32.697 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.697 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.697 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.697 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:32.697 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:32.697 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.117211026, 2024-04-26T10:22:32.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:32.697 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.697 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.697 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.697 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.697 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.698 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:32.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.698 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:32.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:32.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:32.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:32.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:32.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:32.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:32.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:32.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:32.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:32.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:32.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:32.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:32.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:32.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:32.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:32.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:32.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:32.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:32.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:32.702 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.702 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.702 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.702 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:32.702 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:32.702 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.116190469000003, 2024-04-26T10:22:32.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:32.702 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.702 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.702 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.702 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.703 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.703 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:32.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.703 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:32.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:32.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:32.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:32.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:32.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:32.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:32.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:32.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:32.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:32.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:32.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:32.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:32.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:32.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:32.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:32.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:32.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:32.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:32.707 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.707 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.707 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.707 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:32.707 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:32.707 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.115040194000002, 2024-04-26T10:22:32.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:32.708 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.708 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.708 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.708 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.708 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.708 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:32.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.708 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:32.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:32.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:32.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:32.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:32.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:32.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:32.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:32.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:32.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:32.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:32.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:32.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:32.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:32.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:32.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:32.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:32.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:32.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:32.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:32.712 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.712 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.712 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.713 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:32.713 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:32.713 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.6183409520000005, 2024-04-26T10:22:32.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:22:32.713 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.713 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.713 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:22:32.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.713 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:32.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:32.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:22:32.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:22:32.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:22:32.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:22:32.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:22:32.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:22:32.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:22:32.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:22:32.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:22:32.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:22:32.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:22:32.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:32.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:22:32.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:22:32.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:22:32.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:22:32.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:32.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:22:32.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:22:32.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:22:32.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:22:32.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:22:32.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:22:32.718 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.718 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.719 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.719 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:32.719 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:32.719 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 8.6181173559999991, 2024-04-26T10:22:32.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:22:32.719 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.719 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.719 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.719 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.719 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.719 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:22:32.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.720 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:32.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:32.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:22:32.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:22:32.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:22:32.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:22:32.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:22:32.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:22:32.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:22:32.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:22:32.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:22:32.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:22:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:22:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:22:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:22:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:22:32.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:22:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:22:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:22:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:22:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:22:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:22:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:22:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.587271036, 2024-04-26T10:22:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:22:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.726 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:22:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:22:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:22:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:22:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:22:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:22:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:22:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:22:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:22:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:22:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:22:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:22:32.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:22:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:22:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:22:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:22:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:22:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:22:32.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:22:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:22:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:22:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:22:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.5852599330000001, 2024-04-26T10:22:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:22:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:22:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:22:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:22:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:22:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:22:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:22:32.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:22:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:22:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:22:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:22:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:22:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:32.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:22:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:22:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:22:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:22:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:22:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:22:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:22:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:22:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:22:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:22:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.5743818279999999, 2024-04-26T10:22:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:22:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:22:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:22:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:22:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:22:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:22:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:22:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:22:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:22:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:22:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:22:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:22:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:22:32.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:22:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:22:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:22:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:22:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:22:32.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:22:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:22:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:22:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:22:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:22:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.5717006090000001, 2024-04-26T10:22:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:22:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:22:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.745 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:22:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:32.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:22:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:22:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:22:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:22:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:22:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:22:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:22:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:22:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:22:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:22:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:32.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:22:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:22:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:22:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:22:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:22:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:22:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:22:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:22:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:22:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:22:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.750 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.5713335339999999, 2024-04-26T10:22:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:22:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:22:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:32.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:22:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:22:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:22:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:22:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:22:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:22:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:22:32.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:22:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:22:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:22:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:22:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:22:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:22:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:22:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:22:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:22:32.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:22:32.758 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.758 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.758 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.571269282, 2024-04-26T10:22:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:22:32.759 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.760 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.760 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.760 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.760 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.760 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:22:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:32.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:22:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:22:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:22:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:22:32.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:22:32.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:22:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:22:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:22:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:22:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:22:32.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:22:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:22:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:22:32.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:22:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:22:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:22:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:22:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.770 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.566870609, 2024-04-26T10:22:32.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:22:32.772 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.772 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.772 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.772 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.772 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:22:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:22:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:22:32.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:22:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:22:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:22:32.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:22:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:22:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:22:32.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:22:32.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:22:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:22:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:22:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:22:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:22:32.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:22:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:22:32.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:22:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.783 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.5651126259999999, 2024-04-26T10:22:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:22:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:32.784 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:22:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:32.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.786 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:32.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:22:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:22:32.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:22:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:22:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:22:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:22:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:22:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:22:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:22:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:22:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:22:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:22:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:22:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:22:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:22:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:22:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:22:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:22:32.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:22:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:22:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:22:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:32.792 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:32.792 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:32.794 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:32.794 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:32.788+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:32.894 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:32.891+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:32.928 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:32.928 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:32.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.928 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:128086 5.5 5.164f865 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.928 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:32.922893+0000", 2024-04-26T10:22:32.928 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0037107249999999998, 2024-04-26T10:22:32.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037302429999999998, 2024-04-26T10:22:32.929 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.929 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:32.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.929 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 128086 2024-04-26T10:22:32.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.929 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.922893+0000", 2024-04-26T10:22:32.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.922893+0000", 2024-04-26T10:22:32.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.922892+0000", 2024-04-26T10:22:32.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.922953+0000", 2024-04-26T10:22:32.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0563000000000003e-05 2024-04-26T10:22:32.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.922964+0000", 2024-04-26T10:22:32.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1610000000000001e-05 2024-04-26T10:22:32.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.922972+0000", 2024-04-26T10:22:32.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3459999999999996e-06 2024-04-26T10:22:32.931 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.931 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.931 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.932 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:128085 5.b e48/37 5:d71da48d:::benchmark_data_smithi052_19421_object128084:head v 48'7965, mlcod=48'7962)", 2024-04-26T10:22:32.932 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:32.923016+0000", 2024-04-26T10:22:32.932 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003588197, 2024-04-26T10:22:32.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036551940000000001, 2024-04-26T10:22:32.932 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.932 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:32.932 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.923016+0000", 2024-04-26T10:22:32.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.923016+0000", 2024-04-26T10:22:32.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.923015+0000", 2024-04-26T10:22:32.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.923020+0000", 2024-04-26T10:22:32.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6679999999999998e-06 2024-04-26T10:22:32.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.923031+0000", 2024-04-26T10:22:32.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0927999999999999e-05 2024-04-26T10:22:32.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.923037+0000", 2024-04-26T10:22:32.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.003e-06 2024-04-26T10:22:32.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.924879+0000", 2024-04-26T10:22:32.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001841313 2024-04-26T10:22:32.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.924890+0000", 2024-04-26T10:22:32.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1623999999999999e-05 2024-04-26T10:22:32.935 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.935 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.935 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.935 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:128084 5.0 e48/37 5:09672315:::benchmark_data_smithi052_19421_object128083:head v 48'8037, mlcod=48'8033)", 2024-04-26T10:22:32.935 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:32.923355+0000", 2024-04-26T10:22:32.935 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032487250000000001, 2024-04-26T10:22:32.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033463770000000002, 2024-04-26T10:22:32.935 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.935 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:32.935 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.923355+0000", 2024-04-26T10:22:32.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.923355+0000", 2024-04-26T10:22:32.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.923354+0000", 2024-04-26T10:22:32.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.923405+0000", 2024-04-26T10:22:32.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0515e-05 2024-04-26T10:22:32.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.923414+0000", 2024-04-26T10:22:32.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5359999999999998e-06 2024-04-26T10:22:32.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.923421+0000", 2024-04-26T10:22:32.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4579999999999998e-06 2024-04-26T10:22:32.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.923559+0000", 2024-04-26T10:22:32.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013814900000000001 2024-04-26T10:22:32.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.923570+0000", 2024-04-26T10:22:32.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1493e-05 2024-04-26T10:22:32.938 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.938 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.938 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.938 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:128090 5.c 5:34c3c3d9:::benchmark_data_smithi052_19421_object128089:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.939 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:32.925184+0000", 2024-04-26T10:22:32.939 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001419598, 2024-04-26T10:22:32.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015495979999999999, 2024-04-26T10:22:32.939 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.939 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:32.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.939 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 128090 2024-04-26T10:22:32.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.939 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925184+0000", 2024-04-26T10:22:32.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925184+0000", 2024-04-26T10:22:32.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925183+0000", 2024-04-26T10:22:32.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925263+0000", 2024-04-26T10:22:32.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0205999999999997e-05 2024-04-26T10:22:32.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925281+0000", 2024-04-26T10:22:32.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7238e-05 2024-04-26T10:22:32.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925288+0000", 2024-04-26T10:22:32.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6860000000000006e-06 2024-04-26T10:22:32.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925333+0000", 2024-04-26T10:22:32.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4941000000000002e-05 2024-04-26T10:22:32.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925493+0000", 2024-04-26T10:22:32.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015999300000000001 2024-04-26T10:22:32.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.942 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.943 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:128079 5.d e48/37)", 2024-04-26T10:22:32.943 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:32.925351+0000", 2024-04-26T10:22:32.943 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0012523600000000001, 2024-04-26T10:22:32.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001414369, 2024-04-26T10:22:32.943 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.943 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:32.943 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925351+0000", 2024-04-26T10:22:32.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925351+0000", 2024-04-26T10:22:32.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925351+0000", 2024-04-26T10:22:32.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925355+0000", 2024-04-26T10:22:32.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9389999999999999e-06 2024-04-26T10:22:32.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925364+0000", 2024-04-26T10:22:32.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8489999999999995e-06 2024-04-26T10:22:32.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925370+0000", 2024-04-26T10:22:32.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2609999999999999e-06 2024-04-26T10:22:32.945 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.945 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.945 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.945 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:128092 5.2 5:4ab0202a:::benchmark_data_smithi052_19421_object128091:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.946 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:32.925301+0000", 2024-04-26T10:22:32.946 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0013023049999999999, 2024-04-26T10:22:32.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014899189999999999, 2024-04-26T10:22:32.946 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.946 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:32.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.946 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 128092 2024-04-26T10:22:32.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.946 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925301+0000", 2024-04-26T10:22:32.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925301+0000", 2024-04-26T10:22:32.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925301+0000", 2024-04-26T10:22:32.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925412+0000", 2024-04-26T10:22:32.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011109500000000001 2024-04-26T10:22:32.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925420+0000", 2024-04-26T10:22:32.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5769999999999996e-06 2024-04-26T10:22:32.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925426+0000", 2024-04-26T10:22:32.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.127e-06 2024-04-26T10:22:32.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925485+0000", 2024-04-26T10:22:32.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9194999999999998e-05 2024-04-26T10:22:32.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925617+0000", 2024-04-26T10:22:32.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013198999999999999 2024-04-26T10:22:32.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.949 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.949 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:128071 5.3 5:c9b61c24:::benchmark_data_smithi052_19421_object128070:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.949 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:32.915793+0000", 2024-04-26T10:22:32.949 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010810673, 2024-04-26T10:22:32.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011034886000000001, 2024-04-26T10:22:32.950 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.950 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:32.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.950 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 128071 2024-04-26T10:22:32.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.950 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.915793+0000", 2024-04-26T10:22:32.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.915793+0000", 2024-04-26T10:22:32.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.915792+0000", 2024-04-26T10:22:32.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.915879+0000", 2024-04-26T10:22:32.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6718000000000006e-05 2024-04-26T10:22:32.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.915903+0000", 2024-04-26T10:22:32.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4488999999999999e-05 2024-04-26T10:22:32.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.915910+0000", 2024-04-26T10:22:32.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2300000000000002e-06 2024-04-26T10:22:32.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.921171+0000", 2024-04-26T10:22:32.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052605550000000001 2024-04-26T10:22:32.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.921301+0000", 2024-04-26T10:22:32.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012994300000000001 2024-04-26T10:22:32.953 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.953 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.953 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.953 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:128072 5.3 5:c3104ffe:::benchmark_data_smithi052_19421_object128071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.953 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:32.915918+0000", 2024-04-26T10:22:32.953 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010685566000000001, 2024-04-26T10:22:32.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010943262, 2024-04-26T10:22:32.953 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.954 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:32.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.954 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 128072 2024-04-26T10:22:32.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.954 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.915918+0000", 2024-04-26T10:22:32.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.915918+0000", 2024-04-26T10:22:32.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.915917+0000", 2024-04-26T10:22:32.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.915954+0000", 2024-04-26T10:22:32.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6798000000000002e-05 2024-04-26T10:22:32.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.915975+0000", 2024-04-26T10:22:32.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0673e-05 2024-04-26T10:22:32.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.915980+0000", 2024-04-26T10:22:32.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4419999999999997e-06 2024-04-26T10:22:32.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925051+0000", 2024-04-26T10:22:32.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090704960000000008 2024-04-26T10:22:32.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925171+0000", 2024-04-26T10:22:32.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120215 2024-04-26T10:22:32.957 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.957 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.957 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.957 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:128079 5.d 5:b1ce0641:::benchmark_data_smithi052_19421_object128078:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.957 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:32.918605+0000", 2024-04-26T10:22:32.957 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0079987359999999993, 2024-04-26T10:22:32.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082921829999999998, 2024-04-26T10:22:32.957 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.957 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:32.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.958 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.958 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 128079 2024-04-26T10:22:32.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.958 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.918605+0000", 2024-04-26T10:22:32.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.918605+0000", 2024-04-26T10:22:32.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.918604+0000", 2024-04-26T10:22:32.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:32.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.918647+0000", 2024-04-26T10:22:32.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3232999999999998e-05 2024-04-26T10:22:32.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.918662+0000", 2024-04-26T10:22:32.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4800000000000001e-05 2024-04-26T10:22:32.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.918668+0000", 2024-04-26T10:22:32.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0000000000000002e-06 2024-04-26T10:22:32.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.920587+0000", 2024-04-26T10:22:32.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001918697 2024-04-26T10:22:32.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.920708+0000", 2024-04-26T10:22:32.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012146099999999999 2024-04-26T10:22:32.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:32.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.920831+0000", 2024-04-26T10:22:32.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012216899999999999 2024-04-26T10:22:32.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.961 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.961 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:128080 5.d 5:b236b583:::benchmark_data_smithi052_19421_object128079:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:32.962 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:32.918679+0000", 2024-04-26T10:22:32.962 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0079251649999999996, 2024-04-26T10:22:32.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0082546949999999994, 2024-04-26T10:22:32.962 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.962 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:32.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:32.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:32.962 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:32.962 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 128080 2024-04-26T10:22:32.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.962 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.918679+0000", 2024-04-26T10:22:32.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.918679+0000", 2024-04-26T10:22:32.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.918678+0000", 2024-04-26T10:22:32.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.918712+0000", 2024-04-26T10:22:32.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4347999999999997e-05 2024-04-26T10:22:32.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.918720+0000", 2024-04-26T10:22:32.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3339999999999996e-06 2024-04-26T10:22:32.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.918725+0000", 2024-04-26T10:22:32.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1710000000000001e-06 2024-04-26T10:22:32.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925644+0000", 2024-04-26T10:22:32.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069195100000000002 2024-04-26T10:22:32.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925761+0000", 2024-04-26T10:22:32.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116351 2024-04-26T10:22:32.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:32.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.925893+0000", 2024-04-26T10:22:32.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132523 2024-04-26T10:22:32.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.966 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.966 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:128078 5.b e48/37 5:d6cdd1d6:::benchmark_data_smithi052_19421_object128077:head v 48'7964, mlcod=48'7962)", 2024-04-26T10:22:32.966 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:32.919371+0000", 2024-04-26T10:22:32.966 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0072328219999999999, 2024-04-26T10:22:32.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0075968219999999996, 2024-04-26T10:22:32.966 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:32.966 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:32.966 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:32.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:32.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.919371+0000", 2024-04-26T10:22:32.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:32.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.919371+0000", 2024-04-26T10:22:32.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:32.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:32.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.919370+0000", 2024-04-26T10:22:32.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:32.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:32.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.919376+0000", 2024-04-26T10:22:32.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9440000000000002e-06 2024-04-26T10:22:32.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:32.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.919387+0000", 2024-04-26T10:22:32.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0905e-05 2024-04-26T10:22:32.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:32.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.919393+0000", 2024-04-26T10:22:32.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6049999999999997e-06 2024-04-26T10:22:32.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:32.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.923125+0000", 2024-04-26T10:22:32.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037321450000000001 2024-04-26T10:22:32.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:32.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:32.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:32.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:32.923138+0000", 2024-04-26T10:22:32.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2682e-05 2024-04-26T10:22:32.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.969 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:32.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:32.969 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:32.969 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 11 2024-04-26T10:22:32.969 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:32.971 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:32.995 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:32.995+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:33.008 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:22:33.056 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:22:33.095 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:33.092+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:33.101 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:33.101 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:33.101 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:33.101 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:33.101 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:33.116 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:33.167 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:33.189 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:33.190 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:33.190 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:33.190 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:33.193 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:33.193 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:33.196 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:33.192+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:33.247 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:33.247 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:33.260 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:33.306 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:33.304+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:33.388 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:33.388 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:33.398 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:33.395+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:33.403 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:33.498 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:33.496+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:33.529 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:33.530 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:33.542 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:33.599 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:33.599+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:33.619 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Total time run: 60.0042 2024-04-26T10:22:33.619 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Total writes made: 129469 2024-04-26T10:22:33.619 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Write size: 65536 2024-04-26T10:22:33.620 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Object size: 65536 2024-04-26T10:22:33.620 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Bandwidth (MB/sec): 134.854 2024-04-26T10:22:33.620 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Stddev Bandwidth: 33.0282 2024-04-26T10:22:33.620 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Max bandwidth (MB/sec): 192.375 2024-04-26T10:22:33.620 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Min bandwidth (MB/sec): 0.4375 2024-04-26T10:22:33.620 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Average IOPS: 2157 2024-04-26T10:22:33.620 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Stddev IOPS: 528.452 2024-04-26T10:22:33.620 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Max IOPS: 3078 2024-04-26T10:22:33.620 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Min IOPS: 7 2024-04-26T10:22:33.620 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Average Latency(s): 0.00741027 2024-04-26T10:22:33.620 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Stddev Latency(s): 0.0207409 2024-04-26T10:22:33.620 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Max latency(s): 1.59487 2024-04-26T10:22:33.620 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Min latency(s): 0.00175409 2024-04-26T10:22:33.627 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Cleaning up (deleting benchmark objects) 2024-04-26T10:22:33.671 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:33.671 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:33.684 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:33.730 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:33.728+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:33.801 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:33.799+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:33.813 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:33.813 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:33.826 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:33.902 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:33.899+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:33.959 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:33.960 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:33.972 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:34.002 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:33.999+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:34.055 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T10:22:34.103 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:34.103+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:34.104 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:34.104 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:34.117 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:34.204 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:34.200+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:34.242 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:34.242 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:34.254 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:34.306 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:34.303+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:34.385 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:34.385 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:34.398 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:34.443 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:34.443+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:34.506 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:34.504+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:34.519 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:34.519 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:34.531 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:34.610 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:34.604+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:34.661 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:34.661 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:34.673 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:34.709 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:34.704+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:34.805 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:34.805 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:34.809 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:34.807+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:34.816 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:34.910 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:34.904+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:34.985 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:34.986 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:34.999 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:35.043 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:35.043+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:35.112 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:35.108+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:35.126 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:35.126 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:35.140 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:35.194 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:22:35.212 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:35.208+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:35.263 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:35.264 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:35.276 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:35.313 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:35.308+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:35.355 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:35.377 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:35.378 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:35.378 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:35.378 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:35.383 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:35.383 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:35.406 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:35.407 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:35.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:35.407 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:35.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.407 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:35.407 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:35.407 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.874392008000001, 2024-04-26T10:22:35.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:35.407 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.407 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.407 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:35.407 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:35.407 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.407 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:35.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.408 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:35.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:35.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:35.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:35.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:35.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:35.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:35.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:35.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:35.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:35.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:35.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:35.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:35.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:35.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:35.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:35.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:35.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:35.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:35.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:35.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:35.411 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.411 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.411 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.411 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:35.412 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:35.412 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.872409781000002, 2024-04-26T10:22:35.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:35.412 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.412 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.412 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:35.412 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:35.412 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.412 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:35.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.412 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:35.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:35.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:35.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:35.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:35.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:35.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:35.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:35.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:35.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:35.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:35.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:35.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:35.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:35.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:35.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:35.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:35.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:35.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:35.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:35.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:35.416 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.416 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.416 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.416 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:35.416 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:35.416 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.872210397000003, 2024-04-26T10:22:35.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:35.417 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.417 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.417 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:35.417 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:35.417 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.417 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:35.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.417 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:35.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:35.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:35.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:35.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:35.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:35.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:35.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:35.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:35.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:35.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:35.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:35.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:35.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:35.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:35.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:35.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:35.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:35.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:35.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:35.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:35.421 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.421 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.421 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.421 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:35.421 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:35.421 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.871991776999998, 2024-04-26T10:22:35.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:35.421 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.421 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.421 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:35.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:35.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:35.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:35.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:35.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:35.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:35.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:35.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:35.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:35.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:35.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:35.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:35.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:35.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:35.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:35.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:35.425 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.425 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.425 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.425 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:35.425 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:35.425 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.869620339000001, 2024-04-26T10:22:35.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:35.425 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.425 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.425 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:35.425 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:35.425 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.426 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:35.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.426 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:35.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:35.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:35.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:35.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:35.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:35.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:35.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:35.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:35.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:35.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:35.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:35.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:35.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:35.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:35.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:35.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:35.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:35.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:35.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:35.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:35.429 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.429 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.429 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.430 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:35.430 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:35.430 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.869519717000003, 2024-04-26T10:22:35.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:35.430 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.430 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.430 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:35.430 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:35.430 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.430 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:35.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.430 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:35.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:35.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:35.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:35.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:35.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:35.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:35.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:35.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:35.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:35.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:35.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:35.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:35.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:35.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:35.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:35.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:35.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:35.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:35.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:35.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:35.434 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.434 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.434 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.434 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:35.434 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:35.434 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.869401156000002, 2024-04-26T10:22:35.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:35.435 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.435 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.435 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:35.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:35.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:35.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:35.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:35.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:35.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:35.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:35.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:35.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:35.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:35.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:35.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:35.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:35.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:35.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:35.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:35.438 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.438 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.438 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.438 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:35.438 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:35.439 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.869298757999999, 2024-04-26T10:22:35.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:35.439 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.439 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.439 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:35.439 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:35.439 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.439 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:35.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.439 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:35.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:35.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:35.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:35.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:35.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:35.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:35.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:35.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:35.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:35.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:35.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:35.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:35.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:35.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:35.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:35.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:35.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:35.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:35.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:35.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:35.443 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.443 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.443 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.443 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:35.443 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:35.443 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.868278201000003, 2024-04-26T10:22:35.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:35.443 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.443 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.443 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:35.444 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:35.444 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.444 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:35.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.444 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:35.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:35.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:35.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:35.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:35.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:35.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:35.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:35.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:35.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:35.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:35.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:35.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:35.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:35.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:35.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:35.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:35.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:35.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:35.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:35.448 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.448 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.448 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.448 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:35.448 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:35.448 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.867127926000002, 2024-04-26T10:22:35.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:35.448 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.448 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.449 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:35.449 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:35.449 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.449 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:35.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.449 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:35.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:35.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:35.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:35.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:35.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:35.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:35.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:35.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:35.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:35.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:35.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:35.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:35.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:35.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:35.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:35.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:35.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:35.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:35.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:35.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:35.453 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.453 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.453 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.453 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:35.453 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:35.453 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 11.370428684, 2024-04-26T10:22:35.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:22:35.454 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.454 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.454 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:35.454 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:35.454 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.454 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:22:35.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.454 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:35.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:35.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:22:35.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:22:35.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:22:35.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:22:35.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:22:35.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:22:35.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:22:35.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:22:35.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:22:35.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:22:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:22:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:22:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:22:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:22:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:22:35.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:22:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:22:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:22:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:22:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:22:35.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:22:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 11.370205088000001, 2024-04-26T10:22:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:22:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.459 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:22:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:22:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:22:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:22:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:22:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:22:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:22:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:22:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:22:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:22:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:22:35.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:22:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:22:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:22:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:22:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:22:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:22:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:22:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:22:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:22:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:22:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:22:35.464 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3393587680000003, 2024-04-26T10:22:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:22:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.465 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:22:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:22:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:22:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:22:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:22:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:22:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:22:35.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:22:35.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:22:35.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:22:35.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:22:35.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:22:35.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:35.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:22:35.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:22:35.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:35.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:22:35.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:22:35.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:35.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:22:35.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:22:35.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:22:35.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:22:35.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:22:35.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:22:35.470 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.470 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.470 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.471 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:35.471 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:35.471 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3373476650000002, 2024-04-26T10:22:35.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:22:35.471 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.471 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.471 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:35.471 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:35.471 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.471 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:22:35.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.471 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:35.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:35.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:35.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:35.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:22:35.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:22:35.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:22:35.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:22:35.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:22:35.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:22:35.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:22:35.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:22:35.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:22:35.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:22:35.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:35.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:22:35.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:22:35.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:35.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:22:35.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:22:35.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:35.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:22:35.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:22:35.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:22:35.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:22:35.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:22:35.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:22:35.476 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.476 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.476 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.476 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:35.476 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:35.476 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3264695599999996, 2024-04-26T10:22:35.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:22:35.476 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.476 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.476 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:35.477 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:35.477 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.477 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:22:35.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.477 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:35.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:35.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:22:35.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:35.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:22:35.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:22:35.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:22:35.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:22:35.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:22:35.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:22:35.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:22:35.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:22:35.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:22:35.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:22:35.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:35.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:22:35.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:22:35.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:35.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:22:35.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:22:35.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:35.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:22:35.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:22:35.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:22:35.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:22:35.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:22:35.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:22:35.481 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.481 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.481 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.482 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:35.482 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:35.482 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3237883410000002, 2024-04-26T10:22:35.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:22:35.482 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.482 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.482 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:35.482 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:35.482 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.482 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:22:35.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.482 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:35.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:35.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:22:35.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:35.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:22:35.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:22:35.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:22:35.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:22:35.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:22:35.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:22:35.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:22:35.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:22:35.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:22:35.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:22:35.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:35.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:22:35.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:22:35.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:35.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:22:35.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:22:35.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:35.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:22:35.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:22:35.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:22:35.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:22:35.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:22:35.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:22:35.487 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.487 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.487 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.487 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:35.487 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:35.487 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3234212660000004, 2024-04-26T10:22:35.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:22:35.488 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.488 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.488 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:35.488 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:35.488 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.488 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:22:35.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.488 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:35.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:35.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:22:35.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:22:35.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:22:35.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:22:35.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:22:35.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:22:35.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:22:35.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:22:35.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:22:35.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:22:35.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:22:35.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:35.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:22:35.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:22:35.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:22:35.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:22:35.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:22:35.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:22:35.492 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.492 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.492 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.492 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:35.492 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:35.493 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3233570139999999, 2024-04-26T10:22:35.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:22:35.493 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.493 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.493 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:35.493 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:35.493 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.493 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:22:35.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.493 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:35.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:35.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:22:35.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:35.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:22:35.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:22:35.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:22:35.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:22:35.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:22:35.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:22:35.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:22:35.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:22:35.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:22:35.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:22:35.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:35.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:22:35.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:22:35.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:22:35.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:22:35.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:22:35.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:22:35.497 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.497 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.497 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.497 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:35.498 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:35.498 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.3189583410000001, 2024-04-26T10:22:35.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:22:35.498 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.498 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.498 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:35.498 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:35.498 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.498 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:22:35.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.498 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:35.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:35.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:22:35.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:35.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:22:35.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:22:35.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:22:35.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:22:35.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:22:35.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:22:35.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:22:35.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:22:35.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:22:35.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:22:35.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:35.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:22:35.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:22:35.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:22:35.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:22:35.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:22:35.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:22:35.502 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.502 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.502 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.503 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:35.503 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:35.503 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4.317200358, 2024-04-26T10:22:35.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:22:35.503 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:35.503 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:35.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:35.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.503 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:22:35.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.503 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:35.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:35.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:35.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:35.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:35.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:35.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:35.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:22:35.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:35.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:22:35.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:22:35.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:35.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:22:35.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:22:35.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:22:35.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:22:35.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:35.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:22:35.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:22:35.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:35.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:22:35.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:22:35.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:35.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:22:35.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:22:35.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:35.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:22:35.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:22:35.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:35.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:22:35.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:22:35.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:35.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:22:35.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:22:35.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:35.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:35.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:35.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:22:35.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:22:35.508 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.508 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.508 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.508 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:35.508 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:35.508 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:35.510 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:35.507+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:35.510 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:35.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~47s 2024-04-26T10:22:35.611 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:35.611+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:35.641 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:35.641 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:35.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.641 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:134092 5.6 5:63e64ad3:::benchmark_data_smithi052_19421_object4620:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:35.641 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:35.635557+0000", 2024-04-26T10:22:35.641 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0045574109999999999, 2024-04-26T10:22:35.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045739819999999999, 2024-04-26T10:22:35.641 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:35.642 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:35.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:35.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:35.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.642 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 134092 2024-04-26T10:22:35.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.642 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:35.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:35.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.635557+0000", 2024-04-26T10:22:35.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:35.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.635557+0000", 2024-04-26T10:22:35.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:35.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.635557+0000", 2024-04-26T10:22:35.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:35.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:35.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.635560+0000", 2024-04-26T10:22:35.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7159999999999999e-06 2024-04-26T10:22:35.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:35.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.635567+0000", 2024-04-26T10:22:35.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0210000000000002e-06 2024-04-26T10:22:35.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.635573+0000", 2024-04-26T10:22:35.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8320000000000002e-06 2024-04-26T10:22:35.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:35.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.637137+0000", 2024-04-26T10:22:35.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001564183 2024-04-26T10:22:35.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:35.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.637227+0000", 2024-04-26T10:22:35.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0581999999999994e-05 2024-04-26T10:22:35.645 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.645 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:35.645 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.645 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:134093 5.3 5:ce4c1e39:::benchmark_data_smithi052_19421_object4621:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:35.645 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:35.635580+0000", 2024-04-26T10:22:35.645 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0045345560000000004, 2024-04-26T10:22:35.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004600537, 2024-04-26T10:22:35.645 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:35.645 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:35.645 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:35.645 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:35.645 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.646 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 134093 2024-04-26T10:22:35.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.646 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:35.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:35.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.635580+0000", 2024-04-26T10:22:35.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:35.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.635580+0000", 2024-04-26T10:22:35.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:35.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.635580+0000", 2024-04-26T10:22:35.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:35.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:35.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.635583+0000", 2024-04-26T10:22:35.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.695e-06 2024-04-26T10:22:35.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:35.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.635590+0000", 2024-04-26T10:22:35.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1760000000000004e-06 2024-04-26T10:22:35.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.635597+0000", 2024-04-26T10:22:35.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8480000000000003e-06 2024-04-26T10:22:35.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:35.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.635631+0000", 2024-04-26T10:22:35.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4654999999999999e-05 2024-04-26T10:22:35.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:35.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.635760+0000", 2024-04-26T10:22:35.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012908200000000001 2024-04-26T10:22:35.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.649 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:35.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.649 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:134096 5.1 5:8b4ba634:::benchmark_data_smithi052_19421_object4624:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:35.649 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:35.636601+0000", 2024-04-26T10:22:35.649 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0035142020000000001, 2024-04-26T10:22:35.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036155979999999998, 2024-04-26T10:22:35.649 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:35.649 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:35.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:35.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:35.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.650 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 134096 2024-04-26T10:22:35.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.650 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:35.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:35.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.636601+0000", 2024-04-26T10:22:35.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:35.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.636601+0000", 2024-04-26T10:22:35.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:35.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.636600+0000", 2024-04-26T10:22:35.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:35.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.636605+0000", 2024-04-26T10:22:35.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.147e-06 2024-04-26T10:22:35.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:35.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.636623+0000", 2024-04-26T10:22:35.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.842e-05 2024-04-26T10:22:35.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.636637+0000", 2024-04-26T10:22:35.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3574000000000001e-05 2024-04-26T10:22:35.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:35.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.636732+0000", 2024-04-26T10:22:35.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4560000000000003e-05 2024-04-26T10:22:35.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:35.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.636908+0000", 2024-04-26T10:22:35.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017642800000000001 2024-04-26T10:22:35.653 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.653 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:35.653 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.653 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:134097 5.0 e49/37 5:036f5634:::benchmark_data_smithi052_19421_object4625:head v 49'8404, mlcod=49'8402)", 2024-04-26T10:22:35.653 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:35.638342+0000", 2024-04-26T10:22:35.653 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0017726389999999999, 2024-04-26T10:22:35.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001906694, 2024-04-26T10:22:35.653 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:35.653 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:35.653 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:35.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:35.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638342+0000", 2024-04-26T10:22:35.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:35.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638342+0000", 2024-04-26T10:22:35.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:35.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638341+0000", 2024-04-26T10:22:35.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:35.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638349+0000", 2024-04-26T10:22:35.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4800000000000004e-06 2024-04-26T10:22:35.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:35.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638357+0000", 2024-04-26T10:22:35.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1659999999999994e-06 2024-04-26T10:22:35.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638363+0000", 2024-04-26T10:22:35.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4370000000000004e-06 2024-04-26T10:22:35.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:35.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638502+0000", 2024-04-26T10:22:35.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013889600000000001 2024-04-26T10:22:35.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:35.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638524+0000", 2024-04-26T10:22:35.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1923999999999999e-05 2024-04-26T10:22:35.656 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.656 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:35.656 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.656 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:134100 5.6 5:6e506bc4:::benchmark_data_smithi052_19421_object4628:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:35.656 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:35.638813+0000", 2024-04-26T10:22:35.656 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0013021459999999999, 2024-04-26T10:22:35.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014669559999999999, 2024-04-26T10:22:35.657 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:35.657 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:35.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:35.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:35.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.657 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 134100 2024-04-26T10:22:35.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.657 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:35.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:35.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638813+0000", 2024-04-26T10:22:35.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:35.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638813+0000", 2024-04-26T10:22:35.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:35.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638812+0000", 2024-04-26T10:22:35.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:35.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638816+0000", 2024-04-26T10:22:35.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5770000000000004e-06 2024-04-26T10:22:35.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:35.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638827+0000", 2024-04-26T10:22:35.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0251999999999999e-05 2024-04-26T10:22:35.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638832+0000", 2024-04-26T10:22:35.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3179999999999997e-06 2024-04-26T10:22:35.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:35.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638865+0000", 2024-04-26T10:22:35.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3011e-05 2024-04-26T10:22:35.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:35.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.639001+0000", 2024-04-26T10:22:35.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013585800000000001 2024-04-26T10:22:35.660 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.660 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:35.660 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.660 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:134101 5.7 5:e12d1ac4:::benchmark_data_smithi052_19421_object4629:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:35.660 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:35.638864+0000", 2024-04-26T10:22:35.660 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0012505610000000001, 2024-04-26T10:22:35.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014477439999999999, 2024-04-26T10:22:35.660 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:35.660 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:35.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:35.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:35.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.661 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 134101 2024-04-26T10:22:35.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.661 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:35.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:35.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638864+0000", 2024-04-26T10:22:35.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:35.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638864+0000", 2024-04-26T10:22:35.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:35.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638864+0000", 2024-04-26T10:22:35.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:35.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:35.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638868+0000", 2024-04-26T10:22:35.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.33e-06 2024-04-26T10:22:35.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:35.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638879+0000", 2024-04-26T10:22:35.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0893999999999999e-05 2024-04-26T10:22:35.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638887+0000", 2024-04-26T10:22:35.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1920000000000005e-06 2024-04-26T10:22:35.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:35.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.638920+0000", 2024-04-26T10:22:35.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2892999999999998e-05 2024-04-26T10:22:35.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:35.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.639038+0000", 2024-04-26T10:22:35.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011796200000000001 2024-04-26T10:22:35.664 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.664 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:35.664 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.664 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:134088 5.d 5:baa3ed10:::benchmark_data_smithi052_19421_object4616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:35.664 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:35.634358+0000", 2024-04-26T10:22:35.664 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0057571760000000001, 2024-04-26T10:22:35.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059870619999999996, 2024-04-26T10:22:35.664 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:35.664 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:35.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:35.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:35.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.664 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 134088 2024-04-26T10:22:35.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.665 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:35.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:35.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.634358+0000", 2024-04-26T10:22:35.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:35.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.634358+0000", 2024-04-26T10:22:35.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:35.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.634357+0000", 2024-04-26T10:22:35.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:35.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.634363+0000", 2024-04-26T10:22:35.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0179999999999998e-06 2024-04-26T10:22:35.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:35.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.634387+0000", 2024-04-26T10:22:35.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4695999999999999e-05 2024-04-26T10:22:35.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.634396+0000", 2024-04-26T10:22:35.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2910000000000007e-06 2024-04-26T10:22:35.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:35.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.637369+0000", 2024-04-26T10:22:35.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029732370000000001 2024-04-26T10:22:35.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:35.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.637637+0000", 2024-04-26T10:22:35.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026816900000000001 2024-04-26T10:22:35.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:35.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:35.637770+0000", 2024-04-26T10:22:35.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013296200000000001 2024-04-26T10:22:35.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.668 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:35.668 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.668 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.668 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:35.668 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 7 2024-04-26T10:22:35.668 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:35.669 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:35.712 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:35.711+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:35.801 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:35.801 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:35.801 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:35.801 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:35.801 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:35.811 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:35.811+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:35.813 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:35.912 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:35.911+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:35.944 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:35.944 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:35.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:35.944 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:35.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.945 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:35.945 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:35.945 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.412050976000003, 2024-04-26T10:22:35.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:35.945 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:35.945 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:35.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:35.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.945 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:35.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.945 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:35.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:35.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:35.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:35.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:35.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:35.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:35.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:35.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:35.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:35.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:35.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:35.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:35.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:35.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:35.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:35.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:35.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:35.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:35.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:35.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:35.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:35.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:35.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:35.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:35.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:35.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:35.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:35.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:35.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:35.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:35.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:35.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:35.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:35.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:35.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:35.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.950 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:35.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.951 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:35.951 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:35.951 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.407515764000003, 2024-04-26T10:22:35.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:35.951 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:35.951 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:35.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:35.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.951 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:35.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.951 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:35.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:35.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:35.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:35.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:35.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:35.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:35.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:35.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:35.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:35.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:35.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:35.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:35.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:35.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:35.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:35.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:35.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:35.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:35.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:35.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:35.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:35.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:35.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:35.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:35.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:35.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:35.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:35.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:35.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:35.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:35.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:35.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:35.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:35.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:35.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:35.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:35.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.956 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:35.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.956 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:35.956 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:35.956 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.406884472000002, 2024-04-26T10:22:35.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:35.957 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:35.957 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:35.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:35.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.957 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:35.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.957 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:35.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:35.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:35.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:35.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:35.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:35.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:35.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:35.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:35.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:35.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:35.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:35.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:35.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:35.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:35.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:35.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:35.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:35.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:35.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:35.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:35.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:35.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:35.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:35.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:35.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:35.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:35.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:35.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:35.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:35.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:35.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:35.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:35.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:35.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:35.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:35.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.962 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:35.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.962 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110555 5.9 5:919989b3:::benchmark_data_smithi052_19421_object110554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:35.962 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:35.962 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.908087266999999, 2024-04-26T10:22:35.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129736717, 2024-04-26T10:22:35.962 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:35.962 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:35.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:35.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.963 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110555 2024-04-26T10:22:35.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.963 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:35.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:35.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:35.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:35.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:35.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:35.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033309+0000", 2024-04-26T10:22:35.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:35.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033393+0000", 2024-04-26T10:22:35.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3690999999999995e-05 2024-04-26T10:22:35.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:35.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033401+0000", 2024-04-26T10:22:35.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4319999999999999e-06 2024-04-26T10:22:35.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033406+0000", 2024-04-26T10:22:35.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2340000000000002e-06 2024-04-26T10:22:35.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:35.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033467+0000", 2024-04-26T10:22:35.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0915999999999997e-05 2024-04-26T10:22:35.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:35.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033550+0000", 2024-04-26T10:22:35.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3057000000000001e-05 2024-04-26T10:22:35.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:35.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033676+0000", 2024-04-26T10:22:35.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126162 2024-04-26T10:22:35.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:35.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037902+0000", 2024-04-26T10:22:35.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042255720000000004 2024-04-26T10:22:35.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:35.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162728+0000", 2024-04-26T10:22:35.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12482583799999999 2024-04-26T10:22:35.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:35.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162839+0000", 2024-04-26T10:22:35.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111222 2024-04-26T10:22:35.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:35.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163047+0000", 2024-04-26T10:22:35.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207686 2024-04-26T10:22:35.968 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.968 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:35.968 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.968 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110556 5.1 5:822c74bd:::benchmark_data_smithi052_19421_object110555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:35.968 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:35.968 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.907978160000001, 2024-04-26T10:22:35.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129274783, 2024-04-26T10:22:35.968 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:35.968 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:35.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:35.968 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.969 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110556 2024-04-26T10:22:35.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.969 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:35.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:35.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:35.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:35.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:35.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:35.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033418+0000", 2024-04-26T10:22:35.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:35.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033472+0000", 2024-04-26T10:22:35.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3780999999999999e-05 2024-04-26T10:22:35.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:35.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033478+0000", 2024-04-26T10:22:35.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6049999999999997e-06 2024-04-26T10:22:35.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033482+0000", 2024-04-26T10:22:35.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9110000000000001e-06 2024-04-26T10:22:35.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:35.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033509+0000", 2024-04-26T10:22:35.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6415e-05 2024-04-26T10:22:35.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:35.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033650+0000", 2024-04-26T10:22:35.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014088999999999999 2024-04-26T10:22:35.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:35.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161877+0000", 2024-04-26T10:22:35.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128227707 2024-04-26T10:22:35.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:35.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162541+0000", 2024-04-26T10:22:35.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000663863 2024-04-26T10:22:35.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:35.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162694+0000", 2024-04-26T10:22:35.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015245699999999999 2024-04-26T10:22:35.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.973 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:35.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.973 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110558 5.3 5:c73f56b6:::benchmark_data_smithi052_19421_object110557:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:35.973 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:35.973 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.907781525000001, 2024-04-26T10:22:35.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12864012999999999, 2024-04-26T10:22:35.973 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:35.973 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:35.973 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:35.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.974 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110558 2024-04-26T10:22:35.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.974 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:35.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:35.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:35.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:35.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:35.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:35.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033615+0000", 2024-04-26T10:22:35.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:35.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:35.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033717+0000", 2024-04-26T10:22:35.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102298 2024-04-26T10:22:35.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:35.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033725+0000", 2024-04-26T10:22:35.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0090000000000007e-06 2024-04-26T10:22:35.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033731+0000", 2024-04-26T10:22:35.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8919999999999997e-06 2024-04-26T10:22:35.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:35.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033769+0000", 2024-04-26T10:22:35.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7682999999999998e-05 2024-04-26T10:22:35.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:35.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033891+0000", 2024-04-26T10:22:35.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121718 2024-04-26T10:22:35.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:35.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161912+0000", 2024-04-26T10:22:35.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128021512 2024-04-26T10:22:35.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:35.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162043+0000", 2024-04-26T10:22:35.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130588 2024-04-26T10:22:35.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:35.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162256+0000", 2024-04-26T10:22:35.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021311499999999999 2024-04-26T10:22:35.978 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.978 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:35.978 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.978 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110557 5.b e45/37 5:d659544e:::benchmark_data_smithi052_19421_object110556:head v 45'6862, mlcod=45'6860)", 2024-04-26T10:22:35.978 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:35.978 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.906877292000001, 2024-04-26T10:22:35.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12783012499999999, 2024-04-26T10:22:35.978 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:35.978 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.978 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:35.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:35.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:35.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:35.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:35.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:35.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034519+0000", 2024-04-26T10:22:35.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:35.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034526+0000", 2024-04-26T10:22:35.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0380000000000002e-06 2024-04-26T10:22:35.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:35.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034539+0000", 2024-04-26T10:22:35.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.27e-05 2024-04-26T10:22:35.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034545+0000", 2024-04-26T10:22:35.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3369999999999996e-06 2024-04-26T10:22:35.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:35.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034606+0000", 2024-04-26T10:22:35.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0752999999999999e-05 2024-04-26T10:22:35.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:35.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034627+0000", 2024-04-26T10:22:35.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.088e-05 2024-04-26T10:22:35.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:35.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162272+0000", 2024-04-26T10:22:35.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12764540199999999 2024-04-26T10:22:35.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:35.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162350+0000", 2024-04-26T10:22:35.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7835000000000003e-05 2024-04-26T10:22:35.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.982 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:35.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.982 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110554 5.0 e45/37 5:04324c12:::benchmark_data_smithi052_19421_object110553:head v 45'6903, mlcod=45'6898)", 2024-04-26T10:22:35.982 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:35.982 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.90511787, 2024-04-26T10:22:35.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12566923499999999, 2024-04-26T10:22:35.982 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:35.983 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.983 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:35.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:35.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:35.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:35.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:35.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:35.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036278+0000", 2024-04-26T10:22:35.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:35.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036313+0000", 2024-04-26T10:22:35.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5247999999999999e-05 2024-04-26T10:22:35.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:35.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036324+0000", 2024-04-26T10:22:35.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0496000000000001e-05 2024-04-26T10:22:35.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036329+0000", 2024-04-26T10:22:35.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3070000000000002e-06 2024-04-26T10:22:35.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:35.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036364+0000", 2024-04-26T10:22:35.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4391000000000003e-05 2024-04-26T10:22:35.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:35.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036377+0000", 2024-04-26T10:22:35.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3706999999999999e-05 2024-04-26T10:22:35.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:35.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042032+0000", 2024-04-26T10:22:35.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056547120000000001 2024-04-26T10:22:35.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:35.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161949+0000", 2024-04-26T10:22:35.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119916482 2024-04-26T10:22:35.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.986 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:35.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.987 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110559 5.2 5:44c3f174:::benchmark_data_smithi052_19421_object110558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:35.987 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:35.987 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.90349926, 2024-04-26T10:22:35.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12530391299999999, 2024-04-26T10:22:35.987 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:35.987 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:35.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:35.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.987 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110559 2024-04-26T10:22:35.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.987 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:35.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:35.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:35.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:35.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:35.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:35.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037897+0000", 2024-04-26T10:22:35.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:35.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037922+0000", 2024-04-26T10:22:35.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5004e-05 2024-04-26T10:22:35.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:35.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037931+0000", 2024-04-26T10:22:35.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-04-26T10:22:35.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037937+0000", 2024-04-26T10:22:35.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6749999999999999e-06 2024-04-26T10:22:35.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:35.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037972+0000", 2024-04-26T10:22:35.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4678000000000002e-05 2024-04-26T10:22:35.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:35.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038108+0000", 2024-04-26T10:22:35.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013689099999999999 2024-04-26T10:22:35.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:35.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162887+0000", 2024-04-26T10:22:35.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124778258 2024-04-26T10:22:35.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:35.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163010+0000", 2024-04-26T10:22:35.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122924 2024-04-26T10:22:35.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:35.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163202+0000", 2024-04-26T10:22:35.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192203 2024-04-26T10:22:35.991 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.991 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:35.991 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.992 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110560 5.3 5:caf5a141:::benchmark_data_smithi052_19421_object110559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:35.992 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:35.992 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.903448659, 2024-04-26T10:22:35.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12888738299999999, 2024-04-26T10:22:35.992 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:35.992 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.992 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:35.992 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:35.992 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.992 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110560 2024-04-26T10:22:35.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.992 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:35.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:35.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:35.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:35.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:35.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:35.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037948+0000", 2024-04-26T10:22:35.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:35.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:35.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037973+0000", 2024-04-26T10:22:35.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5187000000000001e-05 2024-04-26T10:22:35.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:35.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037978+0000", 2024-04-26T10:22:35.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4120000000000003e-06 2024-04-26T10:22:35.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:35.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037981+0000", 2024-04-26T10:22:35.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6689999999999999e-06 2024-04-26T10:22:35.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:35.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038041+0000", 2024-04-26T10:22:35.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9324999999999999e-05 2024-04-26T10:22:35.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:35.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038179+0000", 2024-04-26T10:22:35.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013832499999999999 2024-04-26T10:22:35.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:35.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166427+0000", 2024-04-26T10:22:35.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128248165 2024-04-26T10:22:35.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:35.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166539+0000", 2024-04-26T10:22:35.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111538 2024-04-26T10:22:35.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:35.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166836+0000", 2024-04-26T10:22:35.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029714100000000001 2024-04-26T10:22:35.996 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.996 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:35.997 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:35.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.997 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110561 5.d 5:b143edec:::benchmark_data_smithi052_19421_object110560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:35.997 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:35.997 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.903406601, 2024-04-26T10:22:35.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.125215574, 2024-04-26T10:22:35.997 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:35.997 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:35.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:35.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:35.997 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:35.997 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110561 2024-04-26T10:22:35.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.998 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:35.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:35.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:35.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:35.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:35.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:35.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:35.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037990+0000", 2024-04-26T10:22:35.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:35.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:35.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038028+0000", 2024-04-26T10:22:35.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7802999999999997e-05 2024-04-26T10:22:35.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:35.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:35.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038035+0000", 2024-04-26T10:22:35.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-06 2024-04-26T10:22:35.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:35.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038040+0000", 2024-04-26T10:22:36.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.147e-06 2024-04-26T10:22:36.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038077+0000", 2024-04-26T10:22:36.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7166999999999998e-05 2024-04-26T10:22:36.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038192+0000", 2024-04-26T10:22:36.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115565 2024-04-26T10:22:36.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:36.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038319+0000", 2024-04-26T10:22:36.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012697699999999999 2024-04-26T10:22:36.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:36.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162690+0000", 2024-04-26T10:22:36.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12437065 2024-04-26T10:22:36.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:36.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162878+0000", 2024-04-26T10:22:36.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000188173 2024-04-26T10:22:36.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:36.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162992+0000", 2024-04-26T10:22:36.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114008 2024-04-26T10:22:36.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:36.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163206+0000", 2024-04-26T10:22:36.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021394900000000001 2024-04-26T10:22:36.002 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.003 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.003 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.003 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:36.003 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:36.003 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.903345997000001, 2024-04-26T10:22:36.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:22:36.003 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.003 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:36.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:36.003 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.003 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:22:36.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.004 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:36.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:36.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:36.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:22:36.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:22:36.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:22:36.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:22:36.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:22:36.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:22:36.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:22:36.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:22:36.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:22:36.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:22:36.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:36.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:22:36.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:22:36.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:36.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:22:36.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:22:36.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:36.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:22:36.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:22:36.007 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.008 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.008 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.008 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110564 5.3 5:c09e33cb:::benchmark_data_smithi052_19421_object110563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:36.008 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:36.008 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.903293338999999, 2024-04-26T10:22:36.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128984614, 2024-04-26T10:22:36.008 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.008 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:36.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:36.008 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.009 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110564 2024-04-26T10:22:36.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.009 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:36.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:36.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038103+0000", 2024-04-26T10:22:36.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038136+0000", 2024-04-26T10:22:36.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.243e-05 2024-04-26T10:22:36.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038143+0000", 2024-04-26T10:22:36.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0870000000000001e-06 2024-04-26T10:22:36.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038151+0000", 2024-04-26T10:22:36.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:22:36.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039813+0000", 2024-04-26T10:22:36.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001661844 2024-04-26T10:22:36.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039970+0000", 2024-04-26T10:22:36.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015712699999999999 2024-04-26T10:22:36.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:36.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166854+0000", 2024-04-26T10:22:36.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.126883788 2024-04-26T10:22:36.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:36.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166976+0000", 2024-04-26T10:22:36.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012231399999999999 2024-04-26T10:22:36.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:36.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167088+0000", 2024-04-26T10:22:36.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011243699999999999 2024-04-26T10:22:36.013 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.013 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.013 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.013 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:36.013 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:36.013 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.903236745999999, 2024-04-26T10:22:36.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:22:36.013 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.013 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.013 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:36.013 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:36.013 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.013 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:22:36.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.014 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:36.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:36.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:36.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:22:36.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:22:36.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:22:36.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:22:36.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:22:36.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:22:36.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:22:36.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:22:36.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:22:36.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:22:36.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:36.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:22:36.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:22:36.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:36.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:22:36.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:22:36.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:36.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:22:36.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:22:36.018 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.018 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.018 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.018 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110566 5.c 5:34145698:::benchmark_data_smithi052_19421_object110565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:36.018 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:36.018 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.903186969, 2024-04-26T10:22:36.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12673530699999999, 2024-04-26T10:22:36.018 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.018 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.018 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:36.018 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:36.019 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.019 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110566 2024-04-26T10:22:36.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.019 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:36.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:36.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:36.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038246+0000", 2024-04-26T10:22:36.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5759000000000001e-05 2024-04-26T10:22:36.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038252+0000", 2024-04-26T10:22:36.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5300000000000002e-06 2024-04-26T10:22:36.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038257+0000", 2024-04-26T10:22:36.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:36.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038312+0000", 2024-04-26T10:22:36.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5108000000000002e-05 2024-04-26T10:22:36.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038480+0000", 2024-04-26T10:22:36.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016751099999999999 2024-04-26T10:22:36.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:36.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164651+0000", 2024-04-26T10:22:36.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12617115600000001 2024-04-26T10:22:36.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:36.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164770+0000", 2024-04-26T10:22:36.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118748 2024-04-26T10:22:36.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:36.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164946+0000", 2024-04-26T10:22:36.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175966 2024-04-26T10:22:36.023 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.023 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.023 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.023 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:36.023 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:36.023 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.900839334, 2024-04-26T10:22:36.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:22:36.023 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.023 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:36.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:36.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.024 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:22:36.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.024 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:36.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:36.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:22:36.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:36.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:22:36.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:22:36.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:22:36.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:22:36.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:22:36.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:22:36.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:22:36.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:22:36.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:22:36.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:22:36.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:36.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:22:36.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:22:36.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:36.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:22:36.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:22:36.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:36.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:22:36.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:22:36.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:36.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:22:36.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:22:36.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:36.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:22:36.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:22:36.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.028 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.029 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110568 5.c 5:34af8ad3:::benchmark_data_smithi052_19421_object110567:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:36.029 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:36.029 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.900721709000001, 2024-04-26T10:22:36.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124943661, 2024-04-26T10:22:36.029 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.029 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:36.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:36.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.029 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110568 2024-04-26T10:22:36.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.029 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:36.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:36.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:36.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040711+0000", 2024-04-26T10:22:36.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6531e-05 2024-04-26T10:22:36.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040719+0000", 2024-04-26T10:22:36.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6120000000000001e-06 2024-04-26T10:22:36.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040724+0000", 2024-04-26T10:22:36.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2100000000000001e-06 2024-04-26T10:22:36.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040771+0000", 2024-04-26T10:22:36.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7123000000000003e-05 2024-04-26T10:22:36.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040984+0000", 2024-04-26T10:22:36.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021227400000000001 2024-04-26T10:22:36.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:36.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165350+0000", 2024-04-26T10:22:36.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124366738 2024-04-26T10:22:36.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:36.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165459+0000", 2024-04-26T10:22:36.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108168 2024-04-26T10:22:36.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:36.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165619+0000", 2024-04-26T10:22:36.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160564 2024-04-26T10:22:36.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.033 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.034 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.034 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:36.034 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:36.034 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.90065341, 2024-04-26T10:22:36.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:22:36.034 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.034 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:36.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:36.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.034 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:22:36.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.035 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:36.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:36.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:22:36.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:22:36.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:22:36.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:22:36.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:22:36.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:22:36.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:22:36.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:22:36.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:22:36.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:22:36.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:22:36.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:36.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:22:36.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:22:36.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:36.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:22:36.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:22:36.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:36.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:22:36.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:22:36.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:36.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:22:36.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:22:36.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:36.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:22:36.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:22:36.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.039 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.040 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110570 5.1 5:876a468c:::benchmark_data_smithi052_19421_object110569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:36.040 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:36.040 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 11.899350865000001, 2024-04-26T10:22:36.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12851437099999999, 2024-04-26T10:22:36.040 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.040 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:36.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:36.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.040 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110570 2024-04-26T10:22:36.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.040 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:36.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:36.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042045+0000", 2024-04-26T10:22:36.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:36.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042083+0000", 2024-04-26T10:22:36.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8064e-05 2024-04-26T10:22:36.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161855+0000", 2024-04-26T10:22:36.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119771934 2024-04-26T10:22:36.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161882+0000", 2024-04-26T10:22:36.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7083000000000001e-05 2024-04-26T10:22:36.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163117+0000", 2024-04-26T10:22:36.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001234509 2024-04-26T10:22:36.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163507+0000", 2024-04-26T10:22:36.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038998400000000001 2024-04-26T10:22:36.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:36.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170347+0000", 2024-04-26T10:22:36.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006840952 2024-04-26T10:22:36.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:36.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170488+0000", 2024-04-26T10:22:36.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140393 2024-04-26T10:22:36.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:36.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170561+0000", 2024-04-26T10:22:36.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2809e-05 2024-04-26T10:22:36.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.044 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.045 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:124481 5.d 5:b507cdbb:::benchmark_data_smithi052_19421_object124480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:36.045 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:36.045 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.8609859430000002, 2024-04-26T10:22:36.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.087933879000000006, 2024-04-26T10:22:36.045 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.045 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:36.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:36.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.045 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124481 2024-04-26T10:22:36.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.045 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:36.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:36.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080410+0000", 2024-04-26T10:22:36.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:36.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080523+0000", 2024-04-26T10:22:36.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112501 2024-04-26T10:22:36.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080528+0000", 2024-04-26T10:22:36.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1789999999999999e-06 2024-04-26T10:22:36.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080532+0000", 2024-04-26T10:22:36.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.805e-06 2024-04-26T10:22:36.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080562+0000", 2024-04-26T10:22:36.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0241000000000001e-05 2024-04-26T10:22:36.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080645+0000", 2024-04-26T10:22:36.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2816000000000001e-05 2024-04-26T10:22:36.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:36.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080786+0000", 2024-04-26T10:22:36.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014129400000000001 2024-04-26T10:22:36.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:36.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.084288+0000", 2024-04-26T10:22:36.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035017920000000001 2024-04-26T10:22:36.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:36.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.167975+0000", 2024-04-26T10:22:36.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.083686673000000003 2024-04-26T10:22:36.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:36.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.168092+0000", 2024-04-26T10:22:36.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117607 2024-04-26T10:22:36.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:36.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.168345+0000", 2024-04-26T10:22:36.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025299200000000001 2024-04-26T10:22:36.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.050 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.050 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.050 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.050 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:36.052 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:36.053 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:36.051+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:36.068 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:22:36.152 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:36.148+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:36.182 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:36.182 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:36.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.182 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:135295 5.8 5:19abf590:::benchmark_data_smithi052_19421_object5823:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:36.182 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:36.174175+0000", 2024-04-26T10:22:36.182 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0075704589999999999, 2024-04-26T10:22:36.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075915790000000002, 2024-04-26T10:22:36.183 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.183 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:36.183 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.183 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.183 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.183 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 135295 2024-04-26T10:22:36.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.183 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174175+0000", 2024-04-26T10:22:36.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174175+0000", 2024-04-26T10:22:36.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174174+0000", 2024-04-26T10:22:36.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:36.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174179+0000", 2024-04-26T10:22:36.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:22:36.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174190+0000", 2024-04-26T10:22:36.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0473e-05 2024-04-26T10:22:36.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174195+0000", 2024-04-26T10:22:36.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.22e-06 2024-04-26T10:22:36.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174227+0000", 2024-04-26T10:22:36.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1887000000000001e-05 2024-04-26T10:22:36.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174306+0000", 2024-04-26T10:22:36.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8961999999999994e-05 2024-04-26T10:22:36.186 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.186 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.186 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.187 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:135301 5.b 5:db143573:::benchmark_data_smithi052_19421_object5829:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:36.187 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:36.174691+0000", 2024-04-26T10:22:36.187 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0070546109999999997, 2024-04-26T10:22:36.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0071213439999999999, 2024-04-26T10:22:36.187 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.187 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:36.187 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.187 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.187 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.187 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 135301 2024-04-26T10:22:36.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.187 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174691+0000", 2024-04-26T10:22:36.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174691+0000", 2024-04-26T10:22:36.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174690+0000", 2024-04-26T10:22:36.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:36.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174695+0000", 2024-04-26T10:22:36.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6070000000000001e-06 2024-04-26T10:22:36.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174703+0000", 2024-04-26T10:22:36.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.422e-06 2024-04-26T10:22:36.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174711+0000", 2024-04-26T10:22:36.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2539999999999992e-06 2024-04-26T10:22:36.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.175267+0000", 2024-04-26T10:22:36.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00055592499999999997 2024-04-26T10:22:36.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.175410+0000", 2024-04-26T10:22:36.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014229999999999999 2024-04-26T10:22:36.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:36.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.175527+0000", 2024-04-26T10:22:36.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011731300000000001 2024-04-26T10:22:36.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.178741+0000", 2024-04-26T10:22:36.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003213998 2024-04-26T10:22:36.191 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.191 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.191 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.191 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:135303 5.0 5:068295af:::benchmark_data_smithi052_19421_object5831:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:36.191 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:36.174770+0000", 2024-04-26T10:22:36.191 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0069752240000000004, 2024-04-26T10:22:36.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.007088408, 2024-04-26T10:22:36.192 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.192 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:36.192 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.192 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.192 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.192 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 135303 2024-04-26T10:22:36.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.192 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174770+0000", 2024-04-26T10:22:36.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174770+0000", 2024-04-26T10:22:36.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174770+0000", 2024-04-26T10:22:36.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174774+0000", 2024-04-26T10:22:36.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0119999999999999e-06 2024-04-26T10:22:36.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174782+0000", 2024-04-26T10:22:36.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9289999999999998e-06 2024-04-26T10:22:36.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174789+0000", 2024-04-26T10:22:36.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1770000000000001e-06 2024-04-26T10:22:36.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.175903+0000", 2024-04-26T10:22:36.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001114692 2024-04-26T10:22:36.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.176014+0000", 2024-04-26T10:22:36.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011105 2024-04-26T10:22:36.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:36.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.176123+0000", 2024-04-26T10:22:36.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010875 2024-04-26T10:22:36.195 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.195 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.196 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.196 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:135304 5.0 5:0e8f037b:::benchmark_data_smithi052_19421_object5832:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:36.196 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:36.174795+0000", 2024-04-26T10:22:36.196 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0069504149999999997, 2024-04-26T10:22:36.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0071044480000000002, 2024-04-26T10:22:36.196 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.196 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:36.196 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.196 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.196 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.197 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 135304 2024-04-26T10:22:36.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.197 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174795+0000", 2024-04-26T10:22:36.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174795+0000", 2024-04-26T10:22:36.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174795+0000", 2024-04-26T10:22:36.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174797+0000", 2024-04-26T10:22:36.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5639999999999999e-06 2024-04-26T10:22:36.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174803+0000", 2024-04-26T10:22:36.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0419999999999999e-06 2024-04-26T10:22:36.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174808+0000", 2024-04-26T10:22:36.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0590000000000002e-06 2024-04-26T10:22:36.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.178041+0000", 2024-04-26T10:22:36.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003232614 2024-04-26T10:22:36.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.178157+0000", 2024-04-26T10:22:36.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011572400000000001 2024-04-26T10:22:36.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:36.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.178267+0000", 2024-04-26T10:22:36.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010998 2024-04-26T10:22:36.200 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.200 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.200 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.200 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:135305 5.4 5:249df0dc:::benchmark_data_smithi052_19421_object5833:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:36.200 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:36.174813+0000", 2024-04-26T10:22:36.200 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.006932634, 2024-04-26T10:22:36.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0071265690000000001, 2024-04-26T10:22:36.201 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.201 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:36.201 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.201 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.201 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.201 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 135305 2024-04-26T10:22:36.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.201 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174813+0000", 2024-04-26T10:22:36.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174813+0000", 2024-04-26T10:22:36.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174813+0000", 2024-04-26T10:22:36.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174815+0000", 2024-04-26T10:22:36.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.136e-06 2024-04-26T10:22:36.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174820+0000", 2024-04-26T10:22:36.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4949999999999999e-06 2024-04-26T10:22:36.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174827+0000", 2024-04-26T10:22:36.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4019999999999999e-06 2024-04-26T10:22:36.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174864+0000", 2024-04-26T10:22:36.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7543999999999998e-05 2024-04-26T10:22:36.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.174981+0000", 2024-04-26T10:22:36.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011692300000000001 2024-04-26T10:22:36.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:36.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.175093+0000", 2024-04-26T10:22:36.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011192300000000001 2024-04-26T10:22:36.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.181874+0000", 2024-04-26T10:22:36.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0067809230000000003 2024-04-26T10:22:36.205 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.205 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.205 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.205 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:135310 5.4 5:21c84f5e:::benchmark_data_smithi052_19421_object5838:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:36.205 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:36.177293+0000", 2024-04-26T10:22:36.205 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0044524330000000004, 2024-04-26T10:22:36.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046878309999999999, 2024-04-26T10:22:36.205 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.205 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:36.205 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.205 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.205 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.205 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 135310 2024-04-26T10:22:36.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.206 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177293+0000", 2024-04-26T10:22:36.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177293+0000", 2024-04-26T10:22:36.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177292+0000", 2024-04-26T10:22:36.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:36.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177299+0000", 2024-04-26T10:22:36.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8719999999999996e-06 2024-04-26T10:22:36.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177308+0000", 2024-04-26T10:22:36.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5799999999999998e-06 2024-04-26T10:22:36.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177326+0000", 2024-04-26T10:22:36.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8187000000000001e-05 2024-04-26T10:22:36.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177371+0000", 2024-04-26T10:22:36.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4280999999999998e-05 2024-04-26T10:22:36.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177482+0000", 2024-04-26T10:22:36.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110917 2024-04-26T10:22:36.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:36.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177588+0000", 2024-04-26T10:22:36.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000106463 2024-04-26T10:22:36.209 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.209 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.209 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.209 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:135311 5.0 5:0e76dade:::benchmark_data_smithi052_19421_object5839:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:36.209 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:36.177350+0000", 2024-04-26T10:22:36.209 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0043956070000000002, 2024-04-26T10:22:36.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004668681, 2024-04-26T10:22:36.209 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.209 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:36.209 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.209 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.209 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.210 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 135311 2024-04-26T10:22:36.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.210 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177350+0000", 2024-04-26T10:22:36.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177350+0000", 2024-04-26T10:22:36.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177349+0000", 2024-04-26T10:22:36.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177353+0000", 2024-04-26T10:22:36.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6219999999999998e-06 2024-04-26T10:22:36.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177360+0000", 2024-04-26T10:22:36.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8249999999999999e-06 2024-04-26T10:22:36.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177365+0000", 2024-04-26T10:22:36.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2580000000000003e-06 2024-04-26T10:22:36.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.180165+0000", 2024-04-26T10:22:36.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028003260000000001 2024-04-26T10:22:36.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.180315+0000", 2024-04-26T10:22:36.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014987099999999999 2024-04-26T10:22:36.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:36.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.180445+0000", 2024-04-26T10:22:36.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0001293 2024-04-26T10:22:36.213 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.213 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.213 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.213 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:135312 5.4 5:251e3a11:::benchmark_data_smithi052_19421_object5840:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:36.213 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:36.177548+0000", 2024-04-26T10:22:36.213 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0041975069999999996, 2024-04-26T10:22:36.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045155839999999996, 2024-04-26T10:22:36.214 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.214 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:36.214 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.214 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.214 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.214 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 135312 2024-04-26T10:22:36.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.214 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177548+0000", 2024-04-26T10:22:36.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177548+0000", 2024-04-26T10:22:36.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177547+0000", 2024-04-26T10:22:36.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:36.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177551+0000", 2024-04-26T10:22:36.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8249999999999998e-06 2024-04-26T10:22:36.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177559+0000", 2024-04-26T10:22:36.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.576e-06 2024-04-26T10:22:36.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.177564+0000", 2024-04-26T10:22:36.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2530000000000004e-06 2024-04-26T10:22:36.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179629+0000", 2024-04-26T10:22:36.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020655140000000001 2024-04-26T10:22:36.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179780+0000", 2024-04-26T10:22:36.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000150092 2024-04-26T10:22:36.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:36.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179880+0000", 2024-04-26T10:22:36.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0001008 2024-04-26T10:22:36.217 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.217 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.217 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.218 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:135313 5.b 5:d27a688d:::benchmark_data_smithi052_19421_object5841:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:36.218 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:36.179013+0000", 2024-04-26T10:22:36.218 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0027320130000000001, 2024-04-26T10:22:36.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003087968, 2024-04-26T10:22:36.218 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.218 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:36.218 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.218 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.218 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.218 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 135313 2024-04-26T10:22:36.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.218 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179013+0000", 2024-04-26T10:22:36.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179013+0000", 2024-04-26T10:22:36.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179013+0000", 2024-04-26T10:22:36.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:36.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179017+0000", 2024-04-26T10:22:36.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9239999999999998e-06 2024-04-26T10:22:36.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179026+0000", 2024-04-26T10:22:36.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7339999999999997e-06 2024-04-26T10:22:36.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179031+0000", 2024-04-26T10:22:36.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8629999999999999e-06 2024-04-26T10:22:36.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179065+0000", 2024-04-26T10:22:36.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3874000000000001e-05 2024-04-26T10:22:36.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179208+0000", 2024-04-26T10:22:36.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014307499999999999 2024-04-26T10:22:36.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:36.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179325+0000", 2024-04-26T10:22:36.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011668 2024-04-26T10:22:36.221 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.221 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.221 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.222 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:135315 5.a 5:58479b89:::benchmark_data_smithi052_19421_object5843:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:36.222 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:36.179306+0000", 2024-04-26T10:22:36.222 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0024397289999999999, 2024-04-26T10:22:36.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0028424309999999999, 2024-04-26T10:22:36.222 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.222 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:36.222 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.222 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.222 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.222 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 135315 2024-04-26T10:22:36.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.223 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179306+0000", 2024-04-26T10:22:36.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179306+0000", 2024-04-26T10:22:36.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179305+0000", 2024-04-26T10:22:36.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179311+0000", 2024-04-26T10:22:36.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2580000000000001e-06 2024-04-26T10:22:36.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179317+0000", 2024-04-26T10:22:36.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8200000000000002e-06 2024-04-26T10:22:36.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179321+0000", 2024-04-26T10:22:36.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2640000000000002e-06 2024-04-26T10:22:36.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179360+0000", 2024-04-26T10:22:36.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8543e-05 2024-04-26T10:22:36.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179490+0000", 2024-04-26T10:22:36.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013025800000000001 2024-04-26T10:22:36.226 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.226 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.226 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.226 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:135316 5.d e49/37 5:b4cef58b:::benchmark_data_smithi052_19421_object5844:head v 49'8528, mlcod=49'8526)", 2024-04-26T10:22:36.226 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:36.179760+0000", 2024-04-26T10:22:36.226 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0019857970000000001, 2024-04-26T10:22:36.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024237730000000002, 2024-04-26T10:22:36.226 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.226 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:36.227 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179760+0000", 2024-04-26T10:22:36.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179760+0000", 2024-04-26T10:22:36.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179759+0000", 2024-04-26T10:22:36.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179766+0000", 2024-04-26T10:22:36.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7209999999999997e-06 2024-04-26T10:22:36.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179774+0000", 2024-04-26T10:22:36.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0800000000000006e-06 2024-04-26T10:22:36.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179780+0000", 2024-04-26T10:22:36.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1619999999999996e-06 2024-04-26T10:22:36.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179836+0000", 2024-04-26T10:22:36.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6313000000000001e-05 2024-04-26T10:22:36.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:36.179856+0000", 2024-04-26T10:22:36.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0041999999999999e-05 2024-04-26T10:22:36.229 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.229 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.229 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.229 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.229 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:36.230 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 11 2024-04-26T10:22:36.230 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:36.231 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:36.252 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:36.248+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:36.353 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:36.348+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:36.357 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:36.358 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:36.358 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:36.358 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:36.358 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:36.369 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:36.454 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:36.451+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:36.504 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:36.504 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 35.971819359999998, 2024-04-26T10:22:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.505 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:36.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.506 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:36.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:36.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:36.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 35.969837132999999, 2024-04-26T10:22:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:36.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:36.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:36.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:36.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:36.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 35.969637749, 2024-04-26T10:22:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.516 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:36.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:36.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:36.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.521 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 35.969419129000002, 2024-04-26T10:22:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:36.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:36.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.526 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 35.967047690999998, 2024-04-26T10:22:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.527 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:36.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:36.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 35.966947069, 2024-04-26T10:22:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:36.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:36.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 35.966828507999999, 2024-04-26T10:22:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:36.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 35.966726110000003, 2024-04-26T10:22:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.544 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:36.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:36.549 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 35.965705552999999, 2024-04-26T10:22:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.550 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:36.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:36.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 35.964555277999999, 2024-04-26T10:22:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:36.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:36.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:36.561 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:36.562 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.467856036000001, 2024-04-26T10:22:36.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:22:36.562 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.562 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.562 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.562 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.562 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.562 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:22:36.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.562 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:22:36.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:22:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:22:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:22:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:22:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:22:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:22:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:22:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:22:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:22:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:22:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:22:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:22:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:22:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:22:36.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:22:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:22:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:22:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:22:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:22:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:22:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 12.467632439999999, 2024-04-26T10:22:36.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:22:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:22:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:36.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:22:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:22:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:22:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:22:36.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:22:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:22:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:22:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:22:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:22:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:22:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:22:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:22:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:22:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:22:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:22:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:22:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:22:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:22:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:22:36.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:22:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:22:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:36.575 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.4367861199999998, 2024-04-26T10:22:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:22:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:22:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:22:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:22:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:22:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:22:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:22:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:22:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:22:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:22:36.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:22:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:22:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:22:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:22:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:22:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:22:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:22:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:22:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:22:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:22:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:22:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:22:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:22:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:36.582 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.4347750169999998, 2024-04-26T10:22:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:22:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:22:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:36.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:36.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:36.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:22:36.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:22:36.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:22:36.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:22:36.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:22:36.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:22:36.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:22:36.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:22:36.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.586 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:22:36.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:22:36.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:36.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:22:36.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:22:36.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:36.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:22:36.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:22:36.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:22:36.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:22:36.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:22:36.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:22:36.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:22:36.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:22:36.589 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.589 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.589 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.589 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:36.589 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:36.589 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.423896912, 2024-04-26T10:22:36.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:22:36.589 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.590 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.590 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.590 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.590 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.590 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:22:36.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.590 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:36.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:36.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:22:36.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:36.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.591 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.591 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:22:36.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:22:36.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:22:36.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:22:36.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:22:36.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:22:36.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:22:36.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:22:36.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:22:36.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:22:36.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:36.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:22:36.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:22:36.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:36.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:22:36.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:22:36.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:22:36.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:22:36.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:22:36.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:22:36.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:22:36.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:22:36.595 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.595 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.595 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.596 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:36.596 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:36.596 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.4212156929999997, 2024-04-26T10:22:36.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:22:36.596 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.596 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.596 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.596 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.596 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.596 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:22:36.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.596 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:36.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:36.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:22:36.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:36.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:22:36.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:22:36.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:22:36.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:22:36.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:22:36.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:22:36.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:22:36.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:22:36.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:22:36.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:22:36.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:36.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:22:36.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:22:36.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:36.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:22:36.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:22:36.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:22:36.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:22:36.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.601 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:22:36.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:22:36.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:22:36.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:22:36.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.602 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.602 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:36.602 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:36.602 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.420848618, 2024-04-26T10:22:36.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:22:36.603 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.603 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.603 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.603 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.603 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.603 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:22:36.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.603 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:36.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:36.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:22:36.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:36.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:22:36.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:22:36.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:22:36.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:22:36.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:22:36.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:22:36.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:22:36.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:22:36.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:22:36.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:22:36.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:22:36.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:22:36.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:22:36.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:22:36.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:22:36.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:22:36.608 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.608 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.608 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.608 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:36.608 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:36.608 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.4207843660000004, 2024-04-26T10:22:36.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:22:36.608 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.608 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.608 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.609 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.609 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.609 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:22:36.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.609 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:36.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:36.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:22:36.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:22:36.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:22:36.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:22:36.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:22:36.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:22:36.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:22:36.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:22:36.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:22:36.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:22:36.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:22:36.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:22:36.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:22:36.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:22:36.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:22:36.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:22:36.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:22:36.613 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.613 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.614 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.614 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:36.614 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:36.614 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.4163856929999996, 2024-04-26T10:22:36.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:22:36.614 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.614 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.614 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.614 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.614 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.615 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:22:36.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.615 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:36.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:36.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:22:36.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:22:36.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:22:36.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:22:36.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:22:36.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:22:36.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:22:36.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:22:36.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:22:36.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:22:36.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:22:36.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:22:36.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:22:36.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:22:36.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:22:36.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:22:36.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:22:36.619 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.619 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.619 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.620 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:36.620 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:36.620 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 5.4146277099999995, 2024-04-26T10:22:36.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:22:36.620 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:36.620 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.620 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:36.620 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:36.620 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.620 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:22:36.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.620 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:36.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:36.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:36.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:36.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:36.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:36.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:36.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:22:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:22:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:22:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:22:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:22:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:22:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:22:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:22:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:22:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:22:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:22:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:22:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:22:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:22:36.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:22:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:22:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:22:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:22:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:22:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:36.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:22:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:22:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:36.626 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:36.626 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:36.628 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:36.627+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:36.628 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:36.729 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:36.724+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:36.760 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:36.760 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:36.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.761 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:136692 5.c 5:3c8ce2b4:::benchmark_data_smithi052_19421_object7220:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:36.761 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:36.749528+0000", 2024-04-26T10:22:36.761 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0094129560000000001, 2024-04-26T10:22:36.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0094314710000000003, 2024-04-26T10:22:36.761 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.761 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:36.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:36.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:36.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.761 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136692 2024-04-26T10:22:36.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.761 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.749528+0000", 2024-04-26T10:22:36.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.749528+0000", 2024-04-26T10:22:36.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.749527+0000", 2024-04-26T10:22:36.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:36.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.749532+0000", 2024-04-26T10:22:36.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9679999999999997e-06 2024-04-26T10:22:36.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.749541+0000", 2024-04-26T10:22:36.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3039999999999994e-06 2024-04-26T10:22:36.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.749547+0000", 2024-04-26T10:22:36.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0599999999999996e-06 2024-04-26T10:22:36.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.753066+0000", 2024-04-26T10:22:36.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035188340000000002 2024-04-26T10:22:36.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.753145+0000", 2024-04-26T10:22:36.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9332999999999994e-05 2024-04-26T10:22:36.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.764 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.765 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.765 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:136697 5.9 5:9875a05a:::benchmark_data_smithi052_19421_object7225:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:36.765 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:36.751910+0000", 2024-04-26T10:22:36.765 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0070303359999999999, 2024-04-26T10:22:36.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071033629999999997, 2024-04-26T10:22:36.765 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.765 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:36.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:36.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:36.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.765 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136697 2024-04-26T10:22:36.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.766 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.751910+0000", 2024-04-26T10:22:36.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.751910+0000", 2024-04-26T10:22:36.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.751910+0000", 2024-04-26T10:22:36.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.751913+0000", 2024-04-26T10:22:36.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8289999999999999e-06 2024-04-26T10:22:36.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.751919+0000", 2024-04-26T10:22:36.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6710000000000004e-06 2024-04-26T10:22:36.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.751923+0000", 2024-04-26T10:22:36.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6249999999999998e-06 2024-04-26T10:22:36.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.751967+0000", 2024-04-26T10:22:36.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3642e-05 2024-04-26T10:22:36.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.752117+0000", 2024-04-26T10:22:36.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014984899999999999 2024-04-26T10:22:36.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:36.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.752220+0000", 2024-04-26T10:22:36.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103787 2024-04-26T10:22:36.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:36.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.758079+0000", 2024-04-26T10:22:36.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0058584860000000004 2024-04-26T10:22:36.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.769 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.770 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:136698 5.f 5:f7ba369f:::benchmark_data_smithi052_19421_object7226:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:36.770 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:36.753008+0000", 2024-04-26T10:22:36.770 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0059323780000000003, 2024-04-26T10:22:36.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006047083, 2024-04-26T10:22:36.770 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.770 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:36.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:36.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:36.770 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.770 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136698 2024-04-26T10:22:36.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.771 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.753008+0000", 2024-04-26T10:22:36.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.753008+0000", 2024-04-26T10:22:36.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.753008+0000", 2024-04-26T10:22:36.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:36.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.753012+0000", 2024-04-26T10:22:36.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4009999999999999e-06 2024-04-26T10:22:36.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.753035+0000", 2024-04-26T10:22:36.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3218999999999999e-05 2024-04-26T10:22:36.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.753042+0000", 2024-04-26T10:22:36.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8519999999999998e-06 2024-04-26T10:22:36.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754083+0000", 2024-04-26T10:22:36.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001040607 2024-04-26T10:22:36.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754257+0000", 2024-04-26T10:22:36.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00017392800000000001 2024-04-26T10:22:36.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:36.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754365+0000", 2024-04-26T10:22:36.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010859 2024-04-26T10:22:36.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:36.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.759003+0000", 2024-04-26T10:22:36.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046382699999999999 2024-04-26T10:22:36.774 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.774 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.774 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.774 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:136700 5.9 5:9fb41c91:::benchmark_data_smithi052_19421_object7228:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:36.775 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:36.754701+0000", 2024-04-26T10:22:36.775 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0042399279999999996, 2024-04-26T10:22:36.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044108029999999996, 2024-04-26T10:22:36.775 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.775 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:36.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:36.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:36.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.775 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136700 2024-04-26T10:22:36.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.775 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754701+0000", 2024-04-26T10:22:36.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754701+0000", 2024-04-26T10:22:36.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754700+0000", 2024-04-26T10:22:36.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:36.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754704+0000", 2024-04-26T10:22:36.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8859999999999997e-06 2024-04-26T10:22:36.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754714+0000", 2024-04-26T10:22:36.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0149999999999999e-05 2024-04-26T10:22:36.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754721+0000", 2024-04-26T10:22:36.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1969999999999999e-06 2024-04-26T10:22:36.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754755+0000", 2024-04-26T10:22:36.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3467000000000003e-05 2024-04-26T10:22:36.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754848+0000", 2024-04-26T10:22:36.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3639000000000003e-05 2024-04-26T10:22:36.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:36.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754912+0000", 2024-04-26T10:22:36.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3788000000000007e-05 2024-04-26T10:22:36.778 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.778 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.779 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.779 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:136701 5.c 5:3c0cd611:::benchmark_data_smithi052_19421_object7229:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:36.779 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:36.754734+0000", 2024-04-26T10:22:36.779 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0042069789999999996, 2024-04-26T10:22:36.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044366889999999997, 2024-04-26T10:22:36.779 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.779 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:36.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:36.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:36.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.779 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136701 2024-04-26T10:22:36.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.780 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754734+0000", 2024-04-26T10:22:36.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754734+0000", 2024-04-26T10:22:36.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754733+0000", 2024-04-26T10:22:36.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754737+0000", 2024-04-26T10:22:36.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5389999999999999e-06 2024-04-26T10:22:36.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754743+0000", 2024-04-26T10:22:36.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6370000000000002e-06 2024-04-26T10:22:36.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754749+0000", 2024-04-26T10:22:36.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4729999999999999e-06 2024-04-26T10:22:36.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754787+0000", 2024-04-26T10:22:36.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8268e-05 2024-04-26T10:22:36.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754903+0000", 2024-04-26T10:22:36.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116308 2024-04-26T10:22:36.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:36.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.759103+0000", 2024-04-26T10:22:36.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042000020000000004 2024-04-26T10:22:36.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:36.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.759127+0000", 2024-04-26T10:22:36.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3822e-05 2024-04-26T10:22:36.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:36.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.759171+0000", 2024-04-26T10:22:36.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3229000000000002e-05 2024-04-26T10:22:36.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.784 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.784 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:136704 5.d 5:b740eec4:::benchmark_data_smithi052_19421_object7232:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:36.784 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:36.754810+0000", 2024-04-26T10:22:36.784 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0041308270000000001, 2024-04-26T10:22:36.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044471199999999997, 2024-04-26T10:22:36.784 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.784 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:36.784 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:36.784 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:36.784 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.785 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136704 2024-04-26T10:22:36.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.785 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754810+0000", 2024-04-26T10:22:36.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754810+0000", 2024-04-26T10:22:36.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754809+0000", 2024-04-26T10:22:36.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:36.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754813+0000", 2024-04-26T10:22:36.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1749999999999998e-06 2024-04-26T10:22:36.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754824+0000", 2024-04-26T10:22:36.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0169999999999999e-05 2024-04-26T10:22:36.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754830+0000", 2024-04-26T10:22:36.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9479999999999996e-06 2024-04-26T10:22:36.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754865+0000", 2024-04-26T10:22:36.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5599000000000003e-05 2024-04-26T10:22:36.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754988+0000", 2024-04-26T10:22:36.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012283699999999999 2024-04-26T10:22:36.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:36.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.755109+0000", 2024-04-26T10:22:36.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012122599999999999 2024-04-26T10:22:36.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.788 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.788 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:136705 5.5 5:a78ea2ba:::benchmark_data_smithi052_19421_object7233:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:36.788 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:36.754843+0000", 2024-04-26T10:22:36.789 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.004098254, 2024-04-26T10:22:36.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044812339999999997, 2024-04-26T10:22:36.789 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.789 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:36.789 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:36.789 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:36.789 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.789 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136705 2024-04-26T10:22:36.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.789 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754843+0000", 2024-04-26T10:22:36.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754843+0000", 2024-04-26T10:22:36.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754842+0000", 2024-04-26T10:22:36.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754845+0000", 2024-04-26T10:22:36.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1e-06 2024-04-26T10:22:36.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754852+0000", 2024-04-26T10:22:36.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4980000000000003e-06 2024-04-26T10:22:36.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.754858+0000", 2024-04-26T10:22:36.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2090000000000002e-06 2024-04-26T10:22:36.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.756042+0000", 2024-04-26T10:22:36.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011840279999999999 2024-04-26T10:22:36.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.756145+0000", 2024-04-26T10:22:36.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102941 2024-04-26T10:22:36.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.792 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.792 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:136702 5.b e49/37 5:dbb43b34:::benchmark_data_smithi052_19421_object7230:head v 49'8532, mlcod=49'8530)", 2024-04-26T10:22:36.793 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:36.755172+0000", 2024-04-26T10:22:36.793 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0037689889999999999, 2024-04-26T10:22:36.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042077429999999999, 2024-04-26T10:22:36.793 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.793 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:36.793 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.755172+0000", 2024-04-26T10:22:36.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.755172+0000", 2024-04-26T10:22:36.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.755171+0000", 2024-04-26T10:22:36.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.755177+0000", 2024-04-26T10:22:36.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8300000000000001e-06 2024-04-26T10:22:36.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.755186+0000", 2024-04-26T10:22:36.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7870000000000007e-06 2024-04-26T10:22:36.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.755193+0000", 2024-04-26T10:22:36.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6420000000000001e-06 2024-04-26T10:22:36.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.755242+0000", 2024-04-26T10:22:36.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9910999999999997e-05 2024-04-26T10:22:36.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.755263+0000", 2024-04-26T10:22:36.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0169e-05 2024-04-26T10:22:36.796 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.796 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.796 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.796 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:136703 5.0 e49/37 5:0ac527dc:::benchmark_data_smithi052_19421_object7231:head v 49'8551, mlcod=49'8549)", 2024-04-26T10:22:36.796 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:36.757244+0000", 2024-04-26T10:22:36.796 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001697212, 2024-04-26T10:22:36.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021858120000000001, 2024-04-26T10:22:36.796 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.796 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:36.797 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.757244+0000", 2024-04-26T10:22:36.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.757244+0000", 2024-04-26T10:22:36.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.757243+0000", 2024-04-26T10:22:36.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:36.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.757248+0000", 2024-04-26T10:22:36.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5539999999999999e-06 2024-04-26T10:22:36.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.757254+0000", 2024-04-26T10:22:36.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1580000000000002e-06 2024-04-26T10:22:36.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.757259+0000", 2024-04-26T10:22:36.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4669999999999998e-06 2024-04-26T10:22:36.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.757293+0000", 2024-04-26T10:22:36.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4620999999999999e-05 2024-04-26T10:22:36.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.757305+0000", 2024-04-26T10:22:36.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1579999999999999e-05 2024-04-26T10:22:36.799 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.799 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.799 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.800 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:136711 5.1 5:86ebcd6d:::benchmark_data_smithi052_19421_object7239:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2024-04-26T10:22:36.800 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:36.757903+0000", 2024-04-26T10:22:36.800 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001037748, 2024-04-26T10:22:36.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0015774230000000001, 2024-04-26T10:22:36.800 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:36.800 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:36.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:36.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:36.800 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:36.800 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 136711 2024-04-26T10:22:36.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.800 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:36.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:36.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.757903+0000", 2024-04-26T10:22:36.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:36.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.757903+0000", 2024-04-26T10:22:36.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:36.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:36.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.757902+0000", 2024-04-26T10:22:36.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:36.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:36.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.757906+0000", 2024-04-26T10:22:36.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1570000000000002e-06 2024-04-26T10:22:36.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:36.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.757915+0000", 2024-04-26T10:22:36.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0289999999999994e-06 2024-04-26T10:22:36.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:36.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.757922+0000", 2024-04-26T10:22:36.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3709999999999996e-06 2024-04-26T10:22:36.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:36.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.757957+0000", 2024-04-26T10:22:36.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5324999999999998e-05 2024-04-26T10:22:36.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:36.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:36.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:36.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:36.758061+0000", 2024-04-26T10:22:36.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104041 2024-04-26T10:22:36.803 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.803 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:36.803 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.803 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:36.803 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:36.804 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 10 2024-04-26T10:22:36.804 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:36.805 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:36.829 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:36.827+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:36.931 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:36.928+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:36.937 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:36.937 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:36.937 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:36.937 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:36.937 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:36.950 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:37.032 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:37.031+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:37.077 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T10:22:37.131 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:37.131 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.599126275000003, 2024-04-26T10:22:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.132 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:37.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:37.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:37.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.594591063000003, 2024-04-26T10:22:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:37.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:37.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.593959771000002, 2024-04-26T10:22:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:37.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:37.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:37.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110555 5.9 5:919989b3:::benchmark_data_smithi052_19421_object110554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:37.149 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.095162566000001, 2024-04-26T10:22:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129736717, 2024-04-26T10:22:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110555 2024-04-26T10:22:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033309+0000", 2024-04-26T10:22:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033393+0000", 2024-04-26T10:22:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3690999999999995e-05 2024-04-26T10:22:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033401+0000", 2024-04-26T10:22:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4319999999999999e-06 2024-04-26T10:22:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033406+0000", 2024-04-26T10:22:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2340000000000002e-06 2024-04-26T10:22:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033467+0000", 2024-04-26T10:22:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0915999999999997e-05 2024-04-26T10:22:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033550+0000", 2024-04-26T10:22:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3057000000000001e-05 2024-04-26T10:22:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033676+0000", 2024-04-26T10:22:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126162 2024-04-26T10:22:37.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037902+0000", 2024-04-26T10:22:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042255720000000004 2024-04-26T10:22:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162728+0000", 2024-04-26T10:22:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12482583799999999 2024-04-26T10:22:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162839+0000", 2024-04-26T10:22:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111222 2024-04-26T10:22:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163047+0000", 2024-04-26T10:22:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207686 2024-04-26T10:22:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110556 5.1 5:822c74bd:::benchmark_data_smithi052_19421_object110555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.095053459000001, 2024-04-26T10:22:37.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129274783, 2024-04-26T10:22:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110556 2024-04-26T10:22:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033418+0000", 2024-04-26T10:22:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033472+0000", 2024-04-26T10:22:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3780999999999999e-05 2024-04-26T10:22:37.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033478+0000", 2024-04-26T10:22:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6049999999999997e-06 2024-04-26T10:22:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033482+0000", 2024-04-26T10:22:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9110000000000001e-06 2024-04-26T10:22:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033509+0000", 2024-04-26T10:22:37.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6415e-05 2024-04-26T10:22:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033650+0000", 2024-04-26T10:22:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014088999999999999 2024-04-26T10:22:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161877+0000", 2024-04-26T10:22:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128227707 2024-04-26T10:22:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162541+0000", 2024-04-26T10:22:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000663863 2024-04-26T10:22:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162694+0000", 2024-04-26T10:22:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015245699999999999 2024-04-26T10:22:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110558 5.3 5:c73f56b6:::benchmark_data_smithi052_19421_object110557:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:37.160 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.094856824000001, 2024-04-26T10:22:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12864012999999999, 2024-04-26T10:22:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110558 2024-04-26T10:22:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033615+0000", 2024-04-26T10:22:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033717+0000", 2024-04-26T10:22:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102298 2024-04-26T10:22:37.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033725+0000", 2024-04-26T10:22:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0090000000000007e-06 2024-04-26T10:22:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033731+0000", 2024-04-26T10:22:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8919999999999997e-06 2024-04-26T10:22:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033769+0000", 2024-04-26T10:22:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7682999999999998e-05 2024-04-26T10:22:37.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033891+0000", 2024-04-26T10:22:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121718 2024-04-26T10:22:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161912+0000", 2024-04-26T10:22:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128021512 2024-04-26T10:22:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162043+0000", 2024-04-26T10:22:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130588 2024-04-26T10:22:37.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162256+0000", 2024-04-26T10:22:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021311499999999999 2024-04-26T10:22:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110557 5.b e45/37 5:d659544e:::benchmark_data_smithi052_19421_object110556:head v 45'6862, mlcod=45'6860)", 2024-04-26T10:22:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.093952591000001, 2024-04-26T10:22:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12783012499999999, 2024-04-26T10:22:37.165 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034519+0000", 2024-04-26T10:22:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034526+0000", 2024-04-26T10:22:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0380000000000002e-06 2024-04-26T10:22:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034539+0000", 2024-04-26T10:22:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.27e-05 2024-04-26T10:22:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034545+0000", 2024-04-26T10:22:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3369999999999996e-06 2024-04-26T10:22:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034606+0000", 2024-04-26T10:22:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0752999999999999e-05 2024-04-26T10:22:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034627+0000", 2024-04-26T10:22:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.088e-05 2024-04-26T10:22:37.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162272+0000", 2024-04-26T10:22:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12764540199999999 2024-04-26T10:22:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162350+0000", 2024-04-26T10:22:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7835000000000003e-05 2024-04-26T10:22:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110554 5.0 e45/37 5:04324c12:::benchmark_data_smithi052_19421_object110553:head v 45'6903, mlcod=45'6898)", 2024-04-26T10:22:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.092193169, 2024-04-26T10:22:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12566923499999999, 2024-04-26T10:22:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036278+0000", 2024-04-26T10:22:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036313+0000", 2024-04-26T10:22:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5247999999999999e-05 2024-04-26T10:22:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036324+0000", 2024-04-26T10:22:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0496000000000001e-05 2024-04-26T10:22:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036329+0000", 2024-04-26T10:22:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3070000000000002e-06 2024-04-26T10:22:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036364+0000", 2024-04-26T10:22:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4391000000000003e-05 2024-04-26T10:22:37.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036377+0000", 2024-04-26T10:22:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3706999999999999e-05 2024-04-26T10:22:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042032+0000", 2024-04-26T10:22:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056547120000000001 2024-04-26T10:22:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161949+0000", 2024-04-26T10:22:37.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119916482 2024-04-26T10:22:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110559 5.2 5:44c3f174:::benchmark_data_smithi052_19421_object110558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.090574559, 2024-04-26T10:22:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12530391299999999, 2024-04-26T10:22:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:37.174 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110559 2024-04-26T10:22:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037897+0000", 2024-04-26T10:22:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037922+0000", 2024-04-26T10:22:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5004e-05 2024-04-26T10:22:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037931+0000", 2024-04-26T10:22:37.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-04-26T10:22:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037937+0000", 2024-04-26T10:22:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6749999999999999e-06 2024-04-26T10:22:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037972+0000", 2024-04-26T10:22:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4678000000000002e-05 2024-04-26T10:22:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038108+0000", 2024-04-26T10:22:37.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013689099999999999 2024-04-26T10:22:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162887+0000", 2024-04-26T10:22:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124778258 2024-04-26T10:22:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163010+0000", 2024-04-26T10:22:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122924 2024-04-26T10:22:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163202+0000", 2024-04-26T10:22:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192203 2024-04-26T10:22:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110560 5.3 5:caf5a141:::benchmark_data_smithi052_19421_object110559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.090523958, 2024-04-26T10:22:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12888738299999999, 2024-04-26T10:22:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.179 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110560 2024-04-26T10:22:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037948+0000", 2024-04-26T10:22:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037973+0000", 2024-04-26T10:22:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5187000000000001e-05 2024-04-26T10:22:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037978+0000", 2024-04-26T10:22:37.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4120000000000003e-06 2024-04-26T10:22:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037981+0000", 2024-04-26T10:22:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6689999999999999e-06 2024-04-26T10:22:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038041+0000", 2024-04-26T10:22:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9324999999999999e-05 2024-04-26T10:22:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038179+0000", 2024-04-26T10:22:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013832499999999999 2024-04-26T10:22:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166427+0000", 2024-04-26T10:22:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128248165 2024-04-26T10:22:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166539+0000", 2024-04-26T10:22:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111538 2024-04-26T10:22:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166836+0000", 2024-04-26T10:22:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029714100000000001 2024-04-26T10:22:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110561 5.d 5:b143edec:::benchmark_data_smithi052_19421_object110560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.0904819, 2024-04-26T10:22:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.125215574, 2024-04-26T10:22:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:37.184 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110561 2024-04-26T10:22:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037990+0000", 2024-04-26T10:22:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038028+0000", 2024-04-26T10:22:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7802999999999997e-05 2024-04-26T10:22:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038035+0000", 2024-04-26T10:22:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-06 2024-04-26T10:22:37.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038040+0000", 2024-04-26T10:22:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.147e-06 2024-04-26T10:22:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038077+0000", 2024-04-26T10:22:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7166999999999998e-05 2024-04-26T10:22:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038192+0000", 2024-04-26T10:22:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115565 2024-04-26T10:22:37.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038319+0000", 2024-04-26T10:22:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012697699999999999 2024-04-26T10:22:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162690+0000", 2024-04-26T10:22:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12437065 2024-04-26T10:22:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162878+0000", 2024-04-26T10:22:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000188173 2024-04-26T10:22:37.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162992+0000", 2024-04-26T10:22:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114008 2024-04-26T10:22:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163206+0000", 2024-04-26T10:22:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021394900000000001 2024-04-26T10:22:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.090421296000001, 2024-04-26T10:22:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:22:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:22:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:22:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:22:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:22:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:22:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:22:37.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:22:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:22:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:22:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:22:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:22:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:22:37.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:22:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:22:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:22:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:22:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:22:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.194 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110564 5.3 5:c09e33cb:::benchmark_data_smithi052_19421_object110563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.090368637999999, 2024-04-26T10:22:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128984614, 2024-04-26T10:22:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110564 2024-04-26T10:22:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.195 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038103+0000", 2024-04-26T10:22:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:37.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038136+0000", 2024-04-26T10:22:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.243e-05 2024-04-26T10:22:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038143+0000", 2024-04-26T10:22:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0870000000000001e-06 2024-04-26T10:22:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038151+0000", 2024-04-26T10:22:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:22:37.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039813+0000", 2024-04-26T10:22:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001661844 2024-04-26T10:22:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039970+0000", 2024-04-26T10:22:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015712699999999999 2024-04-26T10:22:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166854+0000", 2024-04-26T10:22:37.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.126883788 2024-04-26T10:22:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166976+0000", 2024-04-26T10:22:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012231399999999999 2024-04-26T10:22:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167088+0000", 2024-04-26T10:22:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011243699999999999 2024-04-26T10:22:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.090312044999999, 2024-04-26T10:22:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:22:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:22:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.200 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:37.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:22:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:22:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:22:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:22:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:22:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:22:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:22:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:22:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:22:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:22:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:22:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:22:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:22:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:22:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:22:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:22:37.204 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110566 5.c 5:34145698:::benchmark_data_smithi052_19421_object110565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.090262268, 2024-04-26T10:22:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12673530699999999, 2024-04-26T10:22:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.205 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110566 2024-04-26T10:22:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038246+0000", 2024-04-26T10:22:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5759000000000001e-05 2024-04-26T10:22:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038252+0000", 2024-04-26T10:22:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5300000000000002e-06 2024-04-26T10:22:37.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038257+0000", 2024-04-26T10:22:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038312+0000", 2024-04-26T10:22:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5108000000000002e-05 2024-04-26T10:22:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038480+0000", 2024-04-26T10:22:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016751099999999999 2024-04-26T10:22:37.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164651+0000", 2024-04-26T10:22:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12617115600000001 2024-04-26T10:22:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164770+0000", 2024-04-26T10:22:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118748 2024-04-26T10:22:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164946+0000", 2024-04-26T10:22:37.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175966 2024-04-26T10:22:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.087914633, 2024-04-26T10:22:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:22:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:37.210 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:22:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.211 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:22:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:22:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:22:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:22:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:22:37.212 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:22:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:22:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:22:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:22:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:22:37.213 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:22:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:22:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:22:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:22:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:22:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.214 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:22:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:22:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:22:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:22:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:22:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:22:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.215 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110568 5.c 5:34af8ad3:::benchmark_data_smithi052_19421_object110567:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.087797008000001, 2024-04-26T10:22:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124943661, 2024-04-26T10:22:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110568 2024-04-26T10:22:37.216 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.217 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040711+0000", 2024-04-26T10:22:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6531e-05 2024-04-26T10:22:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040719+0000", 2024-04-26T10:22:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6120000000000001e-06 2024-04-26T10:22:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040724+0000", 2024-04-26T10:22:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2100000000000001e-06 2024-04-26T10:22:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040771+0000", 2024-04-26T10:22:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7123000000000003e-05 2024-04-26T10:22:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040984+0000", 2024-04-26T10:22:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021227400000000001 2024-04-26T10:22:37.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165350+0000", 2024-04-26T10:22:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124366738 2024-04-26T10:22:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165459+0000", 2024-04-26T10:22:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108168 2024-04-26T10:22:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165619+0000", 2024-04-26T10:22:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160564 2024-04-26T10:22:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.087728709, 2024-04-26T10:22:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:22:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:37.221 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:22:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:22:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:22:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:22:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:22:37.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:22:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:22:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:22:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:22:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:22:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:22:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:22:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:22:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:22:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:22:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:22:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:22:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:22:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:22:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:22:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:22:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:22:37.226 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110570 5.1 5:876a468c:::benchmark_data_smithi052_19421_object110569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.086426164000001, 2024-04-26T10:22:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12851437099999999, 2024-04-26T10:22:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:37.227 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110570 2024-04-26T10:22:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042045+0000", 2024-04-26T10:22:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042083+0000", 2024-04-26T10:22:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8064e-05 2024-04-26T10:22:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161855+0000", 2024-04-26T10:22:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119771934 2024-04-26T10:22:37.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161882+0000", 2024-04-26T10:22:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7083000000000001e-05 2024-04-26T10:22:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163117+0000", 2024-04-26T10:22:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001234509 2024-04-26T10:22:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163507+0000", 2024-04-26T10:22:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038998400000000001 2024-04-26T10:22:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170347+0000", 2024-04-26T10:22:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006840952 2024-04-26T10:22:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170488+0000", 2024-04-26T10:22:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140393 2024-04-26T10:22:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170561+0000", 2024-04-26T10:22:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2809e-05 2024-04-26T10:22:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:124481 5.d 5:b507cdbb:::benchmark_data_smithi052_19421_object124480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.0480612420000002, 2024-04-26T10:22:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.087933879000000006, 2024-04-26T10:22:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:37.232 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124481 2024-04-26T10:22:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:37.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080410+0000", 2024-04-26T10:22:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080523+0000", 2024-04-26T10:22:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112501 2024-04-26T10:22:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080528+0000", 2024-04-26T10:22:37.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1789999999999999e-06 2024-04-26T10:22:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080532+0000", 2024-04-26T10:22:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.805e-06 2024-04-26T10:22:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080562+0000", 2024-04-26T10:22:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0241000000000001e-05 2024-04-26T10:22:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080645+0000", 2024-04-26T10:22:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2816000000000001e-05 2024-04-26T10:22:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080786+0000", 2024-04-26T10:22:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014129400000000001 2024-04-26T10:22:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.084288+0000", 2024-04-26T10:22:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035017920000000001 2024-04-26T10:22:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.167975+0000", 2024-04-26T10:22:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.083686673000000003 2024-04-26T10:22:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.168092+0000", 2024-04-26T10:22:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117607 2024-04-26T10:22:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.168345+0000", 2024-04-26T10:22:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025299200000000001 2024-04-26T10:22:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.237 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.238 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:37.238 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:37.238 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:37.239 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:37.240 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:37.236+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:37.339 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:37.336+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:37.362 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:37.363 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:37.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.363 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:138054 5.e 5:7f699314:::benchmark_data_smithi052_19421_object8582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T10:22:37.363 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:37.350384+0000", 2024-04-26T10:22:37.363 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.010988919999999999, 2024-04-26T10:22:37.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011020307999999999, 2024-04-26T10:22:37.363 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:37.363 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:37.363 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:37.363 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:37.363 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.363 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138054 2024-04-26T10:22:37.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.364 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:37.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:37.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350384+0000", 2024-04-26T10:22:37.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:37.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350384+0000", 2024-04-26T10:22:37.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:37.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350384+0000", 2024-04-26T10:22:37.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:37.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:37.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350386+0000", 2024-04-26T10:22:37.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8540000000000001e-06 2024-04-26T10:22:37.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:37.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350392+0000", 2024-04-26T10:22:37.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9220000000000002e-06 2024-04-26T10:22:37.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350400+0000", 2024-04-26T10:22:37.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9559999999999997e-06 2024-04-26T10:22:37.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:37.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.352562+0000", 2024-04-26T10:22:37.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021615290000000001 2024-04-26T10:22:37.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:37.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.352661+0000", 2024-04-26T10:22:37.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9492000000000002e-05 2024-04-26T10:22:37.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:37.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361400+0000", 2024-04-26T10:22:37.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087382180000000007 2024-04-26T10:22:37.367 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.367 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:37.367 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.367 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:138056 5.e 5:7dca6da4:::benchmark_data_smithi052_19421_object8584:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T10:22:37.367 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:37.350475+0000", 2024-04-26T10:22:37.367 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.01089769, 2024-04-26T10:22:37.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011040502000000001, 2024-04-26T10:22:37.368 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:37.368 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:37.368 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:37.368 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:37.368 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.368 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138056 2024-04-26T10:22:37.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.368 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:37.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:37.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350475+0000", 2024-04-26T10:22:37.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:37.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350475+0000", 2024-04-26T10:22:37.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:37.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350474+0000", 2024-04-26T10:22:37.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:37.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:37.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350484+0000", 2024-04-26T10:22:37.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:37.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:37.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350494+0000", 2024-04-26T10:22:37.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8830000000000001e-06 2024-04-26T10:22:37.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350502+0000", 2024-04-26T10:22:37.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5830000000000001e-06 2024-04-26T10:22:37.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:37.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.354032+0000", 2024-04-26T10:22:37.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003530624 2024-04-26T10:22:37.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:37.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.354117+0000", 2024-04-26T10:22:37.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4456999999999995e-05 2024-04-26T10:22:37.371 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.371 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:37.371 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.372 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:138058 5.e 5:71c81010:::benchmark_data_smithi052_19421_object8586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T10:22:37.372 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:37.350680+0000", 2024-04-26T10:22:37.372 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.010692518, 2024-04-26T10:22:37.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010939512, 2024-04-26T10:22:37.372 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:37.372 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:37.372 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:37.372 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:37.372 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.372 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138058 2024-04-26T10:22:37.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.372 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:37.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:37.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350680+0000", 2024-04-26T10:22:37.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:37.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350680+0000", 2024-04-26T10:22:37.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:37.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350680+0000", 2024-04-26T10:22:37.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:37.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:37.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350685+0000", 2024-04-26T10:22:37.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5999999999999997e-06 2024-04-26T10:22:37.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:37.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350693+0000", 2024-04-26T10:22:37.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3040000000000005e-06 2024-04-26T10:22:37.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350700+0000", 2024-04-26T10:22:37.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6329999999999999e-06 2024-04-26T10:22:37.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:37.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.355295+0000", 2024-04-26T10:22:37.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045947230000000002 2024-04-26T10:22:37.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:37.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.355401+0000", 2024-04-26T10:22:37.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010597199999999999 2024-04-26T10:22:37.375 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.375 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:37.375 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.376 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:138059 5.8 5:1b0c8390:::benchmark_data_smithi052_19421_object8587:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T10:22:37.376 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:37.350717+0000", 2024-04-26T10:22:37.376 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.010655991, 2024-04-26T10:22:37.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010996854, 2024-04-26T10:22:37.376 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:37.376 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:37.376 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:37.376 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:37.376 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.376 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138059 2024-04-26T10:22:37.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.376 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:37.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:37.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350717+0000", 2024-04-26T10:22:37.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:37.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350717+0000", 2024-04-26T10:22:37.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:37.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350716+0000", 2024-04-26T10:22:37.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:37.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:37.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350723+0000", 2024-04-26T10:22:37.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9580000000000001e-06 2024-04-26T10:22:37.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:37.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350731+0000", 2024-04-26T10:22:37.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.554e-06 2024-04-26T10:22:37.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350737+0000", 2024-04-26T10:22:37.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7819999999999999e-06 2024-04-26T10:22:37.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:37.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350783+0000", 2024-04-26T10:22:37.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6301000000000003e-05 2024-04-26T10:22:37.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:37.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350937+0000", 2024-04-26T10:22:37.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000154062 2024-04-26T10:22:37.379 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.379 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:37.379 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.380 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:138060 5.8 5:1df75fbc:::benchmark_data_smithi052_19421_object8588:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T10:22:37.380 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:37.350893+0000", 2024-04-26T10:22:37.380 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.010480405, 2024-04-26T10:22:37.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010917049, 2024-04-26T10:22:37.380 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:37.380 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:37.380 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:37.380 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:37.380 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.380 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138060 2024-04-26T10:22:37.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.380 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:37.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:37.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350893+0000", 2024-04-26T10:22:37.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:37.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350893+0000", 2024-04-26T10:22:37.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:37.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350892+0000", 2024-04-26T10:22:37.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:37.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:37.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350896+0000", 2024-04-26T10:22:37.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0960000000000003e-06 2024-04-26T10:22:37.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:37.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350911+0000", 2024-04-26T10:22:37.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5356999999999999e-05 2024-04-26T10:22:37.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.350927+0000", 2024-04-26T10:22:37.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5529e-05 2024-04-26T10:22:37.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:37.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.353348+0000", 2024-04-26T10:22:37.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024213300000000002 2024-04-26T10:22:37.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:37.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.353444+0000", 2024-04-26T10:22:37.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5756999999999998e-05 2024-04-26T10:22:37.383 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.384 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:37.384 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.384 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:138063 5.a 5:587aa898:::benchmark_data_smithi052_19421_object8591:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T10:22:37.384 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:37.354353+0000", 2024-04-26T10:22:37.384 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.007020292, 2024-04-26T10:22:37.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0075540650000000004, 2024-04-26T10:22:37.384 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:37.384 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:37.384 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:37.384 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:37.384 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.385 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138063 2024-04-26T10:22:37.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.385 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:37.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:37.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.354353+0000", 2024-04-26T10:22:37.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:37.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.354353+0000", 2024-04-26T10:22:37.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:37.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.354351+0000", 2024-04-26T10:22:37.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:37.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:37.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.354358+0000", 2024-04-26T10:22:37.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3929999999999996e-06 2024-04-26T10:22:37.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:37.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.354369+0000", 2024-04-26T10:22:37.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1494e-05 2024-04-26T10:22:37.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.354377+0000", 2024-04-26T10:22:37.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.52e-06 2024-04-26T10:22:37.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:37.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.354419+0000", 2024-04-26T10:22:37.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2434000000000001e-05 2024-04-26T10:22:37.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:37.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.354572+0000", 2024-04-26T10:22:37.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015276299999999999 2024-04-26T10:22:37.388 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.388 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:37.388 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.388 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:138061 5.9 e50/37 5:99d72fbc:::benchmark_data_smithi052_19421_object8589:head v 50'8694, mlcod=50'8692)", 2024-04-26T10:22:37.388 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:37.356532+0000", 2024-04-26T10:22:37.388 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0048409159999999998, 2024-04-26T10:22:37.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054502589999999998, 2024-04-26T10:22:37.388 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:37.388 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:37.388 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.356532+0000", 2024-04-26T10:22:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.356532+0000", 2024-04-26T10:22:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.356531+0000", 2024-04-26T10:22:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.356549+0000", 2024-04-26T10:22:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7541e-05 2024-04-26T10:22:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.356558+0000", 2024-04-26T10:22:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5969999999999998e-06 2024-04-26T10:22:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.356565+0000", 2024-04-26T10:22:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0099999999999998e-06 2024-04-26T10:22:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.356608+0000", 2024-04-26T10:22:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2274999999999998e-05 2024-04-26T10:22:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.356628+0000", 2024-04-26T10:22:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0471000000000001e-05 2024-04-26T10:22:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:138067 5.d e50/37 5:b21d0b9e:::benchmark_data_smithi052_19421_object8595:head v 50'8695, mlcod=50'8693)", 2024-04-26T10:22:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:37.356579+0000", 2024-04-26T10:22:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0047938219999999997, 2024-04-26T10:22:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054731069999999996, 2024-04-26T10:22:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.356579+0000", 2024-04-26T10:22:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.356579+0000", 2024-04-26T10:22:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.356579+0000", 2024-04-26T10:22:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.356583+0000", 2024-04-26T10:22:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4240000000000003e-06 2024-04-26T10:22:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.356589+0000", 2024-04-26T10:22:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2890000000000003e-06 2024-04-26T10:22:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.356594+0000", 2024-04-26T10:22:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8500000000000002e-06 2024-04-26T10:22:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.356657+0000", 2024-04-26T10:22:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2312999999999998e-05 2024-04-26T10:22:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.356697+0000", 2024-04-26T10:22:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0632e-05 2024-04-26T10:22:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:138072 5.0 5:0d76215c:::benchmark_data_smithi052_19421_object8600:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T10:22:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:37.357023+0000", 2024-04-26T10:22:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0043499419999999999, 2024-04-26T10:22:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051006369999999999, 2024-04-26T10:22:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138072 2024-04-26T10:22:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.357023+0000", 2024-04-26T10:22:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.357023+0000", 2024-04-26T10:22:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.357022+0000", 2024-04-26T10:22:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.357028+0000", 2024-04-26T10:22:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3400000000000003e-06 2024-04-26T10:22:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.357043+0000", 2024-04-26T10:22:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5265999999999999e-05 2024-04-26T10:22:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.357051+0000", 2024-04-26T10:22:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9580000000000007e-06 2024-04-26T10:22:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.357102+0000", 2024-04-26T10:22:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0322999999999999e-05 2024-04-26T10:22:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.357267+0000", 2024-04-26T10:22:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016574299999999999 2024-04-26T10:22:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.357443+0000", 2024-04-26T10:22:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017565500000000001 2024-04-26T10:22:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361855+0000", 2024-04-26T10:22:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044116119999999997 2024-04-26T10:22:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:138074 5.8 5:1f21ae77:::benchmark_data_smithi052_19421_object8602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T10:22:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:37.359297+0000", 2024-04-26T10:22:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0020757219999999999, 2024-04-26T10:22:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029180410000000001, 2024-04-26T10:22:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138074 2024-04-26T10:22:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.359297+0000", 2024-04-26T10:22:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.359297+0000", 2024-04-26T10:22:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.359296+0000", 2024-04-26T10:22:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.359302+0000", 2024-04-26T10:22:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.071e-06 2024-04-26T10:22:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.359318+0000", 2024-04-26T10:22:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5846999999999999e-05 2024-04-26T10:22:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.359327+0000", 2024-04-26T10:22:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5229999999999995e-06 2024-04-26T10:22:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.359398+0000", 2024-04-26T10:22:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1085000000000001e-05 2024-04-26T10:22:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.359520+0000", 2024-04-26T10:22:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000121953 2024-04-26T10:22:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:138075 5.8 5:132d6277:::benchmark_data_smithi052_19421_object8603:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T10:22:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:37.360621+0000", 2024-04-26T10:22:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00075239899999999995, 2024-04-26T10:22:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016704790000000001, 2024-04-26T10:22:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138075 2024-04-26T10:22:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.360621+0000", 2024-04-26T10:22:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.360621+0000", 2024-04-26T10:22:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.360620+0000", 2024-04-26T10:22:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.360624+0000", 2024-04-26T10:22:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9200000000000003e-06 2024-04-26T10:22:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.360638+0000", 2024-04-26T10:22:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3463e-05 2024-04-26T10:22:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.360646+0000", 2024-04-26T10:22:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9279999999999993e-06 2024-04-26T10:22:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361834+0000", 2024-04-26T10:22:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001187914 2024-04-26T10:22:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.362024+0000", 2024-04-26T10:22:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018995700000000001 2024-04-26T10:22:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:138079 5.0 5:0bd54f27:::benchmark_data_smithi052_19421_object8607:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T10:22:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:37.361787+0000", 2024-04-26T10:22:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9995861, 2024-04-26T10:22:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00057754900000000001, 2024-04-26T10:22:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138079 2024-04-26T10:22:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361787+0000", 2024-04-26T10:22:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361787+0000", 2024-04-26T10:22:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361786+0000", 2024-04-26T10:22:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361792+0000", 2024-04-26T10:22:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6590000000000004e-06 2024-04-26T10:22:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361801+0000", 2024-04-26T10:22:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5149999999999995e-06 2024-04-26T10:22:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361808+0000", 2024-04-26T10:22:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361887+0000", 2024-04-26T10:22:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8788000000000005e-05 2024-04-26T10:22:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.362005+0000", 2024-04-26T10:22:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118634 2024-04-26T10:22:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.362083+0000", 2024-04-26T10:22:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7150000000000005e-05 2024-04-26T10:22:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:138080 5.b 5:db612196:::benchmark_data_smithi052_19421_object8608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T10:22:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:37.361814+0000", 2024-04-26T10:22:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9995589, 2024-04-26T10:22:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000629282, 2024-04-26T10:22:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138080 2024-04-26T10:22:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361814+0000", 2024-04-26T10:22:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361814+0000", 2024-04-26T10:22:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361814+0000", 2024-04-26T10:22:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361816+0000", 2024-04-26T10:22:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3379999999999999e-06 2024-04-26T10:22:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361820+0000", 2024-04-26T10:22:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1559999999999997e-06 2024-04-26T10:22:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361825+0000", 2024-04-26T10:22:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5689999999999998e-06 2024-04-26T10:22:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361875+0000", 2024-04-26T10:22:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0587000000000002e-05 2024-04-26T10:22:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.362050+0000", 2024-04-26T10:22:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017457700000000001 2024-04-26T10:22:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.362175+0000", 2024-04-26T10:22:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012536200000000001 2024-04-26T10:22:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:138082 5.4 5:2dcb6fbd:::benchmark_data_smithi052_19421_object8610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-26T10:22:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:37.361928+0000", 2024-04-26T10:22:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.999445, 2024-04-26T10:22:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00059417599999999997, 2024-04-26T10:22:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 138082 2024-04-26T10:22:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361928+0000", 2024-04-26T10:22:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361928+0000", 2024-04-26T10:22:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361927+0000", 2024-04-26T10:22:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361931+0000", 2024-04-26T10:22:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4510000000000002e-06 2024-04-26T10:22:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361942+0000", 2024-04-26T10:22:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0108e-05 2024-04-26T10:22:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361946+0000", 2024-04-26T10:22:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0659999999999997e-06 2024-04-26T10:22:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.361997+0000", 2024-04-26T10:22:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1613999999999997e-05 2024-04-26T10:22:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.362093+0000", 2024-04-26T10:22:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5719999999999998e-05 2024-04-26T10:22:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:37.362188+0000", 2024-04-26T10:22:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4813000000000002e-05 2024-04-26T10:22:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 14 2024-04-26T10:22:37.421 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:37.422 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:22:37.423 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:37.440 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:37.436+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:37.541 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:37.536+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:37.553 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:37.553 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:37.553 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:37.553 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:37.553 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:37.567 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:37.575 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:37.600 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:37.601 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:37.605 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:37.606 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:37.642 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:37.636+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:37.689 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:37.689 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:37.702 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:37.746 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:37.744+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:37.834 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:37.834 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:37.844 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:37.840+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:37.846 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:37.945 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:37.940+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:37.976 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:37.976 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:37.988 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:38.046 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:38.043+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:38.115 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:38.115 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:38.128 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:38.146 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:38.144+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:38.247 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:38.247+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:38.253 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:38.253 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:38.265 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:38.349 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:38.347+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:38.387 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:38.387 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:38.399 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:38.449 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:38.447+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:38.550 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:38.544+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:38.572 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:38.573 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:38.584 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:38.651 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:38.648+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:38.707 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:38.707 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:38.719 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:38.752 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:38.751+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:38.848 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:38.848 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:38.852 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:38.848+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:38.860 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:38.954 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:38.948+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:38.987 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:38.988 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:39.001 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:39.055 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:39.052+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:39.090 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:22:39.129 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:39.129 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:39.141 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:39.156 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:39.155+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:39.257 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:39.255+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:39.263 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:39.263 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:39.275 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:39.359 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:39.356+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:39.449 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:39.449 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:39.459 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:39.459+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:39.462 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:39.561 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:39.559+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:39.600 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:39.600 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:39.606 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:22:39.614 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:39.662 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:39.659+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:39.743 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:39.743 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:39.754 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:39.755 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:39.762 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:39.760+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:39.784 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:39.784 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:39.784 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:39.784 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:39.788 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:39.789 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:39.863 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:39.863+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:39.886 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:39.886 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:39.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:39.887 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:39.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.887 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:39.887 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:39.887 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.353948858999999, 2024-04-26T10:22:39.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:39.887 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.887 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:39.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:39.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:39.887 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:39.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.887 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:39.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:39.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:39.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:39.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:39.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:39.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:39.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:39.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:39.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:39.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:39.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:39.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:39.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:39.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:39.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:39.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:39.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:39.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:39.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:39.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:39.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:39.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:39.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:39.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:39.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:39.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:39.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.892 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.892 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:39.892 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:39.892 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.349413646999999, 2024-04-26T10:22:39.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:39.893 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.893 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:39.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:39.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:39.893 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:39.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.893 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:39.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:39.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:39.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:39.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:39.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:39.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:39.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:39.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:39.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:39.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:39.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:39.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:39.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:39.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:39.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:39.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:39.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:39.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:39.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:39.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:39.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:39.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:39.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:39.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:39.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:39.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:39.898 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.898 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.898 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.898 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:39.898 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:39.898 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.348782354999997, 2024-04-26T10:22:39.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:39.898 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.898 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:39.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:39.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:39.899 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:39.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.899 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:39.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:39.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:39.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:39.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:39.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:39.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:39.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:39.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:39.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:39.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:39.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:39.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:39.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:39.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:39.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:39.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:39.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:39.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:39.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:39.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:39.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:39.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:39.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:39.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:39.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:39.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:39.903 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.903 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.903 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.904 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110555 5.9 5:919989b3:::benchmark_data_smithi052_19421_object110554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:39.904 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:39.904 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.84998515, 2024-04-26T10:22:39.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129736717, 2024-04-26T10:22:39.904 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.904 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:39.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:39.904 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:39.904 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110555 2024-04-26T10:22:39.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.904 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:39.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:39.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033309+0000", 2024-04-26T10:22:39.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:39.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033393+0000", 2024-04-26T10:22:39.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3690999999999995e-05 2024-04-26T10:22:39.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033401+0000", 2024-04-26T10:22:39.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4319999999999999e-06 2024-04-26T10:22:39.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033406+0000", 2024-04-26T10:22:39.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2340000000000002e-06 2024-04-26T10:22:39.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033467+0000", 2024-04-26T10:22:39.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0915999999999997e-05 2024-04-26T10:22:39.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033550+0000", 2024-04-26T10:22:39.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3057000000000001e-05 2024-04-26T10:22:39.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:39.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033676+0000", 2024-04-26T10:22:39.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126162 2024-04-26T10:22:39.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:39.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037902+0000", 2024-04-26T10:22:39.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042255720000000004 2024-04-26T10:22:39.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:39.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162728+0000", 2024-04-26T10:22:39.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12482583799999999 2024-04-26T10:22:39.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162839+0000", 2024-04-26T10:22:39.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111222 2024-04-26T10:22:39.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163047+0000", 2024-04-26T10:22:39.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207686 2024-04-26T10:22:39.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.909 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.909 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110556 5.1 5:822c74bd:::benchmark_data_smithi052_19421_object110555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:39.909 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:39.909 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.849876043, 2024-04-26T10:22:39.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129274783, 2024-04-26T10:22:39.910 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.910 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:39.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:39.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:39.910 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110556 2024-04-26T10:22:39.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.910 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:39.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:39.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033418+0000", 2024-04-26T10:22:39.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:39.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033472+0000", 2024-04-26T10:22:39.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3780999999999999e-05 2024-04-26T10:22:39.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033478+0000", 2024-04-26T10:22:39.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6049999999999997e-06 2024-04-26T10:22:39.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033482+0000", 2024-04-26T10:22:39.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9110000000000001e-06 2024-04-26T10:22:39.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033509+0000", 2024-04-26T10:22:39.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6415e-05 2024-04-26T10:22:39.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033650+0000", 2024-04-26T10:22:39.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014088999999999999 2024-04-26T10:22:39.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:39.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161877+0000", 2024-04-26T10:22:39.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128227707 2024-04-26T10:22:39.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162541+0000", 2024-04-26T10:22:39.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000663863 2024-04-26T10:22:39.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162694+0000", 2024-04-26T10:22:39.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015245699999999999 2024-04-26T10:22:39.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.914 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.914 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110558 5.3 5:c73f56b6:::benchmark_data_smithi052_19421_object110557:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:39.914 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:39.914 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.849679408, 2024-04-26T10:22:39.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12864012999999999, 2024-04-26T10:22:39.915 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.915 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:39.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:39.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:39.915 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110558 2024-04-26T10:22:39.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.915 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:39.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:39.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033615+0000", 2024-04-26T10:22:39.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:39.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033717+0000", 2024-04-26T10:22:39.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102298 2024-04-26T10:22:39.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033725+0000", 2024-04-26T10:22:39.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0090000000000007e-06 2024-04-26T10:22:39.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033731+0000", 2024-04-26T10:22:39.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8919999999999997e-06 2024-04-26T10:22:39.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033769+0000", 2024-04-26T10:22:39.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7682999999999998e-05 2024-04-26T10:22:39.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033891+0000", 2024-04-26T10:22:39.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121718 2024-04-26T10:22:39.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:39.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161912+0000", 2024-04-26T10:22:39.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128021512 2024-04-26T10:22:39.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162043+0000", 2024-04-26T10:22:39.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130588 2024-04-26T10:22:39.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162256+0000", 2024-04-26T10:22:39.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021311499999999999 2024-04-26T10:22:39.919 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.919 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.919 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.919 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110557 5.b e45/37 5:d659544e:::benchmark_data_smithi052_19421_object110556:head v 45'6862, mlcod=45'6860)", 2024-04-26T10:22:39.919 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:39.919 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.848775175, 2024-04-26T10:22:39.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12783012499999999, 2024-04-26T10:22:39.920 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.920 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.920 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:39.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:39.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034519+0000", 2024-04-26T10:22:39.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:39.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034526+0000", 2024-04-26T10:22:39.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0380000000000002e-06 2024-04-26T10:22:39.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034539+0000", 2024-04-26T10:22:39.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.27e-05 2024-04-26T10:22:39.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034545+0000", 2024-04-26T10:22:39.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3369999999999996e-06 2024-04-26T10:22:39.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034606+0000", 2024-04-26T10:22:39.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0752999999999999e-05 2024-04-26T10:22:39.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034627+0000", 2024-04-26T10:22:39.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.088e-05 2024-04-26T10:22:39.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162272+0000", 2024-04-26T10:22:39.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12764540199999999 2024-04-26T10:22:39.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162350+0000", 2024-04-26T10:22:39.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7835000000000003e-05 2024-04-26T10:22:39.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.923 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.924 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110554 5.0 e45/37 5:04324c12:::benchmark_data_smithi052_19421_object110553:head v 45'6903, mlcod=45'6898)", 2024-04-26T10:22:39.924 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:39.924 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.847015753000001, 2024-04-26T10:22:39.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12566923499999999, 2024-04-26T10:22:39.924 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.924 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.924 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:39.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:39.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036278+0000", 2024-04-26T10:22:39.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:39.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036313+0000", 2024-04-26T10:22:39.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5247999999999999e-05 2024-04-26T10:22:39.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036324+0000", 2024-04-26T10:22:39.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0496000000000001e-05 2024-04-26T10:22:39.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036329+0000", 2024-04-26T10:22:39.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3070000000000002e-06 2024-04-26T10:22:39.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036364+0000", 2024-04-26T10:22:39.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4391000000000003e-05 2024-04-26T10:22:39.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036377+0000", 2024-04-26T10:22:39.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3706999999999999e-05 2024-04-26T10:22:39.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042032+0000", 2024-04-26T10:22:39.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056547120000000001 2024-04-26T10:22:39.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161949+0000", 2024-04-26T10:22:39.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119916482 2024-04-26T10:22:39.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.928 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.928 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110559 5.2 5:44c3f174:::benchmark_data_smithi052_19421_object110558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:39.928 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:39.928 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.845397143, 2024-04-26T10:22:39.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12530391299999999, 2024-04-26T10:22:39.928 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.928 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.928 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:39.928 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:39.928 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:39.929 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110559 2024-04-26T10:22:39.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.929 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:39.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:39.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037897+0000", 2024-04-26T10:22:39.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:39.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037922+0000", 2024-04-26T10:22:39.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5004e-05 2024-04-26T10:22:39.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037931+0000", 2024-04-26T10:22:39.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-04-26T10:22:39.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037937+0000", 2024-04-26T10:22:39.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6749999999999999e-06 2024-04-26T10:22:39.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037972+0000", 2024-04-26T10:22:39.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4678000000000002e-05 2024-04-26T10:22:39.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038108+0000", 2024-04-26T10:22:39.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013689099999999999 2024-04-26T10:22:39.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:39.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162887+0000", 2024-04-26T10:22:39.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124778258 2024-04-26T10:22:39.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163010+0000", 2024-04-26T10:22:39.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122924 2024-04-26T10:22:39.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163202+0000", 2024-04-26T10:22:39.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192203 2024-04-26T10:22:39.932 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.933 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.933 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.933 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110560 5.3 5:caf5a141:::benchmark_data_smithi052_19421_object110559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:39.933 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:39.933 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.845346542, 2024-04-26T10:22:39.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12888738299999999, 2024-04-26T10:22:39.933 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.933 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:39.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:39.933 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:39.934 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110560 2024-04-26T10:22:39.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.934 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:39.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:39.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037948+0000", 2024-04-26T10:22:39.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:39.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037973+0000", 2024-04-26T10:22:39.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5187000000000001e-05 2024-04-26T10:22:39.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037978+0000", 2024-04-26T10:22:39.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4120000000000003e-06 2024-04-26T10:22:39.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037981+0000", 2024-04-26T10:22:39.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6689999999999999e-06 2024-04-26T10:22:39.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038041+0000", 2024-04-26T10:22:39.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9324999999999999e-05 2024-04-26T10:22:39.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038179+0000", 2024-04-26T10:22:39.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013832499999999999 2024-04-26T10:22:39.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:39.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166427+0000", 2024-04-26T10:22:39.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128248165 2024-04-26T10:22:39.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166539+0000", 2024-04-26T10:22:39.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111538 2024-04-26T10:22:39.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166836+0000", 2024-04-26T10:22:39.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029714100000000001 2024-04-26T10:22:39.938 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.938 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.938 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.938 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110561 5.d 5:b143edec:::benchmark_data_smithi052_19421_object110560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:39.938 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:39.938 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.845304484, 2024-04-26T10:22:39.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.125215574, 2024-04-26T10:22:39.938 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.938 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:39.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:39.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:39.939 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110561 2024-04-26T10:22:39.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.939 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:39.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:39.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037990+0000", 2024-04-26T10:22:39.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:39.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038028+0000", 2024-04-26T10:22:39.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7802999999999997e-05 2024-04-26T10:22:39.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038035+0000", 2024-04-26T10:22:39.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-06 2024-04-26T10:22:39.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038040+0000", 2024-04-26T10:22:39.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.147e-06 2024-04-26T10:22:39.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038077+0000", 2024-04-26T10:22:39.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7166999999999998e-05 2024-04-26T10:22:39.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038192+0000", 2024-04-26T10:22:39.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115565 2024-04-26T10:22:39.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:39.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038319+0000", 2024-04-26T10:22:39.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012697699999999999 2024-04-26T10:22:39.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:39.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162690+0000", 2024-04-26T10:22:39.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12437065 2024-04-26T10:22:39.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:39.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162878+0000", 2024-04-26T10:22:39.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000188173 2024-04-26T10:22:39.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162992+0000", 2024-04-26T10:22:39.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114008 2024-04-26T10:22:39.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163206+0000", 2024-04-26T10:22:39.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021394900000000001 2024-04-26T10:22:39.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.943 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.944 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.944 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:39.944 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:39.944 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.84524388, 2024-04-26T10:22:39.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:22:39.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:39.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:39.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:39.944 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:22:39.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.945 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:39.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:39.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:39.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:39.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:22:39.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:22:39.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:22:39.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:22:39.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:22:39.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:22:39.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:22:39.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:22:39.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:22:39.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:22:39.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:39.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:22:39.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:22:39.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:22:39.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:22:39.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:22:39.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:22:39.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.949 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.949 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110564 5.3 5:c09e33cb:::benchmark_data_smithi052_19421_object110563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:39.949 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:39.949 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.845191222, 2024-04-26T10:22:39.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128984614, 2024-04-26T10:22:39.949 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.949 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:39.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:39.949 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:39.950 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110564 2024-04-26T10:22:39.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.950 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:39.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:39.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038103+0000", 2024-04-26T10:22:39.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:39.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038136+0000", 2024-04-26T10:22:39.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.243e-05 2024-04-26T10:22:39.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038143+0000", 2024-04-26T10:22:39.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0870000000000001e-06 2024-04-26T10:22:39.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038151+0000", 2024-04-26T10:22:39.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:22:39.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039813+0000", 2024-04-26T10:22:39.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001661844 2024-04-26T10:22:39.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039970+0000", 2024-04-26T10:22:39.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015712699999999999 2024-04-26T10:22:39.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:39.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166854+0000", 2024-04-26T10:22:39.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.126883788 2024-04-26T10:22:39.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166976+0000", 2024-04-26T10:22:39.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012231399999999999 2024-04-26T10:22:39.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167088+0000", 2024-04-26T10:22:39.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011243699999999999 2024-04-26T10:22:39.954 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.954 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.954 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.954 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:39.954 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:39.954 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.845134629, 2024-04-26T10:22:39.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:22:39.954 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.954 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:39.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:39.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:39.955 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:22:39.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.955 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:39.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:39.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:39.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:39.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:22:39.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:22:39.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:22:39.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:22:39.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:22:39.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:22:39.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:22:39.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:22:39.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:22:39.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:22:39.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:39.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:22:39.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:22:39.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:22:39.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:22:39.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:22:39.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:22:39.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.959 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.959 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110566 5.c 5:34145698:::benchmark_data_smithi052_19421_object110565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:39.959 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:39.959 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.845084851999999, 2024-04-26T10:22:39.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12673530699999999, 2024-04-26T10:22:39.959 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.959 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.960 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:39.960 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:39.960 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:39.960 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110566 2024-04-26T10:22:39.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.960 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:39.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:39.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:39.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:39.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038246+0000", 2024-04-26T10:22:39.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5759000000000001e-05 2024-04-26T10:22:39.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038252+0000", 2024-04-26T10:22:39.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5300000000000002e-06 2024-04-26T10:22:39.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038257+0000", 2024-04-26T10:22:39.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:39.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038312+0000", 2024-04-26T10:22:39.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5108000000000002e-05 2024-04-26T10:22:39.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038480+0000", 2024-04-26T10:22:39.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016751099999999999 2024-04-26T10:22:39.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:39.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164651+0000", 2024-04-26T10:22:39.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12617115600000001 2024-04-26T10:22:39.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164770+0000", 2024-04-26T10:22:39.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118748 2024-04-26T10:22:39.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164946+0000", 2024-04-26T10:22:39.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175966 2024-04-26T10:22:39.964 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.964 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.964 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.965 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:39.965 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:39.965 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.842737217, 2024-04-26T10:22:39.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:22:39.965 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.965 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:39.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:39.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:39.965 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:22:39.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.965 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:39.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:39.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:22:39.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:39.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:22:39.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:22:39.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:22:39.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:22:39.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:22:39.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:22:39.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:22:39.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:22:39.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:22:39.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:22:39.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:39.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:22:39.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:22:39.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:39.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:22:39.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:22:39.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:39.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:22:39.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:22:39.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:22:39.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:22:39.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:22:39.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:22:39.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.970 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.971 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110568 5.c 5:34af8ad3:::benchmark_data_smithi052_19421_object110567:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:39.971 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:39.971 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.842619592, 2024-04-26T10:22:39.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124943661, 2024-04-26T10:22:39.971 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.971 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.971 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:39.971 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:39.971 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:39.971 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110568 2024-04-26T10:22:39.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.971 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:39.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:39.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:39.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:39.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040711+0000", 2024-04-26T10:22:39.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6531e-05 2024-04-26T10:22:39.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040719+0000", 2024-04-26T10:22:39.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6120000000000001e-06 2024-04-26T10:22:39.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040724+0000", 2024-04-26T10:22:39.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2100000000000001e-06 2024-04-26T10:22:39.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040771+0000", 2024-04-26T10:22:39.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7123000000000003e-05 2024-04-26T10:22:39.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040984+0000", 2024-04-26T10:22:39.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021227400000000001 2024-04-26T10:22:39.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:39.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165350+0000", 2024-04-26T10:22:39.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124366738 2024-04-26T10:22:39.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165459+0000", 2024-04-26T10:22:39.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108168 2024-04-26T10:22:39.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165619+0000", 2024-04-26T10:22:39.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160564 2024-04-26T10:22:39.975 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.975 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.975 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.976 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:39.976 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:39.976 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.842551293, 2024-04-26T10:22:39.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:22:39.976 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.976 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:39.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:39.976 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:39.976 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:22:39.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.976 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:39.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:39.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:22:39.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:39.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:22:39.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:22:39.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:22:39.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:22:39.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:22:39.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:22:39.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:22:39.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:22:39.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:22:39.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:22:39.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:39.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:22:39.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:22:39.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:39.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:22:39.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:22:39.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:39.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:22:39.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:22:39.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:22:39.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:22:39.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:22:39.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:22:39.981 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.981 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.981 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.981 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110570 5.1 5:876a468c:::benchmark_data_smithi052_19421_object110569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:39.982 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:39.982 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 15.841248748, 2024-04-26T10:22:39.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12851437099999999, 2024-04-26T10:22:39.982 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.982 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.982 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:39.982 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:39.982 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:39.982 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110570 2024-04-26T10:22:39.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.982 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:39.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:39.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042045+0000", 2024-04-26T10:22:39.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:39.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042083+0000", 2024-04-26T10:22:39.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8064e-05 2024-04-26T10:22:39.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161855+0000", 2024-04-26T10:22:39.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119771934 2024-04-26T10:22:39.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161882+0000", 2024-04-26T10:22:39.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7083000000000001e-05 2024-04-26T10:22:39.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163117+0000", 2024-04-26T10:22:39.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001234509 2024-04-26T10:22:39.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163507+0000", 2024-04-26T10:22:39.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038998400000000001 2024-04-26T10:22:39.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:39.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170347+0000", 2024-04-26T10:22:39.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006840952 2024-04-26T10:22:39.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170488+0000", 2024-04-26T10:22:39.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140393 2024-04-26T10:22:39.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170561+0000", 2024-04-26T10:22:39.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2809e-05 2024-04-26T10:22:39.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.986 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.987 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:124481 5.d 5:b507cdbb:::benchmark_data_smithi052_19421_object124480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:39.987 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:39.987 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.8028838260000004, 2024-04-26T10:22:39.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.087933879000000006, 2024-04-26T10:22:39.987 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:39.987 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:39.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:39.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:39.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:39.987 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124481 2024-04-26T10:22:39.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.987 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:39.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:39.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:39.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:39.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:39.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:39.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:39.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080410+0000", 2024-04-26T10:22:39.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:39.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:39.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080523+0000", 2024-04-26T10:22:39.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112501 2024-04-26T10:22:39.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:39.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080528+0000", 2024-04-26T10:22:39.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1789999999999999e-06 2024-04-26T10:22:39.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:39.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080532+0000", 2024-04-26T10:22:39.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.805e-06 2024-04-26T10:22:39.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:39.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080562+0000", 2024-04-26T10:22:39.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0241000000000001e-05 2024-04-26T10:22:39.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:39.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080645+0000", 2024-04-26T10:22:39.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2816000000000001e-05 2024-04-26T10:22:39.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:39.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080786+0000", 2024-04-26T10:22:39.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014129400000000001 2024-04-26T10:22:39.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:39.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.084288+0000", 2024-04-26T10:22:39.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035017920000000001 2024-04-26T10:22:39.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:39.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.167975+0000", 2024-04-26T10:22:39.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.083686673000000003 2024-04-26T10:22:39.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:39.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.168092+0000", 2024-04-26T10:22:39.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117607 2024-04-26T10:22:39.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:39.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:39.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:39.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.168345+0000", 2024-04-26T10:22:39.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025299200000000001 2024-04-26T10:22:39.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.992 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.992 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:39.992 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:39.992 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:39.994 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:39.995 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:39.991+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:40.089 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T10:22:40.096 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:40.088+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:40.122 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:144411 5.4 5:2f345a16:::benchmark_data_smithi052_19421_object14939:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:40.118320+0000", 2024-04-26T10:22:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.003854774, 2024-04-26T10:22:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038716570000000001, 2024-04-26T10:22:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.122 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 144411 2024-04-26T10:22:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118320+0000", 2024-04-26T10:22:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118320+0000", 2024-04-26T10:22:40.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118319+0000", 2024-04-26T10:22:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118326+0000", 2024-04-26T10:22:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9569999999999996e-06 2024-04-26T10:22:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118344+0000", 2024-04-26T10:22:40.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8581999999999999e-05 2024-04-26T10:22:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118358+0000", 2024-04-26T10:22:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3498e-05 2024-04-26T10:22:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118408+0000", 2024-04-26T10:22:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0512e-05 2024-04-26T10:22:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118539+0000", 2024-04-26T10:22:40.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013055200000000001 2024-04-26T10:22:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118660+0000", 2024-04-26T10:22:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000121284 2024-04-26T10:22:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:144413 5.0 5:03f3c1f2:::benchmark_data_smithi052_19421_object14941:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:40.118390+0000", 2024-04-26T10:22:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0037847549999999999, 2024-04-26T10:22:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038463770000000002, 2024-04-26T10:22:40.126 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 144413 2024-04-26T10:22:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118390+0000", 2024-04-26T10:22:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118390+0000", 2024-04-26T10:22:40.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118389+0000", 2024-04-26T10:22:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118394+0000", 2024-04-26T10:22:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7369999999999997e-06 2024-04-26T10:22:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118404+0000", 2024-04-26T10:22:40.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6250000000000002e-06 2024-04-26T10:22:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118411+0000", 2024-04-26T10:22:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1119999999999998e-06 2024-04-26T10:22:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118550+0000", 2024-04-26T10:22:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013904100000000001 2024-04-26T10:22:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118689+0000", 2024-04-26T10:22:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000139593 2024-04-26T10:22:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118822+0000", 2024-04-26T10:22:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013299899999999999 2024-04-26T10:22:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:144414 5.a 5:5c164c40:::benchmark_data_smithi052_19421_object14942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:40.118423+0000", 2024-04-26T10:22:40.130 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0037517800000000001, 2024-04-26T10:22:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038513610000000002, 2024-04-26T10:22:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 144414 2024-04-26T10:22:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118423+0000", 2024-04-26T10:22:40.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118423+0000", 2024-04-26T10:22:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118422+0000", 2024-04-26T10:22:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118426+0000", 2024-04-26T10:22:40.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3859999999999999e-06 2024-04-26T10:22:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118433+0000", 2024-04-26T10:22:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2099999999999996e-06 2024-04-26T10:22:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118439+0000", 2024-04-26T10:22:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3620000000000002e-06 2024-04-26T10:22:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118549+0000", 2024-04-26T10:22:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109807 2024-04-26T10:22:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118689+0000", 2024-04-26T10:22:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013990399999999999 2024-04-26T10:22:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:144416 5.0 5:00477bf4:::benchmark_data_smithi052_19421_object14944:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:40.118450+0000", 2024-04-26T10:22:40.134 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0037250719999999998, 2024-04-26T10:22:40.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003858864, 2024-04-26T10:22:40.135 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.135 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:40.135 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.135 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.135 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.135 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 144416 2024-04-26T10:22:40.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.135 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118450+0000", 2024-04-26T10:22:40.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118450+0000", 2024-04-26T10:22:40.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118449+0000", 2024-04-26T10:22:40.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:40.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118453+0000", 2024-04-26T10:22:40.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2569999999999999e-06 2024-04-26T10:22:40.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118459+0000", 2024-04-26T10:22:40.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7530000000000004e-06 2024-04-26T10:22:40.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118465+0000", 2024-04-26T10:22:40.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4049999999999999e-06 2024-04-26T10:22:40.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121270+0000", 2024-04-26T10:22:40.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002805227 2024-04-26T10:22:40.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121463+0000", 2024-04-26T10:22:40.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019253599999999999 2024-04-26T10:22:40.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:40.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121621+0000", 2024-04-26T10:22:40.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158317 2024-04-26T10:22:40.138 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.138 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.138 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.138 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:144417 5.d e51/37 5:b71f0a93:::benchmark_data_smithi052_19421_object14945:head v 51'9089, mlcod=51'9087)", 2024-04-26T10:22:40.138 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:40.118791+0000", 2024-04-26T10:22:40.138 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0033840279999999999, 2024-04-26T10:22:40.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0035554900000000001, 2024-04-26T10:22:40.139 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.139 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:40.139 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118791+0000", 2024-04-26T10:22:40.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118791+0000", 2024-04-26T10:22:40.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118790+0000", 2024-04-26T10:22:40.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:40.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118795+0000", 2024-04-26T10:22:40.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0719999999999999e-06 2024-04-26T10:22:40.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118801+0000", 2024-04-26T10:22:40.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8000000000000004e-06 2024-04-26T10:22:40.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118805+0000", 2024-04-26T10:22:40.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0029999999999996e-06 2024-04-26T10:22:40.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118850+0000", 2024-04-26T10:22:40.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4583000000000003e-05 2024-04-26T10:22:40.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118872+0000", 2024-04-26T10:22:40.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2748e-05 2024-04-26T10:22:40.141 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.141 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.141 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.142 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:144415 5.f e51/37 5:f8dc0f2f:::benchmark_data_smithi052_19421_object14943:head v 51'9122, mlcod=51'9120)", 2024-04-26T10:22:40.142 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:40.118871+0000", 2024-04-26T10:22:40.142 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.003304165, 2024-04-26T10:22:40.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003504493, 2024-04-26T10:22:40.142 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.142 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:40.142 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118871+0000", 2024-04-26T10:22:40.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118871+0000", 2024-04-26T10:22:40.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118870+0000", 2024-04-26T10:22:40.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:40.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118875+0000", 2024-04-26T10:22:40.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9520000000000002e-06 2024-04-26T10:22:40.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118883+0000", 2024-04-26T10:22:40.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5689999999999999e-06 2024-04-26T10:22:40.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118888+0000", 2024-04-26T10:22:40.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.843e-06 2024-04-26T10:22:40.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118927+0000", 2024-04-26T10:22:40.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9508000000000002e-05 2024-04-26T10:22:40.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.118946+0000", 2024-04-26T10:22:40.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9270999999999999e-05 2024-04-26T10:22:40.145 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.145 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.145 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.145 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:144421 5.b 5:def82200:::benchmark_data_smithi052_19421_object14949:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:40.145 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:40.121594+0000", 2024-04-26T10:22:40.145 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00058080800000000004, 2024-04-26T10:22:40.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00081086699999999995, 2024-04-26T10:22:40.145 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.145 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:40.145 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.146 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.146 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.146 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 144421 2024-04-26T10:22:40.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.146 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121594+0000", 2024-04-26T10:22:40.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121594+0000", 2024-04-26T10:22:40.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121593+0000", 2024-04-26T10:22:40.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:40.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121598+0000", 2024-04-26T10:22:40.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6280000000000002e-06 2024-04-26T10:22:40.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121607+0000", 2024-04-26T10:22:40.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5220000000000007e-06 2024-04-26T10:22:40.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121614+0000", 2024-04-26T10:22:40.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2130000000000002e-06 2024-04-26T10:22:40.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121644+0000", 2024-04-26T10:22:40.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9621e-05 2024-04-26T10:22:40.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121778+0000", 2024-04-26T10:22:40.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013424500000000001 2024-04-26T10:22:40.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:40.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121870+0000", 2024-04-26T10:22:40.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1810000000000004e-05 2024-04-26T10:22:40.149 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.149 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.149 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.149 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:144425 5.0 5.10e7b9f0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:40.149 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:40.121699+0000", 2024-04-26T10:22:40.149 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00047533999999999999, 2024-04-26T10:22:40.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00074200799999999995, 2024-04-26T10:22:40.149 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.150 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:40.150 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.150 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.150 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.150 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 144425 2024-04-26T10:22:40.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.150 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121699+0000", 2024-04-26T10:22:40.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121699+0000", 2024-04-26T10:22:40.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121699+0000", 2024-04-26T10:22:40.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:40.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121708+0000", 2024-04-26T10:22:40.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5279999999999992e-06 2024-04-26T10:22:40.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121715+0000", 2024-04-26T10:22:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3069999999999997e-06 2024-04-26T10:22:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121723+0000", 2024-04-26T10:22:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7829999999999999e-06 2024-04-26T10:22:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "MOSDPGPushReply(5.0 51/37 [PushReplyOp(5:0ce470ff:::benchmark_data_smithi052_19421_object122043:head)])", 2024-04-26T10:22:40.152 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:40.121727+0000", 2024-04-26T10:22:40.153 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00044775700000000002, 2024-04-26T10:22:40.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00074021600000000003, 2024-04-26T10:22:40.153 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.153 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:40.153 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121727+0000", 2024-04-26T10:22:40.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121727+0000", 2024-04-26T10:22:40.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121726+0000", 2024-04-26T10:22:40.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:40.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121732+0000", 2024-04-26T10:22:40.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2850000000000002e-06 2024-04-26T10:22:40.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121741+0000", 2024-04-26T10:22:40.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6260000000000007e-06 2024-04-26T10:22:40.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:40.121748+0000", 2024-04-26T10:22:40.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8480000000000003e-06 2024-04-26T10:22:40.155 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.155 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.155 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.155 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.155 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:40.155 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 9 2024-04-26T10:22:40.155 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:40.156 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:40.195 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:40.195+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:40.279 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:40.279 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:40.279 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:40.279 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:40.279 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:40.291 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:40.296 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:40.292+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:40.397 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:40.392+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:40.421 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.889211672000002, 2024-04-26T10:22:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.422 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:40.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:40.426 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.887229445000003, 2024-04-26T10:22:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.427 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.431 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.887030060999997, 2024-04-26T10:22:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:40.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:40.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:40.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.886811440999999, 2024-04-26T10:22:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.436 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.884440003000002, 2024-04-26T10:22:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:40.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:40.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:40.444 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.884339380999997, 2024-04-26T10:22:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.445 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.449 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.884220820000003, 2024-04-26T10:22:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.453 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.884118422, 2024-04-26T10:22:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.883097865000003, 2024-04-26T10:22:40.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:40.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:40.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:40.463 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.881947590000003, 2024-04-26T10:22:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:40.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 16.385248348000001, 2024-04-26T10:22:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:22:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.468 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:22:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:22:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:22:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:22:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:22:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:22:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:22:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:22:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:22:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:22:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:22:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:22:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:22:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:22:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:22:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:22:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:22:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:22:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:22:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:22:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:22:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:22:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.473 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 16.385024752, 2024-04-26T10:22:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:22:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:22:40.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.475 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:40.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:40.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:22:40.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:22:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:22:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:22:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:22:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:22:40.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:22:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:22:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:22:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:22:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:22:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:40.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:22:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:22:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:22:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:22:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:22:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:22:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:22:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:22:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:22:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:22:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:40.479 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.3541784319999994, 2024-04-26T10:22:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:22:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:22:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:22:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:22:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:22:40.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:22:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:22:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:22:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:22:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:22:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:22:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:22:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:22:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:22:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:22:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:22:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:22:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:22:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:22:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:22:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:22:40.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:22:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:22:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.3521673290000003, 2024-04-26T10:22:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:22:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.485 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:22:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:22:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:22:40.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:22:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:22:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:22:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:22:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:22:40.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:22:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:22:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:22:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:22:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:22:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:22:40.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:22:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:22:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:22:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:22:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:22:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:22:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:22:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.3412892240000005, 2024-04-26T10:22:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:22:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.491 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:22:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:22:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:22:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:22:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:22:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:22:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:22:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:22:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:22:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:22:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:22:40.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:22:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:22:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:22:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:22:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:22:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:40.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:22:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:22:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:22:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:22:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:22:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:22:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.496 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.3386080049999993, 2024-04-26T10:22:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:22:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:22:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:22:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:40.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:22:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:22:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:22:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:22:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:22:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:22:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:22:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:22:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:22:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:22:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:22:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:22:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:22:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:22:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:22:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:22:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:22:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:22:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:22:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:22:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.502 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.3382409299999996, 2024-04-26T10:22:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:22:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:22:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:22:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:22:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:22:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:22:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:22:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:22:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:22:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:22:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:22:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:22:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:22:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:22:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:22:40.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:22:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:22:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:22:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:22:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.338176678, 2024-04-26T10:22:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:22:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:22:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:22:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:40.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:22:40.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:22:40.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:22:40.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:22:40.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:22:40.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:22:40.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:22:40.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:22:40.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:22:40.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:22:40.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:40.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:22:40.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:22:40.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:22:40.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:22:40.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:22:40.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:22:40.512 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.512 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.512 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.513 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:40.513 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:40.513 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.3337780049999992, 2024-04-26T10:22:40.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:22:40.513 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.513 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.513 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.513 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.513 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.513 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:22:40.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.513 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:40.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:40.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:22:40.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:40.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:22:40.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:22:40.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:22:40.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:22:40.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:22:40.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:22:40.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:22:40.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:22:40.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:22:40.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:22:40.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:40.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:22:40.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:22:40.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:22:40.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:22:40.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:22:40.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:22:40.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.517 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.518 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:40.518 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:40.518 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 9.332020022, 2024-04-26T10:22:40.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:22:40.518 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:40.518 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:40.518 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:40.518 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:40.518 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.518 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:22:40.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.518 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:40.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:40.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:40.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:40.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:40.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:40.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:40.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:22:40.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:40.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:40.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:22:40.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:22:40.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:40.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:22:40.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:22:40.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:22:40.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:22:40.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:40.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:22:40.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:22:40.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:40.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:22:40.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:22:40.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:40.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:22:40.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:22:40.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:40.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:22:40.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:22:40.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:40.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:22:40.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:22:40.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:40.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:22:40.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:22:40.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:40.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:40.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:40.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:22:40.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:22:40.523 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.523 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.523 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.523 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:40.523 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:40.523 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:40.525 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:40.526 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:40.520+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:40.625 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:40.623+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:40.658 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:145659 5.d 5:b63bcb07:::benchmark_data_smithi052_19421_object16187:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:40.649441+0000", 2024-04-26T10:22:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0068468349999999999, 2024-04-26T10:22:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068699809999999998, 2024-04-26T10:22:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:40.658 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 145659 2024-04-26T10:22:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.649441+0000", 2024-04-26T10:22:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.649441+0000", 2024-04-26T10:22:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.649440+0000", 2024-04-26T10:22:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.649443+0000", 2024-04-26T10:22:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7580000000000001e-06 2024-04-26T10:22:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.649449+0000", 2024-04-26T10:22:40.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1700000000000002e-06 2024-04-26T10:22:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.649454+0000", 2024-04-26T10:22:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6419999999999998e-06 2024-04-26T10:22:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.649512+0000", 2024-04-26T10:22:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8412999999999998e-05 2024-04-26T10:22:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.649598+0000", 2024-04-26T10:22:40.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6283e-05 2024-04-26T10:22:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.649686+0000", 2024-04-26T10:22:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7517999999999998e-05 2024-04-26T10:22:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.652889+0000", 2024-04-26T10:22:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032027069999999999 2024-04-26T10:22:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:145667 5.7 5:ed8c4798:::benchmark_data_smithi052_19421_object16195:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:40.653044+0000", 2024-04-26T10:22:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003243924, 2024-04-26T10:22:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033443869999999999, 2024-04-26T10:22:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 145667 2024-04-26T10:22:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.653044+0000", 2024-04-26T10:22:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.653044+0000", 2024-04-26T10:22:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.653043+0000", 2024-04-26T10:22:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:40.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.653049+0000", 2024-04-26T10:22:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9220000000000002e-06 2024-04-26T10:22:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.653059+0000", 2024-04-26T10:22:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0762e-05 2024-04-26T10:22:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.653066+0000", 2024-04-26T10:22:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7739999999999999e-06 2024-04-26T10:22:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.653664+0000", 2024-04-26T10:22:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00059844 2024-04-26T10:22:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.653788+0000", 2024-04-26T10:22:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012385099999999999 2024-04-26T10:22:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.666 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:145670 5.d 5:b202b842:::benchmark_data_smithi052_19421_object16198:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:40.654026+0000", 2024-04-26T10:22:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0022609990000000001, 2024-04-26T10:22:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024244959999999999, 2024-04-26T10:22:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 145670 2024-04-26T10:22:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.654026+0000", 2024-04-26T10:22:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.654026+0000", 2024-04-26T10:22:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.654026+0000", 2024-04-26T10:22:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.654032+0000", 2024-04-26T10:22:40.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:22:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.654044+0000", 2024-04-26T10:22:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2700999999999999e-05 2024-04-26T10:22:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.654051+0000", 2024-04-26T10:22:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0140000000000001e-06 2024-04-26T10:22:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:40.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.654109+0000", 2024-04-26T10:22:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7614000000000001e-05 2024-04-26T10:22:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.654281+0000", 2024-04-26T10:22:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171547 2024-04-26T10:22:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.654382+0000", 2024-04-26T10:22:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101617 2024-04-26T10:22:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:40.670 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:145672 5.9 5:93dc6df9:::benchmark_data_smithi052_19421_object16200:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:40.655254+0000", 2024-04-26T10:22:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0010332099999999999, 2024-04-26T10:22:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012593039999999999, 2024-04-26T10:22:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 145672 2024-04-26T10:22:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:40.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655254+0000", 2024-04-26T10:22:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655254+0000", 2024-04-26T10:22:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655253+0000", 2024-04-26T10:22:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:40.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655258+0000", 2024-04-26T10:22:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8359999999999999e-06 2024-04-26T10:22:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655269+0000", 2024-04-26T10:22:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0244000000000001e-05 2024-04-26T10:22:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655273+0000", 2024-04-26T10:22:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.955e-06 2024-04-26T10:22:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655308+0000", 2024-04-26T10:22:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4217999999999997e-05 2024-04-26T10:22:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655415+0000", 2024-04-26T10:22:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010754700000000001 2024-04-26T10:22:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655479+0000", 2024-04-26T10:22:40.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3657000000000004e-05 2024-04-26T10:22:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:145646 5.9 e51/37)", 2024-04-26T10:22:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:40.655499+0000", 2024-04-26T10:22:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00078835999999999999, 2024-04-26T10:22:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001075821, 2024-04-26T10:22:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655499+0000", 2024-04-26T10:22:40.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655499+0000", 2024-04-26T10:22:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655499+0000", 2024-04-26T10:22:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655502+0000", 2024-04-26T10:22:40.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6119999999999999e-06 2024-04-26T10:22:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655508+0000", 2024-04-26T10:22:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6250000000000004e-06 2024-04-26T10:22:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655512+0000", 2024-04-26T10:22:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1840000000000001e-06 2024-04-26T10:22:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:145650 5.9 e51/37)", 2024-04-26T10:22:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:40.655530+0000", 2024-04-26T10:22:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00075761299999999997, 2024-04-26T10:22:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010836979999999999, 2024-04-26T10:22:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655530+0000", 2024-04-26T10:22:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655530+0000", 2024-04-26T10:22:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655530+0000", 2024-04-26T10:22:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655532+0000", 2024-04-26T10:22:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4880000000000001e-06 2024-04-26T10:22:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655538+0000", 2024-04-26T10:22:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0050000000000001e-06 2024-04-26T10:22:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655545+0000", 2024-04-26T10:22:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8129999999999998e-06 2024-04-26T10:22:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:145662 5.4 e51/37 5:2c062a5d:::benchmark_data_smithi052_19421_object16190:head v 51'9190, mlcod=51'9188)", 2024-04-26T10:22:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:40.655562+0000", 2024-04-26T10:22:40.680 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00072541100000000002, 2024-04-26T10:22:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010937970000000001, 2024-04-26T10:22:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655562+0000", 2024-04-26T10:22:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655562+0000", 2024-04-26T10:22:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655562+0000", 2024-04-26T10:22:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-04-26T10:22:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655581+0000", 2024-04-26T10:22:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9446e-05 2024-04-26T10:22:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:40.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655588+0000", 2024-04-26T10:22:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3319999999999997e-06 2024-04-26T10:22:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655591+0000", 2024-04-26T10:22:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.055e-06 2024-04-26T10:22:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655640+0000", 2024-04-26T10:22:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9673999999999999e-05 2024-04-26T10:22:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655660+0000", 2024-04-26T10:22:40.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9287999999999999e-05 2024-04-26T10:22:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:145663 5.4 e51/37)", 2024-04-26T10:22:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:40.655760+0000", 2024-04-26T10:22:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00052714299999999999, 2024-04-26T10:22:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00094508999999999999, 2024-04-26T10:22:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:40.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655760+0000", 2024-04-26T10:22:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655760+0000", 2024-04-26T10:22:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655760+0000", 2024-04-26T10:22:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-04-26T10:22:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:40.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655764+0000", 2024-04-26T10:22:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8940000000000003e-06 2024-04-26T10:22:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655769+0000", 2024-04-26T10:22:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.395e-06 2024-04-26T10:22:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.655773+0000", 2024-04-26T10:22:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.946e-06 2024-04-26T10:22:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:40.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:145674 5.3 5:c853d636:::benchmark_data_smithi052_19421_object16202:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:40.656052+0000", 2024-04-26T10:22:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000235763, 2024-04-26T10:22:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069865599999999997, 2024-04-26T10:22:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 145674 2024-04-26T10:22:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.687 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.656052+0000", 2024-04-26T10:22:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.656052+0000", 2024-04-26T10:22:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:40.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.656051+0000", 2024-04-26T10:22:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.656055+0000", 2024-04-26T10:22:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.245e-06 2024-04-26T10:22:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.656068+0000", 2024-04-26T10:22:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2717e-05 2024-04-26T10:22:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.656074+0000", 2024-04-26T10:22:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4409999999999998e-06 2024-04-26T10:22:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.656122+0000", 2024-04-26T10:22:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8250000000000001e-05 2024-04-26T10:22:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.656241+0000", 2024-04-26T10:22:40.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118646 2024-04-26T10:22:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:145675 5.3 5.79c158c3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:40.656093+0000", 2024-04-26T10:22:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00019451099999999999, 2024-04-26T10:22:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071223100000000002, 2024-04-26T10:22:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:40.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 145675 2024-04-26T10:22:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.656093+0000", 2024-04-26T10:22:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.656093+0000", 2024-04-26T10:22:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.656092+0000", 2024-04-26T10:22:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.656096+0000", 2024-04-26T10:22:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2150000000000001e-06 2024-04-26T10:22:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.656103+0000", 2024-04-26T10:22:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.418e-06 2024-04-26T10:22:40.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.656109+0000", 2024-04-26T10:22:40.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9900000000000002e-06 2024-04-26T10:22:40.694 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.694 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:40.694 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.694 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:145646 5.9 5:9d90c210:::benchmark_data_smithi052_19421_object16174:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:40.694 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:40.647659+0000", 2024-04-26T10:22:40.694 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0086282149999999998, 2024-04-26T10:22:40.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091949100000000006, 2024-04-26T10:22:40.694 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:40.695 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:40.695 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:40.695 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:40.695 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.695 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 145646 2024-04-26T10:22:40.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.695 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:40.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:40.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.647659+0000", 2024-04-26T10:22:40.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:40.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.647659+0000", 2024-04-26T10:22:40.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:40.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.647658+0000", 2024-04-26T10:22:40.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:40.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:40.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.647668+0000", 2024-04-26T10:22:40.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1079999999999999e-06 2024-04-26T10:22:40.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:40.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.647676+0000", 2024-04-26T10:22:40.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8249999999999994e-06 2024-04-26T10:22:40.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.647681+0000", 2024-04-26T10:22:40.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8659999999999997e-06 2024-04-26T10:22:40.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:40.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.647723+0000", 2024-04-26T10:22:40.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1919999999999998e-05 2024-04-26T10:22:40.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:40.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.647878+0000", 2024-04-26T10:22:40.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015465300000000001 2024-04-26T10:22:40.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:40.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.647978+0000", 2024-04-26T10:22:40.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100121 2024-04-26T10:22:40.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:40.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.651015+0000", 2024-04-26T10:22:40.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030374870000000002 2024-04-26T10:22:40.698 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.698 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:40.698 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.699 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:145650 5.9 5:95d62c19:::benchmark_data_smithi052_19421_object16178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:40.699 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:40.647750+0000", 2024-04-26T10:22:40.699 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0085379180000000002, 2024-04-26T10:22:40.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0091726220000000001, 2024-04-26T10:22:40.699 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:40.699 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:40.699 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:40.699 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:40.699 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:40.699 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 145650 2024-04-26T10:22:40.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.699 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:40.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:40.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.647750+0000", 2024-04-26T10:22:40.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:40.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.647750+0000", 2024-04-26T10:22:40.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:40.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:40.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.647749+0000", 2024-04-26T10:22:40.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:40.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:40.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.647752+0000", 2024-04-26T10:22:40.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8049999999999998e-06 2024-04-26T10:22:40.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:40.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.647759+0000", 2024-04-26T10:22:40.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2339999999999997e-06 2024-04-26T10:22:40.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:40.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.647764+0000", 2024-04-26T10:22:40.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7029999999999997e-06 2024-04-26T10:22:40.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:40.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.649273+0000", 2024-04-26T10:22:40.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001509303 2024-04-26T10:22:40.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:40.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.649456+0000", 2024-04-26T10:22:40.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018323300000000001 2024-04-26T10:22:40.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:40.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.649572+0000", 2024-04-26T10:22:40.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011599699999999999 2024-04-26T10:22:40.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:40.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:40.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:40.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:40.651579+0000", 2024-04-26T10:22:40.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020068180000000001 2024-04-26T10:22:40.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.703 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:40.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:40.703 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:40.703 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 12 2024-04-26T10:22:40.703 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:40.704 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:40.726 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:40.724+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:40.829 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:40.824+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:40.834 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:40.834 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:40.834 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:40.845 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:40.928 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:40.927+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:41.018 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:41.018 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:41.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:41.019 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:41.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.019 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:41.019 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:41.019 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.486040172000003, 2024-04-26T10:22:41.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:41.019 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.019 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.019 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.019 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.019 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.019 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:41.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.020 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:41.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:41.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:41.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:41.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:41.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:41.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:41.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:41.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:41.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:41.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:41.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:41.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:41.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:41.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:41.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:41.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:41.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:41.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:41.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:41.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:41.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:41.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:41.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:41.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:41.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:41.025 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.025 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.025 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.025 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:41.025 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:41.025 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.481504960000002, 2024-04-26T10:22:41.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:41.025 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.025 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.025 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.026 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:41.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.026 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:41.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:41.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:41.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:41.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:41.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:41.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:41.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:41.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:41.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:41.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:41.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:41.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:41.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:41.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:41.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:41.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:41.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:41.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:41.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:41.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:41.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:41.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:41.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:41.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:41.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:41.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:41.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.030 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.030 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.030 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:41.031 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:41.031 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.480873668000001, 2024-04-26T10:22:41.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:41.031 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.031 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.031 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.031 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:41.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.031 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:41.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:41.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:41.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:41.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:41.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:41.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:41.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:41.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:41.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:41.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:41.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:41.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:41.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:41.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:41.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:41.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:41.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:41.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:41.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:41.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:41.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:41.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:41.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:41.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:41.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:41.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.036 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.036 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110555 5.9 5:919989b3:::benchmark_data_smithi052_19421_object110554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:41.036 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:41.036 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.982076462999999, 2024-04-26T10:22:41.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129736717, 2024-04-26T10:22:41.036 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.036 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.036 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.036 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.036 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.036 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110555 2024-04-26T10:22:41.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.037 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:41.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:41.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033309+0000", 2024-04-26T10:22:41.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033393+0000", 2024-04-26T10:22:41.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3690999999999995e-05 2024-04-26T10:22:41.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033401+0000", 2024-04-26T10:22:41.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4319999999999999e-06 2024-04-26T10:22:41.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033406+0000", 2024-04-26T10:22:41.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2340000000000002e-06 2024-04-26T10:22:41.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033467+0000", 2024-04-26T10:22:41.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0915999999999997e-05 2024-04-26T10:22:41.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033550+0000", 2024-04-26T10:22:41.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3057000000000001e-05 2024-04-26T10:22:41.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:41.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033676+0000", 2024-04-26T10:22:41.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126162 2024-04-26T10:22:41.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:41.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037902+0000", 2024-04-26T10:22:41.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042255720000000004 2024-04-26T10:22:41.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:41.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162728+0000", 2024-04-26T10:22:41.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12482583799999999 2024-04-26T10:22:41.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162839+0000", 2024-04-26T10:22:41.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111222 2024-04-26T10:22:41.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163047+0000", 2024-04-26T10:22:41.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207686 2024-04-26T10:22:41.041 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.041 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.042 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.042 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110556 5.1 5:822c74bd:::benchmark_data_smithi052_19421_object110555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:41.042 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:41.042 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.981967355999998, 2024-04-26T10:22:41.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129274783, 2024-04-26T10:22:41.042 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.042 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.042 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.043 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110556 2024-04-26T10:22:41.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.043 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:41.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:41.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033418+0000", 2024-04-26T10:22:41.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033472+0000", 2024-04-26T10:22:41.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3780999999999999e-05 2024-04-26T10:22:41.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033478+0000", 2024-04-26T10:22:41.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6049999999999997e-06 2024-04-26T10:22:41.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033482+0000", 2024-04-26T10:22:41.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9110000000000001e-06 2024-04-26T10:22:41.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033509+0000", 2024-04-26T10:22:41.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6415e-05 2024-04-26T10:22:41.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033650+0000", 2024-04-26T10:22:41.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014088999999999999 2024-04-26T10:22:41.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:41.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161877+0000", 2024-04-26T10:22:41.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128227707 2024-04-26T10:22:41.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162541+0000", 2024-04-26T10:22:41.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000663863 2024-04-26T10:22:41.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162694+0000", 2024-04-26T10:22:41.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015245699999999999 2024-04-26T10:22:41.046 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.047 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.047 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.047 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110558 5.3 5:c73f56b6:::benchmark_data_smithi052_19421_object110557:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:41.047 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:41.047 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.981770721, 2024-04-26T10:22:41.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12864012999999999, 2024-04-26T10:22:41.047 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.047 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.047 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.047 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.047 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.047 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110558 2024-04-26T10:22:41.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.047 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:41.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:41.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033615+0000", 2024-04-26T10:22:41.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033717+0000", 2024-04-26T10:22:41.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102298 2024-04-26T10:22:41.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033725+0000", 2024-04-26T10:22:41.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0090000000000007e-06 2024-04-26T10:22:41.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033731+0000", 2024-04-26T10:22:41.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8919999999999997e-06 2024-04-26T10:22:41.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033769+0000", 2024-04-26T10:22:41.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7682999999999998e-05 2024-04-26T10:22:41.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033891+0000", 2024-04-26T10:22:41.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121718 2024-04-26T10:22:41.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:41.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161912+0000", 2024-04-26T10:22:41.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128021512 2024-04-26T10:22:41.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162043+0000", 2024-04-26T10:22:41.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130588 2024-04-26T10:22:41.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162256+0000", 2024-04-26T10:22:41.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021311499999999999 2024-04-26T10:22:41.052 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.052 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.052 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.052 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110557 5.b e45/37 5:d659544e:::benchmark_data_smithi052_19421_object110556:head v 45'6862, mlcod=45'6860)", 2024-04-26T10:22:41.052 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:41.052 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.980866488, 2024-04-26T10:22:41.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12783012499999999, 2024-04-26T10:22:41.052 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.052 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.052 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:41.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:41.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034519+0000", 2024-04-26T10:22:41.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034526+0000", 2024-04-26T10:22:41.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0380000000000002e-06 2024-04-26T10:22:41.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034539+0000", 2024-04-26T10:22:41.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.27e-05 2024-04-26T10:22:41.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034545+0000", 2024-04-26T10:22:41.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3369999999999996e-06 2024-04-26T10:22:41.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034606+0000", 2024-04-26T10:22:41.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0752999999999999e-05 2024-04-26T10:22:41.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034627+0000", 2024-04-26T10:22:41.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.088e-05 2024-04-26T10:22:41.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162272+0000", 2024-04-26T10:22:41.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12764540199999999 2024-04-26T10:22:41.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162350+0000", 2024-04-26T10:22:41.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7835000000000003e-05 2024-04-26T10:22:41.056 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.056 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.056 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.057 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110554 5.0 e45/37 5:04324c12:::benchmark_data_smithi052_19421_object110553:head v 45'6903, mlcod=45'6898)", 2024-04-26T10:22:41.057 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:41.057 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.979107066000001, 2024-04-26T10:22:41.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12566923499999999, 2024-04-26T10:22:41.057 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.057 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.057 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:41.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:41.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036278+0000", 2024-04-26T10:22:41.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036313+0000", 2024-04-26T10:22:41.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5247999999999999e-05 2024-04-26T10:22:41.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036324+0000", 2024-04-26T10:22:41.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0496000000000001e-05 2024-04-26T10:22:41.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036329+0000", 2024-04-26T10:22:41.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3070000000000002e-06 2024-04-26T10:22:41.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036364+0000", 2024-04-26T10:22:41.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4391000000000003e-05 2024-04-26T10:22:41.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036377+0000", 2024-04-26T10:22:41.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3706999999999999e-05 2024-04-26T10:22:41.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042032+0000", 2024-04-26T10:22:41.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056547120000000001 2024-04-26T10:22:41.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161949+0000", 2024-04-26T10:22:41.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119916482 2024-04-26T10:22:41.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.061 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.061 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110559 5.2 5:44c3f174:::benchmark_data_smithi052_19421_object110558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:41.061 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:41.061 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.977488456, 2024-04-26T10:22:41.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12530391299999999, 2024-04-26T10:22:41.061 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.061 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.061 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.062 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110559 2024-04-26T10:22:41.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.062 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:41.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:41.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037897+0000", 2024-04-26T10:22:41.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037922+0000", 2024-04-26T10:22:41.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5004e-05 2024-04-26T10:22:41.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037931+0000", 2024-04-26T10:22:41.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-04-26T10:22:41.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037937+0000", 2024-04-26T10:22:41.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6749999999999999e-06 2024-04-26T10:22:41.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037972+0000", 2024-04-26T10:22:41.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4678000000000002e-05 2024-04-26T10:22:41.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038108+0000", 2024-04-26T10:22:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013689099999999999 2024-04-26T10:22:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162887+0000", 2024-04-26T10:22:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124778258 2024-04-26T10:22:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163010+0000", 2024-04-26T10:22:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122924 2024-04-26T10:22:41.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163202+0000", 2024-04-26T10:22:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192203 2024-04-26T10:22:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110560 5.3 5:caf5a141:::benchmark_data_smithi052_19421_object110559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.977437855000002, 2024-04-26T10:22:41.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12888738299999999, 2024-04-26T10:22:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110560 2024-04-26T10:22:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037948+0000", 2024-04-26T10:22:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037973+0000", 2024-04-26T10:22:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5187000000000001e-05 2024-04-26T10:22:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037978+0000", 2024-04-26T10:22:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4120000000000003e-06 2024-04-26T10:22:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037981+0000", 2024-04-26T10:22:41.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6689999999999999e-06 2024-04-26T10:22:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038041+0000", 2024-04-26T10:22:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9324999999999999e-05 2024-04-26T10:22:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038179+0000", 2024-04-26T10:22:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013832499999999999 2024-04-26T10:22:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166427+0000", 2024-04-26T10:22:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128248165 2024-04-26T10:22:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166539+0000", 2024-04-26T10:22:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111538 2024-04-26T10:22:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166836+0000", 2024-04-26T10:22:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029714100000000001 2024-04-26T10:22:41.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110561 5.d 5:b143edec:::benchmark_data_smithi052_19421_object110560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.977395797, 2024-04-26T10:22:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.125215574, 2024-04-26T10:22:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110561 2024-04-26T10:22:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037990+0000", 2024-04-26T10:22:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038028+0000", 2024-04-26T10:22:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7802999999999997e-05 2024-04-26T10:22:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038035+0000", 2024-04-26T10:22:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-06 2024-04-26T10:22:41.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038040+0000", 2024-04-26T10:22:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.147e-06 2024-04-26T10:22:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038077+0000", 2024-04-26T10:22:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7166999999999998e-05 2024-04-26T10:22:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038192+0000", 2024-04-26T10:22:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115565 2024-04-26T10:22:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038319+0000", 2024-04-26T10:22:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012697699999999999 2024-04-26T10:22:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162690+0000", 2024-04-26T10:22:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12437065 2024-04-26T10:22:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162878+0000", 2024-04-26T10:22:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000188173 2024-04-26T10:22:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162992+0000", 2024-04-26T10:22:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114008 2024-04-26T10:22:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163206+0000", 2024-04-26T10:22:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021394900000000001 2024-04-26T10:22:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:41.077 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.977335193000002, 2024-04-26T10:22:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:22:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:22:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:22:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:22:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:22:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:22:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:22:41.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:22:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:22:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:22:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:22:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:22:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:41.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:22:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:22:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:22:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:22:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:22:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:22:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110564 5.3 5:c09e33cb:::benchmark_data_smithi052_19421_object110563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.977282535000001, 2024-04-26T10:22:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128984614, 2024-04-26T10:22:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110564 2024-04-26T10:22:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038103+0000", 2024-04-26T10:22:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038136+0000", 2024-04-26T10:22:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.243e-05 2024-04-26T10:22:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038143+0000", 2024-04-26T10:22:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0870000000000001e-06 2024-04-26T10:22:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038151+0000", 2024-04-26T10:22:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:22:41.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039813+0000", 2024-04-26T10:22:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001661844 2024-04-26T10:22:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039970+0000", 2024-04-26T10:22:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015712699999999999 2024-04-26T10:22:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:41.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166854+0000", 2024-04-26T10:22:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.126883788 2024-04-26T10:22:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166976+0000", 2024-04-26T10:22:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012231399999999999 2024-04-26T10:22:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167088+0000", 2024-04-26T10:22:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011243699999999999 2024-04-26T10:22:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.977225942, 2024-04-26T10:22:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:22:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:22:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.088 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:22:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:22:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:22:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:22:41.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:22:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:22:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:22:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:22:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:22:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:22:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:22:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:22:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:22:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:22:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:22:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:22:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110566 5.c 5:34145698:::benchmark_data_smithi052_19421_object110565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.977176164999999, 2024-04-26T10:22:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12673530699999999, 2024-04-26T10:22:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110566 2024-04-26T10:22:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038246+0000", 2024-04-26T10:22:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5759000000000001e-05 2024-04-26T10:22:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038252+0000", 2024-04-26T10:22:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5300000000000002e-06 2024-04-26T10:22:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038257+0000", 2024-04-26T10:22:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038312+0000", 2024-04-26T10:22:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5108000000000002e-05 2024-04-26T10:22:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038480+0000", 2024-04-26T10:22:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016751099999999999 2024-04-26T10:22:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164651+0000", 2024-04-26T10:22:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12617115600000001 2024-04-26T10:22:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164770+0000", 2024-04-26T10:22:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118748 2024-04-26T10:22:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164946+0000", 2024-04-26T10:22:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175966 2024-04-26T10:22:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.97482853, 2024-04-26T10:22:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:22:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.098 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:22:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:41.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:22:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:22:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:22:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:22:41.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:22:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:22:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:22:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:22:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:22:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:22:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:22:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:22:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:22:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:22:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:22:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:22:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:22:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:22:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:22:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:22:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:22:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.103 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110568 5.c 5:34af8ad3:::benchmark_data_smithi052_19421_object110567:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.974710904999998, 2024-04-26T10:22:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124943661, 2024-04-26T10:22:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110568 2024-04-26T10:22:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.104 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040711+0000", 2024-04-26T10:22:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6531e-05 2024-04-26T10:22:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040719+0000", 2024-04-26T10:22:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6120000000000001e-06 2024-04-26T10:22:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040724+0000", 2024-04-26T10:22:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2100000000000001e-06 2024-04-26T10:22:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040771+0000", 2024-04-26T10:22:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7123000000000003e-05 2024-04-26T10:22:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040984+0000", 2024-04-26T10:22:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021227400000000001 2024-04-26T10:22:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165350+0000", 2024-04-26T10:22:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124366738 2024-04-26T10:22:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165459+0000", 2024-04-26T10:22:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108168 2024-04-26T10:22:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165619+0000", 2024-04-26T10:22:41.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160564 2024-04-26T10:22:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.974642606, 2024-04-26T10:22:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:22:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:22:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:22:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:22:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:22:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:22:41.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:22:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:22:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:22:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:22:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:22:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:22:41.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:22:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:22:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:22:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:22:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:22:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:41.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:22:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:22:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:22:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:22:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:22:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:22:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110570 5.1 5:876a468c:::benchmark_data_smithi052_19421_object110569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 16.973340061000002, 2024-04-26T10:22:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12851437099999999, 2024-04-26T10:22:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110570 2024-04-26T10:22:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:41.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042045+0000", 2024-04-26T10:22:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042083+0000", 2024-04-26T10:22:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8064e-05 2024-04-26T10:22:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161855+0000", 2024-04-26T10:22:41.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119771934 2024-04-26T10:22:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161882+0000", 2024-04-26T10:22:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7083000000000001e-05 2024-04-26T10:22:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163117+0000", 2024-04-26T10:22:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001234509 2024-04-26T10:22:41.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163507+0000", 2024-04-26T10:22:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038998400000000001 2024-04-26T10:22:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170347+0000", 2024-04-26T10:22:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006840952 2024-04-26T10:22:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170488+0000", 2024-04-26T10:22:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140393 2024-04-26T10:22:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170561+0000", 2024-04-26T10:22:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2809e-05 2024-04-26T10:22:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:124481 5.d 5:b507cdbb:::benchmark_data_smithi052_19421_object124480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:41.120 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.9349751390000005, 2024-04-26T10:22:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.087933879000000006, 2024-04-26T10:22:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124481 2024-04-26T10:22:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080410+0000", 2024-04-26T10:22:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080523+0000", 2024-04-26T10:22:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112501 2024-04-26T10:22:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080528+0000", 2024-04-26T10:22:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1789999999999999e-06 2024-04-26T10:22:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080532+0000", 2024-04-26T10:22:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.805e-06 2024-04-26T10:22:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080562+0000", 2024-04-26T10:22:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0241000000000001e-05 2024-04-26T10:22:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080645+0000", 2024-04-26T10:22:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2816000000000001e-05 2024-04-26T10:22:41.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080786+0000", 2024-04-26T10:22:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014129400000000001 2024-04-26T10:22:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.084288+0000", 2024-04-26T10:22:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035017920000000001 2024-04-26T10:22:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.167975+0000", 2024-04-26T10:22:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.083686673000000003 2024-04-26T10:22:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.168092+0000", 2024-04-26T10:22:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117607 2024-04-26T10:22:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.168345+0000", 2024-04-26T10:22:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025299200000000001 2024-04-26T10:22:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.126 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.126 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:41.128 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:41.129 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:41.124+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:41.228 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:41.224+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:41.262 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:41.262 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:41.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.262 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:147111 5.b 5:df125de9:::benchmark_data_smithi052_19421_object17639:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:41.263 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:41.256936+0000", 2024-04-26T10:22:41.263 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0057552159999999996, 2024-04-26T10:22:41.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005773467, 2024-04-26T10:22:41.263 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.263 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:41.263 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.263 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.263 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.263 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 147111 2024-04-26T10:22:41.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.263 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.256936+0000", 2024-04-26T10:22:41.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.256936+0000", 2024-04-26T10:22:41.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.256935+0000", 2024-04-26T10:22:41.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.256939+0000", 2024-04-26T10:22:41.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.206e-06 2024-04-26T10:22:41.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.256946+0000", 2024-04-26T10:22:41.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1799999999999999e-06 2024-04-26T10:22:41.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.256952+0000", 2024-04-26T10:22:41.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8139999999999997e-06 2024-04-26T10:22:41.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.257042+0000", 2024-04-26T10:22:41.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0141000000000003e-05 2024-04-26T10:22:41.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.257184+0000", 2024-04-26T10:22:41.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000141507 2024-04-26T10:22:41.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:41.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.257332+0000", 2024-04-26T10:22:41.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000148438 2024-04-26T10:22:41.266 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.266 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.266 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.267 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:147119 5.a 5:5cb9cecc:::benchmark_data_smithi052_19421_object17647:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:41.267 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:41.259416+0000", 2024-04-26T10:22:41.267 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.003275259, 2024-04-26T10:22:41.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033380599999999999, 2024-04-26T10:22:41.267 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.267 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:41.267 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.267 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.267 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.267 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 147119 2024-04-26T10:22:41.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.268 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.259416+0000", 2024-04-26T10:22:41.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.259416+0000", 2024-04-26T10:22:41.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.259415+0000", 2024-04-26T10:22:41.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.259419+0000", 2024-04-26T10:22:41.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2030000000000002e-06 2024-04-26T10:22:41.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.259435+0000", 2024-04-26T10:22:41.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5500999999999999e-05 2024-04-26T10:22:41.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.259439+0000", 2024-04-26T10:22:41.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6469999999999997e-06 2024-04-26T10:22:41.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.259482+0000", 2024-04-26T10:22:41.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2703000000000001e-05 2024-04-26T10:22:41.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.259564+0000", 2024-04-26T10:22:41.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1736000000000005e-05 2024-04-26T10:22:41.271 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.271 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.271 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.271 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:147122 5.e 5:7480432a:::benchmark_data_smithi052_19421_object17650:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:41.271 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:41.260099+0000", 2024-04-26T10:22:41.271 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0025919409999999999, 2024-04-26T10:22:41.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0026893329999999999, 2024-04-26T10:22:41.271 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.271 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:41.271 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.271 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.271 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.271 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 147122 2024-04-26T10:22:41.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.272 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.260099+0000", 2024-04-26T10:22:41.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.260099+0000", 2024-04-26T10:22:41.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.260098+0000", 2024-04-26T10:22:41.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.260103+0000", 2024-04-26T10:22:41.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.809e-06 2024-04-26T10:22:41.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.260112+0000", 2024-04-26T10:22:41.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7460000000000006e-06 2024-04-26T10:22:41.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.260116+0000", 2024-04-26T10:22:41.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6020000000000002e-06 2024-04-26T10:22:41.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.260142+0000", 2024-04-26T10:22:41.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6157e-05 2024-04-26T10:22:41.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.260227+0000", 2024-04-26T10:22:41.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4316999999999999e-05 2024-04-26T10:22:41.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.275 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.275 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.275 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:147120 5.f e51/37 5:f5d9ce96:::benchmark_data_smithi052_19421_object17648:head v 51'9296, mlcod=51'9292)", 2024-04-26T10:22:41.275 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:41.261471+0000", 2024-04-26T10:22:41.275 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.001219539, 2024-04-26T10:22:41.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001349631, 2024-04-26T10:22:41.275 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.275 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:41.275 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.261471+0000", 2024-04-26T10:22:41.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.261471+0000", 2024-04-26T10:22:41.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.261471+0000", 2024-04-26T10:22:41.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.261477+0000", 2024-04-26T10:22:41.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4779999999999996e-06 2024-04-26T10:22:41.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.261490+0000", 2024-04-26T10:22:41.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2472e-05 2024-04-26T10:22:41.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.261496+0000", 2024-04-26T10:22:41.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1380000000000004e-06 2024-04-26T10:22:41.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.261523+0000", 2024-04-26T10:22:41.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7708e-05 2024-04-26T10:22:41.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.261539+0000", 2024-04-26T10:22:41.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5353e-05 2024-04-26T10:22:41.278 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.278 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.278 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.279 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:147127 5.b 5:dd5d53f9:::benchmark_data_smithi052_19421_object17655:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:41.279 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:41.261851+0000", 2024-04-26T10:22:41.279 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00083984499999999998, 2024-04-26T10:22:41.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001000864, 2024-04-26T10:22:41.279 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.279 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:41.279 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.279 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.279 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.279 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 147127 2024-04-26T10:22:41.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.280 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.261851+0000", 2024-04-26T10:22:41.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.261851+0000", 2024-04-26T10:22:41.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.261850+0000", 2024-04-26T10:22:41.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.261856+0000", 2024-04-26T10:22:41.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.242e-06 2024-04-26T10:22:41.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.261868+0000", 2024-04-26T10:22:41.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2597e-05 2024-04-26T10:22:41.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.261876+0000", 2024-04-26T10:22:41.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1859999999999992e-06 2024-04-26T10:22:41.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.261906+0000", 2024-04-26T10:22:41.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9281999999999998e-05 2024-04-26T10:22:41.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.261998+0000", 2024-04-26T10:22:41.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2819999999999996e-05 2024-04-26T10:22:41.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:41.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:41.262096+0000", 2024-04-26T10:22:41.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8103999999999994e-05 2024-04-26T10:22:41.283 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.284 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.284 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.284 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.284 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:41.284 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 5 2024-04-26T10:22:41.284 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:41.285 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:41.329 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:41.327+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:41.416 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:41.416 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:41.417 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:41.429 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:41.430 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~53s 2024-04-26T10:22:41.430 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:41.427+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:41.532 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:41.528+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:41.553 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:41.553 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:41.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:41.553 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:41.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.554 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:41.554 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:41.554 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.020951160000003, 2024-04-26T10:22:41.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:41.554 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.554 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.554 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.554 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.554 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.554 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:41.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.555 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:41.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:41.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:41.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:41.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:41.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:41.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:41.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:41.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:41.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:41.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:41.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:41.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:41.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:41.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:41.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:41.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:41.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:41.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:41.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:41.558 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.559 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.559 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.559 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:41.559 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:41.559 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.018968932999996, 2024-04-26T10:22:41.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:41.559 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.559 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.559 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.559 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.559 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.559 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:41.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.560 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:41.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:41.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:41.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:41.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:41.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:41.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:41.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:41.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:41.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:41.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:41.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:41.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:41.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:41.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:41.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:41.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:41.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:41.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:41.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:41.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:41.563 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.563 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.563 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.563 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:41.563 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:41.564 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.018769548999998, 2024-04-26T10:22:41.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:41.564 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.564 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.564 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.564 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:41.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.564 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:41.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:41.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:41.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:41.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:41.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:41.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:41.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:41.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:41.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:41.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:41.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:41.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:41.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:41.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:41.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:41.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.567 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.567 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.567 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:41.567 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:41.567 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.568 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.568 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:41.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:41.568 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.568 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.568 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.568 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.568 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.568 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:41.568 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:41.568 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.018550929, 2024-04-26T10:22:41.568 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:41.568 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.569 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.569 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:41.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.569 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.569 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:41.569 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.569 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.569 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:41.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:41.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:41.570 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.570 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.570 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.570 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:41.570 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:41.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:41.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:41.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:41.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:41.571 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.571 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.571 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.571 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:41.571 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:41.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:41.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:41.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.572 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.572 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.572 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:41.572 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:41.572 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.572 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.572 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.572 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.573 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:41.573 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:41.573 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.016179491000003, 2024-04-26T10:22:41.573 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:41.573 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.573 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.573 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.573 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.573 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.573 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:41.573 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.573 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.573 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.573 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.573 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:41.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:41.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:41.574 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:41.574 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.574 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.574 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.574 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:41.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:41.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:41.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:41.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:41.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:41.575 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.575 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.575 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.575 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:41.575 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:41.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:41.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:41.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:41.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:41.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:41.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.576 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.576 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.576 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:41.576 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:41.576 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.577 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.577 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:41.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:41.577 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.577 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.577 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.577 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.577 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.577 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:41.577 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:41.577 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.016078868999998, 2024-04-26T10:22:41.577 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:41.577 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.577 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.577 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.578 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.578 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.578 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:41.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.578 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:41.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.578 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.578 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.578 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:41.578 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.578 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:41.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:41.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:41.579 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.579 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.579 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.579 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:41.579 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:41.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:41.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:41.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.580 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:41.580 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:41.580 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.580 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.580 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:41.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:41.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:41.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:41.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:41.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:41.581 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:41.581 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.581 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.581 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.581 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:41.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:41.582 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.582 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.582 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.582 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.582 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:41.582 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:41.582 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.015960307999997, 2024-04-26T10:22:41.582 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:41.582 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.582 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.582 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.582 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.582 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.583 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:41.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:41.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:41.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:41.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.584 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:41.584 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:41.584 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.584 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.584 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:41.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:41.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:41.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:41.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.585 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:41.585 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:41.585 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.585 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.585 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.586 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:41.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:41.586 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.586 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.586 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.586 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.586 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.586 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:41.586 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:41.586 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.015857910000001, 2024-04-26T10:22:41.586 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:41.586 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.587 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.587 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.587 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.587 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.587 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:41.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.587 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:41.587 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.587 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.587 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.587 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.587 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:41.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:41.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:41.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.588 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:41.588 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:41.588 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.588 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.588 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:41.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:41.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:41.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:41.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.589 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:41.589 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:41.589 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.589 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.589 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:41.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:41.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:41.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:41.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:41.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:41.590 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:41.590 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.590 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.590 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.590 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:41.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:41.591 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.591 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.591 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.591 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.591 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.591 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:41.591 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:41.591 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.014837352999997, 2024-04-26T10:22:41.591 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:41.591 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.591 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.591 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.592 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.592 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.592 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:41.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.592 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:41.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.592 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.592 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.592 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:41.592 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.592 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:41.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:41.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:41.593 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.593 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.593 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.593 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:41.593 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:41.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:41.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:41.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:41.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:41.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.594 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.594 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.594 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:41.594 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:41.594 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:41.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:41.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:41.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:41.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:41.595 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.595 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.595 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.595 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:41.595 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:41.595 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.596 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.596 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.596 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:41.596 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:41.596 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.013687077999997, 2024-04-26T10:22:41.596 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:41.596 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.596 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.596 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.596 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.596 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.596 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:41.596 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.596 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.596 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:41.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:41.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.597 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.597 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.597 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:41.597 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:41.597 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:41.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:41.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:41.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:41.598 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.598 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.598 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.598 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:41.598 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:41.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:41.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:41.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:41.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:41.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.599 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.599 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:41.599 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:41.599 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:41.599 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:41.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:41.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.600 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.600 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.600 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:41.600 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:41.600 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.600 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.600 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.601 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:41.601 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:41.601 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.516987835999998, 2024-04-26T10:22:41.601 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:22:41.601 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.601 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.601 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.601 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.601 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.601 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:22:41.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.601 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.601 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.601 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:41.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:41.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.602 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.602 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:22:41.602 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.602 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:22:41.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:22:41.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:22:41.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:22:41.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.603 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.603 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:22:41.603 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:22:41.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.603 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:22:41.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:22:41.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:22:41.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:22:41.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.604 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:41.604 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:22:41.604 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:22:41.604 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.604 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:41.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:22:41.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:22:41.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:41.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:22:41.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:22:41.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.605 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.605 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:22:41.605 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:22:41.605 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.605 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.606 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.606 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:22:41.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:22:41.606 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.606 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.606 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.606 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.606 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.606 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:41.606 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:41.606 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 17.516764240000001, 2024-04-26T10:22:41.606 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:22:41.606 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.606 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.607 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.607 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.607 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.607 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:22:41.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.607 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:41.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.607 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.607 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.607 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.607 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:41.607 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:22:41.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.608 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:22:41.608 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:22:41.608 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.608 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.608 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:22:41.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:22:41.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:22:41.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:22:41.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.609 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.609 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:22:41.609 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:22:41.609 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.609 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:22:41.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:22:41.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.610 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:41.610 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:22:41.610 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:22:41.610 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.610 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:41.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:22:41.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:22:41.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:41.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:22:41.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:22:41.611 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.611 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.611 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.611 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:22:41.611 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:22:41.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.612 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.612 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:22:41.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:22:41.612 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.612 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.612 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.612 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.612 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:41.612 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:41.612 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 10.48591792, 2024-04-26T10:22:41.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:22:41.613 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.613 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.613 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.613 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.613 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.613 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:22:41.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.613 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:41.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:41.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:22:41.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:22:41.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:22:41.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:22:41.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:22:41.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:22:41.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:22:41.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:22:41.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:22:41.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:22:41.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:22:41.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:41.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:22:41.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:22:41.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:41.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:22:41.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:22:41.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:41.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:22:41.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:22:41.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:22:41.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:22:41.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:22:41.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:22:41.618 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.618 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.618 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.618 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:41.618 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:41.618 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 10.483906816999999, 2024-04-26T10:22:41.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:22:41.618 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.618 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.618 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.619 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.619 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:22:41.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.619 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:41.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:41.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:41.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:22:41.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:22:41.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:22:41.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:22:41.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:22:41.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:22:41.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:22:41.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:22:41.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:22:41.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:22:41.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:41.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:22:41.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:22:41.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:41.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:22:41.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:22:41.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:41.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:22:41.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:22:41.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:22:41.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:22:41.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:22:41.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:22:41.624 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.624 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.624 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.624 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:41.624 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:41.624 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 10.473028712, 2024-04-26T10:22:41.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:22:41.624 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.624 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.624 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.624 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.624 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.625 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:22:41.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.625 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:41.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.625 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.625 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:41.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.625 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:22:41.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:41.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:22:41.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:22:41.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:22:41.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:22:41.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:22:41.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:22:41.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:22:41.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:22:41.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:22:41.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:22:41.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:41.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:22:41.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:22:41.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:41.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:22:41.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:22:41.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:41.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:22:41.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:22:41.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:22:41.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:22:41.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.629 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.629 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:22:41.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:22:41.629 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.630 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.630 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.630 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:41.630 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:41.630 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 10.470347493, 2024-04-26T10:22:41.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:22:41.630 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.630 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.630 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.630 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.630 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.631 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:22:41.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.631 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:41.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:41.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:22:41.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:41.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:22:41.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:22:41.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:22:41.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:22:41.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:22:41.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:22:41.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:22:41.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:22:41.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:22:41.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:22:41.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:41.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:22:41.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:22:41.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:41.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:22:41.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:22:41.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:41.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:22:41.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:22:41.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.634 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.634 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.634 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:22:41.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:22:41.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:22:41.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:22:41.635 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.635 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.635 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.635 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:41.635 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:41.635 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 10.469980418, 2024-04-26T10:22:41.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:22:41.635 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.636 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.636 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.636 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.636 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.636 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:22:41.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.636 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:41.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:41.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:22:41.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:22:41.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:22:41.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:22:41.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:22:41.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:22:41.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:22:41.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:22:41.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:22:41.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:22:41.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:22:41.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:41.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:22:41.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:22:41.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:22:41.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:22:41.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:22:41.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:22:41.640 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.640 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.640 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.640 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:41.640 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:41.640 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 10.469916166000001, 2024-04-26T10:22:41.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:22:41.640 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.640 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.640 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.641 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.641 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:22:41.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.641 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:41.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:41.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:22:41.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:22:41.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:22:41.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:22:41.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:22:41.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:22:41.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:22:41.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:22:41.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:22:41.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:22:41.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:22:41.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:41.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:22:41.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:22:41.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:22:41.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:22:41.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:22:41.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:22:41.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.645 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.645 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.645 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:41.645 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:41.645 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 10.465517493, 2024-04-26T10:22:41.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:22:41.645 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.645 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.645 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.645 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.645 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.646 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:22:41.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.646 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:41.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:41.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:22:41.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:22:41.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:22:41.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:22:41.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:22:41.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:22:41.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:22:41.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:22:41.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:22:41.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.648 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.648 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:22:41.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:22:41.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:41.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:22:41.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:22:41.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:22:41.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:22:41.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:22:41.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:22:41.649 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.650 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.650 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.650 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:41.650 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:41.650 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 10.463759509999999, 2024-04-26T10:22:41.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:22:41.650 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:41.650 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:41.650 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:41.650 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:41.650 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.651 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:22:41.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.651 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:41.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:41.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:41.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:41.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:41.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:41.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:41.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:22:41.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:41.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:22:41.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:22:41.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:41.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:22:41.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:22:41.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:22:41.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:22:41.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:41.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:22:41.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:22:41.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:41.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:22:41.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:22:41.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:41.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:22:41.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:22:41.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:41.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:22:41.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:22:41.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:41.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:22:41.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:22:41.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:41.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:22:41.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:22:41.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:41.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:41.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:41.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:22:41.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:22:41.655 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.655 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.655 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.656 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:41.656 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:41.656 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:41.657 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:41.658 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:41.655+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:41.758 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:41.756+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:41.789 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:22:41.793 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:41.793 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:41.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.793 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:148391 5.9 5:93a75a6d:::benchmark_data_smithi052_19421_object18919:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:41.793 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:41.786219+0000", 2024-04-26T10:22:41.793 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0045519779999999999, 2024-04-26T10:22:41.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045791920000000002, 2024-04-26T10:22:41.793 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.793 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:41.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.793 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.794 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 148391 2024-04-26T10:22:41.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.794 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786219+0000", 2024-04-26T10:22:41.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786219+0000", 2024-04-26T10:22:41.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786219+0000", 2024-04-26T10:22:41.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786221+0000", 2024-04-26T10:22:41.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6070000000000002e-06 2024-04-26T10:22:41.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786228+0000", 2024-04-26T10:22:41.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3239999999999999e-06 2024-04-26T10:22:41.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786232+0000", 2024-04-26T10:22:41.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7140000000000001e-06 2024-04-26T10:22:41.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786271+0000", 2024-04-26T10:22:41.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8523999999999999e-05 2024-04-26T10:22:41.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786396+0000", 2024-04-26T10:22:41.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012459600000000001 2024-04-26T10:22:41.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:41.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786496+0000", 2024-04-26T10:22:41.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100478 2024-04-26T10:22:41.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:41.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.789083+0000", 2024-04-26T10:22:41.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025873789999999999 2024-04-26T10:22:41.797 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.797 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.798 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.798 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:148392 5.6 5:66024b5a:::benchmark_data_smithi052_19421_object18920:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:41.798 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:41.786241+0000", 2024-04-26T10:22:41.798 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00453047, 2024-04-26T10:22:41.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046640190000000002, 2024-04-26T10:22:41.798 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.798 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:41.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.798 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 148392 2024-04-26T10:22:41.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.799 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786241+0000", 2024-04-26T10:22:41.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786241+0000", 2024-04-26T10:22:41.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786240+0000", 2024-04-26T10:22:41.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786243+0000", 2024-04-26T10:22:41.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.813e-06 2024-04-26T10:22:41.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786249+0000", 2024-04-26T10:22:41.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.066e-06 2024-04-26T10:22:41.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786267+0000", 2024-04-26T10:22:41.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7686999999999999e-05 2024-04-26T10:22:41.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.788025+0000", 2024-04-26T10:22:41.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001757771 2024-04-26T10:22:41.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.788103+0000", 2024-04-26T10:22:41.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8883999999999999e-05 2024-04-26T10:22:41.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.801 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.801 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.802 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:148393 5.3 5:c7776d7d:::benchmark_data_smithi052_19421_object18921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:41.802 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:41.786272+0000", 2024-04-26T10:22:41.802 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0044989069999999999, 2024-04-26T10:22:41.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047043370000000003, 2024-04-26T10:22:41.802 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.802 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:41.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.802 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.802 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 148393 2024-04-26T10:22:41.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.803 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786272+0000", 2024-04-26T10:22:41.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786272+0000", 2024-04-26T10:22:41.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786272+0000", 2024-04-26T10:22:41.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786275+0000", 2024-04-26T10:22:41.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2289999999999999e-06 2024-04-26T10:22:41.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786281+0000", 2024-04-26T10:22:41.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3260000000000001e-06 2024-04-26T10:22:41.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786297+0000", 2024-04-26T10:22:41.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6211000000000001e-05 2024-04-26T10:22:41.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.788190+0000", 2024-04-26T10:22:41.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001892711 2024-04-26T10:22:41.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.788300+0000", 2024-04-26T10:22:41.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010969299999999999 2024-04-26T10:22:41.805 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.805 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.805 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.806 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:148395 5.1 5:870ff368:::benchmark_data_smithi052_19421_object18923:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:41.806 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:41.786608+0000", 2024-04-26T10:22:41.806 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0041633349999999998, 2024-04-26T10:22:41.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044322149999999998, 2024-04-26T10:22:41.806 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.806 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:41.806 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.806 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.806 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.806 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 148395 2024-04-26T10:22:41.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.806 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786608+0000", 2024-04-26T10:22:41.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786608+0000", 2024-04-26T10:22:41.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.807 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.807 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786607+0000", 2024-04-26T10:22:41.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786617+0000", 2024-04-26T10:22:41.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6180000000000001e-06 2024-04-26T10:22:41.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786626+0000", 2024-04-26T10:22:41.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2529999999999993e-06 2024-04-26T10:22:41.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786632+0000", 2024-04-26T10:22:41.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:22:41.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.787796+0000", 2024-04-26T10:22:41.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011638600000000001 2024-04-26T10:22:41.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.787876+0000", 2024-04-26T10:22:41.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0099999999999995e-05 2024-04-26T10:22:41.809 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.809 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.809 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.810 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:148396 5.6 5:627ad9d0:::benchmark_data_smithi052_19421_object18924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:41.810 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:41.786638+0000", 2024-04-26T10:22:41.810 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0041330630000000002, 2024-04-26T10:22:41.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044694690000000002, 2024-04-26T10:22:41.810 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.810 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:41.810 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.810 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.810 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.810 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 148396 2024-04-26T10:22:41.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.810 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786638+0000", 2024-04-26T10:22:41.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786638+0000", 2024-04-26T10:22:41.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786638+0000", 2024-04-26T10:22:41.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786640+0000", 2024-04-26T10:22:41.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5179999999999999e-06 2024-04-26T10:22:41.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786645+0000", 2024-04-26T10:22:41.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0459999999999996e-06 2024-04-26T10:22:41.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.786649+0000", 2024-04-26T10:22:41.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1119999999999998e-06 2024-04-26T10:22:41.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.789338+0000", 2024-04-26T10:22:41.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026882550000000001 2024-04-26T10:22:41.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.789460+0000", 2024-04-26T10:22:41.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012235999999999999 2024-04-26T10:22:41.813 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.813 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.814 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.814 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:148399 5.9 5:9839e687:::benchmark_data_smithi052_19421_object18927:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:41.814 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:41.787418+0000", 2024-04-26T10:22:41.814 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0033536009999999999, 2024-04-26T10:22:41.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037557519999999998, 2024-04-26T10:22:41.814 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.814 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:41.814 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.814 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.814 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.814 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 148399 2024-04-26T10:22:41.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.815 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.787418+0000", 2024-04-26T10:22:41.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.787418+0000", 2024-04-26T10:22:41.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.787417+0000", 2024-04-26T10:22:41.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.787421+0000", 2024-04-26T10:22:41.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3640000000000001e-06 2024-04-26T10:22:41.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.787429+0000", 2024-04-26T10:22:41.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2430000000000005e-06 2024-04-26T10:22:41.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.787435+0000", 2024-04-26T10:22:41.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9549999999999997e-06 2024-04-26T10:22:41.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.789102+0000", 2024-04-26T10:22:41.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016667330000000001 2024-04-26T10:22:41.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.789178+0000", 2024-04-26T10:22:41.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5426999999999995e-05 2024-04-26T10:22:41.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:41.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.789245+0000", 2024-04-26T10:22:41.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7855999999999995e-05 2024-04-26T10:22:41.818 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.818 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.818 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.818 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:148400 5.9 5.e907e909 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:41.818 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:41.787440+0000", 2024-04-26T10:22:41.818 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0033309720000000002, 2024-04-26T10:22:41.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037998699999999999, 2024-04-26T10:22:41.818 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.818 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:41.818 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.819 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.819 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 148400 2024-04-26T10:22:41.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.819 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.787440+0000", 2024-04-26T10:22:41.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.787440+0000", 2024-04-26T10:22:41.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.787440+0000", 2024-04-26T10:22:41.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.787442+0000", 2024-04-26T10:22:41.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.317e-06 2024-04-26T10:22:41.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.820 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.820 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.787447+0000", 2024-04-26T10:22:41.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8879999999999996e-06 2024-04-26T10:22:41.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.787451+0000", 2024-04-26T10:22:41.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2830000000000003e-06 2024-04-26T10:22:41.821 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.821 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.821 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.821 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:148401 5.3 5:c2c54b5b:::benchmark_data_smithi052_19421_object18929:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:41.821 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:41.788231+0000", 2024-04-26T10:22:41.822 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002540086, 2024-04-26T10:22:41.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030629559999999999, 2024-04-26T10:22:41.822 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.822 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:41.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.822 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.822 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 148401 2024-04-26T10:22:41.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.822 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.788231+0000", 2024-04-26T10:22:41.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.788231+0000", 2024-04-26T10:22:41.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.788230+0000", 2024-04-26T10:22:41.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.788235+0000", 2024-04-26T10:22:41.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.386e-06 2024-04-26T10:22:41.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.788243+0000", 2024-04-26T10:22:41.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9150000000000002e-06 2024-04-26T10:22:41.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.788250+0000", 2024-04-26T10:22:41.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1349999999999997e-06 2024-04-26T10:22:41.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.789855+0000", 2024-04-26T10:22:41.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016053420000000001 2024-04-26T10:22:41.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.789924+0000", 2024-04-26T10:22:41.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8731000000000003e-05 2024-04-26T10:22:41.825 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.825 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.825 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.825 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:148404 5.c 5:382a70e1:::benchmark_data_smithi052_19421_object18932:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:41.825 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:41.790055+0000", 2024-04-26T10:22:41.826 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00071619700000000001, 2024-04-26T10:22:41.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001304134, 2024-04-26T10:22:41.826 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.826 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:41.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.826 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.826 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 148404 2024-04-26T10:22:41.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.826 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790055+0000", 2024-04-26T10:22:41.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790055+0000", 2024-04-26T10:22:41.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.827 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.827 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790054+0000", 2024-04-26T10:22:41.827 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.827 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790060+0000", 2024-04-26T10:22:41.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9349999999999999e-06 2024-04-26T10:22:41.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790071+0000", 2024-04-26T10:22:41.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1005999999999999e-05 2024-04-26T10:22:41.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.828 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.828 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.828 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790080+0000", 2024-04-26T10:22:41.828 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6419999999999996e-06 2024-04-26T10:22:41.828 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790875+0000", 2024-04-26T10:22:41.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00079552500000000005 2024-04-26T10:22:41.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.829 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.829 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790986+0000", 2024-04-26T10:22:41.829 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011112600000000001 2024-04-26T10:22:41.829 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.829 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.829 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.829 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.829 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.830 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:148403 5.b e51/37 5:d9687557:::benchmark_data_smithi052_19421_object18931:head v 51'9241, mlcod=51'9239)", 2024-04-26T10:22:41.830 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:41.790254+0000", 2024-04-26T10:22:41.830 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00051716200000000005, 2024-04-26T10:22:41.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001166383, 2024-04-26T10:22:41.830 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.830 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:41.830 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790254+0000", 2024-04-26T10:22:41.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790254+0000", 2024-04-26T10:22:41.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790253+0000", 2024-04-26T10:22:41.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790262+0000", 2024-04-26T10:22:41.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3850000000000002e-06 2024-04-26T10:22:41.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790268+0000", 2024-04-26T10:22:41.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9200000000000001e-06 2024-04-26T10:22:41.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790272+0000", 2024-04-26T10:22:41.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2459999999999997e-06 2024-04-26T10:22:41.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.791090+0000", 2024-04-26T10:22:41.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00081843300000000003 2024-04-26T10:22:41.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.791108+0000", 2024-04-26T10:22:41.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7847e-05 2024-04-26T10:22:41.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.833 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.833 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.833 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:148405 5.3 5:c2b6ff01:::benchmark_data_smithi052_19421_object18933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:41.833 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:41.790394+0000", 2024-04-26T10:22:41.833 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000376824, 2024-04-26T10:22:41.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010719950000000001, 2024-04-26T10:22:41.833 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.833 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:41.833 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.834 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 148405 2024-04-26T10:22:41.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.834 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790394+0000", 2024-04-26T10:22:41.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790394+0000", 2024-04-26T10:22:41.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790394+0000", 2024-04-26T10:22:41.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790397+0000", 2024-04-26T10:22:41.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6339999999999999e-06 2024-04-26T10:22:41.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790403+0000", 2024-04-26T10:22:41.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8019999999999997e-06 2024-04-26T10:22:41.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790407+0000", 2024-04-26T10:22:41.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9360000000000001e-06 2024-04-26T10:22:41.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.791243+0000", 2024-04-26T10:22:41.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00083550499999999995 2024-04-26T10:22:41.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.791351+0000", 2024-04-26T10:22:41.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108344 2024-04-26T10:22:41.837 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.837 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.837 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.837 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:148406 5.1 5:89e81ebc:::benchmark_data_smithi052_19421_object18934:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:41.837 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:41.790440+0000", 2024-04-26T10:22:41.837 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00033135800000000002, 2024-04-26T10:22:41.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010845, 2024-04-26T10:22:41.837 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.837 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:41.837 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.838 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 148406 2024-04-26T10:22:41.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.838 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790440+0000", 2024-04-26T10:22:41.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790440+0000", 2024-04-26T10:22:41.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790439+0000", 2024-04-26T10:22:41.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790442+0000", 2024-04-26T10:22:41.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9919999999999999e-06 2024-04-26T10:22:41.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790449+0000", 2024-04-26T10:22:41.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6189999999999996e-06 2024-04-26T10:22:41.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790452+0000", 2024-04-26T10:22:41.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.01e-06 2024-04-26T10:22:41.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790640+0000", 2024-04-26T10:22:41.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018844700000000001 2024-04-26T10:22:41.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790716+0000", 2024-04-26T10:22:41.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6040999999999999e-05 2024-04-26T10:22:41.841 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.841 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.841 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.841 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:148407 5.7 5:e893fd13:::benchmark_data_smithi052_19421_object18935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:41.841 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:41.790455+0000", 2024-04-26T10:22:41.841 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00031581799999999999, 2024-04-26T10:22:41.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011088059999999999, 2024-04-26T10:22:41.841 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.841 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:41.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.842 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.842 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 148407 2024-04-26T10:22:41.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.842 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790455+0000", 2024-04-26T10:22:41.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790455+0000", 2024-04-26T10:22:41.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790455+0000", 2024-04-26T10:22:41.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790457+0000", 2024-04-26T10:22:41.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.855e-06 2024-04-26T10:22:41.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790460+0000", 2024-04-26T10:22:41.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0599999999999999e-06 2024-04-26T10:22:41.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790463+0000", 2024-04-26T10:22:41.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8739999999999999e-06 2024-04-26T10:22:41.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790501+0000", 2024-04-26T10:22:41.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8229999999999998e-05 2024-04-26T10:22:41.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790575+0000", 2024-04-26T10:22:41.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3878e-05 2024-04-26T10:22:41.845 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.845 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.845 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.845 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:148399 5.9 e51/37)", 2024-04-26T10:22:41.845 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:41.790889+0000", 2024-04-26T10:22:41.845 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9998822, 2024-04-26T10:22:41.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00070589600000000002, 2024-04-26T10:22:41.845 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.845 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:41.846 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790889+0000", 2024-04-26T10:22:41.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790889+0000", 2024-04-26T10:22:41.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790888+0000", 2024-04-26T10:22:41.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790893+0000", 2024-04-26T10:22:41.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.994e-06 2024-04-26T10:22:41.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790902+0000", 2024-04-26T10:22:41.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7590000000000003e-06 2024-04-26T10:22:41.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.790908+0000", 2024-04-26T10:22:41.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0070000000000003e-06 2024-04-26T10:22:41.848 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.848 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.848 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.848 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:148409 5.7 5.acfd37d7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:41.848 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:41.791258+0000", 2024-04-26T10:22:41.848 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9995127, 2024-04-26T10:22:41.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036016500000000002, 2024-04-26T10:22:41.848 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.848 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:41.849 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.849 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.849 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.849 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 148409 2024-04-26T10:22:41.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.849 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.791258+0000", 2024-04-26T10:22:41.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.791258+0000", 2024-04-26T10:22:41.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.791257+0000", 2024-04-26T10:22:41.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:41.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.791262+0000", 2024-04-26T10:22:41.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7929999999999997e-06 2024-04-26T10:22:41.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.791271+0000", 2024-04-26T10:22:41.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0189999999999995e-06 2024-04-26T10:22:41.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.791278+0000", 2024-04-26T10:22:41.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3749999999999999e-06 2024-04-26T10:22:41.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.853 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.853 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.853 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:148410 5.6 5:655c4e28:::benchmark_data_smithi052_19421_object18938:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-26T10:22:41.853 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:41.791306+0000", 2024-04-26T10:22:41.853 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.999465, 2024-04-26T10:22:41.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034404200000000002, 2024-04-26T10:22:41.854 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:41.854 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:41.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:41.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:41.854 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:41.854 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 148410 2024-04-26T10:22:41.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.854 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:41.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:41.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.791306+0000", 2024-04-26T10:22:41.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:41.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.791306+0000", 2024-04-26T10:22:41.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:41.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:41.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.791306+0000", 2024-04-26T10:22:41.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:41.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:41.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.791309+0000", 2024-04-26T10:22:41.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.241e-06 2024-04-26T10:22:41.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:41.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.791316+0000", 2024-04-26T10:22:41.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9519999999999997e-06 2024-04-26T10:22:41.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:41.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.791321+0000", 2024-04-26T10:22:41.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1499999999999998e-06 2024-04-26T10:22:41.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:41.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.791366+0000", 2024-04-26T10:22:41.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5130999999999999e-05 2024-04-26T10:22:41.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:41.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:41.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:41.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:41.791478+0000", 2024-04-26T10:22:41.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011226 2024-04-26T10:22:41.857 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.857 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:41.857 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.857 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:41.857 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:41.857 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 16 2024-04-26T10:22:41.858 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:41.859 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:41.859 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:41.859+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:41.944 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:41.959 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:41.959+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:41.964 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:41.965 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:41.965 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:41.965 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:41.968 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:41.969 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:41.991 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:41.991 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:42.005 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:42.060 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:42.056+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:42.103 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:22:42.137 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:42.138 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:42.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:42.161 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:42.156+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:42.262 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:42.256+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:42.274 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:42.274 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:42.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:42.362 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:42.363+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:42.405 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:42.405 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:42.418 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:42.463 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:42.460+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:42.545 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:42.545 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:42.557 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:42.606 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:42.604+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:42.664 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:42.660+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:42.695 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:42.695 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:42.707 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:42.765 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:42.763+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:42.847 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:42.847 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:42.859 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:42.903 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:42.900+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:42.966 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:42.967+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:42.986 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:42.986 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:43.000 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:43.067 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:43.064+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:43.099 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T10:22:43.132 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:43.132 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:43.144 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:43.169 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:43.167+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:43.269 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:43.267+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:43.273 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:43.273 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:43.285 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:43.370 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:43.367+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:43.415 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:43.415 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:43.427 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:43.474 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:43.472+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:43.558 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:43.558 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:43.571 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:43.572 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:43.568+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:43.673 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:43.668+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:43.698 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:43.698 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:43.711 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:43.774 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:43.771+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:43.875 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:43.875+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:43.883 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:43.883 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:43.896 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:43.969 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:22:43.976 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:43.975+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:44.020 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:44.020 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:44.033 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:44.077 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:44.072+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:44.129 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:44.157 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:44.158 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:44.158 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:44.158 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:44.159 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:44.159 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:44.159 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:44.159 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:44.159 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:44.160 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:44.161 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:44.172 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:44.178 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:44.172+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:44.279 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:44.276+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:44.300 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:44.300 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:44.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:44.300 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:44.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.300 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:44.300 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:44.300 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.768214233999998, 2024-04-26T10:22:44.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:44.301 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.301 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.301 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:44.301 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:44.301 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.301 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:44.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.301 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:44.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:44.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:44.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:44.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:44.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:44.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:44.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:44.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:44.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:44.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:44.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:44.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:44.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:44.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:44.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:44.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:44.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:44.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:44.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:44.305 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.305 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.305 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.305 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:44.305 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:44.305 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.766232006999999, 2024-04-26T10:22:44.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:44.306 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.306 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.306 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:44.306 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:44.306 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.306 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:44.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.306 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:44.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:44.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:44.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:44.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:44.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:44.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:44.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:44.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:44.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:44.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:44.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:44.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:44.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:44.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:44.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:44.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:44.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:44.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:44.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:44.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:44.310 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.310 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.310 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.310 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:44.310 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:44.311 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.766032623000001, 2024-04-26T10:22:44.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:44.311 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.311 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.311 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:44.311 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:44.311 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.311 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:44.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.311 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:44.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:44.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:44.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:44.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:44.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:44.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:44.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:44.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:44.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:44.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:44.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:44.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:44.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:44.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:44.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:44.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:44.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:44.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:44.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:44.315 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.315 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.315 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.315 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:44.316 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:44.316 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.765814003000003, 2024-04-26T10:22:44.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:44.316 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.316 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.316 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:44.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:44.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:44.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:44.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:44.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:44.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:44.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:44.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:44.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:44.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:44.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:44.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:44.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:44.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:44.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:44.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:44.319 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.319 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.319 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.320 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:44.320 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:44.320 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.763442564999998, 2024-04-26T10:22:44.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:44.320 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.320 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.320 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:44.320 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:44.320 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.320 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:44.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.320 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:44.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:44.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:44.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:44.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:44.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:44.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:44.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:44.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:44.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:44.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:44.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:44.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:44.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:44.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:44.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:44.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:44.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:44.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:44.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:44.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:44.324 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.324 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.324 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.324 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:44.325 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:44.325 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.763341943, 2024-04-26T10:22:44.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:44.325 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.325 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.325 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:44.325 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:44.325 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.325 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:44.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.325 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:44.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:44.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:44.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:44.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:44.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:44.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:44.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:44.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:44.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:44.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:44.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:44.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:44.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:44.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:44.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:44.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:44.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:44.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:44.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:44.329 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.329 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.329 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.330 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:44.330 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:44.330 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.763223382, 2024-04-26T10:22:44.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:44.330 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.330 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.330 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:44.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:44.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:44.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:44.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:44.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:44.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:44.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:44.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:44.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:44.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:44.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:44.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:44.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:44.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:44.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:44.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:44.334 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.334 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.334 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.335 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:44.335 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:44.335 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.763120983999997, 2024-04-26T10:22:44.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:44.335 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.335 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:44.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:44.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.335 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:44.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.335 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:44.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:44.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:44.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:44.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:44.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:44.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:44.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:44.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:44.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:44.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:44.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:44.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:44.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:44.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:44.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:44.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:44.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:44.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:44.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:44.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:44.339 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.340 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.340 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.340 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:44.340 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:44.340 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.762100427, 2024-04-26T10:22:44.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:44.340 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.340 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.340 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:44.340 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:44.340 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.340 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:44.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.341 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:44.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:44.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:44.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:44.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:44.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:44.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:44.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:44.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:44.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:44.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:44.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:44.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:44.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:44.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:44.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:44.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:44.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:44.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:44.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:44.344 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.344 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.344 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.345 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:44.345 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:44.345 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.760950151999999, 2024-04-26T10:22:44.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:44.345 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.345 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.345 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:44.345 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:44.345 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.345 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:44.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.345 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:44.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:44.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:44.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:44.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:44.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:44.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:44.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:44.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:44.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:44.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:44.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:44.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:44.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:44.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:44.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:44.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:44.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:44.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:44.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:44.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:44.349 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.349 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.350 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.350 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:44.350 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:44.350 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 20.264250910000001, 2024-04-26T10:22:44.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:22:44.350 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.350 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.350 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:44.350 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:44.350 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.350 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:22:44.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.350 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:44.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:44.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:22:44.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:22:44.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:22:44.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:22:44.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:22:44.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:22:44.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:22:44.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:22:44.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:22:44.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:22:44.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:22:44.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:44.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:22:44.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:22:44.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:44.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:22:44.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:22:44.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:44.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:22:44.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:22:44.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:22:44.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:22:44.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:22:44.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:22:44.354 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.355 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.355 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.355 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:44.355 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:44.355 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 20.264027314, 2024-04-26T10:22:44.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:22:44.355 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.355 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:44.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:44.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.355 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:22:44.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.355 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:44.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:44.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:22:44.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:22:44.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:22:44.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:22:44.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:22:44.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:22:44.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:22:44.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:22:44.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:22:44.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:22:44.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:22:44.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:44.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:22:44.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:22:44.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:44.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:22:44.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:22:44.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:44.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:22:44.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:22:44.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:22:44.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:22:44.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:22:44.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:22:44.360 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.360 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.360 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.360 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:44.360 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:44.360 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.233180994, 2024-04-26T10:22:44.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:22:44.361 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.361 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:44.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:44.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.361 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:22:44.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.361 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:44.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:44.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:22:44.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:22:44.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:22:44.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:22:44.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:22:44.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:22:44.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:22:44.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:22:44.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:22:44.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:22:44.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:22:44.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:44.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:22:44.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:22:44.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:44.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:22:44.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:22:44.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:44.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:22:44.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:22:44.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:22:44.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:22:44.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:22:44.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:22:44.366 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.366 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.366 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.366 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:44.367 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:44.367 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.231169891, 2024-04-26T10:22:44.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:22:44.367 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.367 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.367 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:44.367 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:44.367 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.367 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:22:44.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.367 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:44.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:44.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:44.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:22:44.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:22:44.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:22:44.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:22:44.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:22:44.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:22:44.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:22:44.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:22:44.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:22:44.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:22:44.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:44.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:22:44.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:22:44.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:44.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:22:44.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:22:44.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:44.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:22:44.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:22:44.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:22:44.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:22:44.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:22:44.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:22:44.372 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.372 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.372 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.372 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:44.372 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:44.372 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.220291786000001, 2024-04-26T10:22:44.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:22:44.373 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.373 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.373 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:44.373 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:44.373 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.373 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:22:44.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.373 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:44.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:44.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:22:44.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:44.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:22:44.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:22:44.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:22:44.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:22:44.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:22:44.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:22:44.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:22:44.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:22:44.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:22:44.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:22:44.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:44.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:22:44.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:22:44.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:44.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:22:44.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:22:44.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:44.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:22:44.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:22:44.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.377 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.377 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:22:44.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:22:44.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.377 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:22:44.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:22:44.378 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.378 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.378 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.378 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:44.378 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:44.378 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.217610566999999, 2024-04-26T10:22:44.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:22:44.378 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.379 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.379 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:44.379 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:44.379 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.379 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:22:44.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.379 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:44.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:44.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:22:44.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:44.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:22:44.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:22:44.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:22:44.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:22:44.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:22:44.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:22:44.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:22:44.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:22:44.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:22:44.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:22:44.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:44.382 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:22:44.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:22:44.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.382 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:44.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:22:44.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:22:44.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:44.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:22:44.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:22:44.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:22:44.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:22:44.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:22:44.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:22:44.384 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.384 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.384 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.384 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:44.384 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:44.384 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.217243492, 2024-04-26T10:22:44.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:22:44.384 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.384 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.384 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:44.384 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:44.385 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.385 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:22:44.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.385 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:44.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:44.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:22:44.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:22:44.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:22:44.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:22:44.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:22:44.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:22:44.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:22:44.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:22:44.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:22:44.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:22:44.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:22:44.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:44.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:22:44.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:22:44.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:22:44.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:22:44.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:22:44.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:22:44.389 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.389 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.389 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.389 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:44.389 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:44.389 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.21717924, 2024-04-26T10:22:44.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:22:44.389 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.389 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.389 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:44.389 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:44.390 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.390 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:22:44.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.390 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:44.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:44.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:22:44.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:22:44.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:22:44.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:22:44.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:22:44.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:22:44.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:22:44.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:22:44.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:22:44.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:22:44.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:22:44.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:44.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:22:44.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:22:44.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:22:44.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:22:44.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:22:44.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:22:44.394 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.394 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.394 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.394 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:44.394 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:44.394 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.212780566999999, 2024-04-26T10:22:44.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:22:44.394 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.394 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.394 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:44.394 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:44.394 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.395 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:22:44.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.395 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:44.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:44.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:22:44.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:22:44.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:22:44.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:22:44.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:22:44.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:22:44.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:22:44.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:22:44.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:22:44.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:22:44.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:22:44.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:44.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:22:44.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:22:44.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:22:44.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:22:44.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:22:44.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:22:44.399 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.399 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.399 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.399 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:44.399 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:44.399 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 13.211022584, 2024-04-26T10:22:44.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:22:44.399 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:44.399 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.399 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:44.399 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:44.400 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.400 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:22:44.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.400 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:44.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:44.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:44.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:44.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:44.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:44.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:44.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:22:44.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:44.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:22:44.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:22:44.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:44.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:22:44.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:22:44.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:22:44.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:22:44.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:44.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:22:44.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:22:44.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:44.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:22:44.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:22:44.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:44.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:22:44.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:22:44.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:44.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:22:44.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:22:44.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:44.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:22:44.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:22:44.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:44.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:22:44.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:22:44.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:44.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:44.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:44.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:22:44.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:22:44.404 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.404 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.404 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.404 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:44.404 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:44.405 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:44.406 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:44.403+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:44.406 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:44.507 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:44.507+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:44.537 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:154980 5.b e52/37 5:dffe82d6:::benchmark_data_smithi052_19421_object25508:head v 52'9667, mlcod=52'9664)", 2024-04-26T10:22:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:44.532726+0000", 2024-04-26T10:22:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002327511, 2024-04-26T10:22:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023608119999999999, 2024-04-26T10:22:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.532726+0000", 2024-04-26T10:22:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.532726+0000", 2024-04-26T10:22:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.532726+0000", 2024-04-26T10:22:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.532730+0000", 2024-04-26T10:22:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5619999999999997e-06 2024-04-26T10:22:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.532739+0000", 2024-04-26T10:22:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7199999999999995e-06 2024-04-26T10:22:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.532743+0000", 2024-04-26T10:22:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8149999999999999e-06 2024-04-26T10:22:44.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.533119+0000", 2024-04-26T10:22:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000376163 2024-04-26T10:22:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.533133+0000", 2024-04-26T10:22:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4021e-05 2024-04-26T10:22:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:154977 5.0 e52/37 5:0d24ff24:::benchmark_data_smithi052_19421_object25505:head v 52'9630, mlcod=52'9627)", 2024-04-26T10:22:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:44.533142+0000", 2024-04-26T10:22:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0019111480000000001, 2024-04-26T10:22:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020098120000000001, 2024-04-26T10:22:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.533142+0000", 2024-04-26T10:22:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.533142+0000", 2024-04-26T10:22:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.533142+0000", 2024-04-26T10:22:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.533146+0000", 2024-04-26T10:22:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9979999999999997e-06 2024-04-26T10:22:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.533151+0000", 2024-04-26T10:22:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5729999999999998e-06 2024-04-26T10:22:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.533155+0000", 2024-04-26T10:22:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.72e-06 2024-04-26T10:22:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.533192+0000", 2024-04-26T10:22:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7166999999999998e-05 2024-04-26T10:22:44.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.533222+0000", 2024-04-26T10:22:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9368000000000001e-05 2024-04-26T10:22:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:154982 5.f 5:f70228fd:::benchmark_data_smithi052_19421_object25510:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:44.534785+0000", 2024-04-26T10:22:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000268564, 2024-04-26T10:22:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00042918200000000001, 2024-04-26T10:22:44.544 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 154982 2024-04-26T10:22:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534785+0000", 2024-04-26T10:22:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534785+0000", 2024-04-26T10:22:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534784+0000", 2024-04-26T10:22:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534789+0000", 2024-04-26T10:22:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7570000000000004e-06 2024-04-26T10:22:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534798+0000", 2024-04-26T10:22:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:22:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534803+0000", 2024-04-26T10:22:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7960000000000003e-06 2024-04-26T10:22:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534848+0000", 2024-04-26T10:22:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5349999999999998e-05 2024-04-26T10:22:44.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534972+0000", 2024-04-26T10:22:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123693 2024-04-26T10:22:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.535085+0000", 2024-04-26T10:22:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113163 2024-04-26T10:22:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.548 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:154983 5.7 5:efc820df:::benchmark_data_smithi052_19421_object25511:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:44.534813+0000", 2024-04-26T10:22:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00024080400000000001, 2024-04-26T10:22:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00048433999999999999, 2024-04-26T10:22:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 154983 2024-04-26T10:22:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534813+0000", 2024-04-26T10:22:44.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534813+0000", 2024-04-26T10:22:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534812+0000", 2024-04-26T10:22:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534815+0000", 2024-04-26T10:22:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3750000000000001e-06 2024-04-26T10:22:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534818+0000", 2024-04-26T10:22:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.726e-06 2024-04-26T10:22:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534822+0000", 2024-04-26T10:22:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7079999999999999e-06 2024-04-26T10:22:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534976+0000", 2024-04-26T10:22:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015429199999999999 2024-04-26T10:22:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.535109+0000", 2024-04-26T10:22:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132955 2024-04-26T10:22:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.552 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:154984 5.5 5:ad6ed1d1:::benchmark_data_smithi052_19421_object25512:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:44.534825+0000", 2024-04-26T10:22:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000228416, 2024-04-26T10:22:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00053308399999999997, 2024-04-26T10:22:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 154984 2024-04-26T10:22:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534825+0000", 2024-04-26T10:22:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534825+0000", 2024-04-26T10:22:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534825+0000", 2024-04-26T10:22:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534826+0000", 2024-04-26T10:22:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.635e-06 2024-04-26T10:22:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534829+0000", 2024-04-26T10:22:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0000000000000001e-06 2024-04-26T10:22:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534832+0000", 2024-04-26T10:22:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6599999999999999e-06 2024-04-26T10:22:44.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534875+0000", 2024-04-26T10:22:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2403e-05 2024-04-26T10:22:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.535009+0000", 2024-04-26T10:22:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134258 2024-04-26T10:22:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.556 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:154986 5.d 5:bd71918f:::benchmark_data_smithi052_19421_object25514:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:44.534838+0000", 2024-04-26T10:22:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000215319, 2024-04-26T10:22:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00057624900000000003, 2024-04-26T10:22:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 154986 2024-04-26T10:22:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534838+0000", 2024-04-26T10:22:44.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534838+0000", 2024-04-26T10:22:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534838+0000", 2024-04-26T10:22:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534841+0000", 2024-04-26T10:22:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0429999999999999e-06 2024-04-26T10:22:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534846+0000", 2024-04-26T10:22:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3149999999999999e-06 2024-04-26T10:22:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534851+0000", 2024-04-26T10:22:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3159999999999998e-06 2024-04-26T10:22:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534890+0000", 2024-04-26T10:22:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9254000000000001e-05 2024-04-26T10:22:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534996+0000", 2024-04-26T10:22:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010596599999999999 2024-04-26T10:22:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.535109+0000", 2024-04-26T10:22:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113579 2024-04-26T10:22:44.560 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:154988 5.c 5:345bfe6b:::benchmark_data_smithi052_19421_object25516:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:44.534936+0000", 2024-04-26T10:22:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000117545, 2024-04-26T10:22:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00053925200000000005, 2024-04-26T10:22:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.561 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 154988 2024-04-26T10:22:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534936+0000", 2024-04-26T10:22:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534936+0000", 2024-04-26T10:22:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534935+0000", 2024-04-26T10:22:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534939+0000", 2024-04-26T10:22:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6799999999999999e-06 2024-04-26T10:22:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534947+0000", 2024-04-26T10:22:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5939999999999996e-06 2024-04-26T10:22:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534952+0000", 2024-04-26T10:22:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9100000000000002e-06 2024-04-26T10:22:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.534997+0000", 2024-04-26T10:22:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4728999999999998e-05 2024-04-26T10:22:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.535124+0000", 2024-04-26T10:22:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126346 2024-04-26T10:22:44.564 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:154958 5.b e52/37 5:d814b95e:::benchmark_data_smithi052_19421_object25486:head v 52'9666, mlcod=52'9662)", 2024-04-26T10:22:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:44.524061+0000", 2024-04-26T10:22:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010992755999999999, 2024-04-26T10:22:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011472491, 2024-04-26T10:22:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.524061+0000", 2024-04-26T10:22:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.524061+0000", 2024-04-26T10:22:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.524060+0000", 2024-04-26T10:22:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.524066+0000", 2024-04-26T10:22:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2889999999999997e-06 2024-04-26T10:22:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.524072+0000", 2024-04-26T10:22:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6259999999999997e-06 2024-04-26T10:22:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.524077+0000", 2024-04-26T10:22:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0540000000000002e-06 2024-04-26T10:22:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.524107+0000", 2024-04-26T10:22:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9680999999999999e-05 2024-04-26T10:22:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.524127+0000", 2024-04-26T10:22:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0531e-05 2024-04-26T10:22:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.568 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:154970 5.3 5:c5ac204f:::benchmark_data_smithi052_19421_object25498:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:44.528294+0000", 2024-04-26T10:22:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0067590549999999999, 2024-04-26T10:22:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072900120000000002, 2024-04-26T10:22:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 154970 2024-04-26T10:22:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.528294+0000", 2024-04-26T10:22:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.528294+0000", 2024-04-26T10:22:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.528294+0000", 2024-04-26T10:22:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.528297+0000", 2024-04-26T10:22:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.755e-06 2024-04-26T10:22:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.528306+0000", 2024-04-26T10:22:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0849999999999997e-06 2024-04-26T10:22:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.528311+0000", 2024-04-26T10:22:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9290000000000003e-06 2024-04-26T10:22:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.528349+0000", 2024-04-26T10:22:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7116999999999997e-05 2024-04-26T10:22:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.528439+0000", 2024-04-26T10:22:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9963000000000006e-05 2024-04-26T10:22:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.572 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:154976 5.3 5:c850d3aa:::benchmark_data_smithi052_19421_object25504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:44.529958+0000", 2024-04-26T10:22:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0050953109999999999, 2024-04-26T10:22:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056825859999999999, 2024-04-26T10:22:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 154976 2024-04-26T10:22:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.529958+0000", 2024-04-26T10:22:44.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.529958+0000", 2024-04-26T10:22:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.529958+0000", 2024-04-26T10:22:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.529961+0000", 2024-04-26T10:22:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7790000000000002e-06 2024-04-26T10:22:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.529970+0000", 2024-04-26T10:22:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0880000000000001e-06 2024-04-26T10:22:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.529976+0000", 2024-04-26T10:22:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7060000000000001e-06 2024-04-26T10:22:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.530088+0000", 2024-04-26T10:22:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112163 2024-04-26T10:22:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.530164+0000", 2024-04-26T10:22:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5972999999999999e-05 2024-04-26T10:22:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:154981 5.c 5:319cd1e7:::benchmark_data_smithi052_19421_object25509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:44.532234+0000", 2024-04-26T10:22:44.576 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0028197230000000001, 2024-04-26T10:22:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034625429999999998, 2024-04-26T10:22:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 154981 2024-04-26T10:22:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.532234+0000", 2024-04-26T10:22:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.532234+0000", 2024-04-26T10:22:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.532233+0000", 2024-04-26T10:22:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.532238+0000", 2024-04-26T10:22:44.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7620000000000003e-06 2024-04-26T10:22:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.532248+0000", 2024-04-26T10:22:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0433e-05 2024-04-26T10:22:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.532253+0000", 2024-04-26T10:22:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2360000000000004e-06 2024-04-26T10:22:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.532300+0000", 2024-04-26T10:22:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6669000000000003e-05 2024-04-26T10:22:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:44.532464+0000", 2024-04-26T10:22:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016410799999999999 2024-04-26T10:22:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:44.580 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 11 2024-04-26T10:22:44.580 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:44.581 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:44.609 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:44.604+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:44.710 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:44.704+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:44.712 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:44.712 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:44.712 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:44.712 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:44.712 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:44.726 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:44.811 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:44.808+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:44.898 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:44.898 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:44.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:44.899 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:44.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.899 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:44.899 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:44.899 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.365918295, 2024-04-26T10:22:44.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:44.899 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.899 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.899 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.899 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:44.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.900 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:44.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:44.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:44.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:44.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:44.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:44.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:44.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:44.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:44.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:44.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:44.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:44.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:44.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:44.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:44.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:44.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:44.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:44.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:44.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:44.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:44.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:44.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:44.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:44.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:44.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:44.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:44.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:44.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.905 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.905 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:44.905 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:44.905 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.361383083, 2024-04-26T10:22:44.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:44.906 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.906 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.906 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.906 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.906 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.907 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:44.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.907 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:44.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:44.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:44.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:44.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:44.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:44.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:44.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:44.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:44.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:44.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:44.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:44.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:44.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:44.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:44.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:44.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:44.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:44.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:44.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:44.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:44.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:44.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:44.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:44.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:44.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:44.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:44.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:44.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:44.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.915 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.915 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.915 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:44.915 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:44.915 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.360751790999998, 2024-04-26T10:22:44.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:44.915 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.915 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.916 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.916 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.916 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:44.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.916 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:44.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:44.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:44.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:44.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:44.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:44.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:44.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:44.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:44.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:44.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:44.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:44.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:44.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:44.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:44.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:44.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:44.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:44.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:44.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110555 5.9 5:919989b3:::benchmark_data_smithi052_19421_object110554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.861954586, 2024-04-26T10:22:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129736717, 2024-04-26T10:22:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110555 2024-04-26T10:22:44.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.922 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:44.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:44.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033309+0000", 2024-04-26T10:22:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033393+0000", 2024-04-26T10:22:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3690999999999995e-05 2024-04-26T10:22:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033401+0000", 2024-04-26T10:22:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4319999999999999e-06 2024-04-26T10:22:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033406+0000", 2024-04-26T10:22:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2340000000000002e-06 2024-04-26T10:22:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033467+0000", 2024-04-26T10:22:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0915999999999997e-05 2024-04-26T10:22:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033550+0000", 2024-04-26T10:22:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3057000000000001e-05 2024-04-26T10:22:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:44.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033676+0000", 2024-04-26T10:22:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126162 2024-04-26T10:22:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037902+0000", 2024-04-26T10:22:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042255720000000004 2024-04-26T10:22:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162728+0000", 2024-04-26T10:22:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12482583799999999 2024-04-26T10:22:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:44.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162839+0000", 2024-04-26T10:22:44.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111222 2024-04-26T10:22:44.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:44.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163047+0000", 2024-04-26T10:22:44.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207686 2024-04-26T10:22:44.926 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.926 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.926 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.926 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110556 5.1 5:822c74bd:::benchmark_data_smithi052_19421_object110555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:44.926 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:44.927 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.861845478999999, 2024-04-26T10:22:44.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129274783, 2024-04-26T10:22:44.927 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.927 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.927 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110556 2024-04-26T10:22:44.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.927 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:44.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:44.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033418+0000", 2024-04-26T10:22:44.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033472+0000", 2024-04-26T10:22:44.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3780999999999999e-05 2024-04-26T10:22:44.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033478+0000", 2024-04-26T10:22:44.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6049999999999997e-06 2024-04-26T10:22:44.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033482+0000", 2024-04-26T10:22:44.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9110000000000001e-06 2024-04-26T10:22:44.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033509+0000", 2024-04-26T10:22:44.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6415e-05 2024-04-26T10:22:44.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033650+0000", 2024-04-26T10:22:44.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014088999999999999 2024-04-26T10:22:44.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:44.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161877+0000", 2024-04-26T10:22:44.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128227707 2024-04-26T10:22:44.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:44.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162541+0000", 2024-04-26T10:22:44.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000663863 2024-04-26T10:22:44.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:44.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162694+0000", 2024-04-26T10:22:44.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015245699999999999 2024-04-26T10:22:44.931 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.931 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.931 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.931 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110558 5.3 5:c73f56b6:::benchmark_data_smithi052_19421_object110557:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:44.931 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:44.931 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.861648844000001, 2024-04-26T10:22:44.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12864012999999999, 2024-04-26T10:22:44.931 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.932 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.932 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.932 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.932 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110558 2024-04-26T10:22:44.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.932 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:44.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:44.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033615+0000", 2024-04-26T10:22:44.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033717+0000", 2024-04-26T10:22:44.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102298 2024-04-26T10:22:44.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033725+0000", 2024-04-26T10:22:44.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0090000000000007e-06 2024-04-26T10:22:44.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033731+0000", 2024-04-26T10:22:44.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8919999999999997e-06 2024-04-26T10:22:44.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033769+0000", 2024-04-26T10:22:44.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7682999999999998e-05 2024-04-26T10:22:44.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033891+0000", 2024-04-26T10:22:44.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121718 2024-04-26T10:22:44.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:44.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161912+0000", 2024-04-26T10:22:44.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128021512 2024-04-26T10:22:44.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:44.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162043+0000", 2024-04-26T10:22:44.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130588 2024-04-26T10:22:44.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:44.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162256+0000", 2024-04-26T10:22:44.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021311499999999999 2024-04-26T10:22:44.936 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.936 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.936 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.936 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110557 5.b e45/37 5:d659544e:::benchmark_data_smithi052_19421_object110556:head v 45'6862, mlcod=45'6860)", 2024-04-26T10:22:44.937 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:44.937 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.860744611000001, 2024-04-26T10:22:44.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12783012499999999, 2024-04-26T10:22:44.937 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.937 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.937 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:44.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:44.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034519+0000", 2024-04-26T10:22:44.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034526+0000", 2024-04-26T10:22:44.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0380000000000002e-06 2024-04-26T10:22:44.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034539+0000", 2024-04-26T10:22:44.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.27e-05 2024-04-26T10:22:44.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034545+0000", 2024-04-26T10:22:44.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3369999999999996e-06 2024-04-26T10:22:44.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034606+0000", 2024-04-26T10:22:44.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0752999999999999e-05 2024-04-26T10:22:44.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034627+0000", 2024-04-26T10:22:44.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.088e-05 2024-04-26T10:22:44.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:44.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162272+0000", 2024-04-26T10:22:44.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12764540199999999 2024-04-26T10:22:44.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:44.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162350+0000", 2024-04-26T10:22:44.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7835000000000003e-05 2024-04-26T10:22:44.940 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.941 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.941 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.941 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110554 5.0 e45/37 5:04324c12:::benchmark_data_smithi052_19421_object110553:head v 45'6903, mlcod=45'6898)", 2024-04-26T10:22:44.941 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:44.941 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.858985188999998, 2024-04-26T10:22:44.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12566923499999999, 2024-04-26T10:22:44.941 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.941 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.941 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036278+0000", 2024-04-26T10:22:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036313+0000", 2024-04-26T10:22:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5247999999999999e-05 2024-04-26T10:22:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036324+0000", 2024-04-26T10:22:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0496000000000001e-05 2024-04-26T10:22:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036329+0000", 2024-04-26T10:22:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3070000000000002e-06 2024-04-26T10:22:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036364+0000", 2024-04-26T10:22:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4391000000000003e-05 2024-04-26T10:22:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036377+0000", 2024-04-26T10:22:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3706999999999999e-05 2024-04-26T10:22:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042032+0000", 2024-04-26T10:22:44.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056547120000000001 2024-04-26T10:22:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161949+0000", 2024-04-26T10:22:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119916482 2024-04-26T10:22:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110559 5.2 5:44c3f174:::benchmark_data_smithi052_19421_object110558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:44.945 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.857366579000001, 2024-04-26T10:22:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12530391299999999, 2024-04-26T10:22:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110559 2024-04-26T10:22:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037897+0000", 2024-04-26T10:22:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037922+0000", 2024-04-26T10:22:44.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5004e-05 2024-04-26T10:22:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037931+0000", 2024-04-26T10:22:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-04-26T10:22:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037937+0000", 2024-04-26T10:22:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6749999999999999e-06 2024-04-26T10:22:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037972+0000", 2024-04-26T10:22:44.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4678000000000002e-05 2024-04-26T10:22:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038108+0000", 2024-04-26T10:22:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013689099999999999 2024-04-26T10:22:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162887+0000", 2024-04-26T10:22:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124778258 2024-04-26T10:22:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163010+0000", 2024-04-26T10:22:44.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122924 2024-04-26T10:22:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163202+0000", 2024-04-26T10:22:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192203 2024-04-26T10:22:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110560 5.3 5:caf5a141:::benchmark_data_smithi052_19421_object110559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:44.950 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.857315977999999, 2024-04-26T10:22:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12888738299999999, 2024-04-26T10:22:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110560 2024-04-26T10:22:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037948+0000", 2024-04-26T10:22:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037973+0000", 2024-04-26T10:22:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5187000000000001e-05 2024-04-26T10:22:44.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037978+0000", 2024-04-26T10:22:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4120000000000003e-06 2024-04-26T10:22:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037981+0000", 2024-04-26T10:22:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6689999999999999e-06 2024-04-26T10:22:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038041+0000", 2024-04-26T10:22:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9324999999999999e-05 2024-04-26T10:22:44.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038179+0000", 2024-04-26T10:22:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013832499999999999 2024-04-26T10:22:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166427+0000", 2024-04-26T10:22:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128248165 2024-04-26T10:22:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166539+0000", 2024-04-26T10:22:44.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111538 2024-04-26T10:22:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166836+0000", 2024-04-26T10:22:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029714100000000001 2024-04-26T10:22:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110561 5.d 5:b143edec:::benchmark_data_smithi052_19421_object110560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.857273920000001, 2024-04-26T10:22:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.125215574, 2024-04-26T10:22:44.955 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110561 2024-04-26T10:22:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037990+0000", 2024-04-26T10:22:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038028+0000", 2024-04-26T10:22:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7802999999999997e-05 2024-04-26T10:22:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038035+0000", 2024-04-26T10:22:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-06 2024-04-26T10:22:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038040+0000", 2024-04-26T10:22:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.147e-06 2024-04-26T10:22:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038077+0000", 2024-04-26T10:22:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7166999999999998e-05 2024-04-26T10:22:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038192+0000", 2024-04-26T10:22:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115565 2024-04-26T10:22:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038319+0000", 2024-04-26T10:22:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012697699999999999 2024-04-26T10:22:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162690+0000", 2024-04-26T10:22:44.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12437065 2024-04-26T10:22:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162878+0000", 2024-04-26T10:22:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000188173 2024-04-26T10:22:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162992+0000", 2024-04-26T10:22:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114008 2024-04-26T10:22:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163206+0000", 2024-04-26T10:22:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021394900000000001 2024-04-26T10:22:44.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.857213315999999, 2024-04-26T10:22:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:22:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.961 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:22:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:22:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:22:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:22:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:22:44.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:22:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:22:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:22:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:22:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:22:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:22:44.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:22:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:22:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:22:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:22:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:22:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:22:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.965 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110564 5.3 5:c09e33cb:::benchmark_data_smithi052_19421_object110563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.857160658000002, 2024-04-26T10:22:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128984614, 2024-04-26T10:22:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110564 2024-04-26T10:22:44.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038103+0000", 2024-04-26T10:22:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038136+0000", 2024-04-26T10:22:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.243e-05 2024-04-26T10:22:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038143+0000", 2024-04-26T10:22:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0870000000000001e-06 2024-04-26T10:22:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038151+0000", 2024-04-26T10:22:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:22:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039813+0000", 2024-04-26T10:22:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001661844 2024-04-26T10:22:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039970+0000", 2024-04-26T10:22:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015712699999999999 2024-04-26T10:22:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:44.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166854+0000", 2024-04-26T10:22:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.126883788 2024-04-26T10:22:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166976+0000", 2024-04-26T10:22:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012231399999999999 2024-04-26T10:22:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167088+0000", 2024-04-26T10:22:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011243699999999999 2024-04-26T10:22:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.970 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.857104065000001, 2024-04-26T10:22:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:22:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:22:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.971 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:44.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:22:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:22:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:22:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:22:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:22:44.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:22:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:22:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:22:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:22:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:22:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:22:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:22:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:44.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:22:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:22:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:22:44.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:22:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110566 5.c 5:34145698:::benchmark_data_smithi052_19421_object110565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:44.977 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.857054288, 2024-04-26T10:22:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12673530699999999, 2024-04-26T10:22:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110566 2024-04-26T10:22:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.978 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038246+0000", 2024-04-26T10:22:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5759000000000001e-05 2024-04-26T10:22:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038252+0000", 2024-04-26T10:22:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5300000000000002e-06 2024-04-26T10:22:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038257+0000", 2024-04-26T10:22:44.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038312+0000", 2024-04-26T10:22:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5108000000000002e-05 2024-04-26T10:22:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038480+0000", 2024-04-26T10:22:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016751099999999999 2024-04-26T10:22:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:44.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164651+0000", 2024-04-26T10:22:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12617115600000001 2024-04-26T10:22:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164770+0000", 2024-04-26T10:22:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118748 2024-04-26T10:22:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164946+0000", 2024-04-26T10:22:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175966 2024-04-26T10:22:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.854706653000001, 2024-04-26T10:22:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:22:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:22:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:22:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:44.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:22:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:22:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:22:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:22:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:22:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:22:44.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:22:44.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:22:44.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:22:44.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:22:44.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:44.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:22:44.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:22:44.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:44.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:22:44.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:22:44.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:44.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:22:44.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:22:44.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:44.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:22:44.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:22:44.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:44.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:22:44.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:22:44.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.990 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.990 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.990 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110568 5.c 5:34af8ad3:::benchmark_data_smithi052_19421_object110567:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:44.990 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:44.990 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.854589027999999, 2024-04-26T10:22:44.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124943661, 2024-04-26T10:22:44.991 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.991 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.991 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.991 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.991 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.991 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110568 2024-04-26T10:22:44.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.991 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:44.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:44.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:44.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040711+0000", 2024-04-26T10:22:44.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6531e-05 2024-04-26T10:22:44.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040719+0000", 2024-04-26T10:22:44.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6120000000000001e-06 2024-04-26T10:22:44.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040724+0000", 2024-04-26T10:22:44.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2100000000000001e-06 2024-04-26T10:22:44.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.993 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.993 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040771+0000", 2024-04-26T10:22:44.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7123000000000003e-05 2024-04-26T10:22:44.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040984+0000", 2024-04-26T10:22:44.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021227400000000001 2024-04-26T10:22:44.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:44.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165350+0000", 2024-04-26T10:22:44.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124366738 2024-04-26T10:22:44.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:44.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165459+0000", 2024-04-26T10:22:44.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108168 2024-04-26T10:22:44.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:44.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165619+0000", 2024-04-26T10:22:44.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160564 2024-04-26T10:22:44.995 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.995 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:44.995 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:44.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.995 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:44.995 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:44.995 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.854520729000001, 2024-04-26T10:22:44.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:22:44.995 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:44.995 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:44.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:44.995 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:44.996 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:44.996 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:22:44.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.996 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:44.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:44.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:44.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:44.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:44.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:44.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:44.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:22:44.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:44.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:44.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:22:44.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:22:44.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:44.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:22:44.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:22:44.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:44.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:22:44.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:22:44.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:44.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:22:44.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:22:44.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:44.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:22:44.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:22:44.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:44.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:22:44.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:22:44.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:44.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:22:44.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:22:44.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:44.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:44.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:44.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:22:44.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:22:44.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:45.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:22:45.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:22:45.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:45.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:22:45.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:22:45.000 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.000 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:45.000 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.000 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110570 5.1 5:876a468c:::benchmark_data_smithi052_19421_object110569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:45.001 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:45.001 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 20.853218183999999, 2024-04-26T10:22:45.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12851437099999999, 2024-04-26T10:22:45.001 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:45.001 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.001 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:45.001 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:45.001 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.001 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110570 2024-04-26T10:22:45.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.001 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:45.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:45.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:45.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:45.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:45.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:45.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042045+0000", 2024-04-26T10:22:45.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:45.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:45.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042083+0000", 2024-04-26T10:22:45.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8064e-05 2024-04-26T10:22:45.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:45.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161855+0000", 2024-04-26T10:22:45.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119771934 2024-04-26T10:22:45.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161882+0000", 2024-04-26T10:22:45.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7083000000000001e-05 2024-04-26T10:22:45.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:45.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163117+0000", 2024-04-26T10:22:45.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001234509 2024-04-26T10:22:45.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:45.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163507+0000", 2024-04-26T10:22:45.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038998400000000001 2024-04-26T10:22:45.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:45.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170347+0000", 2024-04-26T10:22:45.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006840952 2024-04-26T10:22:45.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:45.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170488+0000", 2024-04-26T10:22:45.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140393 2024-04-26T10:22:45.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:45.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170561+0000", 2024-04-26T10:22:45.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2809e-05 2024-04-26T10:22:45.005 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.005 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:45.005 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.005 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:124481 5.d 5:b507cdbb:::benchmark_data_smithi052_19421_object124480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:45.005 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:45.005 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.814853262, 2024-04-26T10:22:45.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.087933879000000006, 2024-04-26T10:22:45.006 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:45.006 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:45.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:45.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.006 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124481 2024-04-26T10:22:45.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.006 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:45.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:45.006 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:45.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.006 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:45.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:45.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:45.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080410+0000", 2024-04-26T10:22:45.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:45.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:45.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080523+0000", 2024-04-26T10:22:45.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112501 2024-04-26T10:22:45.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:45.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080528+0000", 2024-04-26T10:22:45.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1789999999999999e-06 2024-04-26T10:22:45.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080532+0000", 2024-04-26T10:22:45.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.805e-06 2024-04-26T10:22:45.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:45.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080562+0000", 2024-04-26T10:22:45.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0241000000000001e-05 2024-04-26T10:22:45.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:45.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080645+0000", 2024-04-26T10:22:45.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2816000000000001e-05 2024-04-26T10:22:45.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:45.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080786+0000", 2024-04-26T10:22:45.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014129400000000001 2024-04-26T10:22:45.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:45.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.084288+0000", 2024-04-26T10:22:45.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035017920000000001 2024-04-26T10:22:45.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:45.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.167975+0000", 2024-04-26T10:22:45.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.083686673000000003 2024-04-26T10:22:45.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:45.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.168092+0000", 2024-04-26T10:22:45.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117607 2024-04-26T10:22:45.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:45.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.168345+0000", 2024-04-26T10:22:45.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025299200000000001 2024-04-26T10:22:45.010 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.011 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:45.011 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.011 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.011 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:45.011 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:45.012 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:45.011+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:45.013 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:45.112 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:22:45.113 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:45.108+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:45.133 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:45.133 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:45.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:156345 5.8 5:10ecb0db:::benchmark_data_smithi052_19421_object26873:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:45.130407+0000", 2024-04-26T10:22:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0031339879999999999, 2024-04-26T10:22:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003151437, 2024-04-26T10:22:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 156345 2024-04-26T10:22:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.134 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130407+0000", 2024-04-26T10:22:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130407+0000", 2024-04-26T10:22:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130406+0000", 2024-04-26T10:22:45.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130411+0000", 2024-04-26T10:22:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1749999999999996e-06 2024-04-26T10:22:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130424+0000", 2024-04-26T10:22:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2204e-05 2024-04-26T10:22:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130430+0000", 2024-04-26T10:22:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4740000000000002e-06 2024-04-26T10:22:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130490+0000", 2024-04-26T10:22:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9821000000000002e-05 2024-04-26T10:22:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130714+0000", 2024-04-26T10:22:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022421100000000001 2024-04-26T10:22:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.137 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:156347 5.8 5:1695494f:::benchmark_data_smithi052_19421_object26875:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:45.130441+0000", 2024-04-26T10:22:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0031005899999999999, 2024-04-26T10:22:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031609260000000001, 2024-04-26T10:22:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "reached pg", 2024-04-26T10:22:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.138 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 156347 2024-04-26T10:22:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130441+0000", 2024-04-26T10:22:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130441+0000", 2024-04-26T10:22:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130440+0000", 2024-04-26T10:22:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130443+0000", 2024-04-26T10:22:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.531e-06 2024-04-26T10:22:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130457+0000", 2024-04-26T10:22:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4504e-05 2024-04-26T10:22:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130462+0000", 2024-04-26T10:22:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.356e-06 2024-04-26T10:22:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.133419+0000", 2024-04-26T10:22:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029564679999999999 2024-04-26T10:22:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:156348 5.8 5.a71093c8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:45.130479+0000", 2024-04-26T10:22:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0030621649999999999, 2024-04-26T10:22:45.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031586539999999999, 2024-04-26T10:22:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 156348 2024-04-26T10:22:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130479+0000", 2024-04-26T10:22:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130479+0000", 2024-04-26T10:22:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130479+0000", 2024-04-26T10:22:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130481+0000", 2024-04-26T10:22:45.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4849999999999999e-06 2024-04-26T10:22:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130487+0000", 2024-04-26T10:22:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5149999999999997e-06 2024-04-26T10:22:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130492+0000", 2024-04-26T10:22:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1359999999999996e-06 2024-04-26T10:22:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:156349 5.a 5:53864994:::benchmark_data_smithi052_19421_object26877:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:45.130496+0000", 2024-04-26T10:22:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0030451160000000001, 2024-04-26T10:22:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031766860000000002, 2024-04-26T10:22:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 156349 2024-04-26T10:22:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130496+0000", 2024-04-26T10:22:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130496+0000", 2024-04-26T10:22:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130496+0000", 2024-04-26T10:22:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130498+0000", 2024-04-26T10:22:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5270000000000001e-06 2024-04-26T10:22:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130503+0000", 2024-04-26T10:22:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3009999999999997e-06 2024-04-26T10:22:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130508+0000", 2024-04-26T10:22:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5260000000000004e-06 2024-04-26T10:22:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.132035+0000", 2024-04-26T10:22:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0015272059999999999 2024-04-26T10:22:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.132175+0000", 2024-04-26T10:22:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000139751 2024-04-26T10:22:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.148 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:156351 5.4 5:2aa5a023:::benchmark_data_smithi052_19421_object26879:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:45.130516+0000", 2024-04-26T10:22:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0030251409999999999, 2024-04-26T10:22:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031924570000000001, 2024-04-26T10:22:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 156351 2024-04-26T10:22:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130516+0000", 2024-04-26T10:22:45.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130516+0000", 2024-04-26T10:22:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130515+0000", 2024-04-26T10:22:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130518+0000", 2024-04-26T10:22:45.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7659999999999999e-06 2024-04-26T10:22:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130524+0000", 2024-04-26T10:22:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4249999999999997e-06 2024-04-26T10:22:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130528+0000", 2024-04-26T10:22:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8099999999999997e-06 2024-04-26T10:22:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130592+0000", 2024-04-26T10:22:45.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3267000000000003e-05 2024-04-26T10:22:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130760+0000", 2024-04-26T10:22:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016800800000000001 2024-04-26T10:22:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.131017+0000", 2024-04-26T10:22:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00025710300000000001 2024-04-26T10:22:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:156346 5.f e52/37 5:f91c313f:::benchmark_data_smithi052_19421_object26874:head v 52'9862, mlcod=52'9859)", 2024-04-26T10:22:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:45.130723+0000", 2024-04-26T10:22:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0028177689999999999, 2024-04-26T10:22:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030205150000000001, 2024-04-26T10:22:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130723+0000", 2024-04-26T10:22:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130723+0000", 2024-04-26T10:22:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130723+0000", 2024-04-26T10:22:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130730+0000", 2024-04-26T10:22:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0709999999999997e-06 2024-04-26T10:22:45.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130739+0000", 2024-04-26T10:22:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8599999999999999e-06 2024-04-26T10:22:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130745+0000", 2024-04-26T10:22:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1149999999999999e-06 2024-04-26T10:22:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130787+0000", 2024-04-26T10:22:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2701999999999999e-05 2024-04-26T10:22:45.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.130807+0000", 2024-04-26T10:22:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9386e-05 2024-04-26T10:22:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:156340 5.0 5:0d5817a4:::benchmark_data_smithi052_19421_object26868:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:45.126354+0000", 2024-04-26T10:22:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0071866769999999998, 2024-04-26T10:22:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0074221460000000001, 2024-04-26T10:22:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.156 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 156340 2024-04-26T10:22:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.126354+0000", 2024-04-26T10:22:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.126354+0000", 2024-04-26T10:22:45.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.126353+0000", 2024-04-26T10:22:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.126359+0000", 2024-04-26T10:22:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8139999999999997e-06 2024-04-26T10:22:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.126373+0000", 2024-04-26T10:22:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3419e-05 2024-04-26T10:22:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.126380+0000", 2024-04-26T10:22:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7020000000000001e-06 2024-04-26T10:22:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.126409+0000", 2024-04-26T10:22:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8790999999999999e-05 2024-04-26T10:22:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.126504+0000", 2024-04-26T10:22:45.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5079000000000002e-05 2024-04-26T10:22:45.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:45.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.126584+0000", 2024-04-26T10:22:45.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0115000000000001e-05 2024-04-26T10:22:45.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.129744+0000", 2024-04-26T10:22:45.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031593099999999998 2024-04-26T10:22:45.160 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.160 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:156343 5.a 5:56be3fd2:::benchmark_data_smithi052_19421_object26871:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:45.129802+0000", 2024-04-26T10:22:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.003738683, 2024-04-26T10:22:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040139240000000003, 2024-04-26T10:22:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 156343 2024-04-26T10:22:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.129802+0000", 2024-04-26T10:22:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.129802+0000", 2024-04-26T10:22:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.129801+0000", 2024-04-26T10:22:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:45.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.129807+0000", 2024-04-26T10:22:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.13e-06 2024-04-26T10:22:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.129817+0000", 2024-04-26T10:22:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0287e-05 2024-04-26T10:22:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.129822+0000", 2024-04-26T10:22:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2580000000000003e-06 2024-04-26T10:22:45.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.129860+0000", 2024-04-26T10:22:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8247999999999997e-05 2024-04-26T10:22:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:45.129968+0000", 2024-04-26T10:22:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010747399999999999 2024-04-26T10:22:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:45.164 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 8 2024-04-26T10:22:45.164 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:45.165 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:45.214 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:45.212+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:45.288 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:45.288 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:45.288 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:45.288 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:45.289 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:45.301 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:45.315 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:45.312+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:45.415 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:45.415+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:45.431 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:45.431 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:45.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:45.431 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:45.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.431 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:45.431 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:45.432 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 44.898520986999998, 2024-04-26T10:22:45.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:45.432 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.432 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.432 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.432 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.432 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.432 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:45.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.432 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:45.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:45.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:45.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:45.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:45.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:45.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:45.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:45.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:45.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:45.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:45.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:45.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:45.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:45.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:45.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:45.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:45.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:45.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:45.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:45.436 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.436 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.436 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.437 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:45.437 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:45.437 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 44.896538759999999, 2024-04-26T10:22:45.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:45.437 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.437 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.437 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.437 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.437 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.437 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:45.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.437 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:45.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:45.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:45.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:45.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:45.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:45.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:45.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:45.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:45.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:45.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:45.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:45.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:45.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:45.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:45.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:45.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:45.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:45.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:45.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:45.441 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.441 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.441 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.442 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:45.442 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:45.442 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 44.896339376, 2024-04-26T10:22:45.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:45.442 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.442 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.442 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.442 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.442 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.442 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:45.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.443 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:45.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:45.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:45.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:45.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:45.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:45.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:45.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:45.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:45.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:45.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:45.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:45.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:45.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:45.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:45.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:45.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:45.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:45.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:45.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:45.446 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.446 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.446 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.447 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:45.447 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:45.447 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 44.896120756000002, 2024-04-26T10:22:45.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:45.447 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.447 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.447 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:45.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:45.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:45.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:45.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:45.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:45.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:45.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:45.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:45.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:45.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:45.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:45.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:45.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:45.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:45.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:45.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:45.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:45.451 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.451 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.451 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.451 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:45.451 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:45.451 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 44.893749317999998, 2024-04-26T10:22:45.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:45.451 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.451 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.451 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.451 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.451 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.451 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:45.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.452 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:45.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:45.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:45.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:45.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:45.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:45.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:45.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:45.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:45.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:45.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:45.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:45.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:45.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:45.455 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.455 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.456 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.456 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:45.456 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:45.456 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 44.893648696, 2024-04-26T10:22:45.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:45.456 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.456 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.456 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.456 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.456 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.456 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:45.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.456 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:45.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:45.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:45.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:45.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:45.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:45.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:45.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:45.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:45.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:45.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:45.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:45.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:45.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:45.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:45.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:45.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:45.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:45.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:45.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:45.460 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.460 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.460 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.461 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:45.461 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:45.461 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 44.893530134999999, 2024-04-26T10:22:45.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:45.461 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.461 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.461 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:45.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:45.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:45.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:45.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:45.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:45.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:45.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:45.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:45.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:45.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:45.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:45.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:45.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:45.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:45.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:45.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:45.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:45.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.465 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.465 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:45.465 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:45.465 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 44.893427737000003, 2024-04-26T10:22:45.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:45.465 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.465 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.465 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.465 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.466 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.466 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:45.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.466 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:45.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:45.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:45.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:45.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:45.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:45.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:45.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:45.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:45.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:45.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:45.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:45.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:45.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:45.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:45.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:45.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:45.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:45.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:45.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:45.470 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.470 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.470 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.470 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:45.470 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:45.470 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 44.892407179999999, 2024-04-26T10:22:45.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:45.470 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.470 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.470 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.470 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.471 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.471 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:45.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.471 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:45.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:45.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:45.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:45.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:45.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:45.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:45.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:45.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:45.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:45.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:45.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:45.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:45.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:45.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:45.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:45.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:45.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:45.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:45.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:45.474 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.475 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.475 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.475 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:45.475 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:45.475 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 44.891256904999999, 2024-04-26T10:22:45.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:45.475 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.475 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.475 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.475 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.475 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.475 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:45.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.475 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:45.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:45.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:45.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:45.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:45.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:45.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:45.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:45.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:45.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:45.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:45.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:45.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:45.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:45.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:45.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:45.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:45.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:45.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:45.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:45.479 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.479 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.479 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.479 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:45.480 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:45.480 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.394557663000001, 2024-04-26T10:22:45.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:22:45.480 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.480 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.480 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.480 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.480 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.480 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:22:45.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.480 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:45.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:45.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:22:45.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:45.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:22:45.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:22:45.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:22:45.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:22:45.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:22:45.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:22:45.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:22:45.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:22:45.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:22:45.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:22:45.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:45.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:22:45.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:22:45.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:22:45.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:22:45.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:45.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:22:45.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:22:45.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:22:45.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:22:45.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:22:45.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:22:45.485 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.485 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.485 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.485 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:45.485 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:45.485 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 21.394334066999999, 2024-04-26T10:22:45.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:22:45.485 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.485 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.485 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.485 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.485 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.486 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:22:45.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.486 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:45.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:45.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:22:45.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:45.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:22:45.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:22:45.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:22:45.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:22:45.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:22:45.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:22:45.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:22:45.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:22:45.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:22:45.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:22:45.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:45.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:22:45.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:22:45.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:22:45.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:22:45.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:45.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:22:45.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:22:45.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:22:45.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:22:45.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:22:45.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:22:45.490 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.490 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.491 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.491 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:45.491 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:45.491 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.363487747000001, 2024-04-26T10:22:45.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:22:45.491 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.491 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.491 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.491 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.491 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.491 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:22:45.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.492 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:45.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:45.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:22:45.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:45.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:22:45.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:22:45.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:22:45.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:22:45.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:22:45.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:22:45.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:22:45.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:22:45.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:22:45.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:22:45.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:45.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:22:45.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:22:45.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:45.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:22:45.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:22:45.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:22:45.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:22:45.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:22:45.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:22:45.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:22:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:22:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.361476644, 2024-04-26T10:22:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:22:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.496 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.497 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.497 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.497 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.497 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:22:45.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.497 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:45.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:45.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:45.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:45.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:22:45.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:22:45.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:22:45.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:22:45.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:22:45.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:22:45.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:22:45.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:22:45.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:22:45.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:22:45.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:45.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:22:45.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:22:45.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:45.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:22:45.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:22:45.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:22:45.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:22:45.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:22:45.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:22:45.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:22:45.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:22:45.502 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.502 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.502 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.502 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:45.502 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:45.502 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.350598539, 2024-04-26T10:22:45.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:22:45.502 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.502 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.502 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.502 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.502 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:22:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:22:45.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:45.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:22:45.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:22:45.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:22:45.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:22:45.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:22:45.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:22:45.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:22:45.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:22:45.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:22:45.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:22:45.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:45.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:22:45.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:22:45.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:45.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:22:45.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:22:45.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:22:45.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:22:45.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:22:45.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:22:45.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:22:45.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:22:45.507 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.507 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.507 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.507 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:45.507 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:45.508 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.347917320000001, 2024-04-26T10:22:45.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:22:45.508 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.508 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.508 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.508 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.508 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.508 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:22:45.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.508 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:45.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:45.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:22:45.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:45.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:22:45.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:22:45.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:22:45.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:22:45.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:22:45.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:22:45.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:22:45.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:22:45.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:22:45.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:22:45.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:45.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:22:45.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:22:45.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:45.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:22:45.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:22:45.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:22:45.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:22:45.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:22:45.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:22:45.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:22:45.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:22:45.512 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.512 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.513 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.513 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:45.513 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:45.513 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.347550245000001, 2024-04-26T10:22:45.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:22:45.513 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.513 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.513 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.513 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.513 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.513 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:22:45.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.513 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:45.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:45.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:22:45.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:45.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:22:45.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:22:45.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:22:45.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:22:45.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:22:45.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:22:45.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:22:45.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:22:45.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:22:45.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:22:45.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:22:45.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:22:45.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:22:45.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:22:45.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:22:45.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:22:45.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.517 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.517 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:45.518 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:45.518 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.347485992999999, 2024-04-26T10:22:45.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:22:45.518 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.518 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.518 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.518 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.518 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.518 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:22:45.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.518 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:45.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:45.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:22:45.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:45.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:22:45.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:22:45.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:22:45.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:22:45.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:22:45.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:22:45.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:22:45.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:22:45.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:22:45.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:22:45.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:22:45.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:22:45.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:22:45.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:22:45.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:22:45.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:22:45.522 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.522 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.522 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.523 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:45.523 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:45.523 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.34308732, 2024-04-26T10:22:45.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:22:45.523 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.523 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.525 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.525 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.525 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:22:45.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.525 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:45.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:45.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:22:45.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:45.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:22:45.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:22:45.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:22:45.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:22:45.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:22:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:22:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:22:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:22:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:22:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:22:45.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:22:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:22:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:22:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:22:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:22:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:22:45.529 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 14.341329336999999, 2024-04-26T10:22:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:22:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:45.530 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:22:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:45.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:22:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:22:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:22:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:22:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:22:45.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:22:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:22:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:22:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:22:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:22:45.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:22:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:22:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:22:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:22:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:22:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:45.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:22:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:22:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:22:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:22:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:22:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:22:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.535 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:45.536 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:45.536 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:45.537 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:45.535+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:45.538 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:45.638 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:45.632+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:45.670 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:45.670 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:45.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.670 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:157589 5.d 5:b86f92e4:::benchmark_data_smithi052_19421_object28117:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:45.670 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:45.657627+0000", 2024-04-26T10:22:45.670 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.011475927, 2024-04-26T10:22:45.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.01149239, 2024-04-26T10:22:45.671 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:45.671 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:45.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:45.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:45.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.671 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 157589 2024-04-26T10:22:45.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.671 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:45.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:45.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.657627+0000", 2024-04-26T10:22:45.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:45.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.657627+0000", 2024-04-26T10:22:45.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:45.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.657626+0000", 2024-04-26T10:22:45.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:45.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:45.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.657630+0000", 2024-04-26T10:22:45.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5360000000000001e-06 2024-04-26T10:22:45.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:45.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.657635+0000", 2024-04-26T10:22:45.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.972e-06 2024-04-26T10:22:45.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.657639+0000", 2024-04-26T10:22:45.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6260000000000001e-06 2024-04-26T10:22:45.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:45.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.664820+0000", 2024-04-26T10:22:45.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00718128 2024-04-26T10:22:45.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:45.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.664966+0000", 2024-04-26T10:22:45.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000145632 2024-04-26T10:22:45.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:45.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665092+0000", 2024-04-26T10:22:45.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126305 2024-04-26T10:22:45.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:45.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.668770+0000", 2024-04-26T10:22:45.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036781140000000001 2024-04-26T10:22:45.675 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.675 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:45.675 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.675 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:157595 5.3 5:ca5c50f6:::benchmark_data_smithi052_19421_object28123:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:45.675 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:45.662211+0000", 2024-04-26T10:22:45.675 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.006892189, 2024-04-26T10:22:45.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069558559999999998, 2024-04-26T10:22:45.675 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:45.676 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:45.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:45.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:45.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.676 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 157595 2024-04-26T10:22:45.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.676 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:45.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:45.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.662211+0000", 2024-04-26T10:22:45.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:45.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.662211+0000", 2024-04-26T10:22:45.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:45.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.662210+0000", 2024-04-26T10:22:45.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:45.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:45.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.662214+0000", 2024-04-26T10:22:45.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4630000000000003e-06 2024-04-26T10:22:45.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:45.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.662222+0000", 2024-04-26T10:22:45.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8290000000000008e-06 2024-04-26T10:22:45.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.662229+0000", 2024-04-26T10:22:45.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4749999999999998e-06 2024-04-26T10:22:45.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:45.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.662272+0000", 2024-04-26T10:22:45.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2919e-05 2024-04-26T10:22:45.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:45.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.662399+0000", 2024-04-26T10:22:45.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000127071 2024-04-26T10:22:45.679 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.679 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:45.679 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.679 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:157594 5.0 e52/37 5:06dc3557:::benchmark_data_smithi052_19421_object28122:head v 52'9786, mlcod=52'9783)", 2024-04-26T10:22:45.679 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:45.662537+0000", 2024-04-26T10:22:45.679 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0065663220000000003, 2024-04-26T10:22:45.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066642230000000004, 2024-04-26T10:22:45.680 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:45.680 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:45.680 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:45.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:45.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.662537+0000", 2024-04-26T10:22:45.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:45.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.662537+0000", 2024-04-26T10:22:45.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:45.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.662536+0000", 2024-04-26T10:22:45.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:45.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:45.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.662542+0000", 2024-04-26T10:22:45.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9050000000000002e-06 2024-04-26T10:22:45.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:45.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.662550+0000", 2024-04-26T10:22:45.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3580000000000003e-06 2024-04-26T10:22:45.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.662556+0000", 2024-04-26T10:22:45.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0689999999999998e-06 2024-04-26T10:22:45.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:45.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.662594+0000", 2024-04-26T10:22:45.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7910000000000001e-05 2024-04-26T10:22:45.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:45.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.662612+0000", 2024-04-26T10:22:45.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7672999999999998e-05 2024-04-26T10:22:45.683 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.683 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:45.683 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.683 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:157598 5.c 5:3139d518:::benchmark_data_smithi052_19421_object28126:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:45.683 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:45.665239+0000", 2024-04-26T10:22:45.683 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0038635919999999999, 2024-04-26T10:22:45.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039911060000000003, 2024-04-26T10:22:45.683 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:45.683 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:45.683 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:45.683 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:45.683 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.683 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 157598 2024-04-26T10:22:45.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.684 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:45.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:45.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665239+0000", 2024-04-26T10:22:45.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:45.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665239+0000", 2024-04-26T10:22:45.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:45.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665239+0000", 2024-04-26T10:22:45.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:45.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:45.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665243+0000", 2024-04-26T10:22:45.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9750000000000001e-06 2024-04-26T10:22:45.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:45.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665255+0000", 2024-04-26T10:22:45.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2371000000000001e-05 2024-04-26T10:22:45.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665261+0000", 2024-04-26T10:22:45.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2670000000000003e-06 2024-04-26T10:22:45.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:45.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665304+0000", 2024-04-26T10:22:45.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2407999999999998e-05 2024-04-26T10:22:45.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:45.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665431+0000", 2024-04-26T10:22:45.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000127584 2024-04-26T10:22:45.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.686 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:45.687 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.687 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:157599 5.7 5:eed61f68:::benchmark_data_smithi052_19421_object28127:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:45.687 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:45.665279+0000", 2024-04-26T10:22:45.687 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0038245060000000001, 2024-04-26T10:22:45.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003985738, 2024-04-26T10:22:45.687 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:45.687 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:45.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:45.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:45.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.687 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 157599 2024-04-26T10:22:45.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.687 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:45.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:45.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665279+0000", 2024-04-26T10:22:45.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:45.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665279+0000", 2024-04-26T10:22:45.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:45.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665278+0000", 2024-04-26T10:22:45.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:45.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:45.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665281+0000", 2024-04-26T10:22:45.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.435e-06 2024-04-26T10:22:45.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:45.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665286+0000", 2024-04-26T10:22:45.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0529999999999997e-06 2024-04-26T10:22:45.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665291+0000", 2024-04-26T10:22:45.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7559999999999996e-06 2024-04-26T10:22:45.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:45.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665327+0000", 2024-04-26T10:22:45.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5181000000000001e-05 2024-04-26T10:22:45.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:45.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665401+0000", 2024-04-26T10:22:45.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4865999999999998e-05 2024-04-26T10:22:45.690 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.690 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:45.690 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.690 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:157602 5.3 5:ca60cd98:::benchmark_data_smithi052_19421_object28130:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:45.690 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:45.665323+0000", 2024-04-26T10:22:45.691 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0037804100000000001, 2024-04-26T10:22:45.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039734490000000004, 2024-04-26T10:22:45.691 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:45.691 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:45.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:45.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:45.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.691 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 157602 2024-04-26T10:22:45.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.691 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:45.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:45.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665323+0000", 2024-04-26T10:22:45.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:45.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665323+0000", 2024-04-26T10:22:45.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:45.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665322+0000", 2024-04-26T10:22:45.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:45.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:45.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665324+0000", 2024-04-26T10:22:45.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2759999999999999e-06 2024-04-26T10:22:45.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:45.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665330+0000", 2024-04-26T10:22:45.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.322e-06 2024-04-26T10:22:45.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665333+0000", 2024-04-26T10:22:45.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3469999999999999e-06 2024-04-26T10:22:45.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:45.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665371+0000", 2024-04-26T10:22:45.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7768999999999997e-05 2024-04-26T10:22:45.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:45.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.665446+0000", 2024-04-26T10:22:45.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5187999999999999e-05 2024-04-26T10:22:45.694 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.694 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:45.694 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.694 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:157604 5.3 5:c34cab38:::benchmark_data_smithi052_19421_object28132:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-26T10:22:45.694 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:45.667042+0000", 2024-04-26T10:22:45.694 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0020611259999999999, 2024-04-26T10:22:45.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022866739999999998, 2024-04-26T10:22:45.694 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:45.695 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:45.695 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:45.695 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:45.695 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:45.695 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 157604 2024-04-26T10:22:45.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.695 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:45.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:45.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.667042+0000", 2024-04-26T10:22:45.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:45.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.667042+0000", 2024-04-26T10:22:45.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:45.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.667041+0000", 2024-04-26T10:22:45.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:45.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:45.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.667046+0000", 2024-04-26T10:22:45.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6659999999999999e-06 2024-04-26T10:22:45.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:45.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.667067+0000", 2024-04-26T10:22:45.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1401999999999999e-05 2024-04-26T10:22:45.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.667075+0000", 2024-04-26T10:22:45.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7759999999999997e-06 2024-04-26T10:22:45.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:45.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.668207+0000", 2024-04-26T10:22:45.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011318140000000001 2024-04-26T10:22:45.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:45.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.668344+0000", 2024-04-26T10:22:45.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013792500000000001 2024-04-26T10:22:45.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.697 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:45.698 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.698 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:157603 5.0 e52/37 5:0d28adb0:::benchmark_data_smithi052_19421_object28131:head v 52'9787, mlcod=52'9784)", 2024-04-26T10:22:45.698 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:45.667785+0000", 2024-04-26T10:22:45.698 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0013177009999999999, 2024-04-26T10:22:45.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001576434, 2024-04-26T10:22:45.698 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:45.698 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:45.698 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:45.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:45.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.667785+0000", 2024-04-26T10:22:45.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:45.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.667785+0000", 2024-04-26T10:22:45.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:45.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:45.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.667785+0000", 2024-04-26T10:22:45.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:45.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:45.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.667791+0000", 2024-04-26T10:22:45.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6159999999999998e-06 2024-04-26T10:22:45.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:45.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.667840+0000", 2024-04-26T10:22:45.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9101999999999998e-05 2024-04-26T10:22:45.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:45.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.667854+0000", 2024-04-26T10:22:45.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3835999999999999e-05 2024-04-26T10:22:45.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:45.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.667905+0000", 2024-04-26T10:22:45.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0541999999999998e-05 2024-04-26T10:22:45.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:45.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:45.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:45.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:45.667923+0000", 2024-04-26T10:22:45.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7982000000000002e-05 2024-04-26T10:22:45.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.701 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:45.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:45.701 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:45.701 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 8 2024-04-26T10:22:45.701 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:45.702 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:45.738 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:45.736+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:45.828 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:45.828 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:45.828 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:45.828 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:45.828 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:45.840 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:45.840 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:45.839+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:45.940 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:45.936+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:46.019 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:46.019 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:46.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:46.019 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:46.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.019 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:46.019 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:46.020 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.486458888000001, 2024-04-26T10:22:46.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:46.020 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.020 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:46.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:46.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.020 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:46.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.020 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:46.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:46.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:46.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:46.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:46.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:46.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:46.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:46.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:46.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:46.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:46.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:46.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:46.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:46.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:46.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:46.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:46.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:46.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:46.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:46.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:46.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:46.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:46.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:46.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:46.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:46.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:46.025 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.025 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.025 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.025 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:46.025 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:46.026 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.481923676000001, 2024-04-26T10:22:46.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:46.026 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.026 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:46.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:46.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.026 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:46.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.026 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:46.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:46.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:46.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:46.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:46.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:46.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:46.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:46.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:46.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:46.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:46.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:46.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:46.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:46.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:46.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:46.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:46.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:46.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:46.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:46.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:46.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:46.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:46.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:46.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:46.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:46.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:46.031 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.031 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.031 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.031 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:46.031 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:46.032 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.481292384, 2024-04-26T10:22:46.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:46.032 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.032 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.032 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:46.032 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:46.032 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.032 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:46.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.032 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:46.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:46.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:46.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:46.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:46.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:46.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:46.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:46.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:46.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:46.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:46.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:46.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:46.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:46.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:46.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:46.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:46.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:46.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:46.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:46.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:46.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:46.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:46.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:46.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:46.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:46.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:46.037 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.037 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.037 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.037 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110555 5.9 5:919989b3:::benchmark_data_smithi052_19421_object110554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:46.037 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:46.038 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.982495179000001, 2024-04-26T10:22:46.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129736717, 2024-04-26T10:22:46.038 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.038 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:46.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:46.038 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.038 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110555 2024-04-26T10:22:46.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.038 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:46.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:46.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033309+0000", 2024-04-26T10:22:46.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:46.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033393+0000", 2024-04-26T10:22:46.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3690999999999995e-05 2024-04-26T10:22:46.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033401+0000", 2024-04-26T10:22:46.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4319999999999999e-06 2024-04-26T10:22:46.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033406+0000", 2024-04-26T10:22:46.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2340000000000002e-06 2024-04-26T10:22:46.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033467+0000", 2024-04-26T10:22:46.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0915999999999997e-05 2024-04-26T10:22:46.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033550+0000", 2024-04-26T10:22:46.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3057000000000001e-05 2024-04-26T10:22:46.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:46.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033676+0000", 2024-04-26T10:22:46.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126162 2024-04-26T10:22:46.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:46.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037902+0000", 2024-04-26T10:22:46.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042255720000000004 2024-04-26T10:22:46.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:46.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162728+0000", 2024-04-26T10:22:46.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12482583799999999 2024-04-26T10:22:46.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162839+0000", 2024-04-26T10:22:46.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111222 2024-04-26T10:22:46.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163047+0000", 2024-04-26T10:22:46.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207686 2024-04-26T10:22:46.043 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.043 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.043 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.043 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110556 5.1 5:822c74bd:::benchmark_data_smithi052_19421_object110555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:46.043 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:46.043 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.982386072000001, 2024-04-26T10:22:46.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129274783, 2024-04-26T10:22:46.043 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.044 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.044 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:46.044 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:46.044 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.044 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110556 2024-04-26T10:22:46.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.044 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:46.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:46.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033418+0000", 2024-04-26T10:22:46.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:46.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033472+0000", 2024-04-26T10:22:46.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3780999999999999e-05 2024-04-26T10:22:46.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033478+0000", 2024-04-26T10:22:46.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6049999999999997e-06 2024-04-26T10:22:46.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033482+0000", 2024-04-26T10:22:46.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9110000000000001e-06 2024-04-26T10:22:46.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033509+0000", 2024-04-26T10:22:46.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6415e-05 2024-04-26T10:22:46.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033650+0000", 2024-04-26T10:22:46.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014088999999999999 2024-04-26T10:22:46.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:46.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161877+0000", 2024-04-26T10:22:46.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128227707 2024-04-26T10:22:46.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162541+0000", 2024-04-26T10:22:46.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000663863 2024-04-26T10:22:46.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162694+0000", 2024-04-26T10:22:46.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015245699999999999 2024-04-26T10:22:46.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.048 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.048 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110558 5.3 5:c73f56b6:::benchmark_data_smithi052_19421_object110557:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:46.048 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:46.048 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.982189436999999, 2024-04-26T10:22:46.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12864012999999999, 2024-04-26T10:22:46.048 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.049 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:46.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:46.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.049 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110558 2024-04-26T10:22:46.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.049 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:46.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:46.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033615+0000", 2024-04-26T10:22:46.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:46.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033717+0000", 2024-04-26T10:22:46.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102298 2024-04-26T10:22:46.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033725+0000", 2024-04-26T10:22:46.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0090000000000007e-06 2024-04-26T10:22:46.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033731+0000", 2024-04-26T10:22:46.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8919999999999997e-06 2024-04-26T10:22:46.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033769+0000", 2024-04-26T10:22:46.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7682999999999998e-05 2024-04-26T10:22:46.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033891+0000", 2024-04-26T10:22:46.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121718 2024-04-26T10:22:46.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:46.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161912+0000", 2024-04-26T10:22:46.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128021512 2024-04-26T10:22:46.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162043+0000", 2024-04-26T10:22:46.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130588 2024-04-26T10:22:46.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162256+0000", 2024-04-26T10:22:46.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021311499999999999 2024-04-26T10:22:46.053 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.053 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.053 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.053 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110557 5.b e45/37 5:d659544e:::benchmark_data_smithi052_19421_object110556:head v 45'6862, mlcod=45'6860)", 2024-04-26T10:22:46.053 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:46.054 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.981285203999999, 2024-04-26T10:22:46.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12783012499999999, 2024-04-26T10:22:46.054 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.054 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.054 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:46.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:46.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034519+0000", 2024-04-26T10:22:46.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:46.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034526+0000", 2024-04-26T10:22:46.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0380000000000002e-06 2024-04-26T10:22:46.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034539+0000", 2024-04-26T10:22:46.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.27e-05 2024-04-26T10:22:46.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034545+0000", 2024-04-26T10:22:46.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3369999999999996e-06 2024-04-26T10:22:46.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034606+0000", 2024-04-26T10:22:46.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0752999999999999e-05 2024-04-26T10:22:46.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034627+0000", 2024-04-26T10:22:46.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.088e-05 2024-04-26T10:22:46.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162272+0000", 2024-04-26T10:22:46.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12764540199999999 2024-04-26T10:22:46.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162350+0000", 2024-04-26T10:22:46.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7835000000000003e-05 2024-04-26T10:22:46.057 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.057 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.057 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.058 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110554 5.0 e45/37 5:04324c12:::benchmark_data_smithi052_19421_object110553:head v 45'6903, mlcod=45'6898)", 2024-04-26T10:22:46.058 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:46.058 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.979525782, 2024-04-26T10:22:46.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12566923499999999, 2024-04-26T10:22:46.058 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.058 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.058 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:46.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:46.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036278+0000", 2024-04-26T10:22:46.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:46.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036313+0000", 2024-04-26T10:22:46.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5247999999999999e-05 2024-04-26T10:22:46.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036324+0000", 2024-04-26T10:22:46.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0496000000000001e-05 2024-04-26T10:22:46.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036329+0000", 2024-04-26T10:22:46.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3070000000000002e-06 2024-04-26T10:22:46.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036364+0000", 2024-04-26T10:22:46.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4391000000000003e-05 2024-04-26T10:22:46.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036377+0000", 2024-04-26T10:22:46.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3706999999999999e-05 2024-04-26T10:22:46.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042032+0000", 2024-04-26T10:22:46.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056547120000000001 2024-04-26T10:22:46.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161949+0000", 2024-04-26T10:22:46.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119916482 2024-04-26T10:22:46.061 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.062 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.062 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.062 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110559 5.2 5:44c3f174:::benchmark_data_smithi052_19421_object110558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:46.062 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:46.062 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.977907171999998, 2024-04-26T10:22:46.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12530391299999999, 2024-04-26T10:22:46.062 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.062 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:46.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:46.062 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.062 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110559 2024-04-26T10:22:46.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.063 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:46.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:46.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037897+0000", 2024-04-26T10:22:46.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:46.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037922+0000", 2024-04-26T10:22:46.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5004e-05 2024-04-26T10:22:46.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037931+0000", 2024-04-26T10:22:46.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-04-26T10:22:46.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037937+0000", 2024-04-26T10:22:46.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6749999999999999e-06 2024-04-26T10:22:46.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037972+0000", 2024-04-26T10:22:46.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4678000000000002e-05 2024-04-26T10:22:46.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038108+0000", 2024-04-26T10:22:46.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013689099999999999 2024-04-26T10:22:46.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:46.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162887+0000", 2024-04-26T10:22:46.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124778258 2024-04-26T10:22:46.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163010+0000", 2024-04-26T10:22:46.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122924 2024-04-26T10:22:46.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163202+0000", 2024-04-26T10:22:46.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192203 2024-04-26T10:22:46.067 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.067 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.067 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.067 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110560 5.3 5:caf5a141:::benchmark_data_smithi052_19421_object110559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:46.067 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:46.067 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.977856571, 2024-04-26T10:22:46.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12888738299999999, 2024-04-26T10:22:46.067 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.067 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:46.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:46.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.068 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110560 2024-04-26T10:22:46.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.068 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:46.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:46.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037948+0000", 2024-04-26T10:22:46.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:46.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037973+0000", 2024-04-26T10:22:46.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5187000000000001e-05 2024-04-26T10:22:46.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037978+0000", 2024-04-26T10:22:46.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4120000000000003e-06 2024-04-26T10:22:46.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037981+0000", 2024-04-26T10:22:46.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6689999999999999e-06 2024-04-26T10:22:46.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038041+0000", 2024-04-26T10:22:46.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9324999999999999e-05 2024-04-26T10:22:46.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038179+0000", 2024-04-26T10:22:46.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013832499999999999 2024-04-26T10:22:46.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:46.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166427+0000", 2024-04-26T10:22:46.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128248165 2024-04-26T10:22:46.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166539+0000", 2024-04-26T10:22:46.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111538 2024-04-26T10:22:46.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166836+0000", 2024-04-26T10:22:46.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029714100000000001 2024-04-26T10:22:46.072 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.072 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.072 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.072 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110561 5.d 5:b143edec:::benchmark_data_smithi052_19421_object110560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:46.072 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:46.072 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.977814512999998, 2024-04-26T10:22:46.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.125215574, 2024-04-26T10:22:46.072 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.072 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.073 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:46.073 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:46.073 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.073 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110561 2024-04-26T10:22:46.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.073 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:46.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:46.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037990+0000", 2024-04-26T10:22:46.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:46.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038028+0000", 2024-04-26T10:22:46.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7802999999999997e-05 2024-04-26T10:22:46.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038035+0000", 2024-04-26T10:22:46.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-06 2024-04-26T10:22:46.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038040+0000", 2024-04-26T10:22:46.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.147e-06 2024-04-26T10:22:46.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038077+0000", 2024-04-26T10:22:46.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7166999999999998e-05 2024-04-26T10:22:46.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038192+0000", 2024-04-26T10:22:46.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115565 2024-04-26T10:22:46.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:46.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038319+0000", 2024-04-26T10:22:46.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012697699999999999 2024-04-26T10:22:46.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:46.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162690+0000", 2024-04-26T10:22:46.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12437065 2024-04-26T10:22:46.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:46.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162878+0000", 2024-04-26T10:22:46.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000188173 2024-04-26T10:22:46.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162992+0000", 2024-04-26T10:22:46.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114008 2024-04-26T10:22:46.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163206+0000", 2024-04-26T10:22:46.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021394900000000001 2024-04-26T10:22:46.077 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.078 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.078 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:46.078 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:46.078 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.977753909, 2024-04-26T10:22:46.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:22:46.078 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.078 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:46.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:46.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.079 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:22:46.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.079 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:46.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:46.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:46.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:46.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:22:46.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:22:46.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:22:46.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:22:46.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:22:46.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:22:46.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:22:46.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:22:46.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:22:46.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:22:46.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:46.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:22:46.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:22:46.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:22:46.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:22:46.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:22:46.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:22:46.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.082 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.083 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110564 5.3 5:c09e33cb:::benchmark_data_smithi052_19421_object110563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:46.083 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:46.083 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.977701250999999, 2024-04-26T10:22:46.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128984614, 2024-04-26T10:22:46.083 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.083 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:46.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:46.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.083 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110564 2024-04-26T10:22:46.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.083 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:46.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:46.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038103+0000", 2024-04-26T10:22:46.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:46.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038136+0000", 2024-04-26T10:22:46.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.243e-05 2024-04-26T10:22:46.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038143+0000", 2024-04-26T10:22:46.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0870000000000001e-06 2024-04-26T10:22:46.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038151+0000", 2024-04-26T10:22:46.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:22:46.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039813+0000", 2024-04-26T10:22:46.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001661844 2024-04-26T10:22:46.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039970+0000", 2024-04-26T10:22:46.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015712699999999999 2024-04-26T10:22:46.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:46.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166854+0000", 2024-04-26T10:22:46.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.126883788 2024-04-26T10:22:46.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166976+0000", 2024-04-26T10:22:46.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012231399999999999 2024-04-26T10:22:46.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167088+0000", 2024-04-26T10:22:46.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011243699999999999 2024-04-26T10:22:46.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.087 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.088 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:46.088 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:46.088 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.977644657999999, 2024-04-26T10:22:46.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:22:46.088 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.088 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:46.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:46.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.088 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:22:46.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.089 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:46.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:46.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:46.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:46.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:22:46.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:22:46.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:22:46.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:22:46.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:22:46.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:22:46.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:22:46.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:22:46.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:22:46.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:22:46.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:46.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:22:46.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:22:46.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:22:46.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:22:46.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:22:46.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:22:46.092 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.093 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.093 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.093 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110566 5.c 5:34145698:::benchmark_data_smithi052_19421_object110565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:46.093 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:46.093 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.977594881000002, 2024-04-26T10:22:46.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12673530699999999, 2024-04-26T10:22:46.093 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.093 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:46.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:46.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.093 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110566 2024-04-26T10:22:46.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.094 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:46.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:46.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:46.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:46.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038246+0000", 2024-04-26T10:22:46.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5759000000000001e-05 2024-04-26T10:22:46.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038252+0000", 2024-04-26T10:22:46.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5300000000000002e-06 2024-04-26T10:22:46.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038257+0000", 2024-04-26T10:22:46.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:46.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038312+0000", 2024-04-26T10:22:46.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5108000000000002e-05 2024-04-26T10:22:46.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038480+0000", 2024-04-26T10:22:46.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016751099999999999 2024-04-26T10:22:46.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:46.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164651+0000", 2024-04-26T10:22:46.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12617115600000001 2024-04-26T10:22:46.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164770+0000", 2024-04-26T10:22:46.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118748 2024-04-26T10:22:46.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164946+0000", 2024-04-26T10:22:46.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175966 2024-04-26T10:22:46.098 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.098 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.098 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.098 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:46.098 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:46.098 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.975247245999999, 2024-04-26T10:22:46.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:22:46.098 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.098 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:46.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:46.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.099 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:22:46.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.099 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:46.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:46.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:22:46.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:46.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:22:46.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:22:46.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:22:46.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:22:46.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:22:46.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:22:46.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:22:46.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:22:46.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:22:46.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:22:46.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:46.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:22:46.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:22:46.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:46.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:22:46.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:22:46.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:46.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:22:46.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:22:46.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:22:46.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:22:46.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:22:46.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:22:46.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.103 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.104 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.104 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110568 5.c 5:34af8ad3:::benchmark_data_smithi052_19421_object110567:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:46.104 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:46.104 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.975129621000001, 2024-04-26T10:22:46.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124943661, 2024-04-26T10:22:46.104 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.104 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:46.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:46.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.104 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110568 2024-04-26T10:22:46.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.105 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:46.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:46.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:46.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:46.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040711+0000", 2024-04-26T10:22:46.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6531e-05 2024-04-26T10:22:46.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040719+0000", 2024-04-26T10:22:46.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6120000000000001e-06 2024-04-26T10:22:46.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040724+0000", 2024-04-26T10:22:46.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2100000000000001e-06 2024-04-26T10:22:46.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040771+0000", 2024-04-26T10:22:46.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7123000000000003e-05 2024-04-26T10:22:46.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040984+0000", 2024-04-26T10:22:46.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021227400000000001 2024-04-26T10:22:46.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:46.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165350+0000", 2024-04-26T10:22:46.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124366738 2024-04-26T10:22:46.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165459+0000", 2024-04-26T10:22:46.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108168 2024-04-26T10:22:46.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165619+0000", 2024-04-26T10:22:46.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160564 2024-04-26T10:22:46.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.109 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.109 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:46.109 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:46.109 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.975061321999998, 2024-04-26T10:22:46.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:22:46.109 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.109 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:46.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:46.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.110 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:22:46.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.110 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:46.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:46.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:22:46.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:46.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:22:46.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:22:46.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:22:46.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:22:46.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:22:46.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:22:46.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:22:46.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:22:46.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:22:46.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:22:46.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:46.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:22:46.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:22:46.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:46.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:22:46.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:22:46.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:46.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:22:46.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:22:46.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:22:46.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:22:46.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:22:46.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:22:46.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.114 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.115 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110570 5.1 5:876a468c:::benchmark_data_smithi052_19421_object110569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:46.115 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:46.115 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.973758777, 2024-04-26T10:22:46.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12851437099999999, 2024-04-26T10:22:46.115 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.115 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:46.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:46.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.115 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110570 2024-04-26T10:22:46.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.115 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:46.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:46.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042045+0000", 2024-04-26T10:22:46.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:46.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042083+0000", 2024-04-26T10:22:46.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8064e-05 2024-04-26T10:22:46.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161855+0000", 2024-04-26T10:22:46.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119771934 2024-04-26T10:22:46.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161882+0000", 2024-04-26T10:22:46.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7083000000000001e-05 2024-04-26T10:22:46.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163117+0000", 2024-04-26T10:22:46.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001234509 2024-04-26T10:22:46.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163507+0000", 2024-04-26T10:22:46.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038998400000000001 2024-04-26T10:22:46.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:46.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170347+0000", 2024-04-26T10:22:46.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006840952 2024-04-26T10:22:46.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170488+0000", 2024-04-26T10:22:46.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140393 2024-04-26T10:22:46.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170561+0000", 2024-04-26T10:22:46.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2809e-05 2024-04-26T10:22:46.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.119 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.119 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.120 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:124481 5.d 5:b507cdbb:::benchmark_data_smithi052_19421_object124480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:46.120 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:46.120 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 14.935393855000001, 2024-04-26T10:22:46.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.087933879000000006, 2024-04-26T10:22:46.120 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:46.120 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:46.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:46.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:46.120 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.120 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124481 2024-04-26T10:22:46.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.121 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:46.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:46.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:46.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:46.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:46.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:46.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:46.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080410+0000", 2024-04-26T10:22:46.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:46.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:46.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080523+0000", 2024-04-26T10:22:46.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112501 2024-04-26T10:22:46.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:46.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080528+0000", 2024-04-26T10:22:46.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1789999999999999e-06 2024-04-26T10:22:46.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080532+0000", 2024-04-26T10:22:46.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.805e-06 2024-04-26T10:22:46.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:46.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080562+0000", 2024-04-26T10:22:46.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0241000000000001e-05 2024-04-26T10:22:46.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:46.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080645+0000", 2024-04-26T10:22:46.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2816000000000001e-05 2024-04-26T10:22:46.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:46.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080786+0000", 2024-04-26T10:22:46.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014129400000000001 2024-04-26T10:22:46.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:46.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.084288+0000", 2024-04-26T10:22:46.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035017920000000001 2024-04-26T10:22:46.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:46.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.167975+0000", 2024-04-26T10:22:46.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.083686673000000003 2024-04-26T10:22:46.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:46.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.168092+0000", 2024-04-26T10:22:46.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117607 2024-04-26T10:22:46.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:46.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:46.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:46.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.168345+0000", 2024-04-26T10:22:46.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025299200000000001 2024-04-26T10:22:46.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.126 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.126 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:46.126 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:46.126 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:46.127 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T10:22:46.128 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:46.127+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:46.129 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:46.163 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:22:46.228 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:46.227+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:46.251 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:158958 5.f e53/37 5:f677e090:::benchmark_data_smithi052_19421_object29486:head v 53'10016, mlcod=53'10013)", 2024-04-26T10:22:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:46.246525+0000", 2024-04-26T10:22:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0040477600000000001, 2024-04-26T10:22:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040710110000000002, 2024-04-26T10:22:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.246525+0000", 2024-04-26T10:22:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.246525+0000", 2024-04-26T10:22:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.246525+0000", 2024-04-26T10:22:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.246538+0000", 2024-04-26T10:22:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3536000000000001e-05 2024-04-26T10:22:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.246544+0000", 2024-04-26T10:22:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0650000000000004e-06 2024-04-26T10:22:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.246549+0000", 2024-04-26T10:22:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9060000000000001e-06 2024-04-26T10:22:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247489+0000", 2024-04-26T10:22:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00093926000000000003 2024-04-26T10:22:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247506+0000", 2024-04-26T10:22:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7771e-05 2024-04-26T10:22:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:158961 5.b 5:d5ca49fd:::benchmark_data_smithi052_19421_object29489:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:22:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:46.246883+0000", 2024-04-26T10:22:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0036901400000000002, 2024-04-26T10:22:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003776827, 2024-04-26T10:22:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 158961 2024-04-26T10:22:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.246883+0000", 2024-04-26T10:22:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.246883+0000", 2024-04-26T10:22:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.246882+0000", 2024-04-26T10:22:46.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.246888+0000", 2024-04-26T10:22:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0870000000000003e-06 2024-04-26T10:22:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.246926+0000", 2024-04-26T10:22:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7978999999999997e-05 2024-04-26T10:22:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.246937+0000", 2024-04-26T10:22:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1080999999999999e-05 2024-04-26T10:22:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.246989+0000", 2024-04-26T10:22:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1634000000000001e-05 2024-04-26T10:22:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247098+0000", 2024-04-26T10:22:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109554 2024-04-26T10:22:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247168+0000", 2024-04-26T10:22:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0180999999999998e-05 2024-04-26T10:22:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:158964 5.8 5:15814af2:::benchmark_data_smithi052_19421_object29492:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:22:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:46.247740+0000", 2024-04-26T10:22:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0028333299999999998, 2024-04-26T10:22:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029898669999999998, 2024-04-26T10:22:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:46.259 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 158964 2024-04-26T10:22:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247740+0000", 2024-04-26T10:22:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247740+0000", 2024-04-26T10:22:46.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247739+0000", 2024-04-26T10:22:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247744+0000", 2024-04-26T10:22:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6959999999999996e-06 2024-04-26T10:22:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:46.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247751+0000", 2024-04-26T10:22:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3209999999999999e-06 2024-04-26T10:22:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247756+0000", 2024-04-26T10:22:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7809999999999996e-06 2024-04-26T10:22:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247792+0000", 2024-04-26T10:22:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5896999999999999e-05 2024-04-26T10:22:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247903+0000", 2024-04-26T10:22:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111718 2024-04-26T10:22:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:158966 5.a 5:55a6f393:::benchmark_data_smithi052_19421_object29494:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:22:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:46.247772+0000", 2024-04-26T10:22:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0028006569999999998, 2024-04-26T10:22:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030186029999999999, 2024-04-26T10:22:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:46.263 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 158966 2024-04-26T10:22:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247772+0000", 2024-04-26T10:22:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:46.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247772+0000", 2024-04-26T10:22:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247772+0000", 2024-04-26T10:22:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247774+0000", 2024-04-26T10:22:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.475e-06 2024-04-26T10:22:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:46.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247779+0000", 2024-04-26T10:22:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.284e-06 2024-04-26T10:22:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247782+0000", 2024-04-26T10:22:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1659999999999998e-06 2024-04-26T10:22:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247823+0000", 2024-04-26T10:22:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1520000000000002e-05 2024-04-26T10:22:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.247929+0000", 2024-04-26T10:22:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010531600000000001 2024-04-26T10:22:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:158963 5.9 e53/37 5:9db90d3f:::benchmark_data_smithi052_19421_object29491:head v 53'9993, mlcod=53'9991)", 2024-04-26T10:22:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:46.249728+0000", 2024-04-26T10:22:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00084474099999999998, 2024-04-26T10:22:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001125179, 2024-04-26T10:22:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:46.267 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249728+0000", 2024-04-26T10:22:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249728+0000", 2024-04-26T10:22:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249728+0000", 2024-04-26T10:22:46.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249732+0000", 2024-04-26T10:22:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2930000000000002e-06 2024-04-26T10:22:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249738+0000", 2024-04-26T10:22:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.57e-06 2024-04-26T10:22:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249742+0000", 2024-04-26T10:22:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0860000000000004e-06 2024-04-26T10:22:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249787+0000", 2024-04-26T10:22:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5289e-05 2024-04-26T10:22:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249809+0000", 2024-04-26T10:22:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1515e-05 2024-04-26T10:22:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.270 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:158968 5.a 5:521725c3:::benchmark_data_smithi052_19421_object29496:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:22:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:46.249839+0000", 2024-04-26T10:22:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00073441900000000004, 2024-04-26T10:22:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010677880000000001, 2024-04-26T10:22:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 158968 2024-04-26T10:22:46.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249839+0000", 2024-04-26T10:22:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249839+0000", 2024-04-26T10:22:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249837+0000", 2024-04-26T10:22:46.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249842+0000", 2024-04-26T10:22:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9880000000000004e-06 2024-04-26T10:22:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249851+0000", 2024-04-26T10:22:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5010000000000004e-06 2024-04-26T10:22:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249857+0000", 2024-04-26T10:22:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1140000000000002e-06 2024-04-26T10:22:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249891+0000", 2024-04-26T10:22:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4468999999999998e-05 2024-04-26T10:22:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249965+0000", 2024-04-26T10:22:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3277999999999999e-05 2024-04-26T10:22:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:46.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:158971 5.0 5:08c53880:::benchmark_data_smithi052_19421_object29499:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:22:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:46.249968+0000", 2024-04-26T10:22:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00060548299999999998, 2024-04-26T10:22:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001005393, 2024-04-26T10:22:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 158971 2024-04-26T10:22:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.275 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249968+0000", 2024-04-26T10:22:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249968+0000", 2024-04-26T10:22:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249967+0000", 2024-04-26T10:22:46.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249970+0000", 2024-04-26T10:22:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2160000000000002e-06 2024-04-26T10:22:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249978+0000", 2024-04-26T10:22:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4869999999999996e-06 2024-04-26T10:22:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249981+0000", 2024-04-26T10:22:46.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2289999999999999e-06 2024-04-26T10:22:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.250016+0000", 2024-04-26T10:22:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4928000000000002e-05 2024-04-26T10:22:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.250110+0000", 2024-04-26T10:22:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3772999999999998e-05 2024-04-26T10:22:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:46.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.250177+0000", 2024-04-26T10:22:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7784e-05 2024-04-26T10:22:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:158972 5.4 5:2168ca55:::benchmark_data_smithi052_19421_object29500:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:22:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:46.249989+0000", 2024-04-26T10:22:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00058428799999999997, 2024-04-26T10:22:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010498910000000001, 2024-04-26T10:22:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:46.279 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 158972 2024-04-26T10:22:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249989+0000", 2024-04-26T10:22:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:46.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249989+0000", 2024-04-26T10:22:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249988+0000", 2024-04-26T10:22:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249991+0000", 2024-04-26T10:22:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4899999999999999e-06 2024-04-26T10:22:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.249997+0000", 2024-04-26T10:22:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3729999999999998e-06 2024-04-26T10:22:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.250003+0000", 2024-04-26T10:22:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1650000000000003e-06 2024-04-26T10:22:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.250052+0000", 2024-04-26T10:22:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8705000000000002e-05 2024-04-26T10:22:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.250181+0000", 2024-04-26T10:22:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129164 2024-04-26T10:22:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.250291+0000", 2024-04-26T10:22:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010996400000000001 2024-04-26T10:22:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.283 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:158973 5.4 5.e25ca7f4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:22:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:46.250015+0000", 2024-04-26T10:22:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00055820499999999999, 2024-04-26T10:22:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001085007, 2024-04-26T10:22:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 158973 2024-04-26T10:22:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.250015+0000", 2024-04-26T10:22:46.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.250015+0000", 2024-04-26T10:22:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.250014+0000", 2024-04-26T10:22:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:46.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.250017+0000", 2024-04-26T10:22:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.486e-06 2024-04-26T10:22:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.250023+0000", 2024-04-26T10:22:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7309999999999998e-06 2024-04-26T10:22:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:46.250028+0000", 2024-04-26T10:22:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.31e-06 2024-04-26T10:22:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:46.286 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.287 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:46.287 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:46.287 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 9 2024-04-26T10:22:46.287 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:46.288 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:46.320 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:46.329 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:46.324+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:46.341 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:46.341 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:46.342 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:46.347 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:46.347 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:46.412 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:46.412 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:46.427 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:46.431 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:46.424+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:46.531 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:46.531+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:46.551 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:46.551 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:46.563 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:46.633 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:46.628+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:46.697 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:46.697 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:46.710 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:46.733 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:46.731+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:46.834 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:46.828+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:46.846 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:46.846 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:46.860 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:46.934 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:46.932+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:47.035 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:47.035 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:47.035 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:47.032+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:47.048 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:47.136 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:47.132+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:47.175 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:47.176 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:47.187 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:47.236 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~59s 2024-04-26T10:22:47.237 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:47.235+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:47.310 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:47.310 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:47.324 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:47.338 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:47.332+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:47.438 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:47.435+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:47.453 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:47.453 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:47.466 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:47.539 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:47.536+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:47.599 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:47.599 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:47.613 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:47.640 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:47.636+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:47.740 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:47.736+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:47.742 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:47.742 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:47.755 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:47.842 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:47.839+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:47.933 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:47.933 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:47.942 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:47.939+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:47.947 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:48.043 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:48.040+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:48.073 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:48.074 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:48.087 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:48.131 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:22:48.145 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:48.143+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:48.217 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:48.217 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:48.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:48.245 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:48.240+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:48.346 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:48.343+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:48.348 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:22:48.355 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:48.355 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:48.368 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:48.446 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:48.447+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:48.492 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:48.503 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:48.503 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:48.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.503 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:164347 5.c 5:3ba2719a:::benchmark_data_smithi052_19421_object34875:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:22:48.503 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:48.497948+0000", 2024-04-26T10:22:48.503 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0037091670000000002, 2024-04-26T10:22:48.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003728599, 2024-04-26T10:22:48.503 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.503 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:48.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.503 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 164347 2024-04-26T10:22:48.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.504 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.497948+0000", 2024-04-26T10:22:48.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.497948+0000", 2024-04-26T10:22:48.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.497947+0000", 2024-04-26T10:22:48.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:48.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.497953+0000", 2024-04-26T10:22:48.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7470000000000002e-06 2024-04-26T10:22:48.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.497966+0000", 2024-04-26T10:22:48.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3305999999999999e-05 2024-04-26T10:22:48.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.497976+0000", 2024-04-26T10:22:48.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9879999999999999e-06 2024-04-26T10:22:48.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498031+0000", 2024-04-26T10:22:48.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5308e-05 2024-04-26T10:22:48.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498126+0000", 2024-04-26T10:22:48.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5074000000000005e-05 2024-04-26T10:22:48.506 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.506 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.506 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.507 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:164340 5.b e53/37 5:de35942f:::benchmark_data_smithi052_19421_object34868:head v 53'10231, mlcod=53'10229)", 2024-04-26T10:22:48.507 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:48.498485+0000", 2024-04-26T10:22:48.507 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003172107, 2024-04-26T10:22:48.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032325520000000001, 2024-04-26T10:22:48.507 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.507 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:48.507 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498485+0000", 2024-04-26T10:22:48.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498485+0000", 2024-04-26T10:22:48.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498484+0000", 2024-04-26T10:22:48.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:48.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498491+0000", 2024-04-26T10:22:48.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1899999999999998e-06 2024-04-26T10:22:48.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498500+0000", 2024-04-26T10:22:48.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3410000000000003e-06 2024-04-26T10:22:48.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498506+0000", 2024-04-26T10:22:48.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2149999999999998e-06 2024-04-26T10:22:48.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498547+0000", 2024-04-26T10:22:48.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1105e-05 2024-04-26T10:22:48.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498568+0000", 2024-04-26T10:22:48.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1619000000000001e-05 2024-04-26T10:22:48.510 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.510 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.510 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.510 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:164341 5.4 e53/37 5:2aefcaf9:::benchmark_data_smithi052_19421_object34869:head v 53'10373, mlcod=53'10369)", 2024-04-26T10:22:48.510 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:48.498523+0000", 2024-04-26T10:22:48.510 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0031345589999999999, 2024-04-26T10:22:48.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032265039999999998, 2024-04-26T10:22:48.510 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.510 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:48.510 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498523+0000", 2024-04-26T10:22:48.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498523+0000", 2024-04-26T10:22:48.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498522+0000", 2024-04-26T10:22:48.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:48.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498537+0000", 2024-04-26T10:22:48.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4679e-05 2024-04-26T10:22:48.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498544+0000", 2024-04-26T10:22:48.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7209999999999997e-06 2024-04-26T10:22:48.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498549+0000", 2024-04-26T10:22:48.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0069999999999997e-06 2024-04-26T10:22:48.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498582+0000", 2024-04-26T10:22:48.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3726999999999997e-05 2024-04-26T10:22:48.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498594+0000", 2024-04-26T10:22:48.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1732e-05 2024-04-26T10:22:48.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.513 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.513 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:164342 5.b e53/37 5:dfbc7b45:::benchmark_data_smithi052_19421_object34870:head v 53'10232, mlcod=53'10229)", 2024-04-26T10:22:48.513 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:48.498558+0000", 2024-04-26T10:22:48.513 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0030990459999999998, 2024-04-26T10:22:48.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0032199580000000002, 2024-04-26T10:22:48.514 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.514 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:48.514 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498558+0000", 2024-04-26T10:22:48.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498558+0000", 2024-04-26T10:22:48.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498558+0000", 2024-04-26T10:22:48.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:48.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498561+0000", 2024-04-26T10:22:48.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6229999999999999e-06 2024-04-26T10:22:48.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498568+0000", 2024-04-26T10:22:48.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1840000000000004e-06 2024-04-26T10:22:48.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498572+0000", 2024-04-26T10:22:48.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0260000000000001e-06 2024-04-26T10:22:48.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.500820+0000", 2024-04-26T10:22:48.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022488289999999999 2024-04-26T10:22:48.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.500841+0000", 2024-04-26T10:22:48.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0432e-05 2024-04-26T10:22:48.516 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.517 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.517 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.517 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:164348 5.c 5:391a0408:::benchmark_data_smithi052_19421_object34876:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:22:48.517 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:48.498790+0000", 2024-04-26T10:22:48.517 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002867138, 2024-04-26T10:22:48.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030189990000000001, 2024-04-26T10:22:48.517 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.517 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:48.517 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.517 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.517 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.517 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 164348 2024-04-26T10:22:48.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.517 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498790+0000", 2024-04-26T10:22:48.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498790+0000", 2024-04-26T10:22:48.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498789+0000", 2024-04-26T10:22:48.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:48.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498793+0000", 2024-04-26T10:22:48.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9750000000000001e-06 2024-04-26T10:22:48.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498815+0000", 2024-04-26T10:22:48.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2333000000000001e-05 2024-04-26T10:22:48.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498824+0000", 2024-04-26T10:22:48.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8710000000000003e-06 2024-04-26T10:22:48.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.500243+0000", 2024-04-26T10:22:48.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001418693 2024-04-26T10:22:48.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.500324+0000", 2024-04-26T10:22:48.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0593999999999994e-05 2024-04-26T10:22:48.520 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.520 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.520 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.520 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:164349 5.9 5:9e378b2d:::benchmark_data_smithi052_19421_object34877:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:22:48.520 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:48.498833+0000", 2024-04-26T10:22:48.520 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002824086, 2024-04-26T10:22:48.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030085770000000001, 2024-04-26T10:22:48.521 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.521 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:48.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.521 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 164349 2024-04-26T10:22:48.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.521 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498833+0000", 2024-04-26T10:22:48.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498833+0000", 2024-04-26T10:22:48.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498832+0000", 2024-04-26T10:22:48.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:48.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498837+0000", 2024-04-26T10:22:48.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2159999999999997e-06 2024-04-26T10:22:48.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498844+0000", 2024-04-26T10:22:48.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1840000000000002e-06 2024-04-26T10:22:48.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498849+0000", 2024-04-26T10:22:48.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5630000000000002e-06 2024-04-26T10:22:48.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498975+0000", 2024-04-26T10:22:48.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012560300000000001 2024-04-26T10:22:48.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.499108+0000", 2024-04-26T10:22:48.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133473 2024-04-26T10:22:48.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:48.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.499230+0000", 2024-04-26T10:22:48.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122232 2024-04-26T10:22:48.524 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.524 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.524 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.524 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:164350 5.c 5:3b1adfcf:::benchmark_data_smithi052_19421_object34878:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:22:48.525 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:48.498886+0000", 2024-04-26T10:22:48.525 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00277064, 2024-04-26T10:22:48.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029903429999999999, 2024-04-26T10:22:48.525 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.525 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:48.525 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.525 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.525 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.525 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 164350 2024-04-26T10:22:48.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.525 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498886+0000", 2024-04-26T10:22:48.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498886+0000", 2024-04-26T10:22:48.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498886+0000", 2024-04-26T10:22:48.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:48.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498890+0000", 2024-04-26T10:22:48.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8809999999999998e-06 2024-04-26T10:22:48.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498898+0000", 2024-04-26T10:22:48.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8630000000000008e-06 2024-04-26T10:22:48.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498904+0000", 2024-04-26T10:22:48.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3640000000000004e-06 2024-04-26T10:22:48.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.501430+0000", 2024-04-26T10:22:48.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002526206 2024-04-26T10:22:48.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.501515+0000", 2024-04-26T10:22:48.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4851999999999993e-05 2024-04-26T10:22:48.528 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.528 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.528 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.528 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:164345 5.4 e53/37 5:288a2da7:::benchmark_data_smithi052_19421_object34873:head v 53'10374, mlcod=53'10369)", 2024-04-26T10:22:48.528 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:48.498913+0000", 2024-04-26T10:22:48.529 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0027440049999999999, 2024-04-26T10:22:48.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029971049999999999, 2024-04-26T10:22:48.529 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.529 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:48.529 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498913+0000", 2024-04-26T10:22:48.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498913+0000", 2024-04-26T10:22:48.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498913+0000", 2024-04-26T10:22:48.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:48.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498917+0000", 2024-04-26T10:22:48.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.425e-06 2024-04-26T10:22:48.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498923+0000", 2024-04-26T10:22:48.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8050000000000003e-06 2024-04-26T10:22:48.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.498927+0000", 2024-04-26T10:22:48.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2860000000000001e-06 2024-04-26T10:22:48.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.500259+0000", 2024-04-26T10:22:48.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001332291 2024-04-26T10:22:48.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.500283+0000", 2024-04-26T10:22:48.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3892000000000001e-05 2024-04-26T10:22:48.532 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.532 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.532 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.532 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:164335 5.f e53/37)", 2024-04-26T10:22:48.532 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:48.500587+0000", 2024-04-26T10:22:48.532 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00107025, 2024-04-26T10:22:48.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013506810000000001, 2024-04-26T10:22:48.532 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.532 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:48.533 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.500587+0000", 2024-04-26T10:22:48.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.500587+0000", 2024-04-26T10:22:48.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.500586+0000", 2024-04-26T10:22:48.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:48.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.500591+0000", 2024-04-26T10:22:48.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8620000000000002e-06 2024-04-26T10:22:48.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.500611+0000", 2024-04-26T10:22:48.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0250000000000001e-05 2024-04-26T10:22:48.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.500618+0000", 2024-04-26T10:22:48.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4880000000000004e-06 2024-04-26T10:22:48.535 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.535 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.535 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.535 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:164335 5.f 5:fd07e710:::benchmark_data_smithi052_19421_object34863:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:22:48.535 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:48.492687+0000", 2024-04-26T10:22:48.535 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0089704229999999999, 2024-04-26T10:22:48.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0092775600000000007, 2024-04-26T10:22:48.535 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.535 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:48.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.535 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 164335 2024-04-26T10:22:48.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.536 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.492687+0000", 2024-04-26T10:22:48.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.492687+0000", 2024-04-26T10:22:48.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.492686+0000", 2024-04-26T10:22:48.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:48.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.492691+0000", 2024-04-26T10:22:48.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0080000000000002e-06 2024-04-26T10:22:48.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.492700+0000", 2024-04-26T10:22:48.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6879999999999994e-06 2024-04-26T10:22:48.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.492707+0000", 2024-04-26T10:22:48.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6669999999999999e-06 2024-04-26T10:22:48.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.494828+0000", 2024-04-26T10:22:48.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021212969999999999 2024-04-26T10:22:48.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.494939+0000", 2024-04-26T10:22:48.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110485 2024-04-26T10:22:48.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:48.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.495051+0000", 2024-04-26T10:22:48.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011247900000000001 2024-04-26T10:22:48.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:48.497997+0000", 2024-04-26T10:22:48.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029457400000000001 2024-04-26T10:22:48.539 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.539 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.539 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.539 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.539 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:48.539 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 10 2024-04-26T10:22:48.539 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:48.540 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:48.540 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:48.541 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:48.541 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:48.541 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:48.541 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:48.542 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:48.547 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:48.544+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:48.648 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:48.647+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:48.674 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:48.674 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:48.674 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:48.674 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:48.674 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:48.688 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:48.749 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:48.744+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:48.850 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:48.847+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:48.867 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:48.867 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:48.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:48.867 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:48.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.868 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:48.868 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:48.868 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.334868055999998, 2024-04-26T10:22:48.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:48.868 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.868 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.868 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:48.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.868 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:48.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:48.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:48.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:48.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:48.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:48.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:48.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:48.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:48.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:48.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:48.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:48.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:48.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:48.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:48.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:48.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:48.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:48.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:48.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:48.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:48.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:48.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:48.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:48.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:48.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:48.873 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.873 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.873 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.873 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:48.873 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:48.874 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.330332843999997, 2024-04-26T10:22:48.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:48.874 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.874 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.874 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.874 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.874 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.874 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:48.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.874 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:48.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:48.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:48.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:48.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:48.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:48.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:48.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:48.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:48.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:48.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:48.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:48.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:48.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:48.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:48.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:48.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:48.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:48.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:48.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:48.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:48.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:48.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:48.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:48.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:48.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:48.879 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.879 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.879 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.879 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:48.879 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:48.879 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.329701552000003, 2024-04-26T10:22:48.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:48.880 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.880 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.880 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:48.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.880 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:48.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:48.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:48.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:48.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:48.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:48.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:48.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:48.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:48.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:48.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:48.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:48.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:48.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:48.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:48.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:48.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:48.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:48.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:48.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:48.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:48.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:48.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:48.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:48.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:48.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:48.885 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.885 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.885 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.885 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110555 5.9 5:919989b3:::benchmark_data_smithi052_19421_object110554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:48.885 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:48.885 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.830904347000001, 2024-04-26T10:22:48.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129736717, 2024-04-26T10:22:48.886 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.886 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.886 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110555 2024-04-26T10:22:48.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.886 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:48.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:48.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033309+0000", 2024-04-26T10:22:48.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:48.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033393+0000", 2024-04-26T10:22:48.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3690999999999995e-05 2024-04-26T10:22:48.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033401+0000", 2024-04-26T10:22:48.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4319999999999999e-06 2024-04-26T10:22:48.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033406+0000", 2024-04-26T10:22:48.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2340000000000002e-06 2024-04-26T10:22:48.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033467+0000", 2024-04-26T10:22:48.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0915999999999997e-05 2024-04-26T10:22:48.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033550+0000", 2024-04-26T10:22:48.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3057000000000001e-05 2024-04-26T10:22:48.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:48.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033676+0000", 2024-04-26T10:22:48.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126162 2024-04-26T10:22:48.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:48.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037902+0000", 2024-04-26T10:22:48.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042255720000000004 2024-04-26T10:22:48.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162728+0000", 2024-04-26T10:22:48.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12482583799999999 2024-04-26T10:22:48.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162839+0000", 2024-04-26T10:22:48.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111222 2024-04-26T10:22:48.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163047+0000", 2024-04-26T10:22:48.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207686 2024-04-26T10:22:48.891 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.891 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.891 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.891 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110556 5.1 5:822c74bd:::benchmark_data_smithi052_19421_object110555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:48.891 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:48.891 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.83079524, 2024-04-26T10:22:48.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129274783, 2024-04-26T10:22:48.891 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.891 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.891 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.892 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.892 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110556 2024-04-26T10:22:48.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.892 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:48.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:48.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033418+0000", 2024-04-26T10:22:48.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:48.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033472+0000", 2024-04-26T10:22:48.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3780999999999999e-05 2024-04-26T10:22:48.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033478+0000", 2024-04-26T10:22:48.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6049999999999997e-06 2024-04-26T10:22:48.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033482+0000", 2024-04-26T10:22:48.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9110000000000001e-06 2024-04-26T10:22:48.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033509+0000", 2024-04-26T10:22:48.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6415e-05 2024-04-26T10:22:48.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033650+0000", 2024-04-26T10:22:48.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014088999999999999 2024-04-26T10:22:48.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161877+0000", 2024-04-26T10:22:48.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128227707 2024-04-26T10:22:48.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162541+0000", 2024-04-26T10:22:48.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000663863 2024-04-26T10:22:48.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162694+0000", 2024-04-26T10:22:48.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015245699999999999 2024-04-26T10:22:48.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.896 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.896 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.896 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110558 5.3 5:c73f56b6:::benchmark_data_smithi052_19421_object110557:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:48.896 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:48.896 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.830598604999999, 2024-04-26T10:22:48.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12864012999999999, 2024-04-26T10:22:48.896 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.896 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.897 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.897 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110558 2024-04-26T10:22:48.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.897 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:48.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:48.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033615+0000", 2024-04-26T10:22:48.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:48.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033717+0000", 2024-04-26T10:22:48.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102298 2024-04-26T10:22:48.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033725+0000", 2024-04-26T10:22:48.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0090000000000007e-06 2024-04-26T10:22:48.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033731+0000", 2024-04-26T10:22:48.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8919999999999997e-06 2024-04-26T10:22:48.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033769+0000", 2024-04-26T10:22:48.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7682999999999998e-05 2024-04-26T10:22:48.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033891+0000", 2024-04-26T10:22:48.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121718 2024-04-26T10:22:48.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161912+0000", 2024-04-26T10:22:48.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128021512 2024-04-26T10:22:48.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162043+0000", 2024-04-26T10:22:48.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130588 2024-04-26T10:22:48.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162256+0000", 2024-04-26T10:22:48.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021311499999999999 2024-04-26T10:22:48.901 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.901 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.901 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.901 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110557 5.b e45/37 5:d659544e:::benchmark_data_smithi052_19421_object110556:head v 45'6862, mlcod=45'6860)", 2024-04-26T10:22:48.901 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:48.901 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.829694371999999, 2024-04-26T10:22:48.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12783012499999999, 2024-04-26T10:22:48.901 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.901 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.901 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:48.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:48.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034519+0000", 2024-04-26T10:22:48.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:48.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034526+0000", 2024-04-26T10:22:48.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0380000000000002e-06 2024-04-26T10:22:48.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034539+0000", 2024-04-26T10:22:48.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.27e-05 2024-04-26T10:22:48.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034545+0000", 2024-04-26T10:22:48.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3369999999999996e-06 2024-04-26T10:22:48.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034606+0000", 2024-04-26T10:22:48.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0752999999999999e-05 2024-04-26T10:22:48.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034627+0000", 2024-04-26T10:22:48.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.088e-05 2024-04-26T10:22:48.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162272+0000", 2024-04-26T10:22:48.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12764540199999999 2024-04-26T10:22:48.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162350+0000", 2024-04-26T10:22:48.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7835000000000003e-05 2024-04-26T10:22:48.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.905 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.905 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110554 5.0 e45/37 5:04324c12:::benchmark_data_smithi052_19421_object110553:head v 45'6903, mlcod=45'6898)", 2024-04-26T10:22:48.905 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:48.905 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.82793495, 2024-04-26T10:22:48.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12566923499999999, 2024-04-26T10:22:48.905 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.905 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.905 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:48.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:48.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036278+0000", 2024-04-26T10:22:48.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:48.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036313+0000", 2024-04-26T10:22:48.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5247999999999999e-05 2024-04-26T10:22:48.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036324+0000", 2024-04-26T10:22:48.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0496000000000001e-05 2024-04-26T10:22:48.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036329+0000", 2024-04-26T10:22:48.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3070000000000002e-06 2024-04-26T10:22:48.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036364+0000", 2024-04-26T10:22:48.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4391000000000003e-05 2024-04-26T10:22:48.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036377+0000", 2024-04-26T10:22:48.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3706999999999999e-05 2024-04-26T10:22:48.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042032+0000", 2024-04-26T10:22:48.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056547120000000001 2024-04-26T10:22:48.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161949+0000", 2024-04-26T10:22:48.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119916482 2024-04-26T10:22:48.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.909 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.909 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110559 5.2 5:44c3f174:::benchmark_data_smithi052_19421_object110558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:48.909 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:48.909 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.826316339999998, 2024-04-26T10:22:48.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12530391299999999, 2024-04-26T10:22:48.909 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.909 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.910 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.910 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110559 2024-04-26T10:22:48.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.910 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:48.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:48.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037897+0000", 2024-04-26T10:22:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037922+0000", 2024-04-26T10:22:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5004e-05 2024-04-26T10:22:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037931+0000", 2024-04-26T10:22:48.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-04-26T10:22:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037937+0000", 2024-04-26T10:22:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6749999999999999e-06 2024-04-26T10:22:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037972+0000", 2024-04-26T10:22:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4678000000000002e-05 2024-04-26T10:22:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038108+0000", 2024-04-26T10:22:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013689099999999999 2024-04-26T10:22:48.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162887+0000", 2024-04-26T10:22:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124778258 2024-04-26T10:22:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163010+0000", 2024-04-26T10:22:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122924 2024-04-26T10:22:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163202+0000", 2024-04-26T10:22:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192203 2024-04-26T10:22:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110560 5.3 5:caf5a141:::benchmark_data_smithi052_19421_object110559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.826265739, 2024-04-26T10:22:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12888738299999999, 2024-04-26T10:22:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.914 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110560 2024-04-26T10:22:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037948+0000", 2024-04-26T10:22:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037973+0000", 2024-04-26T10:22:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5187000000000001e-05 2024-04-26T10:22:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037978+0000", 2024-04-26T10:22:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4120000000000003e-06 2024-04-26T10:22:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037981+0000", 2024-04-26T10:22:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6689999999999999e-06 2024-04-26T10:22:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038041+0000", 2024-04-26T10:22:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9324999999999999e-05 2024-04-26T10:22:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038179+0000", 2024-04-26T10:22:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013832499999999999 2024-04-26T10:22:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166427+0000", 2024-04-26T10:22:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128248165 2024-04-26T10:22:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166539+0000", 2024-04-26T10:22:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111538 2024-04-26T10:22:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166836+0000", 2024-04-26T10:22:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029714100000000001 2024-04-26T10:22:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110561 5.d 5:b143edec:::benchmark_data_smithi052_19421_object110560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.826223680999998, 2024-04-26T10:22:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.125215574, 2024-04-26T10:22:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110561 2024-04-26T10:22:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037990+0000", 2024-04-26T10:22:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038028+0000", 2024-04-26T10:22:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7802999999999997e-05 2024-04-26T10:22:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038035+0000", 2024-04-26T10:22:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-06 2024-04-26T10:22:48.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038040+0000", 2024-04-26T10:22:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.147e-06 2024-04-26T10:22:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038077+0000", 2024-04-26T10:22:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7166999999999998e-05 2024-04-26T10:22:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038192+0000", 2024-04-26T10:22:48.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115565 2024-04-26T10:22:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038319+0000", 2024-04-26T10:22:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012697699999999999 2024-04-26T10:22:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162690+0000", 2024-04-26T10:22:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12437065 2024-04-26T10:22:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162878+0000", 2024-04-26T10:22:48.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000188173 2024-04-26T10:22:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162992+0000", 2024-04-26T10:22:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114008 2024-04-26T10:22:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163206+0000", 2024-04-26T10:22:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021394900000000001 2024-04-26T10:22:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.924 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.826163077, 2024-04-26T10:22:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:22:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:22:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:22:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:22:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:22:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:22:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:22:48.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:22:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:22:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:22:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:22:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:22:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:22:48.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:22:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:22:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:22:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:22:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:22:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110564 5.3 5:c09e33cb:::benchmark_data_smithi052_19421_object110563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.826110418999999, 2024-04-26T10:22:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128984614, 2024-04-26T10:22:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110564 2024-04-26T10:22:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038103+0000", 2024-04-26T10:22:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038136+0000", 2024-04-26T10:22:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.243e-05 2024-04-26T10:22:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038143+0000", 2024-04-26T10:22:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0870000000000001e-06 2024-04-26T10:22:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038151+0000", 2024-04-26T10:22:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:22:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039813+0000", 2024-04-26T10:22:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001661844 2024-04-26T10:22:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039970+0000", 2024-04-26T10:22:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015712699999999999 2024-04-26T10:22:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166854+0000", 2024-04-26T10:22:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.126883788 2024-04-26T10:22:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166976+0000", 2024-04-26T10:22:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012231399999999999 2024-04-26T10:22:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167088+0000", 2024-04-26T10:22:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011243699999999999 2024-04-26T10:22:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:48.934 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.826053825999999, 2024-04-26T10:22:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:22:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:22:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:48.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:22:48.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:22:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:22:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:22:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:22:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:22:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:22:48.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:22:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:22:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:22:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:22:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:22:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:22:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:22:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:22:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:22:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110566 5.c 5:34145698:::benchmark_data_smithi052_19421_object110565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.826004049000002, 2024-04-26T10:22:48.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12673530699999999, 2024-04-26T10:22:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110566 2024-04-26T10:22:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038246+0000", 2024-04-26T10:22:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5759000000000001e-05 2024-04-26T10:22:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038252+0000", 2024-04-26T10:22:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5300000000000002e-06 2024-04-26T10:22:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038257+0000", 2024-04-26T10:22:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038312+0000", 2024-04-26T10:22:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5108000000000002e-05 2024-04-26T10:22:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038480+0000", 2024-04-26T10:22:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016751099999999999 2024-04-26T10:22:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164651+0000", 2024-04-26T10:22:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12617115600000001 2024-04-26T10:22:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164770+0000", 2024-04-26T10:22:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118748 2024-04-26T10:22:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164946+0000", 2024-04-26T10:22:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175966 2024-04-26T10:22:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.823656413999998, 2024-04-26T10:22:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:22:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:22:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:48.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:22:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:22:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:22:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:22:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:22:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:22:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:22:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:22:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:22:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:22:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:22:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:22:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:22:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:22:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:22:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:22:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:22:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:22:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:22:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:22:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:22:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110568 5.c 5:34af8ad3:::benchmark_data_smithi052_19421_object110567:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.823538789000001, 2024-04-26T10:22:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124943661, 2024-04-26T10:22:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110568 2024-04-26T10:22:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040711+0000", 2024-04-26T10:22:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6531e-05 2024-04-26T10:22:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040719+0000", 2024-04-26T10:22:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6120000000000001e-06 2024-04-26T10:22:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040724+0000", 2024-04-26T10:22:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2100000000000001e-06 2024-04-26T10:22:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040771+0000", 2024-04-26T10:22:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7123000000000003e-05 2024-04-26T10:22:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040984+0000", 2024-04-26T10:22:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021227400000000001 2024-04-26T10:22:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165350+0000", 2024-04-26T10:22:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124366738 2024-04-26T10:22:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165459+0000", 2024-04-26T10:22:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108168 2024-04-26T10:22:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165619+0000", 2024-04-26T10:22:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160564 2024-04-26T10:22:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:48.954 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.823470489999998, 2024-04-26T10:22:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:22:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:22:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:48.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:22:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:22:48.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:22:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:22:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:22:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:22:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:22:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:22:48.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:22:48.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:22:48.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:22:48.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:48.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:22:48.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:22:48.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:22:48.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:22:48.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:48.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:22:48.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:22:48.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:22:48.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:22:48.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:22:48.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:22:48.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.960 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.960 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110570 5.1 5:876a468c:::benchmark_data_smithi052_19421_object110569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:48.960 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:48.960 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 24.822167945, 2024-04-26T10:22:48.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12851437099999999, 2024-04-26T10:22:48.960 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.960 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.960 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.960 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.960 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.960 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110570 2024-04-26T10:22:48.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.961 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:48.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:48.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042045+0000", 2024-04-26T10:22:48.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:48.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042083+0000", 2024-04-26T10:22:48.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8064e-05 2024-04-26T10:22:48.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161855+0000", 2024-04-26T10:22:48.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119771934 2024-04-26T10:22:48.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161882+0000", 2024-04-26T10:22:48.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7083000000000001e-05 2024-04-26T10:22:48.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163117+0000", 2024-04-26T10:22:48.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001234509 2024-04-26T10:22:48.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163507+0000", 2024-04-26T10:22:48.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038998400000000001 2024-04-26T10:22:48.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170347+0000", 2024-04-26T10:22:48.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006840952 2024-04-26T10:22:48.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170488+0000", 2024-04-26T10:22:48.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140393 2024-04-26T10:22:48.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170561+0000", 2024-04-26T10:22:48.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2809e-05 2024-04-26T10:22:48.964 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.964 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.964 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.965 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:124481 5.d 5:b507cdbb:::benchmark_data_smithi052_19421_object124480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:48.965 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:48.965 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.783803023000001, 2024-04-26T10:22:48.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.087933879000000006, 2024-04-26T10:22:48.965 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:48.965 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:48.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:48.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:48.965 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:48.965 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124481 2024-04-26T10:22:48.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.965 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:48.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:48.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:48.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:48.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:48.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:48.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:48.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080410+0000", 2024-04-26T10:22:48.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:48.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:48.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080523+0000", 2024-04-26T10:22:48.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112501 2024-04-26T10:22:48.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:48.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080528+0000", 2024-04-26T10:22:48.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1789999999999999e-06 2024-04-26T10:22:48.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:48.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080532+0000", 2024-04-26T10:22:48.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.805e-06 2024-04-26T10:22:48.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:48.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080562+0000", 2024-04-26T10:22:48.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0241000000000001e-05 2024-04-26T10:22:48.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:48.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080645+0000", 2024-04-26T10:22:48.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2816000000000001e-05 2024-04-26T10:22:48.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:48.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080786+0000", 2024-04-26T10:22:48.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014129400000000001 2024-04-26T10:22:48.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:48.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.084288+0000", 2024-04-26T10:22:48.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035017920000000001 2024-04-26T10:22:48.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:48.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.167975+0000", 2024-04-26T10:22:48.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.083686673000000003 2024-04-26T10:22:48.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:48.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.168092+0000", 2024-04-26T10:22:48.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117607 2024-04-26T10:22:48.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:48.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:48.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:48.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.168345+0000", 2024-04-26T10:22:48.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025299200000000001 2024-04-26T10:22:48.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.970 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:48.970 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:48.970 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:48.972 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:48.972 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:48.968+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:49.072 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:49.068+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:49.109 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:49.109 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:49.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.110 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:165802 5.a 5:5813617f:::benchmark_data_smithi052_19421_object36330:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:22:49.110 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:49.103486+0000", 2024-04-26T10:22:49.110 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.006257281, 2024-04-26T10:22:49.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0062751780000000002, 2024-04-26T10:22:49.110 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.110 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.110 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.110 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.110 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.110 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 165802 2024-04-26T10:22:49.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.110 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103486+0000", 2024-04-26T10:22:49.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103486+0000", 2024-04-26T10:22:49.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103485+0000", 2024-04-26T10:22:49.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:49.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103489+0000", 2024-04-26T10:22:49.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.472e-06 2024-04-26T10:22:49.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103497+0000", 2024-04-26T10:22:49.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6049999999999998e-06 2024-04-26T10:22:49.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103504+0000", 2024-04-26T10:22:49.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4640000000000003e-06 2024-04-26T10:22:49.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.105768+0000", 2024-04-26T10:22:49.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002263714 2024-04-26T10:22:49.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.105906+0000", 2024-04-26T10:22:49.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013821300000000001 2024-04-26T10:22:49.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.109688+0000", 2024-04-26T10:22:49.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003782517 2024-04-26T10:22:49.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.109711+0000", 2024-04-26T10:22:49.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2694999999999999e-05 2024-04-26T10:22:49.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.109765+0000", 2024-04-26T10:22:49.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4292999999999997e-05 2024-04-26T10:22:49.114 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.115 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.115 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.115 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:165804 5.0 5:0c239ad5:::benchmark_data_smithi052_19421_object36332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:22:49.115 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:49.103522+0000", 2024-04-26T10:22:49.115 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0062210399999999997, 2024-04-26T10:22:49.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0062957109999999998, 2024-04-26T10:22:49.115 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.115 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:49.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.115 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 165804 2024-04-26T10:22:49.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.116 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103522+0000", 2024-04-26T10:22:49.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103522+0000", 2024-04-26T10:22:49.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103522+0000", 2024-04-26T10:22:49.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:49.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103525+0000", 2024-04-26T10:22:49.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.157e-06 2024-04-26T10:22:49.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103532+0000", 2024-04-26T10:22:49.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0929999999999997e-06 2024-04-26T10:22:49.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103538+0000", 2024-04-26T10:22:49.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.728e-06 2024-04-26T10:22:49.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103756+0000", 2024-04-26T10:22:49.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021886 2024-04-26T10:22:49.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103947+0000", 2024-04-26T10:22:49.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019090399999999999 2024-04-26T10:22:49.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:49.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.104106+0000", 2024-04-26T10:22:49.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015850099999999999 2024-04-26T10:22:49.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.109512+0000", 2024-04-26T10:22:49.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054062889999999999 2024-04-26T10:22:49.119 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.119 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.119 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.120 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:165805 5.a 5:53f7fec3:::benchmark_data_smithi052_19421_object36333:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:22:49.120 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:49.103795+0000", 2024-04-26T10:22:49.120 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0059482579999999997, 2024-04-26T10:22:49.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0060656379999999999, 2024-04-26T10:22:49.120 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.120 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:49.120 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.120 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.120 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.120 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 165805 2024-04-26T10:22:49.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.120 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103795+0000", 2024-04-26T10:22:49.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103795+0000", 2024-04-26T10:22:49.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103794+0000", 2024-04-26T10:22:49.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103800+0000", 2024-04-26T10:22:49.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3160000000000002e-06 2024-04-26T10:22:49.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103811+0000", 2024-04-26T10:22:49.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0750999999999999e-05 2024-04-26T10:22:49.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.103819+0000", 2024-04-26T10:22:49.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7519999999999996e-06 2024-04-26T10:22:49.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.107555+0000", 2024-04-26T10:22:49.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0037363930000000002 2024-04-26T10:22:49.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.107676+0000", 2024-04-26T10:22:49.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120934 2024-04-26T10:22:49.123 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.123 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.123 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.124 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:165811 5.0 5:07d7368d:::benchmark_data_smithi052_19421_object36339:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:22:49.124 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:49.105772+0000", 2024-04-26T10:22:49.124 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0039715419999999998, 2024-04-26T10:22:49.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004124455, 2024-04-26T10:22:49.124 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.124 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:49.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.124 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 165811 2024-04-26T10:22:49.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.124 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.105772+0000", 2024-04-26T10:22:49.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.105772+0000", 2024-04-26T10:22:49.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.105771+0000", 2024-04-26T10:22:49.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.105776+0000", 2024-04-26T10:22:49.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7529999999999998e-06 2024-04-26T10:22:49.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.105785+0000", 2024-04-26T10:22:49.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:22:49.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.105791+0000", 2024-04-26T10:22:49.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5450000000000003e-06 2024-04-26T10:22:49.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.106157+0000", 2024-04-26T10:22:49.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000365931 2024-04-26T10:22:49.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.106326+0000", 2024-04-26T10:22:49.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016983300000000001 2024-04-26T10:22:49.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:49.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.106412+0000", 2024-04-26T10:22:49.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5552999999999999e-05 2024-04-26T10:22:49.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.109549+0000", 2024-04-26T10:22:49.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003136808 2024-04-26T10:22:49.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.128 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.128 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:165816 5.b 5:df3f2383:::benchmark_data_smithi052_19421_object36344:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:22:49.129 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:49.106968+0000", 2024-04-26T10:22:49.129 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.002775203, 2024-04-26T10:22:49.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002966383, 2024-04-26T10:22:49.129 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.129 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:49.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.129 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 165816 2024-04-26T10:22:49.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.129 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.106968+0000", 2024-04-26T10:22:49.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.106968+0000", 2024-04-26T10:22:49.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.106967+0000", 2024-04-26T10:22:49.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:49.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.106971+0000", 2024-04-26T10:22:49.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.765e-06 2024-04-26T10:22:49.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.106981+0000", 2024-04-26T10:22:49.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0054000000000001e-05 2024-04-26T10:22:49.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.106988+0000", 2024-04-26T10:22:49.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3720000000000001e-06 2024-04-26T10:22:49.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.107047+0000", 2024-04-26T10:22:49.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9224000000000001e-05 2024-04-26T10:22:49.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.107194+0000", 2024-04-26T10:22:49.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000147374 2024-04-26T10:22:49.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:49.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.107335+0000", 2024-04-26T10:22:49.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014037899999999999 2024-04-26T10:22:49.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.109833+0000", 2024-04-26T10:22:49.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024985879999999999 2024-04-26T10:22:49.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.133 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.133 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:165820 5.4 5.20348c64 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-26T10:22:49.133 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:49.109931+0000", 2024-04-26T10:22:49.133 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9998121, 2024-04-26T10:22:49.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1325000000000002e-05, 2024-04-26T10:22:49.134 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.134 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:49.134 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.134 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.134 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.134 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 165820 2024-04-26T10:22:49.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.134 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.109931+0000", 2024-04-26T10:22:49.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.109931+0000", 2024-04-26T10:22:49.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.109929+0000", 2024-04-26T10:22:49.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:22:49.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.109937+0000", 2024-04-26T10:22:49.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4669999999999998e-06 2024-04-26T10:22:49.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.109950+0000", 2024-04-26T10:22:49.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3771000000000001e-05 2024-04-26T10:22:49.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:49.109961+0000", 2024-04-26T10:22:49.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1027e-05 2024-04-26T10:22:49.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.136 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.136 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:49.136 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 6 2024-04-26T10:22:49.136 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:49.138 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T10:22:49.138 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:49.173 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:49.171+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:49.253 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:49.253 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:49.253 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:49.253 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:49.253 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:49.264 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:49.273 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:49.271+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:49.369 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:49.369 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:49.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:49.369 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:49.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.370 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:49.370 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:49.370 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.835291534, 2024-04-26T10:22:49.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:49.370 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.370 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.370 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.370 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.370 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.370 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:49.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.370 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:49.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:49.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:49.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:49.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:49.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:49.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:49.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:49.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:49.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:49.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:49.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:49.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:49.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:49.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:49.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:49.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:49.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:49.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:49.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:49.466 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.466 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.466 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.466 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:49.466 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:49.466 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.833309307, 2024-04-26T10:22:49.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:49.466 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.466 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.466 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.467 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.467 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.467 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:49.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.467 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:49.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:49.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:49.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:49.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:49.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:49.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:49.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:49.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:49.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:49.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:49.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:49.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:49.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:49.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:49.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:49.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:49.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:49.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:49.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:49.471 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.471 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.471 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.471 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:49.471 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:49.472 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.833109923000002, 2024-04-26T10:22:49.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:49.472 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.472 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.472 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.472 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.472 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.472 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:49.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.472 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:49.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:49.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:49.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:49.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:49.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:49.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:49.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:49.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:49.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:49.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:49.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:49.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:49.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:49.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:49.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:49.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:49.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:49.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:49.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:49.477 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.477 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.477 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.477 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:49.477 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:49.477 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.832891302999997, 2024-04-26T10:22:49.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:49.477 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.477 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.477 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:49.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:49.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:49.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:49.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:49.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:49.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:49.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:49.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:49.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:49.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:49.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:49.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:49.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:49.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:49.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:49.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:49.481 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.481 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.481 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.481 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:49.482 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:49.482 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.830519864999999, 2024-04-26T10:22:49.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:49.482 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.482 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.482 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.482 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.482 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.482 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:49.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.482 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:49.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:49.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:49.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:49.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:49.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:49.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:49.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:49.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:49.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:49.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:49.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:49.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:49.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:49.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:49.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:49.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:49.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:49.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:49.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:49.486 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.486 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.487 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.487 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:49.487 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:49.487 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.830419243000001, 2024-04-26T10:22:49.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:49.487 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.487 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.487 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.487 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.487 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.487 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:49.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.488 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:49.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:49.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:49.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:49.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:49.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:49.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:49.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:49.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:49.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:49.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:49.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:49.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:49.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:49.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:49.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:49.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:49.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:49.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:49.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:49.492 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.492 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.492 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.492 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:49.492 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:49.492 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.830300682000001, 2024-04-26T10:22:49.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:49.492 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.492 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.492 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:49.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:49.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:49.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:49.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:49.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:49.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:49.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:49.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:49.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:49.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:49.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:49.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:49.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:49.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:49.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:49.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:49.496 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.496 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.496 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.496 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:49.496 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:49.497 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.830198283999998, 2024-04-26T10:22:49.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:49.497 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.497 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.497 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.497 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.497 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.497 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:49.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.497 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:49.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:49.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:49.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:49.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:49.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:49.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:49.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:49.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:49.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:49.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:49.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:49.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:49.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:49.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:49.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:49.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:49.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:49.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:49.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:49.501 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.501 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.501 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.501 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:49.501 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:49.502 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.829177727000001, 2024-04-26T10:22:49.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:49.502 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.502 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.502 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.502 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.502 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.502 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:49.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.502 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:49.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:49.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:49.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:49.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:49.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:49.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:49.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:49.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:49.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:49.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:49.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:49.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:49.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.505 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:49.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:49.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.505 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:49.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:49.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.506 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.506 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:49.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:49.506 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.506 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.506 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.506 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.506 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.506 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:49.507 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:49.507 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.828027452000001, 2024-04-26T10:22:49.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:49.507 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.507 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.507 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.507 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.507 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.507 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:49.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.507 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:49.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:49.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:49.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:49.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:49.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:49.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:49.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:49.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:49.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:49.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:49.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:49.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:49.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:49.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:49.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:49.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:49.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:49.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:49.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:49.511 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.511 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.511 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.511 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:49.511 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:49.511 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.331328209999999, 2024-04-26T10:22:49.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:22:49.511 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.512 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.512 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.512 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.512 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.512 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:22:49.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.512 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.512 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:49.512 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.512 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.512 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.512 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:49.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:22:49.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:22:49.513 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:22:49.513 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.513 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.513 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.513 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:22:49.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:22:49.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:22:49.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:22:49.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:22:49.514 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:22:49.514 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.514 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.514 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.514 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:22:49.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:22:49.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:49.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:22:49.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:22:49.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.515 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:22:49.515 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:22:49.515 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.515 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.515 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:49.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:22:49.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:22:49.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:22:49.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:22:49.516 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.516 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:22:49.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:22:49.516 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.516 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.517 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.517 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:49.517 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:49.517 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 25.331104614000001, 2024-04-26T10:22:49.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:22:49.517 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.517 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.517 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.517 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.517 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.517 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:22:49.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.517 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:49.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:49.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:22:49.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:49.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:22:49.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:22:49.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:22:49.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:22:49.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:22:49.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:22:49.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.520 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:22:49.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:22:49.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.520 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:22:49.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:22:49.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:49.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:22:49.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:22:49.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:22:49.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:22:49.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:49.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:22:49.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:22:49.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:22:49.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:22:49.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:22:49.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:22:49.523 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.523 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.523 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.523 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:49.523 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:49.523 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.300258293999999, 2024-04-26T10:22:49.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:22:49.523 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.523 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.523 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.523 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:22:49.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.524 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:49.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:49.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:22:49.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:22:49.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:22:49.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:22:49.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:22:49.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:22:49.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:22:49.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:22:49.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:22:49.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.526 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.526 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:22:49.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:22:49.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:49.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:22:49.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:22:49.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:49.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:22:49.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:22:49.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:22:49.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:22:49.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:22:49.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:22:49.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:22:49.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:22:49.529 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.529 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.529 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.529 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:49.529 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:49.529 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.298247191000002, 2024-04-26T10:22:49.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:22:49.529 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.529 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.530 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.530 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.530 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.530 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:22:49.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.530 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:49.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:49.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:49.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:49.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:22:49.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:22:49.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:22:49.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:22:49.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:22:49.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:22:49.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:22:49.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:22:49.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:22:49.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:22:49.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:49.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:22:49.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:22:49.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:49.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:22:49.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:22:49.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:22:49.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:22:49.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.534 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.534 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:22:49.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:22:49.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:22:49.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:22:49.535 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.535 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.535 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.535 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:49.535 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:49.535 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.287369085999998, 2024-04-26T10:22:49.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:22:49.535 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.535 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.535 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.535 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.536 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.536 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:22:49.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.536 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:49.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:49.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:22:49.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:49.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:22:49.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:22:49.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:22:49.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:22:49.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:22:49.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:22:49.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:22:49.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:22:49.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:22:49.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:22:49.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:49.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:22:49.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:22:49.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:49.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:22:49.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:22:49.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:22:49.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:22:49.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:22:49.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:22:49.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:22:49.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:22:49.540 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.540 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.540 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.541 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:49.541 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:49.541 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.284687866999999, 2024-04-26T10:22:49.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:22:49.541 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.541 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.541 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.541 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.541 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.541 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:22:49.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.541 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:49.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:49.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:22:49.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:49.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:22:49.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:22:49.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:22:49.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:22:49.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:22:49.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:22:49.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:22:49.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:22:49.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:22:49.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:22:49.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:49.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:22:49.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:22:49.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:49.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:22:49.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:22:49.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:22:49.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:22:49.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:22:49.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:22:49.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:22:49.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:22:49.546 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.546 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.546 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.547 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:49.547 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:49.547 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.284320791999999, 2024-04-26T10:22:49.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:22:49.547 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.547 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.547 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:22:49.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.547 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:22:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:22:49.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:22:49.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:22:49.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:22:49.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:22:49.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:22:49.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:22:49.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:22:49.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:22:49.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:22:49.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:22:49.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:22:49.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:22:49.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:22:49.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:22:49.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:22:49.551 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.551 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.551 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.552 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:49.552 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:49.552 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.284256540000001, 2024-04-26T10:22:49.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:22:49.552 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.552 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.552 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.552 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.552 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.552 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:22:49.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.552 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:49.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:49.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:22:49.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:49.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:22:49.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:22:49.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:22:49.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:22:49.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:22:49.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:22:49.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:22:49.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:22:49.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:22:49.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:22:49.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:22:49.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:22:49.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:22:49.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:22:49.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:22:49.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:22:49.556 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.556 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.556 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.557 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:49.557 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:49.557 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.279857867, 2024-04-26T10:22:49.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:22:49.557 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.557 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.557 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.557 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.557 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.557 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:22:49.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.557 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:49.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:49.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:22:49.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:49.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:22:49.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:22:49.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:22:49.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:22:49.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:22:49.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:22:49.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:22:49.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:22:49.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:22:49.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:22:49.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:22:49.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:22:49.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:22:49.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:22:49.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:22:49.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:22:49.561 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.561 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.561 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.561 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:49.561 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:49.561 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 18.278099884, 2024-04-26T10:22:49.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:22:49.562 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:49.562 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:49.562 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:49.562 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:49.562 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.562 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:22:49.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.562 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:49.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:49.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:49.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:49.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:49.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:49.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:49.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:22:49.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:49.563 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:22:49.563 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:22:49.563 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.563 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.563 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:49.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:22:49.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:22:49.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:22:49.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:22:49.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:49.564 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:22:49.564 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:22:49.564 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.564 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.564 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:49.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:22:49.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:22:49.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:49.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:22:49.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:22:49.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.565 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:49.565 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:22:49.565 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:22:49.565 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.565 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:49.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:22:49.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:22:49.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:49.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:22:49.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:22:49.566 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:49.566 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:49.566 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:49.566 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:22:49.566 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:22:49.566 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.566 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.567 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.567 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:49.567 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:49.567 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:49.568 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:49.567+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:49.569 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:49.669 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:49.664+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:49.693 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:49.693 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:49.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.694 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5.9cb5de30 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:49.694 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:22:49.694 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44812269300000002, 2024-04-26T10:22:49.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44815806899999999, 2024-04-26T10:22:49.694 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:49.694 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-04-26T10:22:49.694 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:49.694 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:49.694 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.694 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:22:49.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.694 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:49.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:49.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:22:49.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:49.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:22:49.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:49.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:22:49.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:49.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:49.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:22:49.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:22:49.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:49.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:22:49.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:22:49.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:22:49.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:22:49.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:49.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:22:49.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:22:49.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:49.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:22:49.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:22:49.698 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.698 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:49.698 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.698 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5.2d84f0e0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:49.698 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:49.698 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.55982770500000001, 2024-04-26T10:22:49.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.55996975900000001, 2024-04-26T10:22:49.698 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:49.699 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-04-26T10:22:49.699 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:49.699 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:49.699 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.699 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:22:49.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.699 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:49.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:49.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:49.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:49.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:49.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:49.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:49.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:49.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:49.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:22:49.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:22:49.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:49.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:22:49.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:22:49.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:22:49.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:22:49.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:49.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:22:49.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:22:49.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:49.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:22:49.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:22:49.702 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.702 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:49.702 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.702 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5.777eeb00 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:49.702 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:22:49.702 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.44767766799999997, 2024-04-26T10:22:49.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.44791268699999998, 2024-04-26T10:22:49.702 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:49.702 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-04-26T10:22:49.703 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:49.703 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:49.703 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.703 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:22:49.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.703 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:49.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:49.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:22:49.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:49.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:22:49.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:49.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:22:49.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:49.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:22:49.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:22:49.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:49.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:22:49.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:22:49.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:22:49.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:22:49.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:49.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:22:49.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:22:49.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:49.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:22:49.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:22:49.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.706 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:49.706 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.707 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5.eecf5320 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:49.707 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:22:49.707 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.41804377700000001, 2024-04-26T10:22:49.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.41836947000000002, 2024-04-26T10:22:49.707 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:49.707 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-04-26T10:22:49.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:49.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:49.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.707 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:22:49.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.707 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:49.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:49.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:22:49.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:49.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:22:49.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:49.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:22:49.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:49.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:22:49.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:22:49.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:49.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:22:49.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:22:49.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:22:49.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:22:49.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:49.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:22:49.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:22:49.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:49.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:22:49.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:22:49.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.710 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:49.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.710 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5.6152d950 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:49.711 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:22:49.711 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.49881756599999999, 2024-04-26T10:22:49.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.49923610699999998, 2024-04-26T10:22:49.711 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:49.711 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-04-26T10:22:49.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:49.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:49.711 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.711 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:22:49.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.711 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:49.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:49.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:22:49.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:49.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:22:49.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:49.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:22:49.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:49.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:22:49.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:22:49.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:49.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:22:49.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:22:49.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:22:49.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:22:49.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:49.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:22:49.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:22:49.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:49.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:22:49.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:22:49.714 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.715 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:49.715 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.715 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5.42ddbfd0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:49.715 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:22:49.715 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48623250299999998, 2024-04-26T10:22:49.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48673969299999997, 2024-04-26T10:22:49.715 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:49.715 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-04-26T10:22:49.715 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:49.716 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:49.716 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.716 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:22:49.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.716 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:49.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:49.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:22:49.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:49.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:22:49.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:49.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:22:49.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:49.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:22:49.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:22:49.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:49.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:22:49.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:22:49.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:22:49.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:22:49.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:49.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:22:49.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:22:49.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:49.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:22:49.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:22:49.719 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.719 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:49.719 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.719 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5.9e0e1b70 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:49.719 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:22:49.719 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.37313175599999998, 2024-04-26T10:22:49.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.373729441, 2024-04-26T10:22:49.720 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:49.720 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-04-26T10:22:49.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:49.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:49.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.720 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:22:49.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.720 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:49.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:49.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:22:49.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:49.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:22:49.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:49.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:22:49.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:49.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:22:49.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:22:49.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:49.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:22:49.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:22:49.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:22:49.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:22:49.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:49.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:22:49.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:22:49.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:49.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:22:49.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:22:49.723 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.723 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:49.723 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.723 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5.2d2a13e0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:49.723 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:22:49.723 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.48599756999999999, 2024-04-26T10:22:49.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.48668684000000001, 2024-04-26T10:22:49.724 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:49.724 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-04-26T10:22:49.724 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:49.724 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:49.724 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.724 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:22:49.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.724 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:49.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:49.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:22:49.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:49.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:22:49.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:49.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:22:49.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:49.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:22:49.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:22:49.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:49.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:22:49.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:22:49.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:22:49.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:22:49.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:49.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:22:49.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:22:49.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:49.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:22:49.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:22:49.727 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.727 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:49.727 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.727 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5.cf7252b0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:49.727 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:22:49.728 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.436074668, 2024-04-26T10:22:49.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.43685458199999999, 2024-04-26T10:22:49.728 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:49.728 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-04-26T10:22:49.728 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:49.728 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:49.728 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.728 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:22:49.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.728 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:49.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:49.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:22:49.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:49.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:22:49.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:49.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:22:49.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:49.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:49.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:22:49.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:22:49.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:49.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:22:49.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:22:49.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:22:49.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:22:49.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:49.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:22:49.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:22:49.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:49.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:22:49.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:22:49.731 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.731 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:49.731 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.731 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5.782d30c0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:49.731 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:22:49.731 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.43480107800000001, 2024-04-26T10:22:49.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.43566975000000002, 2024-04-26T10:22:49.732 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:49.732 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-04-26T10:22:49.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:49.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:49.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.732 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:22:49.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.732 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:49.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:49.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:22:49.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:49.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:22:49.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:49.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:22:49.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:49.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:22:49.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:22:49.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:49.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:22:49.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:22:49.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:22:49.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:22:49.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:49.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:22:49.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:22:49.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:49.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:22:49.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:22:49.735 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.735 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:49.735 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.735 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5.d325bf10 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:49.735 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:22:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.53004232100000004, 2024-04-26T10:22:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.53104291699999995, 2024-04-26T10:22:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-04-26T10:22:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:22:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:22:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:49.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:22:49.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:49.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:22:49.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:49.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:22:49.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:22:49.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:49.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:22:49.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:22:49.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:22:49.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:22:49.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:49.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:22:49.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:22:49.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:49.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:22:49.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:22:49.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.739 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:49.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.740 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5.bb53e000 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:49.740 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:49.740 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.50522805999999998, 2024-04-26T10:22:49.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.50632968099999998, 2024-04-26T10:22:49.740 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:49.740 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-04-26T10:22:49.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:49.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:49.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.740 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:22:49.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.740 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:49.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:49.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:49.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:49.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:49.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:49.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:49.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:49.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:49.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:22:49.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:22:49.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:49.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:22:49.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:22:49.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:22:49.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:22:49.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:22:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:22:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:22:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:22:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5.29c74c60 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:49.743 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:22:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.52804453600000001, 2024-04-26T10:22:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.52924731800000002, 2024-04-26T10:22:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-04-26T10:22:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:22:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:22:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:49.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:22:49.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:49.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:22:49.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:49.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:49.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:22:49.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:22:49.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:49.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:22:49.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:22:49.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:22:49.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:22:49.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:49.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:22:49.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:22:49.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:49.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:22:49.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:22:49.747 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.747 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:49.747 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.748 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5.a9229a50 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:49.748 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:22:49.748 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.51863583099999999, 2024-04-26T10:22:49.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.52000360999999995, 2024-04-26T10:22:49.748 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:49.748 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-04-26T10:22:49.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:49.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:49.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.748 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:22:49.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.749 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:49.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:49.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:22:49.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:49.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:22:49.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:49.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:22:49.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:49.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:22:49.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:22:49.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:49.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:22:49.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:22:49.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:22:49.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:22:49.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:49.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:22:49.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:22:49.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:49.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:22:49.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:22:49.752 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.752 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:49.752 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.752 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5.538899d0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:49.752 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:22:49.752 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.51680778199999999, 2024-04-26T10:22:49.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.51830166200000005, 2024-04-26T10:22:49.752 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:49.753 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-04-26T10:22:49.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:49.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:49.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.753 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:22:49.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.753 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:49.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:49.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:22:49.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:49.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:22:49.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:49.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:22:49.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:49.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:49.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:22:49.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:22:49.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:49.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:22:49.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:22:49.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:22:49.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:22:49.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:49.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:22:49.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:22:49.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:49.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:22:49.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:22:49.756 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.756 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:49.757 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.757 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5.a26f8fc0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:49.757 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:22:49.757 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.53672545900000002, 2024-04-26T10:22:49.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.53830785699999995, 2024-04-26T10:22:49.757 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:49.757 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for peered", 2024-04-26T10:22:49.757 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:49.757 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:49.757 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:49.757 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:22:49.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.758 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:49.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:49.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:22:49.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:49.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:22:49.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:49.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:49.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:22:49.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:49.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:49.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:22:49.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:22:49.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:49.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:22:49.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:22:49.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:49.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:22:49.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:22:49.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:49.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:22:49.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:22:49.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:49.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:49.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:49.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:22:49.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:22:49.761 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.761 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:49.761 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.761 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:49.761 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:49.761 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 16 2024-04-26T10:22:49.762 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:49.763 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:49.770 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:49.768+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:49.872 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:49.871+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:49.882 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:49.882 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:49.882 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:49.882 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:49.883 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:49.893 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:49.972 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:49.971+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:50.051 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:50.051 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:50.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:50.051 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:50.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.051 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65280 5.f 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:50.051 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:50.051 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.517893973, 2024-04-26T10:22:50.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.100555068, 2024-04-26T10:22:50.051 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.051 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:50.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:50.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.052 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65280 2024-04-26T10:22:50.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.052 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:50.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529346+0000", 2024-04-26T10:22:50.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529345+0000", 2024-04-26T10:22:50.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:50.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529407+0000", 2024-04-26T10:22:50.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1698000000000005e-05 2024-04-26T10:22:50.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529417+0000", 2024-04-26T10:22:50.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5650000000000007e-06 2024-04-26T10:22:50.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.529424+0000", 2024-04-26T10:22:50.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0690000000000004e-06 2024-04-26T10:22:50.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531519+0000", 2024-04-26T10:22:50.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020949340000000001 2024-04-26T10:22:50.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531619+0000", 2024-04-26T10:22:50.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000100815 2024-04-26T10:22:50.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:50.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.531715+0000", 2024-04-26T10:22:50.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5717999999999994e-05 2024-04-26T10:22:50.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:50.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538394+0000", 2024-04-26T10:22:50.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066788849999999999 2024-04-26T10:22:50.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:50.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629800+0000", 2024-04-26T10:22:50.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091405806000000006 2024-04-26T10:22:50.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629855+0000", 2024-04-26T10:22:50.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5449999999999999e-05 2024-04-26T10:22:50.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.629901+0000", 2024-04-26T10:22:50.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5972e-05 2024-04-26T10:22:50.057 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.057 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.057 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.057 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65287 5.f 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:50.057 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:50.057 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.513358760999999, 2024-04-26T10:22:50.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096520296000000005, 2024-04-26T10:22:50.057 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.057 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.058 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:50.058 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:50.058 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.058 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65287 2024-04-26T10:22:50.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.058 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:50.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533881+0000", 2024-04-26T10:22:50.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533880+0000", 2024-04-26T10:22:50.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:50.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.533985+0000", 2024-04-26T10:22:50.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010525400000000001 2024-04-26T10:22:50.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534037+0000", 2024-04-26T10:22:50.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1477000000000002e-05 2024-04-26T10:22:50.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534046+0000", 2024-04-26T10:22:50.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0389999999999993e-06 2024-04-26T10:22:50.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534089+0000", 2024-04-26T10:22:50.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3102999999999997e-05 2024-04-26T10:22:50.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534193+0000", 2024-04-26T10:22:50.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010364199999999999 2024-04-26T10:22:50.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:50.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534317+0000", 2024-04-26T10:22:50.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012382100000000001 2024-04-26T10:22:50.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:50.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.538404+0000", 2024-04-26T10:22:50.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040877300000000004 2024-04-26T10:22:50.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:50.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630061+0000", 2024-04-26T10:22:50.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091656771999999997 2024-04-26T10:22:50.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630195+0000", 2024-04-26T10:22:50.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013406400000000001 2024-04-26T10:22:50.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630402+0000", 2024-04-26T10:22:50.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020661200000000001 2024-04-26T10:22:50.062 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.062 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.062 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.063 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:65292 5.f 5:fa4e4d89:::benchmark_data_smithi052_19421_object65291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:50.063 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:50.063 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 49.512727468999998, 2024-04-26T10:22:50.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.096491601999999996, 2024-04-26T10:22:50.063 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.063 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.063 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:50.063 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:50.063 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.063 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 65292 2024-04-26T10:22:50.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.063 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:50.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534513+0000", 2024-04-26T10:22:50.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534512+0000", 2024-04-26T10:22:50.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:50.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534595+0000", 2024-04-26T10:22:50.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3353e-05 2024-04-26T10:22:50.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534604+0000", 2024-04-26T10:22:50.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1169999999999993e-06 2024-04-26T10:22:50.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.534609+0000", 2024-04-26T10:22:50.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6870000000000002e-06 2024-04-26T10:22:50.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536459+0000", 2024-04-26T10:22:50.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018495569999999999 2024-04-26T10:22:50.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536631+0000", 2024-04-26T10:22:50.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000171991 2024-04-26T10:22:50.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:50.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.536735+0000", 2024-04-26T10:22:50.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104479 2024-04-26T10:22:50.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:50.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.539105+0000", 2024-04-26T10:22:50.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023701410000000001 2024-04-26T10:22:50.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:50.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630826+0000", 2024-04-26T10:22:50.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.091720332000000002 2024-04-26T10:22:50.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.630930+0000", 2024-04-26T10:22:50.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104485 2024-04-26T10:22:50.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:00.631004+0000", 2024-04-26T10:22:50.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4305000000000001e-05 2024-04-26T10:22:50.068 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.068 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.068 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.069 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110555 5.9 5:919989b3:::benchmark_data_smithi052_19421_object110554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:50.069 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:50.069 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.013930263999999, 2024-04-26T10:22:50.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129736717, 2024-04-26T10:22:50.069 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.069 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.069 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:50.069 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:50.069 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.069 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110555 2024-04-26T10:22:50.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.069 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:50.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033310+0000", 2024-04-26T10:22:50.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033309+0000", 2024-04-26T10:22:50.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:50.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033393+0000", 2024-04-26T10:22:50.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3690999999999995e-05 2024-04-26T10:22:50.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033401+0000", 2024-04-26T10:22:50.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4319999999999999e-06 2024-04-26T10:22:50.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033406+0000", 2024-04-26T10:22:50.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2340000000000002e-06 2024-04-26T10:22:50.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033467+0000", 2024-04-26T10:22:50.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0915999999999997e-05 2024-04-26T10:22:50.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033550+0000", 2024-04-26T10:22:50.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3057000000000001e-05 2024-04-26T10:22:50.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:50.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033676+0000", 2024-04-26T10:22:50.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126162 2024-04-26T10:22:50.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:50.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037902+0000", 2024-04-26T10:22:50.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042255720000000004 2024-04-26T10:22:50.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:50.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162728+0000", 2024-04-26T10:22:50.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12482583799999999 2024-04-26T10:22:50.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162839+0000", 2024-04-26T10:22:50.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111222 2024-04-26T10:22:50.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163047+0000", 2024-04-26T10:22:50.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000207686 2024-04-26T10:22:50.074 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.074 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.074 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.074 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110556 5.1 5:822c74bd:::benchmark_data_smithi052_19421_object110555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:50.074 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:50.074 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.013821156999999, 2024-04-26T10:22:50.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.129274783, 2024-04-26T10:22:50.074 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.075 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.075 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:50.075 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:50.075 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.075 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110556 2024-04-26T10:22:50.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.075 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:50.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033419+0000", 2024-04-26T10:22:50.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033418+0000", 2024-04-26T10:22:50.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:50.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033472+0000", 2024-04-26T10:22:50.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3780999999999999e-05 2024-04-26T10:22:50.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033478+0000", 2024-04-26T10:22:50.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6049999999999997e-06 2024-04-26T10:22:50.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033482+0000", 2024-04-26T10:22:50.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9110000000000001e-06 2024-04-26T10:22:50.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033509+0000", 2024-04-26T10:22:50.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6415e-05 2024-04-26T10:22:50.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033650+0000", 2024-04-26T10:22:50.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014088999999999999 2024-04-26T10:22:50.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:50.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161877+0000", 2024-04-26T10:22:50.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128227707 2024-04-26T10:22:50.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162541+0000", 2024-04-26T10:22:50.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000663863 2024-04-26T10:22:50.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162694+0000", 2024-04-26T10:22:50.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015245699999999999 2024-04-26T10:22:50.079 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.079 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.079 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.079 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110558 5.3 5:c73f56b6:::benchmark_data_smithi052_19421_object110557:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:50.079 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:50.079 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.013624522000001, 2024-04-26T10:22:50.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12864012999999999, 2024-04-26T10:22:50.079 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.079 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:50.080 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:50.080 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.080 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110558 2024-04-26T10:22:50.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.080 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:50.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033616+0000", 2024-04-26T10:22:50.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033615+0000", 2024-04-26T10:22:50.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:50.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033717+0000", 2024-04-26T10:22:50.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000102298 2024-04-26T10:22:50.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033725+0000", 2024-04-26T10:22:50.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0090000000000007e-06 2024-04-26T10:22:50.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033731+0000", 2024-04-26T10:22:50.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8919999999999997e-06 2024-04-26T10:22:50.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033769+0000", 2024-04-26T10:22:50.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7682999999999998e-05 2024-04-26T10:22:50.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.033891+0000", 2024-04-26T10:22:50.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121718 2024-04-26T10:22:50.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:50.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161912+0000", 2024-04-26T10:22:50.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128021512 2024-04-26T10:22:50.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162043+0000", 2024-04-26T10:22:50.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000130588 2024-04-26T10:22:50.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162256+0000", 2024-04-26T10:22:50.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021311499999999999 2024-04-26T10:22:50.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.084 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.084 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110557 5.b e45/37 5:d659544e:::benchmark_data_smithi052_19421_object110556:head v 45'6862, mlcod=45'6860)", 2024-04-26T10:22:50.084 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:50.084 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.012720289000001, 2024-04-26T10:22:50.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12783012499999999, 2024-04-26T10:22:50.084 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.084 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.085 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:50.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034520+0000", 2024-04-26T10:22:50.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034519+0000", 2024-04-26T10:22:50.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:50.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034526+0000", 2024-04-26T10:22:50.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0380000000000002e-06 2024-04-26T10:22:50.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034539+0000", 2024-04-26T10:22:50.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.27e-05 2024-04-26T10:22:50.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034545+0000", 2024-04-26T10:22:50.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3369999999999996e-06 2024-04-26T10:22:50.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034606+0000", 2024-04-26T10:22:50.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0752999999999999e-05 2024-04-26T10:22:50.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.034627+0000", 2024-04-26T10:22:50.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.088e-05 2024-04-26T10:22:50.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162272+0000", 2024-04-26T10:22:50.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12764540199999999 2024-04-26T10:22:50.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162350+0000", 2024-04-26T10:22:50.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7835000000000003e-05 2024-04-26T10:22:50.088 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.088 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.088 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.088 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:110554 5.0 e45/37 5:04324c12:::benchmark_data_smithi052_19421_object110553:head v 45'6903, mlcod=45'6898)", 2024-04-26T10:22:50.088 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:50.088 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.010960867000001, 2024-04-26T10:22:50.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12566923499999999, 2024-04-26T10:22:50.089 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.089 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.089 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:50.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036279+0000", 2024-04-26T10:22:50.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036278+0000", 2024-04-26T10:22:50.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:50.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036313+0000", 2024-04-26T10:22:50.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5247999999999999e-05 2024-04-26T10:22:50.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036324+0000", 2024-04-26T10:22:50.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0496000000000001e-05 2024-04-26T10:22:50.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036329+0000", 2024-04-26T10:22:50.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3070000000000002e-06 2024-04-26T10:22:50.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036364+0000", 2024-04-26T10:22:50.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4391000000000003e-05 2024-04-26T10:22:50.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.036377+0000", 2024-04-26T10:22:50.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3706999999999999e-05 2024-04-26T10:22:50.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042032+0000", 2024-04-26T10:22:50.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056547120000000001 2024-04-26T10:22:50.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161949+0000", 2024-04-26T10:22:50.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119916482 2024-04-26T10:22:50.092 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.092 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.092 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.093 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110559 5.2 5:44c3f174:::benchmark_data_smithi052_19421_object110558:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:50.093 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:50.093 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.009342257, 2024-04-26T10:22:50.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12530391299999999, 2024-04-26T10:22:50.093 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.093 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:50.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:50.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.093 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110559 2024-04-26T10:22:50.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.093 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:50.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037898+0000", 2024-04-26T10:22:50.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037897+0000", 2024-04-26T10:22:50.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:50.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037922+0000", 2024-04-26T10:22:50.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5004e-05 2024-04-26T10:22:50.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037931+0000", 2024-04-26T10:22:50.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1419999999999999e-06 2024-04-26T10:22:50.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037937+0000", 2024-04-26T10:22:50.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6749999999999999e-06 2024-04-26T10:22:50.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037972+0000", 2024-04-26T10:22:50.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4678000000000002e-05 2024-04-26T10:22:50.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038108+0000", 2024-04-26T10:22:50.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013689099999999999 2024-04-26T10:22:50.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:50.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162887+0000", 2024-04-26T10:22:50.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124778258 2024-04-26T10:22:50.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163010+0000", 2024-04-26T10:22:50.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122924 2024-04-26T10:22:50.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163202+0000", 2024-04-26T10:22:50.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000192203 2024-04-26T10:22:50.098 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.098 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.098 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.098 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110560 5.3 5:caf5a141:::benchmark_data_smithi052_19421_object110559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:50.098 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:50.098 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.009291655999998, 2024-04-26T10:22:50.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12888738299999999, 2024-04-26T10:22:50.098 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.098 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:50.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:50.099 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.099 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110560 2024-04-26T10:22:50.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.099 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:50.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037949+0000", 2024-04-26T10:22:50.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037948+0000", 2024-04-26T10:22:50.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:50.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037973+0000", 2024-04-26T10:22:50.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5187000000000001e-05 2024-04-26T10:22:50.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037978+0000", 2024-04-26T10:22:50.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4120000000000003e-06 2024-04-26T10:22:50.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037981+0000", 2024-04-26T10:22:50.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6689999999999999e-06 2024-04-26T10:22:50.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038041+0000", 2024-04-26T10:22:50.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9324999999999999e-05 2024-04-26T10:22:50.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038179+0000", 2024-04-26T10:22:50.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013832499999999999 2024-04-26T10:22:50.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:50.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166427+0000", 2024-04-26T10:22:50.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128248165 2024-04-26T10:22:50.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166539+0000", 2024-04-26T10:22:50.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111538 2024-04-26T10:22:50.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166836+0000", 2024-04-26T10:22:50.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029714100000000001 2024-04-26T10:22:50.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.103 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.103 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110561 5.d 5:b143edec:::benchmark_data_smithi052_19421_object110560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:50.103 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:50.103 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.009249598, 2024-04-26T10:22:50.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.125215574, 2024-04-26T10:22:50.103 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.104 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:50.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:50.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.104 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110561 2024-04-26T10:22:50.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.104 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:50.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037991+0000", 2024-04-26T10:22:50.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.037990+0000", 2024-04-26T10:22:50.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:50.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038028+0000", 2024-04-26T10:22:50.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7802999999999997e-05 2024-04-26T10:22:50.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038035+0000", 2024-04-26T10:22:50.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-06 2024-04-26T10:22:50.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038040+0000", 2024-04-26T10:22:50.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.147e-06 2024-04-26T10:22:50.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038077+0000", 2024-04-26T10:22:50.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7166999999999998e-05 2024-04-26T10:22:50.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038192+0000", 2024-04-26T10:22:50.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115565 2024-04-26T10:22:50.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:50.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038319+0000", 2024-04-26T10:22:50.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012697699999999999 2024-04-26T10:22:50.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:50.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162690+0000", 2024-04-26T10:22:50.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12437065 2024-04-26T10:22:50.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:50.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162878+0000", 2024-04-26T10:22:50.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000188173 2024-04-26T10:22:50.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162992+0000", 2024-04-26T10:22:50.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114008 2024-04-26T10:22:50.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163206+0000", 2024-04-26T10:22:50.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021394900000000001 2024-04-26T10:22:50.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.109 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.109 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:50.109 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:50.109 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.009188993999999, 2024-04-26T10:22:50.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:22:50.110 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.110 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:50.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:50.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.110 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:22:50.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.110 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:50.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:50.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:50.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:50.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:22:50.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:22:50.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:22:50.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:22:50.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:22:50.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:22:50.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:22:50.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:22:50.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:22:50.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:22:50.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:50.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:22:50.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:22:50.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:22:50.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:22:50.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:22:50.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:22:50.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.115 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.115 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110564 5.3 5:c09e33cb:::benchmark_data_smithi052_19421_object110563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:50.115 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:50.115 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.009136336000001, 2024-04-26T10:22:50.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.128984614, 2024-04-26T10:22:50.115 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.115 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:50.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:50.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.116 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110564 2024-04-26T10:22:50.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.116 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:50.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038104+0000", 2024-04-26T10:22:50.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038103+0000", 2024-04-26T10:22:50.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:50.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038136+0000", 2024-04-26T10:22:50.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.243e-05 2024-04-26T10:22:50.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038143+0000", 2024-04-26T10:22:50.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0870000000000001e-06 2024-04-26T10:22:50.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038151+0000", 2024-04-26T10:22:50.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1969999999999996e-06 2024-04-26T10:22:50.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039813+0000", 2024-04-26T10:22:50.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001661844 2024-04-26T10:22:50.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.039970+0000", 2024-04-26T10:22:50.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015712699999999999 2024-04-26T10:22:50.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:50.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166854+0000", 2024-04-26T10:22:50.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.126883788 2024-04-26T10:22:50.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.166976+0000", 2024-04-26T10:22:50.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012231399999999999 2024-04-26T10:22:50.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167088+0000", 2024-04-26T10:22:50.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011243699999999999 2024-04-26T10:22:50.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.120 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.120 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:50.120 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:50.120 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.009079743000001, 2024-04-26T10:22:50.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:22:50.120 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.121 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:50.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:50.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.121 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:22:50.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.121 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:50.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:50.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:50.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:50.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:22:50.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:22:50.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:22:50.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:22:50.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:22:50.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:22:50.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:22:50.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:22:50.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:22:50.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:22:50.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:50.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:22:50.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:22:50.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:22:50.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:22:50.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:22:50.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:22:50.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.125 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.125 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.125 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110566 5.c 5:34145698:::benchmark_data_smithi052_19421_object110565:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:50.126 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:50.126 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.009029966, 2024-04-26T10:22:50.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12673530699999999, 2024-04-26T10:22:50.126 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.126 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:50.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:50.126 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.126 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110566 2024-04-26T10:22:50.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.126 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:50.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:50.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038210+0000", 2024-04-26T10:22:50.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:50.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038246+0000", 2024-04-26T10:22:50.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5759000000000001e-05 2024-04-26T10:22:50.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038252+0000", 2024-04-26T10:22:50.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5300000000000002e-06 2024-04-26T10:22:50.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038257+0000", 2024-04-26T10:22:50.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9830000000000004e-06 2024-04-26T10:22:50.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038312+0000", 2024-04-26T10:22:50.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5108000000000002e-05 2024-04-26T10:22:50.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038480+0000", 2024-04-26T10:22:50.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016751099999999999 2024-04-26T10:22:50.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:50.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164651+0000", 2024-04-26T10:22:50.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12617115600000001 2024-04-26T10:22:50.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164770+0000", 2024-04-26T10:22:50.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118748 2024-04-26T10:22:50.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.164946+0000", 2024-04-26T10:22:50.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000175966 2024-04-26T10:22:50.131 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.131 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.131 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.131 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:50.131 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:50.131 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.006682331, 2024-04-26T10:22:50.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:22:50.131 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.131 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.131 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:50.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:50.132 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.132 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:22:50.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.132 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:50.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:50.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:22:50.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:50.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:22:50.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:22:50.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:22:50.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:22:50.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:22:50.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:22:50.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:22:50.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:22:50.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:22:50.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:22:50.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:50.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:22:50.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:22:50.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:50.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:22:50.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:22:50.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:50.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:22:50.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:22:50.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:22:50.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:22:50.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:22:50.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:22:50.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.137 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.137 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110568 5.c 5:34af8ad3:::benchmark_data_smithi052_19421_object110567:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:50.137 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:50.137 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.006564705999999, 2024-04-26T10:22:50.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124943661, 2024-04-26T10:22:50.137 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.137 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:50.137 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:50.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.138 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110568 2024-04-26T10:22:50.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.138 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:50.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:50.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040675+0000", 2024-04-26T10:22:50.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:50.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040711+0000", 2024-04-26T10:22:50.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6531e-05 2024-04-26T10:22:50.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040719+0000", 2024-04-26T10:22:50.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6120000000000001e-06 2024-04-26T10:22:50.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040724+0000", 2024-04-26T10:22:50.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2100000000000001e-06 2024-04-26T10:22:50.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040771+0000", 2024-04-26T10:22:50.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7123000000000003e-05 2024-04-26T10:22:50.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040984+0000", 2024-04-26T10:22:50.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021227400000000001 2024-04-26T10:22:50.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:50.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165350+0000", 2024-04-26T10:22:50.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124366738 2024-04-26T10:22:50.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165459+0000", 2024-04-26T10:22:50.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108168 2024-04-26T10:22:50.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165619+0000", 2024-04-26T10:22:50.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160564 2024-04-26T10:22:50.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.142 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.142 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:50.142 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:50.142 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.006496407, 2024-04-26T10:22:50.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:22:50.142 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.143 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:50.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:50.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.143 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:22:50.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.143 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:50.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:50.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:22:50.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:50.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:22:50.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:22:50.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:22:50.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:22:50.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:22:50.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:22:50.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:22:50.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:22:50.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:22:50.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:22:50.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:50.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:22:50.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:22:50.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:50.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:22:50.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:22:50.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:50.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:22:50.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:22:50.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:22:50.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:22:50.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:22:50.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:22:50.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.148 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.148 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110570 5.1 5:876a468c:::benchmark_data_smithi052_19421_object110569:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:50.148 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:50.148 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.005193861999999, 2024-04-26T10:22:50.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12851437099999999, 2024-04-26T10:22:50.148 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.148 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.148 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:50.148 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:50.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.149 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110570 2024-04-26T10:22:50.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.149 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:50.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042046+0000", 2024-04-26T10:22:50.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042045+0000", 2024-04-26T10:22:50.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:50.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.042083+0000", 2024-04-26T10:22:50.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8064e-05 2024-04-26T10:22:50.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161855+0000", 2024-04-26T10:22:50.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.119771934 2024-04-26T10:22:50.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.161882+0000", 2024-04-26T10:22:50.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7083000000000001e-05 2024-04-26T10:22:50.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163117+0000", 2024-04-26T10:22:50.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001234509 2024-04-26T10:22:50.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.163507+0000", 2024-04-26T10:22:50.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038998400000000001 2024-04-26T10:22:50.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:50.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170347+0000", 2024-04-26T10:22:50.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006840952 2024-04-26T10:22:50.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170488+0000", 2024-04-26T10:22:50.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000140393 2024-04-26T10:22:50.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.170561+0000", 2024-04-26T10:22:50.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2809e-05 2024-04-26T10:22:50.153 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.153 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.153 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.153 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:124481 5.d 5:b507cdbb:::benchmark_data_smithi052_19421_object124480:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:50.153 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:50.153 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.966828939999999, 2024-04-26T10:22:50.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.087933879000000006, 2024-04-26T10:22:50.153 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:50.153 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.153 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:50.153 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:50.154 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.154 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 124481 2024-04-26T10:22:50.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.154 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:50.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:50.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:50.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:50.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080411+0000", 2024-04-26T10:22:50.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:50.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:50.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080410+0000", 2024-04-26T10:22:50.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:50.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:50.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080523+0000", 2024-04-26T10:22:50.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112501 2024-04-26T10:22:50.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:50.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080528+0000", 2024-04-26T10:22:50.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1789999999999999e-06 2024-04-26T10:22:50.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080532+0000", 2024-04-26T10:22:50.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.805e-06 2024-04-26T10:22:50.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:50.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080562+0000", 2024-04-26T10:22:50.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0241000000000001e-05 2024-04-26T10:22:50.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:50.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080645+0000", 2024-04-26T10:22:50.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2816000000000001e-05 2024-04-26T10:22:50.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:50.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.080786+0000", 2024-04-26T10:22:50.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014129400000000001 2024-04-26T10:22:50.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:50.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.084288+0000", 2024-04-26T10:22:50.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035017920000000001 2024-04-26T10:22:50.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:50.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.167975+0000", 2024-04-26T10:22:50.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.083686673000000003 2024-04-26T10:22:50.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:50.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.168092+0000", 2024-04-26T10:22:50.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117607 2024-04-26T10:22:50.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:50.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:50.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:50.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:31.168345+0000", 2024-04-26T10:22:50.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00025299200000000001 2024-04-26T10:22:50.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.159 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:50.159 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:50.159 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:50.160 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:50.161 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:50.159+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:50.261 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:50.259+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:50.297 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:166330 5.b 5:d2b1d512:::benchmark_data_smithi052_19421_object36858:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-26T10:22:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:50.291875+0000", 2024-04-26T10:22:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.005943182, 2024-04-26T10:22:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005960534, 2024-04-26T10:22:50.297 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 166330 2024-04-26T10:22:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:50.291875+0000", 2024-04-26T10:22:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:50.291875+0000", 2024-04-26T10:22:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:50.291874+0000", 2024-04-26T10:22:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:50.291878+0000", 2024-04-26T10:22:50.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.109e-06 2024-04-26T10:22:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:50.291893+0000", 2024-04-26T10:22:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4564e-05 2024-04-26T10:22:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:50.291900+0000", 2024-04-26T10:22:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9870000000000002e-06 2024-04-26T10:22:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:50.292393+0000", 2024-04-26T10:22:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049327099999999999 2024-04-26T10:22:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:50.292474+0000", 2024-04-26T10:22:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1073000000000001e-05 2024-04-26T10:22:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:50.292539+0000", 2024-04-26T10:22:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5413999999999994e-05 2024-04-26T10:22:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:50.294769+0000", 2024-04-26T10:22:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022296220000000001 2024-04-26T10:22:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:166337 5.d e55/37 5:ba478169:::benchmark_data_smithi052_19421_object36865:head v 55'10484, mlcod=55'10481)", 2024-04-26T10:22:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:50.297097+0000", 2024-04-26T10:22:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00072081999999999995, 2024-04-26T10:22:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00078701800000000001, 2024-04-26T10:22:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:50.297097+0000", 2024-04-26T10:22:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:50.297097+0000", 2024-04-26T10:22:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:50.297097+0000", 2024-04-26T10:22:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:50.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:50.297101+0000", 2024-04-26T10:22:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0740000000000003e-06 2024-04-26T10:22:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:50.297107+0000", 2024-04-26T10:22:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2589999999999997e-06 2024-04-26T10:22:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:50.297112+0000", 2024-04-26T10:22:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8269999999999997e-06 2024-04-26T10:22:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:50.297139+0000", 2024-04-26T10:22:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7804999999999999e-05 2024-04-26T10:22:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:50.297156+0000", 2024-04-26T10:22:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6473999999999998e-05 2024-04-26T10:22:50.305 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:50.306 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 2 2024-04-26T10:22:50.306 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:50.309 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:50.361 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:50.359+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:50.429 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:50.430 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:50.430 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:50.430 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:50.430 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:50.442 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:50.487 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:50.487+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:50.542 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:22:50.563 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:50.563+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:50.612 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:50.612 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.079921830000004, 2024-04-26T10:22:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.613 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.614 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.615 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:50.616 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.077939602999997, 2024-04-26T10:22:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:50.617 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.618 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.619 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.620 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.621 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.077740218999999, 2024-04-26T10:22:50.622 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.623 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.624 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:50.625 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:50.625 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.626 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.627 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.628 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.077521599000001, 2024-04-26T10:22:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.629 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:50.630 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.631 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.632 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.633 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:50.634 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:50.634 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.075150161000003, 2024-04-26T10:22:50.634 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:50.634 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.634 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.634 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.634 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:50.634 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.634 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:50.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:50.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.635 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.635 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.635 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:50.635 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:50.635 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:50.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:50.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:50.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:50.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.636 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.636 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.636 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:50.636 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:50.636 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:50.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:50.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:50.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:50.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.637 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.637 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.637 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:50.637 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:50.637 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:50.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:50.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.638 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.638 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:50.638 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:50.638 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.638 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.638 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.638 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.638 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.639 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:50.639 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:50.639 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.075049538999998, 2024-04-26T10:22:50.639 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:50.639 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.639 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.639 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.639 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:50.639 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.639 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.639 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.639 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.639 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:50.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:50.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:50.640 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:50.640 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.640 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.640 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.640 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:50.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:50.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:50.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:50.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.641 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:50.641 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:50.641 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.641 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.641 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:50.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:50.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:50.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:50.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.642 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.642 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:50.642 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:50.642 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.642 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:50.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:50.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.643 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.643 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:50.643 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:50.643 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.643 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.643 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.643 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.643 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.643 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:50.643 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:50.644 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.074930977999998, 2024-04-26T10:22:50.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:50.644 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.644 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.644 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:50.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.644 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.644 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:50.644 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.644 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.644 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:50.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:50.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:50.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:50.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.645 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:50.645 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:50.645 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.645 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.645 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:50.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:50.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:50.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:50.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.646 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.646 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.646 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:50.646 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:50.646 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:50.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:50.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.647 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.647 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.647 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:50.647 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:50.647 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.647 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.647 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.647 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.648 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:50.648 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:50.648 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.074828580000002, 2024-04-26T10:22:50.648 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:50.648 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.648 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.648 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.648 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.648 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.648 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:50.648 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.648 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.648 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:50.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:50.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.649 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.649 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.649 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:50.649 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:50.649 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:50.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:50.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.650 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:50.650 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:50.650 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.650 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.650 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:50.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:50.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:50.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:50.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.651 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:50.651 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:50.651 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.651 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.651 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:50.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:50.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:50.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:50.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.652 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.652 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.652 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:50.652 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:50.652 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.652 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.652 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.652 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.653 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:50.653 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:50.653 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.073808022999998, 2024-04-26T10:22:50.653 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:50.653 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.653 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.653 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.653 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.653 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.653 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:50.653 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.653 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.653 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.653 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.653 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:50.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:50.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.654 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.654 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.654 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.654 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:50.654 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:50.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:50.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:50.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:50.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:50.655 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.655 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.655 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:50.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:50.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:50.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:50.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:50.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:50.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:50.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:50.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:50.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:50.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:50.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:50.657 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.657 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.658 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.658 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:50.658 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:50.658 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 50.072657747999997, 2024-04-26T10:22:50.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:50.658 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.658 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.658 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.659 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:50.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.659 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:50.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:50.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:50.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:50.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:50.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:50.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.660 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.660 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:50.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:50.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:50.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:50.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:50.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:50.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:50.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:50.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:50.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:50.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:50.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:50.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:50.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:50.663 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.663 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.663 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.663 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:50.663 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:50.663 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 26.575958505999999, 2024-04-26T10:22:50.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:22:50.663 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.663 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.663 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.663 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.663 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.664 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:22:50.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.664 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:50.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:50.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:22:50.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:50.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:22:50.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:22:50.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:22:50.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:22:50.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:22:50.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:22:50.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:22:50.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:22:50.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:22:50.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:22:50.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:50.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:22:50.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:22:50.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:22:50.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:22:50.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:50.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:22:50.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:22:50.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:22:50.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:22:50.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:22:50.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:22:50.668 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.668 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.668 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.669 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:50.669 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:50.669 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 26.575734910000001, 2024-04-26T10:22:50.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:22:50.669 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.669 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.669 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.669 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.669 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.669 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:22:50.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.669 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:50.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:50.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:22:50.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:50.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:22:50.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:22:50.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:22:50.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:22:50.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:22:50.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:22:50.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:22:50.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:22:50.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:22:50.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:22:50.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:50.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:22:50.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:22:50.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:22:50.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:22:50.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:50.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:22:50.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:22:50.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:22:50.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:22:50.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:22:50.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:22:50.674 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.674 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.674 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.674 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:50.674 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:50.674 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.544888589999999, 2024-04-26T10:22:50.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:22:50.675 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.675 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.675 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.675 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.675 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.675 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:22:50.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.675 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.675 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.675 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:50.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:50.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:22:50.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:50.676 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.676 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.676 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.676 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:22:50.676 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:22:50.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:22:50.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:22:50.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:22:50.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:22:50.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:22:50.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:22:50.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:22:50.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:22:50.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:50.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:22:50.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:22:50.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:50.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:22:50.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:22:50.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:22:50.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:22:50.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:22:50.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:22:50.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:22:50.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:22:50.680 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.680 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.680 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.680 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:50.680 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:50.680 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.542877486999998, 2024-04-26T10:22:50.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:22:50.680 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.681 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.681 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.681 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.681 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.681 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:22:50.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.681 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:50.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:50.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:50.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:50.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:22:50.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:22:50.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:22:50.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:22:50.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:22:50.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:22:50.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:22:50.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:22:50.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:22:50.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:22:50.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:50.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:22:50.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:22:50.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:50.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:22:50.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:22:50.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:22:50.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:22:50.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:22:50.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:22:50.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:22:50.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:22:50.685 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.686 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.686 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.686 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:50.686 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:50.686 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.531999381999999, 2024-04-26T10:22:50.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:22:50.686 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.686 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.686 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.687 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:22:50.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.687 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:50.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:50.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:22:50.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:50.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:22:50.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:22:50.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:22:50.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:22:50.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:22:50.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:22:50.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:22:50.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:22:50.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:22:50.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:22:50.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:50.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:22:50.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:22:50.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:50.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:22:50.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:22:50.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:22:50.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:22:50.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:22:50.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:22:50.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:22:50.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:22:50.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.691 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.691 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:50.692 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:50.692 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.529318162999999, 2024-04-26T10:22:50.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:22:50.692 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.692 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.692 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:22:50.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.692 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:50.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:50.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:22:50.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:50.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:22:50.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:22:50.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:22:50.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:22:50.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:22:50.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:22:50.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:22:50.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:22:50.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:22:50.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:22:50.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:50.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:22:50.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:22:50.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:50.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:22:50.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:22:50.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:22:50.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:22:50.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:22:50.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:22:50.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:22:50.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:22:50.697 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.697 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.697 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.697 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:50.697 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:50.697 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.528951087999999, 2024-04-26T10:22:50.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:22:50.698 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.698 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.698 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.698 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.698 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.698 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:22:50.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.698 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:50.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:50.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:22:50.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:50.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:22:50.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:22:50.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:22:50.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:22:50.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:22:50.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:22:50.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:22:50.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:22:50.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:22:50.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:22:50.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:22:50.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:22:50.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:22:50.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:22:50.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:22:50.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:22:50.702 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.702 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.702 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.703 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:50.703 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:50.703 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.528886836000002, 2024-04-26T10:22:50.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:22:50.703 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.703 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.703 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.703 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.703 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.703 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:22:50.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.703 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:50.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:50.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:22:50.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:50.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:22:50.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:22:50.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:22:50.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:22:50.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:22:50.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:22:50.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:22:50.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:22:50.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:22:50.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:22:50.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:22:50.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:22:50.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:22:50.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:22:50.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:22:50.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:22:50.707 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.707 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.708 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.708 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:50.708 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:50.708 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.524488163000001, 2024-04-26T10:22:50.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:22:50.708 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.708 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.708 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.708 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.708 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.708 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:22:50.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:22:50.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:50.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:22:50.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:22:50.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:22:50.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:22:50.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:22:50.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:22:50.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:22:50.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:22:50.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:22:50.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:22:50.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:22:50.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:22:50.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:22:50.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:22:50.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:22:50.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:22:50.712 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.712 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.712 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.713 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:50.713 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:50.713 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 19.52273018, 2024-04-26T10:22:50.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:22:50.713 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:50.713 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:50.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:50.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:50.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:50.713 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:22:50.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.713 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:50.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:50.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:50.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:50.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:50.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:50.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:50.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:22:50.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:50.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:50.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:22:50.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:22:50.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:50.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:22:50.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:22:50.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:50.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:22:50.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:22:50.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:50.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:22:50.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:22:50.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:50.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:22:50.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:22:50.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:50.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:22:50.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:22:50.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:50.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:22:50.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:22:50.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:50.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:22:50.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:22:50.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:50.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:22:50.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:22:50.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:50.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:50.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:50.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:22:50.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:22:50.718 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.718 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.718 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.718 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:50.718 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:50.718 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:50.719 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:50.720 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:50.719+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:50.721 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:50.721 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:50.721 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:50.722 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:50.722 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:50.725 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:50.726 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:50.821 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:50.819+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:50.851 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:50.851 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:50.865 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:50.921 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:50.916+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:51.001 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:51.001 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:51.014 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:51.058 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:51.056+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:51.122 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:51.120+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:51.139 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:22:51.146 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:51.146 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:51.159 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:51.223 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:51.220+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:51.282 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:51.283 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:51.295 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:51.339 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:51.339+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:51.416 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:51.416 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:51.425 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:51.423+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:51.428 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:51.526 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:51.527+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:51.557 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:51.557 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:51.570 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:51.627 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:51.627+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:51.699 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:51.699 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:51.711 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:51.727 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:51.727+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:51.830 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:51.827+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:51.838 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:51.839 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:51.851 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:51.929 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:51.924+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:51.981 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:51.981 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:51.993 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:52.039 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:52.039+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:52.119 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:52.119 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:52.130 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:52.124+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:52.131 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:52.149 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T10:22:52.231 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:52.231+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:52.257 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:52.257 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:52.270 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:52.332 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:52.328+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:52.390 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:52.391 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:52.402 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:52.433 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:52.431+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:52.534 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:52.531+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:52.536 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:52.537 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:52.548 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:52.636 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:52.632+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:52.675 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:52.675 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:52.688 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:52.727 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:22:52.737 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:52.735+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:52.817 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:52.817 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:52.831 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:52.875 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:52.875+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:52.882 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:52.904 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:52.904 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:52.904 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:52.904 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:52.909 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:52.909 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:52.938 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:52.935+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:52.963 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:52.963 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:52.963 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.963 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:172511 5.b 5:d7409473:::benchmark_data_smithi052_19421_object43039:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:52.963 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:52.959424+0000", 2024-04-26T10:22:52.963 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0037541419999999998, 2024-04-26T10:22:52.963 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0037770519999999999, 2024-04-26T10:22:52.963 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:52.963 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:52.963 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 172511 2024-04-26T10:22:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.959424+0000", 2024-04-26T10:22:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.959424+0000", 2024-04-26T10:22:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:52.964 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.959422+0000", 2024-04-26T10:22:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.959429+0000", 2024-04-26T10:22:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0909999999999998e-06 2024-04-26T10:22:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.959442+0000", 2024-04-26T10:22:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3329000000000001e-05 2024-04-26T10:22:52.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.959449+0000", 2024-04-26T10:22:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.464e-06 2024-04-26T10:22:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.959501+0000", 2024-04-26T10:22:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1557999999999997e-05 2024-04-26T10:22:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.959645+0000", 2024-04-26T10:22:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014453799999999999 2024-04-26T10:22:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.959795+0000", 2024-04-26T10:22:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014937500000000001 2024-04-26T10:22:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.967 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:172510 5.f e56/37 5:f0be130f:::benchmark_data_smithi052_19421_object43038:head v 56'10884, mlcod=56'10882)", 2024-04-26T10:22:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:52.961447+0000", 2024-04-26T10:22:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0017305070000000001, 2024-04-26T10:22:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001814925, 2024-04-26T10:22:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.961447+0000", 2024-04-26T10:22:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:52.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.961447+0000", 2024-04-26T10:22:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.961446+0000", 2024-04-26T10:22:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.961454+0000", 2024-04-26T10:22:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3100000000000003e-06 2024-04-26T10:22:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.969 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.961470+0000", 2024-04-26T10:22:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5872999999999999e-05 2024-04-26T10:22:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.961477+0000", 2024-04-26T10:22:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2849999999999997e-06 2024-04-26T10:22:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.961526+0000", 2024-04-26T10:22:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9461e-05 2024-04-26T10:22:52.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.961548+0000", 2024-04-26T10:22:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1705999999999999e-05 2024-04-26T10:22:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:172516 5.b 5:d2b0746d:::benchmark_data_smithi052_19421_object43044:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:52.961983+0000", 2024-04-26T10:22:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.001195041, 2024-04-26T10:22:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0013493190000000001, 2024-04-26T10:22:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:52.971 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 172516 2024-04-26T10:22:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.961983+0000", 2024-04-26T10:22:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.961983+0000", 2024-04-26T10:22:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:52.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.961981+0000", 2024-04-26T10:22:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.961989+0000", 2024-04-26T10:22:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.52e-06 2024-04-26T10:22:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.962001+0000", 2024-04-26T10:22:52.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1917e-05 2024-04-26T10:22:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.962011+0000", 2024-04-26T10:22:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7650000000000005e-06 2024-04-26T10:22:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.962061+0000", 2024-04-26T10:22:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0639000000000001e-05 2024-04-26T10:22:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:52.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.962201+0000", 2024-04-26T10:22:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000139684 2024-04-26T10:22:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.962338+0000", 2024-04-26T10:22:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000136969 2024-04-26T10:22:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:172501 5.a 5:5fac6921:::benchmark_data_smithi052_19421_object43029:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:52.956713+0000", 2024-04-26T10:22:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0064643879999999997, 2024-04-26T10:22:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0066942379999999999, 2024-04-26T10:22:52.975 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 172501 2024-04-26T10:22:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.956713+0000", 2024-04-26T10:22:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.956713+0000", 2024-04-26T10:22:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.956712+0000", 2024-04-26T10:22:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.956718+0000", 2024-04-26T10:22:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4190000000000001e-06 2024-04-26T10:22:52.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.956731+0000", 2024-04-26T10:22:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3147e-05 2024-04-26T10:22:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.956737+0000", 2024-04-26T10:22:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.584e-06 2024-04-26T10:22:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:52.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.957930+0000", 2024-04-26T10:22:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001192928 2024-04-26T10:22:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.958103+0000", 2024-04-26T10:22:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017283500000000001 2024-04-26T10:22:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.963295+0000", 2024-04-26T10:22:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051919790000000002 2024-04-26T10:22:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:52.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.963335+0000", 2024-04-26T10:22:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0176000000000003e-05 2024-04-26T10:22:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:52.963412+0000", 2024-04-26T10:22:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6304000000000007e-05 2024-04-26T10:22:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:52.980 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 4 2024-04-26T10:22:52.980 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:52.981 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:53.038 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:53.035+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:53.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~65s 2024-04-26T10:22:53.108 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:53.108 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:53.108 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:53.108 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:53.108 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:53.119 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:53.139 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:53.139+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:53.240 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:53.236+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:53.246 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:53.246 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:53.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:53.247 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:53.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.247 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:53.247 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:53.247 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.713612544999997, 2024-04-26T10:22:53.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:53.247 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.247 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.247 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:53.247 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:53.247 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.247 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:53.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.248 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:53.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:53.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:53.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:53.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:53.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:53.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:53.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:53.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:53.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:53.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:53.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:53.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:53.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:53.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:53.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:53.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:53.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:53.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:53.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:53.251 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.252 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.252 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.252 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:53.252 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:53.252 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.711630317999997, 2024-04-26T10:22:53.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:53.252 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.252 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.252 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:53.252 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:53.253 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.253 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:53.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.253 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:53.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:53.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:53.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:53.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:53.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:53.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:53.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:53.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:53.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:53.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:53.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:53.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:53.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:53.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:53.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:53.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:53.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:53.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:53.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:53.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:53.257 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.257 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.257 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.257 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:53.257 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:53.257 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.711430933999999, 2024-04-26T10:22:53.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:53.258 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.258 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.258 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:53.258 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:53.258 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.258 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:53.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.258 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:53.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:53.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:53.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:53.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:53.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:53.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:53.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:53.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:53.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:53.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:53.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:53.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:53.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:53.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:53.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:53.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:53.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:53.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:53.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:53.262 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.262 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.262 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.262 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:53.262 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:53.262 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.711212314000001, 2024-04-26T10:22:53.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:53.263 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.263 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.263 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:53.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:53.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:53.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:53.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:53.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:53.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:53.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:53.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:53.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:53.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:53.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:53.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:53.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:53.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:53.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:53.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:53.266 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.266 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.266 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.267 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:53.267 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:53.267 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.708840875999996, 2024-04-26T10:22:53.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:53.267 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.267 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.267 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:53.267 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:53.267 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.267 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:53.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.267 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:53.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:53.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:53.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:53.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:53.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:53.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:53.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:53.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:53.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:53.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:53.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:53.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:53.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:53.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:53.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:53.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:53.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:53.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:53.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:53.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:53.271 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.272 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.272 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.272 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:53.272 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:53.272 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.708740253999999, 2024-04-26T10:22:53.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:53.272 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.272 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.272 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:53.272 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:53.272 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.272 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:53.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.273 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:53.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:53.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:53.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:53.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:53.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:53.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:53.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:53.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:53.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:53.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:53.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:53.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:53.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:53.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:53.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:53.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:53.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:53.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:53.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:53.277 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.277 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.277 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.277 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:53.277 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:53.277 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.708621692999998, 2024-04-26T10:22:53.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:53.277 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.277 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.277 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:53.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:53.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:53.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:53.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:53.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:53.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:53.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:53.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:53.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:53.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:53.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:53.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:53.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:53.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:53.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:53.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:53.281 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.281 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.281 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.281 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:53.281 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:53.282 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.708519295000002, 2024-04-26T10:22:53.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:53.282 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.282 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.282 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:53.282 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:53.282 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.282 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:53.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.282 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:53.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:53.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:53.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:53.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:53.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:53.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:53.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:53.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:53.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:53.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:53.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:53.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:53.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:53.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:53.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:53.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:53.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:53.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:53.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:53.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:53.286 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.286 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.286 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.287 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:53.287 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:53.287 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.707498737999998, 2024-04-26T10:22:53.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:53.287 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.287 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.287 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:53.287 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:53.287 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.287 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:53.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.287 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:53.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:53.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:53.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:53.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:53.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:53.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:53.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:53.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:53.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:53.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:53.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:53.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:53.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:53.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:53.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:53.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:53.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:53.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:53.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:53.291 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.291 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.291 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.292 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:53.292 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:53.292 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 52.706348462999998, 2024-04-26T10:22:53.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:53.292 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.292 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.292 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:53.292 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:53.292 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.292 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:53.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.292 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:53.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:53.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:53.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:53.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:53.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:53.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:53.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:53.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:53.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:53.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:53.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:53.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:53.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:53.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:53.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:53.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:53.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:53.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:53.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:53.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:53.296 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.296 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.296 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.297 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:53.297 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:53.297 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.209649220999999, 2024-04-26T10:22:53.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:22:53.297 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.297 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.297 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:53.297 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:53.297 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.297 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:22:53.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.297 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:53.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:53.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:22:53.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:22:53.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:22:53.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:22:53.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:22:53.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:22:53.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:22:53.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:22:53.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:22:53.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:22:53.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:22:53.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:53.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:22:53.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:22:53.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:53.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:22:53.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:22:53.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:22:53.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:22:53.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:22:53.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:22:53.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:22:53.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:22:53.302 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.302 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.302 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.302 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:53.302 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:53.302 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 29.209425625000002, 2024-04-26T10:22:53.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:22:53.303 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.303 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.303 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:53.303 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:53.303 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.303 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:22:53.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.303 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:53.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:53.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:22:53.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:22:53.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:22:53.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:22:53.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:22:53.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:22:53.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:22:53.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:22:53.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:22:53.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:22:53.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:22:53.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:53.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:22:53.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:22:53.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:53.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:22:53.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:22:53.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:22:53.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:22:53.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:22:53.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:22:53.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:22:53.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:22:53.310 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.310 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.310 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.310 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:53.310 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:53.311 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.178579305, 2024-04-26T10:22:53.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:22:53.311 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.311 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.311 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:53.311 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:53.311 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.311 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:22:53.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.311 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:53.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:53.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:22:53.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:22:53.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:22:53.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:22:53.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:22:53.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:22:53.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:22:53.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:22:53.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:22:53.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:22:53.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:22:53.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:53.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:22:53.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:22:53.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:22:53.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:22:53.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:53.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:22:53.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:22:53.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:22:53.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:22:53.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:22:53.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:22:53.316 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.316 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.316 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.316 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:53.316 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:53.316 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.176568201999999, 2024-04-26T10:22:53.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:22:53.317 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.317 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:53.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:53.317 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.317 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:22:53.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.317 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:53.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:53.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:53.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:22:53.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:22:53.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:22:53.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:22:53.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:22:53.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:22:53.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:22:53.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:22:53.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:22:53.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:22:53.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:53.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:22:53.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:22:53.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:22:53.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:22:53.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:53.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:22:53.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:22:53.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:22:53.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:22:53.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:22:53.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:22:53.323 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.323 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.323 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.323 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:53.323 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:53.323 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.165690096999999, 2024-04-26T10:22:53.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:22:53.323 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.323 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.323 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:53.324 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:53.324 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.324 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:22:53.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.324 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:53.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:53.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:22:53.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:53.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:22:53.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:22:53.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:22:53.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:22:53.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:22:53.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:22:53.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:22:53.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:22:53.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:22:53.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:22:53.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:53.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:22:53.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:22:53.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:22:53.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:22:53.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:53.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:22:53.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:22:53.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:22:53.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:22:53.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:22:53.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:22:53.328 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.329 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.329 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.329 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:53.329 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:53.329 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.163008877999999, 2024-04-26T10:22:53.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:22:53.329 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.329 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.329 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:53.329 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:53.329 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.329 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:22:53.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.330 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:53.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:53.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:22:53.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:53.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:22:53.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:22:53.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:22:53.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:22:53.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:22:53.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:22:53.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:22:53.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:22:53.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:22:53.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:22:53.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:53.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:22:53.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:22:53.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:22:53.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:22:53.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:53.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:22:53.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:22:53.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:22:53.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:22:53.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:22:53.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:22:53.334 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.334 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.334 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.335 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:53.335 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:53.335 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.162641803, 2024-04-26T10:22:53.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:22:53.335 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.335 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:53.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:53.335 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.335 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:22:53.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.335 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:53.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:53.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:22:53.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:22:53.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:22:53.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:22:53.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:22:53.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:22:53.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:22:53.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:22:53.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:22:53.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:22:53.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:22:53.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:53.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:22:53.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:22:53.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:22:53.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:22:53.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:22:53.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:22:53.339 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.339 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.339 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.340 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:53.340 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:53.340 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.162577550999998, 2024-04-26T10:22:53.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:22:53.340 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.340 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.340 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:53.340 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:53.340 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.340 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:22:53.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.341 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:53.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:53.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:22:53.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:22:53.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:22:53.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:22:53.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:22:53.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:22:53.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:22:53.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:22:53.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:22:53.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:22:53.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:22:53.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:53.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:22:53.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:22:53.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:22:53.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:22:53.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:22:53.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:22:53.344 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.344 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.345 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.345 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:53.345 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:53.345 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.158178878000001, 2024-04-26T10:22:53.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:22:53.345 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.345 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.345 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:53.345 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:53.345 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.345 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:22:53.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.346 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:53.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:53.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:22:53.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:22:53.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:22:53.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:22:53.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:22:53.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:22:53.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:22:53.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:22:53.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:22:53.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:22:53.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:22:53.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:53.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:22:53.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:22:53.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:22:53.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:22:53.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:22:53.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:22:53.349 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.350 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.350 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.350 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:53.350 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:53.350 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 22.156420895, 2024-04-26T10:22:53.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:22:53.350 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:53.350 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.350 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:53.350 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:53.350 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.350 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:22:53.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.351 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:53.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:53.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:53.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:53.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:53.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:53.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:53.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:22:53.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:53.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:22:53.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:22:53.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:53.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:22:53.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:22:53.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:22:53.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:22:53.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:53.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:22:53.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:22:53.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:53.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:22:53.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:22:53.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:53.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:22:53.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:22:53.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:22:53.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:22:53.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:53.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:22:53.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:22:53.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:53.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:22:53.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:22:53.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:53.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:53.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:53.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:22:53.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:22:53.355 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.355 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.355 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.356 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:53.356 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:53.356 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:53.357 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:53.352+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:53.358 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:53.458 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:53.456+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:53.488 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:53.489 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:53.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.489 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:173772 5.c 5:3ea3326c:::benchmark_data_smithi052_19421_object44300:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:53.489 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:53.478962+0000", 2024-04-26T10:22:53.489 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0072732810000000004, 2024-04-26T10:22:53.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007299832, 2024-04-26T10:22:53.489 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.489 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:53.489 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.489 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.489 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.490 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173772 2024-04-26T10:22:53.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.490 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.478962+0000", 2024-04-26T10:22:53.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.478962+0000", 2024-04-26T10:22:53.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.478962+0000", 2024-04-26T10:22:53.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.478965+0000", 2024-04-26T10:22:53.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2380000000000002e-06 2024-04-26T10:22:53.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.478974+0000", 2024-04-26T10:22:53.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7329999999999992e-06 2024-04-26T10:22:53.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.478979+0000", 2024-04-26T10:22:53.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.604e-06 2024-04-26T10:22:53.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.482440+0000", 2024-04-26T10:22:53.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034607399999999999 2024-04-26T10:22:53.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.482644+0000", 2024-04-26T10:22:53.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020424899999999999 2024-04-26T10:22:53.493 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.493 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.494 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.494 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:173775 5.5 5:a6f5f6a2:::benchmark_data_smithi052_19421_object44303:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:53.494 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:53.479034+0000", 2024-04-26T10:22:53.494 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0072010809999999998, 2024-04-26T10:22:53.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072988419999999998, 2024-04-26T10:22:53.494 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.494 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:53.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.495 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.495 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173775 2024-04-26T10:22:53.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.495 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479034+0000", 2024-04-26T10:22:53.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479034+0000", 2024-04-26T10:22:53.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479034+0000", 2024-04-26T10:22:53.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479036+0000", 2024-04-26T10:22:53.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5940000000000001e-06 2024-04-26T10:22:53.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479043+0000", 2024-04-26T10:22:53.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2500000000000003e-06 2024-04-26T10:22:53.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479049+0000", 2024-04-26T10:22:53.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9050000000000002e-06 2024-04-26T10:22:53.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.481094+0000", 2024-04-26T10:22:53.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020455009999999999 2024-04-26T10:22:53.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.481197+0000", 2024-04-26T10:22:53.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103319 2024-04-26T10:22:53.498 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.498 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.498 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.499 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:173776 5.f 5:fcd5cf47:::benchmark_data_smithi052_19421_object44304:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:53.499 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:53.479063+0000", 2024-04-26T10:22:53.499 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0071727300000000004, 2024-04-26T10:22:53.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007357092, 2024-04-26T10:22:53.499 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.499 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:53.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.499 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.499 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173776 2024-04-26T10:22:53.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.499 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479063+0000", 2024-04-26T10:22:53.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479063+0000", 2024-04-26T10:22:53.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479062+0000", 2024-04-26T10:22:53.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479065+0000", 2024-04-26T10:22:53.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8830000000000002e-06 2024-04-26T10:22:53.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479073+0000", 2024-04-26T10:22:53.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2719999999999997e-06 2024-04-26T10:22:53.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479078+0000", 2024-04-26T10:22:53.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0699999999999997e-06 2024-04-26T10:22:53.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.481009+0000", 2024-04-26T10:22:53.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001930569 2024-04-26T10:22:53.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.481139+0000", 2024-04-26T10:22:53.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013046800000000001 2024-04-26T10:22:53.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.481249+0000", 2024-04-26T10:22:53.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109812 2024-04-26T10:22:53.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484421+0000", 2024-04-26T10:22:53.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003171288 2024-04-26T10:22:53.503 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.503 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.504 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.504 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:173778 5.7 5:ecd8d3fd:::benchmark_data_smithi052_19421_object44306:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:53.504 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:53.479129+0000", 2024-04-26T10:22:53.504 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0071061910000000004, 2024-04-26T10:22:53.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0073686869999999996, 2024-04-26T10:22:53.504 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.504 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:53.504 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.504 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.504 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.505 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173778 2024-04-26T10:22:53.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.505 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479129+0000", 2024-04-26T10:22:53.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479129+0000", 2024-04-26T10:22:53.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479129+0000", 2024-04-26T10:22:53.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479132+0000", 2024-04-26T10:22:53.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7690000000000001e-06 2024-04-26T10:22:53.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479138+0000", 2024-04-26T10:22:53.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1909999999999997e-06 2024-04-26T10:22:53.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479144+0000", 2024-04-26T10:22:53.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8780000000000003e-06 2024-04-26T10:22:53.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.482655+0000", 2024-04-26T10:22:53.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035115810000000002 2024-04-26T10:22:53.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.482766+0000", 2024-04-26T10:22:53.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111007 2024-04-26T10:22:53.508 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.508 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.508 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.509 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:173779 5.d 5:b0b90bb1:::benchmark_data_smithi052_19421_object44307:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:53.509 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:53.479355+0000", 2024-04-26T10:22:53.509 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0068800199999999997, 2024-04-26T10:22:53.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072069980000000001, 2024-04-26T10:22:53.509 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.509 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:53.509 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.509 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.509 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.509 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173779 2024-04-26T10:22:53.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.510 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479355+0000", 2024-04-26T10:22:53.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479355+0000", 2024-04-26T10:22:53.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479354+0000", 2024-04-26T10:22:53.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479359+0000", 2024-04-26T10:22:53.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3409999999999996e-06 2024-04-26T10:22:53.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479367+0000", 2024-04-26T10:22:53.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2570000000000007e-06 2024-04-26T10:22:53.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479374+0000", 2024-04-26T10:22:53.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5259999999999999e-06 2024-04-26T10:22:53.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.482756+0000", 2024-04-26T10:22:53.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033819840000000002 2024-04-26T10:22:53.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.482885+0000", 2024-04-26T10:22:53.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012908099999999999 2024-04-26T10:22:53.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.482998+0000", 2024-04-26T10:22:53.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011338200000000001 2024-04-26T10:22:53.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484787+0000", 2024-04-26T10:22:53.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001788665 2024-04-26T10:22:53.514 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.514 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.514 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.515 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:173780 5.7 5:e116223a:::benchmark_data_smithi052_19421_object44308:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:53.515 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:53.479387+0000", 2024-04-26T10:22:53.515 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0068483980000000003, 2024-04-26T10:22:53.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072459400000000002, 2024-04-26T10:22:53.515 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.515 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:53.515 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.515 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.515 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.515 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173780 2024-04-26T10:22:53.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.516 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479387+0000", 2024-04-26T10:22:53.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479387+0000", 2024-04-26T10:22:53.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479387+0000", 2024-04-26T10:22:53.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479390+0000", 2024-04-26T10:22:53.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0429999999999999e-06 2024-04-26T10:22:53.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479396+0000", 2024-04-26T10:22:53.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2750000000000001e-06 2024-04-26T10:22:53.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.479402+0000", 2024-04-26T10:22:53.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.105e-06 2024-04-26T10:22:53.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484244+0000", 2024-04-26T10:22:53.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048415849999999998 2024-04-26T10:22:53.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484361+0000", 2024-04-26T10:22:53.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117626 2024-04-26T10:22:53.519 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.519 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.519 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.519 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:173782 5.c 5:371ac19a:::benchmark_data_smithi052_19421_object44310:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:53.519 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:53.481530+0000", 2024-04-26T10:22:53.519 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0047050870000000002, 2024-04-26T10:22:53.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051620609999999999, 2024-04-26T10:22:53.520 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.520 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:53.520 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.520 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.520 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.520 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173782 2024-04-26T10:22:53.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.520 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.481530+0000", 2024-04-26T10:22:53.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.481530+0000", 2024-04-26T10:22:53.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.481530+0000", 2024-04-26T10:22:53.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.481533+0000", 2024-04-26T10:22:53.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1149999999999998e-06 2024-04-26T10:22:53.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.481539+0000", 2024-04-26T10:22:53.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3249999999999996e-06 2024-04-26T10:22:53.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.481544+0000", 2024-04-26T10:22:53.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9119999999999997e-06 2024-04-26T10:22:53.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.483872+0000", 2024-04-26T10:22:53.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023279860000000002 2024-04-26T10:22:53.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484007+0000", 2024-04-26T10:22:53.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000134738 2024-04-26T10:22:53.524 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.524 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.524 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.525 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:173783 5.f 5:fa1db0cb:::benchmark_data_smithi052_19421_object44311:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:53.525 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:53.484290+0000", 2024-04-26T10:22:53.525 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001944917, 2024-04-26T10:22:53.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024612950000000001, 2024-04-26T10:22:53.525 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.525 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:53.525 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.525 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.525 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.525 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173783 2024-04-26T10:22:53.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.525 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484290+0000", 2024-04-26T10:22:53.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484290+0000", 2024-04-26T10:22:53.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484289+0000", 2024-04-26T10:22:53.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:53.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484294+0000", 2024-04-26T10:22:53.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1830000000000002e-06 2024-04-26T10:22:53.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484304+0000", 2024-04-26T10:22:53.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4089999999999992e-06 2024-04-26T10:22:53.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484311+0000", 2024-04-26T10:22:53.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7129999999999999e-06 2024-04-26T10:22:53.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484440+0000", 2024-04-26T10:22:53.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012986399999999999 2024-04-26T10:22:53.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484559+0000", 2024-04-26T10:22:53.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118447 2024-04-26T10:22:53.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484665+0000", 2024-04-26T10:22:53.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106174 2024-04-26T10:22:53.529 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.529 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.530 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.530 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:173784 5.f 5:f9a1ba90:::benchmark_data_smithi052_19421_object44312:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:53.530 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:53.484328+0000", 2024-04-26T10:22:53.530 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001907686, 2024-04-26T10:22:53.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0024854500000000002, 2024-04-26T10:22:53.530 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.530 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:53.530 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.530 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.531 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.531 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173784 2024-04-26T10:22:53.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.531 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484328+0000", 2024-04-26T10:22:53.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484328+0000", 2024-04-26T10:22:53.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484327+0000", 2024-04-26T10:22:53.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484334+0000", 2024-04-26T10:22:53.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.357e-06 2024-04-26T10:22:53.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484343+0000", 2024-04-26T10:22:53.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0159999999999997e-06 2024-04-26T10:22:53.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484349+0000", 2024-04-26T10:22:53.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8429999999999998e-06 2024-04-26T10:22:53.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.486224+0000", 2024-04-26T10:22:53.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018753419999999999 2024-04-26T10:22:53.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.486332+0000", 2024-04-26T10:22:53.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107178 2024-04-26T10:22:53.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.486436+0000", 2024-04-26T10:22:53.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010443899999999999 2024-04-26T10:22:53.534 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.534 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.534 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.535 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:173786 5.2 5:451262ae:::benchmark_data_smithi052_19421_object44314:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:53.535 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:53.484598+0000", 2024-04-26T10:22:53.535 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0016373609999999999, 2024-04-26T10:22:53.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002295123, 2024-04-26T10:22:53.535 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.535 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:53.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.535 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173786 2024-04-26T10:22:53.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.535 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484598+0000", 2024-04-26T10:22:53.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484598+0000", 2024-04-26T10:22:53.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484597+0000", 2024-04-26T10:22:53.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484602+0000", 2024-04-26T10:22:53.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7679999999999999e-06 2024-04-26T10:22:53.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484612+0000", 2024-04-26T10:22:53.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6879999999999994e-06 2024-04-26T10:22:53.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484619+0000", 2024-04-26T10:22:53.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2069999999999998e-06 2024-04-26T10:22:53.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484663+0000", 2024-04-26T10:22:53.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3671000000000003e-05 2024-04-26T10:22:53.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484786+0000", 2024-04-26T10:22:53.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012338599999999999 2024-04-26T10:22:53.539 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.539 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.539 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.539 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:173787 5.0 5:0c28aa45:::benchmark_data_smithi052_19421_object44315:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:53.539 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:53.484638+0000", 2024-04-26T10:22:53.539 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0015975830000000001, 2024-04-26T10:22:53.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023122920000000001, 2024-04-26T10:22:53.540 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.540 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:53.540 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.540 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.540 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.540 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173787 2024-04-26T10:22:53.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.540 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484638+0000", 2024-04-26T10:22:53.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484638+0000", 2024-04-26T10:22:53.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484637+0000", 2024-04-26T10:22:53.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484641+0000", 2024-04-26T10:22:53.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5319999999999998e-06 2024-04-26T10:22:53.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484648+0000", 2024-04-26T10:22:53.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5619999999999998e-06 2024-04-26T10:22:53.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484654+0000", 2024-04-26T10:22:53.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3580000000000002e-06 2024-04-26T10:22:53.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484695+0000", 2024-04-26T10:22:53.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1201000000000001e-05 2024-04-26T10:22:53.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484820+0000", 2024-04-26T10:22:53.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012554100000000001 2024-04-26T10:22:53.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484928+0000", 2024-04-26T10:22:53.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107267 2024-04-26T10:22:53.544 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.544 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.544 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.544 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:173788 5.9 5:92e9c219:::benchmark_data_smithi052_19421_object44316:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:53.545 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:53.484804+0000", 2024-04-26T10:22:53.545 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0014313010000000001, 2024-04-26T10:22:53.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022083939999999998, 2024-04-26T10:22:53.545 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.545 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:53.545 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.545 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.545 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.545 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173788 2024-04-26T10:22:53.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.545 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484804+0000", 2024-04-26T10:22:53.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484804+0000", 2024-04-26T10:22:53.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484803+0000", 2024-04-26T10:22:53.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484808+0000", 2024-04-26T10:22:53.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6650000000000002e-06 2024-04-26T10:22:53.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484817+0000", 2024-04-26T10:22:53.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0880000000000001e-06 2024-04-26T10:22:53.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484823+0000", 2024-04-26T10:22:53.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3770000000000001e-06 2024-04-26T10:22:53.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484867+0000", 2024-04-26T10:22:53.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3522000000000001e-05 2024-04-26T10:22:53.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484997+0000", 2024-04-26T10:22:53.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129605 2024-04-26T10:22:53.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.485102+0000", 2024-04-26T10:22:53.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105197 2024-04-26T10:22:53.549 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.549 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.549 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.550 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:173785 5.b e56/37 5:dcd97493:::benchmark_data_smithi052_19421_object44313:head v 56'10763, mlcod=56'10761)", 2024-04-26T10:22:53.550 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:53.484842+0000", 2024-04-26T10:22:53.550 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001392959, 2024-04-26T10:22:53.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022319890000000002, 2024-04-26T10:22:53.550 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.550 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:53.550 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484842+0000", 2024-04-26T10:22:53.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484842+0000", 2024-04-26T10:22:53.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484842+0000", 2024-04-26T10:22:53.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484847+0000", 2024-04-26T10:22:53.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5459999999999999e-06 2024-04-26T10:22:53.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484856+0000", 2024-04-26T10:22:53.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0520000000000002e-06 2024-04-26T10:22:53.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484860+0000", 2024-04-26T10:22:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6299999999999997e-06 2024-04-26T10:22:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484906+0000", 2024-04-26T10:22:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5500000000000001e-05 2024-04-26T10:22:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.484927+0000", 2024-04-26T10:22:53.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1157000000000001e-05 2024-04-26T10:22:53.554 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.554 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.554 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.554 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "pg_backfill(progress 5.4 e 56/56 lb 5:22010c0f:::benchmark_data_smithi052_19421_object70249:head)", 2024-04-26T10:22:53.554 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:53.486132+0000", 2024-04-26T10:22:53.554 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000103206, 2024-04-26T10:22:53.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00099146799999999991, 2024-04-26T10:22:53.554 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.554 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:53.555 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.486132+0000", 2024-04-26T10:22:53.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.486132+0000", 2024-04-26T10:22:53.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.486132+0000", 2024-04-26T10:22:53.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.486140+0000", 2024-04-26T10:22:53.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2230000000000007e-06 2024-04-26T10:22:53.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.486147+0000", 2024-04-26T10:22:53.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9179999999999997e-06 2024-04-26T10:22:53.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.486152+0000", 2024-04-26T10:22:53.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8910000000000003e-06 2024-04-26T10:22:53.557 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.557 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.557 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.557 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:173789 5.6 5:66577cde:::benchmark_data_smithi052_19421_object44317:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:53.558 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:53.486210+0000", 2024-04-26T10:22:53.558 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.5627999999999999e-05, 2024-04-26T10:22:53.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00096158099999999998, 2024-04-26T10:22:53.558 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.558 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:53.558 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.558 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.558 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.558 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 173789 2024-04-26T10:22:53.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.558 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.486210+0000", 2024-04-26T10:22:53.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.486210+0000", 2024-04-26T10:22:53.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.486209+0000", 2024-04-26T10:22:53.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.486213+0000", 2024-04-26T10:22:53.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1880000000000004e-06 2024-04-26T10:22:53.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.486221+0000", 2024-04-26T10:22:53.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0849999999999997e-06 2024-04-26T10:22:53.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.486227+0000", 2024-04-26T10:22:53.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.993e-06 2024-04-26T10:22:53.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.486271+0000", 2024-04-26T10:22:53.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3736000000000003e-05 2024-04-26T10:22:53.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:53.486397+0000", 2024-04-26T10:22:53.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000126363 2024-04-26T10:22:53.561 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.562 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.562 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.562 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.562 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:53.562 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 15 2024-04-26T10:22:53.562 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:53.564 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:53.564 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:53.560+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:53.664 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:53.663+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:53.692 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:53.692 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:53.692 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:53.692 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:53.692 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:53.704 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:53.766 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:53.760+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:53.837 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:53.837 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:53.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:53.837 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:53.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.837 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:53.838 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:53.838 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.795661925000001, 2024-04-26T10:22:53.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:22:53.838 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.838 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.838 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.838 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:22:53.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.838 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:53.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:53.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.839 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:53.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:22:53.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:22:53.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:22:53.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:22:53.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:22:53.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:22:53.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:22:53.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:22:53.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:22:53.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:22:53.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:22:53.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:22:53.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:22:53.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:22:53.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:22:53.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:22:53.843 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.843 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.843 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.843 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:53.843 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:53.843 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.795552674, 2024-04-26T10:22:53.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:22:53.844 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.844 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.844 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.844 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:22:53.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.844 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:53.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:53.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.845 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.845 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:53.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:22:53.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:22:53.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:22:53.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:22:53.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:22:53.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:22:53.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:22:53.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:22:53.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:22:53.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:22:53.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:22:53.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:22:53.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:22:53.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:22:53.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:22:53.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:22:53.849 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.849 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.849 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.849 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:53.849 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:53.850 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.793155261999999, 2024-04-26T10:22:53.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:22:53.850 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.850 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.850 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:22:53.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.850 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:53.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:53.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:22:53.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:53.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:22:53.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:22:53.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:22:53.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:22:53.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:22:53.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:22:53.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:22:53.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:22:53.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:22:53.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:22:53.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:22:53.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:22:53.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:22:53.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:22:53.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:22:53.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:22:53.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:22:53.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:22:53.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:22:53.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:22:53.855 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.855 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.855 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.855 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:53.855 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:53.855 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 29.792969337999999, 2024-04-26T10:22:53.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:22:53.855 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.856 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.856 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.856 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.856 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.856 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:22:53.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.856 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:53.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:53.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:22:53.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:22:53.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:22:53.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:22:53.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:22:53.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:22:53.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:22:53.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:22:53.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:22:53.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:22:53.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:22:53.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:22:53.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:22:53.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:22:53.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:22:53.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:22:53.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:22:53.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:22:53.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:22:53.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:22:53.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:22:53.861 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.861 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.861 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.861 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:53.861 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:53.861 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.7029467220000001, 2024-04-26T10:22:53.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:22:53.861 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.862 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.862 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.862 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.862 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.862 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:22:53.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.862 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:53.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:53.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:53.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:22:53.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:22:53.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:22:53.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:22:53.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:22:53.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:22:53.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:22:53.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:22:53.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:53.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:22:53.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:22:53.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:22:53.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:22:53.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:22:53.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:22:53.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:22:53.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:22:53.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:22:53.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:22:53.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:22:53.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:22:53.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:22:53.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:22:53.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:22:53.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:22:53.868 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.868 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.868 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.868 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:53.868 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:22:53.868 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.6798444759999995, 2024-04-26T10:22:53.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:22:53.868 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.868 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.868 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.869 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.869 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.869 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:22:53.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.869 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:22:53.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:22:53.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:22:53.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:53.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:22:53.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:22:53.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:22:53.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:22:53.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:22:53.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:22:53.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:22:53.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:22:53.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:53.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:22:53.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:22:53.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:22:53.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:22:53.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:22:53.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:22:53.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:22:53.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:22:53.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:22:53.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:22:53.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:22:53.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:22:53.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:22:53.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:22:53.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:22:53.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:22:53.875 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.875 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.875 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.875 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:53.875 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:22:53.875 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.6731613379999999, 2024-04-26T10:22:53.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:22:53.875 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.875 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.875 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.875 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.875 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.876 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:22:53.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.876 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:22:53.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:22:53.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:22:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:22:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:22:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:22:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:22:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:22:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:22:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:22:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:22:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:22:53.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:22:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:22:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:22:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:22:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:22:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:22:53.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:22:53.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:22:53.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:22:53.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:22:53.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:22:53.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:22:53.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:22:53.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:22:53.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:22:53.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.881 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.881 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.881 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:53.881 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:22:53.882 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.6711635529999995, 2024-04-26T10:22:53.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:22:53.882 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.882 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.882 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.882 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.882 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.882 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:22:53.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.882 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:22:53.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:22:53.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:22:53.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:53.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:22:53.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:22:53.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:22:53.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:22:53.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:22:53.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:22:53.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:22:53.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:22:53.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:53.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:22:53.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:22:53.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:22:53.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:22:53.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:22:53.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:22:53.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:22:53.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:22:53.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:22:53.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:22:53.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:22:53.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:22:53.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:22:53.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:22:53.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:22:53.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:22:53.888 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.888 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.888 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.888 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:53.889 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:22:53.889 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.6617548480000002, 2024-04-26T10:22:53.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:22:53.889 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.889 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.889 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.889 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:22:53.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.889 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:22:53.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:22:53.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:22:53.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:22:53.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:22:53.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:22:53.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:22:53.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:22:53.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:22:53.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:22:53.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:22:53.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:53.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:22:53.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:22:53.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:22:53.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:22:53.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:22:53.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:22:53.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:22:53.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:22:53.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:22:53.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:22:53.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:22:53.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:22:53.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:22:53.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:22:53.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:22:53.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:22:53.895 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.895 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.895 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.895 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:53.895 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:22:53.895 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.659926799, 2024-04-26T10:22:53.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:22:53.895 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.895 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.895 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:22:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:22:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:22:53.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:22:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:22:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:22:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:22:53.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:22:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:22:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:22:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:22:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:22:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:22:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:22:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:22:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:22:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:22:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:22:53.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:22:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:22:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:22:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:22:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:22:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:22:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:22:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:22:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:22:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:22:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:53.901 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.6483470770000004, 2024-04-26T10:22:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:22:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:22:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:53.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:22:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:22:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:22:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:22:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:22:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:22:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:22:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:22:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:22:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:22:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:22:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:22:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:22:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:22:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:22:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:22:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:22:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:22:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:22:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:22:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:22:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:22:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:22:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:22:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.907 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:22:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.6419365829999997, 2024-04-26T10:22:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:22:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:22:53.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:22:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:22:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:22:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:22:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:22:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:22:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:22:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:22:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:22:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:22:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:22:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:53.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:22:53.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:22:53.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:22:53.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:22:53.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:22:53.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:22:53.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:22:53.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:22:53.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:22:53.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:22:53.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:22:53.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:22:53.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:22:53.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:22:53.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:22:53.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:22:53.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.914 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.914 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.915 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:53.915 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:22:53.915 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.6293515200000002, 2024-04-26T10:22:53.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:22:53.915 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.915 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.915 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.915 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:22:53.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.915 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:22:53.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:22:53.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:22:53.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:22:53.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:22:53.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:22:53.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:22:53.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:22:53.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:22:53.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:22:53.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:22:53.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:53.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:22:53.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:22:53.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:22:53.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:22:53.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:22:53.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:22:53.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:22:53.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:22:53.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:22:53.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:22:53.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:22:53.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:22:53.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:22:53.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:22:53.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:22:53.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:22:53.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.921 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.921 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:53.921 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:22:53.921 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.6291165870000004, 2024-04-26T10:22:53.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:22:53.922 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.922 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.922 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:22:53.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.922 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:22:53.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:22:53.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:22:53.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:22:53.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:22:53.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:22:53.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:22:53.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:22:53.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:22:53.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:22:53.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:22:53.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:53.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:22:53.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:22:53.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:22:53.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:22:53.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:22:53.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:22:53.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:22:53.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:22:53.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:22:53.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:22:53.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:22:53.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:22:53.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:22:53.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:22:53.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:22:53.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:22:53.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.930 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.930 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:53.930 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:22:53.931 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5912417100000003, 2024-04-26T10:22:53.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:22:53.931 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.931 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:22:53.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.931 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:22:53.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:22:53.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:22:53.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:53.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:22:53.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:22:53.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:22:53.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:22:53.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:22:53.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:22:53.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:22:53.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:22:53.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:53.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:22:53.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:22:53.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:22:53.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:22:53.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:22:53.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:22:53.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:22:53.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:22:53.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:22:53.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:22:53.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:22:53.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:22:53.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:22:53.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:22:53.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:22:53.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:22:53.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.937 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.937 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:53.937 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:22:53.937 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5907966849999999, 2024-04-26T10:22:53.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:22:53.937 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.937 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.938 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:22:53.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.938 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:22:53.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:22:53.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:22:53.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:22:53.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:22:53.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:22:53.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:22:53.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:22:53.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:22:53.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:22:53.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:22:53.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:53.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:22:53.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:22:53.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:22:53.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:22:53.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:22:53.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:22:53.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:22:53.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:22:53.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:22:53.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:22:53.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:22:53.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:22:53.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:22:53.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:22:53.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:22:53.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:22:53.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.943 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.944 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:53.944 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:22:53.944 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5791936849999999, 2024-04-26T10:22:53.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:22:53.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.944 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:22:53.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.944 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:22:53.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:22:53.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:22:53.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:53.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:22:53.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:22:53.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:22:53.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:22:53.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:22:53.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:22:53.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:22:53.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:22:53.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:53.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:22:53.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:22:53.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:22:53.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:22:53.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:22:53.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:22:53.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:22:53.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:22:53.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:22:53.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:22:53.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:22:53.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:22:53.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:22:53.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:22:53.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:22:53.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:22:53.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.950 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.950 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:53.950 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:22:53.950 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5779200949999996, 2024-04-26T10:22:53.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:22:53.950 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.950 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.951 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:22:53.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.951 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:22:53.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:22:53.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:22:53.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:22:53.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:22:53.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:22:53.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:22:53.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:22:53.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:22:53.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:22:53.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:22:53.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:53.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:22:53.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:22:53.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:22:53.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:22:53.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:22:53.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:22:53.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:22:53.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:22:53.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:22:53.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:22:53.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:22:53.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:22:53.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:22:53.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:22:53.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:22:53.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:22:53.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.957 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.957 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.957 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:53.957 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:22:53.957 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5611627940000004, 2024-04-26T10:22:53.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:22:53.957 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.957 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.957 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:22:53.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.958 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:22:53.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:22:53.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:22:53.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:22:53.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:22:53.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:22:53.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:22:53.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:22:53.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:22:53.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:22:53.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:22:53.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:53.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:22:53.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:22:53.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:22:53.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:22:53.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:22:53.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:22:53.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:22:53.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:22:53.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:22:53.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:22:53.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:22:53.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:22:53.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:22:53.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:22:53.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:22:53.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:22:53.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.963 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.964 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:53.964 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:22:53.964 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.5162507730000003, 2024-04-26T10:22:53.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:22:53.964 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:53.964 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:53.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:53.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:53.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:53.964 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:22:53.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.964 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:53.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:53.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:22:53.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:53.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:22:53.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:53.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:53.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:22:53.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:53.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:53.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:22:53.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:22:53.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:53.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:22:53.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:22:53.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:53.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:22:53.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:22:53.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:22:53.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:22:53.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:53.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:22:53.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:22:53.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:53.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:22:53.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:22:53.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:53.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:22:53.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:22:53.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:53.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:22:53.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:22:53.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:53.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:22:53.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:22:53.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:53.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:22:53.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:22:53.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:53.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:22:53.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:22:53.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:53.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:53.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:53.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:22:53.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:22:53.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.970 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:53.970 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:53.970 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:53.971 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:53.971+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:53.972 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:54.072 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:54.071+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:54.104 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:175162 5.e 5:714b5bbc:::benchmark_data_smithi052_19421_object45690:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:54.098264+0000", 2024-04-26T10:22:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.005735441, 2024-04-26T10:22:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057568819999999996, 2024-04-26T10:22:54.104 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 175162 2024-04-26T10:22:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098264+0000", 2024-04-26T10:22:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098264+0000", 2024-04-26T10:22:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098264+0000", 2024-04-26T10:22:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098268+0000", 2024-04-26T10:22:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1869999999999999e-06 2024-04-26T10:22:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098277+0000", 2024-04-26T10:22:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5099999999999998e-06 2024-04-26T10:22:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098284+0000", 2024-04-26T10:22:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5780000000000001e-06 2024-04-26T10:22:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098334+0000", 2024-04-26T10:22:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9542000000000001e-05 2024-04-26T10:22:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098511+0000", 2024-04-26T10:22:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017706899999999999 2024-04-26T10:22:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:175163 5.4 5:24b0aa23:::benchmark_data_smithi052_19421_object45691:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:54.108 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:54.098299+0000", 2024-04-26T10:22:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0057008639999999999, 2024-04-26T10:22:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057773690000000001, 2024-04-26T10:22:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 175163 2024-04-26T10:22:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098299+0000", 2024-04-26T10:22:54.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098299+0000", 2024-04-26T10:22:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098298+0000", 2024-04-26T10:22:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098302+0000", 2024-04-26T10:22:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.349e-06 2024-04-26T10:22:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098310+0000", 2024-04-26T10:22:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7610000000000007e-06 2024-04-26T10:22:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098316+0000", 2024-04-26T10:22:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4969999999999998e-06 2024-04-26T10:22:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.099230+0000", 2024-04-26T10:22:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000913663 2024-04-26T10:22:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.099431+0000", 2024-04-26T10:22:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020169599999999999 2024-04-26T10:22:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.099635+0000", 2024-04-26T10:22:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020405299999999999 2024-04-26T10:22:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.102697+0000", 2024-04-26T10:22:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003061261 2024-04-26T10:22:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:175165 5.a 5:543f693e:::benchmark_data_smithi052_19421_object45693:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:54.098434+0000", 2024-04-26T10:22:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0055660199999999996, 2024-04-26T10:22:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.005698491, 2024-04-26T10:22:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.113 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.114 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.114 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 175165 2024-04-26T10:22:54.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.114 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098434+0000", 2024-04-26T10:22:54.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098434+0000", 2024-04-26T10:22:54.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098433+0000", 2024-04-26T10:22:54.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:54.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098438+0000", 2024-04-26T10:22:54.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2310000000000004e-06 2024-04-26T10:22:54.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098472+0000", 2024-04-26T10:22:54.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3430999999999999e-05 2024-04-26T10:22:54.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098479+0000", 2024-04-26T10:22:54.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7810000000000005e-06 2024-04-26T10:22:54.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098530+0000", 2024-04-26T10:22:54.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0753e-05 2024-04-26T10:22:54.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098651+0000", 2024-04-26T10:22:54.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120512 2024-04-26T10:22:54.117 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.117 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.117 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.117 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:175161 5.0 e56/54 5:0f058357:::benchmark_data_smithi052_19421_object45689:head v 56'10885, mlcod=56'10883)", 2024-04-26T10:22:54.117 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:54.098486+0000", 2024-04-26T10:22:54.117 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0055137379999999998, 2024-04-26T10:22:54.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057073310000000004, 2024-04-26T10:22:54.117 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.117 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:54.117 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098486+0000", 2024-04-26T10:22:54.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098486+0000", 2024-04-26T10:22:54.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098485+0000", 2024-04-26T10:22:54.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098492+0000", 2024-04-26T10:22:54.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0870000000000003e-06 2024-04-26T10:22:54.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098499+0000", 2024-04-26T10:22:54.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9179999999999994e-06 2024-04-26T10:22:54.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098505+0000", 2024-04-26T10:22:54.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9000000000000003e-06 2024-04-26T10:22:54.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098563+0000", 2024-04-26T10:22:54.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7717999999999999e-05 2024-04-26T10:22:54.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098584+0000", 2024-04-26T10:22:54.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1183e-05 2024-04-26T10:22:54.120 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.120 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.120 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.121 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:175170 5.e 5:758f421a:::benchmark_data_smithi052_19421_object45698:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:54.121 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:54.101120+0000", 2024-04-26T10:22:54.121 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0028800879999999998, 2024-04-26T10:22:54.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031167679999999998, 2024-04-26T10:22:54.121 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.121 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:54.121 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.121 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.121 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.121 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 175170 2024-04-26T10:22:54.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.122 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101120+0000", 2024-04-26T10:22:54.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101120+0000", 2024-04-26T10:22:54.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101118+0000", 2024-04-26T10:22:54.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:54.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101126+0000", 2024-04-26T10:22:54.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7540000000000006e-06 2024-04-26T10:22:54.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101141+0000", 2024-04-26T10:22:54.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4681999999999999e-05 2024-04-26T10:22:54.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101151+0000", 2024-04-26T10:22:54.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0152999999999999e-05 2024-04-26T10:22:54.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101206+0000", 2024-04-26T10:22:54.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4562999999999999e-05 2024-04-26T10:22:54.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101389+0000", 2024-04-26T10:22:54.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018305099999999999 2024-04-26T10:22:54.124 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.124 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.124 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.125 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:175168 5.0 e56/54 5:0fab06a3:::benchmark_data_smithi052_19421_object45696:head v 56'10886, mlcod=56'10883)", 2024-04-26T10:22:54.125 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:54.101559+0000", 2024-04-26T10:22:54.125 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0024405360000000001, 2024-04-26T10:22:54.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0027214140000000001, 2024-04-26T10:22:54.125 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.125 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:54.125 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101559+0000", 2024-04-26T10:22:54.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101559+0000", 2024-04-26T10:22:54.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101559+0000", 2024-04-26T10:22:54.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101565+0000", 2024-04-26T10:22:54.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6749999999999996e-06 2024-04-26T10:22:54.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101573+0000", 2024-04-26T10:22:54.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2300000000000002e-06 2024-04-26T10:22:54.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101578+0000", 2024-04-26T10:22:54.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1030000000000001e-06 2024-04-26T10:22:54.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.103804+0000", 2024-04-26T10:22:54.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022260750000000001 2024-04-26T10:22:54.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.103822+0000", 2024-04-26T10:22:54.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8703999999999999e-05 2024-04-26T10:22:54.130 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.130 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.130 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.130 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:175171 5.f e56/37 5:fa2e89c4:::benchmark_data_smithi052_19421_object45699:head v 56'11059, mlcod=56'11057)", 2024-04-26T10:22:54.130 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:54.101697+0000", 2024-04-26T10:22:54.130 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0023030799999999999, 2024-04-26T10:22:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002623378, 2024-04-26T10:22:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101697+0000", 2024-04-26T10:22:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101697+0000", 2024-04-26T10:22:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101696+0000", 2024-04-26T10:22:54.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101701+0000", 2024-04-26T10:22:54.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2810000000000002e-06 2024-04-26T10:22:54.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101709+0000", 2024-04-26T10:22:54.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0970000000000006e-06 2024-04-26T10:22:54.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101713+0000", 2024-04-26T10:22:54.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0860000000000004e-06 2024-04-26T10:22:54.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101758+0000", 2024-04-26T10:22:54.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5396999999999999e-05 2024-04-26T10:22:54.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.101777+0000", 2024-04-26T10:22:54.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8998e-05 2024-04-26T10:22:54.134 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.134 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.134 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.134 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:175160 5.8 5:1450af99:::benchmark_data_smithi052_19421_object45688:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:54.134 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:54.098218+0000", 2024-04-26T10:22:54.134 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0057821890000000001, 2024-04-26T10:22:54.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.006146983, 2024-04-26T10:22:54.134 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.134 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:54.134 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.135 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.135 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.135 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 175160 2024-04-26T10:22:54.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.135 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098218+0000", 2024-04-26T10:22:54.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098218+0000", 2024-04-26T10:22:54.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098216+0000", 2024-04-26T10:22:54.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:54.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098224+0000", 2024-04-26T10:22:54.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9500000000000001e-06 2024-04-26T10:22:54.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098237+0000", 2024-04-26T10:22:54.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3057000000000001e-05 2024-04-26T10:22:54.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098246+0000", 2024-04-26T10:22:54.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8449999999999992e-06 2024-04-26T10:22:54.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098295+0000", 2024-04-26T10:22:54.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8681999999999999e-05 2024-04-26T10:22:54.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:54.098491+0000", 2024-04-26T10:22:54.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000195904 2024-04-26T10:22:54.138 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.138 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.138 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.138 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.138 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:54.138 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 8 2024-04-26T10:22:54.138 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:54.140 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:54.163 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:22:54.173 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:54.168+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:54.259 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:54.259 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:54.259 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:54.260 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:54.260 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:54.272 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:54.273 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:54.271+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:54.375 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:54.375+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:54.395 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:54.395 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:54.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:54.395 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:54.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.395 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:54.395 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:54.395 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 53.862469787999999, 2024-04-26T10:22:54.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:54.395 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.396 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.396 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.396 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.396 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.396 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:54.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.396 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:54.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:54.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:54.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:54.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:54.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:54.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:54.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:54.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:54.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:54.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:54.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:54.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:54.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:54.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:54.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:54.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:54.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:54.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:54.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:54.400 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.400 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.400 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.400 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:54.400 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:54.401 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 53.860487560999999, 2024-04-26T10:22:54.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:54.401 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.401 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.401 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.401 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.401 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.401 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:54.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.401 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:54.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:54.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:54.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:54.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:54.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:54.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:54.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:54.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:54.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:54.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:54.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:54.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:54.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:54.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:54.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:54.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:54.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:54.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:54.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:54.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:54.405 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.405 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.405 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.405 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:54.405 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:54.406 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 53.860288177000001, 2024-04-26T10:22:54.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:54.406 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.406 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.406 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.406 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.406 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.406 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:54.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.406 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:54.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:54.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:54.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:54.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:54.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:54.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:54.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:54.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:54.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:54.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:54.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:54.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:54.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:54.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:54.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:54.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:54.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:54.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:54.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:54.410 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.410 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.410 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.410 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:54.410 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:54.411 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 53.860069557000003, 2024-04-26T10:22:54.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:54.411 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.411 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.411 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:54.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:54.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:54.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:54.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:54.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:54.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:54.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:54.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:54.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:54.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:54.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:54.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:54.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:54.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:54.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:54.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:54.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:54.415 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.415 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.415 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.415 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:54.415 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:54.415 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 53.857698118999998, 2024-04-26T10:22:54.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:54.415 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.415 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.415 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.415 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.415 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.416 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:54.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.416 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:54.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:54.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:54.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:54.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:54.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:54.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:54.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:54.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:54.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:54.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:54.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:54.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:54.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:54.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:54.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:54.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:54.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:54.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:54.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:54.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:54.420 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.420 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.420 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.420 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:54.420 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:54.420 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 53.857597497, 2024-04-26T10:22:54.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:54.420 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.420 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.420 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.420 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.421 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.421 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:54.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.421 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:54.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:54.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:54.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:54.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:54.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:54.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:54.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:54.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:54.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:54.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:54.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:54.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:54.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:54.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:54.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:54.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:54.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:54.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:54.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:54.425 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.425 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.425 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.425 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:54.425 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:54.425 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 53.857478936, 2024-04-26T10:22:54.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:54.425 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.425 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.425 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:54.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:54.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:54.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:54.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:54.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:54.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:54.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:54.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:54.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:54.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:54.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:54.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:54.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:54.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:54.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:54.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:54.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:54.429 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.429 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.429 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.429 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:54.429 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:54.429 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 53.857376537999997, 2024-04-26T10:22:54.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:54.429 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.429 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.430 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.430 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.430 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.430 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:54.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.430 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:54.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:54.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:54.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:54.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:54.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:54.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:54.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:54.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:54.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:54.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:54.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:54.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:54.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:54.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:54.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:54.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:54.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:54.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:54.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:54.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:54.434 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.434 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.434 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.434 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:54.434 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:54.434 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 53.856355981, 2024-04-26T10:22:54.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:54.435 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.435 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.435 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.435 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.435 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.435 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:54.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.435 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:54.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:54.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:54.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:54.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:54.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:54.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:54.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:54.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:54.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:54.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:54.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:54.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:54.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:54.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:54.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:54.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:54.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:54.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:54.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:54.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:54.439 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.439 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.439 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.439 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:54.439 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:54.440 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 53.855205706, 2024-04-26T10:22:54.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:54.440 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.440 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.440 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:54.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.440 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:54.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:54.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:54.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:54.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:54.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:54.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:54.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:54.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:54.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:54.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:54.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:54.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:54.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:54.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:54.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:54.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:54.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:54.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:54.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:54.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:54.444 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.444 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.444 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.445 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:54.445 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:54.445 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.358506464000001, 2024-04-26T10:22:54.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:22:54.445 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.445 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.445 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.445 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.445 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.445 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:22:54.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.445 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:54.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:54.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:22:54.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:54.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:22:54.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:22:54.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:22:54.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:22:54.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:22:54.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:22:54.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:22:54.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:22:54.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:22:54.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:22:54.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:54.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:22:54.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:22:54.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:54.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:22:54.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:22:54.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:54.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:22:54.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:22:54.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:22:54.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:22:54.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:22:54.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:22:54.450 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.450 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.450 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.451 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:54.451 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:54.451 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.358282868, 2024-04-26T10:22:54.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:22:54.451 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.451 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.451 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.451 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.451 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.451 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:22:54.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.452 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:54.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:54.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:22:54.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:22:54.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:22:54.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:22:54.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:22:54.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:22:54.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:22:54.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:22:54.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:22:54.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:22:54.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:22:54.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:54.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:22:54.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:22:54.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:54.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:22:54.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:22:54.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:54.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:22:54.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:22:54.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:22:54.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:22:54.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:22:54.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:22:54.456 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.457 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.457 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.457 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:54.457 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:54.457 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.327436548000001, 2024-04-26T10:22:54.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:22:54.457 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.457 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.457 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.457 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.458 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.458 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:22:54.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.458 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:54.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:54.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:22:54.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:54.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:22:54.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:22:54.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:22:54.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:22:54.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:22:54.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:22:54.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:22:54.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:22:54.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:22:54.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:22:54.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:54.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:22:54.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:22:54.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:54.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:22:54.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:22:54.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:54.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:22:54.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:22:54.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:22:54.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:22:54.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:22:54.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:22:54.462 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.463 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.463 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.463 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:54.463 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:54.463 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.325425445, 2024-04-26T10:22:54.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:22:54.463 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.463 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.463 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.463 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.463 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.463 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:22:54.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.464 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:54.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:54.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:54.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:22:54.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:22:54.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:22:54.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:22:54.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:22:54.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:22:54.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:22:54.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:22:54.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:22:54.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:22:54.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:54.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:22:54.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:22:54.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:54.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:22:54.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:22:54.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:54.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:22:54.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:22:54.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:22:54.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:22:54.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:22:54.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:22:54.468 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.468 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.468 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.468 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:54.469 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:54.469 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.314547340000001, 2024-04-26T10:22:54.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:22:54.469 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.469 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.469 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.469 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.469 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.469 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:22:54.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.469 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:54.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:54.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:22:54.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:54.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:22:54.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:22:54.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:22:54.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:22:54.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:22:54.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:22:54.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:22:54.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:22:54.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:22:54.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:22:54.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:54.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:22:54.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:22:54.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:54.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:22:54.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:22:54.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:54.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:22:54.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:22:54.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:22:54.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:22:54.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:22:54.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:22:54.474 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.474 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.474 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.475 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:54.475 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:54.475 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.311866121000001, 2024-04-26T10:22:54.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:22:54.475 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.475 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.475 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.475 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.475 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.475 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:22:54.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.475 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:54.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:54.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:22:54.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:54.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:22:54.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:22:54.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:22:54.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:22:54.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:22:54.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:22:54.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:22:54.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:22:54.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:22:54.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:22:54.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:54.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:22:54.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:22:54.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:54.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:22:54.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:22:54.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:54.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:22:54.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:22:54.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:22:54.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:22:54.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:22:54.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:22:54.480 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.480 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.480 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.481 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:54.481 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:54.481 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.311499046000002, 2024-04-26T10:22:54.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:22:54.481 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.481 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.481 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.481 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.481 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.482 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:22:54.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.482 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:54.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:54.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:22:54.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:54.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:22:54.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:22:54.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:22:54.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:22:54.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:22:54.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:22:54.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:22:54.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:22:54.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:22:54.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:22:54.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:54.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:22:54.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:22:54.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:22:54.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:22:54.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:22:54.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:22:54.486 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.486 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.486 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.486 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:54.486 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:54.486 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.311434794, 2024-04-26T10:22:54.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:22:54.487 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.487 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.487 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.487 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.487 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.487 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:22:54.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.487 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:54.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:54.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:22:54.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:22:54.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:22:54.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:22:54.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:22:54.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:22:54.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:22:54.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:22:54.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:22:54.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:22:54.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:22:54.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:54.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:22:54.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:22:54.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:22:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:22:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:22:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:22:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:54.491 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.307036120999999, 2024-04-26T10:22:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:22:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:22:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:54.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:22:54.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:22:54.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:22:54.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:22:54.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:22:54.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:22:54.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:22:54.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:22:54.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:22:54.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:22:54.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:22:54.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:54.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:22:54.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:22:54.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:22:54.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:22:54.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:22:54.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:22:54.497 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.497 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.497 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.498 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:54.498 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:54.498 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 23.305278137999998, 2024-04-26T10:22:54.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:22:54.498 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:54.498 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:54.498 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:54.498 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:54.499 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.499 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:22:54.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.499 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:54.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:54.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:54.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:54.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:54.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:54.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:54.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:22:54.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:54.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.500 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:54.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:22:54.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:22:54.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:54.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:22:54.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:22:54.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:22:54.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:22:54.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:54.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:22:54.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:22:54.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:54.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:22:54.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:22:54.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:54.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:22:54.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:22:54.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:54.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:22:54.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:22:54.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:54.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:22:54.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:22:54.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:54.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:22:54.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:22:54.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:54.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:54.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:54.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:22:54.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:22:54.504 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.504 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.504 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.504 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:54.504 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:54.504 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:54.505 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:54.500+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:54.506 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:54.606 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:54.603+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:54.637 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:54.637 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:54.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.638 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:176411 5.9 5:9a541735:::benchmark_data_smithi052_19421_object46939:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:54.638 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:54.627764+0000", 2024-04-26T10:22:54.638 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0079563719999999998, 2024-04-26T10:22:54.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079767250000000005, 2024-04-26T10:22:54.638 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:54.638 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:54.638 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:54.638 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:54.638 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.638 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 176411 2024-04-26T10:22:54.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.639 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:54.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:54.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.627764+0000", 2024-04-26T10:22:54.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:54.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.627764+0000", 2024-04-26T10:22:54.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:54.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.627764+0000", 2024-04-26T10:22:54.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:54.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.627768+0000", 2024-04-26T10:22:54.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7309999999999999e-06 2024-04-26T10:22:54.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:54.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.627778+0000", 2024-04-26T10:22:54.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0556e-05 2024-04-26T10:22:54.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.627784+0000", 2024-04-26T10:22:54.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7570000000000001e-06 2024-04-26T10:22:54.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:54.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630629+0000", 2024-04-26T10:22:54.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0028453290000000002 2024-04-26T10:22:54.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:54.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630819+0000", 2024-04-26T10:22:54.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000190077 2024-04-26T10:22:54.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:54.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630943+0000", 2024-04-26T10:22:54.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000124072 2024-04-26T10:22:54.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:54.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.634499+0000", 2024-04-26T10:22:54.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003555847 2024-04-26T10:22:54.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.642 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:54.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.643 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:176412 5.9 5:93fc633e:::benchmark_data_smithi052_19421_object46940:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:54.643 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:54.627789+0000", 2024-04-26T10:22:54.643 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0079315500000000008, 2024-04-26T10:22:54.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0079978150000000001, 2024-04-26T10:22:54.643 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:54.643 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:54.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:54.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:54.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.643 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 176412 2024-04-26T10:22:54.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.643 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:54.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:54.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.627789+0000", 2024-04-26T10:22:54.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:54.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.627789+0000", 2024-04-26T10:22:54.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:54.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.627789+0000", 2024-04-26T10:22:54.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:54.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.627792+0000", 2024-04-26T10:22:54.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0000000000000001e-06 2024-04-26T10:22:54.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:54.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.627800+0000", 2024-04-26T10:22:54.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2519999999999999e-06 2024-04-26T10:22:54.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.627805+0000", 2024-04-26T10:22:54.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5889999999999996e-06 2024-04-26T10:22:54.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:54.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.632566+0000", 2024-04-26T10:22:54.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047613179999999996 2024-04-26T10:22:54.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:54.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.632690+0000", 2024-04-26T10:22:54.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123779 2024-04-26T10:22:54.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:54.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.632807+0000", 2024-04-26T10:22:54.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116966 2024-04-26T10:22:54.647 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.647 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:54.647 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.647 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:176406 5.4 e56/37 5:2a002033:::benchmark_data_smithi052_19421_object46934:head v 56'11135, mlcod=56'11132)", 2024-04-26T10:22:54.647 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:54.629777+0000", 2024-04-26T10:22:54.647 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0059442770000000004, 2024-04-26T10:22:54.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006047958, 2024-04-26T10:22:54.647 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:54.647 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:54.648 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:54.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:54.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.629777+0000", 2024-04-26T10:22:54.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:54.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.629777+0000", 2024-04-26T10:22:54.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:54.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.629776+0000", 2024-04-26T10:22:54.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:54.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.629782+0000", 2024-04-26T10:22:54.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1399999999999997e-06 2024-04-26T10:22:54.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:54.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.629791+0000", 2024-04-26T10:22:54.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9989999999999997e-06 2024-04-26T10:22:54.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.629797+0000", 2024-04-26T10:22:54.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2779999999999999e-06 2024-04-26T10:22:54.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:54.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.629841+0000", 2024-04-26T10:22:54.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3158000000000003e-05 2024-04-26T10:22:54.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:54.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.629861+0000", 2024-04-26T10:22:54.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0183e-05 2024-04-26T10:22:54.650 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.651 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:54.651 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.651 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:176415 5.6 5:678d636b:::benchmark_data_smithi052_19421_object46943:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:54.651 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:54.630138+0000", 2024-04-26T10:22:54.651 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0055825420000000002, 2024-04-26T10:22:54.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057306090000000002, 2024-04-26T10:22:54.651 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:54.651 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:54.651 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:54.651 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:54.651 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.651 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 176415 2024-04-26T10:22:54.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.652 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:54.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:54.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630138+0000", 2024-04-26T10:22:54.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:54.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630138+0000", 2024-04-26T10:22:54.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:54.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630137+0000", 2024-04-26T10:22:54.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:54.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:54.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630142+0000", 2024-04-26T10:22:54.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9579999999999998e-06 2024-04-26T10:22:54.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:54.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630155+0000", 2024-04-26T10:22:54.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2996000000000001e-05 2024-04-26T10:22:54.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630165+0000", 2024-04-26T10:22:54.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4239999999999999e-06 2024-04-26T10:22:54.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:54.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.631949+0000", 2024-04-26T10:22:54.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001784126 2024-04-26T10:22:54.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:54.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.632042+0000", 2024-04-26T10:22:54.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3518999999999997e-05 2024-04-26T10:22:54.655 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.655 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:54.655 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.655 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:176416 5.1 5:83504f9c:::benchmark_data_smithi052_19421_object46944:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:54.655 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:54.630172+0000", 2024-04-26T10:22:54.655 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0055490749999999997, 2024-04-26T10:22:54.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057529599999999997, 2024-04-26T10:22:54.655 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:54.655 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:54.656 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:54.656 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:54.656 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.656 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 176416 2024-04-26T10:22:54.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.656 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:54.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:54.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630172+0000", 2024-04-26T10:22:54.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:54.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630172+0000", 2024-04-26T10:22:54.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:54.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630171+0000", 2024-04-26T10:22:54.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:54.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630174+0000", 2024-04-26T10:22:54.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.807e-06 2024-04-26T10:22:54.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:54.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630183+0000", 2024-04-26T10:22:54.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5019999999999992e-06 2024-04-26T10:22:54.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630191+0000", 2024-04-26T10:22:54.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3590000000000008e-06 2024-04-26T10:22:54.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:54.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.632554+0000", 2024-04-26T10:22:54.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023627990000000001 2024-04-26T10:22:54.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:54.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.632667+0000", 2024-04-26T10:22:54.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113136 2024-04-26T10:22:54.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.662 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:54.663 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.663 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:176418 5.c 5:3b27b0d3:::benchmark_data_smithi052_19421_object46946:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:54.663 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:54.630651+0000", 2024-04-26T10:22:54.663 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0050698669999999996, 2024-04-26T10:22:54.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053134799999999998, 2024-04-26T10:22:54.663 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:54.663 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:54.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:54.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:54.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.663 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 176418 2024-04-26T10:22:54.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.664 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:54.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:54.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630651+0000", 2024-04-26T10:22:54.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:54.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630651+0000", 2024-04-26T10:22:54.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:54.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630650+0000", 2024-04-26T10:22:54.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:54.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:54.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630656+0000", 2024-04-26T10:22:54.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0229999999999998e-06 2024-04-26T10:22:54.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:54.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630665+0000", 2024-04-26T10:22:54.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9420000000000001e-06 2024-04-26T10:22:54.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630671+0000", 2024-04-26T10:22:54.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3339999999999998e-06 2024-04-26T10:22:54.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:54.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.630712+0000", 2024-04-26T10:22:54.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0476999999999999e-05 2024-04-26T10:22:54.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:54.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.631029+0000", 2024-04-26T10:22:54.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00031786199999999997 2024-04-26T10:22:54.666 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.667 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:54.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.667 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:176419 5.b e56/37 5:db27c08a:::benchmark_data_smithi052_19421_object46947:head v 56'10934, mlcod=56'10932)", 2024-04-26T10:22:54.667 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:54.632776+0000", 2024-04-26T10:22:54.667 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0029445220000000002, 2024-04-26T10:22:54.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003225211, 2024-04-26T10:22:54.667 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:54.667 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:54.667 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:54.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:54.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.632776+0000", 2024-04-26T10:22:54.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:54.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.632776+0000", 2024-04-26T10:22:54.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:54.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.632776+0000", 2024-04-26T10:22:54.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:54.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.632781+0000", 2024-04-26T10:22:54.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9969999999999998e-06 2024-04-26T10:22:54.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:54.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.632789+0000", 2024-04-26T10:22:54.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2330000000000006e-06 2024-04-26T10:22:54.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.632795+0000", 2024-04-26T10:22:54.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.404e-06 2024-04-26T10:22:54.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:54.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.632841+0000", 2024-04-26T10:22:54.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5265000000000001e-05 2024-04-26T10:22:54.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:54.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.632861+0000", 2024-04-26T10:22:54.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0296e-05 2024-04-26T10:22:54.670 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.670 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:54.670 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.671 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:176420 5.4 e56/37 5:24549ab8:::benchmark_data_smithi052_19421_object46948:head v 56'11136, mlcod=56'11133)", 2024-04-26T10:22:54.671 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:54.633651+0000", 2024-04-26T10:22:54.671 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0020701489999999999, 2024-04-26T10:22:54.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023814740000000002, 2024-04-26T10:22:54.671 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:54.671 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:54.671 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:54.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:54.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.633651+0000", 2024-04-26T10:22:54.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:54.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.633651+0000", 2024-04-26T10:22:54.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:54.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.633650+0000", 2024-04-26T10:22:54.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:54.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.633655+0000", 2024-04-26T10:22:54.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0930000000000002e-06 2024-04-26T10:22:54.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:54.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.633666+0000", 2024-04-26T10:22:54.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0998e-05 2024-04-26T10:22:54.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.633672+0000", 2024-04-26T10:22:54.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.339e-06 2024-04-26T10:22:54.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:54.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.633736+0000", 2024-04-26T10:22:54.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4770999999999994e-05 2024-04-26T10:22:54.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:54.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.633760+0000", 2024-04-26T10:22:54.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3666999999999999e-05 2024-04-26T10:22:54.674 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.674 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:54.674 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.675 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:176422 5.5 5:a5c94c41:::benchmark_data_smithi052_19421_object46950:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:54.675 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:54.633714+0000", 2024-04-26T10:22:54.675 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0020064409999999999, 2024-04-26T10:22:54.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023499720000000001, 2024-04-26T10:22:54.675 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:54.675 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:54.675 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:54.675 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:54.675 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.675 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 176422 2024-04-26T10:22:54.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.675 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:54.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:54.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.633714+0000", 2024-04-26T10:22:54.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:54.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.633714+0000", 2024-04-26T10:22:54.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:54.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.633713+0000", 2024-04-26T10:22:54.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:54.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:54.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.633718+0000", 2024-04-26T10:22:54.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.938e-06 2024-04-26T10:22:54.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:54.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.633732+0000", 2024-04-26T10:22:54.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4402e-05 2024-04-26T10:22:54.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.633738+0000", 2024-04-26T10:22:54.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9000000000000003e-06 2024-04-26T10:22:54.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:54.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.633796+0000", 2024-04-26T10:22:54.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7221e-05 2024-04-26T10:22:54.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:54.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.633918+0000", 2024-04-26T10:22:54.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012244999999999999 2024-04-26T10:22:54.678 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.678 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:54.678 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.679 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:176423 5.0 5.21c292d0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:54.679 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:54.636032+0000", 2024-04-26T10:22:54.679 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9996891, 2024-04-26T10:22:54.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2517999999999997e-05, 2024-04-26T10:22:54.679 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:54.679 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-04-26T10:22:54.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:54.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:54.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.679 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 176423 2024-04-26T10:22:54.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.679 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:54.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:54.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636032+0000", 2024-04-26T10:22:54.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:54.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636032+0000", 2024-04-26T10:22:54.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:54.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636031+0000", 2024-04-26T10:22:54.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:54.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:54.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636035+0000", 2024-04-26T10:22:54.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6629999999999999e-06 2024-04-26T10:22:54.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:54.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636044+0000", 2024-04-26T10:22:54.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4639999999999995e-06 2024-04-26T10:22:54.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636051+0000", 2024-04-26T10:22:54.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3000000000000004e-06 2024-04-26T10:22:54.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:54.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636121+0000", 2024-04-26T10:22:54.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9298e-05 2024-04-26T10:22:54.682 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.682 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:54.682 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.682 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:176425 5.6 5:60e5039b:::benchmark_data_smithi052_19421_object46953:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:54.682 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:54.636071+0000", 2024-04-26T10:22:54.682 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.99965, 2024-04-26T10:22:54.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112324, 2024-04-26T10:22:54.682 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:54.682 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-04-26T10:22:54.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:54.683 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:54.683 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.683 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 176425 2024-04-26T10:22:54.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.683 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:54.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:54.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636071+0000", 2024-04-26T10:22:54.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:54.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636071+0000", 2024-04-26T10:22:54.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:54.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636070+0000", 2024-04-26T10:22:54.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:54.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636073+0000", 2024-04-26T10:22:54.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5450000000000002e-06 2024-04-26T10:22:54.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:54.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636083+0000", 2024-04-26T10:22:54.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0582e-05 2024-04-26T10:22:54.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636093+0000", 2024-04-26T10:22:54.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4050000000000006e-06 2024-04-26T10:22:54.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:54.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636135+0000", 2024-04-26T10:22:54.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2666000000000001e-05 2024-04-26T10:22:54.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.685 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:54.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.685 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:176426 5.1 5:8281c60c:::benchmark_data_smithi052_19421_object46954:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-26T10:22:54.686 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:54.636108+0000", 2024-04-26T10:22:54.686 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9996128, 2024-04-26T10:22:54.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013289000000000001, 2024-04-26T10:22:54.686 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:54.686 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-04-26T10:22:54.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:54.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:54.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:54.686 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 176426 2024-04-26T10:22:54.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.686 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:54.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:54.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636108+0000", 2024-04-26T10:22:54.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:54.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636108+0000", 2024-04-26T10:22:54.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:54.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:54.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636107+0000", 2024-04-26T10:22:54.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:54.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:54.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636110+0000", 2024-04-26T10:22:54.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2119999999999999e-06 2024-04-26T10:22:54.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:54.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636117+0000", 2024-04-26T10:22:54.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3010000000000003e-06 2024-04-26T10:22:54.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:54.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636124+0000", 2024-04-26T10:22:54.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.277e-06 2024-04-26T10:22:54.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:54.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:54.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:54.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:54.636158+0000", 2024-04-26T10:22:54.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3728e-05 2024-04-26T10:22:54.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.689 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:54.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:54.689 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:54.689 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 12 2024-04-26T10:22:54.689 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:54.690 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:54.707 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:54.704+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:54.809 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:54.804+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:54.817 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:54.817 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:54.817 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:54.818 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:54.818 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:54.830 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:54.910 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:54.907+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:54.910 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:22:55.009 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:55.009 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.967527489999998, 2024-04-26T10:22:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:22:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:22:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.010 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:55.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:22:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:22:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:22:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:22:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.012 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:22:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:22:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:22:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:22:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:22:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:22:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:22:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:22:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:22:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:22:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:22:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:22:55.014 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.967418239000001, 2024-04-26T10:22:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:22:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.015 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:22:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:22:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:22:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:22:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:22:55.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:22:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:22:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:22:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:22:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:22:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:22:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:22:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:22:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:22:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:22:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:22:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:22:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.965020827, 2024-04-26T10:22:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:22:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.020 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:22:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:22:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:22:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:22:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:22:55.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:22:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:22:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:22:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:22:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:22:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:22:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:22:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:22:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:22:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:22:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:22:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:22:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:22:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:22:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:22:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:22:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:22:55.025 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.964834903, 2024-04-26T10:22:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:22:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.026 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:22:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:22:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:22:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:22:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:22:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:22:55.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:22:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:22:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:22:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:22:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:22:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:22:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:22:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:22:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:22:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:22:55.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:22:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:22:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:22:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:22:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:22:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:22:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.8748122870000001, 2024-04-26T10:22:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:22:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.032 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:22:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:22:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:22:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:22:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:22:55.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:22:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:22:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:22:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:22:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:22:55.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:22:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:22:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:22:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:22:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:22:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:22:55.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:22:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:22:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:22:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:22:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:22:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:22:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:22:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:22:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:22:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:22:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.8517100410000005, 2024-04-26T10:22:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:22:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:22:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:22:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:22:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:22:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:55.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:22:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:22:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:22:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:22:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:22:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:22:55.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:22:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:22:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:22:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:22:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:22:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:22:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:22:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:22:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:22:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:22:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:55.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:22:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:22:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:22:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:22:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:22:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:22:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:22:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:22:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:22:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.8450269029999999, 2024-04-26T10:22:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:22:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:22:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:22:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:22:55.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:22:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:22:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:22:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:22:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:22:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:22:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:22:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:22:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:22:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:22:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:22:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:22:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:22:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:22:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:22:55.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:22:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:22:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:22:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:22:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:22:55.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:22:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:22:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:22:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:22:55.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:22:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:22:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.8430291180000005, 2024-04-26T10:22:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:22:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:22:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:22:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:22:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:22:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:22:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:22:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:22:55.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:22:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:22:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:22:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:22:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:22:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:55.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:22:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:22:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:22:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:22:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:22:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:22:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:22:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:22:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:22:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:22:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:22:55.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:22:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:22:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:22:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:22:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:22:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.058 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:22:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.8336204130000002, 2024-04-26T10:22:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:22:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:22:55.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:22:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:22:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:22:55.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:22:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:22:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:22:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:22:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:22:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:22:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:22:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:22:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:22:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:22:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:22:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:22:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:22:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:22:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:22:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:22:55.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:22:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:22:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:22:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:22:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:22:55.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:22:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:22:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:22:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:55.065 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:22:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.831792364, 2024-04-26T10:22:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:22:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:22:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:22:55.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:22:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:22:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:22:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:22:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:22:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:22:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:22:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:22:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:22:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:22:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:22:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:22:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:22:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:22:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:22:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:22:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:22:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:22:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:22:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:22:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:22:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:22:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:22:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:22:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:22:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:22:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.071 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.8202126419999995, 2024-04-26T10:22:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:22:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:22:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.072 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:55.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:22:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:22:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:22:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:22:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:22:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:22:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:22:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:22:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:22:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:22:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:22:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:22:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:22:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:22:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:22:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:22:55.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:22:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:22:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:22:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:22:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:22:55.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:22:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:22:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:22:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:55.078 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:22:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.8138021479999997, 2024-04-26T10:22:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:22:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:22:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:22:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:22:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:22:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:22:55.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:22:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:22:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:22:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:22:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:22:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:22:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:22:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:22:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:22:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:22:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:22:55.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:22:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:22:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:22:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:22:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:22:55.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:22:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:22:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:22:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:22:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:22:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:22:55.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:22:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:22:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.8012170850000002, 2024-04-26T10:22:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:22:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:22:55.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:22:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:22:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:22:55.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:22:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:22:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:22:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:22:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:22:55.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:22:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:22:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:22:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:22:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:22:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:22:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:22:55.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:22:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:22:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:22:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:22:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:22:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:22:55.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:22:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:22:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:22:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:22:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:22:55.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:22:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:22:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.8009821519999996, 2024-04-26T10:22:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:22:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.091 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:22:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:22:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:22:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:22:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:22:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:22:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:22:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:22:55.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:22:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:22:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:22:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:22:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:22:55.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:22:55.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:22:55.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:22:55.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:22:55.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:22:55.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:55.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:22:55.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:22:55.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:55.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:22:55.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:22:55.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:22:55.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:22:55.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:22:55.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:22:55.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:22:55.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:22:55.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.097 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.097 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:55.097 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:22:55.097 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.7631072750000003, 2024-04-26T10:22:55.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:22:55.097 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.097 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.098 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.098 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:22:55.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.098 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:22:55.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:22:55.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:22:55.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:55.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:22:55.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:22:55.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:22:55.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:22:55.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:22:55.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:22:55.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:22:55.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:22:55.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:55.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:22:55.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:22:55.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:22:55.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:22:55.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:22:55.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:22:55.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:55.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:22:55.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:22:55.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:22:55.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:22:55.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:55.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:22:55.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:22:55.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:22:55.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:22:55.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:22:55.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:22:55.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.103 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.103 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.103 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:55.103 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:22:55.104 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.76266225, 2024-04-26T10:22:55.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:22:55.104 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.104 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.104 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.104 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:22:55.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.104 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:22:55.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:22:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:22:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:22:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:22:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:22:55.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:22:55.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:22:55.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:22:55.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:22:55.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:22:55.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:55.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:22:55.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:22:55.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:22:55.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:22:55.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:22:55.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:22:55.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:55.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:22:55.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:22:55.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:22:55.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:22:55.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:55.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:22:55.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:22:55.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:22:55.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:22:55.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:22:55.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:22:55.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.109 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.109 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:55.109 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:22:55.110 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.75105925, 2024-04-26T10:22:55.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:22:55.110 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.110 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.110 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:22:55.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.110 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:22:55.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:22:55.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:22:55.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:55.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:22:55.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:22:55.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:22:55.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:22:55.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:22:55.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:22:55.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:22:55.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:22:55.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:55.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:22:55.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:22:55.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:22:55.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:22:55.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:22:55.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:22:55.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:55.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:22:55.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:22:55.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:55.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:22:55.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:22:55.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:22:55.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:22:55.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:22:55.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:22:55.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:22:55.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:22:55.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.115 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.116 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:55.116 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:22:55.116 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.7497856599999997, 2024-04-26T10:22:55.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:22:55.116 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.116 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.116 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.116 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.116 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.116 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:22:55.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.116 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:22:55.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:22:55.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:22:55.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:55.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:22:55.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:22:55.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:22:55.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:22:55.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:22:55.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:22:55.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:22:55.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:22:55.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:55.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:22:55.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:22:55.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:22:55.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:22:55.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:22:55.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:22:55.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:55.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:22:55.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:22:55.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:55.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:22:55.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:22:55.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:22:55.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:22:55.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:22:55.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:22:55.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:22:55.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:22:55.122 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.122 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.122 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.122 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:55.122 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:22:55.122 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.7330283590000004, 2024-04-26T10:22:55.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:22:55.122 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.122 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.122 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.122 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.123 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.123 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:22:55.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.123 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:22:55.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:22:55.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:22:55.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:55.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:22:55.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:22:55.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:22:55.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:22:55.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:22:55.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:22:55.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:22:55.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:22:55.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:55.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:22:55.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:22:55.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:22:55.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:22:55.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:22:55.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:22:55.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:55.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:22:55.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:22:55.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:55.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:22:55.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:22:55.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:22:55.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:22:55.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:22:55.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:22:55.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:22:55.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:22:55.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.128 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.128 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:55.128 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:22:55.128 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 5.6881163380000004, 2024-04-26T10:22:55.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:22:55.129 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:55.129 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:55.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:55.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:55.129 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:55.129 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:22:55.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.129 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:55.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:55.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:22:55.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:55.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:22:55.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:55.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:55.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:22:55.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:55.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:55.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:22:55.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:22:55.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:55.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:22:55.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:22:55.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:55.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:22:55.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:22:55.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:22:55.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:22:55.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:55.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:22:55.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:22:55.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:55.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:22:55.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:22:55.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:55.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:22:55.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:22:55.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:55.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:22:55.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:22:55.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:55.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:22:55.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:22:55.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:55.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:22:55.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:22:55.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:55.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:22:55.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:22:55.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:55.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:55.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:55.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:22:55.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:22:55.134 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.134 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.134 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.134 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:55.134 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:55.135 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:55.136 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:55.136 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:55.136 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:55.137 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:55.138 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:55.132+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:55.138 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:55.138 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:55.138 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:55.138 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:55.163 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T10:22:55.236 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:55.232+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:55.259 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:55.259 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:55.272 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:55.337 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:55.332+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:55.387 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:55.387 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:55.402 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:55.438 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:55.434+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:55.522 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:55.522 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:55.534 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:55.578 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:55.576+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:55.640 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:55.636+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:55.661 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:55.661 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:55.674 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:55.741 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:55.738+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:55.802 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:55.802 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:55.815 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:55.841 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:55.836+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:55.936 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:55.936 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:55.942 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:55.940+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:55.948 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:56.043 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:56.042+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:56.071 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:56.071 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:56.083 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:56.144 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:56.140+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:56.208 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:56.208 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:56.221 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:56.245 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:56.242+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:56.346 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:56.346 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:56.349 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:56.342+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:56.359 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:56.447 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:56.446+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:56.494 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:56.494 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:56.508 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:56.547 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:56.544+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:56.635 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:56.635 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:56.648 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:56.648 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:56.644+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:56.748 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:56.744+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:56.778 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:56.778 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:56.790 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:56.848 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:56.844+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:56.917 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:56.917 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:56.931 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:56.950 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:56.944+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:57.045 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:57.045 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:57.050 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:57.048+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:57.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:57.139 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:22:57.151 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:57.150+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:57.176 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:22:57.179 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:57.179 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:57.193 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:57.252 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:57.250+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:57.287 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:57.309 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:57.310 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:57.310 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:57.310 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:57.312 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:57.313 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:57.325 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:182516 5.2 5:48b32692:::benchmark_data_smithi052_19421_object53044:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:22:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:57.319631+0000", 2024-04-26T10:22:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0036553570000000001, 2024-04-26T10:22:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036787629999999998, 2024-04-26T10:22:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:57.325 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 182516 2024-04-26T10:22:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.319631+0000", 2024-04-26T10:22:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.319631+0000", 2024-04-26T10:22:57.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.319630+0000", 2024-04-26T10:22:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.319634+0000", 2024-04-26T10:22:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.036e-06 2024-04-26T10:22:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.319642+0000", 2024-04-26T10:22:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.627e-06 2024-04-26T10:22:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.319647+0000", 2024-04-26T10:22:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.711e-06 2024-04-26T10:22:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.320854+0000", 2024-04-26T10:22:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012066690000000001 2024-04-26T10:22:57.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.320934+0000", 2024-04-26T10:22:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0490999999999999e-05 2024-04-26T10:22:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:182519 5.9 5:99d11ab2:::benchmark_data_smithi052_19421_object53047:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:22:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:57.322369+0000", 2024-04-26T10:22:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00091732700000000001, 2024-04-26T10:22:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010143590000000001, 2024-04-26T10:22:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.329 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 182519 2024-04-26T10:22:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322369+0000", 2024-04-26T10:22:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322369+0000", 2024-04-26T10:22:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322367+0000", 2024-04-26T10:22:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322373+0000", 2024-04-26T10:22:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0470000000000001e-06 2024-04-26T10:22:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322382+0000", 2024-04-26T10:22:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4409999999999999e-06 2024-04-26T10:22:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322396+0000", 2024-04-26T10:22:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3553999999999999e-05 2024-04-26T10:22:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322453+0000", 2024-04-26T10:22:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7717999999999999e-05 2024-04-26T10:22:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322720+0000", 2024-04-26T10:22:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026690399999999999 2024-04-26T10:22:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322838+0000", 2024-04-26T10:22:57.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011735000000000001 2024-04-26T10:22:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:182520 5.9 5.f0faac59 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:22:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:57.322410+0000", 2024-04-26T10:22:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00087597399999999996, 2024-04-26T10:22:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010417499999999999, 2024-04-26T10:22:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 182520 2024-04-26T10:22:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322410+0000", 2024-04-26T10:22:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322410+0000", 2024-04-26T10:22:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322410+0000", 2024-04-26T10:22:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322413+0000", 2024-04-26T10:22:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.517e-06 2024-04-26T10:22:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322420+0000", 2024-04-26T10:22:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8369999999999999e-06 2024-04-26T10:22:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322434+0000", 2024-04-26T10:22:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4474999999999999e-05 2024-04-26T10:22:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:182522 5.0 5:02b79969:::benchmark_data_smithi052_19421_object53050:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:22:57.337 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:57.322480+0000", 2024-04-26T10:22:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00080612900000000005, 2024-04-26T10:22:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010249549999999999, 2024-04-26T10:22:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 182522 2024-04-26T10:22:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322480+0000", 2024-04-26T10:22:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322480+0000", 2024-04-26T10:22:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322479+0000", 2024-04-26T10:22:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322487+0000", 2024-04-26T10:22:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3019999999999997e-06 2024-04-26T10:22:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322494+0000", 2024-04-26T10:22:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1389999999999998e-06 2024-04-26T10:22:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322499+0000", 2024-04-26T10:22:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3879999999999999e-06 2024-04-26T10:22:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322556+0000", 2024-04-26T10:22:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6610000000000002e-05 2024-04-26T10:22:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322688+0000", 2024-04-26T10:22:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013233 2024-04-26T10:22:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322794+0000", 2024-04-26T10:22:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010597700000000001 2024-04-26T10:22:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.341 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:182523 5.2 5:461dd330:::benchmark_data_smithi052_19421_object53051:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:22:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:57.322524+0000", 2024-04-26T10:22:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00076223000000000003, 2024-04-26T10:22:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010533319999999999, 2024-04-26T10:22:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 182523 2024-04-26T10:22:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.342 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322524+0000", 2024-04-26T10:22:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322524+0000", 2024-04-26T10:22:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322523+0000", 2024-04-26T10:22:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322526+0000", 2024-04-26T10:22:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5579999999999999e-06 2024-04-26T10:22:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322531+0000", 2024-04-26T10:22:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9930000000000003e-06 2024-04-26T10:22:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322535+0000", 2024-04-26T10:22:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8199999999999998e-06 2024-04-26T10:22:57.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322586+0000", 2024-04-26T10:22:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1607000000000002e-05 2024-04-26T10:22:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322737+0000", 2024-04-26T10:22:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015028400000000001 2024-04-26T10:22:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:182525 5.0 5.cc3c45c0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:22:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:57.322895+0000", 2024-04-26T10:22:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00039105599999999998, 2024-04-26T10:22:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00074213299999999996, 2024-04-26T10:22:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 182525 2024-04-26T10:22:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322895+0000", 2024-04-26T10:22:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322895+0000", 2024-04-26T10:22:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322894+0000", 2024-04-26T10:22:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322899+0000", 2024-04-26T10:22:57.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9960000000000001e-06 2024-04-26T10:22:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322908+0000", 2024-04-26T10:22:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3569999999999998e-06 2024-04-26T10:22:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322912+0000", 2024-04-26T10:22:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7870000000000001e-06 2024-04-26T10:22:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:182521 5.4 e57/37)", 2024-04-26T10:22:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:57.323044+0000", 2024-04-26T10:22:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00024180800000000001, 2024-04-26T10:22:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00064136900000000003, 2024-04-26T10:22:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.323044+0000", 2024-04-26T10:22:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.323044+0000", 2024-04-26T10:22:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.323044+0000", 2024-04-26T10:22:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.323051+0000", 2024-04-26T10:22:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3640000000000001e-06 2024-04-26T10:22:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.323057+0000", 2024-04-26T10:22:57.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6230000000000002e-06 2024-04-26T10:22:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.323060+0000", 2024-04-26T10:22:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4929999999999998e-06 2024-04-26T10:22:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:182509 5.f 5:f63014e8:::benchmark_data_smithi052_19421_object53037:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:22:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:57.315260+0000", 2024-04-26T10:22:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0080263269999999998, 2024-04-26T10:22:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084744699999999996, 2024-04-26T10:22:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.351 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 182509 2024-04-26T10:22:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.315260+0000", 2024-04-26T10:22:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.315260+0000", 2024-04-26T10:22:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.315259+0000", 2024-04-26T10:22:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.315263+0000", 2024-04-26T10:22:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5130000000000001e-06 2024-04-26T10:22:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.315270+0000", 2024-04-26T10:22:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1659999999999997e-06 2024-04-26T10:22:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.315275+0000", 2024-04-26T10:22:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3909999999999997e-06 2024-04-26T10:22:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.316939+0000", 2024-04-26T10:22:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016639739999999999 2024-04-26T10:22:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.317062+0000", 2024-04-26T10:22:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012287499999999999 2024-04-26T10:22:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.317173+0000", 2024-04-26T10:22:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110888 2024-04-26T10:22:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322738+0000", 2024-04-26T10:22:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055649899999999997 2024-04-26T10:22:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.355 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:182510 5.d 5:be1ed5d3:::benchmark_data_smithi052_19421_object53038:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:22:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:57.316686+0000", 2024-04-26T10:22:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0065995910000000001, 2024-04-26T10:22:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007125597, 2024-04-26T10:22:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 182510 2024-04-26T10:22:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.356 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.316686+0000", 2024-04-26T10:22:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.316686+0000", 2024-04-26T10:22:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.316686+0000", 2024-04-26T10:22:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.316690+0000", 2024-04-26T10:22:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1899999999999997e-06 2024-04-26T10:22:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.316696+0000", 2024-04-26T10:22:57.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4620000000000001e-06 2024-04-26T10:22:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.316700+0000", 2024-04-26T10:22:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3159999999999998e-06 2024-04-26T10:22:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.316740+0000", 2024-04-26T10:22:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9465999999999998e-05 2024-04-26T10:22:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.316894+0000", 2024-04-26T10:22:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015413699999999999 2024-04-26T10:22:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.316998+0000", 2024-04-26T10:22:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104194 2024-04-26T10:22:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.322584+0000", 2024-04-26T10:22:57.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055861940000000001 2024-04-26T10:22:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:182512 5.d 5:b510963a:::benchmark_data_smithi052_19421_object53040:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:22:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:57.318952+0000", 2024-04-26T10:22:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0043341380000000004, 2024-04-26T10:22:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049403349999999997, 2024-04-26T10:22:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 182512 2024-04-26T10:22:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.318952+0000", 2024-04-26T10:22:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.318952+0000", 2024-04-26T10:22:57.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.318951+0000", 2024-04-26T10:22:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.318955+0000", 2024-04-26T10:22:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.27e-06 2024-04-26T10:22:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.318960+0000", 2024-04-26T10:22:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4909999999999996e-06 2024-04-26T10:22:57.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.318965+0000", 2024-04-26T10:22:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9679999999999997e-06 2024-04-26T10:22:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.319009+0000", 2024-04-26T10:22:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4016e-05 2024-04-26T10:22:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.319101+0000", 2024-04-26T10:22:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2130000000000001e-05 2024-04-26T10:22:57.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.319174+0000", 2024-04-26T10:22:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2299999999999996e-05 2024-04-26T10:22:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:182513 5.f 5:f0365657:::benchmark_data_smithi052_19421_object53041:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:22:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:57.319231+0000", 2024-04-26T10:22:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0040549490000000004, 2024-04-26T10:22:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047315940000000004, 2024-04-26T10:22:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.365 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 182513 2024-04-26T10:22:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.319231+0000", 2024-04-26T10:22:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.319231+0000", 2024-04-26T10:22:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.319230+0000", 2024-04-26T10:22:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.319234+0000", 2024-04-26T10:22:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2849999999999996e-06 2024-04-26T10:22:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.319244+0000", 2024-04-26T10:22:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7010000000000008e-06 2024-04-26T10:22:57.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.319250+0000", 2024-04-26T10:22:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2949999999999999e-06 2024-04-26T10:22:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.319280+0000", 2024-04-26T10:22:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9575999999999999e-05 2024-04-26T10:22:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.319351+0000", 2024-04-26T10:22:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1396999999999994e-05 2024-04-26T10:22:57.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.320793+0000", 2024-04-26T10:22:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0014416030000000001 2024-04-26T10:22:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:57.323831+0000", 2024-04-26T10:22:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003037653 2024-04-26T10:22:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:57.369 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 11 2024-04-26T10:22:57.370 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:57.371 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:57.371 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:57.368+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:57.472 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:57.467+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:57.505 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:57.505 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:57.505 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:57.505 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:57.505 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:57.517 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:57.572 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:57.567+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:57.651 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:57.652 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:57.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:57.652 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:57.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.652 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:57.652 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:57.652 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.610094599999996, 2024-04-26T10:22:57.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:22:57.652 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.652 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.652 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.652 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.652 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.653 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:22:57.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.653 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:57.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:57.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:57.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:22:57.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:22:57.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:22:57.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:22:57.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:22:57.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:22:57.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:22:57.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:22:57.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:22:57.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:22:57.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:22:57.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:22:57.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:22:57.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:22:57.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:22:57.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:22:57.656 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.656 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.656 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.657 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:57.657 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:57.657 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.609985348999999, 2024-04-26T10:22:57.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:22:57.657 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.657 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.657 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:22:57.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.657 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:57.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:57.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:57.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:22:57.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:22:57.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:22:57.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:22:57.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:22:57.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:22:57.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:22:57.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:22:57.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:22:57.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:22:57.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:22:57.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:22:57.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:22:57.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:22:57.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:22:57.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:22:57.661 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.661 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.661 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.662 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:57.662 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:57.662 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.607587936999998, 2024-04-26T10:22:57.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:22:57.662 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.662 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.662 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.662 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.662 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.662 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:22:57.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.663 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:57.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:57.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:22:57.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:57.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:22:57.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:22:57.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:22:57.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:22:57.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:22:57.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:22:57.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:22:57.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:22:57.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:22:57.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:22:57.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:22:57.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:22:57.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:22:57.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:22:57.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:57.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:22:57.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:22:57.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:22:57.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:22:57.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:22:57.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:22:57.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.667 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.668 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.668 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:57.668 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:57.668 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 33.607402012999998, 2024-04-26T10:22:57.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:22:57.668 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.668 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.668 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:22:57.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.669 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:57.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:57.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:22:57.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:22:57.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:22:57.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:22:57.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:22:57.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:22:57.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:22:57.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:22:57.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:22:57.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:22:57.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:22:57.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:22:57.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:22:57.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:22:57.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:22:57.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:22:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:22:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:22:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:22:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:22:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:22:57.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.5173793969999991, 2024-04-26T10:22:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:22:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.674 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:22:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:57.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:22:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:22:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:22:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:22:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:22:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:22:57.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:22:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:22:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:22:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:22:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:22:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:22:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:22:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:22:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:22:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:22:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:22:57.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:22:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:22:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:22:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:22:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:22:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:22:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:22:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:22:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4942771510000004, 2024-04-26T10:22:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:22:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.680 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:22:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:22:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:22:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:22:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:22:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:22:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:22:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:22:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:22:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:22:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:22:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:22:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:22:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:22:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:22:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:22:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:22:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:22:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:22:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:22:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:22:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:22:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:22:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:22:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:22:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:22:57.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:22:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:22:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:57.686 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:22:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4875940130000007, 2024-04-26T10:22:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:22:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:22:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:22:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:22:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:22:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:22:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:22:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:22:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:22:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:22:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:22:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:22:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:22:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:22:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:22:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:22:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:22:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:22:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:22:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:22:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:22:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:22:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:22:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:22:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:22:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:22:57.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:22:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:22:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:22:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:22:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4855962280000004, 2024-04-26T10:22:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:22:57.693 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:22:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:22:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:22:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:22:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:22:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:22:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:22:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:22:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:22:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:22:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:22:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:22:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:22:57.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:22:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:22:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:22:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:22:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:22:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:22:57.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:22:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:22:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:22:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:22:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:22:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:22:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:22:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:22:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:22:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:57.699 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:22:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4761875230000001, 2024-04-26T10:22:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:22:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:22:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:22:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:22:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:22:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:22:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:22:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:22:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:22:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:22:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:22:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:22:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:22:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:22:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:22:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:22:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:22:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:22:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:22:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:22:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:22:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:22:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:22:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:22:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:22:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:22:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:22:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:22:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:22:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.705 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:22:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4743594739999999, 2024-04-26T10:22:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:22:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:22:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:22:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:22:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:22:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:22:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:22:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:22:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:22:57.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:22:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:22:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:22:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:22:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:22:57.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:22:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:22:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:22:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:22:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:22:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:22:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:22:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:22:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:22:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:22:57.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:22:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:22:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:22:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:22:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:22:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4627797519999994, 2024-04-26T10:22:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:22:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:22:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:22:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:22:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:22:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:22:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:22:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:22:57.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:22:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:22:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:22:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:22:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:22:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:22:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:22:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:22:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:22:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:22:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:22:57.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:22:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:22:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:22:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:22:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:22:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:22:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:22:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:22:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4563692580000005, 2024-04-26T10:22:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:22:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.719 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:22:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:22:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:22:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:22:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:22:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:22:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:22:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:22:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:22:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:22:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:22:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:22:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:22:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:22:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:22:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:22:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:22:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:22:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:22:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:22:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:22:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:22:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:22:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:22:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:22:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:22:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:22:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:22:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:22:57.725 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4437841949999992, 2024-04-26T10:22:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:22:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:22:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:22:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:22:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:22:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:22:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:22:57.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:22:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:22:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:22:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:22:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:22:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:22:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:22:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:22:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:22:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:22:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:22:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:22:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:22:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:22:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:22:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:22:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:22:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:22:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:22:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:22:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:22:57.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:22:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:22:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4435492619999994, 2024-04-26T10:22:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:22:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.732 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:22:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:22:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:22:57.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:22:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:22:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:22:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:22:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:22:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:22:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:22:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:22:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:22:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:22:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:22:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:22:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:22:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:22:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:22:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:22:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:22:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:22:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:22:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:22:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:22:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:22:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:22:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:22:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:22:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.738 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:22:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4056743849999993, 2024-04-26T10:22:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:22:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:22:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:22:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:22:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:22:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:22:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:22:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:22:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:22:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:22:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:22:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:22:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:22:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:22:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:22:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:22:57.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:22:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:22:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:22:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:22:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:22:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:22:57.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:22:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:22:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:22:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:22:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:22:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:22:57.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:22:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:22:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.4052293599999999, 2024-04-26T10:22:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:22:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.745 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:22:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:22:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:22:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:22:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:22:57.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:22:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:22:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:22:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:22:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:22:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:22:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:22:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:22:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:22:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:22:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:22:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:22:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:22:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:22:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:22:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:22:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:22:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:22:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:22:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:22:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:22:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:22:57.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:22:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:22:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.3936263600000007, 2024-04-26T10:22:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:22:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.752 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:22:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:22:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:22:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:22:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:22:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:22:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:22:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:22:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:22:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:22:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:22:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:22:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:22:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:22:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:22:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:22:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:22:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:22:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:22:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:22:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:22:57.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:22:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:22:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:22:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:22:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:22:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:22:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:22:57.757 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:22:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.3923527700000005, 2024-04-26T10:22:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:22:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.758 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:22:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:22:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:22:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:22:57.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:22:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:22:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:22:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:22:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:22:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:22:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:22:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:22:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:22:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:22:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:22:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:22:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:22:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:22:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:22:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:22:57.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:22:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:22:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:22:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:22:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:22:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:22:57.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:22:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:22:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:22:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.3755954690000003, 2024-04-26T10:22:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:22:57.764 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:22:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:22:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:22:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:22:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:22:57.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:22:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:22:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:22:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:22:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:22:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:22:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:22:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:22:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:22:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:22:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:22:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:22:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:22:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:22:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:22:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:22:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:22:57.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:22:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:22:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:22:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:22:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:22:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:22:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:22:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 8.3306834480000003, 2024-04-26T10:22:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:22:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:57.771 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:22:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:22:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:22:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:22:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:22:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:22:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:22:57.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:22:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:22:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:22:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:22:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:22:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:22:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:22:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:22:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:22:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:22:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:22:57.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:22:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:22:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:22:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:22:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:22:57.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:22:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:22:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:22:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:22:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:22:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:57.777 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:57.777 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:57.779 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:57.780 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:57.778+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:57.879 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:57.878+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:57.908 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:57.908 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:57.908 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.908 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:183842 5.b 5:d71423e5:::benchmark_data_smithi052_19421_object54370:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:22:57.908 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:57.898460+0000", 2024-04-26T10:22:57.908 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0092539860000000005, 2024-04-26T10:22:57.908 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0092787100000000008, 2024-04-26T10:22:57.908 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:57.908 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:57.908 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:57.909 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:57.909 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.909 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183842 2024-04-26T10:22:57.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.909 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:57.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:57.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.898460+0000", 2024-04-26T10:22:57.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.909 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.909 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.909 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:57.909 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.898460+0000", 2024-04-26T10:22:57.909 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:57.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.898459+0000", 2024-04-26T10:22:57.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:57.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.910 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.910 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:57.910 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.898465+0000", 2024-04-26T10:22:57.910 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9270000000000002e-06 2024-04-26T10:22:57.910 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:57.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.898475+0000", 2024-04-26T10:22:57.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0414000000000001e-05 2024-04-26T10:22:57.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.911 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.898484+0000", 2024-04-26T10:22:57.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6600000000000001e-06 2024-04-26T10:22:57.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.911 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:57.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.901806+0000", 2024-04-26T10:22:57.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033220480000000002 2024-04-26T10:22:57.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:57.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.901886+0000", 2024-04-26T10:22:57.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0153000000000003e-05 2024-04-26T10:22:57.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:57.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.901951+0000", 2024-04-26T10:22:57.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5167999999999997e-05 2024-04-26T10:22:57.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:57.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.906684+0000", 2024-04-26T10:22:57.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047325910000000004 2024-04-26T10:22:57.913 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.913 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:57.913 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.913 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:183850 5.f e57/37 5:f9f3b7fd:::benchmark_data_smithi052_19421_object54378:head v 57'11584, mlcod=57'11581)", 2024-04-26T10:22:57.913 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:57.903143+0000", 2024-04-26T10:22:57.913 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0045705640000000001, 2024-04-26T10:22:57.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046857749999999997, 2024-04-26T10:22:57.913 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:57.913 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:57.913 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:57.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:57.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903143+0000", 2024-04-26T10:22:57.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:57.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903143+0000", 2024-04-26T10:22:57.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:57.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903143+0000", 2024-04-26T10:22:57.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:57.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903147+0000", 2024-04-26T10:22:57.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4000000000000002e-06 2024-04-26T10:22:57.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:57.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903155+0000", 2024-04-26T10:22:57.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5070000000000003e-06 2024-04-26T10:22:57.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903158+0000", 2024-04-26T10:22:57.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.551e-06 2024-04-26T10:22:57.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:57.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903200+0000", 2024-04-26T10:22:57.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2014000000000001e-05 2024-04-26T10:22:57.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.916 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:57.916 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903219+0000", 2024-04-26T10:22:57.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8879999999999999e-05 2024-04-26T10:22:57.916 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.916 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:57.916 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.916 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:183852 5.b 5:d285c1c4:::benchmark_data_smithi052_19421_object54380:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:22:57.916 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:57.903196+0000", 2024-04-26T10:22:57.917 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0045174330000000004, 2024-04-26T10:22:57.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046931990000000003, 2024-04-26T10:22:57.917 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:57.917 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:57.917 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:57.917 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:57.917 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.917 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183852 2024-04-26T10:22:57.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.917 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:57.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:57.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903196+0000", 2024-04-26T10:22:57.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:57.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903196+0000", 2024-04-26T10:22:57.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:57.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903195+0000", 2024-04-26T10:22:57.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:57.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:57.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903200+0000", 2024-04-26T10:22:57.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.383e-06 2024-04-26T10:22:57.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:57.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903207+0000", 2024-04-26T10:22:57.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.041e-06 2024-04-26T10:22:57.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903212+0000", 2024-04-26T10:22:57.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4100000000000001e-06 2024-04-26T10:22:57.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:57.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903247+0000", 2024-04-26T10:22:57.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5633000000000003e-05 2024-04-26T10:22:57.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:57.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903322+0000", 2024-04-26T10:22:57.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4756000000000001e-05 2024-04-26T10:22:57.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:57.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903395+0000", 2024-04-26T10:22:57.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2997999999999995e-05 2024-04-26T10:22:57.920 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.920 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:57.921 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.921 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:183853 5.b 5:d148b06f:::benchmark_data_smithi052_19421_object54381:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:22:57.921 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:57.903324+0000", 2024-04-26T10:22:57.921 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0043892719999999996, 2024-04-26T10:22:57.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046392639999999997, 2024-04-26T10:22:57.921 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:57.921 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:57.921 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:57.921 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:57.921 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.921 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183853 2024-04-26T10:22:57.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.922 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:57.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:57.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903324+0000", 2024-04-26T10:22:57.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:57.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903324+0000", 2024-04-26T10:22:57.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:57.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903324+0000", 2024-04-26T10:22:57.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:57.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903327+0000", 2024-04-26T10:22:57.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1310000000000002e-06 2024-04-26T10:22:57.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:57.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903332+0000", 2024-04-26T10:22:57.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.361e-06 2024-04-26T10:22:57.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.903336+0000", 2024-04-26T10:22:57.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7139999999999999e-06 2024-04-26T10:22:57.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:57.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.904463+0000", 2024-04-26T10:22:57.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001127198 2024-04-26T10:22:57.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:57.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.904543+0000", 2024-04-26T10:22:57.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9653999999999993e-05 2024-04-26T10:22:57.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:57.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.904606+0000", 2024-04-26T10:22:57.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3508000000000002e-05 2024-04-26T10:22:57.925 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.925 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:57.925 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.925 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:183851 5.9 e57/37 5:990617ed:::benchmark_data_smithi052_19421_object54379:head v 57'11557, mlcod=57'11554)", 2024-04-26T10:22:57.925 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:57.904797+0000", 2024-04-26T10:22:57.925 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.002916269, 2024-04-26T10:22:57.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0032447370000000001, 2024-04-26T10:22:57.925 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:57.925 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:57.925 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:57.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:57.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.904797+0000", 2024-04-26T10:22:57.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:57.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.904797+0000", 2024-04-26T10:22:57.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:57.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.904797+0000", 2024-04-26T10:22:57.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:57.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.904800+0000", 2024-04-26T10:22:57.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.072e-06 2024-04-26T10:22:57.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:57.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.904809+0000", 2024-04-26T10:22:57.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7269999999999996e-06 2024-04-26T10:22:57.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.904812+0000", 2024-04-26T10:22:57.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6520000000000002e-06 2024-04-26T10:22:57.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:57.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.904846+0000", 2024-04-26T10:22:57.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4873000000000003e-05 2024-04-26T10:22:57.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:57.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.904860+0000", 2024-04-26T10:22:57.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3382e-05 2024-04-26T10:22:57.928 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.928 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:57.928 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.928 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:183857 5.a 5:513d223d:::benchmark_data_smithi052_19421_object54385:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:22:57.928 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:57.905182+0000", 2024-04-26T10:22:57.929 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.002532028, 2024-04-26T10:22:57.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029222749999999998, 2024-04-26T10:22:57.929 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:57.929 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:57.929 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:57.929 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:57.929 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.929 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183857 2024-04-26T10:22:57.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.929 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:57.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:57.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905182+0000", 2024-04-26T10:22:57.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:57.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905182+0000", 2024-04-26T10:22:57.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:57.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905181+0000", 2024-04-26T10:22:57.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:57.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:57.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905185+0000", 2024-04-26T10:22:57.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2939999999999999e-06 2024-04-26T10:22:57.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:57.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905194+0000", 2024-04-26T10:22:57.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:22:57.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905200+0000", 2024-04-26T10:22:57.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8089999999999998e-06 2024-04-26T10:22:57.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:57.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905247+0000", 2024-04-26T10:22:57.931 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7005999999999997e-05 2024-04-26T10:22:57.931 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.932 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:57.932 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905390+0000", 2024-04-26T10:22:57.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000142373 2024-04-26T10:22:57.932 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.932 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:57.932 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.932 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.932 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.932 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:183855 5.f e57/37 5:f2003fce:::benchmark_data_smithi052_19421_object54383:head v 57'11585, mlcod=57'11581)", 2024-04-26T10:22:57.932 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:57.905552+0000", 2024-04-26T10:22:57.932 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0021618969999999999, 2024-04-26T10:22:57.932 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0026052969999999999, 2024-04-26T10:22:57.932 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:57.932 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:57.932 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:57.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:57.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905552+0000", 2024-04-26T10:22:57.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:57.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905552+0000", 2024-04-26T10:22:57.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.933 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:57.933 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905551+0000", 2024-04-26T10:22:57.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:57.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905555+0000", 2024-04-26T10:22:57.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0990000000000001e-06 2024-04-26T10:22:57.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:57.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905563+0000", 2024-04-26T10:22:57.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4800000000000004e-06 2024-04-26T10:22:57.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905568+0000", 2024-04-26T10:22:57.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2460000000000003e-06 2024-04-26T10:22:57.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:57.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905604+0000", 2024-04-26T10:22:57.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5911999999999998e-05 2024-04-26T10:22:57.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:57.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905622+0000", 2024-04-26T10:22:57.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8315e-05 2024-04-26T10:22:57.936 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.936 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:57.936 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.936 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:183858 5.0 e57/54 5:0b59fa06:::benchmark_data_smithi052_19421_object54386:head v 57'11441, mlcod=57'11439)", 2024-04-26T10:22:57.936 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:57.905584+0000", 2024-04-26T10:22:57.936 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0021292899999999998, 2024-04-26T10:22:57.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002606297, 2024-04-26T10:22:57.936 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:57.936 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:57.936 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:57.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:57.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905584+0000", 2024-04-26T10:22:57.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:57.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905584+0000", 2024-04-26T10:22:57.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:57.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905584+0000", 2024-04-26T10:22:57.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:57.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905588+0000", 2024-04-26T10:22:57.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8979999999999998e-06 2024-04-26T10:22:57.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:57.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905596+0000", 2024-04-26T10:22:57.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9899999999999997e-06 2024-04-26T10:22:57.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905600+0000", 2024-04-26T10:22:57.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0609999999999997e-06 2024-04-26T10:22:57.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:57.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905639+0000", 2024-04-26T10:22:57.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8491000000000001e-05 2024-04-26T10:22:57.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:57.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.905651+0000", 2024-04-26T10:22:57.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2424e-05 2024-04-26T10:22:57.939 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.940 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:57.940 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.940 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:183859 5.4 5:29436358:::benchmark_data_smithi052_19421_object54387:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:22:57.940 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:57.906963+0000", 2024-04-26T10:22:57.940 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.000750474, 2024-04-26T10:22:57.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001258152, 2024-04-26T10:22:57.940 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:57.940 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:57.940 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:57.940 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:57.940 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.940 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183859 2024-04-26T10:22:57.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.941 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:57.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:57.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.906963+0000", 2024-04-26T10:22:57.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:57.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.906963+0000", 2024-04-26T10:22:57.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:57.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.906962+0000", 2024-04-26T10:22:57.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:57.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:57.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.906967+0000", 2024-04-26T10:22:57.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5179999999999998e-06 2024-04-26T10:22:57.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:57.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.906977+0000", 2024-04-26T10:22:57.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0193e-05 2024-04-26T10:22:57.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.906982+0000", 2024-04-26T10:22:57.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3319999999999999e-06 2024-04-26T10:22:57.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:57.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.907014+0000", 2024-04-26T10:22:57.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1390999999999998e-05 2024-04-26T10:22:57.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:57.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.907094+0000", 2024-04-26T10:22:57.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0201e-05 2024-04-26T10:22:57.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:57.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.907159+0000", 2024-04-26T10:22:57.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4992000000000004e-05 2024-04-26T10:22:57.944 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.944 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:57.944 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.944 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:183861 5.8 5:1a50655d:::benchmark_data_smithi052_19421_object54389:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:22:57.944 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:57.907874+0000", 2024-04-26T10:22:57.944 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9998398, 2024-04-26T10:22:57.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00038779299999999999, 2024-04-26T10:22:57.945 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:57.945 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:57.945 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:57.945 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:57.945 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.945 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183861 2024-04-26T10:22:57.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.945 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:57.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:57.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.907874+0000", 2024-04-26T10:22:57.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:57.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.907874+0000", 2024-04-26T10:22:57.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:57.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.907873+0000", 2024-04-26T10:22:57.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:57.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.907877+0000", 2024-04-26T10:22:57.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6459999999999999e-06 2024-04-26T10:22:57.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:57.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.907903+0000", 2024-04-26T10:22:57.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6427e-05 2024-04-26T10:22:57.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.907910+0000", 2024-04-26T10:22:57.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1129999999999997e-06 2024-04-26T10:22:57.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:57.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.907962+0000", 2024-04-26T10:22:57.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2017e-05 2024-04-26T10:22:57.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:57.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.908140+0000", 2024-04-26T10:22:57.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017808799999999999 2024-04-26T10:22:57.948 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.948 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:57.948 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.948 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.948 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:183862 5.a 5:507abced:::benchmark_data_smithi052_19421_object54390:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-26T10:22:57.948 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:57.907922+0000", 2024-04-26T10:22:57.948 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9997916, 2024-04-26T10:22:57.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037586599999999998, 2024-04-26T10:22:57.948 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:57.948 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:57.949 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:57.949 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:57.949 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:57.949 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 183862 2024-04-26T10:22:57.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.949 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:57.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:57.949 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.907922+0000", 2024-04-26T10:22:57.949 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.949 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.949 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.949 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:57.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.907922+0000", 2024-04-26T10:22:57.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:57.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:57.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.907921+0000", 2024-04-26T10:22:57.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:57.950 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.950 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.950 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:57.950 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.907925+0000", 2024-04-26T10:22:57.950 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4340000000000001e-06 2024-04-26T10:22:57.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:57.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.907933+0000", 2024-04-26T10:22:57.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9619999999999993e-06 2024-04-26T10:22:57.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:57.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.907940+0000", 2024-04-26T10:22:57.951 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.238e-06 2024-04-26T10:22:57.951 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.951 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.951 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:57.951 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.908155+0000", 2024-04-26T10:22:57.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00021537300000000001 2024-04-26T10:22:57.952 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:57.952 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:57.952 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:57.952 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:57.908277+0000", 2024-04-26T10:22:57.952 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000121455 2024-04-26T10:22:57.952 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.952 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:57.952 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.952 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:57.952 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:57.952 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 11 2024-04-26T10:22:57.952 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:57.953 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:57.980 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:57.975+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:58.077 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:58.077 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:58.077 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:58.077 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:58.077 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:58.081 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:58.075+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:58.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:58.177 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T10:22:58.182 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:58.178+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:58.220 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:58.220 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:58.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:58.220 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:58.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.220 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:58.220 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:58.220 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 57.687320409999998, 2024-04-26T10:22:58.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:58.221 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.221 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.221 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:58.221 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:58.221 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.221 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:58.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.221 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:58.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:58.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:58.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:58.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:58.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:58.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:58.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:58.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:58.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:58.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:58.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:58.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:58.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:58.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:58.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:58.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:58.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:58.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:58.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:58.225 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.225 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.225 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.225 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:58.225 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:58.225 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 57.685338182999999, 2024-04-26T10:22:58.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:58.225 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.225 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.226 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:58.226 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:58.226 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.226 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:58.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.226 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:58.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:58.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:58.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:58.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:58.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:58.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:58.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:58.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:58.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:58.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:58.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:58.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:58.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:58.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:58.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:58.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:58.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:58.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:58.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:58.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:58.230 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.230 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.230 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.230 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:58.231 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:58.231 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 57.685138799000001, 2024-04-26T10:22:58.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:58.231 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.231 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.231 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:58.231 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:58.231 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.231 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:58.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.231 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:58.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:58.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:58.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:58.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:58.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:58.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:58.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:58.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:58.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:58.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:58.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:58.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:58.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:58.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:58.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:58.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:58.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:58.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:58.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:58.235 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.235 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.235 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.236 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:58.236 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:58.236 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 57.684920179000002, 2024-04-26T10:22:58.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:58.236 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.236 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.236 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:58.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:58.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:58.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:58.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:58.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:58.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:58.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:58.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:58.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:58.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:58.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:58.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:58.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:58.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:58.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:58.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:58.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:58.240 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.240 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.240 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.240 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:58.240 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:58.240 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 57.682548740999998, 2024-04-26T10:22:58.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:58.241 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.241 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.241 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:58.241 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:58.241 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.241 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:58.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.241 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:58.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:58.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:58.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:58.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:58.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:58.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:58.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:58.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:58.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:58.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:58.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:58.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:58.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:58.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:58.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:58.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:58.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:58.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:58.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:58.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:58.245 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.245 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.245 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.245 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:58.245 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:58.246 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 57.682448119, 2024-04-26T10:22:58.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:58.246 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.246 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.246 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:58.246 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:58.246 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.246 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:58.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.246 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:58.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:58.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:58.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:58.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:58.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:58.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:58.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:58.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:58.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:58.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:58.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:58.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:58.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:58.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:58.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:58.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:58.250 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 57.682329557999999, 2024-04-26T10:22:58.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:58.251 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.251 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.251 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:58.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:58.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:58.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:58.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:58.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:58.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:58.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:58.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:58.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:58.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:58.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:58.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:58.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:58.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:58.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:58.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:58.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:58.254 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.254 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.254 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.255 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:58.255 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:58.255 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 57.682227159999997, 2024-04-26T10:22:58.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:58.255 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.255 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.255 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:58.255 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:58.255 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.255 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:58.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.255 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:58.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:58.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:58.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:58.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:58.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:58.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:58.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:58.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:58.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:58.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:58.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:58.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.258 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:58.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:58.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:58.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:58.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:58.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:58.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:58.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:58.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:58.259 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.259 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.260 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.260 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:58.260 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:58.260 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 57.681206603, 2024-04-26T10:22:58.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:58.260 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.260 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.260 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:58.260 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:58.260 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.260 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:58.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.261 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:58.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:58.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:58.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:58.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:58.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:58.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:58.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:58.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:58.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:58.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:58.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:58.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.263 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:58.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:58.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.263 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:58.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:58.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:58.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:58.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:58.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:58.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:58.264 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.265 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.265 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.265 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:58.265 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:58.265 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 57.680056327999999, 2024-04-26T10:22:58.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:58.265 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.265 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.265 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:58.265 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:58.265 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.266 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:58.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.266 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:58.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:58.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:58.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:58.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:58.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:58.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:58.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:58.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:58.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:58.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:58.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:58.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:58.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:58.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:58.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:58.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:58.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:58.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:58.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:58.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:58.270 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.270 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.270 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.270 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:58.270 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:58.270 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.183357086000001, 2024-04-26T10:22:58.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:22:58.270 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.270 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.270 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:58.271 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:58.271 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.271 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:22:58.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.271 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:58.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:58.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:22:58.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:58.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:22:58.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:22:58.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:22:58.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:22:58.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:22:58.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:22:58.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:22:58.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:22:58.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:22:58.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:22:58.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:58.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:22:58.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:22:58.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:58.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:22:58.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:22:58.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:22:58.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:22:58.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:22:58.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:22:58.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:22:58.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:22:58.275 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.275 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.275 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.276 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:58.276 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:58.276 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 34.183133490000003, 2024-04-26T10:22:58.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:22:58.276 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.276 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.276 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:58.276 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:58.276 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.276 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:22:58.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.276 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:58.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:58.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:22:58.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:22:58.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:22:58.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:22:58.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:22:58.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:22:58.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:22:58.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:22:58.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:22:58.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:22:58.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:22:58.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:58.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:22:58.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:22:58.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:58.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:22:58.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:22:58.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:22:58.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:22:58.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:22:58.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:22:58.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:22:58.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:22:58.281 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.281 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.281 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.281 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:58.281 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:58.281 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.152287170000001, 2024-04-26T10:22:58.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:22:58.282 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.282 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.282 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:58.282 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:58.282 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.282 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:22:58.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.282 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:58.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:58.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:22:58.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:58.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:22:58.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:22:58.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:22:58.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:22:58.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:22:58.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:22:58.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:22:58.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:22:58.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:22:58.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:22:58.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:58.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:22:58.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:22:58.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:22:58.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:22:58.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:58.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:22:58.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:22:58.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:22:58.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:22:58.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:22:58.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:22:58.286 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.286 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.286 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.287 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:58.287 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:58.287 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.150276067, 2024-04-26T10:22:58.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:22:58.287 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.287 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.287 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:58.287 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:58.287 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.287 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:22:58.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.287 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:58.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:58.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:58.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:22:58.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:22:58.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:22:58.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:22:58.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:22:58.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:22:58.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:22:58.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:22:58.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:22:58.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:22:58.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:58.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:22:58.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:22:58.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:22:58.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:22:58.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:58.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:22:58.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:22:58.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:22:58.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:22:58.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:22:58.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:22:58.292 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.292 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.293 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.293 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:58.293 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:58.293 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.139397962, 2024-04-26T10:22:58.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:22:58.293 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.293 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.293 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:58.293 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:58.293 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.294 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:22:58.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.294 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:58.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:58.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:22:58.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:58.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:22:58.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:22:58.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:22:58.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:22:58.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:22:58.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:22:58.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:22:58.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:22:58.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:22:58.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:22:58.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:58.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:22:58.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:22:58.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:22:58.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:22:58.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:58.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:22:58.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:22:58.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:22:58.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:22:58.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:22:58.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:22:58.298 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.298 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.299 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.299 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:58.299 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:58.299 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.136716743000001, 2024-04-26T10:22:58.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:22:58.299 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.299 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.299 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:58.299 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:58.299 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.299 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:22:58.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.299 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:58.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:58.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:22:58.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:58.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:22:58.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:22:58.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:22:58.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:22:58.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:22:58.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:22:58.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:22:58.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:22:58.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:22:58.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:22:58.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:58.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:22:58.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:22:58.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:22:58.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:22:58.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:58.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:22:58.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:22:58.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:22:58.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:22:58.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:22:58.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:22:58.304 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.304 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.304 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.304 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:58.304 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:58.305 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.136349668000001, 2024-04-26T10:22:58.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:22:58.305 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.305 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.305 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:58.305 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:58.305 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.305 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:22:58.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.305 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:58.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:58.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:22:58.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:58.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:22:58.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:22:58.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:22:58.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:22:58.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:22:58.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:22:58.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:22:58.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:22:58.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:22:58.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:22:58.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:58.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:22:58.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:22:58.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:22:58.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:22:58.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:22:58.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:22:58.309 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.309 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.309 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.309 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:58.309 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:58.309 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.136285416, 2024-04-26T10:22:58.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:22:58.309 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.309 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:58.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:58.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.310 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:22:58.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.310 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:58.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:58.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:22:58.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:22:58.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:22:58.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:22:58.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:22:58.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:22:58.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:22:58.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:22:58.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:22:58.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:22:58.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:22:58.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:58.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:22:58.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:22:58.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:22:58.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:22:58.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:22:58.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:22:58.314 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.314 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.314 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.314 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:58.314 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:58.314 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.131886742999999, 2024-04-26T10:22:58.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:22:58.314 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.314 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.314 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:58.314 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:58.315 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.315 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:22:58.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.315 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:58.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:58.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:22:58.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:22:58.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:22:58.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:22:58.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:22:58.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:22:58.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:22:58.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:22:58.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:22:58.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:22:58.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:22:58.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:58.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:22:58.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:22:58.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:22:58.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:22:58.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:22:58.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:22:58.319 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.319 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.319 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.319 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:58.319 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:58.319 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 27.130128760000002, 2024-04-26T10:22:58.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:22:58.319 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:58.320 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.320 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:58.320 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:58.320 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.320 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:22:58.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.320 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:58.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:58.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:58.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:58.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:58.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:58.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:58.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:22:58.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:58.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:58.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:22:58.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:22:58.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:58.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:22:58.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:22:58.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:22:58.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:22:58.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:58.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:22:58.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:22:58.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:58.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:22:58.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:22:58.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:58.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:22:58.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:22:58.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:22:58.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:22:58.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:58.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:22:58.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:22:58.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:58.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:22:58.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:22:58.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:58.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:58.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:58.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:22:58.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:22:58.324 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.324 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.324 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.324 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:58.325 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:58.325 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:58.326 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:58.327 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:58.319+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:58.426 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:58.422+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:58.465 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:58.466 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:58.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.466 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:185151 5.f 5:f5cfd538:::benchmark_data_smithi052_19421_object55679:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:22:58.466 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:58.457928+0000", 2024-04-26T10:22:58.466 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0056848879999999999, 2024-04-26T10:22:58.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057075809999999998, 2024-04-26T10:22:58.466 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.466 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:58.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.466 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185151 2024-04-26T10:22:58.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.467 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.457928+0000", 2024-04-26T10:22:58.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.457928+0000", 2024-04-26T10:22:58.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.457927+0000", 2024-04-26T10:22:58.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.457931+0000", 2024-04-26T10:22:58.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5279999999999999e-06 2024-04-26T10:22:58.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.457938+0000", 2024-04-26T10:22:58.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7780000000000002e-06 2024-04-26T10:22:58.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.457943+0000", 2024-04-26T10:22:58.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3170000000000001e-06 2024-04-26T10:22:58.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.457982+0000", 2024-04-26T10:22:58.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9237999999999999e-05 2024-04-26T10:22:58.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.458077+0000", 2024-04-26T10:22:58.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4844000000000002e-05 2024-04-26T10:22:58.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.458168+0000", 2024-04-26T10:22:58.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0383000000000005e-05 2024-04-26T10:22:58.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462815+0000", 2024-04-26T10:22:58.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046473160000000003 2024-04-26T10:22:58.470 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.470 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.470 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.471 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:185156 5.3 5:c28de7a0:::benchmark_data_smithi052_19421_object55684:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:22:58.471 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:58.460121+0000", 2024-04-26T10:22:58.471 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0034915599999999999, 2024-04-26T10:22:58.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035912129999999998, 2024-04-26T10:22:58.471 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.471 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:58.471 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.471 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.471 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.471 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185156 2024-04-26T10:22:58.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.471 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460121+0000", 2024-04-26T10:22:58.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460121+0000", 2024-04-26T10:22:58.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460121+0000", 2024-04-26T10:22:58.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460125+0000", 2024-04-26T10:22:58.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8650000000000003e-06 2024-04-26T10:22:58.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460131+0000", 2024-04-26T10:22:58.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7299999999999999e-06 2024-04-26T10:22:58.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460135+0000", 2024-04-26T10:22:58.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.732e-06 2024-04-26T10:22:58.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.461395+0000", 2024-04-26T10:22:58.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0012595130000000001 2024-04-26T10:22:58.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.461492+0000", 2024-04-26T10:22:58.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7942999999999994e-05 2024-04-26T10:22:58.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.474 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.475 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:185158 5.d 5:b7d4e5fb:::benchmark_data_smithi052_19421_object55686:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:22:58.475 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:58.460220+0000", 2024-04-26T10:22:58.475 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0033925190000000001, 2024-04-26T10:22:58.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035512719999999998, 2024-04-26T10:22:58.475 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.475 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:58.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.475 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185158 2024-04-26T10:22:58.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.475 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460220+0000", 2024-04-26T10:22:58.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460220+0000", 2024-04-26T10:22:58.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460220+0000", 2024-04-26T10:22:58.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460223+0000", 2024-04-26T10:22:58.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.971e-06 2024-04-26T10:22:58.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460229+0000", 2024-04-26T10:22:58.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3110000000000002e-06 2024-04-26T10:22:58.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460234+0000", 2024-04-26T10:22:58.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8779999999999997e-06 2024-04-26T10:22:58.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460270+0000", 2024-04-26T10:22:58.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6125999999999999e-05 2024-04-26T10:22:58.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460388+0000", 2024-04-26T10:22:58.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118236 2024-04-26T10:22:58.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460485+0000", 2024-04-26T10:22:58.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6537000000000001e-05 2024-04-26T10:22:58.479 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.479 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.479 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.479 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:185159 5.9 5:96d02b8d:::benchmark_data_smithi052_19421_object55687:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:22:58.479 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:58.460246+0000", 2024-04-26T10:22:58.480 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0033667950000000001, 2024-04-26T10:22:58.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035885999999999999, 2024-04-26T10:22:58.480 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.480 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:58.480 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.480 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.480 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.480 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185159 2024-04-26T10:22:58.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.480 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460246+0000", 2024-04-26T10:22:58.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460246+0000", 2024-04-26T10:22:58.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460246+0000", 2024-04-26T10:22:58.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460248+0000", 2024-04-26T10:22:58.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.537e-06 2024-04-26T10:22:58.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460254+0000", 2024-04-26T10:22:58.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1380000000000004e-06 2024-04-26T10:22:58.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460259+0000", 2024-04-26T10:22:58.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0100000000000003e-06 2024-04-26T10:22:58.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460344+0000", 2024-04-26T10:22:58.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4986000000000003e-05 2024-04-26T10:22:58.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460464+0000", 2024-04-26T10:22:58.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119227 2024-04-26T10:22:58.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460572+0000", 2024-04-26T10:22:58.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010804 2024-04-26T10:22:58.484 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.484 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.484 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.484 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:185160 5.0 5:0e3d33e9:::benchmark_data_smithi052_19421_object55688:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:22:58.484 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:58.460269+0000", 2024-04-26T10:22:58.484 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0033437599999999999, 2024-04-26T10:22:58.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003630248, 2024-04-26T10:22:58.485 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.485 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:58.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.485 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.485 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185160 2024-04-26T10:22:58.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.485 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460269+0000", 2024-04-26T10:22:58.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460269+0000", 2024-04-26T10:22:58.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460269+0000", 2024-04-26T10:22:58.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460271+0000", 2024-04-26T10:22:58.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5129999999999999e-06 2024-04-26T10:22:58.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460277+0000", 2024-04-26T10:22:58.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8889999999999999e-06 2024-04-26T10:22:58.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460282+0000", 2024-04-26T10:22:58.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6260000000000003e-06 2024-04-26T10:22:58.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460333+0000", 2024-04-26T10:22:58.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0973000000000001e-05 2024-04-26T10:22:58.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460449+0000", 2024-04-26T10:22:58.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116156 2024-04-26T10:22:58.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460553+0000", 2024-04-26T10:22:58.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104172 2024-04-26T10:22:58.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462521+0000", 2024-04-26T10:22:58.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019675700000000001 2024-04-26T10:22:58.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.489 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.489 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:185161 5.5 5:a09c3f2c:::benchmark_data_smithi052_19421_object55689:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:22:58.489 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:58.460300+0000", 2024-04-26T10:22:58.489 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0033125350000000001, 2024-04-26T10:22:58.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036684790000000001, 2024-04-26T10:22:58.490 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.490 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:58.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.490 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185161 2024-04-26T10:22:58.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.490 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460300+0000", 2024-04-26T10:22:58.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460300+0000", 2024-04-26T10:22:58.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460300+0000", 2024-04-26T10:22:58.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460303+0000", 2024-04-26T10:22:58.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9409999999999999e-06 2024-04-26T10:22:58.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460319+0000", 2024-04-26T10:22:58.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6574000000000001e-05 2024-04-26T10:22:58.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460332+0000", 2024-04-26T10:22:58.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2534000000000001e-05 2024-04-26T10:22:58.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.461966+0000", 2024-04-26T10:22:58.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016340739999999999 2024-04-26T10:22:58.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462056+0000", 2024-04-26T10:22:58.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0371999999999995e-05 2024-04-26T10:22:58.493 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.493 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.493 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.493 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:185163 5.5 5:a1ca82ff:::benchmark_data_smithi052_19421_object55691:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:22:58.494 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:58.460371+0000", 2024-04-26T10:22:58.494 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032416319999999999, 2024-04-26T10:22:58.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003656688, 2024-04-26T10:22:58.494 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.494 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-04-26T10:22:58.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.494 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.494 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185163 2024-04-26T10:22:58.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.494 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460371+0000", 2024-04-26T10:22:58.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460371+0000", 2024-04-26T10:22:58.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460371+0000", 2024-04-26T10:22:58.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460374+0000", 2024-04-26T10:22:58.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7240000000000001e-06 2024-04-26T10:22:58.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460385+0000", 2024-04-26T10:22:58.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1731e-05 2024-04-26T10:22:58.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460390+0000", 2024-04-26T10:22:58.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7099999999999998e-06 2024-04-26T10:22:58.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.463896+0000", 2024-04-26T10:22:58.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035057 2024-04-26T10:22:58.497 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.497 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.497 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.498 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:185164 5.d 5.da00b54d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:22:58.498 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:58.460395+0000", 2024-04-26T10:22:58.498 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032178480000000001, 2024-04-26T10:22:58.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036865130000000002, 2024-04-26T10:22:58.498 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.498 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:22:58.498 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.498 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.498 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.498 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185164 2024-04-26T10:22:58.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.498 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460395+0000", 2024-04-26T10:22:58.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460395+0000", 2024-04-26T10:22:58.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460395+0000", 2024-04-26T10:22:58.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460397+0000", 2024-04-26T10:22:58.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5969999999999999e-06 2024-04-26T10:22:58.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460403+0000", 2024-04-26T10:22:58.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5539999999999997e-06 2024-04-26T10:22:58.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460407+0000", 2024-04-26T10:22:58.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3680000000000004e-06 2024-04-26T10:22:58.501 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.501 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.501 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.501 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:185165 5.7 5:e2625fbc:::benchmark_data_smithi052_19421_object55693:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:22:58.501 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:58.460411+0000", 2024-04-26T10:22:58.501 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032018720000000001, 2024-04-26T10:22:58.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003718374, 2024-04-26T10:22:58.501 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.501 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:58.501 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.502 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.502 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.502 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185165 2024-04-26T10:22:58.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.502 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460411+0000", 2024-04-26T10:22:58.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460411+0000", 2024-04-26T10:22:58.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460411+0000", 2024-04-26T10:22:58.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460413+0000", 2024-04-26T10:22:58.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3769999999999999e-06 2024-04-26T10:22:58.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460419+0000", 2024-04-26T10:22:58.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5090000000000001e-06 2024-04-26T10:22:58.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460423+0000", 2024-04-26T10:22:58.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5249999999999999e-06 2024-04-26T10:22:58.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460854+0000", 2024-04-26T10:22:58.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00043045600000000001 2024-04-26T10:22:58.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.460977+0000", 2024-04-26T10:22:58.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012309899999999999 2024-04-26T10:22:58.505 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.505 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.505 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.505 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:185157 5.b e58/37 5:d8244818:::benchmark_data_smithi052_19421_object55685:head v 58'11477, mlcod=58'11475)", 2024-04-26T10:22:58.506 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:58.462227+0000", 2024-04-26T10:22:58.506 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0013855499999999999, 2024-04-26T10:22:58.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019614089999999999, 2024-04-26T10:22:58.506 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.506 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:58.506 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462227+0000", 2024-04-26T10:22:58.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462227+0000", 2024-04-26T10:22:58.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462227+0000", 2024-04-26T10:22:58.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462232+0000", 2024-04-26T10:22:58.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3249999999999998e-06 2024-04-26T10:22:58.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462238+0000", 2024-04-26T10:22:58.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1340000000000001e-06 2024-04-26T10:22:58.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462243+0000", 2024-04-26T10:22:58.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5129999999999998e-06 2024-04-26T10:22:58.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462981+0000", 2024-04-26T10:22:58.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00073832300000000004 2024-04-26T10:22:58.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.463001+0000", 2024-04-26T10:22:58.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9222999999999999e-05 2024-04-26T10:22:58.509 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.509 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.509 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.509 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:185166 5.3 5:cd69545a:::benchmark_data_smithi052_19421_object55694:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:22:58.509 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:58.462260+0000", 2024-04-26T10:22:58.510 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0013533110000000001, 2024-04-26T10:22:58.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019811350000000002, 2024-04-26T10:22:58.510 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.510 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:58.510 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.510 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.510 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.510 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185166 2024-04-26T10:22:58.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.510 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462260+0000", 2024-04-26T10:22:58.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462260+0000", 2024-04-26T10:22:58.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462259+0000", 2024-04-26T10:22:58.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462263+0000", 2024-04-26T10:22:58.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7419999999999999e-06 2024-04-26T10:22:58.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462270+0000", 2024-04-26T10:22:58.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1679999999999998e-06 2024-04-26T10:22:58.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462276+0000", 2024-04-26T10:22:58.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.195e-06 2024-04-26T10:22:58.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.463101+0000", 2024-04-26T10:22:58.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00082518399999999997 2024-04-26T10:22:58.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.463249+0000", 2024-04-26T10:22:58.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014761 2024-04-26T10:22:58.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.513 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.514 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:185168 5.7 5:ea11121f:::benchmark_data_smithi052_19421_object55696:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:22:58.514 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:58.462621+0000", 2024-04-26T10:22:58.514 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00099199599999999998, 2024-04-26T10:22:58.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016783620000000001, 2024-04-26T10:22:58.514 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.514 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:22:58.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.514 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185168 2024-04-26T10:22:58.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.514 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462621+0000", 2024-04-26T10:22:58.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462621+0000", 2024-04-26T10:22:58.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462620+0000", 2024-04-26T10:22:58.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:58.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462624+0000", 2024-04-26T10:22:58.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2679999999999996e-06 2024-04-26T10:22:58.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462634+0000", 2024-04-26T10:22:58.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2359999999999993e-06 2024-04-26T10:22:58.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462640+0000", 2024-04-26T10:22:58.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3319999999999997e-06 2024-04-26T10:22:58.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462826+0000", 2024-04-26T10:22:58.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000186169 2024-04-26T10:22:58.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462943+0000", 2024-04-26T10:22:58.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011688600000000001 2024-04-26T10:22:58.517 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.517 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.518 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.518 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:185169 5.9 5:94776abe:::benchmark_data_smithi052_19421_object55697:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:22:58.518 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:58.462651+0000", 2024-04-26T10:22:58.518 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00096170499999999998, 2024-04-26T10:22:58.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001710718, 2024-04-26T10:22:58.518 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.518 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:58.518 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.518 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.518 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.518 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 185169 2024-04-26T10:22:58.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.519 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462651+0000", 2024-04-26T10:22:58.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462651+0000", 2024-04-26T10:22:58.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462651+0000", 2024-04-26T10:22:58.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462653+0000", 2024-04-26T10:22:58.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6630000000000002e-06 2024-04-26T10:22:58.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462659+0000", 2024-04-26T10:22:58.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:22:58.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462664+0000", 2024-04-26T10:22:58.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7029999999999997e-06 2024-04-26T10:22:58.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462707+0000", 2024-04-26T10:22:58.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2811000000000001e-05 2024-04-26T10:22:58.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462820+0000", 2024-04-26T10:22:58.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011341900000000001 2024-04-26T10:22:58.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:58.462929+0000", 2024-04-26T10:22:58.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000108949 2024-04-26T10:22:58.522 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.522 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.522 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.522 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.522 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:22:58.522 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 13 2024-04-26T10:22:58.522 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:58.523 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:58.527 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:58.523+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:58.630 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:58.623+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:58.662 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:58.662 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:22:58.662 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:22:58.662 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:22:58.662 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:58.676 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:58.730 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:58.726+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:58.831 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:58.827+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:58.844 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:22:58.844 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:22:58.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:22:58.844 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:22:58.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.845 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:58.845 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:58.845 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.803021919000003, 2024-04-26T10:22:58.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:22:58.845 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.845 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.845 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:22:58.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.846 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:58.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:58.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:22:58.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:22:58.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:22:58.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:22:58.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:22:58.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:22:58.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:22:58.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:22:58.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:22:58.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:22:58.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:22:58.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:22:58.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:22:58.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:22:58.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:22:58.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:22:58.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:22:58.850 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.850 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.850 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.850 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:58.850 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:58.850 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.802912667999998, 2024-04-26T10:22:58.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:22:58.850 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.850 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.850 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.851 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:22:58.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.851 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:58.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.851 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.851 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:58.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:22:58.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:22:58.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:22:58.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:22:58.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:22:58.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:22:58.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:22:58.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:22:58.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:22:58.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:22:58.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:22:58.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:22:58.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:22:58.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:22:58.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:22:58.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:22:58.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:22:58.854 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.855 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.855 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.855 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:58.855 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:58.855 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.800515255999997, 2024-04-26T10:22:58.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:22:58.855 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.855 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.855 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.855 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.855 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.855 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:22:58.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.856 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:58.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:22:58.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:22:58.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:58.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:22:58.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:22:58.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.857 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.857 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:22:58.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:22:58.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:22:58.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:22:58.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:22:58.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:22:58.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:22:58.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:22:58.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:22:58.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:22:58.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:22:58.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:22:58.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:22:58.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:22:58.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:22:58.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:22:58.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:22:58.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:22:58.861 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.861 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.861 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.861 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:58.861 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:58.861 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.800329331999997, 2024-04-26T10:22:58.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:22:58.861 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.861 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.861 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.861 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.861 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.861 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:22:58.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.862 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:58.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:22:58.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:22:58.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:22:58.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:22:58.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:22:58.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:22:58.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:22:58.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:22:58.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:22:58.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:22:58.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.864 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:22:58.864 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:22:58.864 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.864 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.864 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:22:58.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:22:58.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:22:58.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:22:58.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.865 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.865 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:22:58.865 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:22:58.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:22:58.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:22:58.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.866 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:22:58.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:22:58.866 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.866 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.866 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.867 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:58.867 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:58.867 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.7103067159999998, 2024-04-26T10:22:58.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:22:58.867 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.867 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.867 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.867 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.867 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.867 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:22:58.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.867 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:58.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:58.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:22:58.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:22:58.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:22:58.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:22:58.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:22:58.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:22:58.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:22:58.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:22:58.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:22:58.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:58.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:22:58.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:22:58.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:22:58.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:22:58.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:22:58.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:22:58.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:22:58.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:22:58.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:22:58.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:22:58.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:22:58.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:22:58.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:22:58.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:22:58.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:22:58.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:22:58.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.873 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.873 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.873 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:58.873 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:22:58.873 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6872044699999993, 2024-04-26T10:22:58.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:22:58.873 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.873 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.873 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:22:58.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.874 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:22:58.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:22:58.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:22:58.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:58.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:22:58.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:22:58.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:22:58.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:22:58.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:22:58.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:22:58.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:22:58.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:22:58.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:58.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:22:58.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:22:58.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:22:58.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:22:58.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:22:58.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:22:58.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:22:58.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:22:58.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:22:58.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:22:58.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:22:58.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:22:58.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:22:58.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:22:58.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:22:58.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:22:58.879 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.879 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.879 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.879 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:58.880 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:22:58.880 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6805213319999996, 2024-04-26T10:22:58.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:22:58.880 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.880 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.880 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:22:58.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.880 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:22:58.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:22:58.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:22:58.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:58.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:22:58.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:22:58.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:22:58.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:22:58.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:22:58.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:22:58.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:22:58.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:22:58.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:58.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:22:58.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:22:58.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:22:58.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:22:58.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:22:58.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:22:58.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:22:58.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:22:58.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:22:58.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:22:58.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:22:58.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:22:58.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:22:58.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:22:58.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:22:58.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:22:58.886 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.886 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.886 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.886 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:58.886 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:22:58.886 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6785235469999993, 2024-04-26T10:22:58.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:22:58.886 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.886 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.887 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:22:58.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.887 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:22:58.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:22:58.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:22:58.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:58.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:22:58.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:22:58.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:22:58.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:22:58.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:22:58.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:22:58.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:22:58.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:22:58.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:58.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:22:58.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:22:58.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:22:58.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:22:58.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:22:58.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:22:58.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:22:58.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:22:58.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:22:58.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:22:58.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:22:58.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:22:58.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:22:58.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:22:58.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:22:58.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:22:58.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.892 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.893 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:58.893 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:22:58.893 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6691148420000008, 2024-04-26T10:22:58.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:22:58.893 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.893 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.893 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:22:58.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.893 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:22:58.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:22:58.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:22:58.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:58.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:22:58.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:22:58.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:22:58.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:22:58.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:22:58.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:22:58.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:22:58.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:22:58.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:58.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:22:58.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:22:58.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:22:58.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:22:58.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:22:58.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:22:58.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:22:58.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:22:58.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:22:58.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:22:58.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:22:58.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:22:58.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:22:58.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:22:58.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:22:58.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:22:58.899 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.899 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.899 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.899 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:58.899 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:22:58.899 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6672867930000006, 2024-04-26T10:22:58.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:22:58.899 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.899 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.900 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:22:58.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.900 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:22:58.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:22:58.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:22:58.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:58.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:22:58.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:22:58.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:22:58.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:22:58.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:22:58.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:22:58.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:22:58.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:22:58.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:58.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:22:58.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:22:58.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:22:58.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:22:58.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:22:58.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:22:58.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:22:58.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:22:58.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:22:58.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:22:58.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:22:58.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:22:58.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:22:58.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:22:58.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:22:58.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:22:58.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.906 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.906 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:58.906 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:58.906 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6557070710000001, 2024-04-26T10:22:58.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:22:58.906 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.906 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.906 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.906 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.907 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:22:58.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.907 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:58.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:58.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:22:58.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:58.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:22:58.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:22:58.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:22:58.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:22:58.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:22:58.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:22:58.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:22:58.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:22:58.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:58.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:22:58.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:22:58.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:22:58.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:22:58.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:22:58.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:22:58.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:22:58.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:22:58.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:22:58.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:22:58.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:22:58.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:22:58.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:22:58.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:22:58.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:22:58.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:22:58.912 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.912 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.912 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.912 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:58.913 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:22:58.913 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6492965769999994, 2024-04-26T10:22:58.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:22:58.913 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.913 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.913 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:22:58.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.913 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:22:58.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:22:58.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:22:58.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:58.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:22:58.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:22:58.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:22:58.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:22:58.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:22:58.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:22:58.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:22:58.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:22:58.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:58.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:22:58.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:22:58.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:22:58.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:22:58.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:22:58.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:22:58.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:22:58.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:22:58.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:22:58.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:22:58.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:22:58.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:22:58.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:22:58.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:22:58.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:22:58.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:22:58.919 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.919 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.920 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.920 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:58.920 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:22:58.920 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6367115139999999, 2024-04-26T10:22:58.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:22:58.920 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.920 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.920 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.921 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:22:58.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.921 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:22:58.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:22:58.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:22:58.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:58.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:22:58.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:22:58.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:22:58.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:22:58.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:22:58.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:22:58.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:22:58.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:22:58.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:58.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:22:58.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:22:58.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:22:58.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:22:58.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:22:58.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:22:58.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:22:58.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:22:58.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:22:58.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:22:58.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:22:58.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:22:58.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:22:58.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:22:58.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:22:58.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:22:58.926 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.926 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.926 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.927 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:58.927 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:22:58.927 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.6364765810000002, 2024-04-26T10:22:58.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:22:58.927 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.927 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.927 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.927 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:22:58.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.927 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:22:58.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:22:58.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:22:58.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:58.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:22:58.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:22:58.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:22:58.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:22:58.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:22:58.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:22:58.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:22:58.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:22:58.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:58.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:22:58.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:22:58.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:22:58.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:22:58.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:22:58.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:22:58.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:22:58.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:22:58.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:22:58.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:22:58.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:22:58.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:22:58.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:22:58.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:22:58.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:22:58.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:22:58.933 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.933 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.933 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.933 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:58.934 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:22:58.934 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.598601704, 2024-04-26T10:22:58.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:22:58.934 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.934 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.934 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:22:58.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.934 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:22:58.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:22:58.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:22:58.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:58.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:22:58.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:22:58.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:22:58.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:22:58.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:22:58.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:22:58.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:22:58.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:22:58.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:58.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:22:58.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:22:58.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:22:58.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:22:58.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:22:58.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:22:58.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:22:58.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:22:58.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:22:58.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:22:58.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:22:58.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:22:58.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:22:58.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:22:58.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:22:58.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:22:58.940 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.940 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.940 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.940 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:58.940 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:22:58.940 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.5981566790000006, 2024-04-26T10:22:58.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:22:58.940 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.940 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.941 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.941 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.941 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.941 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:22:58.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.941 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:22:58.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:22:58.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:22:58.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:58.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:22:58.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:22:58.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:22:58.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:22:58.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:22:58.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:22:58.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:22:58.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:22:58.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:58.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:22:58.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:22:58.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:22:58.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:22:58.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:22:58.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:22:58.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:22:58.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:22:58.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:22:58.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:22:58.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:22:58.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:22:58.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:22:58.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:22:58.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:22:58.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:22:58.946 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.947 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.947 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:58.947 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:22:58.947 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.5865536789999997, 2024-04-26T10:22:58.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:22:58.947 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.947 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.947 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.948 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:22:58.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.948 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:22:58.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:22:58.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:22:58.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:58.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:22:58.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:22:58.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:22:58.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:22:58.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:22:58.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:22:58.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:22:58.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:22:58.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:58.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:22:58.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:22:58.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:22:58.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:22:58.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:22:58.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:22:58.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:22:58.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:22:58.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:22:58.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:22:58.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:22:58.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:22:58.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:22:58.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:22:58.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:22:58.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:22:58.953 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.953 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.953 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.954 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:58.954 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:22:58.954 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.5852800889999994, 2024-04-26T10:22:58.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:22:58.954 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.954 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.954 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:22:58.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.954 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:22:58.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:22:58.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:22:58.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:58.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:22:58.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:22:58.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:22:58.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:22:58.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:22:58.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:22:58.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:22:58.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:22:58.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:58.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:22:58.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:22:58.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:22:58.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:22:58.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:22:58.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:22:58.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:22:58.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:22:58.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:22:58.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:22:58.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:22:58.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:22:58.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:22:58.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:22:58.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:22:58.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:22:58.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.960 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.960 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:58.960 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:22:58.960 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.5685227879999992, 2024-04-26T10:22:58.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:22:58.961 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.961 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.961 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:22:58.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.961 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:22:58.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:22:58.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:22:58.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:58.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:22:58.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:22:58.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:22:58.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:22:58.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:22:58.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:22:58.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:22:58.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:22:58.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:58.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:22:58.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:22:58.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:22:58.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:22:58.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:22:58.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:22:58.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:22:58.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:22:58.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:22:58.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:22:58.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:22:58.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:22:58.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:22:58.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:22:58.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:22:58.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:22:58.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.967 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.967 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.967 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:22:58.967 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:22:58.967 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 9.5236107669999992, 2024-04-26T10:22:58.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:22:58.967 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:22:58.967 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:58.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:22:58.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:22:58.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:58.968 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:22:58.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.968 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:22:58.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:22:58.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:22:58.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:22:58.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:22:58.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:22:58.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:22:58.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:22:58.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:22:58.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:22:58.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:22:58.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:22:58.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:22:58.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:22:58.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:22:58.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:22:58.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:22:58.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:22:58.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:22:58.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:22:58.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:22:58.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:22:58.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:22:58.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:22:58.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:22:58.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:22:58.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:22:58.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:22:58.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:22:58.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:22:58.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:22:58.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:22:58.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:58.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:22:58.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:22:58.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:22:58.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:22:58.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:22:58.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:22:58.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:22:58.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:22:58.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:22:58.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:22:58.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:22:58.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:22:58.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:22:58.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.973 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:22:58.973 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:22:58.973 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:22:58.974 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~70s 2024-04-26T10:22:58.975 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:58.974+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:58.975 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:22:59.076 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:59.071+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:59.102 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:59.102 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:59.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:186609 5.0 e58/54 5:030e6b5e:::benchmark_data_smithi052_19421_object57137:head v 58'11625, mlcod=58'11622)", 2024-04-26T10:22:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:59.098143+0000", 2024-04-26T10:22:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0043925520000000001, 2024-04-26T10:22:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0044087379999999997, 2024-04-26T10:22:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098143+0000", 2024-04-26T10:22:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098143+0000", 2024-04-26T10:22:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098143+0000", 2024-04-26T10:22:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098148+0000", 2024-04-26T10:22:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7570000000000001e-06 2024-04-26T10:22:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098164+0000", 2024-04-26T10:22:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5696e-05 2024-04-26T10:22:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098169+0000", 2024-04-26T10:22:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1359999999999996e-06 2024-04-26T10:22:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098201+0000", 2024-04-26T10:22:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.18e-05 2024-04-26T10:22:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098214+0000", 2024-04-26T10:22:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2957e-05 2024-04-26T10:22:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.102552+0000", 2024-04-26T10:22:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004338186 2024-04-26T10:22:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.106 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:186617 5.a 5:5e1d45c3:::benchmark_data_smithi052_19421_object57145:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:22:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:59.098300+0000", 2024-04-26T10:22:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0042354469999999998, 2024-04-26T10:22:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042965299999999998, 2024-04-26T10:22:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186617 2024-04-26T10:22:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098300+0000", 2024-04-26T10:22:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098300+0000", 2024-04-26T10:22:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098299+0000", 2024-04-26T10:22:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098306+0000", 2024-04-26T10:22:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0550000000000002e-06 2024-04-26T10:22:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098318+0000", 2024-04-26T10:22:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1548e-05 2024-04-26T10:22:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098326+0000", 2024-04-26T10:22:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.011e-06 2024-04-26T10:22:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098368+0000", 2024-04-26T10:22:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2438000000000003e-05 2024-04-26T10:22:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098510+0000", 2024-04-26T10:22:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014127200000000001 2024-04-26T10:22:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.110 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:186615 5.9 e58/37 5:98e6c0ab:::benchmark_data_smithi052_19421_object57143:head v 58'11715, mlcod=58'11712)", 2024-04-26T10:22:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:59.098538+0000", 2024-04-26T10:22:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.003998171, 2024-04-26T10:22:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0040984359999999996, 2024-04-26T10:22:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098538+0000", 2024-04-26T10:22:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098538+0000", 2024-04-26T10:22:59.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098537+0000", 2024-04-26T10:22:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098544+0000", 2024-04-26T10:22:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5390000000000004e-06 2024-04-26T10:22:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098555+0000", 2024-04-26T10:22:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1031e-05 2024-04-26T10:22:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098562+0000", 2024-04-26T10:22:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4429999999999997e-06 2024-04-26T10:22:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098601+0000", 2024-04-26T10:22:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9257e-05 2024-04-26T10:22:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098626+0000", 2024-04-26T10:22:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5094000000000001e-05 2024-04-26T10:22:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:186618 5.e 5:7f62ee6e:::benchmark_data_smithi052_19421_object57146:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:22:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:59.100262+0000", 2024-04-26T10:22:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0022737650000000001, 2024-04-26T10:22:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024061629999999998, 2024-04-26T10:22:59.114 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186618 2024-04-26T10:22:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100262+0000", 2024-04-26T10:22:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100262+0000", 2024-04-26T10:22:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100261+0000", 2024-04-26T10:22:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100268+0000", 2024-04-26T10:22:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5220000000000004e-06 2024-04-26T10:22:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100283+0000", 2024-04-26T10:22:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5763000000000001e-05 2024-04-26T10:22:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100290+0000", 2024-04-26T10:22:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1770000000000001e-06 2024-04-26T10:22:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100343+0000", 2024-04-26T10:22:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2107000000000001e-05 2024-04-26T10:22:59.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100463+0000", 2024-04-26T10:22:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120723 2024-04-26T10:22:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:186619 5.4 5:25e3742f:::benchmark_data_smithi052_19421_object57147:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:22:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:59.100347+0000", 2024-04-26T10:22:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.002189065, 2024-04-26T10:22:59.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0023558160000000002, 2024-04-26T10:22:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186619 2024-04-26T10:22:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100347+0000", 2024-04-26T10:22:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100347+0000", 2024-04-26T10:22:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100346+0000", 2024-04-26T10:22:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100351+0000", 2024-04-26T10:22:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9300000000000002e-06 2024-04-26T10:22:59.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100358+0000", 2024-04-26T10:22:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7000000000000002e-06 2024-04-26T10:22:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100365+0000", 2024-04-26T10:22:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0609999999999998e-06 2024-04-26T10:22:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100404+0000", 2024-04-26T10:22:59.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9450999999999999e-05 2024-04-26T10:22:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100491+0000", 2024-04-26T10:22:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6735000000000002e-05 2024-04-26T10:22:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100606+0000", 2024-04-26T10:22:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000115506 2024-04-26T10:22:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.122 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:186620 5.8 5:10f53e5c:::benchmark_data_smithi052_19421_object57148:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:22:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:59.100377+0000", 2024-04-26T10:22:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.002158765, 2024-04-26T10:22:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002367049, 2024-04-26T10:22:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:22:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186620 2024-04-26T10:22:59.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100377+0000", 2024-04-26T10:22:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100377+0000", 2024-04-26T10:22:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100377+0000", 2024-04-26T10:22:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100380+0000", 2024-04-26T10:22:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9979999999999999e-06 2024-04-26T10:22:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100384+0000", 2024-04-26T10:22:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5990000000000004e-06 2024-04-26T10:22:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100388+0000", 2024-04-26T10:22:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6239999999999999e-06 2024-04-26T10:22:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100428+0000", 2024-04-26T10:22:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0441000000000001e-05 2024-04-26T10:22:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.100527+0000", 2024-04-26T10:22:59.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8635999999999995e-05 2024-04-26T10:22:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:186613 5.4 5:20afc9df:::benchmark_data_smithi052_19421_object57141:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-26T10:22:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:59.097932+0000", 2024-04-26T10:22:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0046036810000000001, 2024-04-26T10:22:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004849491, 2024-04-26T10:22:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:22:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.127 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 186613 2024-04-26T10:22:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.097932+0000", 2024-04-26T10:22:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.097932+0000", 2024-04-26T10:22:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.097931+0000", 2024-04-26T10:22:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.097937+0000", 2024-04-26T10:22:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3480000000000003e-06 2024-04-26T10:22:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.097945+0000", 2024-04-26T10:22:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9000000000000006e-06 2024-04-26T10:22:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.097950+0000", 2024-04-26T10:22:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3349999999999997e-06 2024-04-26T10:22:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.097990+0000", 2024-04-26T10:22:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0212000000000001e-05 2024-04-26T10:22:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098121+0000", 2024-04-26T10:22:59.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013053199999999999 2024-04-26T10:22:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:59.098245+0000", 2024-04-26T10:22:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000124554 2024-04-26T10:22:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:22:59.131 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 7 2024-04-26T10:22:59.131 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:59.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:22:59.176 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:59.171+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:59.255 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:59.256 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:22:59.256 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:22:59.256 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:22:59.256 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:59.269 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:22:59.277 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:59.271+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:59.313 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:22:59.378 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:59.371+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:59.391 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:22:59.391 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:22:59.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:22:59.391 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:22:59.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.391 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:59.391 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:59.392 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.858828785, 2024-04-26T10:22:59.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:22:59.392 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.392 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.392 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.392 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.392 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.392 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:22:59.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.392 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:59.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:22:59.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:22:59.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:59.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:22:59.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:22:59.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:22:59.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:22:59.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:22:59.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:22:59.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:22:59.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:22:59.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:22:59.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:22:59.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:59.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:22:59.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:22:59.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:22:59.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:22:59.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:22:59.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:22:59.396 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.396 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.396 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.396 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:59.396 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:59.396 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.856846558000001, 2024-04-26T10:22:59.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:22:59.396 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.396 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.397 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.397 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.397 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.397 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:22:59.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.397 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:59.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:22:59.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:22:59.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:22:59.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:22:59.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:22:59.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:22:59.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:22:59.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:22:59.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:22:59.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:22:59.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:22:59.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:22:59.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:22:59.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:59.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:22:59.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:22:59.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:22:59.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:22:59.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:22:59.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:22:59.401 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.401 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.401 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.401 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:59.401 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:59.401 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.856647174000003, 2024-04-26T10:22:59.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:22:59.401 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.401 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.401 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.401 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.402 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.402 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:22:59.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.402 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:59.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:59.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:22:59.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:59.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:22:59.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:22:59.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:22:59.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:22:59.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:22:59.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:22:59.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:22:59.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:22:59.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:22:59.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:22:59.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:59.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:22:59.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:22:59.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:22:59.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:22:59.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:22:59.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:22:59.406 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.406 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.406 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.406 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:22:59.406 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:59.406 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.856428553999997, 2024-04-26T10:22:59.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:22:59.406 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.406 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.407 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:59.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:22:59.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:22:59.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:59.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:22:59.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:22:59.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:22:59.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:22:59.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:22:59.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:22:59.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:22:59.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:22:59.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:22:59.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:22:59.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:22:59.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:22:59.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:22:59.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:22:59.410 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.410 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.410 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.410 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:59.411 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:59.411 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.854057116, 2024-04-26T10:22:59.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:22:59.411 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.411 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.411 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.411 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.411 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.411 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:22:59.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.411 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:59.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:22:59.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:22:59.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:59.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:22:59.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:22:59.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:22:59.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:22:59.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:22:59.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:22:59.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:59.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:22:59.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:22:59.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:22:59.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:59.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:22:59.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:22:59.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:22:59.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:22:59.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:22:59.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:22:59.415 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.415 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.415 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.415 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:59.415 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:59.415 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.853956494000002, 2024-04-26T10:22:59.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:22:59.416 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.416 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.416 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.416 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.416 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.416 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:22:59.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.416 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:59.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:22:59.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:22:59.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:59.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:22:59.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:22:59.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:22:59.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:22:59.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:22:59.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:22:59.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:22:59.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:22:59.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:22:59.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:22:59.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:59.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:22:59.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:22:59.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:22:59.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:22:59.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:22:59.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:22:59.420 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.420 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.420 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.420 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:22:59.420 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:59.420 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.853837933000001, 2024-04-26T10:22:59.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:22:59.420 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.421 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.421 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:59.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:22:59.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:22:59.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:59.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:22:59.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:22:59.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:22:59.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:22:59.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:22:59.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:22:59.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:22:59.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:22:59.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:22:59.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:22:59.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:22:59.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:22:59.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:22:59.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:22:59.424 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.425 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.425 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.425 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:59.425 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:59.425 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.853735534999998, 2024-04-26T10:22:59.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:22:59.425 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.425 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.425 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.425 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.425 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.425 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:22:59.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.426 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:59.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:22:59.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:22:59.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:59.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:22:59.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:22:59.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:22:59.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:22:59.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:22:59.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:22:59.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:22:59.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:22:59.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:22:59.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:22:59.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:59.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:22:59.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:22:59.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:22:59.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:22:59.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:22:59.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:22:59.429 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.429 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.430 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.430 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:59.430 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:59.430 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.852714978000002, 2024-04-26T10:22:59.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:22:59.430 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.430 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.430 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.430 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.430 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.430 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:22:59.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.431 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:59.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:22:59.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:22:59.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:59.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:22:59.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:22:59.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:22:59.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:22:59.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:22:59.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:22:59.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:22:59.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:22:59.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:22:59.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:22:59.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:59.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:22:59.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:22:59.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:22:59.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:22:59.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:22:59.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:22:59.434 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.434 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.435 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.435 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:22:59.435 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:59.435 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.851564703000001, 2024-04-26T10:22:59.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:22:59.435 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.435 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.435 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.435 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.435 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.435 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:22:59.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.436 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:59.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:22:59.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:22:59.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:59.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:22:59.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:22:59.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:22:59.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:22:59.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:22:59.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:22:59.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:22:59.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:22:59.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:22:59.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:22:59.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:59.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:22:59.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:22:59.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:22:59.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:22:59.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:22:59.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:22:59.439 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.440 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.440 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.440 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:59.440 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:59.440 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 35.354865461000003, 2024-04-26T10:22:59.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:22:59.440 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.440 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.440 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.440 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:22:59.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.441 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:59.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:22:59.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:22:59.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:59.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:22:59.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:22:59.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:22:59.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:22:59.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:22:59.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:22:59.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:22:59.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:22:59.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:22:59.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:22:59.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:59.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:22:59.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:22:59.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:59.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:22:59.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:22:59.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:59.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:22:59.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:22:59.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:22:59.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:22:59.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:22:59.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:22:59.447 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.447 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.447 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.447 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:22:59.448 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:59.448 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 35.354641864999998, 2024-04-26T10:22:59.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:22:59.448 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.448 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.448 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.448 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.448 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.448 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:22:59.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.448 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:59.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:22:59.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:22:59.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:59.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:22:59.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:22:59.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:22:59.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:22:59.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:22:59.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:22:59.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:22:59.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:22:59.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:22:59.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:22:59.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:59.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:22:59.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:22:59.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:59.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:22:59.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:22:59.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:59.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:22:59.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:22:59.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:22:59.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:22:59.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:22:59.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:22:59.453 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.453 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.453 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.453 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:59.453 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:59.454 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.323795544999999, 2024-04-26T10:22:59.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:22:59.454 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.454 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.454 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.454 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.454 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.454 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:22:59.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.454 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:59.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:22:59.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:22:59.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:59.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:22:59.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:22:59.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:22:59.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:22:59.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:22:59.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:22:59.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:22:59.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:22:59.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:22:59.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:22:59.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:59.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:22:59.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:22:59.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:59.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:22:59.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:22:59.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:59.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:22:59.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:22:59.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:22:59.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:22:59.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:22:59.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:22:59.459 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.459 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.459 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.459 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:59.459 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:59.459 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.321784441999998, 2024-04-26T10:22:59.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:22:59.459 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.459 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.460 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.460 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.460 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.460 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:22:59.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.460 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:59.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:59.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:22:59.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:59.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:22:59.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:22:59.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:22:59.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:22:59.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:22:59.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:22:59.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:22:59.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:22:59.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:22:59.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:22:59.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:59.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:22:59.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:22:59.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:59.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:22:59.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:22:59.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:59.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:22:59.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:22:59.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:22:59.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:22:59.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:22:59.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:22:59.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.465 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.465 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:59.465 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:59.465 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.310906336999999, 2024-04-26T10:22:59.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:22:59.465 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.465 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.465 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.465 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.466 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.466 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:22:59.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.466 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:59.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:22:59.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:22:59.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:59.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:22:59.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:22:59.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:22:59.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:22:59.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:22:59.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:22:59.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:22:59.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:22:59.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:22:59.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:22:59.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:59.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:22:59.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:22:59.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:59.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:22:59.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:22:59.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:59.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:22:59.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:22:59.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:22:59.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:22:59.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:22:59.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:22:59.470 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.470 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.471 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.471 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:59.471 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:59.471 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.308225117999999, 2024-04-26T10:22:59.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:22:59.471 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.471 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.471 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.471 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.471 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.471 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:22:59.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.472 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:59.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:22:59.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:22:59.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:22:59.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:22:59.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:22:59.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:22:59.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:22:59.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:22:59.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:22:59.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:22:59.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:22:59.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:22:59.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:22:59.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:59.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:22:59.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:22:59.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:59.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:22:59.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:22:59.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:59.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:22:59.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:22:59.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:22:59.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:22:59.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:22:59.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:22:59.476 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.476 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.476 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.477 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:59.477 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:59.477 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.307858043, 2024-04-26T10:22:59.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:22:59.477 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.477 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.477 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.477 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.477 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.477 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:22:59.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.477 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:59.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:22:59.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:22:59.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:59.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:22:59.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:22:59.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:22:59.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:22:59.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:22:59.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:22:59.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:22:59.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:22:59.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:22:59.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:22:59.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:59.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:22:59.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:22:59.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:22:59.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:22:59.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:22:59.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:22:59.482 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.482 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.482 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.482 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:59.482 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:59.482 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.307793791000002, 2024-04-26T10:22:59.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:22:59.482 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.482 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.482 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.482 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.483 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.483 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:22:59.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.483 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:59.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:22:59.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:22:59.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:59.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:22:59.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:22:59.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:22:59.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:22:59.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:22:59.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:22:59.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:22:59.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:22:59.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:22:59.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:22:59.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:59.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:22:59.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:22:59.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:22:59.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:22:59.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:22:59.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:22:59.487 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.487 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.487 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.487 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:59.487 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:59.487 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.303395118000001, 2024-04-26T10:22:59.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:22:59.487 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.487 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.488 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.488 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.488 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.488 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:22:59.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.488 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:59.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:22:59.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:22:59.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:22:59.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:22:59.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:22:59.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:22:59.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:22:59.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:22:59.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:22:59.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:22:59.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:22:59.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:22:59.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:22:59.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:59.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:22:59.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:22:59.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:22:59.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:22:59.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:22:59.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:22:59.492 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.492 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.492 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.492 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:22:59.492 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:59.492 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 28.301637135, 2024-04-26T10:22:59.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:22:59.492 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:22:59.492 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:22:59.493 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:22:59.493 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:22:59.493 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:22:59.493 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:22:59.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.493 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:22:59.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:22:59.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:59.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:22:59.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:22:59.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:22:59.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:22:59.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:22:59.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:22:59.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:22:59.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:22:59.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:22:59.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:22:59.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:22:59.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:22:59.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:22:59.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:22:59.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:22:59.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:22:59.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:22:59.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:22:59.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:22:59.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:22:59.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:22:59.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:22:59.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:22:59.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:22:59.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:22:59.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:22:59.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:22:59.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:22:59.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:22:59.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:22:59.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:22:59.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:22:59.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:22:59.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:22:59.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:22:59.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:22:59.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:22:59.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:22:59.497 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.497 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.498 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.498 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:22:59.498 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:22:59.498 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:22:59.499 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:22:59.499 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:22:59.500 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:59.498+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:59.500 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:22:59.501 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:22:59.501 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:22:59.501 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:22:59.501 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:22:59.501 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:22:59.600 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:22:59.598+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:22:59.627 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:59.627 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:59.640 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:22:59.701 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:59.695+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:59.768 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:59.768 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:59.780 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:22:59.801 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:59.795+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:59.902 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:22:59.899+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:22:59.914 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:22:59.914 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:22:59.926 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:00.003 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:00.002+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:00.055 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:00.055 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:00.066 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:00.103 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:00.099+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:00.190 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:23:00.201 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:00.201 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:00.204 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:00.199+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:00.214 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:00.305 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:00.299+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:00.344 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:00.344 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:00.356 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:00.406 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:00.402+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:00.486 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:00.486 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:00.498 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:00.507 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:00.503+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:00.608 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:00.606+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:00.628 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:00.628 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:00.641 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:00.709 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:00.703+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:00.771 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:00.771 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:00.783 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:00.831 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:00.830+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:00.911 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:00.911 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:00.912 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:00.910+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:00.924 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:01.013 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:01.007+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:01.048 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:01.048 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:01.060 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:01.114 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:01.107+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:01.181 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:01.181 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:01.192 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:01.197 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T10:23:01.215 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:01.214+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:01.315 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:01.314+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:01.325 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:01.325 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:01.338 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:01.416 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:01.414+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:01.469 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:01.469 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:01.481 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:01.502 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:23:01.517 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:01.514+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:01.608 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:01.608 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:01.618 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:01.614+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:01.622 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:01.656 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:23:01.678 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:23:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:23:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:23:01.678 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:23:01.683 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:23:01.683 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:23:01.719 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:01.718+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:01.754 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:01.754 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:01.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.754 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:192747 5.8 5:16e6a03b:::benchmark_data_smithi052_19421_object63275:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:01.754 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:01.748647+0000", 2024-04-26T10:23:01.754 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0055136409999999997, 2024-04-26T10:23:01.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055395160000000004, 2024-04-26T10:23:01.754 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:01.754 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:01.754 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:01.754 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:01.754 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:01.755 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 192747 2024-04-26T10:23:01.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.755 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:01.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:01.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.748647+0000", 2024-04-26T10:23:01.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:01.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:01.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.748647+0000", 2024-04-26T10:23:01.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:01.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:01.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.748645+0000", 2024-04-26T10:23:01.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999981 2024-04-26T10:23:01.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:01.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.748654+0000", 2024-04-26T10:23:01.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6470000000000004e-06 2024-04-26T10:23:01.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:01.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.748667+0000", 2024-04-26T10:23:01.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3156000000000001e-05 2024-04-26T10:23:01.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:01.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.748676+0000", 2024-04-26T10:23:01.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5280000000000003e-06 2024-04-26T10:23:01.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:01.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.749048+0000", 2024-04-26T10:23:01.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00037177599999999999 2024-04-26T10:23:01.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:01.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.749199+0000", 2024-04-26T10:23:01.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015155799999999999 2024-04-26T10:23:01.757 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:01.758 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:01.758 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:01.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.758 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:192748 5.a 5:5c0dd198:::benchmark_data_smithi052_19421_object63276:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:01.758 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:01.748694+0000", 2024-04-26T10:23:01.758 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0054672089999999998, 2024-04-26T10:23:01.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055392490000000004, 2024-04-26T10:23:01.758 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:01.758 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:01.758 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:01.758 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:01.758 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:01.759 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 192748 2024-04-26T10:23:01.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.759 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:01.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:01.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.748694+0000", 2024-04-26T10:23:01.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:01.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:01.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.748694+0000", 2024-04-26T10:23:01.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:01.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:01.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.748693+0000", 2024-04-26T10:23:01.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:01.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:01.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.748697+0000", 2024-04-26T10:23:01.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7560000000000001e-06 2024-04-26T10:23:01.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:01.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.748705+0000", 2024-04-26T10:23:01.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.6149999999999997e-06 2024-04-26T10:23:01.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:01.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.748712+0000", 2024-04-26T10:23:01.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3640000000000004e-06 2024-04-26T10:23:01.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:01.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.748769+0000", 2024-04-26T10:23:01.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.719e-05 2024-04-26T10:23:01.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:01.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.748859+0000", 2024-04-26T10:23:01.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0511000000000001e-05 2024-04-26T10:23:01.762 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:01.762 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:01.762 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:01.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.762 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:192752 5.e 5:77aaa3d7:::benchmark_data_smithi052_19421_object63280:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:01.762 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:01.750830+0000", 2024-04-26T10:23:01.762 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0033309670000000002, 2024-04-26T10:23:01.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034425060000000001, 2024-04-26T10:23:01.763 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:01.763 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:01.763 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:01.763 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:01.763 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:01.763 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 192752 2024-04-26T10:23:01.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.763 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:01.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:01.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.750830+0000", 2024-04-26T10:23:01.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:01.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:01.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.750830+0000", 2024-04-26T10:23:01.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:01.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:01.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.750829+0000", 2024-04-26T10:23:01.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:01.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:01.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.750834+0000", 2024-04-26T10:23:01.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6729999999999997e-06 2024-04-26T10:23:01.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:01.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.750848+0000", 2024-04-26T10:23:01.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3422e-05 2024-04-26T10:23:01.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:01.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.750853+0000", 2024-04-26T10:23:01.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.631e-06 2024-04-26T10:23:01.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:01.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.750906+0000", 2024-04-26T10:23:01.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2337999999999999e-05 2024-04-26T10:23:01.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:01.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.751050+0000", 2024-04-26T10:23:01.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014398899999999999 2024-04-26T10:23:01.766 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:01.766 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:01.766 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:01.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.766 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:192751 5.0 e59/54 5:0c561fe1:::benchmark_data_smithi052_19421_object63279:head v 59'12010, mlcod=59'12008)", 2024-04-26T10:23:01.766 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:01.751004+0000", 2024-04-26T10:23:01.766 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0031571590000000001, 2024-04-26T10:23:01.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033048130000000002, 2024-04-26T10:23:01.767 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:01.767 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:01.767 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:01.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:01.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.751004+0000", 2024-04-26T10:23:01.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:01.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:01.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.751004+0000", 2024-04-26T10:23:01.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:01.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:01.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.751003+0000", 2024-04-26T10:23:01.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:01.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:01.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.751009+0000", 2024-04-26T10:23:01.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3800000000000002e-06 2024-04-26T10:23:01.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:01.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.751023+0000", 2024-04-26T10:23:01.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.448e-05 2024-04-26T10:23:01.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:01.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.751030+0000", 2024-04-26T10:23:01.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5649999999999998e-06 2024-04-26T10:23:01.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:01.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.751126+0000", 2024-04-26T10:23:01.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5898999999999998e-05 2024-04-26T10:23:01.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:01.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.751141+0000", 2024-04-26T10:23:01.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5324000000000001e-05 2024-04-26T10:23:01.770 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:01.770 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:01.770 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:01.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.770 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:192753 5.0 e59/54 5:07da2f5c:::benchmark_data_smithi052_19421_object63281:head v 59'12011, mlcod=59'12008)", 2024-04-26T10:23:01.770 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:01.752864+0000", 2024-04-26T10:23:01.770 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.001297271, 2024-04-26T10:23:01.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014780279999999999, 2024-04-26T10:23:01.770 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:01.770 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:01.771 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:01.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:01.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.752864+0000", 2024-04-26T10:23:01.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:01.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:01.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.752864+0000", 2024-04-26T10:23:01.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:01.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:01.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.752863+0000", 2024-04-26T10:23:01.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:01.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:01.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.752868+0000", 2024-04-26T10:23:01.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6519999999999997e-06 2024-04-26T10:23:01.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:01.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.752876+0000", 2024-04-26T10:23:01.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9789999999999993e-06 2024-04-26T10:23:01.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:01.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.752880+0000", 2024-04-26T10:23:01.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8589999999999998e-06 2024-04-26T10:23:01.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:01.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.752923+0000", 2024-04-26T10:23:01.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3846e-05 2024-04-26T10:23:01.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:01.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.752961+0000", 2024-04-26T10:23:01.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7367999999999999e-05 2024-04-26T10:23:01.774 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:01.774 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:01.774 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:01.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.774 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:192743 5.4 5:25298255:::benchmark_data_smithi052_19421_object63271:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:01.774 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:01.746213+0000", 2024-04-26T10:23:01.774 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0079479960000000006, 2024-04-26T10:23:01.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0081621239999999998, 2024-04-26T10:23:01.774 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:01.774 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:01.775 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:01.775 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:01.775 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:01.775 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 192743 2024-04-26T10:23:01.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.775 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:01.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:01.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.746213+0000", 2024-04-26T10:23:01.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:01.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:01.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.746213+0000", 2024-04-26T10:23:01.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:01.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:01.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.746212+0000", 2024-04-26T10:23:01.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:01.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:01.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.746218+0000", 2024-04-26T10:23:01.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0769999999999996e-06 2024-04-26T10:23:01.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:01.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.746230+0000", 2024-04-26T10:23:01.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2532e-05 2024-04-26T10:23:01.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:01.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.746238+0000", 2024-04-26T10:23:01.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3250000000000008e-06 2024-04-26T10:23:01.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:01.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.748787+0000", 2024-04-26T10:23:01.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002548233 2024-04-26T10:23:01.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:01.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.748923+0000", 2024-04-26T10:23:01.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013628499999999999 2024-04-26T10:23:01.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:01.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:01.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:01.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:01.749007+0000", 2024-04-26T10:23:01.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4417000000000002e-05 2024-04-26T10:23:01.778 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:01.778 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:01.778 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:01.778 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:01.779 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:23:01.779 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 6 2024-04-26T10:23:01.779 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:01.780 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:01.820 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:01.815+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:01.906 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:01.906 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:01.906 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:23:01.906 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:23:01.906 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:01.917 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:01.921 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:01.915+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:02.021 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:02.018+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:02.043 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:02.043 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:23:02.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:23:02.043 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:02.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.043 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:02.043 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:02.043 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.510824329999998, 2024-04-26T10:23:02.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:23:02.043 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.043 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.044 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.044 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.044 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.044 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:23:02.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.044 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:02.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:02.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:23:02.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:23:02.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:23:02.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.045 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.045 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:23:02.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:23:02.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:23:02.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:23:02.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:23:02.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:23:02.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:23:02.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:23:02.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:23:02.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:23:02.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:23:02.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:23:02.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:23:02.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:23:02.048 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.048 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.048 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.048 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:02.048 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:02.048 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.508842102999999, 2024-04-26T10:23:02.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:23:02.049 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.049 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.049 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.049 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.049 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.049 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:23:02.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.049 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:02.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:02.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:23:02.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:23:02.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:23:02.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:23:02.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:23:02.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:23:02.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:23:02.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:23:02.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:23:02.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:23:02.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:23:02.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:23:02.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:23:02.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:23:02.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:23:02.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:23:02.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:23:02.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:23:02.053 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.053 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.053 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.053 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:02.053 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:02.053 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.508642719000001, 2024-04-26T10:23:02.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:23:02.054 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.054 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.054 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.054 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.054 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.054 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:23:02.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.054 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:02.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:02.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:02.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:23:02.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:23:02.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:23:02.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:23:02.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:23:02.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:23:02.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:23:02.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:23:02.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:23:02.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:23:02.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:23:02.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:23:02.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:23:02.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:23:02.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:23:02.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:23:02.058 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.058 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.058 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.058 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:23:02.058 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:02.058 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.508424099000003, 2024-04-26T10:23:02.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:23:02.058 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.058 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.059 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:02.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:02.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:23:02.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:23:02.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:23:02.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:23:02.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:23:02.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:23:02.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:23:02.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:23:02.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:23:02.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:23:02.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:23:02.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:23:02.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:23:02.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:23:02.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:23:02.062 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.062 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.062 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.062 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:02.062 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:02.062 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.506052660999998, 2024-04-26T10:23:02.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:23:02.063 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.063 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.063 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.063 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.063 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.063 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:23:02.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.063 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:02.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:02.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:23:02.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:02.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:23:02.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:23:02.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:23:02.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:23:02.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:23:02.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:23:02.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:02.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:23:02.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:23:02.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:23:02.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:23:02.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:23:02.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:23:02.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:23:02.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:23:02.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:23:02.067 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.067 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.067 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.067 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:02.067 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:02.067 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.505952039, 2024-04-26T10:23:02.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:23:02.067 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.067 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.067 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.068 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.068 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.068 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:23:02.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.068 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:02.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:02.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:23:02.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:23:02.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:23:02.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:23:02.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:23:02.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:23:02.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:23:02.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:23:02.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:23:02.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:23:02.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:23:02.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:23:02.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:23:02.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:23:02.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:23:02.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:23:02.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:23:02.072 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.072 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.072 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.072 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:23:02.072 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:02.072 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.505833478, 2024-04-26T10:23:02.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:23:02.072 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.072 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.073 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:02.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:02.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:23:02.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:23:02.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:23:02.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:23:02.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:23:02.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:23:02.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:23:02.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:23:02.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:23:02.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:23:02.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:23:02.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:23:02.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:23:02.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:23:02.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:23:02.076 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.076 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.076 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.076 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:02.076 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:02.077 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.505731079999997, 2024-04-26T10:23:02.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:23:02.077 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.077 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.077 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.077 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.077 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.077 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:23:02.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.077 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:02.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:02.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:23:02.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:02.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:23:02.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:23:02.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:23:02.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:23:02.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:23:02.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:23:02.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:02.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:23:02.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:23:02.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:23:02.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:23:02.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:23:02.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:23:02.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:23:02.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:23:02.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:23:02.081 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.081 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.081 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.081 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:02.081 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:02.081 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.504710523, 2024-04-26T10:23:02.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:23:02.081 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.081 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.082 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.082 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.082 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.082 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:23:02.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.082 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:02.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:02.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:23:02.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:23:02.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:23:02.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:23:02.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:23:02.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:23:02.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:23:02.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:23:02.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:23:02.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:23:02.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:23:02.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:23:02.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:23:02.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:23:02.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:23:02.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:23:02.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:23:02.086 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.086 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.086 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.086 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:02.086 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:02.086 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 61.503560247999999, 2024-04-26T10:23:02.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:23:02.086 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.086 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.086 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.086 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.087 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.087 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:23:02.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.087 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:02.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:02.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:23:02.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:02.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:23:02.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:23:02.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:23:02.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:23:02.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:23:02.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:23:02.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:23:02.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:23:02.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:23:02.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:23:02.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:23:02.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:23:02.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:23:02.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:23:02.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:23:02.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.006861006000001, 2024-04-26T10:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.092 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:23:02.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.092 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:02.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:02.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:23:02.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:23:02.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:23:02.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:23:02.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:23:02.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:23:02.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:23:02.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:23:02.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:23:02.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:23:02.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:23:02.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:02.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:23:02.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:23:02.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:23:02.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:23:02.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:23:02.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:23:02.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:23:02.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:23:02.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:23:02.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:23:02.096 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.096 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.096 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.097 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:02.097 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:02.097 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 38.006637410000003, 2024-04-26T10:23:02.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:23:02.097 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.097 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.097 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.097 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.097 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.097 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:23:02.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.097 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:02.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:02.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:23:02.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:23:02.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:23:02.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:23:02.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:23:02.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:23:02.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:23:02.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:23:02.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:23:02.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:23:02.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:23:02.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:02.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:23:02.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:23:02.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:23:02.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:23:02.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:23:02.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:23:02.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:23:02.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:23:02.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:23:02.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:23:02.102 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.102 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.102 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.102 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:02.102 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:02.102 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.975791090000001, 2024-04-26T10:23:02.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:23:02.102 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.103 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.103 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.103 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.103 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.103 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:23:02.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.103 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:02.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:02.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:23:02.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:23:02.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:23:02.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:23:02.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:23:02.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:23:02.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:23:02.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:23:02.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:23:02.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:23:02.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:23:02.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:02.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:23:02.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:23:02.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:23:02.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:23:02.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:23:02.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:23:02.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:23:02.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:23:02.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:23:02.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:23:02.107 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.107 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.107 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.108 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:02.108 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:02.108 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.973779987, 2024-04-26T10:23:02.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:23:02.108 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.108 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.108 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.108 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.108 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.108 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:23:02.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.108 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:02.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:02.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:02.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:23:02.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:23:02.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:23:02.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:23:02.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:23:02.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:23:02.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:23:02.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:23:02.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:23:02.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:23:02.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:02.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:23:02.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:23:02.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:23:02.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:23:02.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:23:02.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:23:02.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:23:02.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:23:02.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:23:02.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:23:02.115 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.115 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.115 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.115 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:02.115 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:02.115 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.962901882000001, 2024-04-26T10:23:02.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:23:02.115 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.115 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.115 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.116 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.116 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.116 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:23:02.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.116 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:02.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:02.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:23:02.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:02.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:23:02.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:23:02.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:23:02.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:23:02.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:23:02.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:23:02.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:23:02.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:23:02.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:23:02.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:23:02.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:02.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:23:02.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:23:02.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:23:02.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:23:02.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:23:02.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:23:02.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:23:02.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:23:02.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:23:02.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:23:02.120 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.120 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.120 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.121 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:02.121 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:02.121 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.960220663000001, 2024-04-26T10:23:02.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:23:02.121 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.121 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.121 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.121 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.121 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.121 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:23:02.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.121 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:02.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:02.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:23:02.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:02.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:23:02.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:23:02.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:23:02.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:23:02.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:23:02.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:23:02.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:23:02.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:23:02.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:23:02.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:23:02.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:02.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:23:02.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:23:02.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:23:02.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:23:02.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:23:02.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:23:02.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:23:02.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:23:02.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:23:02.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:23:02.126 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.126 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.126 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.126 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:02.126 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:02.126 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.959853588000001, 2024-04-26T10:23:02.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:23:02.126 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.126 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.127 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.127 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.127 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.127 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:23:02.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.127 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:02.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:02.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:23:02.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:23:02.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:23:02.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:23:02.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:23:02.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:23:02.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:23:02.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:23:02.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:23:02.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:23:02.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:23:02.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:23:02.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:23:02.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:23:02.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:23:02.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:23:02.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:23:02.131 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.131 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.131 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.131 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:02.131 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:02.131 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.959789336, 2024-04-26T10:23:02.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:23:02.131 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.131 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.132 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.132 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.132 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.132 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:23:02.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.132 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:02.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:02.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:23:02.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:23:02.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:23:02.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:23:02.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:23:02.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:23:02.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:23:02.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:23:02.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:23:02.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:23:02.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:23:02.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:23:02.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:23:02.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:23:02.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:23:02.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:23:02.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:23:02.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.136 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.136 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:02.136 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:02.136 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.955390662999999, 2024-04-26T10:23:02.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:23:02.136 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.136 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.136 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.136 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.136 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.137 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:23:02.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.137 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:02.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:02.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:23:02.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:23:02.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:23:02.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:23:02.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:23:02.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:23:02.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:23:02.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:23:02.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:23:02.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:23:02.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:23:02.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:23:02.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:23:02.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:23:02.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:23:02.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:23:02.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:23:02.140 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.141 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.141 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.141 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:02.141 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:02.141 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 30.953632679999998, 2024-04-26T10:23:02.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:23:02.141 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.141 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.141 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:23:02.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.142 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:02.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:02.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:23:02.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:23:02.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:23:02.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:23:02.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:23:02.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:23:02.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:23:02.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:23:02.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:23:02.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:23:02.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:23:02.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:02.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:23:02.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:23:02.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:23:02.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:23:02.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:23:02.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:23:02.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:02.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:23:02.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:23:02.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:02.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:23:02.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:23:02.146 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.146 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.146 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.146 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.146 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.146 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:02.148 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:02.146+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:02.148 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:02.248 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:02.243+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:02.282 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:02.282 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:02.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.282 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:194031 5.5 5:a90fdddd:::benchmark_data_smithi052_19421_object64559:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.282 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:02.276016+0000", 2024-04-26T10:23:02.282 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0040707360000000001, 2024-04-26T10:23:02.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040980820000000003, 2024-04-26T10:23:02.282 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.282 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:02.283 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.283 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.283 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.283 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 194031 2024-04-26T10:23:02.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.283 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276016+0000", 2024-04-26T10:23:02.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276016+0000", 2024-04-26T10:23:02.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276015+0000", 2024-04-26T10:23:02.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276020+0000", 2024-04-26T10:23:02.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8670000000000002e-06 2024-04-26T10:23:02.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276031+0000", 2024-04-26T10:23:02.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0644e-05 2024-04-26T10:23:02.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276038+0000", 2024-04-26T10:23:02.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.097e-06 2024-04-26T10:23:02.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276066+0000", 2024-04-26T10:23:02.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8541999999999999e-05 2024-04-26T10:23:02.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276137+0000", 2024-04-26T10:23:02.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1072e-05 2024-04-26T10:23:02.286 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.286 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.286 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.286 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:194032 5.1 5:8e894085:::benchmark_data_smithi052_19421_object64560:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.286 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:02.276116+0000", 2024-04-26T10:23:02.286 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0039706790000000004, 2024-04-26T10:23:02.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040509960000000003, 2024-04-26T10:23:02.286 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.286 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:02.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.286 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 194032 2024-04-26T10:23:02.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.287 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276116+0000", 2024-04-26T10:23:02.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276116+0000", 2024-04-26T10:23:02.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276115+0000", 2024-04-26T10:23:02.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276120+0000", 2024-04-26T10:23:02.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4109999999999998e-06 2024-04-26T10:23:02.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276133+0000", 2024-04-26T10:23:02.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3551e-05 2024-04-26T10:23:02.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276141+0000", 2024-04-26T10:23:02.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3520000000000001e-06 2024-04-26T10:23:02.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276492+0000", 2024-04-26T10:23:02.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035109200000000001 2024-04-26T10:23:02.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276645+0000", 2024-04-26T10:23:02.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015312799999999999 2024-04-26T10:23:02.289 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.289 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.290 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.290 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:194033 5.c 5:39d9a1ac:::benchmark_data_smithi052_19421_object64561:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.290 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:02.276157+0000", 2024-04-26T10:23:02.290 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0039294439999999998, 2024-04-26T10:23:02.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040559359999999996, 2024-04-26T10:23:02.290 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.290 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:02.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.290 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 194033 2024-04-26T10:23:02.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.291 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276157+0000", 2024-04-26T10:23:02.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276157+0000", 2024-04-26T10:23:02.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276157+0000", 2024-04-26T10:23:02.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276161+0000", 2024-04-26T10:23:02.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.794e-06 2024-04-26T10:23:02.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276168+0000", 2024-04-26T10:23:02.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7589999999999997e-06 2024-04-26T10:23:02.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276174+0000", 2024-04-26T10:23:02.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3669999999999996e-06 2024-04-26T10:23:02.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276221+0000", 2024-04-26T10:23:02.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7413999999999997e-05 2024-04-26T10:23:02.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276343+0000", 2024-04-26T10:23:02.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121654 2024-04-26T10:23:02.293 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.293 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.293 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.293 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:194028 5.b e59/37 5:dac8eb60:::benchmark_data_smithi052_19421_object64556:head v 59'12010, mlcod=59'12008)", 2024-04-26T10:23:02.294 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:02.276229+0000", 2024-04-26T10:23:02.294 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0038578190000000002, 2024-04-26T10:23:02.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040345249999999997, 2024-04-26T10:23:02.294 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.294 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:02.294 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276229+0000", 2024-04-26T10:23:02.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276229+0000", 2024-04-26T10:23:02.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276229+0000", 2024-04-26T10:23:02.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276233+0000", 2024-04-26T10:23:02.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5959999999999997e-06 2024-04-26T10:23:02.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276240+0000", 2024-04-26T10:23:02.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2310000000000001e-06 2024-04-26T10:23:02.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276245+0000", 2024-04-26T10:23:02.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6779999999999997e-06 2024-04-26T10:23:02.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276285+0000", 2024-04-26T10:23:02.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9496000000000003e-05 2024-04-26T10:23:02.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276305+0000", 2024-04-26T10:23:02.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0701000000000001e-05 2024-04-26T10:23:02.297 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.297 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.297 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.297 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:194034 5.b e59/37 5:dfd63d1f:::benchmark_data_smithi052_19421_object64562:head v 59'12011, mlcod=59'12008)", 2024-04-26T10:23:02.297 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:02.278059+0000", 2024-04-26T10:23:02.297 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002027849, 2024-04-26T10:23:02.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002251978, 2024-04-26T10:23:02.297 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.297 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:02.297 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278059+0000", 2024-04-26T10:23:02.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278059+0000", 2024-04-26T10:23:02.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278058+0000", 2024-04-26T10:23:02.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:02.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278069+0000", 2024-04-26T10:23:02.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1368e-05 2024-04-26T10:23:02.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278082+0000", 2024-04-26T10:23:02.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2914e-05 2024-04-26T10:23:02.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278088+0000", 2024-04-26T10:23:02.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7729999999999996e-06 2024-04-26T10:23:02.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278359+0000", 2024-04-26T10:23:02.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000271205 2024-04-26T10:23:02.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278379+0000", 2024-04-26T10:23:02.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9850000000000001e-05 2024-04-26T10:23:02.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.300 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.300 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.300 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:194035 5.2 5:4ec4b951:::benchmark_data_smithi052_19421_object64563:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.301 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:02.278149+0000", 2024-04-26T10:23:02.301 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0019375359999999999, 2024-04-26T10:23:02.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022183300000000001, 2024-04-26T10:23:02.301 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.301 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:02.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.301 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.301 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 194035 2024-04-26T10:23:02.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.301 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278149+0000", 2024-04-26T10:23:02.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278149+0000", 2024-04-26T10:23:02.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278149+0000", 2024-04-26T10:23:02.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278152+0000", 2024-04-26T10:23:02.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2559999999999998e-06 2024-04-26T10:23:02.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278160+0000", 2024-04-26T10:23:02.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9759999999999995e-06 2024-04-26T10:23:02.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278164+0000", 2024-04-26T10:23:02.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.721e-06 2024-04-26T10:23:02.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278218+0000", 2024-04-26T10:23:02.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4027999999999998e-05 2024-04-26T10:23:02.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278347+0000", 2024-04-26T10:23:02.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012962600000000001 2024-04-26T10:23:02.304 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.304 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.304 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.304 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:194037 5.d 5:bda15264:::benchmark_data_smithi052_19421_object64565:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.304 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:02.278543+0000", 2024-04-26T10:23:02.305 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0015437370000000001, 2024-04-26T10:23:02.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001887742, 2024-04-26T10:23:02.305 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.305 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:02.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.305 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.305 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 194037 2024-04-26T10:23:02.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.305 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278543+0000", 2024-04-26T10:23:02.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278543+0000", 2024-04-26T10:23:02.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278542+0000", 2024-04-26T10:23:02.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278547+0000", 2024-04-26T10:23:02.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.707e-06 2024-04-26T10:23:02.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278554+0000", 2024-04-26T10:23:02.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.401e-06 2024-04-26T10:23:02.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278560+0000", 2024-04-26T10:23:02.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1449999999999999e-06 2024-04-26T10:23:02.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278604+0000", 2024-04-26T10:23:02.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4299999999999999e-05 2024-04-26T10:23:02.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278721+0000", 2024-04-26T10:23:02.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116737 2024-04-26T10:23:02.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278822+0000", 2024-04-26T10:23:02.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010156499999999999 2024-04-26T10:23:02.308 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.308 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.308 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.309 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:194038 5.3 5:c3649760:::benchmark_data_smithi052_19421_object64566:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.309 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:02.278571+0000", 2024-04-26T10:23:02.309 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001516075, 2024-04-26T10:23:02.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019317889999999999, 2024-04-26T10:23:02.309 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.309 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:02.309 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.309 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.309 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.309 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 194038 2024-04-26T10:23:02.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.309 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278571+0000", 2024-04-26T10:23:02.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278571+0000", 2024-04-26T10:23:02.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278570+0000", 2024-04-26T10:23:02.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278574+0000", 2024-04-26T10:23:02.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2780000000000002e-06 2024-04-26T10:23:02.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278580+0000", 2024-04-26T10:23:02.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3960000000000003e-06 2024-04-26T10:23:02.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278583+0000", 2024-04-26T10:23:02.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.365e-06 2024-04-26T10:23:02.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278665+0000", 2024-04-26T10:23:02.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1676999999999997e-05 2024-04-26T10:23:02.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278751+0000", 2024-04-26T10:23:02.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5722000000000004e-05 2024-04-26T10:23:02.312 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.312 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.312 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.312 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:194039 5.3 5.14d41673 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.312 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:02.278625+0000", 2024-04-26T10:23:02.312 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0014620729999999999, 2024-04-26T10:23:02.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019389520000000001, 2024-04-26T10:23:02.313 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.313 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:02.313 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.313 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.313 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.313 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 194039 2024-04-26T10:23:02.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.313 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278625+0000", 2024-04-26T10:23:02.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278625+0000", 2024-04-26T10:23:02.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278624+0000", 2024-04-26T10:23:02.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278628+0000", 2024-04-26T10:23:02.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7529999999999999e-06 2024-04-26T10:23:02.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278633+0000", 2024-04-26T10:23:02.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.524e-06 2024-04-26T10:23:02.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278637+0000", 2024-04-26T10:23:02.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0459999999999999e-06 2024-04-26T10:23:02.315 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.315 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.315 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.315 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:194040 5.9 5:993648e9:::benchmark_data_smithi052_19421_object64568:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.316 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:02.278793+0000", 2024-04-26T10:23:02.316 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001293401, 2024-04-26T10:23:02.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001822845, 2024-04-26T10:23:02.316 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.316 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:02.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.316 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 194040 2024-04-26T10:23:02.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.316 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278793+0000", 2024-04-26T10:23:02.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278793+0000", 2024-04-26T10:23:02.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278792+0000", 2024-04-26T10:23:02.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278799+0000", 2024-04-26T10:23:02.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1079999999999998e-06 2024-04-26T10:23:02.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278809+0000", 2024-04-26T10:23:02.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0397999999999999e-05 2024-04-26T10:23:02.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278816+0000", 2024-04-26T10:23:02.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1169999999999998e-06 2024-04-26T10:23:02.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278858+0000", 2024-04-26T10:23:02.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2015999999999999e-05 2024-04-26T10:23:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.279000+0000", 2024-04-26T10:23:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014183500000000001 2024-04-26T10:23:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.279104+0000", 2024-04-26T10:23:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104014 2024-04-26T10:23:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.320 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:194036 5.4 e59/37 5:2f72815e:::benchmark_data_smithi052_19421_object64564:head v 59'12258, mlcod=59'12256)", 2024-04-26T10:23:02.320 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:02.278884+0000", 2024-04-26T10:23:02.320 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0012033230000000001, 2024-04-26T10:23:02.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001796927, 2024-04-26T10:23:02.320 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.320 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:02.320 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278884+0000", 2024-04-26T10:23:02.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278884+0000", 2024-04-26T10:23:02.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278883+0000", 2024-04-26T10:23:02.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278889+0000", 2024-04-26T10:23:02.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7459999999999997e-06 2024-04-26T10:23:02.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278907+0000", 2024-04-26T10:23:02.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7767000000000001e-05 2024-04-26T10:23:02.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278913+0000", 2024-04-26T10:23:02.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1530000000000002e-06 2024-04-26T10:23:02.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278976+0000", 2024-04-26T10:23:02.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3689000000000006e-05 2024-04-26T10:23:02.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278994+0000", 2024-04-26T10:23:02.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7428999999999999e-05 2024-04-26T10:23:02.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.323 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.323 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.323 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:194021 5.5 5:a5696b83:::benchmark_data_smithi052_19421_object64549:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.323 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:02.272276+0000", 2024-04-26T10:23:02.323 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0078107999999999997, 2024-04-26T10:23:02.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0084648589999999999, 2024-04-26T10:23:02.323 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.323 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:02.323 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.323 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.324 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.324 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 194021 2024-04-26T10:23:02.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.324 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.272276+0000", 2024-04-26T10:23:02.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.272276+0000", 2024-04-26T10:23:02.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.272276+0000", 2024-04-26T10:23:02.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-04-26T10:23:02.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.272278+0000", 2024-04-26T10:23:02.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.9e-06 2024-04-26T10:23:02.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.272281+0000", 2024-04-26T10:23:02.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1549999999999999e-06 2024-04-26T10:23:02.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.272284+0000", 2024-04-26T10:23:02.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6520000000000002e-06 2024-04-26T10:23:02.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.273968+0000", 2024-04-26T10:23:02.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016848500000000001 2024-04-26T10:23:02.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.274125+0000", 2024-04-26T10:23:02.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000156265 2024-04-26T10:23:02.326 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.327 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.327 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.327 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:194022 5.d 5:bfb31b05:::benchmark_data_smithi052_19421_object64550:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.327 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:02.272289+0000", 2024-04-26T10:23:02.327 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0077979490000000002, 2024-04-26T10:23:02.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0085172289999999994, 2024-04-26T10:23:02.327 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.327 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:02.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.327 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.327 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 194022 2024-04-26T10:23:02.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.328 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.272289+0000", 2024-04-26T10:23:02.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.272289+0000", 2024-04-26T10:23:02.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.272288+0000", 2024-04-26T10:23:02.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.272291+0000", 2024-04-26T10:23:02.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5450000000000002e-06 2024-04-26T10:23:02.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.272297+0000", 2024-04-26T10:23:02.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7479999999999999e-06 2024-04-26T10:23:02.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.272303+0000", 2024-04-26T10:23:02.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0299999999999999e-06 2024-04-26T10:23:02.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.273953+0000", 2024-04-26T10:23:02.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016499049999999999 2024-04-26T10:23:02.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.274122+0000", 2024-04-26T10:23:02.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016938700000000001 2024-04-26T10:23:02.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.274235+0000", 2024-04-26T10:23:02.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011256699999999999 2024-04-26T10:23:02.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278154+0000", 2024-04-26T10:23:02.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039196780000000002 2024-04-26T10:23:02.331 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.331 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.331 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.331 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:194027 5.3 5:c4b54c09:::benchmark_data_smithi052_19421_object64555:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.331 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:02.273422+0000", 2024-04-26T10:23:02.332 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0066651000000000002, 2024-04-26T10:23:02.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007456308, 2024-04-26T10:23:02.332 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.332 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:02.332 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.332 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.332 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.332 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 194027 2024-04-26T10:23:02.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.332 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.273422+0000", 2024-04-26T10:23:02.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.273422+0000", 2024-04-26T10:23:02.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.273421+0000", 2024-04-26T10:23:02.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.273426+0000", 2024-04-26T10:23:02.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2970000000000003e-06 2024-04-26T10:23:02.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.273435+0000", 2024-04-26T10:23:02.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2650000000000002e-06 2024-04-26T10:23:02.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.273442+0000", 2024-04-26T10:23:02.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.939e-06 2024-04-26T10:23:02.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.273485+0000", 2024-04-26T10:23:02.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2703000000000001e-05 2024-04-26T10:23:02.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.273621+0000", 2024-04-26T10:23:02.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013607499999999999 2024-04-26T10:23:02.335 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.335 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.335 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.335 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:194029 5.d 5:b0bc392b:::benchmark_data_smithi052_19421_object64557:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.335 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:02.275672+0000", 2024-04-26T10:23:02.335 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.004414963, 2024-04-26T10:23:02.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052742880000000002, 2024-04-26T10:23:02.335 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.335 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:02.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.336 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.336 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.336 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 194029 2024-04-26T10:23:02.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.336 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.275672+0000", 2024-04-26T10:23:02.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.275672+0000", 2024-04-26T10:23:02.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.275671+0000", 2024-04-26T10:23:02.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.275677+0000", 2024-04-26T10:23:02.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2079999999999997e-06 2024-04-26T10:23:02.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.275693+0000", 2024-04-26T10:23:02.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5574999999999999e-05 2024-04-26T10:23:02.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.275706+0000", 2024-04-26T10:23:02.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2931e-05 2024-04-26T10:23:02.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.275895+0000", 2024-04-26T10:23:02.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000189524 2024-04-26T10:23:02.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.275972+0000", 2024-04-26T10:23:02.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7045999999999994e-05 2024-04-26T10:23:02.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.276052+0000", 2024-04-26T10:23:02.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0139e-05 2024-04-26T10:23:02.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:02.278190+0000", 2024-04-26T10:23:02.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021377879999999998 2024-04-26T10:23:02.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.339 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.339 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:23:02.339 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 15 2024-04-26T10:23:02.339 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:02.340 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:02.350 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:02.343+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:02.450 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:02.447+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:02.474 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:02.474 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:02.474 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:23:02.474 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:23:02.474 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:02.487 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:02.551 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:02.550+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:02.652 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:02.650+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:02.657 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:02.657 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:23:02.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:23:02.657 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:02.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.657 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:02.657 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:02.657 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.615304254000002, 2024-04-26T10:23:02.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:23:02.657 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.657 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.658 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.658 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.658 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:23:02.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.658 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:02.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:02.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:02.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:23:02.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:23:02.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:23:02.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:23:02.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:23:02.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:23:02.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:23:02.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:23:02.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:23:02.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:23:02.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:23:02.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:23:02.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:23:02.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:23:02.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:23:02.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:23:02.661 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.662 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.662 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.662 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:02.662 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:02.662 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.615195002999997, 2024-04-26T10:23:02.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:23:02.662 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.662 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.662 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.662 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.662 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.662 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:23:02.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.663 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:02.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:02.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:02.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:23:02.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:23:02.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:23:02.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:23:02.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:23:02.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:23:02.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:23:02.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:23:02.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:23:02.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:23:02.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:23:02.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:23:02.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:23:02.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:23:02.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:23:02.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:23:02.666 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.666 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.666 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.667 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:02.667 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:02.667 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.612797591000003, 2024-04-26T10:23:02.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:23:02.667 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.667 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.667 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:23:02.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.667 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:02.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:02.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:23:02.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:02.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:23:02.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:23:02.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:23:02.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:23:02.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:23:02.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:23:02.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:23:02.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:23:02.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:23:02.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:23:02.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:23:02.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:23:02.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:23:02.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:23:02.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:23:02.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:23:02.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:23:02.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:23:02.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:23:02.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:23:02.672 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.672 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.672 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.672 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:02.672 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:02.672 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 38.612611667000003, 2024-04-26T10:23:02.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:23:02.672 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.672 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.673 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:23:02.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.673 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:02.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:02.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:23:02.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:23:02.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:23:02.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:23:02.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:23:02.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:23:02.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:23:02.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:23:02.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:23:02.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:23:02.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:23:02.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:23:02.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:23:02.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:23:02.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:23:02.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:23:02.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:23:02.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:23:02.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:23:02.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:23:02.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:23:02.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.677 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.677 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:02.678 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:02.678 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.522589051000001, 2024-04-26T10:23:02.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:23:02.678 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.678 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.678 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.678 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.678 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.678 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:23:02.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.678 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:02.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:02.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:02.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:23:02.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:23:02.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:23:02.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:23:02.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:23:02.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:23:02.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:23:02.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:23:02.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:02.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:23:02.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:23:02.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:23:02.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:23:02.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:23:02.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:23:02.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:23:02.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:23:02.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:23:02.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:23:02.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:23:02.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:23:02.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:23:02.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:23:02.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:23:02.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:23:02.683 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.683 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.683 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.684 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:02.684 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:02.684 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.499486805, 2024-04-26T10:23:02.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:23:02.684 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.684 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.684 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.684 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.684 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.684 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:23:02.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.684 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:02.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:02.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:23:02.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:02.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:23:02.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:23:02.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:23:02.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:23:02.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:23:02.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:23:02.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:23:02.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:23:02.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:02.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:23:02.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:23:02.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:23:02.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:23:02.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:23:02.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:23:02.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:23:02.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:23:02.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:23:02.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:23:02.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:23:02.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:23:02.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:23:02.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:23:02.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:23:02.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:23:02.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.690 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.690 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.690 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:02.690 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:02.690 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.492803667, 2024-04-26T10:23:02.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:23:02.690 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.690 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.690 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:23:02.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.691 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:02.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:02.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:23:02.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:23:02.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:23:02.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:23:02.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:23:02.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:23:02.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:23:02.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:23:02.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:23:02.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:02.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:23:02.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:23:02.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:23:02.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:23:02.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:23:02.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:23:02.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:23:02.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:23:02.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:23:02.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:23:02.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:23:02.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:23:02.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:23:02.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:23:02.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:23:02.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:23:02.695 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.696 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.696 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.696 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:02.696 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:02.696 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.490805882, 2024-04-26T10:23:02.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:23:02.696 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.696 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.696 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:23:02.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.697 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:02.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:02.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:23:02.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:02.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:23:02.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:23:02.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:23:02.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:23:02.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:23:02.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:23:02.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:23:02.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:23:02.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:02.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:23:02.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:02.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:23:02.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:23:02.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:23:02.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:23:02.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:23:02.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:23:02.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:23:02.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:23:02.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:23:02.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:23:02.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:23:02.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:23:02.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:23:02.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:23:02.702 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.702 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.702 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.702 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:02.702 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:02.702 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.481397177, 2024-04-26T10:23:02.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:23:02.702 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.702 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.703 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.703 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:23:02.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.703 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:02.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:02.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:23:02.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:23:02.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:23:02.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:23:02.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:02.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:23:02.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:23:02.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:23:02.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:23:02.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:02.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:23:02.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:23:02.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:23:02.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:23:02.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:23:02.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:23:02.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:23:02.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:23:02.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:23:02.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:23:02.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:23:02.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:23:02.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:23:02.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:23:02.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:23:02.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:23:02.708 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.708 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.708 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.708 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:02.708 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:02.708 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.479569128, 2024-04-26T10:23:02.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:23:02.708 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.708 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.709 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.709 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.709 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:23:02.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.709 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:02.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:02.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:23:02.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:23:02.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:23:02.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:23:02.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:23:02.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:23:02.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:23:02.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:23:02.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:23:02.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:02.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:23:02.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:23:02.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:23:02.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:23:02.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:23:02.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:23:02.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:23:02.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:23:02.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:23:02.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:23:02.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:23:02.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:23:02.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:23:02.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:23:02.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:23:02.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:23:02.714 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.714 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.714 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.714 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:02.714 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:02.714 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.467989405999999, 2024-04-26T10:23:02.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:23:02.715 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.715 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.715 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.715 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.715 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.715 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:23:02.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.715 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:02.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:02.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:02.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:23:02.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:23:02.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:23:02.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:23:02.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:23:02.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:23:02.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:23:02.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:23:02.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:02.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:23:02.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:23:02.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:23:02.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:23:02.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:23:02.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:23:02.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:23:02.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:23:02.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:23:02.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:23:02.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:23:02.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:23:02.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:23:02.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:23:02.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:23:02.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:23:02.722 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.722 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.722 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.723 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:02.723 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:02.723 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.461578912, 2024-04-26T10:23:02.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:23:02.723 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.723 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.723 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:23:02.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.723 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:02.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:02.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:23:02.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:23:02.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:23:02.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:23:02.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:23:02.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:23:02.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:02.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:23:02.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:23:02.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:02.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:23:02.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:23:02.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:23:02.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:23:02.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:23:02.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:23:02.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:23:02.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:23:02.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:23:02.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:23:02.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:23:02.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:23:02.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:23:02.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:23:02.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:23:02.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:23:02.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.728 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.729 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.729 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:02.729 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:02.729 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.448993849000001, 2024-04-26T10:23:02.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:23:02.729 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.729 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.729 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:23:02.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.729 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:02.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:02.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:23:02.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:23:02.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:02.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:23:02.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:23:02.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:23:02.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:23:02.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:23:02.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:23:02.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:02.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:23:02.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:02.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:23:02.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:23:02.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:23:02.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:23:02.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:23:02.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:23:02.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:23:02.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:23:02.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:23:02.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:23:02.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:23:02.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:23:02.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:23:02.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:23:02.734 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.735 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.735 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.735 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:02.735 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:02.735 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.448758915999999, 2024-04-26T10:23:02.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:23:02.735 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.735 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.735 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.735 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.735 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.735 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:23:02.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.736 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:02.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:02.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:23:02.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:23:02.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:23:02.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:23:02.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:23:02.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:23:02.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:23:02.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:23:02.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:23:02.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:02.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:23:02.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:02.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:23:02.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:23:02.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:23:02.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:23:02.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:23:02.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:23:02.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:23:02.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:23:02.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:23:02.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:23:02.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:23:02.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:23:02.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:23:02.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:23:02.741 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.741 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.741 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.741 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:02.741 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:02.741 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.410884039000001, 2024-04-26T10:23:02.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:23:02.741 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.741 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.741 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.742 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.742 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.742 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:23:02.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.742 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:02.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:02.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:23:02.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:02.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:23:02.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:23:02.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:23:02.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:23:02.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:23:02.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:23:02.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:23:02.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:23:02.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:02.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:23:02.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:02.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:23:02.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:23:02.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:23:02.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:23:02.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:23:02.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:23:02.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:23:02.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:23:02.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:23:02.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:23:02.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:23:02.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:23:02.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:23:02.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:23:02.747 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.747 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.747 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.747 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:02.747 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:02.747 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.410439014, 2024-04-26T10:23:02.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:23:02.748 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.748 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.748 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:23:02.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.748 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:02.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:02.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:23:02.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:23:02.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:23:02.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:23:02.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:23:02.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:23:02.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:23:02.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:23:02.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:23:02.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:02.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:23:02.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:23:02.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:23:02.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:23:02.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:23:02.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:23:02.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:23:02.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:23:02.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:23:02.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:23:02.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:23:02.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:23:02.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:23:02.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:23:02.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:23:02.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:23:02.753 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.753 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.753 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.753 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:02.754 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:02.754 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.398836014, 2024-04-26T10:23:02.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:23:02.754 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.754 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.754 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.754 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.754 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.754 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:23:02.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.754 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:02.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:02.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:23:02.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:02.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:23:02.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:23:02.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:23:02.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:23:02.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:23:02.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:23:02.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:23:02.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:23:02.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:02.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:23:02.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:23:02.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:23:02.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:23:02.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:23:02.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:23:02.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:23:02.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:23:02.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:23:02.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:23:02.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:23:02.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:23:02.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:23:02.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:23:02.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:23:02.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:23:02.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.760 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.760 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.760 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:02.760 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:02.760 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.397562424, 2024-04-26T10:23:02.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:23:02.760 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.760 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.760 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.761 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:23:02.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.761 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:02.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:02.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:23:02.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:23:02.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:23:02.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:23:02.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:23:02.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:23:02.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:23:02.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:23:02.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:23:02.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:02.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:23:02.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:23:02.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:23:02.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:23:02.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:23:02.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:23:02.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:23:02.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:23:02.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:23:02.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:23:02.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:23:02.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:23:02.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:23:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:23:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:23:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:23:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:02.766 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.380805123, 2024-04-26T10:23:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:23:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:23:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:23:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:23:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:23:02.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:23:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:23:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:23:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:23:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:23:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:23:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:02.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:23:02.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:23:02.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:23:02.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:23:02.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:23:02.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:23:02.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:23:02.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:23:02.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:23:02.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:23:02.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:23:02.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:23:02.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:23:02.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:23:02.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:23:02.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:23:02.772 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.772 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.772 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.772 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:02.773 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:02.773 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 13.335893102, 2024-04-26T10:23:02.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:23:02.773 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:02.773 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:02.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:02.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:02.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.773 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:23:02.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.773 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:02.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:02.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:02.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:02.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:02.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:02.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:02.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:23:02.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:02.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:23:02.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:23:02.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:02.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:23:02.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:23:02.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:23:02.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:23:02.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:23:02.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:23:02.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:02.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:23:02.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:23:02.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:02.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:23:02.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:23:02.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:02.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:23:02.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:23:02.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:02.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:23:02.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:23:02.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:02.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:23:02.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:23:02.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:02.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:23:02.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:23:02.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:02.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:23:02.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:23:02.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:02.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:02.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:02.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:23:02.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:23:02.778 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.779 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.779 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.779 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:02.779 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:02.779 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:02.780 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:02.781 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:02.778+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:02.881 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:02.875+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:02.910 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:02.910 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:02.911 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.911 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:195433 5.b 5:d31d5e2d:::benchmark_data_smithi052_19421_object65961:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.911 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:02.901694+0000", 2024-04-26T10:23:02.911 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0089874970000000005, 2024-04-26T10:23:02.911 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0090048330000000003, 2024-04-26T10:23:02.911 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.911 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:02.911 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.911 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.911 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.911 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 195433 2024-04-26T10:23:02.911 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.912 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.901694+0000", 2024-04-26T10:23:02.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.901694+0000", 2024-04-26T10:23:02.912 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.912 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.912 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.912 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.912 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.901693+0000", 2024-04-26T10:23:02.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.901701+0000", 2024-04-26T10:23:02.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:02.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.913 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.913 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.901711+0000", 2024-04-26T10:23:02.913 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0158e-05 2024-04-26T10:23:02.913 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.913 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.901718+0000", 2024-04-26T10:23:02.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0419999999999997e-06 2024-04-26T10:23:02.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.901841+0000", 2024-04-26T10:23:02.914 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012274200000000001 2024-04-26T10:23:02.914 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.914 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.914 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.914 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.901913+0000", 2024-04-26T10:23:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2700000000000005e-05 2024-04-26T10:23:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.901976+0000", 2024-04-26T10:23:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3096999999999996e-05 2024-04-26T10:23:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.908787+0000", 2024-04-26T10:23:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0068109520000000003 2024-04-26T10:23:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.915 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:195437 5.b 5:dde73a57:::benchmark_data_smithi052_19421_object65965:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:02.902085+0000", 2024-04-26T10:23:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0085964270000000002, 2024-04-26T10:23:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086608469999999993, 2024-04-26T10:23:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 195437 2024-04-26T10:23:02.916 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.902085+0000", 2024-04-26T10:23:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.902085+0000", 2024-04-26T10:23:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.917 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.902084+0000", 2024-04-26T10:23:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.902089+0000", 2024-04-26T10:23:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2449999999999998e-06 2024-04-26T10:23:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.902099+0000", 2024-04-26T10:23:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3929999999999997e-06 2024-04-26T10:23:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.918 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.902106+0000", 2024-04-26T10:23:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7569999999999998e-06 2024-04-26T10:23:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.904016+0000", 2024-04-26T10:23:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001910122 2024-04-26T10:23:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.904091+0000", 2024-04-26T10:23:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5575999999999996e-05 2024-04-26T10:23:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.919 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.904159+0000", 2024-04-26T10:23:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7858e-05 2024-04-26T10:23:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.908794+0000", 2024-04-26T10:23:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0046350660000000002 2024-04-26T10:23:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.920 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:195443 5.b 5:dd45e9fa:::benchmark_data_smithi052_19421_object65971:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:02.904586+0000", 2024-04-26T10:23:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0060958890000000002, 2024-04-26T10:23:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0062009769999999999, 2024-04-26T10:23:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 195443 2024-04-26T10:23:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.921 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.904586+0000", 2024-04-26T10:23:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.904586+0000", 2024-04-26T10:23:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.904585+0000", 2024-04-26T10:23:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.922 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.904589+0000", 2024-04-26T10:23:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.608e-06 2024-04-26T10:23:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.904604+0000", 2024-04-26T10:23:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5308999999999999e-05 2024-04-26T10:23:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.904610+0000", 2024-04-26T10:23:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3119999999999999e-06 2024-04-26T10:23:02.923 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.905651+0000", 2024-04-26T10:23:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001040935 2024-04-26T10:23:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.905847+0000", 2024-04-26T10:23:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019619400000000001 2024-04-26T10:23:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.906007+0000", 2024-04-26T10:23:02.924 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015969500000000001 2024-04-26T10:23:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.908800+0000", 2024-04-26T10:23:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0027930260000000001 2024-04-26T10:23:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:195448 5.e 5:714f33b5:::benchmark_data_smithi052_19421_object65976:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:02.907124+0000", 2024-04-26T10:23:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0035570810000000001, 2024-04-26T10:23:02.925 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003702346, 2024-04-26T10:23:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 195448 2024-04-26T10:23:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907124+0000", 2024-04-26T10:23:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.926 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907124+0000", 2024-04-26T10:23:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907123+0000", 2024-04-26T10:23:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907130+0000", 2024-04-26T10:23:02.927 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6359999999999997e-06 2024-04-26T10:23:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907139+0000", 2024-04-26T10:23:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6139999999999998e-06 2024-04-26T10:23:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907148+0000", 2024-04-26T10:23:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3389999999999993e-06 2024-04-26T10:23:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907196+0000", 2024-04-26T10:23:02.928 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7772999999999998e-05 2024-04-26T10:23:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907293+0000", 2024-04-26T10:23:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7411000000000006e-05 2024-04-26T10:23:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:195449 5.b 5:d90783ab:::benchmark_data_smithi052_19421_object65977:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:02.907177+0000", 2024-04-26T10:23:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0035039889999999999, 2024-04-26T10:23:02.929 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0037101040000000001, 2024-04-26T10:23:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 195449 2024-04-26T10:23:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907177+0000", 2024-04-26T10:23:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.930 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.931 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907177+0000", 2024-04-26T10:23:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.933 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907177+0000", 2024-04-26T10:23:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907185+0000", 2024-04-26T10:23:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9729999999999997e-06 2024-04-26T10:23:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907195+0000", 2024-04-26T10:23:02.934 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8460000000000003e-06 2024-04-26T10:23:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907203+0000", 2024-04-26T10:23:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5809999999999997e-06 2024-04-26T10:23:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907271+0000", 2024-04-26T10:23:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8217000000000001e-05 2024-04-26T10:23:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.935 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907381+0000", 2024-04-26T10:23:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109337 2024-04-26T10:23:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907460+0000", 2024-04-26T10:23:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9140000000000005e-05 2024-04-26T10:23:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.909150+0000", 2024-04-26T10:23:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016900509999999999 2024-04-26T10:23:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.936 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:195450 5.0 e59/54 5:02d06f02:::benchmark_data_smithi052_19421_object65978:head v 59'12194, mlcod=59'12192)", 2024-04-26T10:23:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:02.907817+0000", 2024-04-26T10:23:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0028640509999999998, 2024-04-26T10:23:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031088829999999998, 2024-04-26T10:23:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907817+0000", 2024-04-26T10:23:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.937 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907817+0000", 2024-04-26T10:23:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907817+0000", 2024-04-26T10:23:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907822+0000", 2024-04-26T10:23:02.938 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4090000000000002e-06 2024-04-26T10:23:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907834+0000", 2024-04-26T10:23:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1528999999999999e-05 2024-04-26T10:23:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907840+0000", 2024-04-26T10:23:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9380000000000003e-06 2024-04-26T10:23:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907891+0000", 2024-04-26T10:23:02.939 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0498000000000003e-05 2024-04-26T10:23:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.907919+0000", 2024-04-26T10:23:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7809000000000001e-05 2024-04-26T10:23:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:195454 5.e 5:72d232ea:::benchmark_data_smithi052_19421_object65982:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:02.909947+0000", 2024-04-26T10:23:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00073494399999999996, 2024-04-26T10:23:02.940 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001009481, 2024-04-26T10:23:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 195454 2024-04-26T10:23:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.909947+0000", 2024-04-26T10:23:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.941 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.909947+0000", 2024-04-26T10:23:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.909946+0000", 2024-04-26T10:23:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.909951+0000", 2024-04-26T10:23:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4389999999999999e-06 2024-04-26T10:23:02.942 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.909962+0000", 2024-04-26T10:23:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0705e-05 2024-04-26T10:23:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.909968+0000", 2024-04-26T10:23:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8579999999999996e-06 2024-04-26T10:23:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.910020+0000", 2024-04-26T10:23:02.943 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2061000000000002e-05 2024-04-26T10:23:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.910157+0000", 2024-04-26T10:23:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013715299999999999 2024-04-26T10:23:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:195455 5.8 5:183b8087:::benchmark_data_smithi052_19421_object65983:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:02.909983+0000", 2024-04-26T10:23:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00069818899999999999, 2024-04-26T10:23:02.944 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010072449999999999, 2024-04-26T10:23:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 195455 2024-04-26T10:23:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.909983+0000", 2024-04-26T10:23:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.945 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.909983+0000", 2024-04-26T10:23:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.909983+0000", 2024-04-26T10:23:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.909986+0000", 2024-04-26T10:23:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1159999999999999e-06 2024-04-26T10:23:02.946 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.909993+0000", 2024-04-26T10:23:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6760000000000001e-06 2024-04-26T10:23:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.910000+0000", 2024-04-26T10:23:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6490000000000008e-06 2024-04-26T10:23:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.910054+0000", 2024-04-26T10:23:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3837e-05 2024-04-26T10:23:02.947 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:02.910185+0000", 2024-04-26T10:23:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013062300000000001 2024-04-26T10:23:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:23:02.948 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 8 2024-04-26T10:23:02.948 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:02.949 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:02.981 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:02.975+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:03.078 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:03.078 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:03.078 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:23:03.078 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:23:03.078 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:03.082 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:03.079+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:03.092 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:03.183 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:03.179+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:03.211 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:23:03.217 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:03.218 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:23:03.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:23:03.218 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:03.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.218 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:03.218 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:03.218 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.685489517000001, 2024-04-26T10:23:03.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:23:03.218 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.218 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.218 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:03.218 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:03.218 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.219 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:23:03.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.219 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:03.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:03.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:23:03.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:03.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:23:03.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:23:03.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:23:03.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:23:03.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:23:03.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:23:03.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:23:03.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:23:03.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:23:03.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:23:03.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:03.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:23:03.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:23:03.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:23:03.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:23:03.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:23:03.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:23:03.223 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.223 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.223 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.224 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:03.224 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:03.224 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.683507290000001, 2024-04-26T10:23:03.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:23:03.224 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.224 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.224 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:03.224 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:03.225 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.225 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:23:03.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.225 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:03.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:03.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:23:03.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:23:03.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:23:03.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:23:03.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:23:03.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:23:03.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:23:03.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:23:03.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:23:03.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:23:03.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:23:03.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:23:03.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:03.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:23:03.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:23:03.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:23:03.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:23:03.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:23:03.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:23:03.230 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.230 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.230 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.230 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:03.230 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:03.230 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.683307906000003, 2024-04-26T10:23:03.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:23:03.230 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.230 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.230 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:03.230 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:03.231 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.231 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:23:03.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.231 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:03.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:03.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:03.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:03.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:23:03.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:23:03.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:23:03.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:23:03.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:23:03.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:23:03.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:23:03.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:23:03.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:23:03.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:23:03.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:03.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:23:03.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:23:03.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:23:03.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:23:03.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:23:03.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:23:03.236 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.236 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.236 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.236 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:23:03.236 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:03.236 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.683089285999998, 2024-04-26T10:23:03.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:23:03.237 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.237 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.237 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:03.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.237 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.237 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:03.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:23:03.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:03.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:23:03.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:23:03.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:23:03.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:23:03.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:23:03.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:23:03.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:23:03.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:23:03.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:23:03.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:23:03.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:23:03.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:23:03.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:23:03.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:23:03.240 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.240 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.241 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.241 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:03.241 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:03.241 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.680717848, 2024-04-26T10:23:03.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:23:03.241 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.241 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.241 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:03.241 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:03.241 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.242 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:23:03.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.242 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:03.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.242 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.242 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:03.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:23:03.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:03.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:23:03.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:23:03.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:23:03.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:23:03.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:23:03.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:23:03.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:03.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:23:03.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:23:03.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:23:03.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:03.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:23:03.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:23:03.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:23:03.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:23:03.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:23:03.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:23:03.246 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.246 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.246 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.246 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:03.246 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:03.246 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.680617226000003, 2024-04-26T10:23:03.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:23:03.247 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.247 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.247 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:03.247 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:03.247 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.247 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:23:03.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.247 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.247 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.247 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:03.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:03.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:23:03.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:03.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:23:03.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:23:03.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:23:03.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:23:03.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:23:03.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:23:03.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:23:03.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:23:03.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:23:03.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:23:03.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:03.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:23:03.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:23:03.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:23:03.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:23:03.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:23:03.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:23:03.252 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.252 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.252 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.252 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:23:03.253 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:03.253 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.680498665000002, 2024-04-26T10:23:03.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:23:03.253 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.253 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.253 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:03.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:03.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:23:03.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:03.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:23:03.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:23:03.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:23:03.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:23:03.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:23:03.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:23:03.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:23:03.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:23:03.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:23:03.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:23:03.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:23:03.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:23:03.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:23:03.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:23:03.257 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.257 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.257 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.257 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:03.257 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:03.258 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.680396266999999, 2024-04-26T10:23:03.258 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:23:03.258 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.258 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.258 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:03.258 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:03.258 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.258 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:23:03.258 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.258 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.258 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.258 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:03.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:03.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.259 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.259 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.259 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:23:03.259 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:03.259 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:23:03.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:23:03.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:23:03.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:23:03.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.260 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.260 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.260 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:23:03.260 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:23:03.260 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:03.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:23:03.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:23:03.261 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:23:03.261 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.261 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.261 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:03.261 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:23:03.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:23:03.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:23:03.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:23:03.262 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.262 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.262 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.262 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:23:03.262 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:23:03.262 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.262 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.263 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.263 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.263 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.263 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:03.263 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:03.263 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.679375710000002, 2024-04-26T10:23:03.263 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:23:03.263 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.263 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.263 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:03.263 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:03.263 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.264 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:23:03.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.264 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:03.264 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.264 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.264 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.264 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.264 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:03.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:23:03.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:03.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.265 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.265 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:23:03.265 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:23:03.265 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.265 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:23:03.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:23:03.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:23:03.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:23:03.266 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.266 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.266 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.266 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:23:03.266 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:23:03.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:23:03.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:23:03.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:03.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:23:03.267 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:23:03.267 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.267 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.267 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.267 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:23:03.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:23:03.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.268 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.268 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:23:03.268 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:23:03.268 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.268 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.268 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.268 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.268 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.268 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:03.268 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:03.268 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.678225435000002, 2024-04-26T10:23:03.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:23:03.269 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.269 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.269 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:03.269 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:03.269 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.269 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:23:03.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.269 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.269 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.269 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:03.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.269 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:03.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:23:03.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:03.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:23:03.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:23:03.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:23:03.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:23:03.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:23:03.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:23:03.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:23:03.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:23:03.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:23:03.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:23:03.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:03.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:23:03.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:23:03.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:23:03.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:23:03.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:23:03.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:23:03.273 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.273 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.273 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.274 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:03.274 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:03.274 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.181526193000003, 2024-04-26T10:23:03.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:23:03.274 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.274 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.274 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:03.274 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:03.274 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.274 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:23:03.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.274 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:03.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:03.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.275 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:23:03.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:03.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:23:03.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:23:03.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:23:03.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:23:03.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:23:03.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:23:03.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:23:03.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:23:03.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:23:03.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:23:03.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:03.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:23:03.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:23:03.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:03.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:23:03.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:23:03.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:03.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:23:03.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:23:03.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:23:03.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:23:03.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:23:03.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:23:03.279 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.279 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.279 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.279 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:03.279 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:03.280 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.181302596999998, 2024-04-26T10:23:03.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:23:03.280 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.280 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.280 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:03.280 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:03.280 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.280 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:23:03.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.280 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.280 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.280 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:03.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:03.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:23:03.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:03.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:23:03.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:23:03.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:23:03.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:23:03.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:23:03.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:23:03.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:23:03.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:23:03.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:23:03.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:23:03.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:03.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:23:03.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:23:03.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:03.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:23:03.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:23:03.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:03.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:23:03.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:23:03.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:23:03.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:23:03.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:23:03.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:23:03.285 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.285 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.285 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.285 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:03.285 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:03.285 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.150456277000004, 2024-04-26T10:23:03.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:23:03.286 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.286 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.286 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:03.286 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:03.286 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.286 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:23:03.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.286 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:03.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:03.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:23:03.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:03.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:23:03.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:23:03.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:23:03.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:23:03.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:23:03.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:23:03.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:23:03.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:23:03.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:23:03.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:23:03.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:03.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:23:03.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:23:03.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:03.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:23:03.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:23:03.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:03.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:23:03.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:23:03.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:23:03.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:23:03.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:23:03.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:23:03.291 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.291 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.291 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.291 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:03.291 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:03.291 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.148445174000003, 2024-04-26T10:23:03.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:23:03.291 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.292 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.292 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:03.292 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:03.292 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.292 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:23:03.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.292 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:03.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:03.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:03.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:03.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:23:03.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:23:03.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:23:03.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:23:03.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:23:03.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:23:03.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:23:03.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:23:03.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:23:03.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:23:03.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:03.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:23:03.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:23:03.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:03.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:23:03.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:23:03.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:03.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:23:03.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:23:03.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:23:03.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:23:03.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:23:03.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:23:03.297 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.297 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.297 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.297 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:03.297 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:03.297 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.137567068999999, 2024-04-26T10:23:03.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:23:03.298 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.298 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.298 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:03.298 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:03.298 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.298 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:23:03.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.298 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:03.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:03.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:23:03.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:03.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:23:03.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:23:03.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:23:03.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:23:03.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:23:03.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:23:03.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:23:03.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:23:03.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:23:03.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:23:03.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:03.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:23:03.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:23:03.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:03.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:23:03.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:23:03.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:03.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:23:03.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:23:03.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:23:03.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:23:03.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:23:03.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:23:03.303 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.304 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.304 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.304 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:03.304 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:03.304 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.134885850000003, 2024-04-26T10:23:03.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:23:03.304 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.304 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.304 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:03.304 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:03.304 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.304 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:23:03.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.305 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:03.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:03.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.305 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.305 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:23:03.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:03.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:23:03.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:23:03.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:23:03.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:23:03.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:23:03.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:23:03.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:23:03.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:23:03.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:23:03.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:23:03.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:03.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:23:03.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:23:03.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:03.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:23:03.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:23:03.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:03.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:23:03.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:23:03.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:23:03.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:23:03.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:23:03.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:23:03.309 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.309 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.309 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.309 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:03.309 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:03.310 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.134518774999997, 2024-04-26T10:23:03.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:23:03.310 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.310 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:03.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:03.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.310 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:23:03.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.310 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.310 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:03.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:03.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:23:03.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:03.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:23:03.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:23:03.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:23:03.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:23:03.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:23:03.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:23:03.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:23:03.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:23:03.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:23:03.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:23:03.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:03.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:23:03.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:23:03.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:23:03.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:23:03.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:23:03.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:23:03.314 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.314 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.314 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.314 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:03.314 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:03.314 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.134454523000002, 2024-04-26T10:23:03.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:23:03.314 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.314 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.315 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:03.315 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:03.315 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.315 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:23:03.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.315 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:03.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.315 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.315 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:03.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:23:03.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:03.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:23:03.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:23:03.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:23:03.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:23:03.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:23:03.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:23:03.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:23:03.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:23:03.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:23:03.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:23:03.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:03.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:23:03.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:23:03.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:23:03.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:23:03.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:23:03.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:23:03.318 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.318 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.319 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.319 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:03.319 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:03.319 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.130055849999998, 2024-04-26T10:23:03.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:23:03.319 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.319 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.319 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:03.319 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:03.319 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.320 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:23:03.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.320 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:03.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:03.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:23:03.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:03.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:23:03.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:23:03.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:23:03.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:23:03.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:23:03.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:23:03.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:23:03.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:23:03.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:23:03.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:23:03.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:03.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:23:03.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:23:03.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:23:03.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:23:03.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:23:03.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:23:03.324 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.324 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.324 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.324 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:03.324 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:03.324 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 32.128297867000001, 2024-04-26T10:23:03.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:23:03.324 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:03.324 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:03.324 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:03.324 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:03.325 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.325 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:23:03.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.325 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:03.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:03.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:03.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:03.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:03.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:03.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:03.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:23:03.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:03.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:03.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:23:03.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:23:03.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:03.326 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:23:03.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:23:03.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:23:03.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:23:03.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:03.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:23:03.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:23:03.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:03.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:23:03.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:23:03.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:03.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:23:03.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:23:03.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:03.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:23:03.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:23:03.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:03.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:23:03.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:23:03.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:03.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:23:03.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:23:03.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:03.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:03.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:03.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:23:03.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:23:03.329 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.329 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.329 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.329 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:03.329 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:03.330 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:03.331 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:03.327+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:03.332 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:03.432 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:03.427+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:03.465 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:196712 5.d 5:b75714e0:::benchmark_data_smithi052_19421_object67240:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:03.454400+0000", 2024-04-26T10:23:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0087115040000000001, 2024-04-26T10:23:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0087297999999999994, 2024-04-26T10:23:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.466 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 196712 2024-04-26T10:23:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.454400+0000", 2024-04-26T10:23:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.454400+0000", 2024-04-26T10:23:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.454399+0000", 2024-04-26T10:23:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.454403+0000", 2024-04-26T10:23:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5050000000000001e-06 2024-04-26T10:23:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.454412+0000", 2024-04-26T10:23:03.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7919999999999998e-06 2024-04-26T10:23:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.454418+0000", 2024-04-26T10:23:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.392e-06 2024-04-26T10:23:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.455720+0000", 2024-04-26T10:23:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00130115 2024-04-26T10:23:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:03.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.455853+0000", 2024-04-26T10:23:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013381100000000001 2024-04-26T10:23:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.455988+0000", 2024-04-26T10:23:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013495400000000001 2024-04-26T10:23:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.461519+0000", 2024-04-26T10:23:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055305759999999997 2024-04-26T10:23:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.470 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:196709 5.b e59/37 5:dfbdf106:::benchmark_data_smithi052_19421_object67237:head v 59'12185, mlcod=59'12182)", 2024-04-26T10:23:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:03.456205+0000", 2024-04-26T10:23:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.006905909, 2024-04-26T10:23:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069729350000000004, 2024-04-26T10:23:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:03.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.456205+0000", 2024-04-26T10:23:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.456205+0000", 2024-04-26T10:23:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.456205+0000", 2024-04-26T10:23:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.456213+0000", 2024-04-26T10:23:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3410000000000003e-06 2024-04-26T10:23:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.456220+0000", 2024-04-26T10:23:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9789999999999996e-06 2024-04-26T10:23:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.456230+0000", 2024-04-26T10:23:03.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4890000000000001e-06 2024-04-26T10:23:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.456263+0000", 2024-04-26T10:23:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3019999999999999e-05 2024-04-26T10:23:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.456276+0000", 2024-04-26T10:23:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3124e-05 2024-04-26T10:23:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:03.474 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:196713 5.5 5:a3a1484d:::benchmark_data_smithi052_19421_object67241:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:03.457179+0000", 2024-04-26T10:23:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.005932545, 2024-04-26T10:23:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060324419999999998, 2024-04-26T10:23:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 196713 2024-04-26T10:23:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.475 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457179+0000", 2024-04-26T10:23:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457179+0000", 2024-04-26T10:23:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457177+0000", 2024-04-26T10:23:03.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457183+0000", 2024-04-26T10:23:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3920000000000002e-06 2024-04-26T10:23:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457193+0000", 2024-04-26T10:23:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0234999999999999e-05 2024-04-26T10:23:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457200+0000", 2024-04-26T10:23:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8859999999999998e-06 2024-04-26T10:23:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457254+0000", 2024-04-26T10:23:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3996999999999998e-05 2024-04-26T10:23:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457376+0000", 2024-04-26T10:23:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012196 2024-04-26T10:23:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.478 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:196714 5.d 5:b9786b65:::benchmark_data_smithi052_19421_object67242:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:03.457224+0000", 2024-04-26T10:23:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0058872880000000001, 2024-04-26T10:23:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060212449999999997, 2024-04-26T10:23:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.479 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 196714 2024-04-26T10:23:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457224+0000", 2024-04-26T10:23:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457224+0000", 2024-04-26T10:23:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457223+0000", 2024-04-26T10:23:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457227+0000", 2024-04-26T10:23:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9149999999999998e-06 2024-04-26T10:23:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457235+0000", 2024-04-26T10:23:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6120000000000001e-06 2024-04-26T10:23:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457241+0000", 2024-04-26T10:23:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8239999999999996e-06 2024-04-26T10:23:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457269+0000", 2024-04-26T10:23:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8537000000000001e-05 2024-04-26T10:23:03.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457380+0000", 2024-04-26T10:23:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111051 2024-04-26T10:23:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457487+0000", 2024-04-26T10:23:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000106747 2024-04-26T10:23:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:196716 5.f 5:f2940fc6:::benchmark_data_smithi052_19421_object67244:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:03.457250+0000", 2024-04-26T10:23:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0058613049999999998, 2024-04-26T10:23:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060324860000000001, 2024-04-26T10:23:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 196716 2024-04-26T10:23:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:03.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457250+0000", 2024-04-26T10:23:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457250+0000", 2024-04-26T10:23:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457249+0000", 2024-04-26T10:23:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457253+0000", 2024-04-26T10:23:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2150000000000001e-06 2024-04-26T10:23:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457269+0000", 2024-04-26T10:23:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6039999999999999e-05 2024-04-26T10:23:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457274+0000", 2024-04-26T10:23:03.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5740000000000003e-06 2024-04-26T10:23:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457318+0000", 2024-04-26T10:23:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3584999999999997e-05 2024-04-26T10:23:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457435+0000", 2024-04-26T10:23:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117156 2024-04-26T10:23:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457718+0000", 2024-04-26T10:23:03.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000283441 2024-04-26T10:23:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:196719 5.c 5:3f6bf64b:::benchmark_data_smithi052_19421_object67247:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:03.457490+0000", 2024-04-26T10:23:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0056210660000000001, 2024-04-26T10:23:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.005828209, 2024-04-26T10:23:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:03.488 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 196719 2024-04-26T10:23:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457490+0000", 2024-04-26T10:23:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457490+0000", 2024-04-26T10:23:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457489+0000", 2024-04-26T10:23:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457494+0000", 2024-04-26T10:23:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4789999999999998e-06 2024-04-26T10:23:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457502+0000", 2024-04-26T10:23:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8429999999999999e-06 2024-04-26T10:23:03.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457509+0000", 2024-04-26T10:23:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.336e-06 2024-04-26T10:23:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457583+0000", 2024-04-26T10:23:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4030999999999996e-05 2024-04-26T10:23:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:03.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.457730+0000", 2024-04-26T10:23:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014692399999999999 2024-04-26T10:23:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:196715 5.b e59/37 5:d4305fb4:::benchmark_data_smithi052_19421_object67243:head v 59'12186, mlcod=59'12182)", 2024-04-26T10:23:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:03.458115+0000", 2024-04-26T10:23:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0049964620000000001, 2024-04-26T10:23:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052374470000000001, 2024-04-26T10:23:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.458115+0000", 2024-04-26T10:23:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.458115+0000", 2024-04-26T10:23:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.458114+0000", 2024-04-26T10:23:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.458124+0000", 2024-04-26T10:23:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7459999999999995e-06 2024-04-26T10:23:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.458133+0000", 2024-04-26T10:23:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7170000000000003e-06 2024-04-26T10:23:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.458140+0000", 2024-04-26T10:23:03.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5150000000000003e-06 2024-04-26T10:23:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.459331+0000", 2024-04-26T10:23:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011917570000000001 2024-04-26T10:23:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.459356+0000", 2024-04-26T10:23:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4287e-05 2024-04-26T10:23:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:196720 5.f 5:f91102e3:::benchmark_data_smithi052_19421_object67248:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:03.459912+0000", 2024-04-26T10:23:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0031987449999999998, 2024-04-26T10:23:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034716679999999998, 2024-04-26T10:23:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 196720 2024-04-26T10:23:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.459912+0000", 2024-04-26T10:23:03.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.459912+0000", 2024-04-26T10:23:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.459911+0000", 2024-04-26T10:23:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.459917+0000", 2024-04-26T10:23:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0630000000000002e-06 2024-04-26T10:23:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.459932+0000", 2024-04-26T10:23:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4782e-05 2024-04-26T10:23:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.459940+0000", 2024-04-26T10:23:03.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.807e-06 2024-04-26T10:23:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.461362+0000", 2024-04-26T10:23:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001421973 2024-04-26T10:23:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.461466+0000", 2024-04-26T10:23:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103884 2024-04-26T10:23:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:03.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.461530+0000", 2024-04-26T10:23:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4652000000000004e-05 2024-04-26T10:23:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:196721 5.d 5:b8cdc2ab:::benchmark_data_smithi052_19421_object67249:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:03.459948+0000", 2024-04-26T10:23:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0031633339999999999, 2024-04-26T10:23:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034716040000000001, 2024-04-26T10:23:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:03.500 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 196721 2024-04-26T10:23:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.459948+0000", 2024-04-26T10:23:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.459948+0000", 2024-04-26T10:23:03.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.459947+0000", 2024-04-26T10:23:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.459951+0000", 2024-04-26T10:23:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3579999999999999e-06 2024-04-26T10:23:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:03.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.459960+0000", 2024-04-26T10:23:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2e-06 2024-04-26T10:23:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.459968+0000", 2024-04-26T10:23:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8539999999999997e-06 2024-04-26T10:23:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.460009+0000", 2024-04-26T10:23:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0911000000000002e-05 2024-04-26T10:23:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.460103+0000", 2024-04-26T10:23:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4606999999999997e-05 2024-04-26T10:23:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.460185+0000", 2024-04-26T10:23:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2272000000000001e-05 2024-04-26T10:23:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.504 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:196701 5.f 5:f0b2fc72:::benchmark_data_smithi052_19421_object67229:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:03.449736+0000", 2024-04-26T10:23:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.013374990999999999, 2024-04-26T10:23:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013756928999999999, 2024-04-26T10:23:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 196701 2024-04-26T10:23:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:03.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.449736+0000", 2024-04-26T10:23:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.449736+0000", 2024-04-26T10:23:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.449736+0000", 2024-04-26T10:23:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:03.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.449739+0000", 2024-04-26T10:23:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8929999999999998e-06 2024-04-26T10:23:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.449746+0000", 2024-04-26T10:23:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.007e-06 2024-04-26T10:23:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.449752+0000", 2024-04-26T10:23:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.169e-06 2024-04-26T10:23:03.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.454339+0000", 2024-04-26T10:23:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045870770000000002 2024-04-26T10:23:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.454478+0000", 2024-04-26T10:23:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139216 2024-04-26T10:23:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.454586+0000", 2024-04-26T10:23:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107804 2024-04-26T10:23:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.456725+0000", 2024-04-26T10:23:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002139092 2024-04-26T10:23:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.509 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:196722 5.f 5:fa1617f5:::benchmark_data_smithi052_19421_object67250:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:03.461776+0000", 2024-04-26T10:23:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001335113, 2024-04-26T10:23:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017678119999999999, 2024-04-26T10:23:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 196722 2024-04-26T10:23:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.461776+0000", 2024-04-26T10:23:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.461776+0000", 2024-04-26T10:23:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.461775+0000", 2024-04-26T10:23:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.461780+0000", 2024-04-26T10:23:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8679999999999998e-06 2024-04-26T10:23:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.461794+0000", 2024-04-26T10:23:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4306e-05 2024-04-26T10:23:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.461804+0000", 2024-04-26T10:23:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8379999999999997e-06 2024-04-26T10:23:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462660+0000", 2024-04-26T10:23:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00085583800000000004 2024-04-26T10:23:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462760+0000", 2024-04-26T10:23:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010035 2024-04-26T10:23:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462840+0000", 2024-04-26T10:23:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0098000000000005e-05 2024-04-26T10:23:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.513 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:196723 5.5 5:aa0e1690:::benchmark_data_smithi052_19421_object67251:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:03.461929+0000", 2024-04-26T10:23:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001182022, 2024-04-26T10:23:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016534010000000001, 2024-04-26T10:23:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:03.514 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 196723 2024-04-26T10:23:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.461929+0000", 2024-04-26T10:23:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:03.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.461929+0000", 2024-04-26T10:23:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.461928+0000", 2024-04-26T10:23:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.461936+0000", 2024-04-26T10:23:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2309999999999999e-06 2024-04-26T10:23:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.461948+0000", 2024-04-26T10:23:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2475e-05 2024-04-26T10:23:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.461955+0000", 2024-04-26T10:23:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7490000000000001e-06 2024-04-26T10:23:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.461998+0000", 2024-04-26T10:23:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3053999999999998e-05 2024-04-26T10:23:03.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462147+0000", 2024-04-26T10:23:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014949599999999999 2024-04-26T10:23:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:196724 5.0 5:0674d116:::benchmark_data_smithi052_19421_object67252:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:03.462489+0000", 2024-04-26T10:23:03.518 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00062159900000000002, 2024-04-26T10:23:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011554880000000001, 2024-04-26T10:23:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 196724 2024-04-26T10:23:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462489+0000", 2024-04-26T10:23:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462489+0000", 2024-04-26T10:23:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462489+0000", 2024-04-26T10:23:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462494+0000", 2024-04-26T10:23:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.276e-06 2024-04-26T10:23:03.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462502+0000", 2024-04-26T10:23:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0139999999999998e-06 2024-04-26T10:23:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462507+0000", 2024-04-26T10:23:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2900000000000002e-06 2024-04-26T10:23:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462548+0000", 2024-04-26T10:23:03.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1048999999999999e-05 2024-04-26T10:23:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462682+0000", 2024-04-26T10:23:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133263 2024-04-26T10:23:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462795+0000", 2024-04-26T10:23:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113019 2024-04-26T10:23:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:196725 5.0 5.d5d61eb0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:03.462730+0000", 2024-04-26T10:23:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00038081399999999999, 2024-04-26T10:23:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00098435699999999994, 2024-04-26T10:23:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 196725 2024-04-26T10:23:03.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462730+0000", 2024-04-26T10:23:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462730+0000", 2024-04-26T10:23:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:03.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462729+0000", 2024-04-26T10:23:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462734+0000", 2024-04-26T10:23:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5669999999999996e-06 2024-04-26T10:23:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462743+0000", 2024-04-26T10:23:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6179999999999995e-06 2024-04-26T10:23:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462749+0000", 2024-04-26T10:23:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.703e-06 2024-04-26T10:23:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:196726 5.1 5:891abade:::benchmark_data_smithi052_19421_object67254:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-26T10:23:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:03.462852+0000", 2024-04-26T10:23:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00025881599999999998, 2024-04-26T10:23:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00090899500000000001, 2024-04-26T10:23:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:03.526 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 196726 2024-04-26T10:23:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462852+0000", 2024-04-26T10:23:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462852+0000", 2024-04-26T10:23:03.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462852+0000", 2024-04-26T10:23:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462856+0000", 2024-04-26T10:23:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3819999999999997e-06 2024-04-26T10:23:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:03.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462864+0000", 2024-04-26T10:23:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5830000000000001e-06 2024-04-26T10:23:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462870+0000", 2024-04-26T10:23:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2940000000000002e-06 2024-04-26T10:23:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.462910+0000", 2024-04-26T10:23:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9614999999999999e-05 2024-04-26T10:23:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:03.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.463046+0000", 2024-04-26T10:23:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136871 2024-04-26T10:23:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "MOSDPGPush(5.4 59/37 [PushOp(5:268046a3:::benchmark_data_smithi052_19421_object89257:head, version: 42'5618, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:268046a3:::benchmark_data_smithi052_19421_object89257:head@42'5618, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-04-26T10:23:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:03.463463+0000", 2024-04-26T10:23:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9996486, 2024-04-26T10:23:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00038106000000000001, 2024-04-26T10:23:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:03.530 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.463463+0000", 2024-04-26T10:23:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.463463+0000", 2024-04-26T10:23:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.463462+0000", 2024-04-26T10:23:03.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.463536+0000", 2024-04-26T10:23:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4363999999999995e-05 2024-04-26T10:23:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.463555+0000", 2024-04-26T10:23:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8224999999999999e-05 2024-04-26T10:23:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.463571+0000", 2024-04-26T10:23:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6188000000000002e-05 2024-04-26T10:23:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.463658+0000", 2024-04-26T10:23:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.755e-05 2024-04-26T10:23:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.463673+0000", 2024-04-26T10:23:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5097e-05 2024-04-26T10:23:03.533 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "pg_backfill(progress 5.4 e 59/59 lb 5:267e8f12:::benchmark_data_smithi052_19421_object124106:head)", 2024-04-26T10:23:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:03.463596+0000", 2024-04-26T10:23:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9995151, 2024-04-26T10:23:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032539, 2024-04-26T10:23:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.463596+0000", 2024-04-26T10:23:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.463596+0000", 2024-04-26T10:23:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.463596+0000", 2024-04-26T10:23:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.463604+0000", 2024-04-26T10:23:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0220000000000004e-06 2024-04-26T10:23:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.463611+0000", 2024-04-26T10:23:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4410000000000004e-06 2024-04-26T10:23:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:03.463617+0000", 2024-04-26T10:23:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7409999999999998e-06 2024-04-26T10:23:03.536 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:23:03.537 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 17 2024-04-26T10:23:03.537 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:03.539 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:03.539 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:03.535+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:03.639 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:03.635+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:03.669 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:03.669 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:23:03.670 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:23:03.670 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:03.683 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:03.684 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:23:03.740 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:03.735+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:03.842 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:23:03.843 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:03.838+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:03.858 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:03.858 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:03.867 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:23:03.868 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:23:03.868 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:23:03.868 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:23:03.871 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:03.871 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:23:03.872 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:23:03.942 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:03.938+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:04.010 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:04.010 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:04.022 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:04.042 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:04.039+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:04.142 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:04.142 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:04.145 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:04.142+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:04.155 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:04.210 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T10:23:04.243 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:04.242+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:04.276 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:04.276 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:04.289 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:04.345 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:04.342+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:04.418 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:04.418 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:04.432 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:04.446 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:04.442+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:04.547 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:04.546+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:04.557 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:04.557 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:04.569 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:04.647 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:04.643+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:04.701 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:04.701 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:04.714 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:04.748 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:04.743+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:04.778 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~76s 2024-04-26T10:23:04.841 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:04.841 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:04.850 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:04.843+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:04.852 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:04.950 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:04.946+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:04.974 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:04.974 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:04.987 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:05.050 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:05.047+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:05.111 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:05.111 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:05.123 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:05.166 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:05.163+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:05.249 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:05.249 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:05.252 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:05.250+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:05.261 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:05.353 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:05.350+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:05.394 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:05.394 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:05.408 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:05.453 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:05.450+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:05.531 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:05.531 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:05.543 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:05.587 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:05.586+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:05.655 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:05.654+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:05.672 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:05.672 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:05.683 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:05.756 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:05.754+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:05.808 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:05.808 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:05.820 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:05.857 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:05.851+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:05.873 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:23:05.958 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:05.951+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:05.979 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:05.979 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:05.992 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:06.034 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:23:06.058 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:06.055+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:06.062 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:23:06.063 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:23:06.064 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:23:06.064 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:23:06.068 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:23:06.068 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:23:06.123 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:06.123 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:06.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.123 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:202641 5.f 5:f3fcad14:::benchmark_data_smithi052_19421_object73169:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.123 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:06.112911+0000", 2024-04-26T10:23:06.123 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0082757109999999998, 2024-04-26T10:23:06.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0083002960000000004, 2024-04-26T10:23:06.124 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.124 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:06.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.124 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 202641 2024-04-26T10:23:06.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.124 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.112911+0000", 2024-04-26T10:23:06.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.112911+0000", 2024-04-26T10:23:06.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.112910+0000", 2024-04-26T10:23:06.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.112916+0000", 2024-04-26T10:23:06.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9920000000000004e-06 2024-04-26T10:23:06.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.112937+0000", 2024-04-26T10:23:06.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1528000000000001e-05 2024-04-26T10:23:06.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.112947+0000", 2024-04-26T10:23:06.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3260000000000002e-06 2024-04-26T10:23:06.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.113040+0000", 2024-04-26T10:23:06.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3528000000000003e-05 2024-04-26T10:23:06.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.113182+0000", 2024-04-26T10:23:06.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014138099999999999 2024-04-26T10:23:06.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.113300+0000", 2024-04-26T10:23:06.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118647 2024-04-26T10:23:06.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118492+0000", 2024-04-26T10:23:06.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051921859999999997 2024-04-26T10:23:06.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.128 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.128 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.128 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:202643 5.f 5:ffc537c1:::benchmark_data_smithi052_19421_object73171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.128 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:06.114825+0000", 2024-04-26T10:23:06.128 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0063619770000000004, 2024-04-26T10:23:06.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0064782049999999999, 2024-04-26T10:23:06.128 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.128 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:06.128 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.128 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.128 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.129 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 202643 2024-04-26T10:23:06.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.129 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.114825+0000", 2024-04-26T10:23:06.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.114825+0000", 2024-04-26T10:23:06.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.114824+0000", 2024-04-26T10:23:06.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.114830+0000", 2024-04-26T10:23:06.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4710000000000004e-06 2024-04-26T10:23:06.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.114841+0000", 2024-04-26T10:23:06.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1239e-05 2024-04-26T10:23:06.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.114850+0000", 2024-04-26T10:23:06.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4889999999999995e-06 2024-04-26T10:23:06.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.115040+0000", 2024-04-26T10:23:06.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019004199999999999 2024-04-26T10:23:06.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.115135+0000", 2024-04-26T10:23:06.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5576999999999996e-05 2024-04-26T10:23:06.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.115215+0000", 2024-04-26T10:23:06.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9536999999999994e-05 2024-04-26T10:23:06.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121243+0000", 2024-04-26T10:23:06.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0060281780000000004 2024-04-26T10:23:06.132 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.132 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.132 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.132 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:202644 5.c 5:3bf22f76:::benchmark_data_smithi052_19421_object73172:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.132 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:06.114863+0000", 2024-04-26T10:23:06.132 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0063231440000000002, 2024-04-26T10:23:06.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065302010000000002, 2024-04-26T10:23:06.133 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.133 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.133 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.133 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 202644 2024-04-26T10:23:06.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.133 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.114863+0000", 2024-04-26T10:23:06.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.114863+0000", 2024-04-26T10:23:06.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.114863+0000", 2024-04-26T10:23:06.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.114866+0000", 2024-04-26T10:23:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.715e-06 2024-04-26T10:23:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.114878+0000", 2024-04-26T10:23:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1199000000000001e-05 2024-04-26T10:23:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.114884+0000", 2024-04-26T10:23:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.691e-06 2024-04-26T10:23:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.115634+0000", 2024-04-26T10:23:06.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00074967700000000003 2024-04-26T10:23:06.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.115756+0000", 2024-04-26T10:23:06.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012243599999999999 2024-04-26T10:23:06.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121277+0000", 2024-04-26T10:23:06.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055209329999999996 2024-04-26T10:23:06.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121320+0000", 2024-04-26T10:23:06.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2564000000000001e-05 2024-04-26T10:23:06.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121394+0000", 2024-04-26T10:23:06.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3732999999999994e-05 2024-04-26T10:23:06.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.137 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.137 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.137 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:202645 5.f 5:fdea2c13:::benchmark_data_smithi052_19421_object73173:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.138 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:06.114890+0000", 2024-04-26T10:23:06.138 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0062964989999999997, 2024-04-26T10:23:06.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0066063220000000004, 2024-04-26T10:23:06.138 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.138 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:06.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.138 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.138 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 202645 2024-04-26T10:23:06.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.138 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.114890+0000", 2024-04-26T10:23:06.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.114890+0000", 2024-04-26T10:23:06.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.114890+0000", 2024-04-26T10:23:06.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:06.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.114892+0000", 2024-04-26T10:23:06.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2520000000000002e-06 2024-04-26T10:23:06.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.114904+0000", 2024-04-26T10:23:06.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1433e-05 2024-04-26T10:23:06.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.114989+0000", 2024-04-26T10:23:06.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5134000000000002e-05 2024-04-26T10:23:06.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.116913+0000", 2024-04-26T10:23:06.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001924126 2024-04-26T10:23:06.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.117066+0000", 2024-04-26T10:23:06.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015367500000000001 2024-04-26T10:23:06.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.117176+0000", 2024-04-26T10:23:06.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010998899999999999 2024-04-26T10:23:06.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121468+0000", 2024-04-26T10:23:06.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042913580000000003 2024-04-26T10:23:06.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121505+0000", 2024-04-26T10:23:06.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6857999999999998e-05 2024-04-26T10:23:06.142 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.143 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.143 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.143 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:202649 5.f 5:f9a1199d:::benchmark_data_smithi052_19421_object73177:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.143 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:06.118155+0000", 2024-04-26T10:23:06.143 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0030320400000000002, 2024-04-26T10:23:06.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003437084, 2024-04-26T10:23:06.143 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.143 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:06.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.143 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.143 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 202649 2024-04-26T10:23:06.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.144 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118155+0000", 2024-04-26T10:23:06.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118155+0000", 2024-04-26T10:23:06.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118154+0000", 2024-04-26T10:23:06.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:06.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118157+0000", 2024-04-26T10:23:06.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7779999999999999e-06 2024-04-26T10:23:06.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118164+0000", 2024-04-26T10:23:06.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2559999999999996e-06 2024-04-26T10:23:06.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118169+0000", 2024-04-26T10:23:06.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6500000000000004e-06 2024-04-26T10:23:06.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118531+0000", 2024-04-26T10:23:06.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00036160899999999999 2024-04-26T10:23:06.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118636+0000", 2024-04-26T10:23:06.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105597 2024-04-26T10:23:06.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118732+0000", 2024-04-26T10:23:06.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6119999999999995e-05 2024-04-26T10:23:06.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121475+0000", 2024-04-26T10:23:06.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002742586 2024-04-26T10:23:06.147 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.147 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.147 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.147 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:202650 5.d 5:bb15d98b:::benchmark_data_smithi052_19421_object73178:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.148 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:06.118173+0000", 2024-04-26T10:23:06.148 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0030136350000000002, 2024-04-26T10:23:06.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034975459999999998, 2024-04-26T10:23:06.148 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.148 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:06.148 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.148 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.148 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.148 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 202650 2024-04-26T10:23:06.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.148 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.148 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.148 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118173+0000", 2024-04-26T10:23:06.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118173+0000", 2024-04-26T10:23:06.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118173+0000", 2024-04-26T10:23:06.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:06.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118175+0000", 2024-04-26T10:23:06.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3439999999999999e-06 2024-04-26T10:23:06.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118180+0000", 2024-04-26T10:23:06.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.259e-06 2024-04-26T10:23:06.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118185+0000", 2024-04-26T10:23:06.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4309999999999996e-06 2024-04-26T10:23:06.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118217+0000", 2024-04-26T10:23:06.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1996999999999999e-05 2024-04-26T10:23:06.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118308+0000", 2024-04-26T10:23:06.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1013000000000004e-05 2024-04-26T10:23:06.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118459+0000", 2024-04-26T10:23:06.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015125199999999999 2024-04-26T10:23:06.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.151 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.151 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.152 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:202653 5.f 5:f7e497c1:::benchmark_data_smithi052_19421_object73181:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.152 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:06.118337+0000", 2024-04-26T10:23:06.152 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0028501350000000002, 2024-04-26T10:23:06.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034134109999999999, 2024-04-26T10:23:06.152 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.152 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:06.152 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.152 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.152 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.152 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 202653 2024-04-26T10:23:06.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.152 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118337+0000", 2024-04-26T10:23:06.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118337+0000", 2024-04-26T10:23:06.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118336+0000", 2024-04-26T10:23:06.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118341+0000", 2024-04-26T10:23:06.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8520000000000003e-06 2024-04-26T10:23:06.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118349+0000", 2024-04-26T10:23:06.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5550000000000003e-06 2024-04-26T10:23:06.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.118356+0000", 2024-04-26T10:23:06.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8249999999999999e-06 2024-04-26T10:23:06.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.119963+0000", 2024-04-26T10:23:06.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016068219999999999 2024-04-26T10:23:06.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.120030+0000", 2024-04-26T10:23:06.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6988000000000003e-05 2024-04-26T10:23:06.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.155 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.155 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.120100+0000", 2024-04-26T10:23:06.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0505000000000003e-05 2024-04-26T10:23:06.155 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.156 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.156 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.156 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:202654 5.f 5.895744f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.156 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:06.120886+0000", 2024-04-26T10:23:06.156 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00030026199999999998, 2024-04-26T10:23:06.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00092995000000000003, 2024-04-26T10:23:06.156 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.156 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-04-26T10:23:06.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.156 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.156 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 202654 2024-04-26T10:23:06.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.157 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.120886+0000", 2024-04-26T10:23:06.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.120886+0000", 2024-04-26T10:23:06.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.120885+0000", 2024-04-26T10:23:06.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.120890+0000", 2024-04-26T10:23:06.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5190000000000003e-06 2024-04-26T10:23:06.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.120899+0000", 2024-04-26T10:23:06.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9639999999999992e-06 2024-04-26T10:23:06.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.120904+0000", 2024-04-26T10:23:06.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0669999999999999e-06 2024-04-26T10:23:06.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121814+0000", 2024-04-26T10:23:06.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00091025700000000004 2024-04-26T10:23:06.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.159 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.159 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.159 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:202655 5.d 5:bbd86a13:::benchmark_data_smithi052_19421_object73183:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.159 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:06.120909+0000", 2024-04-26T10:23:06.160 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00027783300000000001, 2024-04-26T10:23:06.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00096722599999999996, 2024-04-26T10:23:06.160 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.160 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:06.160 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.160 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.160 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.160 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 202655 2024-04-26T10:23:06.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.160 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.120909+0000", 2024-04-26T10:23:06.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.120909+0000", 2024-04-26T10:23:06.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.120908+0000", 2024-04-26T10:23:06.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:06.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.120910+0000", 2024-04-26T10:23:06.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.95e-06 2024-04-26T10:23:06.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.120914+0000", 2024-04-26T10:23:06.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.455e-06 2024-04-26T10:23:06.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.120918+0000", 2024-04-26T10:23:06.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1969999999999998e-06 2024-04-26T10:23:06.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.120966+0000", 2024-04-26T10:23:06.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8208000000000003e-05 2024-04-26T10:23:06.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121109+0000", 2024-04-26T10:23:06.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014320000000000001 2024-04-26T10:23:06.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121253+0000", 2024-04-26T10:23:06.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014373399999999999 2024-04-26T10:23:06.163 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.163 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.163 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.164 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:202658 5.f 5.8008a5cf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.164 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:06.121471+0000", 2024-04-26T10:23:06.164 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9997158, 2024-04-26T10:23:06.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049204700000000001, 2024-04-26T10:23:06.164 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.164 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:06.164 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.164 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.164 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.164 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 202658 2024-04-26T10:23:06.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.164 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121471+0000", 2024-04-26T10:23:06.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121471+0000", 2024-04-26T10:23:06.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121470+0000", 2024-04-26T10:23:06.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:06.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121473+0000", 2024-04-26T10:23:06.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8729999999999999e-06 2024-04-26T10:23:06.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121478+0000", 2024-04-26T10:23:06.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1279999999999999e-06 2024-04-26T10:23:06.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121482+0000", 2024-04-26T10:23:06.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4630000000000001e-06 2024-04-26T10:23:06.166 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.166 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.166 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.166 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:202661 5.1 5:8a8b5031:::benchmark_data_smithi052_19421_object73189:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.167 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:06.121557+0000", 2024-04-26T10:23:06.167 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.999629, 2024-04-26T10:23:06.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00048109699999999999, 2024-04-26T10:23:06.167 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.167 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:06.167 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.167 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.167 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.167 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 202661 2024-04-26T10:23:06.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.167 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121557+0000", 2024-04-26T10:23:06.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121557+0000", 2024-04-26T10:23:06.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121557+0000", 2024-04-26T10:23:06.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:06.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121560+0000", 2024-04-26T10:23:06.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0979999999999998e-06 2024-04-26T10:23:06.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121565+0000", 2024-04-26T10:23:06.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0329999999999999e-06 2024-04-26T10:23:06.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.169 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121568+0000", 2024-04-26T10:23:06.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3960000000000002e-06 2024-04-26T10:23:06.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121609+0000", 2024-04-26T10:23:06.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0299999999999997e-05 2024-04-26T10:23:06.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121722+0000", 2024-04-26T10:23:06.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011369799999999999 2024-04-26T10:23:06.170 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.170 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.170 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.170 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:202662 5.0 5:021dae8d:::benchmark_data_smithi052_19421_object73190:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.171 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:06.121582+0000", 2024-04-26T10:23:06.171 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9996052, 2024-04-26T10:23:06.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00052080300000000002, 2024-04-26T10:23:06.171 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.171 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:06.171 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.171 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.171 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.171 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 202662 2024-04-26T10:23:06.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.171 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121582+0000", 2024-04-26T10:23:06.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121582+0000", 2024-04-26T10:23:06.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121581+0000", 2024-04-26T10:23:06.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:06.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121584+0000", 2024-04-26T10:23:06.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9500000000000001e-06 2024-04-26T10:23:06.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121588+0000", 2024-04-26T10:23:06.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2239999999999997e-06 2024-04-26T10:23:06.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121591+0000", 2024-04-26T10:23:06.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2009999999999999e-06 2024-04-26T10:23:06.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121631+0000", 2024-04-26T10:23:06.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9869000000000001e-05 2024-04-26T10:23:06.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121723+0000", 2024-04-26T10:23:06.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1929999999999996e-05 2024-04-26T10:23:06.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121800+0000", 2024-04-26T10:23:06.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6805999999999996e-05 2024-04-26T10:23:06.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.174 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.174 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.175 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:202664 5.1 5.a3c9f741 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.175 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:06.121688+0000", 2024-04-26T10:23:06.175 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9994984, 2024-04-26T10:23:06.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00047812899999999999, 2024-04-26T10:23:06.175 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.175 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:06.175 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.175 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.175 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.175 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 202664 2024-04-26T10:23:06.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.175 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121688+0000", 2024-04-26T10:23:06.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121688+0000", 2024-04-26T10:23:06.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121687+0000", 2024-04-26T10:23:06.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121692+0000", 2024-04-26T10:23:06.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9459999999999997e-06 2024-04-26T10:23:06.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121700+0000", 2024-04-26T10:23:06.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.1659999999999994e-06 2024-04-26T10:23:06.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121707+0000", 2024-04-26T10:23:06.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4690000000000002e-06 2024-04-26T10:23:06.177 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.178 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.178 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.178 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:202665 5.9 5.482ad2c9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.178 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:06.121717+0000", 2024-04-26T10:23:06.178 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9994698, 2024-04-26T10:23:06.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00048075800000000002, 2024-04-26T10:23:06.178 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.178 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:06.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.178 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.178 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 202665 2024-04-26T10:23:06.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.179 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121717+0000", 2024-04-26T10:23:06.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121717+0000", 2024-04-26T10:23:06.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121716+0000", 2024-04-26T10:23:06.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:06.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121719+0000", 2024-04-26T10:23:06.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8229999999999999e-06 2024-04-26T10:23:06.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121728+0000", 2024-04-26T10:23:06.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5979999999999997e-06 2024-04-26T10:23:06.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:06.121734+0000", 2024-04-26T10:23:06.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0109999999999997e-06 2024-04-26T10:23:06.180 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.180 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.181 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.181 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.181 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:23:06.181 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 14 2024-04-26T10:23:06.181 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:06.182 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:06.183 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:06.178+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:06.223 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:23:06.284 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:06.279+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:06.314 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:06.314 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:06.314 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:23:06.314 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:23:06.314 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:06.326 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:06.383 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:06.382+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:06.484 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:06.479+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:06.505 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:06.505 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:23:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:23:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.463273571999999, 2024-04-26T10:23:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:23:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.506 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:23:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:23:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:23:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:23:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:23:06.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:23:06.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:23:06.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:23:06.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:23:06.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:23:06.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:23:06.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:23:06.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:23:06.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:23:06.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:23:06.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:23:06.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:23:06.511 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.511 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.511 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.511 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:06.511 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:06.511 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.463164321000001, 2024-04-26T10:23:06.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:23:06.511 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.511 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.512 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.512 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:23:06.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.512 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:06.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:06.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:06.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:06.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:23:06.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:23:06.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:23:06.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:23:06.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:23:06.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:23:06.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:23:06.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:23:06.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:23:06.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:23:06.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:23:06.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:23:06.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:23:06.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:23:06.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:23:06.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:23:06.516 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.516 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.516 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.517 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:06.517 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:06.517 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.460766909, 2024-04-26T10:23:06.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:23:06.517 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.517 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.517 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.517 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.517 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.517 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:23:06.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.517 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:06.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:06.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:23:06.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:06.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:23:06.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:23:06.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:23:06.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:23:06.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:23:06.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:23:06.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:23:06.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:23:06.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:23:06.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:23:06.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:23:06.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:23:06.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:23:06.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:23:06.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:23:06.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:23:06.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:23:06.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:23:06.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:23:06.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:23:06.522 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.522 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.522 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.522 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:06.523 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:06.523 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 42.460580985, 2024-04-26T10:23:06.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:23:06.523 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.523 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.523 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.523 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.523 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.523 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:23:06.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.523 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:06.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:06.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:23:06.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:06.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:23:06.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:23:06.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:23:06.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:23:06.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:23:06.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:23:06.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:23:06.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:23:06.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:23:06.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:23:06.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:23:06.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:23:06.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:23:06.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:23:06.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:23:06.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:23:06.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:23:06.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:23:06.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:23:06.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:23:06.528 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.528 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.528 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.528 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:06.528 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:06.528 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.370558369000001, 2024-04-26T10:23:06.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:23:06.528 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.528 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.528 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.528 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.529 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.529 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:23:06.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.529 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:06.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:06.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:06.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:06.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:23:06.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:23:06.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:23:06.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:23:06.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:23:06.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:23:06.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:23:06.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:23:06.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:06.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:23:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:23:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:23:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:23:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:23:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:23:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:23:06.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:23:06.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:23:06.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:23:06.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:23:06.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:23:06.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:23:06.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:23:06.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:23:06.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:23:06.534 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.534 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.534 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.534 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:06.534 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:06.534 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.347456123000001, 2024-04-26T10:23:06.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:23:06.535 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.535 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.535 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:23:06.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.535 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:06.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:06.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:23:06.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:06.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:23:06.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:23:06.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:23:06.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:23:06.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:23:06.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:23:06.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:23:06.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:23:06.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:06.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:23:06.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:23:06.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:23:06.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:23:06.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:23:06.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:23:06.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:23:06.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:23:06.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:23:06.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:23:06.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:23:06.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:23:06.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:23:06.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:23:06.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:23:06.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:23:06.540 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.540 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.541 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.541 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:06.541 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:06.541 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.340772985000001, 2024-04-26T10:23:06.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:23:06.541 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.541 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.541 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:23:06.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.542 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:06.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:06.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:23:06.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:23:06.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:23:06.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:23:06.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:23:06.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:23:06.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:23:06.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:23:06.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:23:06.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:06.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:23:06.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:23:06.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:23:06.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:23:06.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:23:06.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:23:06.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:23:06.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:23:06.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:23:06.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:23:06.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:23:06.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:23:06.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:23:06.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:23:06.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:23:06.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:23:06.547 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.547 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.547 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.547 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:06.547 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:06.547 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.338775200000001, 2024-04-26T10:23:06.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:23:06.548 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.548 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.548 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.548 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.548 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.548 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:23:06.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.548 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:06.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:06.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:23:06.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:06.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:23:06.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:23:06.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:23:06.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:23:06.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:23:06.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:23:06.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:23:06.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:23:06.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:06.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:23:06.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:06.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:23:06.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:23:06.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:23:06.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:23:06.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:23:06.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:23:06.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:23:06.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:23:06.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:23:06.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:23:06.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:23:06.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:23:06.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:23:06.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:23:06.553 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.553 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.553 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.554 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:06.554 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:06.554 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.329366494999999, 2024-04-26T10:23:06.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:23:06.554 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.554 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.554 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.554 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.554 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.554 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:23:06.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.554 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:06.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:06.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:23:06.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:23:06.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:23:06.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:23:06.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:06.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:23:06.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:23:06.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:23:06.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:23:06.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:06.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:23:06.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:23:06.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:23:06.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:23:06.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:23:06.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:23:06.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:23:06.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:23:06.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:23:06.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:23:06.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:23:06.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:23:06.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:23:06.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:23:06.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:23:06.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:23:06.560 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.560 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.560 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.560 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:06.560 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:06.560 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.327538445999998, 2024-04-26T10:23:06.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:23:06.561 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.561 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.561 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.561 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.561 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.561 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:23:06.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.561 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:06.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:06.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:23:06.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:23:06.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:23:06.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:23:06.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:23:06.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:23:06.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:23:06.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:23:06.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:23:06.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:06.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:23:06.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:23:06.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:23:06.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:23:06.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:23:06.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:23:06.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:23:06.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:23:06.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:23:06.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:23:06.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:23:06.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:23:06.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:23:06.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:23:06.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:23:06.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:23:06.566 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.566 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.566 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.567 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:06.567 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:06.567 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.315958724000001, 2024-04-26T10:23:06.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:23:06.567 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.567 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.567 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.567 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.567 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.567 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:23:06.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.567 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:06.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:06.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:06.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:06.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:23:06.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:23:06.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:23:06.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:23:06.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:23:06.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:23:06.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:23:06.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:23:06.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:06.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:23:06.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:23:06.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:23:06.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:23:06.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:23:06.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:23:06.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:23:06.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:23:06.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:23:06.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:23:06.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:23:06.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:23:06.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:23:06.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:23:06.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:23:06.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:23:06.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.573 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.573 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.573 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:06.573 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:06.573 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.309548230000001, 2024-04-26T10:23:06.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:23:06.573 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.574 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.574 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.574 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:23:06.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.574 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:06.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:06.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:23:06.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:23:06.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:23:06.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:23:06.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:23:06.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:23:06.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:06.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:23:06.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:23:06.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:06.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:23:06.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:23:06.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:23:06.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:23:06.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:23:06.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:23:06.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:23:06.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:23:06.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:23:06.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:23:06.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:23:06.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:23:06.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:23:06.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:23:06.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:23:06.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:23:06.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.580 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.580 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:06.580 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:06.580 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.296963167000001, 2024-04-26T10:23:06.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:23:06.580 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.580 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.581 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.581 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.581 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.581 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:23:06.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.581 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:06.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:06.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:23:06.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:23:06.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:06.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:23:06.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:23:06.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:23:06.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:23:06.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:23:06.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:23:06.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:06.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:23:06.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:06.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:23:06.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:23:06.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:23:06.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:23:06.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:23:06.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:23:06.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:23:06.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:23:06.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:23:06.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:23:06.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:23:06.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:23:06.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:23:06.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:23:06.587 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.587 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.587 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.587 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:06.587 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:06.587 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.296728234, 2024-04-26T10:23:06.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:23:06.587 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.588 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.588 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.588 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.588 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.588 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:23:06.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.588 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:06.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:06.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:23:06.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:23:06.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:23:06.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:23:06.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:23:06.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:23:06.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:23:06.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:23:06.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:23:06.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:06.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:23:06.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:06.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:23:06.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:23:06.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:23:06.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:23:06.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:23:06.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:23:06.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:23:06.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:23:06.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:23:06.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:23:06.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:23:06.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:23:06.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:23:06.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:23:06.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.594 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.594 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.594 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:06.594 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:06.595 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.258853357, 2024-04-26T10:23:06.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:23:06.595 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.595 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.595 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.595 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:23:06.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.595 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:06.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:06.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:23:06.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:06.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:23:06.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:23:06.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:23:06.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:23:06.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:23:06.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:23:06.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:23:06.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:23:06.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:06.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:23:06.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:06.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:23:06.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:23:06.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:23:06.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:23:06.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:23:06.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:23:06.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:23:06.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:23:06.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:23:06.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:23:06.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:23:06.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:23:06.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:23:06.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:23:06.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.604 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.604 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:06.605 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:06.605 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.258408331999998, 2024-04-26T10:23:06.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:23:06.605 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.605 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.605 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:23:06.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.605 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:06.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:06.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:23:06.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:23:06.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:23:06.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:23:06.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:23:06.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:23:06.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:23:06.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:23:06.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:23:06.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:06.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:23:06.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:23:06.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:23:06.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:23:06.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:23:06.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:23:06.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:23:06.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:23:06.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:23:06.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:23:06.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:23:06.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:23:06.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:23:06.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:23:06.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:23:06.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:23:06.611 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.611 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.611 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.611 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:06.611 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:06.611 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.246805332000001, 2024-04-26T10:23:06.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:23:06.611 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.612 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.612 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.612 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.612 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.612 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:23:06.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.612 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:06.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:06.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:23:06.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:06.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:23:06.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:23:06.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:23:06.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:23:06.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:23:06.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:23:06.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:23:06.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:23:06.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:06.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:23:06.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:23:06.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:23:06.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:23:06.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:23:06.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:23:06.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:23:06.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:23:06.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:23:06.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:23:06.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:23:06.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:23:06.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:23:06.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:23:06.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:23:06.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:23:06.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.617 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.618 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.618 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:06.618 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:06.618 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.245531742000001, 2024-04-26T10:23:06.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:23:06.618 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.618 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.618 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.618 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.618 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.618 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:23:06.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.619 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:06.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:06.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:23:06.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:23:06.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:23:06.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:23:06.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:23:06.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:23:06.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:23:06.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:23:06.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:23:06.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:06.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:23:06.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:23:06.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:23:06.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:23:06.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:23:06.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:23:06.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:23:06.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:23:06.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:23:06.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:23:06.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:23:06.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:23:06.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:23:06.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:23:06.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:23:06.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:23:06.624 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.624 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.624 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.624 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:06.624 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:06.624 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.228774440999999, 2024-04-26T10:23:06.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:23:06.624 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.625 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.625 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.625 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.625 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.625 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:23:06.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.625 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:06.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:06.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:23:06.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:23:06.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:23:06.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:23:06.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:23:06.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:23:06.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:23:06.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:23:06.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:23:06.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:06.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:23:06.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:23:06.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:23:06.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:23:06.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:23:06.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:23:06.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:23:06.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:23:06.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:23:06.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:23:06.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:23:06.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:23:06.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:23:06.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:23:06.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:23:06.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:23:06.630 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.631 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.631 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.631 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:06.631 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:06.631 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 17.183862420000001, 2024-04-26T10:23:06.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:23:06.631 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:06.631 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:06.631 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:06.631 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:06.631 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.631 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:23:06.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.632 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:06.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:06.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:06.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:06.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:06.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:06.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:06.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:23:06.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:06.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:23:06.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:23:06.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:06.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:23:06.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:23:06.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:23:06.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:23:06.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:23:06.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:23:06.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:06.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:23:06.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:23:06.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:06.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:23:06.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:23:06.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:06.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:23:06.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:23:06.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:06.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:23:06.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:23:06.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:06.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:23:06.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:23:06.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:06.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:23:06.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:23:06.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:06.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:23:06.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:23:06.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:06.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:06.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:06.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:23:06.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:23:06.637 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.637 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.637 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.637 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:06.637 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:06.637 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:06.639 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:06.639 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:06.635+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:06.740 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:06.738+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:06.774 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:204183 5.b 5:d7ea9118:::benchmark_data_smithi052_19421_object74711:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:06.770977+0000", 2024-04-26T10:23:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0026299309999999998, 2024-04-26T10:23:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0026533139999999999, 2024-04-26T10:23:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:06.774 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 204183 2024-04-26T10:23:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.770977+0000", 2024-04-26T10:23:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.770977+0000", 2024-04-26T10:23:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.770976+0000", 2024-04-26T10:23:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.770982+0000", 2024-04-26T10:23:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.037e-06 2024-04-26T10:23:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.770991+0000", 2024-04-26T10:23:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5140000000000007e-06 2024-04-26T10:23:06.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.770998+0000", 2024-04-26T10:23:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8260000000000004e-06 2024-04-26T10:23:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771038+0000", 2024-04-26T10:23:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9620999999999999e-05 2024-04-26T10:23:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771155+0000", 2024-04-26T10:23:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011721400000000001 2024-04-26T10:23:06.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771254+0000", 2024-04-26T10:23:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9196000000000004e-05 2024-04-26T10:23:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:204186 5.8 5:15e0d404:::benchmark_data_smithi052_19421_object74714:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:06.771408+0000", 2024-04-26T10:23:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.002199052, 2024-04-26T10:23:06.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002299494, 2024-04-26T10:23:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 204186 2024-04-26T10:23:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771408+0000", 2024-04-26T10:23:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771408+0000", 2024-04-26T10:23:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771407+0000", 2024-04-26T10:23:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771412+0000", 2024-04-26T10:23:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8980000000000004e-06 2024-04-26T10:23:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771421+0000", 2024-04-26T10:23:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0019999999999995e-06 2024-04-26T10:23:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771427+0000", 2024-04-26T10:23:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5969999999999997e-06 2024-04-26T10:23:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771478+0000", 2024-04-26T10:23:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0182999999999997e-05 2024-04-26T10:23:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771608+0000", 2024-04-26T10:23:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013071799999999999 2024-04-26T10:23:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:204184 5.d e60/37 5:b77c3841:::benchmark_data_smithi052_19421_object74712:head v 60'12856, mlcod=60'12852)", 2024-04-26T10:23:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:06.771535+0000", 2024-04-26T10:23:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0020715540000000002, 2024-04-26T10:23:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022406320000000002, 2024-04-26T10:23:06.782 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771535+0000", 2024-04-26T10:23:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771535+0000", 2024-04-26T10:23:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:06.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771535+0000", 2024-04-26T10:23:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771540+0000", 2024-04-26T10:23:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2789999999999998e-06 2024-04-26T10:23:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771547+0000", 2024-04-26T10:23:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8449999999999997e-06 2024-04-26T10:23:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771552+0000", 2024-04-26T10:23:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.023e-06 2024-04-26T10:23:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771584+0000", 2024-04-26T10:23:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2203999999999999e-05 2024-04-26T10:23:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771598+0000", 2024-04-26T10:23:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3988999999999999e-05 2024-04-26T10:23:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.785 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:204188 5.8 5:11c7181d:::benchmark_data_smithi052_19421_object74716:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:06.771609+0000", 2024-04-26T10:23:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0019974480000000002, 2024-04-26T10:23:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002223348, 2024-04-26T10:23:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.786 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 204188 2024-04-26T10:23:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771609+0000", 2024-04-26T10:23:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771609+0000", 2024-04-26T10:23:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771608+0000", 2024-04-26T10:23:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771613+0000", 2024-04-26T10:23:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.809e-06 2024-04-26T10:23:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:06.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771622+0000", 2024-04-26T10:23:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4579999999999993e-06 2024-04-26T10:23:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.771628+0000", 2024-04-26T10:23:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5019999999999998e-06 2024-04-26T10:23:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.773447+0000", 2024-04-26T10:23:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001819071 2024-04-26T10:23:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:06.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.773592+0000", 2024-04-26T10:23:06.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014455199999999999 2024-04-26T10:23:06.790 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.790 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:06.790 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.790 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:204189 5.e 5:72d05d6f:::benchmark_data_smithi052_19421_object74717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.790 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:06.772213+0000", 2024-04-26T10:23:06.790 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0013936129999999999, 2024-04-26T10:23:06.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001682011, 2024-04-26T10:23:06.791 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:06.791 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:06.791 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:06.791 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:06.791 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.791 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 204189 2024-04-26T10:23:06.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.791 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:06.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.791 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:06.791 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.772213+0000", 2024-04-26T10:23:06.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:06.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:06.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.772213+0000", 2024-04-26T10:23:06.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:06.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:06.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.772212+0000", 2024-04-26T10:23:06.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:06.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.772217+0000", 2024-04-26T10:23:06.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3299999999999998e-06 2024-04-26T10:23:06.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:06.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.772230+0000", 2024-04-26T10:23:06.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2123000000000001e-05 2024-04-26T10:23:06.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.772237+0000", 2024-04-26T10:23:06.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.08e-06 2024-04-26T10:23:06.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:06.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.772287+0000", 2024-04-26T10:23:06.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0773000000000003e-05 2024-04-26T10:23:06.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:06.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.772427+0000", 2024-04-26T10:23:06.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013976900000000001 2024-04-26T10:23:06.794 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.794 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:06.794 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.794 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:204187 5.d e60/37 5:bc903392:::benchmark_data_smithi052_19421_object74715:head v 60'12857, mlcod=60'12853)", 2024-04-26T10:23:06.794 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:06.773462+0000", 2024-04-26T10:23:06.794 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00014470600000000001, 2024-04-26T10:23:06.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00049349400000000003, 2024-04-26T10:23:06.795 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:06.795 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:06.795 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:06.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:06.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.773462+0000", 2024-04-26T10:23:06.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:06.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:06.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.773462+0000", 2024-04-26T10:23:06.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:06.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:06.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.773461+0000", 2024-04-26T10:23:06.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:06.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:06.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.773468+0000", 2024-04-26T10:23:06.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2310000000000001e-06 2024-04-26T10:23:06.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:06.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.773475+0000", 2024-04-26T10:23:06.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2860000000000002e-06 2024-04-26T10:23:06.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.773480+0000", 2024-04-26T10:23:06.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8359999999999999e-06 2024-04-26T10:23:06.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:06.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.773518+0000", 2024-04-26T10:23:06.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8498000000000003e-05 2024-04-26T10:23:06.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:06.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.773538+0000", 2024-04-26T10:23:06.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9981999999999999e-05 2024-04-26T10:23:06.798 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.798 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:06.798 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.798 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:204174 5.8 5:157136d1:::benchmark_data_smithi052_19421_object74702:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.798 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:06.766901+0000", 2024-04-26T10:23:06.798 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0067053929999999996, 2024-04-26T10:23:06.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0071098910000000001, 2024-04-26T10:23:06.798 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:06.798 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:06.799 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:06.799 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:06.799 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.799 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 204174 2024-04-26T10:23:06.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.799 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:06.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:06.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.766901+0000", 2024-04-26T10:23:06.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:06.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:06.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.766901+0000", 2024-04-26T10:23:06.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:06.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:06.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.766900+0000", 2024-04-26T10:23:06.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:06.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:06.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.766905+0000", 2024-04-26T10:23:06.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7829999999999998e-06 2024-04-26T10:23:06.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:06.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.766918+0000", 2024-04-26T10:23:06.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2658e-05 2024-04-26T10:23:06.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.766926+0000", 2024-04-26T10:23:06.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0069999999999997e-06 2024-04-26T10:23:06.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:06.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.767803+0000", 2024-04-26T10:23:06.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00087708800000000004 2024-04-26T10:23:06.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:06.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.767943+0000", 2024-04-26T10:23:06.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000139889 2024-04-26T10:23:06.802 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.802 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:06.802 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.802 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:204178 5.0 e60/54 5:00abf3d9:::benchmark_data_smithi052_19421_object74706:head v 60'12753, mlcod=60'12750)", 2024-04-26T10:23:06.802 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:06.768596+0000", 2024-04-26T10:23:06.802 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0050110880000000003, 2024-04-26T10:23:06.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054810529999999996, 2024-04-26T10:23:06.802 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:06.803 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:06.803 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:06.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:06.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.768596+0000", 2024-04-26T10:23:06.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:06.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:06.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.768596+0000", 2024-04-26T10:23:06.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:06.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:06.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.768595+0000", 2024-04-26T10:23:06.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:06.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:06.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.768601+0000", 2024-04-26T10:23:06.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4960000000000004e-06 2024-04-26T10:23:06.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:06.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.768609+0000", 2024-04-26T10:23:06.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9689999999999994e-06 2024-04-26T10:23:06.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.768614+0000", 2024-04-26T10:23:06.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6169999999999998e-06 2024-04-26T10:23:06.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:06.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.769663+0000", 2024-04-26T10:23:06.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010489270000000001 2024-04-26T10:23:06.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:06.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.769678+0000", 2024-04-26T10:23:06.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4612e-05 2024-04-26T10:23:06.805 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.805 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:06.805 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.806 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:204181 5.e 5:70b04cb0:::benchmark_data_smithi052_19421_object74709:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-26T10:23:06.806 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:06.769564+0000", 2024-04-26T10:23:06.806 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.004042482, 2024-04-26T10:23:06.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0045680670000000003, 2024-04-26T10:23:06.806 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:06.806 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:06.806 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:06.806 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:06.806 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:06.806 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 204181 2024-04-26T10:23:06.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.807 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:06.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:06.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.769564+0000", 2024-04-26T10:23:06.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:06.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:06.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.769564+0000", 2024-04-26T10:23:06.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:06.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:06.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.769563+0000", 2024-04-26T10:23:06.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:06.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:06.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.769569+0000", 2024-04-26T10:23:06.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1920000000000002e-06 2024-04-26T10:23:06.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:06.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.769579+0000", 2024-04-26T10:23:06.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9480000000000003e-06 2024-04-26T10:23:06.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:06.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.769586+0000", 2024-04-26T10:23:06.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0879999999999997e-06 2024-04-26T10:23:06.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:06.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.769627+0000", 2024-04-26T10:23:06.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1143999999999998e-05 2024-04-26T10:23:06.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:06.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:06.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:06.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:06.769701+0000", 2024-04-26T10:23:06.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3254e-05 2024-04-26T10:23:06.809 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.809 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:06.809 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.810 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:06.810 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:23:06.810 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 9 2024-04-26T10:23:06.810 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:06.811 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:06.841 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:06.838+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:06.937 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:06.937 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:06.937 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:23:06.937 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:23:06.938 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:06.942 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:06.938+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:06.948 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:07.043 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:07.039+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:07.123 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:07.123 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:23:07.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:23:07.123 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:07.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.123 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:07.124 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:07.124 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 66.590770395999996, 2024-04-26T10:23:07.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:23:07.124 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.124 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.124 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:23:07.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.124 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:07.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:07.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:23:07.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:23:07.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:23:07.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:23:07.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:23:07.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:23:07.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:23:07.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:23:07.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:23:07.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:23:07.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:23:07.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:23:07.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:23:07.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:23:07.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:23:07.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:23:07.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:23:07.128 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.128 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.129 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.129 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:07.129 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:07.129 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 66.588788168999997, 2024-04-26T10:23:07.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:23:07.129 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.129 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.129 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.129 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:23:07.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.130 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:07.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:07.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:23:07.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:23:07.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:23:07.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:23:07.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:23:07.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:23:07.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:23:07.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:23:07.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:23:07.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:23:07.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:23:07.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:23:07.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:23:07.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:23:07.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:23:07.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:23:07.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:23:07.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:23:07.134 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.134 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.134 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.134 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:07.134 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:07.134 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 66.588588784999999, 2024-04-26T10:23:07.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:23:07.134 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.135 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.135 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.135 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.135 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.135 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:23:07.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.135 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:07.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:07.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:07.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:23:07.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:23:07.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:23:07.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:23:07.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:23:07.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:23:07.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:23:07.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:23:07.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:23:07.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:23:07.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:23:07.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:23:07.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:23:07.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:23:07.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:23:07.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:23:07.139 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.139 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.139 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.140 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:23:07.140 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:07.140 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 66.588370165000001, 2024-04-26T10:23:07.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:23:07.140 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.140 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.140 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:07.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:07.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:23:07.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.141 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.141 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:23:07.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:23:07.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:23:07.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:23:07.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:23:07.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:23:07.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:23:07.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:23:07.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:23:07.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:23:07.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:23:07.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:23:07.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:23:07.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:23:07.144 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.144 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.144 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.144 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:07.144 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:07.145 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 66.585998727000003, 2024-04-26T10:23:07.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:23:07.145 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.145 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.145 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.145 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.145 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.145 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:23:07.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.145 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:07.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:07.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:23:07.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:07.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:23:07.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:23:07.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:23:07.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:23:07.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:23:07.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:23:07.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:07.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:23:07.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:23:07.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:23:07.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:23:07.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:23:07.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:23:07.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:23:07.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:23:07.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:23:07.149 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.149 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.149 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.149 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:07.149 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:07.150 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 66.585898104999998, 2024-04-26T10:23:07.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:23:07.150 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.150 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.150 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.150 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.150 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.150 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:23:07.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.150 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:07.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:07.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:23:07.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:23:07.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:23:07.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:23:07.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:23:07.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:23:07.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:23:07.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:23:07.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:23:07.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:23:07.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:23:07.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:23:07.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:23:07.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:23:07.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:23:07.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:23:07.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:23:07.154 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.154 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.154 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.155 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:23:07.155 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:07.155 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 66.585779544000005, 2024-04-26T10:23:07.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:23:07.155 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.155 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.155 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:07.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:07.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:23:07.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:23:07.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:23:07.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:23:07.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:23:07.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:23:07.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:23:07.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:23:07.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:23:07.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:23:07.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:23:07.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:23:07.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:23:07.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:23:07.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:23:07.159 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.159 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.159 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.159 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:07.159 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:07.159 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 66.585677145999995, 2024-04-26T10:23:07.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:23:07.159 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.159 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.159 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.159 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.159 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.160 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:23:07.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.160 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:07.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:07.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:23:07.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:07.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:23:07.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:23:07.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:23:07.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:23:07.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:23:07.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:23:07.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:07.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:23:07.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:23:07.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:23:07.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:23:07.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:23:07.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:23:07.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:23:07.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:23:07.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:23:07.164 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.164 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.164 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.164 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:07.164 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:07.164 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 66.584656589000005, 2024-04-26T10:23:07.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:23:07.164 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.164 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.164 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.164 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.164 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.164 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:23:07.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.165 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:07.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:07.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:23:07.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:23:07.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:23:07.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:23:07.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:23:07.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:23:07.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:23:07.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:23:07.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:23:07.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:23:07.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:23:07.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:23:07.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:23:07.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:23:07.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:23:07.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:23:07.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:23:07.168 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.169 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.169 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.169 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:07.169 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:07.169 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 66.583506314000005, 2024-04-26T10:23:07.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:23:07.169 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.169 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.169 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.169 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.169 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.169 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:23:07.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.170 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:07.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:07.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:23:07.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:07.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:23:07.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:23:07.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:23:07.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:23:07.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:23:07.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:23:07.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:23:07.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:23:07.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:23:07.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:23:07.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:23:07.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:23:07.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:23:07.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:23:07.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:23:07.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:23:07.174 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.174 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.174 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.174 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:07.174 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:07.174 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.086807071999999, 2024-04-26T10:23:07.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:23:07.174 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.174 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.174 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.174 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.174 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.175 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:23:07.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.175 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:07.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:07.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:23:07.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:23:07.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:23:07.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:23:07.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:23:07.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:23:07.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:23:07.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:23:07.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:23:07.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:23:07.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:23:07.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:07.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:23:07.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:23:07.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:23:07.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:23:07.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:23:07.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:23:07.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:23:07.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:23:07.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:23:07.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:23:07.179 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.179 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.179 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.180 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:07.180 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:07.180 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 43.086583476000001, 2024-04-26T10:23:07.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:23:07.180 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.180 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.180 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.180 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.180 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.180 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:23:07.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.180 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:07.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:07.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:23:07.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:23:07.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:23:07.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:23:07.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:23:07.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:23:07.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:23:07.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:23:07.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:23:07.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:23:07.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:23:07.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:07.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:23:07.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:23:07.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:23:07.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:23:07.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:23:07.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:23:07.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:23:07.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:23:07.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:23:07.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:23:07.185 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.185 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.185 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.186 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:07.186 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:07.186 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.055737155999999, 2024-04-26T10:23:07.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:23:07.186 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.186 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.186 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.186 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.186 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.186 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:23:07.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.186 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:07.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:07.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:23:07.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:23:07.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:23:07.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:23:07.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:23:07.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:23:07.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:23:07.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:23:07.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:23:07.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:23:07.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:23:07.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:07.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:23:07.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:23:07.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:23:07.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:23:07.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:23:07.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:23:07.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:23:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:23:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:23:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:23:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:07.191 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.053726052999998, 2024-04-26T10:23:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:23:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:23:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:23:07.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:23:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:23:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:23:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:23:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:23:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:23:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:23:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:23:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:23:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:23:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:23:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:23:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:23:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:23:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:23:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:23:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:23:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:23:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:23:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.042847948000002, 2024-04-26T10:23:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:23:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.197 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:23:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:07.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:23:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:23:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:23:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:23:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:23:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:23:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:23:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:23:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:23:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:23:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:23:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:23:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:23:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:23:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:23:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:23:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:23:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:23:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:23:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:23:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:23:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.202 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.040166728999999, 2024-04-26T10:23:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:23:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:23:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:23:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:07.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:23:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:23:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:23:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:23:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:23:07.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:23:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:23:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:23:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:23:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:23:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:23:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:23:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:23:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:23:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:23:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:23:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:23:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:23:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:23:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:23:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.208 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.039799653999999, 2024-04-26T10:23:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:23:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:23:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:23:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:23:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:23:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:23:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:23:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:23:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:23:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:23:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:23:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:23:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:23:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:23:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:23:07.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:23:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:23:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:23:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:23:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.039735401999998, 2024-04-26T10:23:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:23:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:23:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:23:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:23:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:23:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:23:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:23:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:23:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:23:07.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:23:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:23:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:23:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:23:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:23:07.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:23:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:23:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:23:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:23:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:23:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.035336729000001, 2024-04-26T10:23:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:23:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:23:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.222 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:23:07.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:23:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:23:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:23:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:23:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:23:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:23:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:23:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:23:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:23:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:23:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:23:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:23:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:23:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:23:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:23:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:23:07.226 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 36.033578746000003, 2024-04-26T10:23:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:23:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.227 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:23:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:23:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:23:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:23:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:23:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:23:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:23:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:23:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:23:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:23:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:23:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:23:07.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:23:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:23:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:23:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:23:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:23:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:23:07.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:23:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:23:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:23:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:23:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.232 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.232 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:07.234 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T10:23:07.234 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:07.227+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:07.235 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:07.334 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:07.334+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:07.368 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:205355 5.f 5:f1e45d8f:::benchmark_data_smithi052_19421_object75883:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:07.363231+0000", 2024-04-26T10:23:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002895384, 2024-04-26T10:23:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029159339999999998, 2024-04-26T10:23:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 205355 2024-04-26T10:23:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363231+0000", 2024-04-26T10:23:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363231+0000", 2024-04-26T10:23:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363230+0000", 2024-04-26T10:23:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363235+0000", 2024-04-26T10:23:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3479999999999997e-06 2024-04-26T10:23:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363245+0000", 2024-04-26T10:23:07.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0288e-05 2024-04-26T10:23:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363250+0000", 2024-04-26T10:23:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.989e-06 2024-04-26T10:23:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363303+0000", 2024-04-26T10:23:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2862999999999999e-05 2024-04-26T10:23:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363436+0000", 2024-04-26T10:23:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000133158 2024-04-26T10:23:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363553+0000", 2024-04-26T10:23:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117235 2024-04-26T10:23:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:205356 5.5 5:aa831c13:::benchmark_data_smithi052_19421_object75884:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.372 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:07.363619+0000", 2024-04-26T10:23:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0025079019999999998, 2024-04-26T10:23:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025761690000000001, 2024-04-26T10:23:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 205356 2024-04-26T10:23:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363619+0000", 2024-04-26T10:23:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363619+0000", 2024-04-26T10:23:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363618+0000", 2024-04-26T10:23:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363622+0000", 2024-04-26T10:23:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3950000000000001e-06 2024-04-26T10:23:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363628+0000", 2024-04-26T10:23:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8629999999999996e-06 2024-04-26T10:23:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363631+0000", 2024-04-26T10:23:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7050000000000001e-06 2024-04-26T10:23:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363666+0000", 2024-04-26T10:23:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4391000000000003e-05 2024-04-26T10:23:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363775+0000", 2024-04-26T10:23:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010945799999999999 2024-04-26T10:23:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:205357 5.c 5:39810293:::benchmark_data_smithi052_19421_object75885:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.376 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:07.363976+0000", 2024-04-26T10:23:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0021503479999999998, 2024-04-26T10:23:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022587100000000001, 2024-04-26T10:23:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 205357 2024-04-26T10:23:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363976+0000", 2024-04-26T10:23:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363976+0000", 2024-04-26T10:23:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363975+0000", 2024-04-26T10:23:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363980+0000", 2024-04-26T10:23:07.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3850000000000004e-06 2024-04-26T10:23:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363993+0000", 2024-04-26T10:23:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2785999999999999e-05 2024-04-26T10:23:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.363999+0000", 2024-04-26T10:23:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6329999999999999e-06 2024-04-26T10:23:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.364053+0000", 2024-04-26T10:23:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4098000000000003e-05 2024-04-26T10:23:07.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.364262+0000", 2024-04-26T10:23:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000208925 2024-04-26T10:23:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:205358 5.2 5:47fb2021:::benchmark_data_smithi052_19421_object75886:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:07.364010+0000", 2024-04-26T10:23:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0021171670000000001, 2024-04-26T10:23:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022608229999999999, 2024-04-26T10:23:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:07.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 205358 2024-04-26T10:23:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.364010+0000", 2024-04-26T10:23:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.364010+0000", 2024-04-26T10:23:07.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.364009+0000", 2024-04-26T10:23:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.364012+0000", 2024-04-26T10:23:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.464e-06 2024-04-26T10:23:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.364017+0000", 2024-04-26T10:23:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4500000000000003e-06 2024-04-26T10:23:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.364021+0000", 2024-04-26T10:23:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3479999999999997e-06 2024-04-26T10:23:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.364066+0000", 2024-04-26T10:23:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4270000000000001e-05 2024-04-26T10:23:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.364268+0000", 2024-04-26T10:23:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000202108 2024-04-26T10:23:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:205347 5.b e61/37 5:d8a33293:::benchmark_data_smithi052_19421_object75875:head v 61'12703, mlcod=61'12699)", 2024-04-26T10:23:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:07.364170+0000", 2024-04-26T10:23:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0019565419999999999, 2024-04-26T10:23:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021373719999999998, 2024-04-26T10:23:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.364170+0000", 2024-04-26T10:23:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.364170+0000", 2024-04-26T10:23:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.364170+0000", 2024-04-26T10:23:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.364175+0000", 2024-04-26T10:23:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1909999999999999e-06 2024-04-26T10:23:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.364201+0000", 2024-04-26T10:23:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6007e-05 2024-04-26T10:23:07.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.364206+0000", 2024-04-26T10:23:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5759999999999996e-06 2024-04-26T10:23:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.365124+0000", 2024-04-26T10:23:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00091781800000000004 2024-04-26T10:23:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.365135+0000", 2024-04-26T10:23:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1086e-05 2024-04-26T10:23:07.387 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:205344 5.7 5:e053aa77:::benchmark_data_smithi052_19421_object75872:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:07.358160+0000", 2024-04-26T10:23:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0079662710000000005, 2024-04-26T10:23:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081796950000000007, 2024-04-26T10:23:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.388 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 205344 2024-04-26T10:23:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.358160+0000", 2024-04-26T10:23:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.358160+0000", 2024-04-26T10:23:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.358160+0000", 2024-04-26T10:23:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.358164+0000", 2024-04-26T10:23:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7230000000000004e-06 2024-04-26T10:23:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.358175+0000", 2024-04-26T10:23:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0730999999999999e-05 2024-04-26T10:23:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.358181+0000", 2024-04-26T10:23:07.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0759999999999999e-06 2024-04-26T10:23:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.358230+0000", 2024-04-26T10:23:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9097000000000001e-05 2024-04-26T10:23:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.358368+0000", 2024-04-26T10:23:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000137983 2024-04-26T10:23:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:205343 5.b e61/37 5:db3f9bbe:::benchmark_data_smithi052_19421_object75871:head v 61'12701, mlcod=61'12697)", 2024-04-26T10:23:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:07.358196+0000", 2024-04-26T10:23:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0079307679999999995, 2024-04-26T10:23:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0081787660000000005, 2024-04-26T10:23:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.358196+0000", 2024-04-26T10:23:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.358196+0000", 2024-04-26T10:23:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.358195+0000", 2024-04-26T10:23:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.358200+0000", 2024-04-26T10:23:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7190000000000001e-06 2024-04-26T10:23:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.358205+0000", 2024-04-26T10:23:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.532e-06 2024-04-26T10:23:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.358211+0000", 2024-04-26T10:23:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8119999999999996e-06 2024-04-26T10:23:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.358257+0000", 2024-04-26T10:23:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6456999999999999e-05 2024-04-26T10:23:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.358281+0000", 2024-04-26T10:23:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3765999999999999e-05 2024-04-26T10:23:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:205345 5.0 5:03de138f:::benchmark_data_smithi052_19421_object75873:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:07.359890+0000", 2024-04-26T10:23:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0062371229999999998, 2024-04-26T10:23:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00651982, 2024-04-26T10:23:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:07.395 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 205345 2024-04-26T10:23:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359890+0000", 2024-04-26T10:23:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359890+0000", 2024-04-26T10:23:07.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359889+0000", 2024-04-26T10:23:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359894+0000", 2024-04-26T10:23:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9209999999999997e-06 2024-04-26T10:23:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359905+0000", 2024-04-26T10:23:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0812000000000001e-05 2024-04-26T10:23:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359915+0000", 2024-04-26T10:23:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3850000000000008e-06 2024-04-26T10:23:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359989+0000", 2024-04-26T10:23:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4407999999999996e-05 2024-04-26T10:23:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360130+0000", 2024-04-26T10:23:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014114999999999999 2024-04-26T10:23:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360266+0000", 2024-04-26T10:23:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013537999999999999 2024-04-26T10:23:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.362794+0000", 2024-04-26T10:23:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002528626 2024-04-26T10:23:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.399 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:205348 5.5 5:a2cabe06:::benchmark_data_smithi052_19421_object75876:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:07.359943+0000", 2024-04-26T10:23:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0061834769999999997, 2024-04-26T10:23:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0065075109999999997, 2024-04-26T10:23:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 205348 2024-04-26T10:23:07.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359943+0000", 2024-04-26T10:23:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359943+0000", 2024-04-26T10:23:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359943+0000", 2024-04-26T10:23:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359947+0000", 2024-04-26T10:23:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2150000000000003e-06 2024-04-26T10:23:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359956+0000", 2024-04-26T10:23:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4429999999999992e-06 2024-04-26T10:23:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359963+0000", 2024-04-26T10:23:07.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4280000000000001e-06 2024-04-26T10:23:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360003+0000", 2024-04-26T10:23:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0528000000000002e-05 2024-04-26T10:23:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360117+0000", 2024-04-26T10:23:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113928 2024-04-26T10:23:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:205350 5.2 5:43d30ba1:::benchmark_data_smithi052_19421_object75878:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:07.359978+0000", 2024-04-26T10:23:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0061488510000000003, 2024-04-26T10:23:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006507662, 2024-04-26T10:23:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 205350 2024-04-26T10:23:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359978+0000", 2024-04-26T10:23:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359978+0000", 2024-04-26T10:23:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359977+0000", 2024-04-26T10:23:07.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359980+0000", 2024-04-26T10:23:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9849999999999998e-06 2024-04-26T10:23:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359987+0000", 2024-04-26T10:23:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8079999999999999e-06 2024-04-26T10:23:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.359995+0000", 2024-04-26T10:23:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4959999999999999e-06 2024-04-26T10:23:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360063+0000", 2024-04-26T10:23:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8287999999999994e-05 2024-04-26T10:23:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360209+0000", 2024-04-26T10:23:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146284 2024-04-26T10:23:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:205351 5.d 5:b818cede:::benchmark_data_smithi052_19421_object75879:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:07.360235+0000", 2024-04-26T10:23:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0058918299999999998, 2024-04-26T10:23:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062853509999999998, 2024-04-26T10:23:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 205351 2024-04-26T10:23:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360235+0000", 2024-04-26T10:23:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360235+0000", 2024-04-26T10:23:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360234+0000", 2024-04-26T10:23:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360239+0000", 2024-04-26T10:23:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9130000000000002e-06 2024-04-26T10:23:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360248+0000", 2024-04-26T10:23:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1989999999999995e-06 2024-04-26T10:23:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360255+0000", 2024-04-26T10:23:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0439999999999998e-06 2024-04-26T10:23:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360284+0000", 2024-04-26T10:23:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8404000000000001e-05 2024-04-26T10:23:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360406+0000", 2024-04-26T10:23:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012282699999999999 2024-04-26T10:23:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360525+0000", 2024-04-26T10:23:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118584 2024-04-26T10:23:07.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.365074+0000", 2024-04-26T10:23:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045495049999999997 2024-04-26T10:23:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:205352 5.6 5:6a0df316:::benchmark_data_smithi052_19421_object75880:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:07.360267+0000", 2024-04-26T10:23:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0058595230000000002, 2024-04-26T10:23:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006293412, 2024-04-26T10:23:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.412 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 205352 2024-04-26T10:23:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360267+0000", 2024-04-26T10:23:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360267+0000", 2024-04-26T10:23:07.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360267+0000", 2024-04-26T10:23:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360270+0000", 2024-04-26T10:23:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.061e-06 2024-04-26T10:23:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360276+0000", 2024-04-26T10:23:07.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3060000000000003e-06 2024-04-26T10:23:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360281+0000", 2024-04-26T10:23:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9599999999999999e-06 2024-04-26T10:23:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.362086+0000", 2024-04-26T10:23:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018050950000000001 2024-04-26T10:23:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.362267+0000", 2024-04-26T10:23:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018119100000000001 2024-04-26T10:23:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:205353 5.c 5:388ba7be:::benchmark_data_smithi052_19421_object75881:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:07.360291+0000", 2024-04-26T10:23:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0058356069999999996, 2024-04-26T10:23:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063043880000000002, 2024-04-26T10:23:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.419 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 205353 2024-04-26T10:23:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360291+0000", 2024-04-26T10:23:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360291+0000", 2024-04-26T10:23:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360291+0000", 2024-04-26T10:23:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360293+0000", 2024-04-26T10:23:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7329999999999999e-06 2024-04-26T10:23:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360299+0000", 2024-04-26T10:23:07.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0440000000000001e-06 2024-04-26T10:23:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360304+0000", 2024-04-26T10:23:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9409999999999998e-06 2024-04-26T10:23:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360344+0000", 2024-04-26T10:23:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9604000000000002e-05 2024-04-26T10:23:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360474+0000", 2024-04-26T10:23:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012985699999999999 2024-04-26T10:23:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:205354 5.1 5:80385151:::benchmark_data_smithi052_19421_object75882:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:07.360326+0000", 2024-04-26T10:23:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0058004600000000003, 2024-04-26T10:23:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063038499999999997, 2024-04-26T10:23:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.423 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 205354 2024-04-26T10:23:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360326+0000", 2024-04-26T10:23:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360326+0000", 2024-04-26T10:23:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360326+0000", 2024-04-26T10:23:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360329+0000", 2024-04-26T10:23:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0110000000000001e-06 2024-04-26T10:23:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360336+0000", 2024-04-26T10:23:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1489999999999997e-06 2024-04-26T10:23:07.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360341+0000", 2024-04-26T10:23:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3229999999999997e-06 2024-04-26T10:23:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.361627+0000", 2024-04-26T10:23:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001285296 2024-04-26T10:23:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.361777+0000", 2024-04-26T10:23:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000150154 2024-04-26T10:23:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:205349 5.4 e61/37 5:2576e9dc:::benchmark_data_smithi052_19421_object75877:head v 61'12967, mlcod=61'12965)", 2024-04-26T10:23:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:07.360561+0000", 2024-04-26T10:23:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0055655729999999999, 2024-04-26T10:23:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061070680000000002, 2024-04-26T10:23:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360561+0000", 2024-04-26T10:23:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360561+0000", 2024-04-26T10:23:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360561+0000", 2024-04-26T10:23:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360566+0000", 2024-04-26T10:23:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2399999999999998e-06 2024-04-26T10:23:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360574+0000", 2024-04-26T10:23:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6840000000000002e-06 2024-04-26T10:23:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.360580+0000", 2024-04-26T10:23:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9580000000000004e-06 2024-04-26T10:23:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.362264+0000", 2024-04-26T10:23:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016839419999999999 2024-04-26T10:23:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.362285+0000", 2024-04-26T10:23:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0224000000000002e-05 2024-04-26T10:23:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.430 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:205346 5.b e61/37 5:d30a4a6f:::benchmark_data_smithi052_19421_object75874:head v 61'12702, mlcod=61'12697)", 2024-04-26T10:23:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:07.361532+0000", 2024-04-26T10:23:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.004594491, 2024-04-26T10:23:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0051685680000000001, 2024-04-26T10:23:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.361532+0000", 2024-04-26T10:23:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.361532+0000", 2024-04-26T10:23:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.361532+0000", 2024-04-26T10:23:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.361537+0000", 2024-04-26T10:23:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5650000000000001e-06 2024-04-26T10:23:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.361548+0000", 2024-04-26T10:23:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1177e-05 2024-04-26T10:23:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.361554+0000", 2024-04-26T10:23:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.682e-06 2024-04-26T10:23:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.361622+0000", 2024-04-26T10:23:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8380999999999995e-05 2024-04-26T10:23:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:07.361643+0000", 2024-04-26T10:23:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1112e-05 2024-04-26T10:23:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:23:07.434 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 16 2024-04-26T10:23:07.434 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:07.435 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:07.436 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:07.434+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:07.537 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:07.534+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:07.571 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:07.571 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:07.571 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:23:07.572 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:23:07.572 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:07.585 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:07.638 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:07.631+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:07.706 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:07.706 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:23:07.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:23:07.706 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:07.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.706 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:07.706 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:07.706 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.663838699999999, 2024-04-26T10:23:07.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:23:07.707 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.707 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.707 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.707 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:23:07.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.707 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:07.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:07.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:07.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:23:07.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:23:07.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:23:07.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:23:07.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:23:07.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:23:07.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:23:07.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:23:07.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:23:07.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:23:07.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:23:07.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:23:07.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:23:07.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:23:07.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:23:07.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:23:07.711 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.711 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.711 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.711 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:07.711 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:07.711 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.663729449000002, 2024-04-26T10:23:07.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:23:07.712 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.712 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.712 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.712 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.712 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.712 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:23:07.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.712 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:07.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:07.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:07.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:23:07.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:23:07.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:23:07.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:23:07.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:23:07.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:23:07.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:23:07.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:23:07.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:23:07.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:23:07.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:23:07.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:23:07.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:23:07.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:23:07.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:23:07.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:23:07.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.716 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.716 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:07.716 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:07.717 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.661332037000001, 2024-04-26T10:23:07.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:23:07.717 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.717 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.717 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:23:07.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.717 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:07.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:07.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:23:07.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:07.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:23:07.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:23:07.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:23:07.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:23:07.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:23:07.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:23:07.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:23:07.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:23:07.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:23:07.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:23:07.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:23:07.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:23:07.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:23:07.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:23:07.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:23:07.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:23:07.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:23:07.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:23:07.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:23:07.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:23:07.722 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.722 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.722 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.722 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:07.722 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:07.722 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.661146113000001, 2024-04-26T10:23:07.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:23:07.723 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.723 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.723 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.723 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:23:07.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.723 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:07.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:07.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:23:07.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:23:07.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:23:07.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:23:07.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:23:07.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:23:07.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:23:07.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:23:07.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:23:07.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:23:07.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:23:07.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:23:07.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:23:07.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:23:07.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:23:07.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:23:07.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:23:07.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:23:07.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:23:07.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:23:07.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:23:07.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.728 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.728 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.728 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:07.728 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:07.728 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.571123496999999, 2024-04-26T10:23:07.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:23:07.728 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.729 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.729 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.729 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:23:07.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.729 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:07.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:07.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:07.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:23:07.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:23:07.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:23:07.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:23:07.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:23:07.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:23:07.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:23:07.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:23:07.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:07.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:23:07.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:23:07.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:23:07.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:23:07.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:23:07.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:23:07.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:23:07.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:23:07.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:23:07.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:23:07.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:23:07.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:23:07.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:23:07.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:23:07.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:23:07.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:23:07.734 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.734 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.734 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.735 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:07.735 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:07.735 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.548021251000002, 2024-04-26T10:23:07.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:23:07.735 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.735 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.735 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.735 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.735 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.735 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:23:07.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.735 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:07.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:07.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:23:07.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:07.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:23:07.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:23:07.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:23:07.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:23:07.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:23:07.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:23:07.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:23:07.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:23:07.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:07.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:23:07.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:23:07.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:23:07.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:23:07.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:23:07.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:23:07.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:23:07.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:23:07.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:23:07.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:23:07.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:23:07.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:23:07.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:23:07.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:23:07.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:23:07.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:23:07.741 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.741 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.741 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.741 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:07.741 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:07.741 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.541338112999998, 2024-04-26T10:23:07.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:23:07.741 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.742 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.742 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.742 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.742 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.742 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:23:07.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.742 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:07.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:07.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:23:07.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:23:07.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:23:07.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:23:07.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:23:07.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:23:07.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:23:07.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:23:07.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:23:07.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:07.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:23:07.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:23:07.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:23:07.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:23:07.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:23:07.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:23:07.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:23:07.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:23:07.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:23:07.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:23:07.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:23:07.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:23:07.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:23:07.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:23:07.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:23:07.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:23:07.747 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.747 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.747 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.748 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:07.748 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:07.748 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.539340328000002, 2024-04-26T10:23:07.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:23:07.748 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.748 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.748 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.748 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:23:07.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.749 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:07.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:07.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:23:07.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:07.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:23:07.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:23:07.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:23:07.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:23:07.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:23:07.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:23:07.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:23:07.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:23:07.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:07.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:23:07.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:07.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:23:07.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:23:07.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:23:07.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:23:07.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:23:07.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:23:07.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:23:07.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:23:07.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:23:07.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:23:07.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:23:07.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:23:07.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:23:07.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:23:07.754 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.754 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.754 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.754 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:07.754 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:07.755 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.529931623, 2024-04-26T10:23:07.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:23:07.755 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.755 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.755 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.755 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.755 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.755 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:23:07.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.755 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:07.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:07.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:23:07.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:23:07.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:23:07.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:23:07.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:07.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:23:07.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:23:07.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:23:07.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:23:07.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:07.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:23:07.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:23:07.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:23:07.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:23:07.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:23:07.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:23:07.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:23:07.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:23:07.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:23:07.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:23:07.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:23:07.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:23:07.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:23:07.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:23:07.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:23:07.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:23:07.761 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.761 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.761 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.761 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:07.761 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:07.761 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.528103573999999, 2024-04-26T10:23:07.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:23:07.761 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.761 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.761 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.762 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.762 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:23:07.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.762 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:07.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:07.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:23:07.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:23:07.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:23:07.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:23:07.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:23:07.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:23:07.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:23:07.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:23:07.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:23:07.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:07.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:23:07.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:23:07.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:23:07.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:23:07.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:23:07.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:23:07.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:23:07.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:23:07.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:23:07.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:23:07.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:23:07.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:23:07.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:23:07.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:23:07.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:23:07.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:23:07.767 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.767 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.767 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.767 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:07.768 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:07.768 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.516523851999999, 2024-04-26T10:23:07.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:23:07.768 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.768 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.768 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.768 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.768 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.768 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:23:07.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.768 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:07.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:07.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:07.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:23:07.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:23:07.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:23:07.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:23:07.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:23:07.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:23:07.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:23:07.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:23:07.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:07.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:23:07.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:23:07.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:23:07.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:23:07.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:23:07.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:23:07.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:23:07.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:23:07.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:23:07.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:23:07.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:23:07.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:23:07.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:23:07.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:23:07.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:23:07.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:23:07.774 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.774 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.774 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.774 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:07.774 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:07.774 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.510113358000002, 2024-04-26T10:23:07.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:23:07.774 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.774 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.774 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.775 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.775 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:23:07.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.775 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:07.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:07.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:23:07.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:23:07.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:23:07.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:23:07.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:23:07.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:23:07.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:07.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:23:07.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:23:07.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:07.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:23:07.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:23:07.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:23:07.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:23:07.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:23:07.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:23:07.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:23:07.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:23:07.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:23:07.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:23:07.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:23:07.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:23:07.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:23:07.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:23:07.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:23:07.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:23:07.780 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.780 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.780 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.781 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:07.781 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:07.781 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.497528294999999, 2024-04-26T10:23:07.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:23:07.781 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.781 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.781 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.781 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.781 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.781 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:23:07.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.781 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:07.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:07.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:23:07.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:23:07.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:07.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:23:07.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:23:07.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:23:07.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:23:07.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:23:07.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:23:07.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:07.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:23:07.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:07.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:23:07.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:23:07.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:23:07.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:23:07.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:23:07.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:23:07.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:23:07.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:23:07.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:23:07.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:23:07.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:23:07.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:23:07.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:23:07.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:23:07.787 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.787 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.787 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.787 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:07.787 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:07.787 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.497293362000001, 2024-04-26T10:23:07.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:23:07.787 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.787 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.788 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.788 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:23:07.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.788 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:07.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:07.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:23:07.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:23:07.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:23:07.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:23:07.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:23:07.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:23:07.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:23:07.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:23:07.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:23:07.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:07.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:23:07.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:07.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:23:07.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:23:07.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:23:07.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:23:07.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:23:07.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:23:07.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:23:07.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:23:07.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:23:07.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:23:07.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:23:07.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:23:07.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:23:07.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:23:07.793 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.793 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.793 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.794 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:07.794 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:07.794 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.459418485, 2024-04-26T10:23:07.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:23:07.794 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.794 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.794 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.794 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:23:07.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.795 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:07.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:07.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:23:07.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:07.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:23:07.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:23:07.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:23:07.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:23:07.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:23:07.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:23:07.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:23:07.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:23:07.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:07.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:23:07.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:07.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:23:07.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:23:07.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:23:07.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:23:07.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:23:07.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:23:07.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:23:07.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:23:07.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:23:07.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:23:07.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:23:07.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:23:07.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:23:07.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:23:07.800 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.800 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.800 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.800 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:07.800 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:07.800 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.458973459999999, 2024-04-26T10:23:07.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:23:07.800 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.800 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.801 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.801 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:23:07.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.801 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:07.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:07.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:23:07.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:23:07.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:23:07.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:23:07.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:23:07.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:23:07.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:23:07.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:23:07.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:23:07.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:07.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:23:07.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:23:07.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:23:07.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:23:07.804 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.804 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.804 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.804 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:23:07.804 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:23:07.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:23:07.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:23:07.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.805 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:23:07.805 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:23:07.805 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.805 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.805 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:23:07.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:23:07.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:23:07.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:23:07.806 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.806 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.806 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.806 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:23:07.806 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:23:07.806 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.806 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.807 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.807 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.807 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:07.807 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:07.807 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.447370459999998, 2024-04-26T10:23:07.807 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:23:07.807 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.807 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.807 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.807 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:23:07.807 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.808 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:07.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.808 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:07.808 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.808 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.808 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.808 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:23:07.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:07.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:23:07.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:23:07.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.809 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.809 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:23:07.809 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:23:07.809 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.809 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:23:07.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:23:07.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:23:07.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:23:07.810 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.810 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.810 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:07.810 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:23:07.810 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:23:07.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:23:07.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:23:07.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:23:07.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:23:07.811 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.811 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.811 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.811 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:23:07.811 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:23:07.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:23:07.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:23:07.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:23:07.812 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:23:07.812 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.812 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.812 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.812 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:23:07.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:23:07.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.813 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.813 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:23:07.813 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:23:07.813 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.813 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.813 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.813 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.813 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.813 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:07.813 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:07.813 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.446096870000002, 2024-04-26T10:23:07.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:23:07.814 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.814 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.814 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.814 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.814 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.814 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:23:07.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.814 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.814 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.814 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.814 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:07.814 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.814 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:07.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:23:07.815 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.815 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.815 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.815 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.815 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:23:07.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:23:07.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:23:07.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:23:07.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:23:07.816 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:23:07.816 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.816 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.816 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.816 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:23:07.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:23:07.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:07.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:23:07.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:23:07.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:23:07.817 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:23:07.817 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.817 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.817 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.817 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:23:07.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:23:07.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:23:07.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:23:07.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.818 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.818 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:23:07.818 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:23:07.818 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.818 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:23:07.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:23:07.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:23:07.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:23:07.819 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.819 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.819 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.819 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:23:07.819 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:23:07.819 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.820 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.820 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.820 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.820 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:07.820 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:07.820 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.429339569, 2024-04-26T10:23:07.820 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:23:07.820 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.820 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.820 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.820 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.820 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.820 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:23:07.820 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.821 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:07.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:07.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.821 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.821 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.821 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.821 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:23:07.821 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:23:07.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:23:07.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.822 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:23:07.822 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:23:07.822 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.822 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.822 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:23:07.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:23:07.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:23:07.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:23:07.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:07.823 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:23:07.823 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:23:07.823 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.823 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.823 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:23:07.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:23:07.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:23:07.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:23:07.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.824 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:23:07.824 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:23:07.824 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.824 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.824 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:23:07.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:23:07.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:23:07.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:23:07.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.825 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.825 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:23:07.825 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:23:07.825 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.825 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.826 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.826 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:23:07.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:23:07.826 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.826 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.826 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.826 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.826 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.826 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:07.826 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:07.826 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 18.384427548000001, 2024-04-26T10:23:07.826 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:23:07.826 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:07.827 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:07.827 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:07.827 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:07.827 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.827 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:23:07.827 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.830 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:07.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:07.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:07.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:07.830 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:07.830 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:07.830 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.830 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.830 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:07.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:23:07.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:07.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:23:07.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:23:07.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.831 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.831 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:07.831 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:23:07.831 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:23:07.831 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:23:07.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:23:07.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:23:07.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:23:07.832 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.832 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.832 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:07.832 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:23:07.832 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:23:07.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:07.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:23:07.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:23:07.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:07.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:23:07.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:23:07.833 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.833 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:07.833 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:23:07.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:23:07.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:07.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:23:07.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:23:07.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:07.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:23:07.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:23:07.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:07.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:23:07.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:23:07.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:07.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:07.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:07.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:23:07.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:23:07.835 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.835 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.835 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.835 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:07.835 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:07.835 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:07.837 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:07.837 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:07.834+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:07.937 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:07.931+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:07.964 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:07.964 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:07.964 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.964 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:206699 5.4 5:231003da:::benchmark_data_smithi052_19421_object77227:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.964 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:07.955630+0000", 2024-04-26T10:23:07.964 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.008470745, 2024-04-26T10:23:07.964 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0084876859999999995, 2024-04-26T10:23:07.965 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.965 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:07.965 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.965 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.965 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.965 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 206699 2024-04-26T10:23:07.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.965 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.955630+0000", 2024-04-26T10:23:07.965 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.965 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.965 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.965 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.965 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.955630+0000", 2024-04-26T10:23:07.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.955629+0000", 2024-04-26T10:23:07.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.966 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.966 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.955634+0000", 2024-04-26T10:23:07.966 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6910000000000002e-06 2024-04-26T10:23:07.966 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.966 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.955646+0000", 2024-04-26T10:23:07.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2023e-05 2024-04-26T10:23:07.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.955653+0000", 2024-04-26T10:23:07.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.024e-06 2024-04-26T10:23:07.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.967 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.967 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.955714+0000", 2024-04-26T10:23:07.967 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0877e-05 2024-04-26T10:23:07.967 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.967 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.955877+0000", 2024-04-26T10:23:07.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162867 2024-04-26T10:23:07.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:07.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.956025+0000", 2024-04-26T10:23:07.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000147668 2024-04-26T10:23:07.968 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.968 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.968 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:07.968 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.960290+0000", 2024-04-26T10:23:07.968 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042649849999999998 2024-04-26T10:23:07.968 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.968 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.969 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.969 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.969 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.969 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:206704 5.8 5:1791a80c:::benchmark_data_smithi052_19421_object77232:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.969 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:07.958995+0000", 2024-04-26T10:23:07.969 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0051050069999999999, 2024-04-26T10:23:07.969 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051844930000000001, 2024-04-26T10:23:07.969 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.969 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:07.969 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.969 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.969 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.969 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 206704 2024-04-26T10:23:07.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.970 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.958995+0000", 2024-04-26T10:23:07.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.970 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.958995+0000", 2024-04-26T10:23:07.970 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.970 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.970 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.970 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.958995+0000", 2024-04-26T10:23:07.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.959000+0000", 2024-04-26T10:23:07.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9989999999999999e-06 2024-04-26T10:23:07.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.971 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.959012+0000", 2024-04-26T10:23:07.971 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2401e-05 2024-04-26T10:23:07.971 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.971 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.971 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.959018+0000", 2024-04-26T10:23:07.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5029999999999997e-06 2024-04-26T10:23:07.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.959733+0000", 2024-04-26T10:23:07.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00071505099999999997 2024-04-26T10:23:07.972 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.972 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.972 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.972 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.959853+0000", 2024-04-26T10:23:07.972 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120647 2024-04-26T10:23:07.972 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.973 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.973 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.973 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.973 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:206706 5.9 e61/37 5:9703fbe2:::benchmark_data_smithi052_19421_object77234:head v 61'12986, mlcod=61'12984)", 2024-04-26T10:23:07.973 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:07.959452+0000", 2024-04-26T10:23:07.973 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.004648531, 2024-04-26T10:23:07.973 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047694909999999998, 2024-04-26T10:23:07.973 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.973 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:07.973 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.973 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.973 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.973 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.959452+0000", 2024-04-26T10:23:07.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.959452+0000", 2024-04-26T10:23:07.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.974 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.974 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.974 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.959451+0000", 2024-04-26T10:23:07.974 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.974 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.959459+0000", 2024-04-26T10:23:07.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5979999999999999e-06 2024-04-26T10:23:07.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.959485+0000", 2024-04-26T10:23:07.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6315000000000001e-05 2024-04-26T10:23:07.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.975 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.975 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.959491+0000", 2024-04-26T10:23:07.975 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2600000000000002e-06 2024-04-26T10:23:07.975 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.975 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.959534+0000", 2024-04-26T10:23:07.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2444000000000002e-05 2024-04-26T10:23:07.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.976 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.976 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.959563+0000", 2024-04-26T10:23:07.976 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8986e-05 2024-04-26T10:23:07.976 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.976 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.976 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.976 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.976 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.976 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:206710 5.8 5:107f4a80:::benchmark_data_smithi052_19421_object77238:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.976 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:07.961617+0000", 2024-04-26T10:23:07.977 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0024837380000000001, 2024-04-26T10:23:07.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0026554249999999999, 2024-04-26T10:23:07.977 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.977 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:07.977 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.977 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.977 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.977 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 206710 2024-04-26T10:23:07.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.977 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.977 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.977 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.977 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.961617+0000", 2024-04-26T10:23:07.977 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.977 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.961617+0000", 2024-04-26T10:23:07.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.961616+0000", 2024-04-26T10:23:07.978 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.978 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.978 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.978 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.978 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.961621+0000", 2024-04-26T10:23:07.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9570000000000001e-06 2024-04-26T10:23:07.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.961628+0000", 2024-04-26T10:23:07.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6569999999999997e-06 2024-04-26T10:23:07.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.961634+0000", 2024-04-26T10:23:07.979 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9259999999999997e-06 2024-04-26T10:23:07.979 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.979 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.979 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.979 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.961708+0000", 2024-04-26T10:23:07.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3502000000000002e-05 2024-04-26T10:23:07.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.980 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.980 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.961797+0000", 2024-04-26T10:23:07.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9536000000000005e-05 2024-04-26T10:23:07.980 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.980 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.980 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.980 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.980 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.980 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:206714 5.e 5:7990ab23:::benchmark_data_smithi052_19421_object77242:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.980 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:07.961650+0000", 2024-04-26T10:23:07.980 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.002450748, 2024-04-26T10:23:07.980 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0026823860000000001, 2024-04-26T10:23:07.981 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.981 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:07.981 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.981 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.981 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.981 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 206714 2024-04-26T10:23:07.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.981 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.961650+0000", 2024-04-26T10:23:07.981 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.981 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.981 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.981 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.981 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.961650+0000", 2024-04-26T10:23:07.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.961649+0000", 2024-04-26T10:23:07.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.982 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.961652+0000", 2024-04-26T10:23:07.982 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.305e-06 2024-04-26T10:23:07.982 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.982 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.982 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.961658+0000", 2024-04-26T10:23:07.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3779999999999998e-06 2024-04-26T10:23:07.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.961661+0000", 2024-04-26T10:23:07.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2380000000000002e-06 2024-04-26T10:23:07.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.983 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.983 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.961697+0000", 2024-04-26T10:23:07.983 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5947e-05 2024-04-26T10:23:07.983 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.983 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.984 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.984 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.961798+0000", 2024-04-26T10:23:07.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010119399999999999 2024-04-26T10:23:07.984 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.984 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.984 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.984 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.984 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.984 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:206709 5.d e61/37 5:bd45e304:::benchmark_data_smithi052_19421_object77237:head v 61'13015, mlcod=61'13011)", 2024-04-26T10:23:07.984 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:07.962143+0000", 2024-04-26T10:23:07.984 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0019572840000000001, 2024-04-26T10:23:07.984 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022239780000000002, 2024-04-26T10:23:07.984 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.984 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:07.984 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.962143+0000", 2024-04-26T10:23:07.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.962143+0000", 2024-04-26T10:23:07.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.985 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.985 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.985 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.985 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.962142+0000", 2024-04-26T10:23:07.985 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.962152+0000", 2024-04-26T10:23:07.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1160000000000005e-06 2024-04-26T10:23:07.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.986 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.962160+0000", 2024-04-26T10:23:07.986 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5569999999999996e-06 2024-04-26T10:23:07.986 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.986 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.986 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.962167+0000", 2024-04-26T10:23:07.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6769999999999998e-06 2024-04-26T10:23:07.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.962209+0000", 2024-04-26T10:23:07.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2605999999999998e-05 2024-04-26T10:23:07.987 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.987 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.987 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.962229+0000", 2024-04-26T10:23:07.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9952000000000001e-05 2024-04-26T10:23:07.987 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.987 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.988 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.988 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:206708 5.0 e61/54 5:06809a84:::benchmark_data_smithi052_19421_object77236:head v 61'12898, mlcod=61'12894)", 2024-04-26T10:23:07.988 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:07.962190+0000", 2024-04-26T10:23:07.988 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0019108160000000001, 2024-04-26T10:23:07.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022083350000000001, 2024-04-26T10:23:07.988 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.988 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:07.988 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.962190+0000", 2024-04-26T10:23:07.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.962190+0000", 2024-04-26T10:23:07.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.962189+0000", 2024-04-26T10:23:07.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:07.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.962197+0000", 2024-04-26T10:23:07.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2570000000000001e-06 2024-04-26T10:23:07.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.962203+0000", 2024-04-26T10:23:07.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8029999999999999e-06 2024-04-26T10:23:07.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.962208+0000", 2024-04-26T10:23:07.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6369999999999998e-06 2024-04-26T10:23:07.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.962239+0000", 2024-04-26T10:23:07.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0904000000000001e-05 2024-04-26T10:23:07.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.962257+0000", 2024-04-26T10:23:07.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7754e-05 2024-04-26T10:23:07.991 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.991 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.991 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.991 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:206715 5.8 5:17b10cf4:::benchmark_data_smithi052_19421_object77243:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.991 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:07.963884+0000", 2024-04-26T10:23:07.991 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00021664699999999999, 2024-04-26T10:23:07.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00054732800000000003, 2024-04-26T10:23:07.992 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.992 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:07.992 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.992 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.992 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.992 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 206715 2024-04-26T10:23:07.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.992 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.963884+0000", 2024-04-26T10:23:07.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.963884+0000", 2024-04-26T10:23:07.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.963883+0000", 2024-04-26T10:23:07.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.963888+0000", 2024-04-26T10:23:07.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4720000000000003e-06 2024-04-26T10:23:07.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.963900+0000", 2024-04-26T10:23:07.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1268e-05 2024-04-26T10:23:07.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.963906+0000", 2024-04-26T10:23:07.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9819999999999996e-06 2024-04-26T10:23:07.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.994 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.964154+0000", 2024-04-26T10:23:07.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000248688 2024-04-26T10:23:07.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.964268+0000", 2024-04-26T10:23:07.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000113658 2024-04-26T10:23:07.995 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.995 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.995 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.995 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:206716 5.b 5:d5e8db1d:::benchmark_data_smithi052_19421_object77244:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.995 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:07.964131+0000", 2024-04-26T10:23:07.995 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.99997, 2024-04-26T10:23:07.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00033799999999999998, 2024-04-26T10:23:07.996 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:07.996 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:07.996 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:07.996 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:07.996 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:07.996 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 206716 2024-04-26T10:23:07.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.996 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:07.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:07.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.964131+0000", 2024-04-26T10:23:07.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:07.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.964131+0000", 2024-04-26T10:23:07.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:07.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:07.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.964130+0000", 2024-04-26T10:23:07.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:07.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:07.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.964135+0000", 2024-04-26T10:23:07.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3020000000000002e-06 2024-04-26T10:23:07.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:07.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.964143+0000", 2024-04-26T10:23:07.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3999999999999992e-06 2024-04-26T10:23:07.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:07.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.964149+0000", 2024-04-26T10:23:07.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0430000000000004e-06 2024-04-26T10:23:07.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:07.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.964192+0000", 2024-04-26T10:23:07.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2685000000000002e-05 2024-04-26T10:23:07.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:07.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.964303+0000", 2024-04-26T10:23:07.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000110942 2024-04-26T10:23:07.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.999 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:07.999 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.964448+0000", 2024-04-26T10:23:07.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014499900000000001 2024-04-26T10:23:07.999 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.999 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:07.999 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:07.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:07.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:07.999 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:206718 5.8 5.b6370648 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-26T10:23:07.999 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:07.964239+0000", 2024-04-26T10:23:08.000 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9998612, 2024-04-26T10:23:08.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000267483, 2024-04-26T10:23:08.000 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:08.000 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:08.000 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:08.000 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:08.000 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:08.000 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 206718 2024-04-26T10:23:08.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:08.000 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:08.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:08.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:08.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.964239+0000", 2024-04-26T10:23:08.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:08.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:08.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:08.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:08.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.964239+0000", 2024-04-26T10:23:08.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:08.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:08.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:08.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:08.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.964238+0000", 2024-04-26T10:23:08.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:08.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:08.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:08.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:08.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.964244+0000", 2024-04-26T10:23:08.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9050000000000002e-06 2024-04-26T10:23:08.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:08.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:08.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:08.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.964258+0000", 2024-04-26T10:23:08.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3959e-05 2024-04-26T10:23:08.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:08.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:08.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:08.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:07.964265+0000", 2024-04-26T10:23:08.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0770000000000002e-06 2024-04-26T10:23:08.002 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:08.002 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:08.002 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:08.002 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:08.003 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:23:08.003 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 10 2024-04-26T10:23:08.003 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:08.004 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:08.037 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:08.031+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:08.069 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:23:08.127 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:08.128 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:08.128 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:23:08.128 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:23:08.128 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:08.139 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:08.135+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:08.139 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:08.228 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:23:08.239 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:08.235+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:08.248 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:23:08.249 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:23:08.249 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:23:08.249 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:23:08.254 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:23:08.254 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:23:08.267 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:08.267 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:08.277 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:08.339 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:08.335+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:08.403 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:08.403 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:08.415 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:08.442 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:08.439+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:08.543 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:08.542+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:08.546 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:08.546 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:08.560 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:08.645 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:08.639+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:08.690 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:08.690 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:08.702 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:08.746 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:08.743+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:08.829 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:08.829 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:08.840 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:08.845 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:08.839+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:08.946 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:08.942+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:08.962 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:08.962 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:08.975 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:09.047 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:09.046+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:09.100 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:09.101 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:09.113 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:09.158 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:09.155+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:09.237 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:23:09.241 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:09.241 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:09.249 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:09.246+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:09.254 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:09.352 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:09.347+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:09.393 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:09.393 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:09.405 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:09.452 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:09.450+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:09.554 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:09.551+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:09.577 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:09.577 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:09.590 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:09.655 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:09.650+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:09.715 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:09.716 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:09.728 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:09.754 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:09.751+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:09.849 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:09.849 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:09.855 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:09.854+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:09.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:09.956 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:09.951+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:09.990 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:09.990 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:10.003 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:10.057 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:10.054+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:10.134 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:10.135 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:10.147 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:10.158 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:10.151+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:10.240 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T10:23:10.255 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:23:10.258 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:10.251+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:10.281 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:10.281 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:10.294 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:10.359 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:10.358+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:10.406 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:23:10.428 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:23:10.429 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:23:10.429 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:23:10.429 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:23:10.433 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:10.433 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:23:10.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:23:10.433 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:10.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.434 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:10.434 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:10.434 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 46.390813698999999, 2024-04-26T10:23:10.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:23:10.434 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.434 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.434 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.434 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:23:10.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.435 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:10.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:10.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:10.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:10.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:23:10.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:23:10.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:23:10.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:23:10.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:23:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:23:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:23:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:23:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:23:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:23:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:23:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:23:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:23:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:23:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:23:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:23:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.438 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 46.390704448000001, 2024-04-26T10:23:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:23:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:23:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.439 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:10.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:23:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:23:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:23:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:23:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:23:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:23:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:23:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:23:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:23:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:23:10.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:23:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:23:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:23:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:23:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:23:10.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:23:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 46.388307036, 2024-04-26T10:23:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:23:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:23:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:23:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:23:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:23:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:23:10.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:23:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:23:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:23:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:23:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:23:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:23:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:23:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:23:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:23:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:23:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:23:10.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:23:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:23:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:23:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:23:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:23:10.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:23:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 46.388121112, 2024-04-26T10:23:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:23:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.450 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.451 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.451 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:23:10.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.451 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:10.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:10.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:23:10.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:10.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:23:10.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:23:10.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:23:10.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:23:10.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:23:10.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:23:10.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:23:10.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:23:10.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:23:10.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:23:10.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:10.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:23:10.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:23:10.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:23:10.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:23:10.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:10.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:23:10.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:23:10.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:23:10.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:23:10.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:23:10.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:23:10.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.456 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.456 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:10.456 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:10.456 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.298098496000001, 2024-04-26T10:23:10.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:23:10.456 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.456 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.457 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:23:10.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.457 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:10.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:10.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:10.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:10.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:23:10.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:23:10.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:23:10.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:23:10.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:23:10.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:23:10.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:23:10.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:23:10.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:10.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:23:10.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:23:10.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:23:10.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:23:10.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:23:10.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:23:10.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:10.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:23:10.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:23:10.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:10.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:23:10.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:23:10.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:23:10.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:23:10.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:23:10.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:23:10.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:23:10.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:23:10.463 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.463 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.463 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.463 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:10.463 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:10.463 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.274996250000001, 2024-04-26T10:23:10.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:23:10.463 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.463 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.463 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.463 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:23:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:23:10.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:23:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:23:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:23:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:23:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:23:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:23:10.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:23:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:23:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:23:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:23:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:23:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:23:10.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:23:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:23:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:23:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:23:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:10.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:23:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:23:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:23:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:23:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:23:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:23:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:23:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:23:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.268313112000001, 2024-04-26T10:23:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:23:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.469 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:23:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:23:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:23:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:23:10.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:23:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:23:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:23:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:23:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:23:10.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:23:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:23:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:23:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:23:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:23:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:23:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:23:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:23:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:23:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:23:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:23:10.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:23:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:23:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:23:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:23:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:23:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:23:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.266315327000001, 2024-04-26T10:23:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:23:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.476 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:23:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:10.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:23:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:23:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:23:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:23:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:23:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:23:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:23:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:23:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:23:10.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:23:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:23:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:23:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:23:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:23:10.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:23:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:23:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:23:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:23:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:23:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:23:10.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:23:10.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:23:10.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:23:10.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:23:10.482 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.482 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.482 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.483 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:10.483 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:10.483 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.256906621999999, 2024-04-26T10:23:10.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:23:10.483 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.483 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.483 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.483 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.483 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.483 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:23:10.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.483 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:23:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:23:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:23:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:23:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:23:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:23:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:23:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:23:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:23:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:23:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:23:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:23:10.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:23:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:23:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:23:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:23:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:23:10.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:23:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:23:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:23:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:23:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:23:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:23:10.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:23:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.255078572999999, 2024-04-26T10:23:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:23:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.489 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:23:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:23:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:23:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:23:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:23:10.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:23:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:23:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:23:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:23:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:23:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:10.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:23:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:23:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:23:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:23:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:23:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:23:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:23:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:23:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:23:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:23:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:23:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:23:10.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:23:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:23:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:23:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:23:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.243498850999998, 2024-04-26T10:23:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:23:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:23:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:10.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.497 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:23:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:23:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:23:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:23:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:23:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:23:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:23:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:23:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:23:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:23:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:23:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:23:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:23:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:23:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:23:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:23:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:23:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:23:10.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:23:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:23:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:23:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:23:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:23:10.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:23:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.237088357000001, 2024-04-26T10:23:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:23:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.502 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:23:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:10.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:23:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:23:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:23:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:23:10.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:23:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:23:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:23:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:23:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:10.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:23:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:23:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:23:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:23:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:23:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:23:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:10.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:23:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:23:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:23:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:23:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:23:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:23:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:23:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:23:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:23:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:23:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.508 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.224503294000002, 2024-04-26T10:23:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:23:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:23:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:23:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:10.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:23:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:23:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:23:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:23:10.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:23:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:23:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:23:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:23:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:23:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:23:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:23:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:23:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:23:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:23:10.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:23:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:23:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:23:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:23:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:23:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:23:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:23:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:23:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:10.515 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.224268361, 2024-04-26T10:23:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:23:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:23:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:23:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:23:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:23:10.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:23:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:23:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:23:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:23:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:23:10.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:23:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:23:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:23:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:23:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:23:10.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:23:10.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:10.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:23:10.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:23:10.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:10.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:23:10.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:23:10.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:23:10.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:23:10.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:23:10.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:23:10.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:23:10.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:23:10.522 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.522 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.522 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.522 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:10.522 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:10.522 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.186393484, 2024-04-26T10:23:10.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:23:10.522 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.522 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.522 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.522 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.523 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.523 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:23:10.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.523 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:10.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:10.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:23:10.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:10.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:23:10.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:23:10.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:23:10.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:23:10.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:23:10.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:23:10.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:23:10.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:23:10.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:10.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:23:10.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:10.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:23:10.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:23:10.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:23:10.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:23:10.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:10.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:23:10.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:23:10.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:23:10.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:23:10.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:10.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:23:10.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:23:10.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:23:10.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:23:10.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:23:10.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:23:10.528 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.528 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.528 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.528 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:10.528 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:10.528 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.185948458999999, 2024-04-26T10:23:10.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:23:10.528 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.528 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.529 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.529 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.529 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.529 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:23:10.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.529 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:10.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:10.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:23:10.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:10.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:23:10.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:23:10.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:23:10.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:23:10.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:23:10.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:23:10.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:23:10.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:23:10.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:10.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:23:10.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:23:10.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:23:10.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:23:10.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:23:10.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:23:10.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:10.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:23:10.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:23:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:23:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:23:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:23:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:23:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:23:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:23:10.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:23:10.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:23:10.534 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.534 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.534 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.534 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:10.534 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:10.534 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.174345459000001, 2024-04-26T10:23:10.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:23:10.534 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.535 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.535 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.535 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:23:10.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.535 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:10.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:10.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:23:10.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:10.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:23:10.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:23:10.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:23:10.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:23:10.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:23:10.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:23:10.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:23:10.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:23:10.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:10.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:23:10.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:23:10.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:23:10.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:23:10.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:23:10.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:23:10.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:10.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:23:10.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:23:10.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:10.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:23:10.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:23:10.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:23:10.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:23:10.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:23:10.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:23:10.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:23:10.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:23:10.540 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.540 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.540 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.540 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:10.540 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:10.541 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.173071869000001, 2024-04-26T10:23:10.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:23:10.541 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.541 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.541 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.541 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:23:10.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.541 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:10.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:10.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:23:10.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:10.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:23:10.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:23:10.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:23:10.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:23:10.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:23:10.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:23:10.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:23:10.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:23:10.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:10.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:23:10.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:23:10.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:23:10.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:23:10.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:23:10.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:23:10.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:10.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:23:10.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:23:10.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:10.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:23:10.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:23:10.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:23:10.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:23:10.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:23:10.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:23:10.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:23:10.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:23:10.546 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.546 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.547 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.547 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:10.547 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:10.547 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.156314567999999, 2024-04-26T10:23:10.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:23:10.547 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.547 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.547 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.547 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.547 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.547 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:23:10.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.547 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:10.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:10.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:23:10.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:10.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:23:10.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:23:10.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:23:10.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:23:10.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:23:10.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:23:10.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:23:10.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:23:10.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:10.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:23:10.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:23:10.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:23:10.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:23:10.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:23:10.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:23:10.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:10.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:23:10.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:23:10.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:10.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:23:10.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:23:10.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:23:10.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:23:10.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:23:10.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:23:10.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:23:10.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:23:10.553 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.553 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.553 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.553 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:10.553 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:10.553 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 21.111402547000001, 2024-04-26T10:23:10.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:23:10.553 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:10.553 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.553 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:10.553 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:10.554 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.554 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:23:10.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.554 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:10.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:10.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:10.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:10.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:10.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:10.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:10.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:23:10.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:10.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:10.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:23:10.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:23:10.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:10.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:23:10.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:23:10.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:23:10.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:23:10.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:23:10.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:23:10.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:10.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:23:10.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:23:10.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:10.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:23:10.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:23:10.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:10.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:23:10.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:23:10.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:10.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:23:10.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:23:10.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:10.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:23:10.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:23:10.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:10.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:23:10.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:23:10.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:10.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:23:10.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:23:10.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:10.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:10.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:10.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:23:10.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:23:10.559 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.559 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.559 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.559 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:10.559 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:10.559 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:10.560 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:23:10.561 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:23:10.562 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:10.562 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:10.555+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:10.660 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~82s 2024-04-26T10:23:10.661 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:10.655+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:10.689 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:10.689 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:10.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.689 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:212991 5.4 5:2e6291bf:::benchmark_data_smithi052_19421_object83519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:10.689 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:10.674469+0000", 2024-04-26T10:23:10.689 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.014568025, 2024-04-26T10:23:10.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.014592822, 2024-04-26T10:23:10.689 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:10.689 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:10.690 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:10.690 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:10.690 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.690 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 212991 2024-04-26T10:23:10.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.690 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:10.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:10.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.674469+0000", 2024-04-26T10:23:10.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:10.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:10.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.674469+0000", 2024-04-26T10:23:10.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:10.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:10.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.674468+0000", 2024-04-26T10:23:10.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:10.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:10.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.674474+0000", 2024-04-26T10:23:10.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4500000000000001e-06 2024-04-26T10:23:10.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:10.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.674485+0000", 2024-04-26T10:23:10.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1060000000000001e-05 2024-04-26T10:23:10.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.674493+0000", 2024-04-26T10:23:10.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9840000000000001e-06 2024-04-26T10:23:10.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:10.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.674549+0000", 2024-04-26T10:23:10.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5204000000000002e-05 2024-04-26T10:23:10.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:10.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.674727+0000", 2024-04-26T10:23:10.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017829900000000001 2024-04-26T10:23:10.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:10.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.674893+0000", 2024-04-26T10:23:10.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016646799999999999 2024-04-26T10:23:10.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:10.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.677623+0000", 2024-04-26T10:23:10.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0027298819999999999 2024-04-26T10:23:10.693 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.693 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:10.693 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.693 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:213002 5.4 5.a09485c4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:10.694 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:10.679834+0000", 2024-04-26T10:23:10.694 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0092028500000000003, 2024-04-26T10:23:10.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0093158410000000001, 2024-04-26T10:23:10.694 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:10.694 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:10.694 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:10.694 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:10.694 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.694 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 213002 2024-04-26T10:23:10.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.694 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:10.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:10.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.679834+0000", 2024-04-26T10:23:10.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:10.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:10.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.679834+0000", 2024-04-26T10:23:10.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:10.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:10.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.679834+0000", 2024-04-26T10:23:10.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:10.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:10.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.679837+0000", 2024-04-26T10:23:10.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5389999999999999e-06 2024-04-26T10:23:10.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:10.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.679846+0000", 2024-04-26T10:23:10.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3380000000000005e-06 2024-04-26T10:23:10.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.679852+0000", 2024-04-26T10:23:10.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7769999999999999e-06 2024-04-26T10:23:10.696 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.697 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:10.697 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.697 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop_reply(client.4722.0:212991 5.4 e62/37)", 2024-04-26T10:23:10.697 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:10.682936+0000", 2024-04-26T10:23:10.697 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0061010200000000004, 2024-04-26T10:23:10.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0062452899999999997, 2024-04-26T10:23:10.697 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:10.697 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:10.697 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:10.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:10.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.682936+0000", 2024-04-26T10:23:10.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:10.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:10.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.682936+0000", 2024-04-26T10:23:10.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:10.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:10.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.682936+0000", 2024-04-26T10:23:10.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:10.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:10.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.682940+0000", 2024-04-26T10:23:10.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8060000000000002e-06 2024-04-26T10:23:10.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:10.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.682956+0000", 2024-04-26T10:23:10.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5319999999999999e-05 2024-04-26T10:23:10.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.682964+0000", 2024-04-26T10:23:10.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7970000000000001e-06 2024-04-26T10:23:10.699 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.700 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:10.700 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.700 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:213008 5.4 5.b804a6d4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:10.700 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:10.683076+0000", 2024-04-26T10:23:10.700 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0059614070000000002, 2024-04-26T10:23:10.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061369500000000004, 2024-04-26T10:23:10.700 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:10.700 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:10.700 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:10.700 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:10.700 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.700 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 213008 2024-04-26T10:23:10.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.701 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:10.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:10.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.683076+0000", 2024-04-26T10:23:10.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:10.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:10.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.683076+0000", 2024-04-26T10:23:10.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:10.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:10.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.683074+0000", 2024-04-26T10:23:10.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:10.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:10.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.683082+0000", 2024-04-26T10:23:10.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3830000000000003e-06 2024-04-26T10:23:10.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:10.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.683093+0000", 2024-04-26T10:23:10.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.098e-05 2024-04-26T10:23:10.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.683101+0000", 2024-04-26T10:23:10.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4630000000000001e-06 2024-04-26T10:23:10.703 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.703 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:10.703 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.703 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:213009 5.4 5.39eb20e4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:10.703 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:10.683618+0000", 2024-04-26T10:23:10.703 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0054194860000000003, 2024-04-26T10:23:10.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0056250420000000002, 2024-04-26T10:23:10.704 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:10.704 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:10.704 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:10.704 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:10.704 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.704 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 213009 2024-04-26T10:23:10.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.704 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:10.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:10.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.683618+0000", 2024-04-26T10:23:10.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:10.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:10.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.683618+0000", 2024-04-26T10:23:10.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:10.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:10.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.683617+0000", 2024-04-26T10:23:10.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:10.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:10.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.683623+0000", 2024-04-26T10:23:10.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4049999999999997e-06 2024-04-26T10:23:10.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:10.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.683634+0000", 2024-04-26T10:23:10.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0458e-05 2024-04-26T10:23:10.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.683642+0000", 2024-04-26T10:23:10.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7099999999999996e-06 2024-04-26T10:23:10.706 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.706 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:10.706 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.706 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:213016 5.b 5:dc30d76a:::benchmark_data_smithi052_19421_object83544:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:10.706 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:10.686706+0000", 2024-04-26T10:23:10.707 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0023315530000000001, 2024-04-26T10:23:10.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025857079999999999, 2024-04-26T10:23:10.707 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:10.707 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:10.707 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:10.707 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:10.707 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.707 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 213016 2024-04-26T10:23:10.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.707 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:10.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:10.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.686706+0000", 2024-04-26T10:23:10.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:10.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:10.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.686706+0000", 2024-04-26T10:23:10.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:10.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:10.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.686705+0000", 2024-04-26T10:23:10.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:10.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:10.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.686710+0000", 2024-04-26T10:23:10.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5779999999999998e-06 2024-04-26T10:23:10.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:10.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.686728+0000", 2024-04-26T10:23:10.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7252e-05 2024-04-26T10:23:10.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.686736+0000", 2024-04-26T10:23:10.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3000000000000002e-06 2024-04-26T10:23:10.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:10.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.686788+0000", 2024-04-26T10:23:10.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1983e-05 2024-04-26T10:23:10.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:10.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.686941+0000", 2024-04-26T10:23:10.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015312400000000001 2024-04-26T10:23:10.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:10.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.687070+0000", 2024-04-26T10:23:10.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000128942 2024-04-26T10:23:10.711 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.711 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:10.711 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.711 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:213017 5.9 e62/37 5:9bd5b511:::benchmark_data_smithi052_19421_object83545:head v 62'13402, mlcod=62'13400)", 2024-04-26T10:23:10.711 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:10.687197+0000", 2024-04-26T10:23:10.711 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0018407460000000001, 2024-04-26T10:23:10.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021330670000000002, 2024-04-26T10:23:10.711 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:10.711 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:10.711 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:10.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:10.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.687197+0000", 2024-04-26T10:23:10.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:10.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:10.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.687197+0000", 2024-04-26T10:23:10.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:10.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:10.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.687196+0000", 2024-04-26T10:23:10.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:10.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:10.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.687204+0000", 2024-04-26T10:23:10.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7570000000000004e-06 2024-04-26T10:23:10.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:10.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.687213+0000", 2024-04-26T10:23:10.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4669999999999993e-06 2024-04-26T10:23:10.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.687219+0000", 2024-04-26T10:23:10.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3280000000000002e-06 2024-04-26T10:23:10.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:10.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.687271+0000", 2024-04-26T10:23:10.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1656999999999997e-05 2024-04-26T10:23:10.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:10.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:10.687293+0000", 2024-04-26T10:23:10.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1719e-05 2024-04-26T10:23:10.714 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.714 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:10.714 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.714 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.714 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:23:10.714 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 7 2024-04-26T10:23:10.714 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:10.715 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:10.763 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:10.758+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:10.843 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:10.843 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:10.843 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:23:10.843 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:23:10.843 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:10.854 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:10.862 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:10.859+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:10.963 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:10.959+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:10.987 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:10.987 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:23:10.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:23:10.987 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:10.987 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.987 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:10.987 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:10.987 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 70.454483073999995, 2024-04-26T10:23:10.987 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:23:10.987 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:10.988 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.988 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:10.988 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:10.988 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.988 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:23:10.988 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.988 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:10.988 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.988 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:10.988 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:10.988 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:10.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:10.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:10.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:10.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.989 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.989 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:10.989 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:23:10.989 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:10.989 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:10.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:23:10.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:23:10.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.990 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:10.990 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:23:10.990 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:23:10.990 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.990 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:23:10.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:23:10.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:10.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:23:10.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:23:10.991 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.991 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.991 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:10.991 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:23:10.991 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:23:10.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:10.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:23:10.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:23:10.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.992 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:10.992 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:23:10.992 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:23:10.992 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.992 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.993 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:10.993 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:23:10.993 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:23:10.993 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.993 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:10.993 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.993 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.993 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.993 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:10.993 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:10.993 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 70.452500846999996, 2024-04-26T10:23:10.994 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:23:10.994 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:10.994 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:10.994 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:10.994 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:10.994 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:10.994 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:23:10.994 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.994 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:10.994 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.994 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:10.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:10.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:10.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:10.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:10.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:10.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.995 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.995 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:10.995 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:23:10.995 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:23:10.995 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:10.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:23:10.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:23:10.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:10.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:23:10.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:23:10.996 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.996 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.996 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:10.996 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:23:10.996 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:23:10.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:10.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:23:10.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:23:10.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.997 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:10.997 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:23:10.997 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:23:10.997 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.997 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:10.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:23:10.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:23:10.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:10.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:23:10.998 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:23:10.998 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.998 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.998 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:10.998 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:23:10.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:23:10.999 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.999 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:10.999 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:10.999 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:10.999 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:10.999 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:10.999 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:10.999 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 70.452301462999998, 2024-04-26T10:23:10.999 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:23:10.999 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:10.999 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.000 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.000 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.000 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.000 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:23:11.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.000 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.000 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.000 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:11.000 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.000 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.000 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:11.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:11.001 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.001 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.001 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.001 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.001 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:23:11.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:23:11.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:23:11.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:23:11.002 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.002 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.002 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.002 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:23:11.002 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:23:11.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:23:11.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:23:11.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.003 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.003 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:23:11.003 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:23:11.003 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.003 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:11.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:23:11.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:23:11.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:11.004 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:23:11.004 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:23:11.004 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.004 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.004 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:11.005 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:23:11.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:23:11.005 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.005 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.005 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.005 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.005 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.005 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:23:11.005 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:11.005 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 70.452082842999999, 2024-04-26T10:23:11.005 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:23:11.005 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.006 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.006 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:11.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.006 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.006 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.006 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:11.006 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.006 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:23:11.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.007 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:23:11.007 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:23:11.007 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.007 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.007 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:23:11.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:23:11.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:23:11.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:23:11.008 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.008 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.008 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.008 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:23:11.008 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:23:11.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:23:11.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:23:11.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:11.009 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:23:11.009 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:23:11.009 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.009 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.009 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:11.010 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:23:11.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:23:11.010 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.010 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.010 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.010 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.010 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.010 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:11.010 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:11.010 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 70.449711405000002, 2024-04-26T10:23:11.010 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:23:11.010 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.010 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.011 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.011 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.011 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.011 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:23:11.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.011 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.011 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:11.011 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.011 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.011 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.011 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:11.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:23:11.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:11.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.012 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.012 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.012 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:23:11.012 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:23:11.012 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:23:11.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:23:11.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.013 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:23:11.013 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:23:11.013 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.013 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.013 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:11.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:23:11.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:23:11.014 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:23:11.014 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.014 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.014 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:11.014 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:23:11.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:23:11.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:11.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:23:11.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:23:11.015 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.015 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.015 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:11.015 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:23:11.015 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:23:11.015 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.016 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.016 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.016 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.016 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.016 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:11.016 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:11.016 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 70.449610782999997, 2024-04-26T10:23:11.016 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:23:11.016 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.016 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.016 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.017 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.017 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.017 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:23:11.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.017 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:11.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.017 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.017 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.017 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.017 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:11.017 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:23:11.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.018 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.018 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.018 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:23:11.018 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:23:11.018 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:23:11.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:23:11.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.019 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:23:11.019 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:23:11.019 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.019 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.019 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:23:11.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:23:11.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:23:11.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:23:11.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.020 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.020 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:11.020 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:23:11.020 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:23:11.020 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:11.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:23:11.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:23:11.021 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.021 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.021 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:11.021 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:23:11.021 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:23:11.021 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.021 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.021 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.022 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.022 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:23:11.022 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:11.022 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 70.449492222000003, 2024-04-26T10:23:11.022 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:23:11.022 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.022 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.022 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.022 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.022 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.022 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:11.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:11.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.023 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.023 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.023 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:23:11.023 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.023 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:23:11.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:23:11.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.024 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:23:11.024 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:23:11.024 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.024 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.024 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:23:11.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:23:11.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:23:11.025 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:23:11.025 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.025 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.025 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.025 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:23:11.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:23:11.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:11.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:23:11.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:23:11.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.026 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:11.026 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:23:11.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:23:11.026 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.027 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.027 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.027 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:11.027 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:11.027 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 70.449389823999994, 2024-04-26T10:23:11.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:23:11.027 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.027 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.027 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.027 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.028 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.028 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:23:11.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.028 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:11.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:11.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:23:11.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:11.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:23:11.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:23:11.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:23:11.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:23:11.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:23:11.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:23:11.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:11.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:23:11.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.031 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:23:11.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:23:11.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:11.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:23:11.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:23:11.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:11.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:23:11.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:23:11.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:11.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:23:11.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:23:11.032 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.033 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.033 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.033 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:11.033 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:11.033 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 70.448369267000004, 2024-04-26T10:23:11.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:23:11.033 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.033 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.033 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.034 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:23:11.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.034 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:11.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:11.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:23:11.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:23:11.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:23:11.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:23:11.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:23:11.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:23:11.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:23:11.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.036 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:23:11.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:23:11.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:23:11.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:23:11.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:11.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:23:11.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:23:11.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:11.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:23:11.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:23:11.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:11.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:23:11.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:23:11.038 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.038 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.038 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.038 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:11.038 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:11.039 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 70.447218992000003, 2024-04-26T10:23:11.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:23:11.039 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.039 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.039 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.039 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.039 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.039 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:23:11.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.039 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:11.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:11.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:23:11.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:11.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:23:11.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:23:11.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:23:11.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:23:11.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:23:11.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:23:11.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:23:11.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:23:11.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:23:11.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:23:11.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:11.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:23:11.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:23:11.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:11.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:23:11.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:23:11.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:11.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:23:11.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:23:11.044 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.044 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.044 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.044 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:11.045 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:11.045 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.950519749999998, 2024-04-26T10:23:11.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:23:11.045 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.045 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.045 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.045 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.045 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.045 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:23:11.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.045 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:11.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:11.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:23:11.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:23:11.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:23:11.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:23:11.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:23:11.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:23:11.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:23:11.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:23:11.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:23:11.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:23:11.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:23:11.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:11.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:23:11.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:23:11.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:11.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:23:11.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:23:11.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:23:11.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:23:11.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:11.050 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:23:11.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:23:11.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.050 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:11.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:23:11.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:23:11.051 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.051 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.051 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.051 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:11.051 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:11.051 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 46.950296154, 2024-04-26T10:23:11.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:23:11.051 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.052 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.052 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.052 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.052 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.052 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:23:11.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.052 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:11.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:11.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:23:11.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:23:11.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:23:11.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:23:11.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:23:11.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:23:11.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:23:11.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:23:11.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:23:11.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:23:11.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:23:11.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:11.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:23:11.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:23:11.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:11.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:23:11.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:23:11.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:23:11.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:23:11.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:11.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:23:11.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:23:11.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:11.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:23:11.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:23:11.058 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.058 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.058 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.058 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:11.058 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:11.058 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.919449833999998, 2024-04-26T10:23:11.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:23:11.059 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.059 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.059 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.059 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.059 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.059 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:23:11.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.059 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:11.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:11.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:23:11.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:23:11.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:23:11.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:23:11.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:23:11.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:23:11.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:23:11.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:23:11.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:23:11.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:23:11.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:23:11.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:11.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:23:11.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:23:11.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:23:11.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:23:11.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:11.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:23:11.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:23:11.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:11.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:23:11.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:23:11.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.064 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:11.064 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:23:11.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:23:11.064 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.064 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.064 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.064 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:11.065 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:11.065 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.917438730999997, 2024-04-26T10:23:11.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:23:11.065 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.065 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.065 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.065 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.065 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.065 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:23:11.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.065 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:11.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:11.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:11.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:23:11.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:23:11.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:23:11.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:23:11.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:23:11.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:23:11.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:23:11.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:23:11.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:23:11.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:23:11.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.069 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:11.069 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:23:11.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:23:11.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:23:11.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:23:11.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:11.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:23:11.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:23:11.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:23:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:23:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:23:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:23:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:11.071 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:11.072 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.906560626000001, 2024-04-26T10:23:11.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:23:11.072 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.072 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.072 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.072 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.072 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.072 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:23:11.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.072 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:11.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:11.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:23:11.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:11.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:23:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:23:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:23:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:23:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.074 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:23:11.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:23:11.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:23:11.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:23:11.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:23:11.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:23:11.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:11.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:23:11.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:23:11.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:23:11.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:23:11.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:11.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:23:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:23:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:23:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:23:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:23:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:23:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.077 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.903879406999998, 2024-04-26T10:23:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:23:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.078 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:23:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:23:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:23:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:23:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:23:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:23:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:23:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:23:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:23:11.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:23:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:23:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:23:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:23:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:23:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:23:11.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:23:11.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:11.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:23:11.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:23:11.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:11.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:23:11.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:23:11.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:11.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:23:11.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:23:11.084 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.084 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.084 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.084 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.903512331999998, 2024-04-26T10:23:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:23:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:23:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:23:11.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:23:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:23:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:23:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:23:11.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:23:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:23:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:23:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:23:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:23:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:23:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:23:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:23:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:23:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:23:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:23:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:23:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:11.090 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.903448079999997, 2024-04-26T10:23:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:23:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:23:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:23:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:23:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:23:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:23:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:23:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:23:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:23:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:23:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:23:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:23:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:23:11.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:23:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:23:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:23:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:23:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:11.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:23:11.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:23:11.096 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.096 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.096 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.096 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:11.096 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:11.096 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.899049407, 2024-04-26T10:23:11.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:23:11.096 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.096 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:23:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:23:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:23:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:23:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:23:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:23:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:23:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:23:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:23:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:23:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:23:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:23:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:23:11.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:23:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:23:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:23:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:23:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:23:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.101 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 39.897291424000002, 2024-04-26T10:23:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:23:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.102 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:23:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:23:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:23:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:23:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:23:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:23:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:23:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:23:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:23:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:23:11.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:23:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:23:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:23:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:23:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:23:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:23:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:23:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:23:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:11.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:23:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:23:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:23:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:23:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.108 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.108 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:11.110 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:11.106+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:11.110 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:11.212 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:11.207+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:11.245 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:11.245 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:11.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.245 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:214323 5.c 5:3bb7d65f:::benchmark_data_smithi052_19421_object84851:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:11.245 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:11.236542+0000", 2024-04-26T10:23:11.245 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0068215960000000001, 2024-04-26T10:23:11.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068408119999999999, 2024-04-26T10:23:11.245 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.245 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:11.245 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.246 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.246 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.246 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 214323 2024-04-26T10:23:11.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.246 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.236542+0000", 2024-04-26T10:23:11.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.236542+0000", 2024-04-26T10:23:11.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.236541+0000", 2024-04-26T10:23:11.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.236544+0000", 2024-04-26T10:23:11.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6989999999999999e-06 2024-04-26T10:23:11.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.236550+0000", 2024-04-26T10:23:11.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5500000000000002e-06 2024-04-26T10:23:11.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.236556+0000", 2024-04-26T10:23:11.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1550000000000004e-06 2024-04-26T10:23:11.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240023+0000", 2024-04-26T10:23:11.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034676220000000001 2024-04-26T10:23:11.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.249 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.249 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240109+0000", 2024-04-26T10:23:11.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5786999999999997e-05 2024-04-26T10:23:11.249 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.249 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.249 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.249 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:214328 5.2 5:471cb96c:::benchmark_data_smithi052_19421_object84856:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:11.249 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:11.240390+0000", 2024-04-26T10:23:11.249 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0029732930000000001, 2024-04-26T10:23:11.250 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030413599999999999, 2024-04-26T10:23:11.250 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.250 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:11.250 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.250 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.250 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.250 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 214328 2024-04-26T10:23:11.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.250 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240390+0000", 2024-04-26T10:23:11.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240390+0000", 2024-04-26T10:23:11.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240389+0000", 2024-04-26T10:23:11.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240394+0000", 2024-04-26T10:23:11.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6349999999999997e-06 2024-04-26T10:23:11.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240410+0000", 2024-04-26T10:23:11.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6232e-05 2024-04-26T10:23:11.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240416+0000", 2024-04-26T10:23:11.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2040000000000002e-06 2024-04-26T10:23:11.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240450+0000", 2024-04-26T10:23:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4310000000000002e-05 2024-04-26T10:23:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240555+0000", 2024-04-26T10:23:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000104626 2024-04-26T10:23:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.254 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:214329 5.c 5:3848d655:::benchmark_data_smithi052_19421_object84857:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:11.254 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:11.240431+0000", 2024-04-26T10:23:11.254 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0029328190000000001, 2024-04-26T10:23:11.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030753379999999999, 2024-04-26T10:23:11.254 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.254 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:11.254 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.254 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.254 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.254 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 214329 2024-04-26T10:23:11.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.254 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240431+0000", 2024-04-26T10:23:11.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240431+0000", 2024-04-26T10:23:11.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240430+0000", 2024-04-26T10:23:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240434+0000", 2024-04-26T10:23:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6040000000000001e-06 2024-04-26T10:23:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240438+0000", 2024-04-26T10:23:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6229999999999996e-06 2024-04-26T10:23:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240444+0000", 2024-04-26T10:23:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.536e-06 2024-04-26T10:23:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.243087+0000", 2024-04-26T10:23:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002642808 2024-04-26T10:23:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.243166+0000", 2024-04-26T10:23:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8837000000000004e-05 2024-04-26T10:23:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.258 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:214331 5.c 5.6007e43c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:11.258 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:11.240454+0000", 2024-04-26T10:23:11.258 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0029092979999999998, 2024-04-26T10:23:11.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031013619999999999, 2024-04-26T10:23:11.258 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.258 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:11.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.258 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 214331 2024-04-26T10:23:11.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.259 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240454+0000", 2024-04-26T10:23:11.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240454+0000", 2024-04-26T10:23:11.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240454+0000", 2024-04-26T10:23:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240456+0000", 2024-04-26T10:23:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1569999999999998e-06 2024-04-26T10:23:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240460+0000", 2024-04-26T10:23:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1450000000000001e-06 2024-04-26T10:23:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240464+0000", 2024-04-26T10:23:11.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4649999999999999e-06 2024-04-26T10:23:11.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.261 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.261 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:214333 5.1 5:813551e5:::benchmark_data_smithi052_19421_object84861:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:11.261 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:11.240468+0000", 2024-04-26T10:23:11.261 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0028950820000000002, 2024-04-26T10:23:11.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031262299999999998, 2024-04-26T10:23:11.262 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.262 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:11.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.262 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 214333 2024-04-26T10:23:11.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.262 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240468+0000", 2024-04-26T10:23:11.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240468+0000", 2024-04-26T10:23:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240468+0000", 2024-04-26T10:23:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240470+0000", 2024-04-26T10:23:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.012e-06 2024-04-26T10:23:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240474+0000", 2024-04-26T10:23:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5329999999999999e-06 2024-04-26T10:23:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240477+0000", 2024-04-26T10:23:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0709999999999999e-06 2024-04-26T10:23:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240520+0000", 2024-04-26T10:23:11.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3696999999999999e-05 2024-04-26T10:23:11.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240649+0000", 2024-04-26T10:23:11.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012830400000000001 2024-04-26T10:23:11.265 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.265 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.265 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.265 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:214335 5.5 5:a37048b1:::benchmark_data_smithi052_19421_object84863:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:11.265 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:11.240494+0000", 2024-04-26T10:23:11.265 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0028692919999999998, 2024-04-26T10:23:11.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031393020000000001, 2024-04-26T10:23:11.266 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.266 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:11.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.266 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 214335 2024-04-26T10:23:11.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.266 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240494+0000", 2024-04-26T10:23:11.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240494+0000", 2024-04-26T10:23:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240494+0000", 2024-04-26T10:23:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240497+0000", 2024-04-26T10:23:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.343e-06 2024-04-26T10:23:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240510+0000", 2024-04-26T10:23:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2642e-05 2024-04-26T10:23:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240515+0000", 2024-04-26T10:23:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7150000000000003e-06 2024-04-26T10:23:11.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240557+0000", 2024-04-26T10:23:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2035e-05 2024-04-26T10:23:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240670+0000", 2024-04-26T10:23:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112586 2024-04-26T10:23:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.269 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:214336 5.7 5:ecc41f9a:::benchmark_data_smithi052_19421_object84864:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:11.240869+0000", 2024-04-26T10:23:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002495035, 2024-04-26T10:23:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002815031, 2024-04-26T10:23:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 214336 2024-04-26T10:23:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240869+0000", 2024-04-26T10:23:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240869+0000", 2024-04-26T10:23:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240867+0000", 2024-04-26T10:23:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240874+0000", 2024-04-26T10:23:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.032e-06 2024-04-26T10:23:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240885+0000", 2024-04-26T10:23:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1273e-05 2024-04-26T10:23:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240892+0000", 2024-04-26T10:23:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5630000000000003e-06 2024-04-26T10:23:11.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240947+0000", 2024-04-26T10:23:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4595999999999997e-05 2024-04-26T10:23:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.241112+0000", 2024-04-26T10:23:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016534199999999999 2024-04-26T10:23:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.273 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:214330 5.b e62/37 5:d5a1cc10:::benchmark_data_smithi052_19421_object84858:head v 62'13287, mlcod=62'13285)", 2024-04-26T10:23:11.274 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:11.240999+0000", 2024-04-26T10:23:11.274 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0023649130000000002, 2024-04-26T10:23:11.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027449969999999999, 2024-04-26T10:23:11.274 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.274 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:11.274 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240999+0000", 2024-04-26T10:23:11.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240999+0000", 2024-04-26T10:23:11.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.240998+0000", 2024-04-26T10:23:11.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.241005+0000", 2024-04-26T10:23:11.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0010000000000004e-06 2024-04-26T10:23:11.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.241014+0000", 2024-04-26T10:23:11.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9660000000000002e-06 2024-04-26T10:23:11.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.241020+0000", 2024-04-26T10:23:11.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8579999999999996e-06 2024-04-26T10:23:11.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.241088+0000", 2024-04-26T10:23:11.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8157000000000005e-05 2024-04-26T10:23:11.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.241109+0000", 2024-04-26T10:23:11.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1586e-05 2024-04-26T10:23:11.277 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.277 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.277 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.277 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:214338 5.c 5.3641954c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:11.277 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:11.242534+0000", 2024-04-26T10:23:11.277 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00082957400000000002, 2024-04-26T10:23:11.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001259724, 2024-04-26T10:23:11.277 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.278 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:11.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.278 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.278 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 214338 2024-04-26T10:23:11.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.278 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.242534+0000", 2024-04-26T10:23:11.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.242534+0000", 2024-04-26T10:23:11.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.242533+0000", 2024-04-26T10:23:11.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.242538+0000", 2024-04-26T10:23:11.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6099999999999999e-06 2024-04-26T10:23:11.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.242548+0000", 2024-04-26T10:23:11.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0142e-05 2024-04-26T10:23:11.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.242553+0000", 2024-04-26T10:23:11.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3680000000000001e-06 2024-04-26T10:23:11.280 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.280 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.280 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:214339 5.7 5:e06fe971:::benchmark_data_smithi052_19421_object84867:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:11.243452+0000", 2024-04-26T10:23:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999118, 2024-04-26T10:23:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039625100000000003, 2024-04-26T10:23:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 214339 2024-04-26T10:23:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.243452+0000", 2024-04-26T10:23:11.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.243452+0000", 2024-04-26T10:23:11.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.243451+0000", 2024-04-26T10:23:11.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.243456+0000", 2024-04-26T10:23:11.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2399999999999998e-06 2024-04-26T10:23:11.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.243466+0000", 2024-04-26T10:23:11.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9420000000000007e-06 2024-04-26T10:23:11.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.243473+0000", 2024-04-26T10:23:11.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9809999999999997e-06 2024-04-26T10:23:11.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.243522+0000", 2024-04-26T10:23:11.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9098000000000003e-05 2024-04-26T10:23:11.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.243716+0000", 2024-04-26T10:23:11.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000193439 2024-04-26T10:23:11.284 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:214340 5.9 5:99bc2210:::benchmark_data_smithi052_19421_object84868:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:11.243668+0000", 2024-04-26T10:23:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9996953, 2024-04-26T10:23:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00023715300000000001, 2024-04-26T10:23:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 214340 2024-04-26T10:23:11.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.286 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.243668+0000", 2024-04-26T10:23:11.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.243668+0000", 2024-04-26T10:23:11.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.243667+0000", 2024-04-26T10:23:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.243672+0000", 2024-04-26T10:23:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9509999999999997e-06 2024-04-26T10:23:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.243681+0000", 2024-04-26T10:23:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6049999999999998e-06 2024-04-26T10:23:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.243702+0000", 2024-04-26T10:23:11.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1311999999999999e-05 2024-04-26T10:23:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.243746+0000", 2024-04-26T10:23:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3686999999999997e-05 2024-04-26T10:23:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.243871+0000", 2024-04-26T10:23:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012552700000000001 2024-04-26T10:23:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.289 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:214320 5.c 5:389f2da7:::benchmark_data_smithi052_19421_object84848:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:11.289 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:11.236477+0000", 2024-04-26T10:23:11.289 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0068868560000000002, 2024-04-26T10:23:11.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0074808740000000002, 2024-04-26T10:23:11.289 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.289 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:11.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.289 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.289 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 214320 2024-04-26T10:23:11.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.289 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.236477+0000", 2024-04-26T10:23:11.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.236477+0000", 2024-04-26T10:23:11.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.236476+0000", 2024-04-26T10:23:11.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.236490+0000", 2024-04-26T10:23:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4218e-05 2024-04-26T10:23:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.236501+0000", 2024-04-26T10:23:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0372e-05 2024-04-26T10:23:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.236506+0000", 2024-04-26T10:23:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5339999999999999e-06 2024-04-26T10:23:11.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.236550+0000", 2024-04-26T10:23:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3511999999999999e-05 2024-04-26T10:23:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:11.238567+0000", 2024-04-26T10:23:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020173639999999998 2024-04-26T10:23:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:23:11.292 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 12 2024-04-26T10:23:11.293 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:11.294 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:11.311 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:11.310+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:11.412 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:11.410+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:11.426 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:11.426 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:11.426 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:23:11.426 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:23:11.426 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:11.439 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:11.513 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:11.510+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:11.570 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:11.570 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:23:11.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:23:11.570 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:11.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.570 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:11.570 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:11.570 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.528850660000003, 2024-04-26T10:23:11.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:23:11.570 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.570 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.570 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.570 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.571 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.571 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:23:11.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.571 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:11.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:11.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:11.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:23:11.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:23:11.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:23:11.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:23:11.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:23:11.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:23:11.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:23:11.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:23:11.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:23:11.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:23:11.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:23:11.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:23:11.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:23:11.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:23:11.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:23:11.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:23:11.575 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.575 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.575 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.575 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:11.575 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:11.575 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.528741408999998, 2024-04-26T10:23:11.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:23:11.575 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:23:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:23:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:23:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:23:11.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:23:11.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:23:11.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:23:11.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:23:11.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:23:11.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:23:11.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:23:11.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:23:11.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:23:11.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:23:11.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:23:11.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:23:11.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:23:11.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.580 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.580 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.580 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:11.580 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:11.580 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.526343996999998, 2024-04-26T10:23:11.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:23:11.580 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.580 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.580 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.580 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.580 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.580 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:23:11.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.581 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:11.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:11.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:23:11.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:11.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:23:11.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:23:11.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:23:11.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:23:11.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:23:11.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:23:11.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:23:11.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:23:11.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:23:11.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:23:11.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:11.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:23:11.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:23:11.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:23:11.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:23:11.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:23:11.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:23:11.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:23:11.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:23:11.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:23:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:23:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.526158072999998, 2024-04-26T10:23:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:23:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.586 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:23:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:23:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:23:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:23:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:23:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:23:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:23:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:23:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:23:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:23:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:23:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:23:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:23:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:23:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:23:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:23:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:23:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:23:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:23:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:23:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:23:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:23:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:11.591 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.436135456999999, 2024-04-26T10:23:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:23:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:23:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:23:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:23:11.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:23:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:23:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:23:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:23:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:23:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:23:11.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:23:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:23:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:23:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:23:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:23:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:23:11.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:23:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:23:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:23:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:23:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:23:11.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:23:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:23:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:23:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:23:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:23:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.413033210999998, 2024-04-26T10:23:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:23:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:23:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:23:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:11.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:23:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:23:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:23:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:23:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:23:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:23:11.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:23:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:23:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:23:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:23:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:23:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:23:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:23:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:23:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:23:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:23:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:23:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:23:11.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:23:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:23:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:23:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:23:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:23:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:23:11.603 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.406350072999999, 2024-04-26T10:23:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:23:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.604 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:23:11.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.605 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:11.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:11.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:23:11.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:23:11.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:23:11.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:23:11.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:23:11.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:23:11.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:23:11.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:23:11.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:23:11.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:11.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:23:11.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:23:11.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:23:11.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:23:11.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:23:11.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:23:11.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:11.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:23:11.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:23:11.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:23:11.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:23:11.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:23:11.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:23:11.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:23:11.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:23:11.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:23:11.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:23:11.610 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.610 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.610 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.611 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:11.611 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:11.611 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.404352287999998, 2024-04-26T10:23:11.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:23:11.611 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.611 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.611 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:23:11.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.612 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:11.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:11.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:23:11.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:11.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:23:11.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:23:11.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:23:11.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:23:11.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:23:11.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:23:11.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:23:11.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:23:11.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:11.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:23:11.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:11.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:23:11.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:23:11.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:23:11.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:23:11.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:11.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:23:11.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:23:11.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:23:11.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:23:11.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:23:11.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:23:11.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:23:11.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:23:11.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:23:11.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:23:11.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.617 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.617 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:11.617 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:11.617 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.394943583, 2024-04-26T10:23:11.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:23:11.617 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.617 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.618 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:23:11.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.618 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:11.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:11.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:23:11.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:23:11.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:23:11.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:23:11.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:11.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:23:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:23:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:23:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:23:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:23:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:23:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:23:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:23:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:23:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:23:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:23:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:23:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:23:11.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:23:11.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:23:11.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:23:11.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:23:11.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:23:11.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:23:11.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:23:11.623 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.623 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.623 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.623 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:11.623 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:11.623 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.393115534, 2024-04-26T10:23:11.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:23:11.623 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.623 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.623 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.624 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:23:11.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.624 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:11.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:11.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:23:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:23:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:23:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:23:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:23:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:23:11.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:23:11.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:23:11.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:23:11.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:11.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:23:11.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:23:11.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:23:11.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:23:11.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:23:11.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:23:11.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:11.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:23:11.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:23:11.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:23:11.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:23:11.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:23:11.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:23:11.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:23:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:23:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:23:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:23:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.381535811999999, 2024-04-26T10:23:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:23:11.629 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.630 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.630 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:23:11.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.630 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:11.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:11.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:11.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:23:11.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:23:11.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:23:11.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:23:11.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:23:11.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:23:11.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:23:11.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:23:11.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:11.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:23:11.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:23:11.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:23:11.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:23:11.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:23:11.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:23:11.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:11.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:23:11.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:23:11.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:23:11.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:23:11.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:23:11.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:23:11.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:23:11.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:23:11.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:23:11.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:23:11.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.636 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.636 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:11.636 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:11.636 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.375125317999998, 2024-04-26T10:23:11.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:23:11.636 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.636 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.636 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:23:11.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.637 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:11.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:11.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:23:11.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:23:11.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:23:11.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:23:11.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:23:11.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:23:11.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:11.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:23:11.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:23:11.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:11.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:23:11.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:23:11.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:23:11.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:23:11.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:23:11.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:23:11.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:11.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:23:11.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:23:11.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:23:11.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:23:11.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:23:11.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:23:11.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:23:11.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:23:11.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:23:11.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:23:11.641 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.642 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.642 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:11.642 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:11.642 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.362540254999999, 2024-04-26T10:23:11.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:23:11.642 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.642 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.642 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.642 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:23:11.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.643 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:11.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:11.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:23:11.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:23:11.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:11.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:23:11.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:23:11.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:23:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:23:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:23:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:23:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:23:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:23:11.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:23:11.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:23:11.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:23:11.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:11.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:23:11.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:23:11.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:23:11.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:23:11.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:23:11.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:23:11.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:23:11.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:23:11.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:23:11.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:23:11.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.648 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.648 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:11.648 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:11.648 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.362305322000001, 2024-04-26T10:23:11.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:23:11.648 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.648 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.648 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.648 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.648 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.648 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:23:11.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.649 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:11.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:11.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:23:11.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:23:11.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:23:11.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:23:11.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:23:11.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:23:11.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:23:11.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:23:11.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:23:11.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:11.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:23:11.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:11.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:23:11.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:23:11.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:23:11.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:23:11.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:11.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:23:11.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:23:11.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:23:11.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:23:11.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:23:11.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:23:11.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:23:11.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:23:11.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:23:11.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:23:11.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.654 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.654 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:11.654 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:11.654 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.324430445000001, 2024-04-26T10:23:11.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:23:11.655 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.655 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.655 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:23:11.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.655 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:11.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:11.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:23:11.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:11.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:23:11.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:23:11.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:23:11.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:23:11.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:23:11.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:23:11.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:23:11.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:23:11.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:11.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:23:11.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:11.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:23:11.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:23:11.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:23:11.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:23:11.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:11.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:23:11.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:23:11.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:23:11.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:23:11.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:23:11.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:23:11.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:23:11.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:23:11.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:23:11.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:23:11.660 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.660 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.660 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.661 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:11.661 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:11.661 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.32398542, 2024-04-26T10:23:11.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:23:11.661 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.661 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.661 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:23:11.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.661 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:11.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:11.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:23:11.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:23:11.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:23:11.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:23:11.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:23:11.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:23:11.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:23:11.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:23:11.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:23:11.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:11.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:23:11.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:23:11.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:23:11.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:23:11.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:23:11.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:23:11.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:11.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:23:11.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:23:11.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:23:11.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:23:11.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:23:11.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:23:11.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:23:11.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:23:11.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:23:11.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:23:11.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.667 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.667 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:11.667 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:11.667 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.312382419999999, 2024-04-26T10:23:11.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:23:11.667 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.667 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.667 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.667 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:23:11.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:23:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:11.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:23:11.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:23:11.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:23:11.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:23:11.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:23:11.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:23:11.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:23:11.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:23:11.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:11.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:23:11.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:23:11.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:23:11.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:23:11.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:23:11.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:23:11.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:11.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:23:11.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:23:11.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:23:11.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:23:11.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:23:11.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:23:11.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:23:11.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:23:11.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:23:11.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:23:11.672 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.672 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.311108829999998, 2024-04-26T10:23:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:23:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:23:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:11.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:11.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:23:11.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:23:11.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:23:11.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:23:11.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:23:11.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:23:11.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:23:11.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:23:11.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:23:11.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:11.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:23:11.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:23:11.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:23:11.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:23:11.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:23:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:23:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:23:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:23:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:23:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:23:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:23:11.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:23:11.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:23:11.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:23:11.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:23:11.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:23:11.678 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.678 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.678 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.679 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:11.679 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:11.679 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.294351529, 2024-04-26T10:23:11.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:23:11.679 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.679 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.679 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:23:11.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.680 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:11.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:11.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:23:11.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:23:11.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:23:11.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:23:11.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:23:11.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:23:11.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:23:11.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:23:11.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:23:11.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:11.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:23:11.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:23:11.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:23:11.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:23:11.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:23:11.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:23:11.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:11.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:23:11.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:23:11.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:23:11.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:23:11.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:23:11.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:23:11.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:23:11.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:23:11.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:23:11.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:23:11.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.685 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.685 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:11.685 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:11.685 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 22.249439507999998, 2024-04-26T10:23:11.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:23:11.685 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:11.685 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:11.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:11.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:11.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.686 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:23:11.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.686 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:11.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:11.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:11.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:11.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:11.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:11.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:11.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:23:11.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:11.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:23:11.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:23:11.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:11.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:23:11.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:23:11.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:23:11.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:23:11.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:23:11.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:23:11.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:11.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:23:11.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:23:11.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:11.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:23:11.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:23:11.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:11.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:23:11.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:23:11.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:11.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:23:11.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:23:11.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:11.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:23:11.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:23:11.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:11.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:23:11.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:23:11.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:11.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:23:11.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:23:11.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:11.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:11.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:11.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:23:11.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:23:11.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.691 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:11.691 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:11.691 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:11.693 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:11.693 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:11.687+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:11.793 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:11.787+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:11.820 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:11.820 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:11.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.820 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:215642 5.a 5:5f350d3a:::benchmark_data_smithi052_19421_object86170:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:11.820 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:11.816256+0000", 2024-04-26T10:23:11.820 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0041227820000000002, 2024-04-26T10:23:11.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041425949999999998, 2024-04-26T10:23:11.820 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.820 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:11.820 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.820 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.821 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.821 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 215642 2024-04-26T10:23:11.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.821 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.821 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816256+0000", 2024-04-26T10:23:11.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.821 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816256+0000", 2024-04-26T10:23:11.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816255+0000", 2024-04-26T10:23:11.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816259+0000", 2024-04-26T10:23:11.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.408e-06 2024-04-26T10:23:11.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816273+0000", 2024-04-26T10:23:11.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3767999999999999e-05 2024-04-26T10:23:11.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816278+0000", 2024-04-26T10:23:11.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1290000000000004e-06 2024-04-26T10:23:11.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.817367+0000", 2024-04-26T10:23:11.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010892950000000001 2024-04-26T10:23:11.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.817575+0000", 2024-04-26T10:23:11.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000207715 2024-04-26T10:23:11.824 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.824 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.824 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.824 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:215640 5.9 e62/37 5:97ca43dc:::benchmark_data_smithi052_19421_object86168:head v 62'13568, mlcod=62'13566)", 2024-04-26T10:23:11.824 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:11.816273+0000", 2024-04-26T10:23:11.824 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0041057259999999996, 2024-04-26T10:23:11.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041767000000000002, 2024-04-26T10:23:11.824 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.824 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:11.825 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816273+0000", 2024-04-26T10:23:11.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816273+0000", 2024-04-26T10:23:11.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.826 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816272+0000", 2024-04-26T10:23:11.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.826 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.826 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816281+0000", 2024-04-26T10:23:11.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.7970000000000006e-06 2024-04-26T10:23:11.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.826 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.826 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816289+0000", 2024-04-26T10:23:11.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.3250000000000008e-06 2024-04-26T10:23:11.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816301+0000", 2024-04-26T10:23:11.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1419e-05 2024-04-26T10:23:11.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816336+0000", 2024-04-26T10:23:11.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5196e-05 2024-04-26T10:23:11.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816358+0000", 2024-04-26T10:23:11.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1883999999999999e-05 2024-04-26T10:23:11.827 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.827 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.827 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.828 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:215643 5.e 5:7564931e:::benchmark_data_smithi052_19421_object86171:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:11.828 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:11.816287+0000", 2024-04-26T10:23:11.828 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0040917560000000002, 2024-04-26T10:23:11.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041991750000000003, 2024-04-26T10:23:11.828 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.828 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:11.828 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.828 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.828 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.828 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 215643 2024-04-26T10:23:11.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.828 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816287+0000", 2024-04-26T10:23:11.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816287+0000", 2024-04-26T10:23:11.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816286+0000", 2024-04-26T10:23:11.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816288+0000", 2024-04-26T10:23:11.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9599999999999999e-06 2024-04-26T10:23:11.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816292+0000", 2024-04-26T10:23:11.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.4939999999999999e-06 2024-04-26T10:23:11.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816295+0000", 2024-04-26T10:23:11.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.869e-06 2024-04-26T10:23:11.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816330+0000", 2024-04-26T10:23:11.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5692999999999999e-05 2024-04-26T10:23:11.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816424+0000", 2024-04-26T10:23:11.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3876999999999996e-05 2024-04-26T10:23:11.831 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.831 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.831 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.832 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:215644 5.e 5:7438bca1:::benchmark_data_smithi052_19421_object86172:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:11.832 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:11.816305+0000", 2024-04-26T10:23:11.832 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.004073218, 2024-04-26T10:23:11.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0042203789999999998, 2024-04-26T10:23:11.832 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.832 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:11.832 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:11.832 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:11.832 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:11.832 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 215644 2024-04-26T10:23:11.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.832 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816305+0000", 2024-04-26T10:23:11.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816305+0000", 2024-04-26T10:23:11.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816305+0000", 2024-04-26T10:23:11.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816307+0000", 2024-04-26T10:23:11.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.277e-06 2024-04-26T10:23:11.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816314+0000", 2024-04-26T10:23:11.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.058e-06 2024-04-26T10:23:11.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816321+0000", 2024-04-26T10:23:11.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8009999999999998e-06 2024-04-26T10:23:11.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.818581+0000", 2024-04-26T10:23:11.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022605149999999998 2024-04-26T10:23:11.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.818744+0000", 2024-04-26T10:23:11.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162578 2024-04-26T10:23:11.835 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.835 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.835 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.836 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:215641 5.0 e62/54 5:09011503:::benchmark_data_smithi052_19421_object86169:head v 62'13464, mlcod=62'13462)", 2024-04-26T10:23:11.836 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:11.816573+0000", 2024-04-26T10:23:11.836 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0038049799999999999, 2024-04-26T10:23:11.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0039966250000000002, 2024-04-26T10:23:11.836 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.836 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:11.836 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816573+0000", 2024-04-26T10:23:11.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816573+0000", 2024-04-26T10:23:11.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816573+0000", 2024-04-26T10:23:11.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:11.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816581+0000", 2024-04-26T10:23:11.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4339999999999992e-06 2024-04-26T10:23:11.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816590+0000", 2024-04-26T10:23:11.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5110000000000003e-06 2024-04-26T10:23:11.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816596+0000", 2024-04-26T10:23:11.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0650000000000004e-06 2024-04-26T10:23:11.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816635+0000", 2024-04-26T10:23:11.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9462999999999998e-05 2024-04-26T10:23:11.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.816659+0000", 2024-04-26T10:23:11.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3268000000000002e-05 2024-04-26T10:23:11.839 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.839 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.839 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.839 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:215648 5.f e62/37 5:f81d5e1b:::benchmark_data_smithi052_19421_object86176:head v 62'13606, mlcod=62'13604)", 2024-04-26T10:23:11.839 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:11.819704+0000", 2024-04-26T10:23:11.840 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00067406499999999995, 2024-04-26T10:23:11.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00089911799999999997, 2024-04-26T10:23:11.840 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:11.840 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:11.840 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:11.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:11.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.819704+0000", 2024-04-26T10:23:11.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:11.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.819704+0000", 2024-04-26T10:23:11.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:11.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:11.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.819703+0000", 2024-04-26T10:23:11.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:11.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:11.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.819710+0000", 2024-04-26T10:23:11.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:23:11.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:11.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.819720+0000", 2024-04-26T10:23:11.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0098999999999999e-05 2024-04-26T10:23:11.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:11.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.819726+0000", 2024-04-26T10:23:11.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3279999999999996e-06 2024-04-26T10:23:11.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:11.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.819758+0000", 2024-04-26T10:23:11.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1928999999999999e-05 2024-04-26T10:23:11.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:11.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:11.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:11.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:11.819772+0000", 2024-04-26T10:23:11.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4436e-05 2024-04-26T10:23:11.843 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.843 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:11.843 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.843 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:11.843 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:23:11.843 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 6 2024-04-26T10:23:11.843 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:11.844 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:11.894 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:11.890+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:11.966 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:11.966 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:11.966 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:23:11.967 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:23:11.967 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:11.979 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:12.023 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:12.022+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:12.096 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:12.094+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:12.107 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:12.107 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:23:12.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:23:12.107 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:12.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.107 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:12.107 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:12.107 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 71.574618947000005, 2024-04-26T10:23:12.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:23:12.107 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.108 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.108 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:12.108 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:12.108 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.108 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:23:12.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.108 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:12.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:12.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:23:12.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:12.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:23:12.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:23:12.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:23:12.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:23:12.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:23:12.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:23:12.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:23:12.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:23:12.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:23:12.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:23:12.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:12.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:23:12.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:23:12.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:23:12.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:23:12.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:23:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:23:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 71.572636720000006, 2024-04-26T10:23:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:23:12.112 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:23:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:23:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:23:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:23:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:23:12.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:23:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:23:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:23:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:23:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:23:12.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:23:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:23:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:23:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:23:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:23:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:23:12.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:23:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:23:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:23:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 71.572437335999993, 2024-04-26T10:23:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:23:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.117 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:23:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:23:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:23:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:23:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:23:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:23:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:23:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:23:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:23:12.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:23:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:23:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:23:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:23:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:23:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:23:12.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:23:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:23:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:23:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 71.572218715999995, 2024-04-26T10:23:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:23:12.122 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:23:12.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:12.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:23:12.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:23:12.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:23:12.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:23:12.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:23:12.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:23:12.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:23:12.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:23:12.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:23:12.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:23:12.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:23:12.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:23:12.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:23:12.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:23:12.126 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.126 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.126 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.126 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:12.127 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:12.127 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 71.569847277999997, 2024-04-26T10:23:12.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:23:12.127 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.127 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.127 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:12.127 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:12.127 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.127 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:23:12.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.127 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:12.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:12.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:23:12.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:12.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:23:12.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:23:12.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:23:12.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:23:12.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:23:12.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:23:12.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:12.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:23:12.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:23:12.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:23:12.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:12.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:23:12.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:23:12.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:23:12.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:23:12.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:23:12.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:23:12.131 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.131 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.131 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.131 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:12.131 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:12.132 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 71.569746656000007, 2024-04-26T10:23:12.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:23:12.132 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.132 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.132 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:12.132 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:12.132 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.132 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:23:12.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.132 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:12.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:12.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:23:12.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:12.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:23:12.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:23:12.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:23:12.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:23:12.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:23:12.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:23:12.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:23:12.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:23:12.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:23:12.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:23:12.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.135 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:12.135 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:23:12.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:23:12.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:23:12.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:23:12.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:23:12.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:23:12.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.136 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.136 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.137 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:23:12.137 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:12.137 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 71.569628094999999, 2024-04-26T10:23:12.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:23:12.137 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.137 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.137 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:12.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:12.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:23:12.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:12.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:23:12.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:23:12.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:23:12.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:23:12.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:23:12.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:23:12.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:23:12.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:23:12.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:23:12.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:23:12.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:23:12.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:23:12.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:23:12.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:23:12.141 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.141 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.141 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.141 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:12.141 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:12.141 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 71.569525697000003, 2024-04-26T10:23:12.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:23:12.141 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.141 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:12.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:12.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.142 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:23:12.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.142 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:12.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:12.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:23:12.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:12.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:23:12.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:23:12.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:23:12.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:23:12.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:23:12.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:23:12.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:12.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:23:12.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:23:12.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:23:12.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:12.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:23:12.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:23:12.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:23:12.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:23:12.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:23:12.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:23:12.145 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.146 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.146 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.146 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:12.146 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:12.146 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 71.568505139999999, 2024-04-26T10:23:12.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:23:12.146 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.146 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.146 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:12.146 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:12.146 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.146 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:23:12.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.147 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:12.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.147 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:12.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.147 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:23:12.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:12.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:23:12.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:23:12.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:23:12.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:23:12.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:23:12.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:23:12.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:23:12.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:23:12.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:23:12.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:23:12.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:12.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:23:12.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:23:12.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:23:12.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:23:12.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:23:12.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:23:12.151 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.151 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.151 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.151 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:12.151 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:12.151 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 71.567354864999999, 2024-04-26T10:23:12.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:23:12.151 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.151 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.151 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:12.151 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:12.151 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.152 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:23:12.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.152 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:12.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:12.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:23:12.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:12.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:23:12.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:23:12.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.153 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.153 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:23:12.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:23:12.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:23:12.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:23:12.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:23:12.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:23:12.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:23:12.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:23:12.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:12.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:23:12.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:23:12.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:23:12.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:23:12.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:23:12.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:23:12.156 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.156 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.156 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.156 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:12.156 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:12.156 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.070655623, 2024-04-26T10:23:12.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:23:12.156 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.156 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.156 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:12.157 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:12.157 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.157 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:23:12.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.157 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:12.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:12.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:23:12.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:12.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:23:12.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:23:12.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:23:12.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:23:12.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:23:12.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:23:12.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:23:12.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:23:12.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:23:12.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:23:12.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:12.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:23:12.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:23:12.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:12.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:23:12.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:23:12.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:12.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:23:12.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:23:12.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:23:12.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:23:12.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:23:12.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:23:12.162 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.162 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.162 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.162 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:12.162 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:12.162 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.070432027000003, 2024-04-26T10:23:12.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:23:12.162 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.162 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.162 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:12.162 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:12.162 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.162 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:23:12.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.163 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:12.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:12.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:23:12.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:12.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:23:12.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:23:12.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:23:12.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:23:12.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:23:12.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:23:12.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:23:12.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:23:12.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:23:12.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:23:12.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:12.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:23:12.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:23:12.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:12.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:23:12.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:23:12.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:12.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:23:12.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:23:12.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:23:12.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:23:12.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:23:12.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:23:12.167 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.167 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.167 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.167 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:12.167 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:12.167 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.039585707000001, 2024-04-26T10:23:12.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:23:12.167 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.167 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.167 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:12.167 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:12.168 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.168 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:23:12.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.168 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:12.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:12.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:23:12.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:12.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:23:12.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:23:12.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:23:12.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:23:12.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:23:12.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:23:12.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:23:12.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:23:12.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:23:12.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:23:12.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:12.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:23:12.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:23:12.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:12.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:23:12.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:23:12.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:12.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:23:12.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:23:12.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:23:12.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:23:12.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:23:12.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:23:12.172 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.172 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.173 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.173 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:12.173 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:12.173 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.037574604, 2024-04-26T10:23:12.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:23:12.173 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.173 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.173 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:12.173 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:12.173 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.173 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:23:12.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.173 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:12.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:12.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:12.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:12.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:23:12.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:23:12.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:23:12.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:23:12.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:23:12.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:23:12.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:23:12.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:23:12.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:23:12.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:23:12.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:12.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:23:12.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:23:12.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:12.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:23:12.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:23:12.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:12.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:23:12.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:23:12.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:23:12.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:23:12.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:23:12.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:23:12.178 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.178 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.178 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.178 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:12.178 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:12.178 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.026696499000003, 2024-04-26T10:23:12.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:23:12.178 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.178 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.178 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:12.178 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:12.179 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.179 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:23:12.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.179 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:12.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:12.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:23:12.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:12.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:23:12.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:23:12.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:23:12.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:23:12.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:23:12.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:23:12.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:23:12.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:23:12.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:23:12.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:23:12.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:12.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:23:12.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:23:12.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:12.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:23:12.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:23:12.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:12.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:23:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:23:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:23:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:23:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:23:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:23:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.183 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.02401528, 2024-04-26T10:23:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:23:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:23:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:23:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:23:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:23:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:23:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:23:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:23:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:23:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:23:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:23:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:23:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:23:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:23:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:23:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:23:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:23:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:23:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:23:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:23:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:23:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:23:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:23:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.023648205000001, 2024-04-26T10:23:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:23:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.189 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:23:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:23:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:23:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:23:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:23:12.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:23:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:23:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:23:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:23:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:23:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:23:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:23:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:23:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:23:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:23:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:23:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:23:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:23:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.023583952999999, 2024-04-26T10:23:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:23:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:12.194 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:23:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:12.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:23:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:23:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:23:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:23:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:23:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:23:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:23:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:23:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:23:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:23:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:23:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:23:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:23:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:23:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:23:12.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:23:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:23:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.019185280000002, 2024-04-26T10:23:12.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:23:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:23:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:23:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:23:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:23:12.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:23:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:23:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:23:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:23:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:23:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:23:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:23:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:23:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:23:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:23:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:23:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:23:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:23:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:23:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:12.204 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 41.017427296999998, 2024-04-26T10:23:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:23:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:23:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:23:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:23:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:23:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:12.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:23:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:23:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:23:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:23:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:23:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:23:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:12.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:23:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:23:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:23:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:23:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:23:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:23:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:23:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:23:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:23:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:23:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:23:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:23:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.209 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.210 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:12.210 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:12.210 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:12.211 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:12.212 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:12.207+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:12.257 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:23:12.311 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:12.307+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:12.340 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:12.340 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:12.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.341 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:216928 5.f 5:f7eab7c9:::benchmark_data_smithi052_19421_object87456:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:12.341 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:12.336998+0000", 2024-04-26T10:23:12.341 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00061859199999999995, 2024-04-26T10:23:12.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00064133400000000002, 2024-04-26T10:23:12.341 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:12.341 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:12.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:12.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:12.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.341 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 216928 2024-04-26T10:23:12.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.341 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:12.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:12.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.336998+0000", 2024-04-26T10:23:12.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:12.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.336998+0000", 2024-04-26T10:23:12.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:12.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.336997+0000", 2024-04-26T10:23:12.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:12.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:12.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337002+0000", 2024-04-26T10:23:12.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1230000000000002e-06 2024-04-26T10:23:12.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:12.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337018+0000", 2024-04-26T10:23:12.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6073999999999999e-05 2024-04-26T10:23:12.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337026+0000", 2024-04-26T10:23:12.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9359999999999999e-06 2024-04-26T10:23:12.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:12.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337058+0000", 2024-04-26T10:23:12.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2604999999999997e-05 2024-04-26T10:23:12.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:12.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337144+0000", 2024-04-26T10:23:12.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5847000000000007e-05 2024-04-26T10:23:12.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:12.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337206+0000", 2024-04-26T10:23:12.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2457000000000002e-05 2024-04-26T10:23:12.344 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.345 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:12.345 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.345 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:216933 5.2 5:43d5306f:::benchmark_data_smithi052_19421_object87461:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:12.345 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:12.337246+0000", 2024-04-26T10:23:12.345 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00037106800000000001, 2024-04-26T10:23:12.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00046619599999999999, 2024-04-26T10:23:12.345 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:12.345 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:12.345 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:12.345 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:12.345 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.346 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 216933 2024-04-26T10:23:12.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.346 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:12.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:12.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337246+0000", 2024-04-26T10:23:12.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:12.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337246+0000", 2024-04-26T10:23:12.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:12.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337245+0000", 2024-04-26T10:23:12.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:12.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:12.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337249+0000", 2024-04-26T10:23:12.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0090000000000001e-06 2024-04-26T10:23:12.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:12.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337257+0000", 2024-04-26T10:23:12.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8369999999999997e-06 2024-04-26T10:23:12.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337263+0000", 2024-04-26T10:23:12.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7049999999999996e-06 2024-04-26T10:23:12.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:12.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337309+0000", 2024-04-26T10:23:12.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6507e-05 2024-04-26T10:23:12.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337440+0000", 2024-04-26T10:23:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013114499999999999 2024-04-26T10:23:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:216929 5.b e62/37 5:d74ee8cd:::benchmark_data_smithi052_19421_object87457:head v 62'13460, mlcod=62'13457)", 2024-04-26T10:23:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:12.337594+0000", 2024-04-26T10:23:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 2.3053000000000001e-05, 2024-04-26T10:23:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001771, 2024-04-26T10:23:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:12.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:12.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337594+0000", 2024-04-26T10:23:12.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:12.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337594+0000", 2024-04-26T10:23:12.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:12.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337593+0000", 2024-04-26T10:23:12.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:12.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337598+0000", 2024-04-26T10:23:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9010000000000002e-06 2024-04-26T10:23:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337606+0000", 2024-04-26T10:23:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7740000000000004e-06 2024-04-26T10:23:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337611+0000", 2024-04-26T10:23:12.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1259999999999997e-06 2024-04-26T10:23:12.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:12.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337653+0000", 2024-04-26T10:23:12.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2352999999999999e-05 2024-04-26T10:23:12.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:12.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337677+0000", 2024-04-26T10:23:12.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3921999999999999e-05 2024-04-26T10:23:12.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.352 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:12.352 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:216913 5.4 e62/37 5:2852ed04:::benchmark_data_smithi052_19421_object87441:head v 62'13668, mlcod=62'13666)", 2024-04-26T10:23:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:12.330018+0000", 2024-04-26T10:23:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0075987270000000004, 2024-04-26T10:23:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0078072879999999999, 2024-04-26T10:23:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.330018+0000", 2024-04-26T10:23:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.330018+0000", 2024-04-26T10:23:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.330017+0000", 2024-04-26T10:23:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.330023+0000", 2024-04-26T10:23:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9689999999999999e-06 2024-04-26T10:23:12.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:12.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.330032+0000", 2024-04-26T10:23:12.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8389999999999996e-06 2024-04-26T10:23:12.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.330038+0000", 2024-04-26T10:23:12.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1419999999999998e-06 2024-04-26T10:23:12.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:12.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.330197+0000", 2024-04-26T10:23:12.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015868699999999999 2024-04-26T10:23:12.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:12.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.330215+0000", 2024-04-26T10:23:12.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8410000000000002e-05 2024-04-26T10:23:12.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.356 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:12.356 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.356 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:216919 5.3 5:ce2c6b0d:::benchmark_data_smithi052_19421_object87447:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:12.356 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:12.330950+0000", 2024-04-26T10:23:12.356 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0066671009999999999, 2024-04-26T10:23:12.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.006929747, 2024-04-26T10:23:12.356 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:12.357 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:12.357 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:12.357 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:12.357 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.357 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 216919 2024-04-26T10:23:12.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.357 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:12.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:12.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.330950+0000", 2024-04-26T10:23:12.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:12.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.330950+0000", 2024-04-26T10:23:12.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:12.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.330949+0000", 2024-04-26T10:23:12.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:12.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:12.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.330954+0000", 2024-04-26T10:23:12.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4199999999999998e-06 2024-04-26T10:23:12.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:12.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.330965+0000", 2024-04-26T10:23:12.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1289e-05 2024-04-26T10:23:12.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.330972+0000", 2024-04-26T10:23:12.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6379999999999998e-06 2024-04-26T10:23:12.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:12.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.332645+0000", 2024-04-26T10:23:12.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016731230000000001 2024-04-26T10:23:12.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:12.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.332738+0000", 2024-04-26T10:23:12.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2328000000000001e-05 2024-04-26T10:23:12.360 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.360 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:12.360 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.360 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:216920 5.6 5:653c5c4d:::benchmark_data_smithi052_19421_object87448:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:12.360 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:12.333886+0000", 2024-04-26T10:23:12.360 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0037302669999999998, 2024-04-26T10:23:12.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040509470000000001, 2024-04-26T10:23:12.361 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:12.361 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:12.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:12.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:12.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.361 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 216920 2024-04-26T10:23:12.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.361 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:12.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:12.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.333886+0000", 2024-04-26T10:23:12.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:12.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.333886+0000", 2024-04-26T10:23:12.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:12.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.333886+0000", 2024-04-26T10:23:12.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:12.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:12.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.333889+0000", 2024-04-26T10:23:12.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6239999999999999e-06 2024-04-26T10:23:12.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:12.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.333900+0000", 2024-04-26T10:23:12.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0771000000000001e-05 2024-04-26T10:23:12.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.333905+0000", 2024-04-26T10:23:12.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0730000000000004e-06 2024-04-26T10:23:12.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:12.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.333949+0000", 2024-04-26T10:23:12.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.337e-05 2024-04-26T10:23:12.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:12.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334048+0000", 2024-04-26T10:23:12.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9510000000000001e-05 2024-04-26T10:23:12.364 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.364 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:12.364 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.364 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:216921 5.6 5:6c1d013e:::benchmark_data_smithi052_19421_object87449:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:12.364 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:12.333921+0000", 2024-04-26T10:23:12.365 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0036959810000000001, 2024-04-26T10:23:12.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040730669999999997, 2024-04-26T10:23:12.365 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:12.365 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:12.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:12.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:12.365 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.365 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 216921 2024-04-26T10:23:12.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.365 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:12.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:12.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.333921+0000", 2024-04-26T10:23:12.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:12.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.333921+0000", 2024-04-26T10:23:12.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:12.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.333920+0000", 2024-04-26T10:23:12.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:12.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:12.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.333923+0000", 2024-04-26T10:23:12.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5450000000000002e-06 2024-04-26T10:23:12.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:12.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.333927+0000", 2024-04-26T10:23:12.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2799999999999997e-06 2024-04-26T10:23:12.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.333931+0000", 2024-04-26T10:23:12.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.126e-06 2024-04-26T10:23:12.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:12.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.335717+0000", 2024-04-26T10:23:12.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001785855 2024-04-26T10:23:12.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:12.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.335842+0000", 2024-04-26T10:23:12.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012473599999999999 2024-04-26T10:23:12.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.368 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:12.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.368 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:216922 5.3 5:c209b797:::benchmark_data_smithi052_19421_object87450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:12.368 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:12.334281+0000", 2024-04-26T10:23:12.369 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003335387, 2024-04-26T10:23:12.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037840759999999999, 2024-04-26T10:23:12.369 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:12.369 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:12.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:12.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:12.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.369 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 216922 2024-04-26T10:23:12.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.369 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:12.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:12.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334281+0000", 2024-04-26T10:23:12.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:12.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334281+0000", 2024-04-26T10:23:12.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:12.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334280+0000", 2024-04-26T10:23:12.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:12.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:12.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334285+0000", 2024-04-26T10:23:12.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.955e-06 2024-04-26T10:23:12.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:12.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334295+0000", 2024-04-26T10:23:12.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9280000000000005e-06 2024-04-26T10:23:12.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334303+0000", 2024-04-26T10:23:12.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.0460000000000006e-06 2024-04-26T10:23:12.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:12.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334369+0000", 2024-04-26T10:23:12.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5486000000000003e-05 2024-04-26T10:23:12.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:12.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334571+0000", 2024-04-26T10:23:12.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020211900000000001 2024-04-26T10:23:12.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.372 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:12.372 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.372 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:216924 5.1 5:8daaad56:::benchmark_data_smithi052_19421_object87452:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:12.372 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:12.334483+0000", 2024-04-26T10:23:12.372 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0031335149999999999, 2024-04-26T10:23:12.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036398429999999998, 2024-04-26T10:23:12.373 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:12.373 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:12.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:12.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:12.373 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.373 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 216924 2024-04-26T10:23:12.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.373 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:12.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:12.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334483+0000", 2024-04-26T10:23:12.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:12.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334483+0000", 2024-04-26T10:23:12.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:12.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334482+0000", 2024-04-26T10:23:12.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:12.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:12.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334487+0000", 2024-04-26T10:23:12.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.617e-06 2024-04-26T10:23:12.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:12.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334501+0000", 2024-04-26T10:23:12.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.437e-05 2024-04-26T10:23:12.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334516+0000", 2024-04-26T10:23:12.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4645e-05 2024-04-26T10:23:12.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:12.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334565+0000", 2024-04-26T10:23:12.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8395e-05 2024-04-26T10:23:12.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:12.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334673+0000", 2024-04-26T10:23:12.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010815900000000001 2024-04-26T10:23:12.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.376 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:12.376 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.376 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:216923 5.b e62/37 5:d8834523:::benchmark_data_smithi052_19421_object87451:head v 62'13459, mlcod=62'13456)", 2024-04-26T10:23:12.376 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:12.334834+0000", 2024-04-26T10:23:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0027827329999999999, 2024-04-26T10:23:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033452780000000001, 2024-04-26T10:23:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334834+0000", 2024-04-26T10:23:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334834+0000", 2024-04-26T10:23:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:12.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334833+0000", 2024-04-26T10:23:12.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:12.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:12.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334838+0000", 2024-04-26T10:23:12.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7430000000000002e-06 2024-04-26T10:23:12.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:12.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334844+0000", 2024-04-26T10:23:12.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3029999999999999e-06 2024-04-26T10:23:12.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334847+0000", 2024-04-26T10:23:12.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5470000000000001e-06 2024-04-26T10:23:12.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:12.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334878+0000", 2024-04-26T10:23:12.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0854e-05 2024-04-26T10:23:12.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:12.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.334892+0000", 2024-04-26T10:23:12.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3804e-05 2024-04-26T10:23:12.379 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:216925 5.6 5:6dd31265:::benchmark_data_smithi052_19421_object87453:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-26T10:23:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:12.335963+0000", 2024-04-26T10:23:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001654125, 2024-04-26T10:23:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022685750000000001, 2024-04-26T10:23:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 216925 2024-04-26T10:23:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.380 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:12.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:12.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.335963+0000", 2024-04-26T10:23:12.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:12.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.335963+0000", 2024-04-26T10:23:12.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:12.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.335962+0000", 2024-04-26T10:23:12.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:12.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:12.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.335967+0000", 2024-04-26T10:23:12.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3179999999999997e-06 2024-04-26T10:23:12.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:12.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.335980+0000", 2024-04-26T10:23:12.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2584e-05 2024-04-26T10:23:12.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.335986+0000", 2024-04-26T10:23:12.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8340000000000001e-06 2024-04-26T10:23:12.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:12.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337041+0000", 2024-04-26T10:23:12.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010543060000000001 2024-04-26T10:23:12.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:12.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.337142+0000", 2024-04-26T10:23:12.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010089700000000001 2024-04-26T10:23:12.383 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.383 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:12.383 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.384 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:216926 5.4 e62/37 5:22e02a87:::benchmark_data_smithi052_19421_object87454:head v 62'13669, mlcod=62'13666)", 2024-04-26T10:23:12.384 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:12.336597+0000", 2024-04-26T10:23:12.384 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0010193590000000001, 2024-04-26T10:23:12.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017011680000000001, 2024-04-26T10:23:12.384 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:12.384 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:12.384 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:12.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:12.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.336597+0000", 2024-04-26T10:23:12.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:12.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.336597+0000", 2024-04-26T10:23:12.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:12.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:12.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.336597+0000", 2024-04-26T10:23:12.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:12.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:12.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.336603+0000", 2024-04-26T10:23:12.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7259999999999999e-06 2024-04-26T10:23:12.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:12.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.336613+0000", 2024-04-26T10:23:12.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0796e-05 2024-04-26T10:23:12.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:12.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.336619+0000", 2024-04-26T10:23:12.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3319999999999999e-06 2024-04-26T10:23:12.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:12.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.336720+0000", 2024-04-26T10:23:12.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101279 2024-04-26T10:23:12.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:12.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:12.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:12.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:12.336741+0000", 2024-04-26T10:23:12.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0958000000000002e-05 2024-04-26T10:23:12.387 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.387 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:12.387 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.387 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:12.387 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:23:12.387 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 12 2024-04-26T10:23:12.387 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:12.388 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:12.434 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:12.431+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:12.514 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:12.511+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:12.562 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:23:12.569 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:12.569 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:12.569 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:23:12.569 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:23:12.569 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:12.581 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:12.630 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:12.627+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:12.708 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:23:12.711 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:12.711 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:12.715 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:12.711+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:12.723 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:12.734 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:23:12.735 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:23:12.735 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:23:12.735 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:23:12.739 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:23:12.740 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:23:12.816 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:12.814+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:12.853 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:12.853 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:12.865 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:12.916 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:12.914+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:12.991 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:12.991 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:13.002 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:13.018 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:13.015+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:13.119 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:13.118+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:13.171 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:13.171 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:13.184 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:13.220 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:13.218+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:13.251 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T10:23:13.320 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:13.315+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:13.324 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:13.324 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:13.339 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:13.421 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:13.418+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:13.473 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:13.473 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:13.485 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:13.522 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:13.518+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:13.616 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:13.616 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:13.623 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:13.619+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:13.628 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:13.725 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:13.719+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:13.757 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:13.757 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:13.770 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:13.825 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:13.819+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:13.889 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:13.890 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:13.902 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:13.926 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:13.922+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:14.027 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:14.027 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:14.027 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:14.026+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:14.041 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:14.128 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:14.123+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:14.173 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:14.173 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:14.188 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:14.229 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:14.226+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:14.320 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:14.320 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:14.329 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:14.323+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:14.333 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:14.430 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:14.426+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:14.460 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:14.460 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:14.474 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:14.530 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:14.527+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:14.609 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:14.609 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:14.622 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:14.631 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:14.630+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:14.732 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:14.730+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:14.740 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:23:14.741 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:14.741 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:14.753 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:14.833 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:14.830+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:14.896 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:23:14.920 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:23:14.920 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:14.920 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:14.921 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:23:14.921 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:23:14.921 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:23:14.926 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:23:14.926 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:23:14.932 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:14.933 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:14.927+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:15.034 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:15.027+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:15.068 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:15.068 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:223327 5.0 5:0255ee7a:::benchmark_data_smithi052_19421_object93855:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:15.062175+0000", 2024-04-26T10:23:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0044118569999999999, 2024-04-26T10:23:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044399440000000004, 2024-04-26T10:23:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 223327 2024-04-26T10:23:15.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062175+0000", 2024-04-26T10:23:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062175+0000", 2024-04-26T10:23:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062174+0000", 2024-04-26T10:23:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062178+0000", 2024-04-26T10:23:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5590000000000001e-06 2024-04-26T10:23:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062185+0000", 2024-04-26T10:23:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6549999999999998e-06 2024-04-26T10:23:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062189+0000", 2024-04-26T10:23:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7890000000000002e-06 2024-04-26T10:23:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062745+0000", 2024-04-26T10:23:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00055587599999999996 2024-04-26T10:23:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062889+0000", 2024-04-26T10:23:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144258 2024-04-26T10:23:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.063019+0000", 2024-04-26T10:23:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129047 2024-04-26T10:23:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065112+0000", 2024-04-26T10:23:15.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002093662 2024-04-26T10:23:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:223329 5.d 5:b320ca39:::benchmark_data_smithi052_19421_object93857:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:15.062655+0000", 2024-04-26T10:23:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0039314099999999998, 2024-04-26T10:23:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040433250000000004, 2024-04-26T10:23:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 223329 2024-04-26T10:23:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062655+0000", 2024-04-26T10:23:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062655+0000", 2024-04-26T10:23:15.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062655+0000", 2024-04-26T10:23:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062659+0000", 2024-04-26T10:23:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4619999999999998e-06 2024-04-26T10:23:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062666+0000", 2024-04-26T10:23:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9519999999999997e-06 2024-04-26T10:23:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062670+0000", 2024-04-26T10:23:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.374e-06 2024-04-26T10:23:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.063829+0000", 2024-04-26T10:23:15.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0011590000000000001 2024-04-26T10:23:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.063963+0000", 2024-04-26T10:23:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013339999999999999 2024-04-26T10:23:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.064041+0000", 2024-04-26T10:23:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7996000000000003e-05 2024-04-26T10:23:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.078 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:223330 5.c 5:3384b987:::benchmark_data_smithi052_19421_object93858:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:15.062676+0000", 2024-04-26T10:23:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0039110400000000002, 2024-04-26T10:23:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041007830000000002, 2024-04-26T10:23:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 223330 2024-04-26T10:23:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.079 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062676+0000", 2024-04-26T10:23:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062676+0000", 2024-04-26T10:23:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062675+0000", 2024-04-26T10:23:15.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967296 2024-04-26T10:23:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062677+0000", 2024-04-26T10:23:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7910000000000001e-06 2024-04-26T10:23:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062680+0000", 2024-04-26T10:23:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9299999999999999e-06 2024-04-26T10:23:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062687+0000", 2024-04-26T10:23:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.109e-06 2024-04-26T10:23:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062732+0000", 2024-04-26T10:23:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4468000000000002e-05 2024-04-26T10:23:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.064902+0000", 2024-04-26T10:23:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021707369999999998 2024-04-26T10:23:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.082 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:223331 5.d 5:baa3f37a:::benchmark_data_smithi052_19421_object93859:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:15.062701+0000", 2024-04-26T10:23:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0038853939999999999, 2024-04-26T10:23:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041405030000000002, 2024-04-26T10:23:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 223331 2024-04-26T10:23:15.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062701+0000", 2024-04-26T10:23:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062701+0000", 2024-04-26T10:23:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062701+0000", 2024-04-26T10:23:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062704+0000", 2024-04-26T10:23:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6460000000000002e-06 2024-04-26T10:23:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062709+0000", 2024-04-26T10:23:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0830000000000003e-06 2024-04-26T10:23:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062712+0000", 2024-04-26T10:23:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.179e-06 2024-04-26T10:23:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065654+0000", 2024-04-26T10:23:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002942503 2024-04-26T10:23:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065801+0000", 2024-04-26T10:23:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000146329 2024-04-26T10:23:15.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065922+0000", 2024-04-26T10:23:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012111 2024-04-26T10:23:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:223332 5.f 5:f716e849:::benchmark_data_smithi052_19421_object93860:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:15.062718+0000", 2024-04-26T10:23:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0038691770000000001, 2024-04-26T10:23:15.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041955610000000004, 2024-04-26T10:23:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 223332 2024-04-26T10:23:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062718+0000", 2024-04-26T10:23:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062718+0000", 2024-04-26T10:23:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062717+0000", 2024-04-26T10:23:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062719+0000", 2024-04-26T10:23:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0370000000000001e-06 2024-04-26T10:23:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062725+0000", 2024-04-26T10:23:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9429999999999997e-06 2024-04-26T10:23:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062730+0000", 2024-04-26T10:23:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3129999999999998e-06 2024-04-26T10:23:15.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062766+0000", 2024-04-26T10:23:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5924999999999999e-05 2024-04-26T10:23:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.062889+0000", 2024-04-26T10:23:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122633 2024-04-26T10:23:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.063019+0000", 2024-04-26T10:23:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000129531 2024-04-26T10:23:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:223333 5.f 5:f9831a3f:::benchmark_data_smithi052_19421_object93861:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:15.063023+0000", 2024-04-26T10:23:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0035638929999999998, 2024-04-26T10:23:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039593730000000004, 2024-04-26T10:23:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.092 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 223333 2024-04-26T10:23:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.063023+0000", 2024-04-26T10:23:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.063023+0000", 2024-04-26T10:23:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.063022+0000", 2024-04-26T10:23:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.063026+0000", 2024-04-26T10:23:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.963e-06 2024-04-26T10:23:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.063033+0000", 2024-04-26T10:23:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1250000000000004e-06 2024-04-26T10:23:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.063037+0000", 2024-04-26T10:23:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9960000000000004e-06 2024-04-26T10:23:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.064872+0000", 2024-04-26T10:23:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018345709999999999 2024-04-26T10:23:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065034+0000", 2024-04-26T10:23:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000162082 2024-04-26T10:23:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065152+0000", 2024-04-26T10:23:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000118207 2024-04-26T10:23:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.096 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:223334 5.c 5:37f111cd:::benchmark_data_smithi052_19421_object93862:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:15.064504+0000", 2024-04-26T10:23:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002083213, 2024-04-26T10:23:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025477070000000002, 2024-04-26T10:23:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 223334 2024-04-26T10:23:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.097 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.064504+0000", 2024-04-26T10:23:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.064504+0000", 2024-04-26T10:23:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.064502+0000", 2024-04-26T10:23:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.064508+0000", 2024-04-26T10:23:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8799999999999996e-06 2024-04-26T10:23:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.064520+0000", 2024-04-26T10:23:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1253000000000001e-05 2024-04-26T10:23:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.064617+0000", 2024-04-26T10:23:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7683000000000006e-05 2024-04-26T10:23:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066825+0000", 2024-04-26T10:23:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022074849999999999 2024-04-26T10:23:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066948+0000", 2024-04-26T10:23:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000123187 2024-04-26T10:23:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:223336 5.f 5:f3cd6724:::benchmark_data_smithi052_19421_object93864:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:15.065013+0000", 2024-04-26T10:23:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001573774, 2024-04-26T10:23:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021058499999999998, 2024-04-26T10:23:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 223336 2024-04-26T10:23:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065013+0000", 2024-04-26T10:23:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065013+0000", 2024-04-26T10:23:15.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065012+0000", 2024-04-26T10:23:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065024+0000", 2024-04-26T10:23:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1426e-05 2024-04-26T10:23:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065033+0000", 2024-04-26T10:23:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7620000000000007e-06 2024-04-26T10:23:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065041+0000", 2024-04-26T10:23:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5920000000000003e-06 2024-04-26T10:23:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066746+0000", 2024-04-26T10:23:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017046380000000001 2024-04-26T10:23:15.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066817+0000", 2024-04-26T10:23:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1668999999999994e-05 2024-04-26T10:23:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066876+0000", 2024-04-26T10:23:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8782000000000001e-05 2024-04-26T10:23:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.105 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:223337 5.3 5:c669ce7a:::benchmark_data_smithi052_19421_object93865:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:15.065399+0000", 2024-04-26T10:23:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0011878699999999999, 2024-04-26T10:23:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017895299999999999, 2024-04-26T10:23:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 223337 2024-04-26T10:23:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065399+0000", 2024-04-26T10:23:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065399+0000", 2024-04-26T10:23:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065398+0000", 2024-04-26T10:23:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:15.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065402+0000", 2024-04-26T10:23:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5200000000000002e-06 2024-04-26T10:23:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065411+0000", 2024-04-26T10:23:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0790000000000007e-06 2024-04-26T10:23:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065418+0000", 2024-04-26T10:23:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7780000000000002e-06 2024-04-26T10:23:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065465+0000", 2024-04-26T10:23:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7818000000000002e-05 2024-04-26T10:23:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.065643+0000", 2024-04-26T10:23:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000177522 2024-04-26T10:23:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.109 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:223341 5.6 5:6e3f4942:::benchmark_data_smithi052_19421_object93869:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:15.066378+0000", 2024-04-26T10:23:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00020879500000000001, 2024-04-26T10:23:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00087281399999999997, 2024-04-26T10:23:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.110 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 223341 2024-04-26T10:23:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066378+0000", 2024-04-26T10:23:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066378+0000", 2024-04-26T10:23:15.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066377+0000", 2024-04-26T10:23:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066382+0000", 2024-04-26T10:23:15.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9280000000000001e-06 2024-04-26T10:23:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066396+0000", 2024-04-26T10:23:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3912e-05 2024-04-26T10:23:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066403+0000", 2024-04-26T10:23:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2540000000000003e-06 2024-04-26T10:23:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066462+0000", 2024-04-26T10:23:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9326000000000001e-05 2024-04-26T10:23:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066599+0000", 2024-04-26T10:23:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000136575 2024-04-26T10:23:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:223342 5.f 5.28914f1f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:15.066435+0000", 2024-04-26T10:23:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00015173300000000001, 2024-04-26T10:23:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00087508599999999996, 2024-04-26T10:23:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 223342 2024-04-26T10:23:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066435+0000", 2024-04-26T10:23:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066435+0000", 2024-04-26T10:23:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066434+0000", 2024-04-26T10:23:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066438+0000", 2024-04-26T10:23:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.405e-06 2024-04-26T10:23:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066445+0000", 2024-04-26T10:23:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6669999999999996e-06 2024-04-26T10:23:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.066451+0000", 2024-04-26T10:23:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9499999999999998e-06 2024-04-26T10:23:15.117 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:223332 5.f e63/37)", 2024-04-26T10:23:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:15.067058+0000", 2024-04-26T10:23:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9995284, 2024-04-26T10:23:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030134399999999999, 2024-04-26T10:23:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.067058+0000", 2024-04-26T10:23:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.067058+0000", 2024-04-26T10:23:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.067058+0000", 2024-04-26T10:23:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.067063+0000", 2024-04-26T10:23:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5840000000000002e-06 2024-04-26T10:23:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.067072+0000", 2024-04-26T10:23:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:23:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.067078+0000", 2024-04-26T10:23:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2659999999999998e-06 2024-04-26T10:23:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:223329 5.d e63/37)", 2024-04-26T10:23:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:15.067238+0000", 2024-04-26T10:23:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9993482, 2024-04-26T10:23:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016834099999999999, 2024-04-26T10:23:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.067238+0000", 2024-04-26T10:23:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.067238+0000", 2024-04-26T10:23:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.067238+0000", 2024-04-26T10:23:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.067247+0000", 2024-04-26T10:23:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2469999999999997e-06 2024-04-26T10:23:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.067263+0000", 2024-04-26T10:23:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6303e-05 2024-04-26T10:23:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.067269+0000", 2024-04-26T10:23:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.31e-06 2024-04-26T10:23:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:223317 5.0 5:0259279d:::benchmark_data_smithi052_19421_object93845:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:15.058645+0000", 2024-04-26T10:23:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0079413569999999996, 2024-04-26T10:23:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0088136800000000008, 2024-04-26T10:23:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 223317 2024-04-26T10:23:15.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.058645+0000", 2024-04-26T10:23:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.058645+0000", 2024-04-26T10:23:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.058642+0000", 2024-04-26T10:23:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999971 2024-04-26T10:23:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.058649+0000", 2024-04-26T10:23:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.973e-06 2024-04-26T10:23:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.058665+0000", 2024-04-26T10:23:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5268e-05 2024-04-26T10:23:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.058673+0000", 2024-04-26T10:23:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6729999999999998e-06 2024-04-26T10:23:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.060658+0000", 2024-04-26T10:23:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019851059999999999 2024-04-26T10:23:15.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.060853+0000", 2024-04-26T10:23:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00019439199999999999 2024-04-26T10:23:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.060966+0000", 2024-04-26T10:23:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011309 2024-04-26T10:23:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:15.064595+0000", 2024-04-26T10:23:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003628942 2024-04-26T10:23:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:23:15.129 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 14 2024-04-26T10:23:15.129 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:15.130 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:15.134 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:15.130+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:15.235 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:15.231+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:15.265 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:23:15.305 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:15.305 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:15.305 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:23:15.305 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:23:15.305 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:15.318 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:15.362 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:15.359+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:15.437 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:15.431+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:15.454 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:23:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:23:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.412407322, 2024-04-26T10:23:15.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:23:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:23:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:23:15.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:23:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:23:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:23:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:23:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:23:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:23:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:23:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:23:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:23:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:23:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:23:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:23:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:23:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:23:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:23:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.459 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.412298071000002, 2024-04-26T10:23:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:23:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:23:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:23:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:23:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:23:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:23:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:23:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:23:15.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:23:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:23:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:23:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:23:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:23:15.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:23:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:23:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:23:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:23:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:23:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.409900659000002, 2024-04-26T10:23:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:23:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:23:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:23:15.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:23:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:23:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:23:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:23:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:23:15.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:23:15.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:23:15.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:23:15.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:23:15.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:23:15.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:23:15.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:23:15.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:23:15.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:23:15.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:15.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:23:15.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:23:15.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:23:15.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:23:15.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.470 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.470 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:23:15.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:23:15.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.471 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.471 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.471 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:15.471 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:15.471 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 51.409714735000001, 2024-04-26T10:23:15.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:23:15.471 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.471 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.471 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.471 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.472 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.472 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:23:15.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.472 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:15.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:15.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:23:15.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:15.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:23:15.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:23:15.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:23:15.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:23:15.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:23:15.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:23:15.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:23:15.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:23:15.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:23:15.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:23:15.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:23:15.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:23:15.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:23:15.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:23:15.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:15.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:23:15.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:23:15.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:23:15.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:23:15.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:23:15.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:23:15.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.476 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.477 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.477 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:15.477 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:15.477 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.319692118999999, 2024-04-26T10:23:15.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:23:15.477 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.477 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.477 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:23:15.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.478 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:15.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:15.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:15.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:15.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:23:15.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:23:15.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:23:15.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:23:15.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:23:15.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:23:15.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:23:15.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:23:15.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:15.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:23:15.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:23:15.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:23:15.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:23:15.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:23:15.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:23:15.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:23:15.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:23:15.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:15.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:23:15.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:23:15.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:23:15.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:23:15.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:23:15.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:23:15.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:23:15.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:23:15.483 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.483 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.483 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.483 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:15.484 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:15.484 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.296589872999999, 2024-04-26T10:23:15.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:23:15.484 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.484 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.484 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.484 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.484 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.484 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:23:15.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.484 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:15.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:15.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:23:15.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:15.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:23:15.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:23:15.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:23:15.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:23:15.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:23:15.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:23:15.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:23:15.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:23:15.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:15.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:23:15.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:23:15.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:23:15.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:23:15.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:23:15.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:23:15.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:23:15.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:23:15.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:15.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:23:15.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:23:15.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:23:15.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:23:15.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.489 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:23:15.489 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:23:15.489 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.489 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.489 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.490 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:23:15.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:23:15.490 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.490 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.490 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.490 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.490 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.490 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:15.490 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:15.490 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.289906734999999, 2024-04-26T10:23:15.490 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:23:15.490 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.490 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.491 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.491 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.491 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.491 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:23:15.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.491 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:15.491 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.491 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.491 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.491 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.491 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:15.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:23:15.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.492 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:23:15.492 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:23:15.492 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.492 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.492 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:23:15.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:23:15.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:23:15.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:23:15.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.493 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.493 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:23:15.493 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:23:15.493 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.493 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:15.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:23:15.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:23:15.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:23:15.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:23:15.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.494 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.494 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.494 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:23:15.494 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:23:15.494 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:23:15.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:23:15.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:15.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:23:15.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:23:15.495 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.495 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.495 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.495 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:23:15.495 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:23:15.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:23:15.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:23:15.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.496 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.496 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.496 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:23:15.496 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:23:15.496 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.496 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.496 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.496 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.497 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:15.497 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:15.497 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.287908949999998, 2024-04-26T10:23:15.497 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:23:15.497 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.497 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.497 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.497 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:23:15.497 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.497 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.497 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:15.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:15.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.498 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.498 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.498 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.498 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:23:15.498 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:15.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:23:15.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:23:15.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:23:15.499 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:23:15.499 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.499 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.499 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.499 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:23:15.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:23:15.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:23:15.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:23:15.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:15.500 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:23:15.500 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:15.500 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.500 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.500 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:23:15.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:23:15.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:23:15.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:23:15.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.501 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.501 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:23:15.501 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:23:15.501 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.501 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:15.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:23:15.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:23:15.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:23:15.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:23:15.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.502 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.502 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.502 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:23:15.502 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:23:15.502 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.503 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.503 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:23:15.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:23:15.503 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.503 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.503 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.503 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.503 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.503 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:15.503 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:15.503 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.278500245, 2024-04-26T10:23:15.503 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:23:15.504 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.504 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.504 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.504 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.504 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.504 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:23:15.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.504 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.504 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.504 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:15.504 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.504 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.504 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:15.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:23:15.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.505 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.505 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.505 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:23:15.505 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:23:15.505 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:23:15.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:15.506 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.506 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.506 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.506 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:23:15.506 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:23:15.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:23:15.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:23:15.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:15.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:23:15.507 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:23:15.507 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.507 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.507 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.507 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:23:15.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:23:15.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:23:15.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:23:15.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.508 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.508 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:23:15.508 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:23:15.508 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.508 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:23:15.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:23:15.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:15.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:23:15.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:23:15.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.509 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.509 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.509 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:23:15.509 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:23:15.509 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.510 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.510 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:23:15.510 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:23:15.510 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.510 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.510 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.510 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.510 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.510 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:15.510 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:15.510 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.276672196, 2024-04-26T10:23:15.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:23:15.511 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.511 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.511 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.511 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.511 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.511 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:23:15.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.511 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.511 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:15.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:15.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:23:15.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:23:15.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:23:15.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:23:15.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:23:15.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:23:15.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:23:15.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:23:15.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:23:15.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:15.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:23:15.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:23:15.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:23:15.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:23:15.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:23:15.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:23:15.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:23:15.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:23:15.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.515 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:15.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:23:15.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:23:15.515 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:23:15.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:23:15.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:23:15.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:23:15.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.516 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.516 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:23:15.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:23:15.516 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.517 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.517 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.517 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:15.517 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:15.517 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.265092473999999, 2024-04-26T10:23:15.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:23:15.517 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.517 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.517 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.517 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.517 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.517 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:23:15.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.518 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:15.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:15.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:15.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:15.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:23:15.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:23:15.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:23:15.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:23:15.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:23:15.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:23:15.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:23:15.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:23:15.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:15.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:23:15.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:23:15.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:23:15.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:23:15.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:23:15.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:23:15.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:23:15.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:23:15.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:23:15.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:23:15.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:15.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:23:15.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:23:15.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:23:15.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:23:15.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:23:15.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:23:15.523 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.523 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.523 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.523 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:15.523 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:15.523 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.258681979999999, 2024-04-26T10:23:15.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:23:15.524 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.524 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.524 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.524 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.524 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.524 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:23:15.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.524 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:15.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:15.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:23:15.525 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.525 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.525 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:23:15.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:23:15.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:23:15.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:23:15.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:23:15.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:15.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:23:15.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:23:15.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:15.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:23:15.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:23:15.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:23:15.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:23:15.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:23:15.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:23:15.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:23:15.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:23:15.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:15.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:23:15.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:23:15.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:23:15.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:23:15.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:23:15.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:23:15.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:23:15.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:23:15.530 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.530 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.530 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.530 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:15.530 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:15.530 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.246096916999999, 2024-04-26T10:23:15.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:23:15.530 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.530 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.530 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.530 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.531 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.531 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:23:15.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.531 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:15.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:15.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:23:15.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:23:15.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:15.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:23:15.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:23:15.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:23:15.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:23:15.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:23:15.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:23:15.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.533 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:15.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:23:15.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:15.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:23:15.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:23:15.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:23:15.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:23:15.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:23:15.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:23:15.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:23:15.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:23:15.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:15.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:23:15.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:23:15.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:23:15.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:23:15.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:23:15.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:23:15.536 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.536 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.536 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.537 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:15.537 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:15.537 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.245861984000001, 2024-04-26T10:23:15.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:23:15.537 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.537 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.537 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.537 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.537 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.537 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:23:15.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.537 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:15.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:15.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:23:15.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:23:15.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:23:15.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:23:15.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:23:15.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:23:15.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:23:15.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:23:15.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:23:15.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:15.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:23:15.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:15.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:23:15.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:23:15.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:23:15.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:23:15.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:23:15.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:23:15.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:15.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:23:15.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:23:15.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:23:15.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:23:15.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:23:15.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:23:15.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:23:15.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:23:15.543 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.543 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.543 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.543 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:15.543 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:15.543 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.207987107000001, 2024-04-26T10:23:15.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:23:15.544 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.544 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.544 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.544 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.544 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.544 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:23:15.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.544 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:15.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:15.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:23:15.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:15.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:23:15.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:23:15.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:23:15.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:23:15.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:23:15.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:23:15.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:23:15.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:23:15.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:15.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:23:15.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:15.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:23:15.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:23:15.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:23:15.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:23:15.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:23:15.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:23:15.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:23:15.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:23:15.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:15.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:23:15.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:23:15.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:23:15.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:23:15.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:23:15.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:23:15.549 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.549 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.550 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.550 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:15.550 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:15.550 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.207542082, 2024-04-26T10:23:15.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:23:15.550 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.550 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.550 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.550 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.550 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.550 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:23:15.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.551 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:15.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:15.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:23:15.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:23:15.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:23:15.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:23:15.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:23:15.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:23:15.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:23:15.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:23:15.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:23:15.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:15.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:23:15.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:23:15.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:23:15.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:23:15.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:23:15.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:23:15.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:23:15.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:23:15.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:23:15.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:23:15.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:15.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:23:15.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:23:15.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:23:15.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:23:15.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:23:15.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:23:15.556 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.556 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.556 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.556 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:15.556 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:15.556 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.195939081999999, 2024-04-26T10:23:15.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:23:15.556 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.556 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.557 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.557 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.557 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.557 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:23:15.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.557 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:15.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:15.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:23:15.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:15.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:23:15.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:23:15.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:23:15.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:23:15.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:23:15.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:23:15.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:23:15.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:23:15.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:15.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:23:15.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:23:15.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:23:15.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:23:15.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:23:15.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:23:15.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:23:15.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:23:15.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:15.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:23:15.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:23:15.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:23:15.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:23:15.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:23:15.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:23:15.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:23:15.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:23:15.562 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.562 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.562 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.563 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:15.563 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:15.563 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.194665491999999, 2024-04-26T10:23:15.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:23:15.563 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.563 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.563 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.563 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.563 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.563 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:23:15.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.563 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:15.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:15.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:23:15.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:23:15.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:23:15.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:23:15.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:23:15.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:23:15.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:23:15.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:23:15.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:23:15.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:15.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:23:15.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:23:15.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.566 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.566 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:23:15.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:23:15.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:23:15.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:23:15.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:23:15.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:23:15.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:15.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:23:15.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:23:15.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:23:15.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:23:15.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:23:15.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:23:15.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:23:15.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:23:15.569 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.569 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.569 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.569 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:15.569 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:15.569 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.177908191, 2024-04-26T10:23:15.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:23:15.569 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.569 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.570 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.570 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.570 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.570 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:23:15.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.570 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:15.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:15.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:23:15.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:23:15.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:23:15.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:23:15.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:23:15.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:23:15.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:23:15.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.572 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.572 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:23:15.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:23:15.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:15.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:23:15.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:23:15.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:23:15.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:23:15.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:23:15.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:23:15.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:23:15.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:23:15.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:15.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:23:15.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:23:15.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:23:15.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:23:15.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:23:15.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:23:15.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:23:15.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:23:15.575 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.575 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.576 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.576 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:15.576 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:15.576 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 26.132996169999998, 2024-04-26T10:23:15.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:23:15.576 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:15.576 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:15.576 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:15.576 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:15.576 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.576 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:23:15.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.577 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:15.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:15.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:15.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:15.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:15.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:15.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:15.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:23:15.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:15.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:23:15.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:23:15.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:15.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:23:15.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:23:15.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:23:15.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:23:15.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:23:15.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:23:15.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:15.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:23:15.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:23:15.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:15.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:23:15.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:23:15.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:15.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:23:15.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:23:15.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:15.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:23:15.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:23:15.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:15.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:23:15.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:23:15.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:15.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:23:15.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:23:15.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:15.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:23:15.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:23:15.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:15.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:15.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:15.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:23:15.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:23:15.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.582 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.582 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:15.582 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:15.582 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:15.584 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:15.584 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:15.582+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:15.685 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:15.679+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:15.710 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:15.710 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:15.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.711 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop_reply(client.4722.0:224780 5.b e63/37)", 2024-04-26T10:23:15.711 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:15.709259+0000", 2024-04-26T10:23:15.711 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00096714200000000005, 2024-04-26T10:23:15.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00098041100000000004, 2024-04-26T10:23:15.711 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:15.711 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:15.711 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:15.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:15.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709259+0000", 2024-04-26T10:23:15.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:15.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709259+0000", 2024-04-26T10:23:15.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:15.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709258+0000", 2024-04-26T10:23:15.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:15.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709263+0000", 2024-04-26T10:23:15.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2590000000000002e-06 2024-04-26T10:23:15.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:15.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709271+0000", 2024-04-26T10:23:15.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2630000000000003e-06 2024-04-26T10:23:15.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709276+0000", 2024-04-26T10:23:15.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7559999999999999e-06 2024-04-26T10:23:15.713 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.713 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:15.713 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.713 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop_reply(client.4722.0:224781 5.b e63/37)", 2024-04-26T10:23:15.713 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:15.709286+0000", 2024-04-26T10:23:15.713 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00094012900000000005, 2024-04-26T10:23:15.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00098171799999999991, 2024-04-26T10:23:15.713 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:15.714 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:15.714 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:15.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:15.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709286+0000", 2024-04-26T10:23:15.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:15.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709286+0000", 2024-04-26T10:23:15.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709286+0000", 2024-04-26T10:23:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709288+0000", 2024-04-26T10:23:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4669999999999998e-06 2024-04-26T10:23:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709292+0000", 2024-04-26T10:23:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.641e-06 2024-04-26T10:23:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709295+0000", 2024-04-26T10:23:15.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0589999999999998e-06 2024-04-26T10:23:15.716 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.716 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:15.716 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.716 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop_reply(client.4722.0:224784 5.b e63/37)", 2024-04-26T10:23:15.716 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:15.709298+0000", 2024-04-26T10:23:15.716 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00092875200000000003, 2024-04-26T10:23:15.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00099405000000000001, 2024-04-26T10:23:15.716 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:15.716 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:15.716 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:15.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:15.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709298+0000", 2024-04-26T10:23:15.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:15.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709298+0000", 2024-04-26T10:23:15.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:15.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709298+0000", 2024-04-26T10:23:15.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967296 2024-04-26T10:23:15.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:15.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709299+0000", 2024-04-26T10:23:15.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5659999999999999e-06 2024-04-26T10:23:15.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:15.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709302+0000", 2024-04-26T10:23:15.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.988e-06 2024-04-26T10:23:15.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709307+0000", 2024-04-26T10:23:15.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7010000000000004e-06 2024-04-26T10:23:15.718 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.718 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:15.718 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.719 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:224801 5.8 5:1b380b73:::benchmark_data_smithi052_19421_object95329:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.719 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:15.709426+0000", 2024-04-26T10:23:15.719 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00080096099999999999, 2024-04-26T10:23:15.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000894286, 2024-04-26T10:23:15.719 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:15.719 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:15.719 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:15.719 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:15.719 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.719 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 224801 2024-04-26T10:23:15.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.719 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:15.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:15.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709426+0000", 2024-04-26T10:23:15.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:15.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709426+0000", 2024-04-26T10:23:15.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:15.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709424+0000", 2024-04-26T10:23:15.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:15.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709431+0000", 2024-04-26T10:23:15.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1179999999999997e-06 2024-04-26T10:23:15.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:15.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709441+0000", 2024-04-26T10:23:15.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0202e-05 2024-04-26T10:23:15.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709449+0000", 2024-04-26T10:23:15.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7640000000000005e-06 2024-04-26T10:23:15.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:15.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709497+0000", 2024-04-26T10:23:15.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8906999999999998e-05 2024-04-26T10:23:15.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:15.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709617+0000", 2024-04-26T10:23:15.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000119984 2024-04-26T10:23:15.722 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.722 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:15.722 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.722 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:224776 5.b 5:d7f32f2e:::benchmark_data_smithi052_19421_object95304:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.722 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:15.696361+0000", 2024-04-26T10:23:15.722 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0138651, 2024-04-26T10:23:15.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013995741000000001, 2024-04-26T10:23:15.723 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:15.723 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:15.723 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:15.723 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:15.723 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.723 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 224776 2024-04-26T10:23:15.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.723 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:15.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:15.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.696361+0000", 2024-04-26T10:23:15.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:15.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.696361+0000", 2024-04-26T10:23:15.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:15.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.696361+0000", 2024-04-26T10:23:15.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:15.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:15.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.696365+0000", 2024-04-26T10:23:15.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7249999999999999e-06 2024-04-26T10:23:15.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:15.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.696371+0000", 2024-04-26T10:23:15.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4899999999999997e-06 2024-04-26T10:23:15.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.696375+0000", 2024-04-26T10:23:15.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6789999999999998e-06 2024-04-26T10:23:15.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:15.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.696420+0000", 2024-04-26T10:23:15.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5416e-05 2024-04-26T10:23:15.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:15.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.696537+0000", 2024-04-26T10:23:15.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000116978 2024-04-26T10:23:15.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:15.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.696618+0000", 2024-04-26T10:23:15.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1009999999999999e-05 2024-04-26T10:23:15.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:15.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.700180+0000", 2024-04-26T10:23:15.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0035618469999999999 2024-04-26T10:23:15.726 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.727 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:15.727 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.727 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:224780 5.b 5:deb6fd90:::benchmark_data_smithi052_19421_object95308:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.727 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:15.698681+0000", 2024-04-26T10:23:15.727 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.011545400000000001, 2024-04-26T10:23:15.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011717010999999999, 2024-04-26T10:23:15.727 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:15.727 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:15.727 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:15.727 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:15.727 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.727 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 224780 2024-04-26T10:23:15.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.728 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:15.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:15.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.698681+0000", 2024-04-26T10:23:15.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:15.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.698681+0000", 2024-04-26T10:23:15.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:15.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.698680+0000", 2024-04-26T10:23:15.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:15.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.698686+0000", 2024-04-26T10:23:15.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1020000000000002e-06 2024-04-26T10:23:15.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:15.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.698697+0000", 2024-04-26T10:23:15.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0718e-05 2024-04-26T10:23:15.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.698707+0000", 2024-04-26T10:23:15.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5540000000000003e-06 2024-04-26T10:23:15.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:15.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.698747+0000", 2024-04-26T10:23:15.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.0839e-05 2024-04-26T10:23:15.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:15.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.698881+0000", 2024-04-26T10:23:15.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000133597 2024-04-26T10:23:15.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:15.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.698980+0000", 2024-04-26T10:23:15.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8884999999999999e-05 2024-04-26T10:23:15.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:15.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.702241+0000", 2024-04-26T10:23:15.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0032607949999999999 2024-04-26T10:23:15.731 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.731 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:15.731 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.731 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:224781 5.b 5:d9b0be3e:::benchmark_data_smithi052_19421_object95309:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.731 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:15.699976+0000", 2024-04-26T10:23:15.731 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.010250471000000001, 2024-04-26T10:23:15.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.010462332, 2024-04-26T10:23:15.732 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:15.732 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:15.732 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:15.732 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:15.732 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.732 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 224781 2024-04-26T10:23:15.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.732 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:15.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:15.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.699976+0000", 2024-04-26T10:23:15.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:15.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.699976+0000", 2024-04-26T10:23:15.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:15.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.699975+0000", 2024-04-26T10:23:15.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:15.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:15.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.699981+0000", 2024-04-26T10:23:15.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4729999999999997e-06 2024-04-26T10:23:15.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:15.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.699994+0000", 2024-04-26T10:23:15.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2617e-05 2024-04-26T10:23:15.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.700001+0000", 2024-04-26T10:23:15.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3520000000000001e-06 2024-04-26T10:23:15.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:15.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.700223+0000", 2024-04-26T10:23:15.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022170499999999999 2024-04-26T10:23:15.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:15.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.700424+0000", 2024-04-26T10:23:15.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000200738 2024-04-26T10:23:15.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:15.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.700579+0000", 2024-04-26T10:23:15.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015503700000000001 2024-04-26T10:23:15.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:15.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.706309+0000", 2024-04-26T10:23:15.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0057303270000000003 2024-04-26T10:23:15.735 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.735 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:15.735 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.736 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:224784 5.b 5:d0a3b5e4:::benchmark_data_smithi052_19421_object95312:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.736 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:15.701776+0000", 2024-04-26T10:23:15.736 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0084500789999999992, 2024-04-26T10:23:15.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0087093719999999999, 2024-04-26T10:23:15.736 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:15.736 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:15.736 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:15.736 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:15.736 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.736 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 224784 2024-04-26T10:23:15.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.736 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:15.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:15.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.701776+0000", 2024-04-26T10:23:15.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:15.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.701776+0000", 2024-04-26T10:23:15.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:15.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.701775+0000", 2024-04-26T10:23:15.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:15.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:15.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.701782+0000", 2024-04-26T10:23:15.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3939999999999998e-06 2024-04-26T10:23:15.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:15.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.701816+0000", 2024-04-26T10:23:15.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3586e-05 2024-04-26T10:23:15.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.701830+0000", 2024-04-26T10:23:15.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3920000000000001e-05 2024-04-26T10:23:15.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:15.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.702275+0000", 2024-04-26T10:23:15.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00044500600000000001 2024-04-26T10:23:15.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:15.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.702378+0000", 2024-04-26T10:23:15.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102724 2024-04-26T10:23:15.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:15.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.702521+0000", 2024-04-26T10:23:15.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000142931 2024-04-26T10:23:15.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:15.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.706319+0000", 2024-04-26T10:23:15.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00379824 2024-04-26T10:23:15.740 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.740 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:15.740 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.740 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:224785 5.b 5:d3665e23:::benchmark_data_smithi052_19421_object95313:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.740 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:15.701851+0000", 2024-04-26T10:23:15.740 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0083759449999999992, 2024-04-26T10:23:15.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086829750000000008, 2024-04-26T10:23:15.740 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:15.740 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:15.740 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:15.740 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:15.741 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.741 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 224785 2024-04-26T10:23:15.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.741 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:15.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:15.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.701851+0000", 2024-04-26T10:23:15.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:15.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.701851+0000", 2024-04-26T10:23:15.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:15.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.701843+0000", 2024-04-26T10:23:15.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999919 2024-04-26T10:23:15.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:15.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.701854+0000", 2024-04-26T10:23:15.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1779e-05 2024-04-26T10:23:15.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:15.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.701864+0000", 2024-04-26T10:23:15.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2760000000000006e-06 2024-04-26T10:23:15.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.701870+0000", 2024-04-26T10:23:15.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.832e-06 2024-04-26T10:23:15.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:15.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.704401+0000", 2024-04-26T10:23:15.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0025302329999999998 2024-04-26T10:23:15.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:15.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.704513+0000", 2024-04-26T10:23:15.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112176 2024-04-26T10:23:15.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:15.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.704606+0000", 2024-04-26T10:23:15.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2712000000000003e-05 2024-04-26T10:23:15.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.744 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:15.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.744 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:224793 5.b 5:d73a3144:::benchmark_data_smithi052_19421_object95321:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.744 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:15.702785+0000", 2024-04-26T10:23:15.744 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0074413869999999998, 2024-04-26T10:23:15.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0077845090000000002, 2024-04-26T10:23:15.744 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:15.744 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:15.744 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:15.744 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:15.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.745 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 224793 2024-04-26T10:23:15.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.745 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:15.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:15.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.702785+0000", 2024-04-26T10:23:15.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:15.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.702785+0000", 2024-04-26T10:23:15.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:15.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.702784+0000", 2024-04-26T10:23:15.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:15.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:15.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.702791+0000", 2024-04-26T10:23:15.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1600000000000001e-06 2024-04-26T10:23:15.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:15.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.702807+0000", 2024-04-26T10:23:15.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5798999999999999e-05 2024-04-26T10:23:15.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.702816+0000", 2024-04-26T10:23:15.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.2e-06 2024-04-26T10:23:15.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:15.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.706353+0000", 2024-04-26T10:23:15.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0035366740000000001 2024-04-26T10:23:15.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:15.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.706481+0000", 2024-04-26T10:23:15.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012823399999999999 2024-04-26T10:23:15.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:15.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709385+0000", 2024-04-26T10:23:15.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029036589999999998 2024-04-26T10:23:15.748 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.748 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:15.748 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.748 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:224794 5.e 5:7edb6ce4:::benchmark_data_smithi052_19421_object95322:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.748 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:15.706724+0000", 2024-04-26T10:23:15.748 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.003502734, 2024-04-26T10:23:15.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0038810289999999998, 2024-04-26T10:23:15.748 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:15.748 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:15.748 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:15.749 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:15.749 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.749 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 224794 2024-04-26T10:23:15.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.749 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:15.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:15.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.706724+0000", 2024-04-26T10:23:15.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:15.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.706724+0000", 2024-04-26T10:23:15.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:15.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.706722+0000", 2024-04-26T10:23:15.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:15.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:15.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.706730+0000", 2024-04-26T10:23:15.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8970000000000008e-06 2024-04-26T10:23:15.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:15.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.706751+0000", 2024-04-26T10:23:15.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1050999999999999e-05 2024-04-26T10:23:15.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.706762+0000", 2024-04-26T10:23:15.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0473e-05 2024-04-26T10:23:15.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:15.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.706812+0000", 2024-04-26T10:23:15.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0139999999999998e-05 2024-04-26T10:23:15.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:15.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.706927+0000", 2024-04-26T10:23:15.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011503200000000001 2024-04-26T10:23:15.751 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.751 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:15.751 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.752 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop_reply(client.4722.0:224776 5.b e63/37)", 2024-04-26T10:23:15.752 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:15.707482+0000", 2024-04-26T10:23:15.752 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0027449509999999998, 2024-04-26T10:23:15.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0031535930000000001, 2024-04-26T10:23:15.752 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:15.752 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:15.752 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:15.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:15.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.707482+0000", 2024-04-26T10:23:15.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:15.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.707482+0000", 2024-04-26T10:23:15.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:15.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.707481+0000", 2024-04-26T10:23:15.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:15.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:15.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.707485+0000", 2024-04-26T10:23:15.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4059999999999998e-06 2024-04-26T10:23:15.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:15.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.707498+0000", 2024-04-26T10:23:15.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2305e-05 2024-04-26T10:23:15.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.707505+0000", 2024-04-26T10:23:15.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9909999999999996e-06 2024-04-26T10:23:15.754 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.754 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:15.754 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.754 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:224798 5.e 5:72196f35:::benchmark_data_smithi052_19421_object95326:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:15.754 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:15.708345+0000", 2024-04-26T10:23:15.755 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0018812360000000001, 2024-04-26T10:23:15.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0023139710000000002, 2024-04-26T10:23:15.755 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:15.755 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:15.755 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:15.755 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:15.755 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:15.755 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 224798 2024-04-26T10:23:15.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.755 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:15.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:15.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.708345+0000", 2024-04-26T10:23:15.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:15.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.708345+0000", 2024-04-26T10:23:15.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:15.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.708344+0000", 2024-04-26T10:23:15.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:15.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:15.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.708351+0000", 2024-04-26T10:23:15.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6440000000000003e-06 2024-04-26T10:23:15.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:15.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.708364+0000", 2024-04-26T10:23:15.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2772000000000001e-05 2024-04-26T10:23:15.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.708374+0000", 2024-04-26T10:23:15.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0621999999999999e-05 2024-04-26T10:23:15.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:15.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709394+0000", 2024-04-26T10:23:15.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0010202239999999999 2024-04-26T10:23:15.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:15.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.709520+0000", 2024-04-26T10:23:15.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012547799999999999 2024-04-26T10:23:15.758 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.758 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:15.758 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.758 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:224799 5.f e63/37 5:f67e9afc:::benchmark_data_smithi052_19421_object95327:head v 63'14188, mlcod=63'14186)", 2024-04-26T10:23:15.758 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:15.708626+0000", 2024-04-26T10:23:15.758 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.001600057, 2024-04-26T10:23:15.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020648910000000001, 2024-04-26T10:23:15.758 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:15.758 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:15.759 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:15.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:15.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.708626+0000", 2024-04-26T10:23:15.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:15.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.708626+0000", 2024-04-26T10:23:15.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:15.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:15.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.708625+0000", 2024-04-26T10:23:15.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:15.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:15.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.708635+0000", 2024-04-26T10:23:15.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0225e-05 2024-04-26T10:23:15.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:15.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.708651+0000", 2024-04-26T10:23:15.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5913000000000002e-05 2024-04-26T10:23:15.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:15.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.708660+0000", 2024-04-26T10:23:15.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.1980000000000007e-06 2024-04-26T10:23:15.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:15.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.708708+0000", 2024-04-26T10:23:15.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7719999999999997e-05 2024-04-26T10:23:15.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:15.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:15.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:15.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:15.708724+0000", 2024-04-26T10:23:15.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6209e-05 2024-04-26T10:23:15.761 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.761 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:15.761 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.761 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:15.761 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:23:15.762 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 14 2024-04-26T10:23:15.762 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:15.763 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:15.786 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:15.779+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:15.886 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:15.883+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:15.887 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:15.887 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:15.887 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:23:15.887 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:23:15.887 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:15.900 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:15.987 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:15.983+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:16.025 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:16.026 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:23:16.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:23:16.026 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:16.026 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.026 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:16.026 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:16.026 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.493434049000001, 2024-04-26T10:23:16.026 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:23:16.026 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.026 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.026 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.026 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.026 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.026 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:23:16.026 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.027 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:16.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:16.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.027 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.027 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.027 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.027 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:23:16.027 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:23:16.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:23:16.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:23:16.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:23:16.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.028 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.028 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.028 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:23:16.028 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:23:16.028 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:23:16.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:23:16.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:23:16.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:23:16.029 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.029 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.029 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.029 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:23:16.029 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:23:16.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:23:16.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:23:16.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.030 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.030 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:23:16.030 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:23:16.030 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.030 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.030 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.030 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.030 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.031 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:16.031 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:16.031 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.491451822000002, 2024-04-26T10:23:16.031 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:23:16.031 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.031 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.031 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.031 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.031 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.031 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:23:16.031 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.031 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.031 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.031 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:16.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:16.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.032 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.032 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:23:16.032 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:23:16.032 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.032 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:23:16.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:23:16.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:23:16.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:23:16.033 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.033 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.033 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.033 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:23:16.033 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:23:16.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:23:16.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:23:16.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.034 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:23:16.034 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:23:16.034 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.034 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.034 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:23:16.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:23:16.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:23:16.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:23:16.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.035 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.035 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.035 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:23:16.035 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:23:16.035 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.035 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.035 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.035 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.036 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:16.036 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:16.036 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.491252438000004, 2024-04-26T10:23:16.036 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:23:16.036 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.036 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.036 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.036 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.036 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.036 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:23:16.036 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.036 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.036 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.036 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:16.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:16.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.037 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:16.037 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.037 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.037 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.037 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:23:16.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:23:16.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:23:16.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:23:16.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.038 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.038 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.038 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:23:16.038 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:23:16.038 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:23:16.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:23:16.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:23:16.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:23:16.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.039 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.039 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.039 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:23:16.039 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:23:16.039 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:23:16.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:23:16.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.040 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.040 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:23:16.040 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:23:16.040 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.040 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.040 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.040 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.040 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.041 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:23:16.041 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:16.041 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.491033818000005, 2024-04-26T10:23:16.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:23:16.041 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.041 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.041 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.041 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:16.041 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.041 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.041 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.041 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:16.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:23:16.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.042 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.042 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:23:16.042 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:23:16.042 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.042 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:23:16.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:23:16.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:23:16.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:23:16.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.043 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.043 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.043 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:23:16.043 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:23:16.043 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:23:16.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:23:16.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:23:16.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:23:16.044 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.044 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.044 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.044 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:23:16.044 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:23:16.045 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.045 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.045 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.045 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.045 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.045 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:16.045 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:16.045 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.488662379999994, 2024-04-26T10:23:16.045 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:23:16.045 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.045 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.045 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.045 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.045 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.046 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:23:16.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.046 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:16.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.046 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.046 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:16.046 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.046 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.046 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:23:16.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:16.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:23:16.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:23:16.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.047 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.047 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:23:16.047 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:23:16.047 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.047 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:23:16.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:23:16.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:16.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:23:16.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.048 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.048 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:23:16.048 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:23:16.048 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.048 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:23:16.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:23:16.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:23:16.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:23:16.049 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.049 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.049 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.049 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:23:16.049 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:23:16.049 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.050 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.050 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.050 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.050 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.050 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:16.050 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:16.050 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.488561758000003, 2024-04-26T10:23:16.050 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:23:16.050 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.050 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.050 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.050 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.050 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.051 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:23:16.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.051 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:16.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.051 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:16.051 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.051 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.051 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.051 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:23:16.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:23:16.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:23:16.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.052 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.052 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:23:16.052 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:23:16.052 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.052 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:23:16.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:23:16.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:23:16.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:23:16.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.053 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.053 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:23:16.053 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:23:16.053 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.053 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:23:16.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:23:16.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:23:16.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:23:16.054 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.054 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.054 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.054 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:23:16.054 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:23:16.054 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.055 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.055 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.055 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.055 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:23:16.055 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:16.055 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.488443196999995, 2024-04-26T10:23:16.055 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:23:16.055 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.055 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.055 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.055 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.055 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.055 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:16.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:16.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.056 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:23:16.056 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.056 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.056 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.056 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:23:16.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:23:16.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:23:16.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:23:16.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.057 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:23:16.057 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:23:16.057 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.057 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.057 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:23:16.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:23:16.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:23:16.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:23:16.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.058 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.058 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:23:16.058 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:23:16.058 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.058 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.059 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.059 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:23:16.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:23:16.059 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.059 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.059 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.059 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.059 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.059 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:16.059 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:16.059 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.488340798999999, 2024-04-26T10:23:16.059 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:23:16.059 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.059 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.059 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.060 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.060 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.060 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:23:16.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.060 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:16.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.060 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.060 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.060 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.060 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:16.060 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:23:16.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:16.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:23:16.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:23:16.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.061 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.061 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.061 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:23:16.061 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:23:16.061 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:23:16.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:23:16.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:16.062 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:23:16.062 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.062 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.062 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.062 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:23:16.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:23:16.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:23:16.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:23:16.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:23:16.063 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:23:16.063 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.063 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.063 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.063 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:23:16.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:23:16.064 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.064 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.064 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.064 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.064 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.064 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:16.064 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:16.064 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.487320241999996, 2024-04-26T10:23:16.064 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:23:16.064 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.064 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.064 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.064 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.065 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.065 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:23:16.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.065 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:16.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.065 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.065 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.065 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:16.065 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.065 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:23:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:23:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:23:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:23:16.066 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:23:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:23:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:23:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:23:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:23:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.067 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:23:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:23:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:23:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:23:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:23:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:23:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.068 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:23:16.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:23:16.069 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.069 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.069 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.069 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.069 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.069 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:16.069 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:16.069 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 75.486169966999995, 2024-04-26T10:23:16.069 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:23:16.069 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.069 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.069 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.069 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.069 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.070 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:23:16.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.070 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:16.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.070 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:16.070 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.070 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.070 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.070 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:23:16.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:16.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:23:16.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:23:16.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:23:16.071 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:23:16.071 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.071 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.071 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.071 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:23:16.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:23:16.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:23:16.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:23:16.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.072 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.072 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:23:16.072 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:23:16.072 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.072 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:23:16.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:23:16.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:23:16.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:23:16.073 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.073 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.073 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.073 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:23:16.073 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:23:16.073 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.073 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.074 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.074 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.074 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:16.074 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:16.074 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.989470724999997, 2024-04-26T10:23:16.074 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:23:16.074 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.074 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.074 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.074 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.074 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.074 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:23:16.074 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.075 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:16.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.075 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:16.075 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.075 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.075 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.075 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:23:16.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:23:16.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:23:16.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.076 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.076 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:23:16.076 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:23:16.076 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.076 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:23:16.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:23:16.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:23:16.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:23:16.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.077 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.077 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:23:16.077 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:23:16.077 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.077 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:16.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:23:16.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:23:16.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:23:16.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:23:16.078 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.078 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.078 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.078 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:23:16.078 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:23:16.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:23:16.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:23:16.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.079 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.079 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.079 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:23:16.079 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:23:16.079 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.079 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.079 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.079 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.080 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:16.080 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:16.080 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 51.989247128999999, 2024-04-26T10:23:16.080 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:23:16.080 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.080 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.080 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.080 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.080 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.080 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:23:16.080 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.080 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.080 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.080 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:16.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:16.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.081 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.081 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:23:16.081 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.081 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.081 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:23:16.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:23:16.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:23:16.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:23:16.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.082 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.082 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.082 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:23:16.082 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:23:16.082 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:23:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:23:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:23:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:23:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:23:16.083 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:23:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:23:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:23:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:23:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:23:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.084 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:23:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:23:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:23:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:23:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:16.085 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 44.958400808999997, 2024-04-26T10:23:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:23:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:23:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.086 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:23:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:23:16.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:23:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:23:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:23:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:23:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:23:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:23:16.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:23:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:23:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:23:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:23:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:23:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:23:16.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:23:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:23:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:23:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:23:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:23:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:23:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:23:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 44.956389706000003, 2024-04-26T10:23:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:23:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.091 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:23:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:16.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:23:16.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:23:16.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:23:16.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:23:16.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:23:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:23:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:23:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:23:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:23:16.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:23:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:23:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:23:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:23:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:23:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:23:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:23:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:23:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:23:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:23:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:23:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.096 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 44.945511601, 2024-04-26T10:23:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:23:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:23:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.097 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:23:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:16.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:23:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:23:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:23:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:23:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:23:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:23:16.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:23:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:23:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:23:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:23:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:16.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:23:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:23:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:23:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:23:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:23:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:23:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:23:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:23:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:23:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:23:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 44.942830381999997, 2024-04-26T10:23:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:23:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:23:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:23:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:23:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:23:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:23:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:23:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:23:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:23:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:23:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:23:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:23:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:23:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:23:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:23:16.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:23:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:23:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:23:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:23:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:23:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:23:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:23:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:23:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:16.108 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 44.942463306999997, 2024-04-26T10:23:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:23:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:23:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:23:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:23:16.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:23:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:23:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:23:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:23:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:23:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:23:16.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:23:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:23:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:23:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:23:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:23:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:23:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:23:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:23:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:23:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:16.113 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 44.942399055000003, 2024-04-26T10:23:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:23:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:23:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:23:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:23:16.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:23:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:23:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:23:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:23:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:23:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:23:16.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:23:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:23:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:23:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:23:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:23:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:23:16.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:23:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:23:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:23:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:16.118 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 44.938000381999998, 2024-04-26T10:23:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:23:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:23:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:23:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:23:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:23:16.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:23:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:23:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:23:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:23:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:23:16.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:23:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:23:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:23:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:23:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:23:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:23:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:23:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:23:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:23:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:16.123 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 44.936242399000001, 2024-04-26T10:23:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:23:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:23:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:23:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:23:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:23:16.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:23:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:23:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:23:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:23:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:23:16.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:23:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:23:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:23:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:23:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:23:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:23:16.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:23:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:23:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:23:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:23:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:23:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:23:16.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:23:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.129 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.129 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:16.130 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:16.131 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:16.127+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:16.231 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:16.227+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:16.262 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:16.262 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:16.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.262 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:226078 5.f 5.9538dfaf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:16.262 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:16.259225+0000", 2024-04-26T10:23:16.262 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0017172750000000001, 2024-04-26T10:23:16.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001732663, 2024-04-26T10:23:16.262 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.263 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:16.263 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.263 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.263 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.263 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 226078 2024-04-26T10:23:16.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.263 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259225+0000", 2024-04-26T10:23:16.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259225+0000", 2024-04-26T10:23:16.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259224+0000", 2024-04-26T10:23:16.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259227+0000", 2024-04-26T10:23:16.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6960000000000001e-06 2024-04-26T10:23:16.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259233+0000", 2024-04-26T10:23:16.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.63e-06 2024-04-26T10:23:16.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259239+0000", 2024-04-26T10:23:16.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.879e-06 2024-04-26T10:23:16.265 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.265 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.265 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.265 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:226079 5.d 5:bcdbba65:::benchmark_data_smithi052_19421_object96607:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:16.265 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:16.259284+0000", 2024-04-26T10:23:16.266 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001657986, 2024-04-26T10:23:16.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017100489999999999, 2024-04-26T10:23:16.266 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.266 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:16.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.266 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.266 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 226079 2024-04-26T10:23:16.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.266 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259284+0000", 2024-04-26T10:23:16.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259284+0000", 2024-04-26T10:23:16.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259283+0000", 2024-04-26T10:23:16.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259287+0000", 2024-04-26T10:23:16.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7239999999999998e-06 2024-04-26T10:23:16.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259294+0000", 2024-04-26T10:23:16.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3000000000000004e-06 2024-04-26T10:23:16.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259301+0000", 2024-04-26T10:23:16.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7070000000000003e-06 2024-04-26T10:23:16.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259361+0000", 2024-04-26T10:23:16.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0112999999999999e-05 2024-04-26T10:23:16.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259472+0000", 2024-04-26T10:23:16.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011087899999999999 2024-04-26T10:23:16.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259594+0000", 2024-04-26T10:23:16.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012240600000000001 2024-04-26T10:23:16.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.269 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.269 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.269 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:226080 5.9 5.470c24c9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:16.270 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:16.259315+0000", 2024-04-26T10:23:16.270 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001626965, 2024-04-26T10:23:16.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017162690000000001, 2024-04-26T10:23:16.270 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.270 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:16.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.270 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 226080 2024-04-26T10:23:16.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.270 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259315+0000", 2024-04-26T10:23:16.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259315+0000", 2024-04-26T10:23:16.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259314+0000", 2024-04-26T10:23:16.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259317+0000", 2024-04-26T10:23:16.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0110000000000001e-06 2024-04-26T10:23:16.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259324+0000", 2024-04-26T10:23:16.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3509999999999998e-06 2024-04-26T10:23:16.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259330+0000", 2024-04-26T10:23:16.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2879999999999998e-06 2024-04-26T10:23:16.272 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.272 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.272 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.273 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:226081 5.2 5:4275bbb7:::benchmark_data_smithi052_19421_object96609:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:16.273 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:16.259347+0000", 2024-04-26T10:23:16.273 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0015953569999999999, 2024-04-26T10:23:16.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001712304, 2024-04-26T10:23:16.273 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.273 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:16.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.273 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 226081 2024-04-26T10:23:16.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.273 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259347+0000", 2024-04-26T10:23:16.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259347+0000", 2024-04-26T10:23:16.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259346+0000", 2024-04-26T10:23:16.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259349+0000", 2024-04-26T10:23:16.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4599999999999999e-06 2024-04-26T10:23:16.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259358+0000", 2024-04-26T10:23:16.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6149999999999997e-06 2024-04-26T10:23:16.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259362+0000", 2024-04-26T10:23:16.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3930000000000001e-06 2024-04-26T10:23:16.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259403+0000", 2024-04-26T10:23:16.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0806999999999997e-05 2024-04-26T10:23:16.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259515+0000", 2024-04-26T10:23:16.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011186100000000001 2024-04-26T10:23:16.276 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.276 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.277 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.277 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:226066 5.4 e63/37 5:28d63a16:::benchmark_data_smithi052_19421_object96594:head v 63'14275, mlcod=63'14271)", 2024-04-26T10:23:16.277 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:16.259388+0000", 2024-04-26T10:23:16.277 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0015537890000000001, 2024-04-26T10:23:16.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001707652, 2024-04-26T10:23:16.277 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.277 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:16.277 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259388+0000", 2024-04-26T10:23:16.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259388+0000", 2024-04-26T10:23:16.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259388+0000", 2024-04-26T10:23:16.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259393+0000", 2024-04-26T10:23:16.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0980000000000001e-06 2024-04-26T10:23:16.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259399+0000", 2024-04-26T10:23:16.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5640000000000002e-06 2024-04-26T10:23:16.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259404+0000", 2024-04-26T10:23:16.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6929999999999998e-06 2024-04-26T10:23:16.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259435+0000", 2024-04-26T10:23:16.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1324e-05 2024-04-26T10:23:16.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259454+0000", 2024-04-26T10:23:16.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451e-05 2024-04-26T10:23:16.280 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.280 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.280 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.280 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:226076 5.b e63/37 5:d12da796:::benchmark_data_smithi052_19421_object96604:head v 63'14020, mlcod=63'14018)", 2024-04-26T10:23:16.280 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:16.259876+0000", 2024-04-26T10:23:16.280 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0010655700000000001, 2024-04-26T10:23:16.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001272785, 2024-04-26T10:23:16.280 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.281 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:16.281 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259876+0000", 2024-04-26T10:23:16.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259876+0000", 2024-04-26T10:23:16.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259876+0000", 2024-04-26T10:23:16.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259880+0000", 2024-04-26T10:23:16.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0980000000000004e-06 2024-04-26T10:23:16.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259889+0000", 2024-04-26T10:23:16.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1449999999999997e-06 2024-04-26T10:23:16.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259895+0000", 2024-04-26T10:23:16.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0020000000000003e-06 2024-04-26T10:23:16.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259930+0000", 2024-04-26T10:23:16.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5271000000000002e-05 2024-04-26T10:23:16.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259943+0000", 2024-04-26T10:23:16.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2334000000000001e-05 2024-04-26T10:23:16.283 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.283 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.283 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.284 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:226083 5.9 5.dd87ed99 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:16.284 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:16.260310+0000", 2024-04-26T10:23:16.284 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00063215700000000005, 2024-04-26T10:23:16.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00089351700000000003, 2024-04-26T10:23:16.284 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.284 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:16.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.284 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 226083 2024-04-26T10:23:16.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.284 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.260310+0000", 2024-04-26T10:23:16.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.260310+0000", 2024-04-26T10:23:16.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.260309+0000", 2024-04-26T10:23:16.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.260314+0000", 2024-04-26T10:23:16.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.746e-06 2024-04-26T10:23:16.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.260325+0000", 2024-04-26T10:23:16.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1307e-05 2024-04-26T10:23:16.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.260331+0000", 2024-04-26T10:23:16.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4740000000000002e-06 2024-04-26T10:23:16.286 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.286 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.286 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.287 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:226059 5.4 e63/37 5:2b7801d8:::benchmark_data_smithi052_19421_object96587:head v 63'14274, mlcod=63'14270)", 2024-04-26T10:23:16.287 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:16.256413+0000", 2024-04-26T10:23:16.287 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0045286850000000002, 2024-04-26T10:23:16.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048229029999999999, 2024-04-26T10:23:16.287 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.287 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:16.287 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.256413+0000", 2024-04-26T10:23:16.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.256413+0000", 2024-04-26T10:23:16.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.256413+0000", 2024-04-26T10:23:16.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.256420+0000", 2024-04-26T10:23:16.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9820000000000002e-06 2024-04-26T10:23:16.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.256428+0000", 2024-04-26T10:23:16.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6670000000000002e-06 2024-04-26T10:23:16.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.256434+0000", 2024-04-26T10:23:16.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1890000000000004e-06 2024-04-26T10:23:16.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.256474+0000", 2024-04-26T10:23:16.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9756999999999999e-05 2024-04-26T10:23:16.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.256501+0000", 2024-04-26T10:23:16.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6928999999999999e-05 2024-04-26T10:23:16.290 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.290 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.290 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.290 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:226074 5.9 5:9dfeb29d:::benchmark_data_smithi052_19421_object96602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:16.290 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:16.259172+0000", 2024-04-26T10:23:16.290 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0017696630000000001, 2024-04-26T10:23:16.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020970239999999998, 2024-04-26T10:23:16.290 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.290 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:16.290 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.291 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.291 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.291 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 226074 2024-04-26T10:23:16.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.291 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259172+0000", 2024-04-26T10:23:16.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259172+0000", 2024-04-26T10:23:16.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259171+0000", 2024-04-26T10:23:16.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259175+0000", 2024-04-26T10:23:16.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9870000000000001e-06 2024-04-26T10:23:16.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259184+0000", 2024-04-26T10:23:16.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9539999999999993e-06 2024-04-26T10:23:16.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259189+0000", 2024-04-26T10:23:16.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.668e-06 2024-04-26T10:23:16.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259245+0000", 2024-04-26T10:23:16.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6175999999999999e-05 2024-04-26T10:23:16.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.261107+0000", 2024-04-26T10:23:16.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018615680000000001 2024-04-26T10:23:16.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.261231+0000", 2024-04-26T10:23:16.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012403800000000001 2024-04-26T10:23:16.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.294 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.294 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.294 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:226075 5.f 5:fb64c314:::benchmark_data_smithi052_19421_object96603:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-26T10:23:16.294 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:16.259202+0000", 2024-04-26T10:23:16.294 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001740084, 2024-04-26T10:23:16.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021035709999999998, 2024-04-26T10:23:16.294 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.295 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:16.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.295 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.295 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 226075 2024-04-26T10:23:16.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.295 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259202+0000", 2024-04-26T10:23:16.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259202+0000", 2024-04-26T10:23:16.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259201+0000", 2024-04-26T10:23:16.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259204+0000", 2024-04-26T10:23:16.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6230000000000001e-06 2024-04-26T10:23:16.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259208+0000", 2024-04-26T10:23:16.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0269999999999997e-06 2024-04-26T10:23:16.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259211+0000", 2024-04-26T10:23:16.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2890000000000002e-06 2024-04-26T10:23:16.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259256+0000", 2024-04-26T10:23:16.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4471999999999997e-05 2024-04-26T10:23:16.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259357+0000", 2024-04-26T10:23:16.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101184 2024-04-26T10:23:16.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:16.259450+0000", 2024-04-26T10:23:16.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2632000000000004e-05 2024-04-26T10:23:16.298 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.298 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.298 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.298 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.298 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:23:16.298 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 10 2024-04-26T10:23:16.298 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:16.300 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T10:23:16.300 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:16.332 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:16.330+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:16.432 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:16.432 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:16.433 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:23:16.433 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:23:16.433 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:16.433 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:16.427+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:16.445 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:16.533 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~88s 2024-04-26T10:23:16.533 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:16.527+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:16.575 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:23:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:23:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.534593868999998, 2024-04-26T10:23:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:23:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.576 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:23:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:23:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:23:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:23:16.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:23:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:23:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:23:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:23:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:23:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:23:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:23:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:23:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:23:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:23:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:23:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:23:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:23:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.534484618, 2024-04-26T10:23:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:23:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.581 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:23:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:23:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:23:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:23:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:23:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:23:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:23:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:23:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:23:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:23:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:23:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:23:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:23:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:23:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:23:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.585 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:23:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:23:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.532087206, 2024-04-26T10:23:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:23:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.586 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:23:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:23:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:23:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:23:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:23:16.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:23:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:23:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:23:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:23:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:23:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:23:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:23:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:23:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:23:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:23:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:23:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:23:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:23:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:23:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:23:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:23:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:23:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.591 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 52.531901282, 2024-04-26T10:23:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:23:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:23:16.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:23:16.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:23:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:23:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:23:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:23:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:23:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:23:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:23:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:23:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:23:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:23:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:23:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:23:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:23:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:23:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:23:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:23:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:23:16.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:23:16.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:23:16.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:23:16.597 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.597 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.597 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.597 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:16.597 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.441878666000001, 2024-04-26T10:23:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:23:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:23:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.598 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:16.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:16.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:16.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:23:16.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:23:16.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:23:16.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:23:16.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:23:16.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:23:16.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:23:16.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:23:16.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:16.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:23:16.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:23:16.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:23:16.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:23:16.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:23:16.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:23:16.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:23:16.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:23:16.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:23:16.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:23:16.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:23:16.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:23:16.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:23:16.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:23:16.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:23:16.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:23:16.603 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.603 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.604 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:16.604 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:16.604 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.41877642, 2024-04-26T10:23:16.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:23:16.604 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.604 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.604 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.604 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:23:16.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.604 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:16.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:16.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:23:16.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:16.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:23:16.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:23:16.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:23:16.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:23:16.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:23:16.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:23:16.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:23:16.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:23:16.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:16.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:23:16.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:23:16.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:23:16.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:23:16.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:23:16.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:23:16.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:23:16.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:23:16.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:23:16.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:23:16.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:23:16.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:23:16.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:23:16.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:23:16.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:23:16.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:23:16.610 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.610 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.610 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.610 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:16.610 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:16.610 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.412093282000001, 2024-04-26T10:23:16.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:23:16.610 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.611 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.611 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:23:16.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.611 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.611 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:16.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.611 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:16.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:23:16.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:23:16.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:23:16.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:23:16.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:23:16.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:23:16.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:23:16.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:23:16.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:23:16.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:16.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:23:16.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:23:16.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:23:16.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:23:16.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:23:16.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:23:16.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:23:16.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:23:16.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:23:16.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:23:16.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:23:16.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:23:16.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:23:16.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:23:16.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:23:16.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:23:16.616 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.616 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.616 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.617 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:16.617 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:16.617 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.410095497, 2024-04-26T10:23:16.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:23:16.617 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.617 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.618 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:23:16.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.618 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:16.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:16.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:23:16.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:16.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:23:16.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:23:16.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:23:16.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:23:16.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:23:16.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:23:16.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:23:16.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:23:16.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:16.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:23:16.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:16.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:23:16.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:23:16.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:23:16.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:23:16.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:23:16.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:23:16.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:23:16.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:23:16.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:23:16.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:23:16.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:23:16.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:23:16.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:23:16.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:23:16.623 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.623 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.623 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.623 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:16.623 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:16.624 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.400686791999998, 2024-04-26T10:23:16.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:23:16.624 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.624 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.624 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.624 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.624 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.624 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:23:16.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.624 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:16.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:16.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:23:16.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:23:16.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:23:16.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:23:16.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:16.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:23:16.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:23:16.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:23:16.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:23:16.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:16.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:23:16.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:23:16.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:23:16.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:23:16.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:23:16.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:23:16.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:23:16.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:23:16.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:23:16.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:23:16.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:23:16.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:23:16.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:23:16.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:23:16.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:23:16.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:23:16.629 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.629 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.629 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.630 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:16.630 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:16.630 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.398858743000002, 2024-04-26T10:23:16.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:23:16.630 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.630 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.630 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.630 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:23:16.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.630 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:16.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:16.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:23:16.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:23:16.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:23:16.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:23:16.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:23:16.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:23:16.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:23:16.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:23:16.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:23:16.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:16.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:23:16.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:23:16.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:23:16.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:23:16.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:23:16.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:23:16.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:23:16.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:23:16.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:23:16.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:23:16.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:23:16.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:23:16.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:23:16.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:23:16.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:23:16.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:23:16.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.636 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.636 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:16.636 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:16.636 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.387279021000001, 2024-04-26T10:23:16.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:23:16.636 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.636 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.636 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.637 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:23:16.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.637 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:16.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:16.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:16.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:23:16.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:23:16.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:23:16.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:23:16.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:23:16.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:23:16.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:23:16.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:23:16.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:16.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:23:16.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:23:16.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:23:16.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:23:16.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:23:16.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:23:16.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:23:16.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:23:16.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:23:16.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:23:16.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:23:16.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:23:16.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:23:16.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:23:16.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:23:16.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:23:16.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.642 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.642 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.642 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:16.642 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:16.643 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.380868527000001, 2024-04-26T10:23:16.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:23:16.643 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.643 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.643 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:23:16.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.643 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:16.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:16.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:23:16.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:23:16.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:23:16.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:23:16.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:23:16.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:23:16.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:16.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:23:16.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:23:16.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:16.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:23:16.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:23:16.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:23:16.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:23:16.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:23:16.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:23:16.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:23:16.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:23:16.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:23:16.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:23:16.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:23:16.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:23:16.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:23:16.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:23:16.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:23:16.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:23:16.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.648 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.648 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.649 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:16.649 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:16.649 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.368283464000001, 2024-04-26T10:23:16.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:23:16.649 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.649 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.649 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.649 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:23:16.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.649 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:16.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:16.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:23:16.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:23:16.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:16.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:23:16.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:23:16.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:23:16.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:23:16.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:23:16.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:23:16.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:16.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:23:16.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:16.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:23:16.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:23:16.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:23:16.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:23:16.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:23:16.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:23:16.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:23:16.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:23:16.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:23:16.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:23:16.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:23:16.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:23:16.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:23:16.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:23:16.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.654 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.654 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.655 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:16.655 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:16.655 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.368048530999999, 2024-04-26T10:23:16.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:23:16.655 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.655 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.655 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.655 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:23:16.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.655 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:16.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:16.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:23:16.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:23:16.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:23:16.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:23:16.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:23:16.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:23:16.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:23:16.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:23:16.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:23:16.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:16.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:23:16.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:16.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:23:16.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:23:16.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:23:16.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:23:16.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:23:16.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:23:16.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:23:16.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:23:16.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:23:16.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:23:16.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:23:16.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:23:16.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:23:16.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:23:16.661 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.661 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.661 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.661 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:16.661 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:16.661 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.330173653999999, 2024-04-26T10:23:16.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:23:16.661 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.661 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.661 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.662 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:23:16.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.662 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:16.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:16.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:23:16.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:16.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:23:16.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:23:16.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:23:16.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:23:16.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:23:16.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:23:16.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:23:16.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:23:16.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:16.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:23:16.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:16.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:23:16.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:23:16.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:23:16.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:23:16.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:23:16.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:23:16.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:23:16.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:23:16.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:23:16.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:23:16.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:23:16.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:23:16.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:23:16.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:23:16.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.667 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.667 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.667 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:16.667 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:16.667 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.329728629000002, 2024-04-26T10:23:16.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:23:16.667 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.667 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:23:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:23:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:23:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:23:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:23:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:23:16.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:23:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:23:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:23:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:23:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:23:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:23:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:23:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:23:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:23:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:23:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:23:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:23:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:23:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:23:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:23:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:23:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:23:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:23:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:23:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:23:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.318125629000001, 2024-04-26T10:23:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:23:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:23:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:23:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:23:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:23:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:23:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:23:16.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:23:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:23:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:23:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:23:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:23:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:23:16.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:23:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:23:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:23:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:23:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:23:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:23:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:23:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:23:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:23:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:23:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:23:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:23:16.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:23:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:23:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.316852039, 2024-04-26T10:23:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:23:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.679 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:23:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:23:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:23:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:23:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:23:16.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:23:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:23:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:23:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:23:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:23:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:23:16.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:23:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:23:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:23:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:23:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:23:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:23:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:23:16.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:23:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:23:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:23:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:23:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:23:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:23:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:23:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:23:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.300094737999999, 2024-04-26T10:23:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:23:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.685 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:23:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:23:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:23:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:23:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:23:16.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:23:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:23:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:23:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:23:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:23:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:23:16.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:23:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:23:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:23:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:23:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:23:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:23:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:23:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:23:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:23:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:23:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:23:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:23:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:23:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:23:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:23:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 27.255182717, 2024-04-26T10:23:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:23:16.691 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:23:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:23:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:23:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:23:16.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:23:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:23:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:23:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:23:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:23:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:23:16.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:23:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:23:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:23:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:23:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:23:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:23:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:23:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:23:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:23:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:23:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:23:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:23:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:23:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:23:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:23:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:23:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:16.697 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:16.697 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:16.699 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:16.699 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:16.695+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:16.799 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:16.795+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:16.832 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:16.832 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:16.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.832 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:227397 5.b 5:d9c36f0a:::benchmark_data_smithi052_19421_object97925:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T10:23:16.832 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:16.827127+0000", 2024-04-26T10:23:16.832 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0050710950000000003, 2024-04-26T10:23:16.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050878980000000004, 2024-04-26T10:23:16.832 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.832 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:16.832 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.832 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.833 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.833 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 227397 2024-04-26T10:23:16.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.833 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827127+0000", 2024-04-26T10:23:16.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827127+0000", 2024-04-26T10:23:16.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827126+0000", 2024-04-26T10:23:16.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827131+0000", 2024-04-26T10:23:16.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3680000000000001e-06 2024-04-26T10:23:16.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.834 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.834 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827141+0000", 2024-04-26T10:23:16.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8830000000000001e-06 2024-04-26T10:23:16.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827147+0000", 2024-04-26T10:23:16.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5779999999999998e-06 2024-04-26T10:23:16.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827225+0000", 2024-04-26T10:23:16.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8203999999999999e-05 2024-04-26T10:23:16.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827416+0000", 2024-04-26T10:23:16.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019115700000000001 2024-04-26T10:23:16.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:16.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827542+0000", 2024-04-26T10:23:16.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012542400000000001 2024-04-26T10:23:16.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.829998+0000", 2024-04-26T10:23:16.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024562640000000001 2024-04-26T10:23:16.836 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.836 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.836 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.837 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:227399 5.4 5:2e6e49a5:::benchmark_data_smithi052_19421_object97927:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T10:23:16.837 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:16.827244+0000", 2024-04-26T10:23:16.837 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0049543879999999997, 2024-04-26T10:23:16.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050506589999999999, 2024-04-26T10:23:16.837 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.837 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:16.837 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.837 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.837 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.837 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 227399 2024-04-26T10:23:16.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.837 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827244+0000", 2024-04-26T10:23:16.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827244+0000", 2024-04-26T10:23:16.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827243+0000", 2024-04-26T10:23:16.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827247+0000", 2024-04-26T10:23:16.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9960000000000004e-06 2024-04-26T10:23:16.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827252+0000", 2024-04-26T10:23:16.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0250000000000002e-06 2024-04-26T10:23:16.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827256+0000", 2024-04-26T10:23:16.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5279999999999999e-06 2024-04-26T10:23:16.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827334+0000", 2024-04-26T10:23:16.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8429000000000004e-05 2024-04-26T10:23:16.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827432+0000", 2024-04-26T10:23:16.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8430000000000005e-05 2024-04-26T10:23:16.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:16.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827509+0000", 2024-04-26T10:23:16.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6754000000000004e-05 2024-04-26T10:23:16.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.841 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.841 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.829943+0000", 2024-04-26T10:23:16.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0024340529999999998 2024-04-26T10:23:16.841 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.841 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.841 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.841 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:227400 5.8 5:1a2e06f0:::benchmark_data_smithi052_19421_object97928:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T10:23:16.841 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:16.827268+0000", 2024-04-26T10:23:16.841 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0049303089999999999, 2024-04-26T10:23:16.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0051054059999999998, 2024-04-26T10:23:16.842 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.842 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:16.842 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.842 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.842 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.842 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 227400 2024-04-26T10:23:16.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.842 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827268+0000", 2024-04-26T10:23:16.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827268+0000", 2024-04-26T10:23:16.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827267+0000", 2024-04-26T10:23:16.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:16.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827270+0000", 2024-04-26T10:23:16.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7410000000000001e-06 2024-04-26T10:23:16.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827312+0000", 2024-04-26T10:23:16.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2175999999999997e-05 2024-04-26T10:23:16.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827318+0000", 2024-04-26T10:23:16.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7130000000000002e-06 2024-04-26T10:23:16.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827438+0000", 2024-04-26T10:23:16.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120265 2024-04-26T10:23:16.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.827552+0000", 2024-04-26T10:23:16.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000113255 2024-04-26T10:23:16.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:16.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.832275+0000", 2024-04-26T10:23:16.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047236880000000002 2024-04-26T10:23:16.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:16.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.832326+0000", 2024-04-26T10:23:16.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0467000000000003e-05 2024-04-26T10:23:16.846 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.846 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.846 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.846 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:227404 5.9 e64/37 5:9bc73a09:::benchmark_data_smithi052_19421_object97932:head v 64'14336, mlcod=64'14333)", 2024-04-26T10:23:16.846 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:16.830975+0000", 2024-04-26T10:23:16.846 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0012229910000000001, 2024-04-26T10:23:16.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001451532, 2024-04-26T10:23:16.846 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.846 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:16.846 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.830975+0000", 2024-04-26T10:23:16.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.830975+0000", 2024-04-26T10:23:16.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.830974+0000", 2024-04-26T10:23:16.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.830981+0000", 2024-04-26T10:23:16.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9450000000000004e-06 2024-04-26T10:23:16.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.848 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.830998+0000", 2024-04-26T10:23:16.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6200000000000001e-05 2024-04-26T10:23:16.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.848 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.831005+0000", 2024-04-26T10:23:16.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7149999999999998e-06 2024-04-26T10:23:16.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.831045+0000", 2024-04-26T10:23:16.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9739e-05 2024-04-26T10:23:16.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.831062+0000", 2024-04-26T10:23:16.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6602000000000001e-05 2024-04-26T10:23:16.849 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.849 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.850 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.850 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:227407 5.4 5:227ceada:::benchmark_data_smithi052_19421_object97935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-26T10:23:16.850 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:16.831939+0000", 2024-04-26T10:23:16.850 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00025896399999999998, 2024-04-26T10:23:16.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00054607099999999997, 2024-04-26T10:23:16.850 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:16.850 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:16.850 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:16.850 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:16.850 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:16.850 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 227407 2024-04-26T10:23:16.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.851 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:16.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:16.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.831939+0000", 2024-04-26T10:23:16.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:16.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.831939+0000", 2024-04-26T10:23:16.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:16.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:16.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.831938+0000", 2024-04-26T10:23:16.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:16.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:16.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.831943+0000", 2024-04-26T10:23:16.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5800000000000002e-06 2024-04-26T10:23:16.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:16.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.831952+0000", 2024-04-26T10:23:16.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.431e-06 2024-04-26T10:23:16.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:16.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.831957+0000", 2024-04-26T10:23:16.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6280000000000004e-06 2024-04-26T10:23:16.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:16.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.832008+0000", 2024-04-26T10:23:16.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1059e-05 2024-04-26T10:23:16.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:16.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.832233+0000", 2024-04-26T10:23:16.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022525400000000001 2024-04-26T10:23:16.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:16.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:16.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:16.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:16.832372+0000", 2024-04-26T10:23:16.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013867 2024-04-26T10:23:16.854 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.854 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:16.854 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.854 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:16.854 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:23:16.854 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 5 2024-04-26T10:23:16.854 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:16.855 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:16.900 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:16.895+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:16.927 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:23:16.990 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:16.991 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:16.991 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:23:16.991 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:23:16.991 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:17.001 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:16.998+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:17.003 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:17.082 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:23:17.102 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:17.098+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:17.103 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:23:17.104 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:23:17.104 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:23:17.104 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:23:17.109 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:23:17.109 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:23:17.123 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:17.123 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:17.135 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:17.204 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:17.199+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:17.271 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:17.271 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:17.284 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:17.304 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:17.299+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:17.390 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:17.390 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:17.400 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:17.405 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:17.399+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:17.506 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:17.503+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:17.506 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:17.507 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:17.516 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:17.607 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:17.606+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:17.640 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:17.640 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:17.651 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:17.707 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:17.703+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:17.756 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:17.757 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:17.766 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:17.808 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:17.806+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:17.869 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:17.869 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:17.879 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:17.908 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:17.906+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:17.999 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:18.000 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:18.009 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:18.003+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:18.010 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:18.110 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:18.107+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:18.168 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:18.168 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:18.178 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:18.210 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:18.210+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:18.297 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:18.297 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:18.301 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:23:18.307 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:18.351 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:18.350+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:18.412 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:18.407+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:18.439 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:18.439 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:18.450 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:18.513 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:18.507+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:18.572 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:18.572 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:18.584 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:18.614 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:18.611+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:18.706 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:18.706 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:18.715 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:18.714+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:18.718 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:18.817 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:18.811+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:18.846 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:18.846 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:18.857 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:18.918 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:18.911+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:18.992 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:18.992 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:19.005 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:19.018 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:19.018+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:19.110 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:23:19.119 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:19.118+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:19.180 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:19.180 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:19.192 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:19.239 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:19.238+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:19.264 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:23:19.285 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:23:19.287 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:23:19.287 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:23:19.287 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:23:19.290 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T10:23:19.291 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:23:19.291 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:23:19.321 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:19.318+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:19.326 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:19.326 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:19.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.326 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:230798 5.9 e67/37 5:981f3c8a:::benchmark_data_smithi052_19421_object101326:head v 67'14540, mlcod=67'14538)", 2024-04-26T10:23:19.326 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:19.319756+0000", 2024-04-26T10:23:19.326 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0053505890000000002, 2024-04-26T10:23:19.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053686890000000003, 2024-04-26T10:23:19.326 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.326 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:19.326 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.326 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.319756+0000", 2024-04-26T10:23:19.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.319756+0000", 2024-04-26T10:23:19.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.319756+0000", 2024-04-26T10:23:19.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.319762+0000", 2024-04-26T10:23:19.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5289999999999997e-06 2024-04-26T10:23:19.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.319772+0000", 2024-04-26T10:23:19.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8819999999999996e-06 2024-04-26T10:23:19.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.319779+0000", 2024-04-26T10:23:19.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9990000000000002e-06 2024-04-26T10:23:19.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.319815+0000", 2024-04-26T10:23:19.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5683999999999999e-05 2024-04-26T10:23:19.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.319838+0000", 2024-04-26T10:23:19.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.2875e-05 2024-04-26T10:23:19.329 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.329 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.329 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.330 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:230800 5.b 5:db6acffd:::benchmark_data_smithi052_19421_object101328:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:19.330 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:19.319776+0000", 2024-04-26T10:23:19.330 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0053308510000000002, 2024-04-26T10:23:19.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053865739999999999, 2024-04-26T10:23:19.330 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.330 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:19.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.330 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.330 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 230800 2024-04-26T10:23:19.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.330 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.319776+0000", 2024-04-26T10:23:19.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.319776+0000", 2024-04-26T10:23:19.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.319776+0000", 2024-04-26T10:23:19.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.319779+0000", 2024-04-26T10:23:19.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9979999999999999e-06 2024-04-26T10:23:19.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.319785+0000", 2024-04-26T10:23:19.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7490000000000001e-06 2024-04-26T10:23:19.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.332 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.332 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.319794+0000", 2024-04-26T10:23:19.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9220000000000003e-06 2024-04-26T10:23:19.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.320635+0000", 2024-04-26T10:23:19.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00084038400000000001 2024-04-26T10:23:19.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.320776+0000", 2024-04-26T10:23:19.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014171299999999999 2024-04-26T10:23:19.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:19.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.320929+0000", 2024-04-26T10:23:19.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015288699999999999 2024-04-26T10:23:19.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:19.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.324736+0000", 2024-04-26T10:23:19.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003807024 2024-04-26T10:23:19.334 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.334 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.334 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.334 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:230803 5.4 e67/65 5:24f89bda:::benchmark_data_smithi052_19421_object101331:head v 67'14544, mlcod=66'14541)", 2024-04-26T10:23:19.334 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:19.320173+0000", 2024-04-26T10:23:19.334 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0049336199999999997, 2024-04-26T10:23:19.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0050318560000000003, 2024-04-26T10:23:19.335 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.335 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:19.335 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.320173+0000", 2024-04-26T10:23:19.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.320173+0000", 2024-04-26T10:23:19.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.320173+0000", 2024-04-26T10:23:19.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.320178+0000", 2024-04-26T10:23:19.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6200000000000004e-06 2024-04-26T10:23:19.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.320187+0000", 2024-04-26T10:23:19.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4190000000000002e-06 2024-04-26T10:23:19.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.320192+0000", 2024-04-26T10:23:19.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.767e-06 2024-04-26T10:23:19.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.320249+0000", 2024-04-26T10:23:19.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6190999999999998e-05 2024-04-26T10:23:19.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.320273+0000", 2024-04-26T10:23:19.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4553999999999999e-05 2024-04-26T10:23:19.338 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.338 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.338 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.339 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:230801 5.f e67/37 5:fa5d425f:::benchmark_data_smithi052_19421_object101329:head v 67'14539, mlcod=67'14536)", 2024-04-26T10:23:19.339 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:19.321558+0000", 2024-04-26T10:23:19.339 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0035492240000000001, 2024-04-26T10:23:19.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036791979999999998, 2024-04-26T10:23:19.339 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.339 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:19.339 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.321558+0000", 2024-04-26T10:23:19.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.321558+0000", 2024-04-26T10:23:19.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.321557+0000", 2024-04-26T10:23:19.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:19.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.321564+0000", 2024-04-26T10:23:19.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1860000000000003e-06 2024-04-26T10:23:19.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.321582+0000", 2024-04-26T10:23:19.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7997999999999999e-05 2024-04-26T10:23:19.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.321592+0000", 2024-04-26T10:23:19.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:19.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.321630+0000", 2024-04-26T10:23:19.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8618000000000002e-05 2024-04-26T10:23:19.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.321687+0000", 2024-04-26T10:23:19.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6468000000000002e-05 2024-04-26T10:23:19.342 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.342 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.342 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.342 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:230805 5.a 5:583f313a:::benchmark_data_smithi052_19421_object101333:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:19.343 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:19.321966+0000", 2024-04-26T10:23:19.343 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0031412850000000002, 2024-04-26T10:23:19.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003304937, 2024-04-26T10:23:19.343 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.343 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:19.343 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.343 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.343 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.343 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 230805 2024-04-26T10:23:19.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.343 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.321966+0000", 2024-04-26T10:23:19.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.321966+0000", 2024-04-26T10:23:19.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.321964+0000", 2024-04-26T10:23:19.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:19.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.321970+0000", 2024-04-26T10:23:19.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8810000000000001e-06 2024-04-26T10:23:19.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.321984+0000", 2024-04-26T10:23:19.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4017e-05 2024-04-26T10:23:19.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.321992+0000", 2024-04-26T10:23:19.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0940000000000008e-06 2024-04-26T10:23:19.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.322046+0000", 2024-04-26T10:23:19.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3519e-05 2024-04-26T10:23:19.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.322210+0000", 2024-04-26T10:23:19.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016406099999999999 2024-04-26T10:23:19.349 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.349 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.349 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.350 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:230804 5.0 e67/54 5:0cff89e2:::benchmark_data_smithi052_19421_object101332:head v 67'14447, mlcod=67'14444)", 2024-04-26T10:23:19.350 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:19.322053+0000", 2024-04-26T10:23:19.350 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0030537089999999999, 2024-04-26T10:23:19.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003249385, 2024-04-26T10:23:19.350 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.350 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:19.350 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.322053+0000", 2024-04-26T10:23:19.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.322053+0000", 2024-04-26T10:23:19.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.322052+0000", 2024-04-26T10:23:19.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.322059+0000", 2024-04-26T10:23:19.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8789999999999997e-06 2024-04-26T10:23:19.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.322069+0000", 2024-04-26T10:23:19.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6059999999999992e-06 2024-04-26T10:23:19.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.322076+0000", 2024-04-26T10:23:19.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8630000000000002e-06 2024-04-26T10:23:19.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.322125+0000", 2024-04-26T10:23:19.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8875000000000002e-05 2024-04-26T10:23:19.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.322151+0000", 2024-04-26T10:23:19.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6622e-05 2024-04-26T10:23:19.353 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.353 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.353 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.353 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:230807 5.e 5:771f3d04:::benchmark_data_smithi052_19421_object101335:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:19.353 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:19.322395+0000", 2024-04-26T10:23:19.353 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0027121960000000001, 2024-04-26T10:23:19.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029374980000000002, 2024-04-26T10:23:19.353 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.354 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:19.354 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.354 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.354 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.354 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 230807 2024-04-26T10:23:19.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.354 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.322395+0000", 2024-04-26T10:23:19.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.322395+0000", 2024-04-26T10:23:19.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.322394+0000", 2024-04-26T10:23:19.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:19.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.322399+0000", 2024-04-26T10:23:19.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5219999999999998e-06 2024-04-26T10:23:19.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.322412+0000", 2024-04-26T10:23:19.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2958e-05 2024-04-26T10:23:19.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.322420+0000", 2024-04-26T10:23:19.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3259999999999998e-06 2024-04-26T10:23:19.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.323324+0000", 2024-04-26T10:23:19.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00090406000000000004 2024-04-26T10:23:19.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.323489+0000", 2024-04-26T10:23:19.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016572000000000001 2024-04-26T10:23:19.357 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.357 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.357 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.357 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:230809 5.d e67/37 5:b8b3e890:::benchmark_data_smithi052_19421_object101337:head v 67'14500, mlcod=67'14498)", 2024-04-26T10:23:19.357 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:19.323710+0000", 2024-04-26T10:23:19.357 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0013968839999999999, 2024-04-26T10:23:19.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016556450000000001, 2024-04-26T10:23:19.357 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.357 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:19.358 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.323710+0000", 2024-04-26T10:23:19.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.323710+0000", 2024-04-26T10:23:19.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.323709+0000", 2024-04-26T10:23:19.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.323716+0000", 2024-04-26T10:23:19.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.776e-06 2024-04-26T10:23:19.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.323726+0000", 2024-04-26T10:23:19.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0189e-05 2024-04-26T10:23:19.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.323733+0000", 2024-04-26T10:23:19.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.6229999999999999e-06 2024-04-26T10:23:19.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.323776+0000", 2024-04-26T10:23:19.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2657999999999997e-05 2024-04-26T10:23:19.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.323796+0000", 2024-04-26T10:23:19.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0438999999999999e-05 2024-04-26T10:23:19.361 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.361 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.361 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.362 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:230808 5.0 e67/54 5:0791b64a:::benchmark_data_smithi052_19421_object101336:head v 67'14448, mlcod=67'14444)", 2024-04-26T10:23:19.362 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:19.323758+0000", 2024-04-26T10:23:19.362 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0013491289999999999, 2024-04-26T10:23:19.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016368229999999999, 2024-04-26T10:23:19.362 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.362 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:19.362 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.323758+0000", 2024-04-26T10:23:19.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.323758+0000", 2024-04-26T10:23:19.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.323757+0000", 2024-04-26T10:23:19.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.323762+0000", 2024-04-26T10:23:19.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2780000000000004e-06 2024-04-26T10:23:19.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.323769+0000", 2024-04-26T10:23:19.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.153e-06 2024-04-26T10:23:19.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.323774+0000", 2024-04-26T10:23:19.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5249999999999996e-06 2024-04-26T10:23:19.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.324001+0000", 2024-04-26T10:23:19.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00022709100000000001 2024-04-26T10:23:19.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.324047+0000", 2024-04-26T10:23:19.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5351e-05 2024-04-26T10:23:19.365 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.365 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.365 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.365 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:230810 5.8 5:179a80c6:::benchmark_data_smithi052_19421_object101338:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:19.365 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:19.324755+0000", 2024-04-26T10:23:19.365 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00035214099999999999, 2024-04-26T10:23:19.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00066955699999999999, 2024-04-26T10:23:19.365 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.366 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:19.366 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.366 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.366 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.366 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 230810 2024-04-26T10:23:19.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.366 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.324755+0000", 2024-04-26T10:23:19.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.324755+0000", 2024-04-26T10:23:19.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.324753+0000", 2024-04-26T10:23:19.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:19.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.324759+0000", 2024-04-26T10:23:19.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3299999999999998e-06 2024-04-26T10:23:19.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.324768+0000", 2024-04-26T10:23:19.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0899999999999994e-06 2024-04-26T10:23:19.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.324775+0000", 2024-04-26T10:23:19.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7610000000000002e-06 2024-04-26T10:23:19.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.324852+0000", 2024-04-26T10:23:19.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.7412999999999999e-05 2024-04-26T10:23:19.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.324991+0000", 2024-04-26T10:23:19.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000138923 2024-04-26T10:23:19.369 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.369 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.369 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.369 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:230811 5.b 5.3ac7e40b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:19.369 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:19.324795+0000", 2024-04-26T10:23:19.369 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.000311739, 2024-04-26T10:23:19.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00066039899999999999, 2024-04-26T10:23:19.369 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.369 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:19.370 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.370 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.370 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.370 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 230811 2024-04-26T10:23:19.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.370 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.324795+0000", 2024-04-26T10:23:19.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.324795+0000", 2024-04-26T10:23:19.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.324795+0000", 2024-04-26T10:23:19.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.324798+0000", 2024-04-26T10:23:19.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.5619999999999999e-06 2024-04-26T10:23:19.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.324805+0000", 2024-04-26T10:23:19.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7360000000000004e-06 2024-04-26T10:23:19.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.324810+0000", 2024-04-26T10:23:19.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4840000000000003e-06 2024-04-26T10:23:19.372 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.372 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.372 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.373 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:230812 5.9 e67/37 5:9e099848:::benchmark_data_smithi052_19421_object101340:head v 67'14541, mlcod=67'14538)", 2024-04-26T10:23:19.373 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:19.325090+0000", 2024-04-26T10:23:19.373 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 1.6714999999999998e-05, 2024-04-26T10:23:19.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00039177, 2024-04-26T10:23:19.373 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.373 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:19.373 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.325090+0000", 2024-04-26T10:23:19.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.325090+0000", 2024-04-26T10:23:19.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.325089+0000", 2024-04-26T10:23:19.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.325095+0000", 2024-04-26T10:23:19.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9939999999999997e-06 2024-04-26T10:23:19.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.325105+0000", 2024-04-26T10:23:19.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.397e-06 2024-04-26T10:23:19.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.325111+0000", 2024-04-26T10:23:19.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.784e-06 2024-04-26T10:23:19.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.325153+0000", 2024-04-26T10:23:19.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2324000000000003e-05 2024-04-26T10:23:19.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.325172+0000", 2024-04-26T10:23:19.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9347e-05 2024-04-26T10:23:19.376 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.376 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.376 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.376 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:230792 5.e 5:7eaa9bd0:::benchmark_data_smithi052_19421_object101320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:19.377 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:19.316231+0000", 2024-04-26T10:23:19.377 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0088757909999999992, 2024-04-26T10:23:19.377 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0092808630000000003, 2024-04-26T10:23:19.377 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.377 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:19.377 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.377 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.377 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.377 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 230792 2024-04-26T10:23:19.377 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.377 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.316231+0000", 2024-04-26T10:23:19.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.378 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.378 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.378 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.316231+0000", 2024-04-26T10:23:19.378 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.378 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.379 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.379 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.316231+0000", 2024-04-26T10:23:19.379 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.379 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.379 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.316234+0000", 2024-04-26T10:23:19.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.8679999999999999e-06 2024-04-26T10:23:19.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.316240+0000", 2024-04-26T10:23:19.380 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.443e-06 2024-04-26T10:23:19.380 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.380 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.380 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.380 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.316245+0000", 2024-04-26T10:23:19.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9189999999999998e-06 2024-04-26T10:23:19.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.316279+0000", 2024-04-26T10:23:19.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3773999999999999e-05 2024-04-26T10:23:19.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.381 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.381 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.381 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.316414+0000", 2024-04-26T10:23:19.381 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013545699999999999 2024-04-26T10:23:19.381 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.381 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.381 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.381 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.382 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.382 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:230793 5.8 5:17f12a32:::benchmark_data_smithi052_19421_object101321:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:19.382 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:19.316265+0000", 2024-04-26T10:23:19.382 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.008841738, 2024-04-26T10:23:19.382 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0092795849999999999, 2024-04-26T10:23:19.382 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.382 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:19.382 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.382 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.382 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.382 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 230793 2024-04-26T10:23:19.382 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.382 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.316265+0000", 2024-04-26T10:23:19.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.316265+0000", 2024-04-26T10:23:19.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.383 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.383 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.383 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.383 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.316265+0000", 2024-04-26T10:23:19.383 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.316268+0000", 2024-04-26T10:23:19.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1140000000000002e-06 2024-04-26T10:23:19.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.316275+0000", 2024-04-26T10:23:19.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7309999999999996e-06 2024-04-26T10:23:19.384 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.384 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.384 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.316280+0000", 2024-04-26T10:23:19.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2959999999999998e-06 2024-04-26T10:23:19.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.316318+0000", 2024-04-26T10:23:19.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.8566000000000003e-05 2024-04-26T10:23:19.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.316456+0000", 2024-04-26T10:23:19.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013734199999999999 2024-04-26T10:23:19.385 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.385 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.385 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.386 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:230795 5.0 e67/54 5:0974f630:::benchmark_data_smithi052_19421_object101323:head v 67'14446, mlcod=67'14444)", 2024-04-26T10:23:19.386 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:19.317270+0000", 2024-04-26T10:23:19.386 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0078373350000000008, 2024-04-26T10:23:19.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.008307053, 2024-04-26T10:23:19.386 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.386 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:19.386 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.317270+0000", 2024-04-26T10:23:19.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.317270+0000", 2024-04-26T10:23:19.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.317269+0000", 2024-04-26T10:23:19.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.317273+0000", 2024-04-26T10:23:19.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3059999999999999e-06 2024-04-26T10:23:19.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.317280+0000", 2024-04-26T10:23:19.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4250000000000003e-06 2024-04-26T10:23:19.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.317284+0000", 2024-04-26T10:23:19.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2390000000000004e-06 2024-04-26T10:23:19.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.317321+0000", 2024-04-26T10:23:19.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7085999999999997e-05 2024-04-26T10:23:19.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.389 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:19.317349+0000", 2024-04-26T10:23:19.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7627000000000002e-05 2024-04-26T10:23:19.389 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.389 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.389 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.389 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.389 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:23:19.389 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 15 2024-04-26T10:23:19.389 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:19.390 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:19.435 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:19.434+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:19.514 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:19.514 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:19.514 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:23:19.514 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:23:19.514 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:19.524 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:19.522+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:19.527 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:19.625 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:19.619+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:19.655 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:19.655 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:23:19.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:23:19.655 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:19.655 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.655 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:19.655 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:19.655 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.122571868999998, 2024-04-26T10:23:19.655 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:23:19.655 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.655 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.655 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.655 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.656 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.656 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:23:19.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.656 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:19.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.656 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.656 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:19.656 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.656 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.656 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:23:19.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:23:19.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:23:19.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.657 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.657 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:23:19.657 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:23:19.657 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.657 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:23:19.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:23:19.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:23:19.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:23:19.658 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.658 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.658 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.658 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:23:19.658 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:23:19.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:19.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:23:19.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:23:19.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:23:19.659 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:23:19.659 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.659 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.659 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.659 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:23:19.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:23:19.660 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.660 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.660 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.660 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.660 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.660 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:19.660 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:19.660 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.120589641999999, 2024-04-26T10:23:19.660 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:23:19.660 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.660 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.660 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.661 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.661 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.661 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:23:19.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.661 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:19.661 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.661 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.661 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.661 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.661 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:19.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:23:19.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:23:19.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.662 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.662 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:23:19.662 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:23:19.662 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.662 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:23:19.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:23:19.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:23:19.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:23:19.663 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.663 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.663 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.663 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:23:19.663 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:23:19.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:23:19.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:23:19.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:19.664 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:23:19.664 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:23:19.664 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.664 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.664 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:23:19.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:23:19.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.665 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.665 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:23:19.665 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:23:19.665 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.665 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.665 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.665 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.665 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.665 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:19.665 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:19.666 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.120390258, 2024-04-26T10:23:19.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:23:19.666 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.666 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.666 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.666 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.666 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.666 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:23:19.666 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.666 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.666 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.666 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.666 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:19.666 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:19.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:19.667 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.667 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.667 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.667 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.667 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:23:19.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:23:19.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:23:19.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:23:19.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:23:19.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:23:19.668 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.668 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.668 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.668 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:23:19.668 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:23:19.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:23:19.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:23:19.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:19.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:23:19.669 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:23:19.669 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.669 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.669 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.669 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:23:19.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:23:19.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.670 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.670 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:23:19.670 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:23:19.670 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.670 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.670 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.670 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.670 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.670 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:23:19.670 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:19.671 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.120171638000002, 2024-04-26T10:23:19.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:23:19.671 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.671 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.671 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:19.671 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.671 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.671 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.671 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.671 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:19.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:23:19.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:19.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:23:19.672 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:23:19.672 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.672 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.672 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.672 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:23:19.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:23:19.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:23:19.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:23:19.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.673 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.673 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:23:19.673 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:23:19.673 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.673 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:23:19.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:23:19.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:23:19.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:23:19.674 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.674 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.674 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.674 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:23:19.674 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:23:19.675 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.675 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.675 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.675 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.675 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.675 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:19.675 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:19.675 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.117800200000005, 2024-04-26T10:23:19.675 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:23:19.675 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.675 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.675 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.675 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.677 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.677 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:23:19.677 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.677 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.677 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.677 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:19.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:19.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.678 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:23:19.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:19.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.678 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.678 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:23:19.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:23:19.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:23:19.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:23:19.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:23:19.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:23:19.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:19.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:23:19.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:23:19.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:23:19.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:19.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:23:19.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:23:19.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:23:19.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:23:19.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:23:19.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:23:19.681 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.681 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.681 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.681 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:19.681 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:19.681 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.117699578, 2024-04-26T10:23:19.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:23:19.682 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.682 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.682 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.682 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:23:19.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.682 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:19.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:19.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:23:19.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:23:19.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:23:19.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:23:19.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:23:19.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:23:19.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:23:19.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:23:19.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:23:19.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:23:19.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:23:19.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:19.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:23:19.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:23:19.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:23:19.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:23:19.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:23:19.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:23:19.686 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.687 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.687 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.687 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:23:19.687 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:19.687 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.117581017000006, 2024-04-26T10:23:19.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:23:19.687 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.687 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.687 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:19.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:19.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:23:19.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:19.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:23:19.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:23:19.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:23:19.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:23:19.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:23:19.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:23:19.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.689 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.689 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:23:19.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:23:19.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:23:19.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:23:19.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:23:19.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:23:19.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:23:19.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:23:19.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.691 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.691 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.691 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:19.691 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:19.691 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.117478618999996, 2024-04-26T10:23:19.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:23:19.691 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.691 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.691 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.692 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.692 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:23:19.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.692 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:19.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:19.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:23:19.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:19.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:23:19.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:23:19.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:23:19.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:23:19.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:23:19.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:23:19.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.694 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:19.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:23:19.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:23:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:23:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:23:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:23:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:23:19.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:23:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:23:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:23:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.116458062000007, 2024-04-26T10:23:19.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:23:19.697 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.697 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.697 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.697 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.697 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.697 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:23:19.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.697 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:19.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:19.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:23:19.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:19.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:23:19.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:23:19.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:23:19.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:23:19.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:23:19.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:23:19.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:23:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:23:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:23:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:23:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:23:19.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:23:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:23:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:23:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:23:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:23:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.702 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:19.702 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:19.702 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 79.115307787000006, 2024-04-26T10:23:19.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:23:19.702 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.702 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.702 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.702 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.702 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.702 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:23:19.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:23:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:23:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:23:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:23:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:23:19.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:23:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:23:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:23:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:23:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:23:19.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:23:19.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:19.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:23:19.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:23:19.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:23:19.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:23:19.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:23:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:23:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.618608545000001, 2024-04-26T10:23:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:23:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.707 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.708 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.708 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.708 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:23:19.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.708 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:19.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:19.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:23:19.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:19.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:23:19.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:23:19.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:23:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:23:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:23:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:23:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:23:19.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:23:19.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:23:19.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:23:19.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:19.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:23:19.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:23:19.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:23:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:23:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:23:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:23:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:23:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:23:19.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:23:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:23:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 55.618384949000003, 2024-04-26T10:23:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:23:19.713 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.714 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.714 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.714 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.714 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.714 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:23:19.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.714 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:19.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:23:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:23:19.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:23:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:23:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:23:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:23:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:23:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:23:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:23:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:23:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:23:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:23:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:23:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:19.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:23:19.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:23:19.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:19.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:23:19.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:23:19.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.718 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.718 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:23:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:23:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:23:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:23:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:19.719 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:19.720 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.587538629000001, 2024-04-26T10:23:19.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:23:19.720 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.720 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.720 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.720 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.720 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.720 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:23:19.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.720 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:23:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:23:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:23:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:23:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:23:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:23:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:23:19.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:23:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:23:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:23:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:23:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:23:19.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:23:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:23:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:23:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:23:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:23:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:23:19.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:23:19.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:23:19.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:23:19.725 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.725 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.725 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.725 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:19.725 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:19.726 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.585527526, 2024-04-26T10:23:19.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:23:19.726 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.726 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.726 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.726 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.726 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.726 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:23:19.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.726 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:23:19.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:23:19.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:23:19.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:23:19.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.728 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:23:19.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:23:19.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:23:19.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:23:19.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:23:19.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:23:19.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:19.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:23:19.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:23:19.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:19.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:23:19.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:23:19.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:19.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:23:19.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:23:19.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:23:19.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:23:19.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:23:19.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:23:19.731 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.731 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.731 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.732 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:19.732 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:19.732 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.574649420999997, 2024-04-26T10:23:19.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:23:19.732 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.732 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.732 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.732 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.732 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.732 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:23:19.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.732 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:19.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:19.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:23:19.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:19.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:23:19.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:23:19.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:23:19.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:23:19.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.734 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.734 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:23:19.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:23:19.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:23:19.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:23:19.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:23:19.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:23:19.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:19.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:23:19.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:23:19.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:19.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:23:19.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:23:19.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:19.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:23:19.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:23:19.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:23:19.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:23:19.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:23:19.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:23:19.737 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.737 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.737 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.738 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:19.738 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:19.739 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.571968202000001, 2024-04-26T10:23:19.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:23:19.739 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.739 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.739 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.739 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:23:19.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.739 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:19.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:19.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:23:19.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:19.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:23:19.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:23:19.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:23:19.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:23:19.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:23:19.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:23:19.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:23:19.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:23:19.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:23:19.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:23:19.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:19.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:23:19.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:23:19.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:19.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:23:19.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:23:19.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:19.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:23:19.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:23:19.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:23:19.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:23:19.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:23:19.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:23:19.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.744 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.744 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:19.744 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:19.744 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.571601127000001, 2024-04-26T10:23:19.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:23:19.744 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.745 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.745 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:23:19.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.745 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.745 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.745 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:19.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:19.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:23:19.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:19.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:23:19.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:23:19.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:23:19.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:23:19.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:23:19.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:23:19.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:23:19.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:23:19.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:23:19.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:23:19.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:19.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:23:19.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:23:19.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:23:19.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:23:19.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:23:19.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:23:19.749 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.749 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.749 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.749 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:19.749 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:19.749 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.571536875, 2024-04-26T10:23:19.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:23:19.750 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.750 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.750 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.750 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.750 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.750 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:23:19.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.750 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:19.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:19.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:23:19.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:23:19.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:23:19.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:23:19.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:23:19.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:23:19.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:23:19.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:23:19.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:23:19.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:23:19.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:23:19.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:19.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:23:19.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:23:19.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:23:19.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:23:19.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:23:19.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:23:19.754 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.754 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.754 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.754 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:19.755 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:19.755 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.567138202000002, 2024-04-26T10:23:19.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:23:19.755 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.755 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.755 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.755 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.755 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.755 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:23:19.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.756 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:19.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:19.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.756 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.756 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:23:19.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:23:19.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:23:19.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:23:19.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:23:19.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:23:19.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:23:19.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:23:19.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:23:19.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:23:19.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:23:19.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:19.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:23:19.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:23:19.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:23:19.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:23:19.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:23:19.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:23:19.760 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.760 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.760 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.760 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:19.760 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:19.760 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 48.565380218999998, 2024-04-26T10:23:19.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:23:19.760 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:19.760 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.760 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:19.760 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:19.761 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.761 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:23:19.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.761 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:19.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:19.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:19.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:19.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:19.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:19.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:19.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:23:19.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:19.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:19.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:23:19.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:23:19.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.762 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:19.762 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:23:19.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:23:19.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:23:19.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:23:19.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:19.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:23:19.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:23:19.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:19.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:23:19.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:23:19.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:19.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:23:19.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:23:19.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:19.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:23:19.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:23:19.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:19.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:23:19.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:23:19.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:19.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:23:19.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:23:19.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:19.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:19.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:19.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:23:19.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:23:19.765 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.765 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.766 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.766 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:19.766 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:19.766 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:19.767 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:19.766+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:19.768 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:19.868 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:19.866+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:19.900 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:19.900 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:19.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.900 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:232166 5.c 5:39e12e36:::benchmark_data_smithi052_19421_object102694:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:19.900 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:19.894431+0000", 2024-04-26T10:23:19.900 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0042792860000000002, 2024-04-26T10:23:19.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004305718, 2024-04-26T10:23:19.900 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:19.900 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:19.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:19.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:19.901 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.901 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232166 2024-04-26T10:23:19.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.901 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:19.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:19.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.894431+0000", 2024-04-26T10:23:19.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:19.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:19.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.894431+0000", 2024-04-26T10:23:19.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:19.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:19.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.894430+0000", 2024-04-26T10:23:19.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:19.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:19.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.894434+0000", 2024-04-26T10:23:19.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0740000000000003e-06 2024-04-26T10:23:19.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:19.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.894441+0000", 2024-04-26T10:23:19.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1870000000000002e-06 2024-04-26T10:23:19.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.894445+0000", 2024-04-26T10:23:19.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0770000000000001e-06 2024-04-26T10:23:19.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:19.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.894480+0000", 2024-04-26T10:23:19.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5349999999999999e-05 2024-04-26T10:23:19.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:19.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.894583+0000", 2024-04-26T10:23:19.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010292400000000001 2024-04-26T10:23:19.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:19.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898467+0000", 2024-04-26T10:23:19.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003883882 2024-04-26T10:23:19.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:19.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898678+0000", 2024-04-26T10:23:19.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021148400000000001 2024-04-26T10:23:19.904 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.905 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:19.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.905 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:232170 5.c 5:31673dc4:::benchmark_data_smithi052_19421_object102698:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:19.905 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:19.895510+0000", 2024-04-26T10:23:19.905 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032006069999999998, 2024-04-26T10:23:19.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033271189999999999, 2024-04-26T10:23:19.905 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:19.905 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:19.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:19.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:19.905 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.905 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232170 2024-04-26T10:23:19.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.906 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:19.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:19.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895510+0000", 2024-04-26T10:23:19.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:19.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:19.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895510+0000", 2024-04-26T10:23:19.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:19.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:19.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895509+0000", 2024-04-26T10:23:19.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:19.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:19.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895512+0000", 2024-04-26T10:23:19.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.14e-06 2024-04-26T10:23:19.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:19.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895519+0000", 2024-04-26T10:23:19.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7569999999999998e-06 2024-04-26T10:23:19.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895524+0000", 2024-04-26T10:23:19.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0810000000000001e-06 2024-04-26T10:23:19.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:19.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.896329+0000", 2024-04-26T10:23:19.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00080545300000000003 2024-04-26T10:23:19.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:19.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.896442+0000", 2024-04-26T10:23:19.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112327 2024-04-26T10:23:19.908 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.909 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:19.909 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.909 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:232171 5.5 5:a978920b:::benchmark_data_smithi052_19421_object102699:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:19.909 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:19.895910+0000", 2024-04-26T10:23:19.909 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0028004570000000001, 2024-04-26T10:23:19.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029820490000000001, 2024-04-26T10:23:19.909 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:19.909 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:19.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:19.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:19.909 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.910 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232171 2024-04-26T10:23:19.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.910 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:19.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:19.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895910+0000", 2024-04-26T10:23:19.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:19.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:19.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895910+0000", 2024-04-26T10:23:19.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:19.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:19.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895909+0000", 2024-04-26T10:23:19.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:19.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:19.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895914+0000", 2024-04-26T10:23:19.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4070000000000003e-06 2024-04-26T10:23:19.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:19.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895925+0000", 2024-04-26T10:23:19.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:19.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895934+0000", 2024-04-26T10:23:19.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4700000000000002e-06 2024-04-26T10:23:19.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:19.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895981+0000", 2024-04-26T10:23:19.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7287999999999999e-05 2024-04-26T10:23:19.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:19.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.896131+0000", 2024-04-26T10:23:19.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000150247 2024-04-26T10:23:19.913 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.913 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:19.913 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.913 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:232172 5.1 5:8f8dace7:::benchmark_data_smithi052_19421_object102700:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:19.913 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:19.895968+0000", 2024-04-26T10:23:19.913 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0027426360000000001, 2024-04-26T10:23:19.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029637140000000001, 2024-04-26T10:23:19.913 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:19.913 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:19.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:19.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:19.913 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.914 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232172 2024-04-26T10:23:19.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.914 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:19.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:19.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895968+0000", 2024-04-26T10:23:19.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:19.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:19.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895968+0000", 2024-04-26T10:23:19.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:19.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:19.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895967+0000", 2024-04-26T10:23:19.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:19.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895971+0000", 2024-04-26T10:23:19.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.738e-06 2024-04-26T10:23:19.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:19.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895985+0000", 2024-04-26T10:23:19.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.432e-05 2024-04-26T10:23:19.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.895992+0000", 2024-04-26T10:23:19.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7299999999999999e-06 2024-04-26T10:23:19.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:19.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.896059+0000", 2024-04-26T10:23:19.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7028999999999998e-05 2024-04-26T10:23:19.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:19.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.896193+0000", 2024-04-26T10:23:19.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013397800000000001 2024-04-26T10:23:19.917 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.917 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:19.917 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.917 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:232174 5.0 5:09dc0d5b:::benchmark_data_smithi052_19421_object102702:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:19.917 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:19.896003+0000", 2024-04-26T10:23:19.917 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002707844, 2024-04-26T10:23:19.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029667970000000002, 2024-04-26T10:23:19.917 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:19.917 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:19.918 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:19.918 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:19.918 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.918 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232174 2024-04-26T10:23:19.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.918 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:19.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:19.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.896003+0000", 2024-04-26T10:23:19.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:19.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:19.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.896003+0000", 2024-04-26T10:23:19.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:19.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:19.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.896002+0000", 2024-04-26T10:23:19.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:19.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.896005+0000", 2024-04-26T10:23:19.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5450000000000002e-06 2024-04-26T10:23:19.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:19.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.896018+0000", 2024-04-26T10:23:19.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3271000000000001e-05 2024-04-26T10:23:19.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.896023+0000", 2024-04-26T10:23:19.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7910000000000004e-06 2024-04-26T10:23:19.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:19.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.896082+0000", 2024-04-26T10:23:19.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9697000000000001e-05 2024-04-26T10:23:19.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:19.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.896196+0000", 2024-04-26T10:23:19.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114033 2024-04-26T10:23:19.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:19.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.896308+0000", 2024-04-26T10:23:19.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111505 2024-04-26T10:23:19.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.921 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:19.921 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.922 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:232176 5.1 5:834ffa7e:::benchmark_data_smithi052_19421_object102704:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:19.922 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:19.896077+0000", 2024-04-26T10:23:19.922 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0026336770000000001, 2024-04-26T10:23:19.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0029316630000000002, 2024-04-26T10:23:19.922 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:19.922 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:19.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:19.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:19.922 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.922 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232176 2024-04-26T10:23:19.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.922 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:19.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:19.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.896077+0000", 2024-04-26T10:23:19.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:19.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:19.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.896077+0000", 2024-04-26T10:23:19.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:19.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:19.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.896076+0000", 2024-04-26T10:23:19.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:19.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:19.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.897917+0000", 2024-04-26T10:23:19.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018412330000000001 2024-04-26T10:23:19.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:19.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.897950+0000", 2024-04-26T10:23:19.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2153999999999997e-05 2024-04-26T10:23:19.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.897972+0000", 2024-04-26T10:23:19.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2517000000000001e-05 2024-04-26T10:23:19.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:19.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898209+0000", 2024-04-26T10:23:19.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000237209 2024-04-26T10:23:19.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:19.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898357+0000", 2024-04-26T10:23:19.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000147794 2024-04-26T10:23:19.925 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.926 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:19.926 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.926 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:232177 5.3 5:c88c34d3:::benchmark_data_smithi052_19421_object102705:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:19.926 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:19.898025+0000", 2024-04-26T10:23:19.926 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00068563100000000002, 2024-04-26T10:23:19.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001019477, 2024-04-26T10:23:19.926 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:19.926 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:19.926 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:19.926 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:19.926 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.927 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232177 2024-04-26T10:23:19.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.927 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:19.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:19.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898025+0000", 2024-04-26T10:23:19.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:19.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:19.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898025+0000", 2024-04-26T10:23:19.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:19.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:19.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898024+0000", 2024-04-26T10:23:19.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:19.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:19.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898029+0000", 2024-04-26T10:23:19.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4870000000000004e-06 2024-04-26T10:23:19.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:19.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898036+0000", 2024-04-26T10:23:19.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6480000000000003e-06 2024-04-26T10:23:19.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898043+0000", 2024-04-26T10:23:19.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9380000000000003e-06 2024-04-26T10:23:19.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:19.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898082+0000", 2024-04-26T10:23:19.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.909e-05 2024-04-26T10:23:19.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:19.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898233+0000", 2024-04-26T10:23:19.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015094899999999999 2024-04-26T10:23:19.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.930 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:19.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.930 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:232173 5.b e67/37 5:df78b576:::benchmark_data_smithi052_19421_object102701:head v 67'14405, mlcod=67'14402)", 2024-04-26T10:23:19.930 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:19.898111+0000", 2024-04-26T10:23:19.930 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00059924399999999997, 2024-04-26T10:23:19.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00097140799999999999, 2024-04-26T10:23:19.930 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:19.930 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:19.930 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:19.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:19.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898111+0000", 2024-04-26T10:23:19.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:19.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:19.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898111+0000", 2024-04-26T10:23:19.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:19.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:19.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898110+0000", 2024-04-26T10:23:19.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:19.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:19.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898116+0000", 2024-04-26T10:23:19.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:19.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:19.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898124+0000", 2024-04-26T10:23:19.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4610000000000002e-06 2024-04-26T10:23:19.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898130+0000", 2024-04-26T10:23:19.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.835e-06 2024-04-26T10:23:19.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:19.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898163+0000", 2024-04-26T10:23:19.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3744000000000001e-05 2024-04-26T10:23:19.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:19.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898188+0000", 2024-04-26T10:23:19.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4411999999999999e-05 2024-04-26T10:23:19.933 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.933 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:19.934 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.934 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:232178 5.d 5.ad701a8d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:19.934 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:19.898773+0000", 2024-04-26T10:23:19.934 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999375, 2024-04-26T10:23:19.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034124200000000001, 2024-04-26T10:23:19.934 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:19.934 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:19.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:19.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:19.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:19.934 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 232178 2024-04-26T10:23:19.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.935 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:19.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:19.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898773+0000", 2024-04-26T10:23:19.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:19.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:19.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898773+0000", 2024-04-26T10:23:19.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:19.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:19.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898772+0000", 2024-04-26T10:23:19.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:19.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:19.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898781+0000", 2024-04-26T10:23:19.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7250000000000003e-06 2024-04-26T10:23:19.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:19.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898792+0000", 2024-04-26T10:23:19.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1479e-05 2024-04-26T10:23:19.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:19.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:19.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:19.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:19.898799+0000", 2024-04-26T10:23:19.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2069999999999998e-06 2024-04-26T10:23:19.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.937 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:19.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:19.937 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:23:19.937 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 9 2024-04-26T10:23:19.937 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:19.938 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:19.968 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:19.966+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:20.069 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:20.066+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:20.070 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:20.070 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:20.070 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:23:20.070 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:23:20.070 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:20.083 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:20.170 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:20.166+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:20.215 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:20.215 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:23:20.215 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:23:20.216 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:20.216 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.216 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:20.216 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:20.216 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 56.172966181, 2024-04-26T10:23:20.216 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:23:20.216 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.217 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.217 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.217 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.217 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.217 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:23:20.217 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.217 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.218 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.218 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:20.218 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.218 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.218 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:20.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:20.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:20.219 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.219 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.219 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.219 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:23:20.219 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:23:20.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:23:20.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:23:20.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:23:20.220 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:23:20.220 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.220 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.220 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.220 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:23:20.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:23:20.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:23:20.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:23:20.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.221 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.221 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.221 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:23:20.221 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:23:20.221 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:23:20.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:23:20.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.222 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.222 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.222 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:23:20.222 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:23:20.222 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.222 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.222 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.222 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.223 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.223 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:20.223 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:20.223 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 56.172856930000002, 2024-04-26T10:23:20.223 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:23:20.223 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.223 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.223 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.223 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.223 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.224 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:23:20.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.224 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:20.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.224 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.224 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:20.224 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.224 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.224 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:20.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:20.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:23:20.225 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:23:20.225 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.225 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.225 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.225 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:23:20.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:23:20.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:23:20.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:23:20.226 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.226 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.226 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.226 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:23:20.226 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:23:20.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:23:20.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:23:20.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:23:20.227 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:23:20.227 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.227 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.227 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.227 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:23:20.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:23:20.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.228 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.228 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:23:20.228 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:23:20.228 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.228 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.228 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.228 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.228 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.228 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:20.228 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:20.228 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 56.170459518000001, 2024-04-26T10:23:20.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:23:20.229 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.229 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.229 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.229 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:23:20.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.229 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.229 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.229 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:20.229 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.229 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.229 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:20.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:23:20.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:20.230 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.230 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.230 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.230 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:23:20.230 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:23:20.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:23:20.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:23:20.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.231 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:23:20.231 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:23:20.231 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.231 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.231 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:23:20.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:23:20.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:23:20.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:23:20.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:20.232 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:23:20.232 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:23:20.232 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.232 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.232 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:23:20.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:23:20.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.233 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.233 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.233 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:23:20.233 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:23:20.233 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:23:20.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:23:20.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.234 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.234 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.234 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:23:20.234 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:23:20.234 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.234 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.234 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.234 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.235 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:20.235 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:20.235 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 56.170273594000001, 2024-04-26T10:23:20.235 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:23:20.235 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.235 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.235 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.235 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:23:20.235 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.235 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.235 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.235 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:20.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:20.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.236 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.236 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.236 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.236 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:23:20.236 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:20.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:23:20.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:23:20.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.237 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.237 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:23:20.237 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:23:20.237 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.237 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:23:20.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:23:20.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:23:20.238 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:23:20.238 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.238 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.238 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.238 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:23:20.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:23:20.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:20.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:23:20.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:23:20.239 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.239 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.239 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.239 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:23:20.239 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:23:20.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:23:20.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:23:20.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.240 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.240 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:23:20.240 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:23:20.240 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.240 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.241 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.241 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:23:20.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:23:20.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.241 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.241 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.241 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.241 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.241 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:20.241 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:20.241 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.080250977999999, 2024-04-26T10:23:20.241 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:23:20.241 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.241 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.242 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.242 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.242 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.242 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:23:20.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.242 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.242 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:20.242 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.242 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.242 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.242 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:20.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.243 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:20.243 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:20.243 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.243 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.243 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:23:20.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:23:20.244 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.244 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.244 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.244 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:23:20.244 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:23:20.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:23:20.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:23:20.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.245 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.245 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:23:20.245 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:23:20.245 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.245 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:20.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:23:20.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:23:20.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:23:20.246 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:23:20.246 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.246 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.246 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.246 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:23:20.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:23:20.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:20.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:23:20.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:23:20.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.247 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:23:20.247 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:23:20.247 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.247 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.247 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:23:20.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:23:20.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:23:20.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:23:20.248 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.248 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.248 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.248 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:23:20.248 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:23:20.248 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.249 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.249 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.249 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.249 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.249 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:20.249 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:20.249 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.057148732000002, 2024-04-26T10:23:20.249 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:23:20.249 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.249 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.249 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.250 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.250 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:23:20.250 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.250 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.250 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.250 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.250 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:20.251 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.251 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.251 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.251 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.251 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:20.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:23:20.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:20.252 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.252 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.252 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.252 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:23:20.252 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:23:20.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:23:20.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:23:20.253 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.253 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.253 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.253 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:23:20.253 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:23:20.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:23:20.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:23:20.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:20.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:23:20.254 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:23:20.254 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.254 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.254 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.254 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:23:20.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:23:20.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:23:20.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:23:20.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.255 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:20.255 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:23:20.255 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:23:20.255 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.255 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:23:20.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:23:20.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:23:20.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:23:20.256 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.256 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.256 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:23:20.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:23:20.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:23:20.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:23:20.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.257 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.257 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.257 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:20.258 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:20.258 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.050465593999999, 2024-04-26T10:23:20.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:23:20.258 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.258 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.258 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.258 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:23:20.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.258 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:20.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:20.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:23:20.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:23:20.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:23:20.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:23:20.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:23:20.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.262 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.262 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:23:20.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:23:20.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:23:20.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:23:20.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:20.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:23:20.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:23:20.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:23:20.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:23:20.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:23:20.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:23:20.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:20.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:23:20.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:23:20.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.267 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.267 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:23:20.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:23:20.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:23:20.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:23:20.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:23:20.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:23:20.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:23:20.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:23:20.270 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.270 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.270 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.270 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:20.270 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:20.270 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.048467809000002, 2024-04-26T10:23:20.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:23:20.270 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.270 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.270 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.271 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.271 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.271 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:23:20.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.271 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:20.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:20.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:23:20.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:20.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:23:20.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:23:20.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:23:20.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:23:20.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:23:20.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:23:20.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:23:20.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:23:20.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.273 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:20.273 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:23:20.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:20.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:23:20.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:23:20.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:23:20.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:23:20.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:20.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:23:20.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:23:20.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:23:20.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:23:20.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:23:20.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:23:20.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:23:20.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:23:20.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:23:20.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:23:20.276 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.276 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.276 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.276 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:20.276 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:20.276 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.039059104, 2024-04-26T10:23:20.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:23:20.277 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.277 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.277 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.277 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.277 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.277 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:23:20.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.277 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:20.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:20.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:23:20.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:23:20.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:23:20.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:23:20.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:20.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.279 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.279 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:23:20.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:23:20.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:23:20.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:23:20.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:20.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:23:20.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:23:20.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:23:20.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:23:20.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:23:20.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:23:20.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:20.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:23:20.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:23:20.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:23:20.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:23:20.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:23:20.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:23:20.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:23:20.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:23:20.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:23:20.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:23:20.283 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.283 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.283 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.283 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:20.283 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:20.283 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.037231054999999, 2024-04-26T10:23:20.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:23:20.284 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.284 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.284 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.284 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:23:20.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.284 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:20.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:20.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:23:20.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:23:20.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:23:20.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:23:20.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:23:20.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.286 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:23:20.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:23:20.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.286 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:23:20.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:23:20.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:20.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:23:20.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:23:20.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:23:20.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:23:20.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:23:20.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:23:20.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:20.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:23:20.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:23:20.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:23:20.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:23:20.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:23:20.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:23:20.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:23:20.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:23:20.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:23:20.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:23:20.290 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.290 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.290 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.290 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:20.290 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:20.290 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.025651332999999, 2024-04-26T10:23:20.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:23:20.291 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.291 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.291 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.291 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.291 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.291 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:23:20.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.291 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:20.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:20.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:20.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:20.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:23:20.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:23:20.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:23:20.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:23:20.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:23:20.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:23:20.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.293 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.293 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:23:20.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:23:20.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:20.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:23:20.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:23:20.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:23:20.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:23:20.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:23:20.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:23:20.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:20.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:23:20.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:23:20.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:23:20.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:23:20.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:23:20.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:23:20.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:23:20.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:23:20.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:23:20.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:23:20.297 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.297 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.297 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.297 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:20.297 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:20.297 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.019240838999998, 2024-04-26T10:23:20.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:23:20.297 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.297 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.297 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.298 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:23:20.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.298 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:20.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:20.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:23:20.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:23:20.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:23:20.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:23:20.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:23:20.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:23:20.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:20.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:23:20.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:23:20.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:20.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:23:20.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:23:20.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:23:20.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:23:20.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:23:20.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:23:20.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:20.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:23:20.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:23:20.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:23:20.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:23:20.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:23:20.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:23:20.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:23:20.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:23:20.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:23:20.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:23:20.303 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.303 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.303 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.303 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:20.303 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:20.303 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.006655775999999, 2024-04-26T10:23:20.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:23:20.304 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.304 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.304 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.304 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.304 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.304 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:23:20.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.304 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:20.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:20.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:23:20.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:23:20.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:20.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:23:20.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:23:20.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:23:20.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:23:20.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:23:20.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:23:20.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.306 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:20.306 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:23:20.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:20.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:23:20.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:23:20.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:23:20.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:23:20.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:20.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:23:20.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:23:20.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:23:20.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:23:20.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:23:20.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:23:20.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:23:20.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:23:20.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:23:20.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:23:20.309 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.309 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.309 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.309 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:20.309 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:20.309 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 31.006420843000001, 2024-04-26T10:23:20.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:23:20.310 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.310 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.310 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.310 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:23:20.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.310 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:20.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:20.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:23:20.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:23:20.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:23:20.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:23:20.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:23:20.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:23:20.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:23:20.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:23:20.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:23:20.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:20.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:23:20.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:20.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:23:20.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:23:20.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:23:20.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:23:20.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:20.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:23:20.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:23:20.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:23:20.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:23:20.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:23:20.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:23:20.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:23:20.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:23:20.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:23:20.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:23:20.315 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.315 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.315 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.315 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:20.315 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:20.316 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.968545966000001, 2024-04-26T10:23:20.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:23:20.316 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.316 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.316 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.316 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:23:20.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.316 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:20.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:20.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:23:20.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:20.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:23:20.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:23:20.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:23:20.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:23:20.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:23:20.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:23:20.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:23:20.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:23:20.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:20.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:23:20.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:20.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:23:20.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:23:20.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:23:20.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:23:20.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:20.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:23:20.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:23:20.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:23:20.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:23:20.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:23:20.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:23:20.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:23:20.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:23:20.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:23:20.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:23:20.321 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.321 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.321 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.321 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:20.321 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:20.322 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.968100940999999, 2024-04-26T10:23:20.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:23:20.322 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.322 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.322 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.322 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.322 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.322 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:23:20.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.322 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:20.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:20.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:23:20.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:23:20.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:23:20.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:23:20.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:23:20.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:23:20.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:23:20.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:23:20.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:23:20.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:20.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:23:20.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:23:20.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:23:20.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:23:20.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:23:20.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:23:20.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:20.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:23:20.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:23:20.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:23:20.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:23:20.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.326 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.326 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:23:20.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:23:20.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:23:20.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:23:20.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:23:20.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:23:20.327 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.327 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.327 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.328 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:20.328 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:20.328 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.956497940999999, 2024-04-26T10:23:20.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:23:20.328 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.328 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.328 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.328 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:23:20.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.328 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:20.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:20.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:23:20.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:20.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:23:20.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:23:20.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:23:20.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:23:20.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:23:20.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:23:20.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:23:20.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:23:20.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:20.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:23:20.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:23:20.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:23:20.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:23:20.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:23:20.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:23:20.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:20.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:23:20.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:23:20.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:23:20.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:23:20.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:23:20.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:23:20.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:23:20.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:23:20.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:23:20.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:23:20.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.334 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.334 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.334 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:20.334 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:20.334 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.955224350999998, 2024-04-26T10:23:20.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:23:20.334 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.334 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.334 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.335 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.335 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:23:20.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.335 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:20.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:20.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:23:20.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:23:20.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:23:20.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:23:20.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:23:20.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:23:20.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:23:20.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:23:20.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:23:20.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:20.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:23:20.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:23:20.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:23:20.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:23:20.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:23:20.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:23:20.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:20.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:23:20.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:23:20.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:23:20.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:23:20.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:23:20.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:23:20.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.339 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:23:20.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:23:20.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:23:20.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:23:20.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.340 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.340 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.340 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:20.340 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:20.341 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.93846705, 2024-04-26T10:23:20.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:23:20.341 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.341 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.341 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.341 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:23:20.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.341 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:20.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:20.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:23:20.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:23:20.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:23:20.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:23:20.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:23:20.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:23:20.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:23:20.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:23:20.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:23:20.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:20.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:23:20.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:23:20.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:23:20.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:23:20.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:23:20.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:23:20.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:20.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:23:20.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:23:20.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:23:20.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:23:20.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:23:20.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:23:20.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:23:20.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:23:20.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.346 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.346 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:23:20.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:23:20.346 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.346 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.346 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.347 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:20.347 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:20.347 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 30.893555029000002, 2024-04-26T10:23:20.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:23:20.347 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:20.347 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.347 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:20.347 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:20.347 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.347 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:23:20.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.347 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:20.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:20.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:20.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:20.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:20.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:20.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:20.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:23:20.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:20.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:23:20.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:23:20.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:20.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:23:20.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:23:20.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:23:20.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:23:20.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:23:20.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:23:20.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:20.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:23:20.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:23:20.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:20.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:23:20.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:23:20.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:20.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:23:20.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:23:20.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:20.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:23:20.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:23:20.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:23:20.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:23:20.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:20.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:23:20.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:23:20.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:20.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:23:20.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:23:20.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:20.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:20.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:20.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:23:20.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:23:20.353 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.353 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.353 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.353 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:20.353 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:20.353 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:20.355 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:20.355 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:20.351+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:20.455 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:20.451+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:20.477 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:20.478 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:20.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.478 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:233480 5.b 5:d2df1b73:::benchmark_data_smithi052_19421_object104008:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:20.478 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:20.470292+0000", 2024-04-26T10:23:20.478 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0077365929999999999, 2024-04-26T10:23:20.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0077609030000000004, 2024-04-26T10:23:20.478 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.478 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:20.478 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.478 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.478 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.478 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 233480 2024-04-26T10:23:20.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.479 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.470292+0000", 2024-04-26T10:23:20.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.470292+0000", 2024-04-26T10:23:20.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.470291+0000", 2024-04-26T10:23:20.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.470296+0000", 2024-04-26T10:23:20.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6589999999999998e-06 2024-04-26T10:23:20.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.470303+0000", 2024-04-26T10:23:20.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8870000000000003e-06 2024-04-26T10:23:20.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.470308+0000", 2024-04-26T10:23:20.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1780000000000002e-06 2024-04-26T10:23:20.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.473807+0000", 2024-04-26T10:23:20.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034987 2024-04-26T10:23:20.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.473935+0000", 2024-04-26T10:23:20.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012840900000000001 2024-04-26T10:23:20.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:20.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.474066+0000", 2024-04-26T10:23:20.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013077999999999999 2024-04-26T10:23:20.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.477682+0000", 2024-04-26T10:23:20.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0036157429999999998 2024-04-26T10:23:20.482 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.482 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.482 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.483 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:233485 5.8 5:1e2e3cda:::benchmark_data_smithi052_19421_object104013:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:20.483 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:20.473970+0000", 2024-04-26T10:23:20.483 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0040583310000000001, 2024-04-26T10:23:20.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041658709999999998, 2024-04-26T10:23:20.483 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.483 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:20.483 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.483 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.483 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.483 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 233485 2024-04-26T10:23:20.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.484 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.473970+0000", 2024-04-26T10:23:20.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.473970+0000", 2024-04-26T10:23:20.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.473969+0000", 2024-04-26T10:23:20.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:20.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.473976+0000", 2024-04-26T10:23:20.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7440000000000001e-06 2024-04-26T10:23:20.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.473988+0000", 2024-04-26T10:23:20.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2510000000000001e-05 2024-04-26T10:23:20.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.473996+0000", 2024-04-26T10:23:20.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5830000000000001e-06 2024-04-26T10:23:20.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.474044+0000", 2024-04-26T10:23:20.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7896999999999999e-05 2024-04-26T10:23:20.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.474238+0000", 2024-04-26T10:23:20.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00019397800000000001 2024-04-26T10:23:20.486 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.486 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.487 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.487 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:233486 5.e 5:727e89f6:::benchmark_data_smithi052_19421_object104014:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:20.487 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:20.475839+0000", 2024-04-26T10:23:20.487 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.002189472, 2024-04-26T10:23:20.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002361078, 2024-04-26T10:23:20.487 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.487 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:20.487 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.487 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.487 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.487 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 233486 2024-04-26T10:23:20.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.488 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.475839+0000", 2024-04-26T10:23:20.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.475839+0000", 2024-04-26T10:23:20.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.475838+0000", 2024-04-26T10:23:20.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.475848+0000", 2024-04-26T10:23:20.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.5149999999999995e-06 2024-04-26T10:23:20.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.475857+0000", 2024-04-26T10:23:20.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6779999999999995e-06 2024-04-26T10:23:20.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.475863+0000", 2024-04-26T10:23:20.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2310000000000004e-06 2024-04-26T10:23:20.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.475912+0000", 2024-04-26T10:23:20.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9635000000000002e-05 2024-04-26T10:23:20.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.476048+0000", 2024-04-26T10:23:20.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013575699999999999 2024-04-26T10:23:20.490 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.490 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.490 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.491 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:233487 5.b 5:da50f526:::benchmark_data_smithi052_19421_object104015:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:20.491 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:20.475878+0000", 2024-04-26T10:23:20.491 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.002150824, 2024-04-26T10:23:20.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0023848620000000002, 2024-04-26T10:23:20.491 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.491 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:20.491 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.491 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.491 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.491 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 233487 2024-04-26T10:23:20.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.491 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.475878+0000", 2024-04-26T10:23:20.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.475878+0000", 2024-04-26T10:23:20.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.475877+0000", 2024-04-26T10:23:20.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:20.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.475880+0000", 2024-04-26T10:23:20.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4159999999999998e-06 2024-04-26T10:23:20.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.475892+0000", 2024-04-26T10:23:20.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1707e-05 2024-04-26T10:23:20.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.475896+0000", 2024-04-26T10:23:20.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2409999999999997e-06 2024-04-26T10:23:20.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.475925+0000", 2024-04-26T10:23:20.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9119999999999999e-05 2024-04-26T10:23:20.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.476039+0000", 2024-04-26T10:23:20.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011424799999999999 2024-04-26T10:23:20.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:20.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.476145+0000", 2024-04-26T10:23:20.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010627400000000001 2024-04-26T10:23:20.495 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.496 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.496 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.496 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:233490 5.b 5:d7411459:::benchmark_data_smithi052_19421_object104018:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:20.496 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:20.476063+0000", 2024-04-26T10:23:20.496 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.001966045, 2024-04-26T10:23:20.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0022694170000000001, 2024-04-26T10:23:20.496 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.496 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:20.496 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.496 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.496 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.496 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 233490 2024-04-26T10:23:20.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.497 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.476063+0000", 2024-04-26T10:23:20.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.476063+0000", 2024-04-26T10:23:20.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.476062+0000", 2024-04-26T10:23:20.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.476067+0000", 2024-04-26T10:23:20.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2279999999999998e-06 2024-04-26T10:23:20.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.476076+0000", 2024-04-26T10:23:20.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0920000000000004e-06 2024-04-26T10:23:20.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.476084+0000", 2024-04-26T10:23:20.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2069999999999995e-06 2024-04-26T10:23:20.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.477705+0000", 2024-04-26T10:23:20.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0016203120000000001 2024-04-26T10:23:20.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.477795+0000", 2024-04-26T10:23:20.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.0160000000000004e-05 2024-04-26T10:23:20.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:20.500 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.477873+0000", 2024-04-26T10:23:20.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8343000000000005e-05 2024-04-26T10:23:20.500 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.500 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.500 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.500 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:233476 5.4 e67/65 5:2a0a7ef1:::benchmark_data_smithi052_19421_object104004:head v 67'14724, mlcod=67'14718)", 2024-04-26T10:23:20.500 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:20.476330+0000", 2024-04-26T10:23:20.500 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.001698773, 2024-04-26T10:23:20.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0020698180000000002, 2024-04-26T10:23:20.500 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.500 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:20.500 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.476330+0000", 2024-04-26T10:23:20.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.476330+0000", 2024-04-26T10:23:20.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.476329+0000", 2024-04-26T10:23:20.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:20.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.476336+0000", 2024-04-26T10:23:20.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3119999999999999e-06 2024-04-26T10:23:20.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.476348+0000", 2024-04-26T10:23:20.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2265e-05 2024-04-26T10:23:20.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.476354+0000", 2024-04-26T10:23:20.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3759999999999996e-06 2024-04-26T10:23:20.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.476398+0000", 2024-04-26T10:23:20.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3563999999999998e-05 2024-04-26T10:23:20.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:20.476419+0000", 2024-04-26T10:23:20.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0713999999999999e-05 2024-04-26T10:23:20.503 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.503 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.503 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.503 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.503 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:23:20.503 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 6 2024-04-26T10:23:20.503 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:20.504 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:20.555 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:20.551+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:20.627 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:20.627 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:20.627 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:23:20.627 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:23:20.627 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:20.638 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:20.657 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:20.651+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:20.757 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:20.754+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:20.766 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:20.766 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:23:20.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:23:20.766 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:20.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.766 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:20.766 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:20.766 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 80.233678783000002, 2024-04-26T10:23:20.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:23:20.766 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.766 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.766 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.767 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.767 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.767 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:23:20.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.767 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:20.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:20.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:23:20.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:20.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:23:20.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:23:20.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:23:20.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:23:20.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:23:20.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:23:20.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:23:20.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:23:20.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:23:20.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:23:20.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:23:20.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:23:20.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:23:20.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:23:20.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:23:20.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:23:20.771 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.771 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.771 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.771 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:20.771 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:20.771 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 80.231696556000003, 2024-04-26T10:23:20.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:23:20.771 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.771 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.772 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.772 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.772 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.772 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:23:20.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.772 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:20.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:20.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:23:20.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:23:20.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:23:20.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:23:20.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:23:20.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:23:20.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:23:20.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:23:20.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:23:20.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:23:20.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:23:20.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:23:20.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:23:20.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:23:20.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:23:20.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:23:20.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:23:20.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:23:20.776 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.776 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.776 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.776 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:20.776 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:20.776 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 80.231497172000005, 2024-04-26T10:23:20.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:23:20.776 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.777 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.777 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.777 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.777 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.777 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:23:20.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.777 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:20.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:20.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:20.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:20.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:23:20.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:23:20.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:23:20.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:23:20.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:23:20.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:23:20.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:23:20.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:23:20.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:23:20.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:23:20.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:23:20.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:23:20.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:23:20.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:23:20.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:23:20.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:23:20.781 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.781 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.781 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.781 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:23:20.781 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:20.781 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 80.231278552000006, 2024-04-26T10:23:20.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:23:20.782 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.782 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.782 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:20.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.782 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:20.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.782 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:23:20.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:23:20.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:23:20.783 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.783 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.783 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.783 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:23:20.783 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:23:20.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:23:20.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:23:20.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:23:20.784 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:23:20.784 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.784 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.784 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.784 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:23:20.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:23:20.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:23:20.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:23:20.785 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.785 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.785 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.785 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:23:20.785 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:23:20.785 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.785 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.785 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.786 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.786 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:20.786 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:20.786 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 80.228907113999995, 2024-04-26T10:23:20.786 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:23:20.786 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.786 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.786 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.786 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.786 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.786 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:23:20.786 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.786 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:20.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:20.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.787 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.787 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.787 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.787 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:23:20.787 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:20.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:23:20.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:23:20.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:23:20.788 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:23:20.788 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.788 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.788 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.788 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:23:20.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:23:20.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:20.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:23:20.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.789 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:23:20.789 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:23:20.789 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.789 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.789 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:23:20.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:23:20.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:23:20.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:23:20.790 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.790 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.790 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.790 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:23:20.790 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:23:20.790 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.791 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.791 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.791 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.791 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.791 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:20.791 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:20.791 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 80.228806492000004, 2024-04-26T10:23:20.791 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:23:20.791 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.791 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.791 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.791 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.791 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.791 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:23:20.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.792 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:20.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.792 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:20.792 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.792 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.792 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.792 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:23:20.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:20.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:23:20.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:23:20.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.793 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:23:20.793 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:23:20.793 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.793 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.793 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:23:20.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:23:20.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:23:20.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:23:20.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.794 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.794 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:23:20.794 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:23:20.794 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.794 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:23:20.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:23:20.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:23:20.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:23:20.795 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.795 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.795 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.795 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:23:20.795 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:23:20.795 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.796 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.796 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.796 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.796 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:23:20.796 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:20.796 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 80.228687930999996, 2024-04-26T10:23:20.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:23:20.796 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.796 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.796 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.796 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.796 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.796 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:20.796 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:20.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:23:20.797 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.797 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.797 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.797 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.797 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:23:20.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:23:20.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:23:20.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:23:20.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.798 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.798 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:23:20.798 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:23:20.798 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.798 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:23:20.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:23:20.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:23:20.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:23:20.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.799 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.799 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.799 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:23:20.799 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:23:20.799 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.800 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.800 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:23:20.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:23:20.800 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.800 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.800 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.800 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.800 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.800 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:20.800 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:20.800 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 80.228585533, 2024-04-26T10:23:20.800 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:23:20.800 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.800 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.801 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.801 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.801 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.801 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:23:20.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.801 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:20.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.801 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.801 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.801 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.801 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:20.801 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:23:20.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:20.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.802 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:23:20.802 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:23:20.802 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.802 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.802 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:23:20.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:23:20.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:23:20.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:23:20.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.803 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.803 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.803 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:20.803 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:23:20.803 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:23:20.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:23:20.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:23:20.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:23:20.804 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.804 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.804 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.804 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:23:20.804 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:23:20.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.805 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.805 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:23:20.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:23:20.805 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.805 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.805 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.805 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.805 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.805 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:20.805 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:20.805 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 80.227564975999996, 2024-04-26T10:23:20.805 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:23:20.806 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.806 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.806 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.806 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.806 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.806 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:23:20.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.806 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.806 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.806 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.806 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:20.806 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.806 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:20.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:23:20.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.807 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.807 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.807 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.807 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:23:20.807 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:23:20.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:23:20.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:23:20.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.808 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:23:20.808 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:23:20.808 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.808 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.808 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:23:20.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:23:20.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:23:20.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:23:20.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.809 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.809 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:23:20.809 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:23:20.809 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.809 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:23:20.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:23:20.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.810 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.810 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:23:20.810 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:23:20.810 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.810 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.810 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.810 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.810 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.810 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:20.811 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:20.811 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 80.226414700999996, 2024-04-26T10:23:20.811 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:23:20.811 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.811 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.811 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.811 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.811 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.811 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:23:20.811 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.811 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.811 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.811 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:20.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:20.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.812 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:23:20.812 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:20.812 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.812 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.812 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:23:20.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:23:20.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:23:20.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:23:20.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.813 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.813 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.813 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:23:20.813 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:23:20.813 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:23:20.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:23:20.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:23:20.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:23:20.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.814 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.814 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.814 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:23:20.814 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:23:20.814 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:23:20.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:23:20.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.815 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.815 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.815 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:23:20.815 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:23:20.815 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.815 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.815 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.815 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.816 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:20.816 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:20.816 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.729715458999998, 2024-04-26T10:23:20.816 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:23:20.816 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.816 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.816 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.816 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.816 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.816 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:23:20.816 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.816 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.816 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:20.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:20.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.817 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.817 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:23:20.817 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.817 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.817 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:23:20.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:23:20.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:23:20.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:23:20.818 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.818 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.818 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.818 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:23:20.818 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:23:20.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:23:20.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:23:20.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:23:20.819 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:23:20.819 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.819 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.819 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:20.819 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:23:20.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:23:20.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:23:20.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:23:20.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.820 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:23:20.820 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:23:20.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.820 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.820 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:23:20.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:23:20.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.821 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.821 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:23:20.821 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:23:20.821 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.821 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.821 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.821 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.821 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:20.821 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:20.822 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 56.729491863, 2024-04-26T10:23:20.822 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:23:20.822 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.822 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.822 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.822 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.822 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.822 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:23:20.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.822 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.822 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.822 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.822 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:20.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:20.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.823 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:23:20.823 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:20.823 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.823 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.823 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:23:20.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:23:20.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:23:20.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:23:20.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.824 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:23:20.824 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:23:20.824 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.824 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.824 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:23:20.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:23:20.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:23:20.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:23:20.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.825 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.825 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:20.825 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:23:20.825 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:23:20.825 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.826 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.826 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:23:20.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:23:20.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.826 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.826 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:23:20.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:23:20.826 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.826 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.826 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.826 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:23:20.826 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:23:20.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.827 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.827 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:23:20.827 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:23:20.827 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.827 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.827 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.827 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.827 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.827 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:20.828 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:20.828 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 49.698645542999998, 2024-04-26T10:23:20.828 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:23:20.828 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.828 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.828 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.828 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.828 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.828 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:23:20.828 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.828 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.828 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:20.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:20.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.829 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.829 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.829 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.829 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:23:20.829 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:23:20.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:23:20.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.830 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.830 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:23:20.830 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:23:20.830 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.830 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:23:20.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:23:20.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:23:20.831 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:23:20.831 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.831 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.831 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.831 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:23:20.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:23:20.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:20.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:23:20.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:23:20.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.832 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.832 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.832 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:23:20.832 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:23:20.832 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:23:20.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:23:20.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:23:20.833 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:23:20.833 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.833 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.833 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.833 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:23:20.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:23:20.834 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.834 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.834 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.834 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.834 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.834 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:20.834 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:20.834 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 49.696634439999997, 2024-04-26T10:23:20.834 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:23:20.834 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.834 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.834 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.835 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.835 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.835 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:23:20.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.835 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.835 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:20.835 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.835 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.835 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.835 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:20.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:20.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:20.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.836 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.836 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.836 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:23:20.836 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:23:20.836 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:23:20.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:23:20.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.837 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:23:20.837 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:23:20.837 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.837 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.837 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:23:20.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:23:20.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.838 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:23:20.838 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:23:20.838 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.838 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.838 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:20.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:23:20.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:23:20.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:23:20.839 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:23:20.839 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.839 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.839 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.839 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:23:20.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:23:20.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:23:20.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:23:20.840 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.840 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.840 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.840 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:23:20.840 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:23:20.840 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.840 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.840 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.841 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.841 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.841 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:20.841 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:20.841 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 49.685756335000001, 2024-04-26T10:23:20.841 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:23:20.841 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.841 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.841 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.841 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.841 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.841 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:23:20.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.842 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:20.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.842 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.842 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.842 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.842 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:20.842 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:23:20.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:20.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.843 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:23:20.843 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:23:20.843 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.843 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.843 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:23:20.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:23:20.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:23:20.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:23:20.844 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.844 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.844 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.844 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:23:20.844 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:23:20.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:23:20.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:23:20.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:20.845 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:23:20.845 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:23:20.845 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.845 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.845 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:23:20.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:23:20.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:23:20.846 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:23:20.846 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.846 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.846 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.846 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:23:20.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:23:20.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.847 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.847 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:23:20.847 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:23:20.847 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.847 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.847 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.847 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.847 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.847 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:20.848 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:20.848 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 49.683075115999998, 2024-04-26T10:23:20.848 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:23:20.848 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.848 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.848 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.848 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.848 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.848 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:23:20.848 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.848 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.848 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:20.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:20.849 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.849 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.849 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.849 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.849 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:23:20.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:20.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:23:20.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:23:20.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.850 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.850 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:23:20.850 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:23:20.850 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.850 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:23:20.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:23:20.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.851 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:23:20.851 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:23:20.851 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.851 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.851 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:23:20.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:23:20.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:20.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:23:20.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:23:20.852 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.852 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.852 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.852 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:23:20.852 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:23:20.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:23:20.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:23:20.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.853 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.853 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.853 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:23:20.853 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:23:20.853 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.854 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.854 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:23:20.854 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:23:20.854 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.854 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.854 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.854 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.854 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.854 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:20.854 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:20.855 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 49.682708040999998, 2024-04-26T10:23:20.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:23:20.855 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.855 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.855 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.855 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.855 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.855 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:23:20.855 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.855 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.855 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.855 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.855 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:20.855 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:20.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.856 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:23:20.856 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.856 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.856 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.856 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:23:20.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:23:20.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:23:20.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:23:20.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.857 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.857 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.857 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:23:20.857 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:23:20.857 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:23:20.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:23:20.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.858 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.858 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.858 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:23:20.858 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:23:20.858 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:23:20.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:23:20.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.859 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:23:20.859 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:23:20.859 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.859 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.859 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.860 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:23:20.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:23:20.860 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.860 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.860 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.860 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.860 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.860 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:20.860 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:20.860 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 49.682643788999997, 2024-04-26T10:23:20.860 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:23:20.860 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.860 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.861 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.861 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.861 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.861 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:23:20.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.861 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.861 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:20.861 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.861 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.861 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.861 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:20.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:23:20.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:20.862 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.862 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.862 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.862 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:23:20.862 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:23:20.863 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.863 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.865 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.865 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:23:20.865 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:23:20.865 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.865 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:23:20.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:23:20.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:23:20.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:23:20.866 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.866 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.866 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.866 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:23:20.866 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:23:20.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:23:20.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:23:20.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.867 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:23:20.867 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:23:20.867 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.867 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.867 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.868 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:23:20.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:23:20.868 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.868 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.868 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.868 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.868 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.868 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:20.868 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:20.868 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 49.678245115999999, 2024-04-26T10:23:20.868 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:23:20.868 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.869 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.869 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.869 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.869 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.869 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:23:20.869 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.869 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.869 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.869 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.869 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:20.869 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:20.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.870 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.870 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:23:20.870 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:20.870 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.870 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:23:20.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:23:20.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.871 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:23:20.871 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:23:20.871 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.871 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.871 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:23:20.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:23:20.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:23:20.872 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:23:20.872 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.872 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.872 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.872 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:23:20.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:23:20.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:23:20.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:23:20.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.873 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.873 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.873 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:23:20.873 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:23:20.873 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.874 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.874 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:23:20.874 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:23:20.874 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.874 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.874 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.874 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.874 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.874 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:20.874 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:20.874 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 49.676487133000002, 2024-04-26T10:23:20.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:23:20.875 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:20.875 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:20.875 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:20.875 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:20.875 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:20.875 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:23:20.875 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.875 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:20.875 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.875 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:20.875 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:20.875 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:20.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:20.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:20.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.876 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:20.876 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:23:20.876 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:20.876 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.876 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:20.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:23:20.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:23:20.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:20.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:23:20.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:23:20.877 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.877 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.877 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:20.877 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:23:20.877 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:23:20.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:20.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:23:20.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:23:20.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.878 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.878 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:20.878 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:23:20.878 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:23:20.878 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:20.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:23:20.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:23:20.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:20.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:23:20.879 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:23:20.879 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.879 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.879 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:20.879 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:23:20.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:23:20.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:20.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:23:20.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:23:20.880 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:20.880 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:20.880 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:20.880 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:23:20.880 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:23:20.880 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.880 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.881 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.881 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:20.881 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:20.881 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:20.882 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:20.878+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:20.883 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:20.983 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:20.979+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:21.016 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:21.016 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:21.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.016 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:234777 5.3 5:c2635a1c:::benchmark_data_smithi052_19421_object105305:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:21.016 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:21.004964+0000", 2024-04-26T10:23:21.016 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0083987279999999994, 2024-04-26T10:23:21.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.008422957, 2024-04-26T10:23:21.016 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.016 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:21.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.016 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.017 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.017 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 234777 2024-04-26T10:23:21.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.017 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004964+0000", 2024-04-26T10:23:21.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004964+0000", 2024-04-26T10:23:21.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004963+0000", 2024-04-26T10:23:21.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:21.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004968+0000", 2024-04-26T10:23:21.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4610000000000001e-06 2024-04-26T10:23:21.018 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.018 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004976+0000", 2024-04-26T10:23:21.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7870000000000007e-06 2024-04-26T10:23:21.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004983+0000", 2024-04-26T10:23:21.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2199999999999997e-06 2024-04-26T10:23:21.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.019 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.019 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.005543+0000", 2024-04-26T10:23:21.019 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00056090399999999998 2024-04-26T10:23:21.019 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.019 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.020 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.020 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.005616+0000", 2024-04-26T10:23:21.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2096999999999998e-05 2024-04-26T10:23:21.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.020 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.020 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.020 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.020 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.020 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:234778 5.5 5:ac0422bc:::benchmark_data_smithi052_19421_object105306:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:21.020 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:21.007124+0000", 2024-04-26T10:23:21.020 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0062381529999999998, 2024-04-26T10:23:21.020 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063363389999999999, 2024-04-26T10:23:21.020 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.020 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:21.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.021 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.021 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 234778 2024-04-26T10:23:21.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.021 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.007124+0000", 2024-04-26T10:23:21.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.021 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.021 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.021 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.021 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.007124+0000", 2024-04-26T10:23:21.021 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.007124+0000", 2024-04-26T10:23:21.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:21.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.007128+0000", 2024-04-26T10:23:21.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8860000000000003e-06 2024-04-26T10:23:21.022 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.022 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.022 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.022 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.007137+0000", 2024-04-26T10:23:21.022 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7139999999999999e-06 2024-04-26T10:23:21.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.007142+0000", 2024-04-26T10:23:21.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:23:21.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.009115+0000", 2024-04-26T10:23:21.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001972793 2024-04-26T10:23:21.023 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.023 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.023 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.009252+0000", 2024-04-26T10:23:21.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013732699999999999 2024-04-26T10:23:21.024 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.024 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.024 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.024 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:234784 5.b e67/37 5:d3ec4343:::benchmark_data_smithi052_19421_object105312:head v 67'14576, mlcod=67'14574)", 2024-04-26T10:23:21.024 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:21.009678+0000", 2024-04-26T10:23:21.024 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.003684849, 2024-04-26T10:23:21.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0038499379999999998, 2024-04-26T10:23:21.024 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.024 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:21.024 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.009678+0000", 2024-04-26T10:23:21.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.009678+0000", 2024-04-26T10:23:21.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.009677+0000", 2024-04-26T10:23:21.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:21.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.009685+0000", 2024-04-26T10:23:21.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5379999999999997e-06 2024-04-26T10:23:21.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.009692+0000", 2024-04-26T10:23:21.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8870000000000003e-06 2024-04-26T10:23:21.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.009696+0000", 2024-04-26T10:23:21.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2649999999999998e-06 2024-04-26T10:23:21.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010056+0000", 2024-04-26T10:23:21.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00035985200000000002 2024-04-26T10:23:21.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010077+0000", 2024-04-26T10:23:21.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0894999999999999e-05 2024-04-26T10:23:21.027 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.027 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.027 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.028 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:234786 5.4 5:25e9a86b:::benchmark_data_smithi052_19421_object105314:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:21.028 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:21.010121+0000", 2024-04-26T10:23:21.028 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0032416839999999999, 2024-04-26T10:23:21.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034665719999999998, 2024-04-26T10:23:21.028 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.028 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:21.028 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.028 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.028 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.028 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 234786 2024-04-26T10:23:21.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.028 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010121+0000", 2024-04-26T10:23:21.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010121+0000", 2024-04-26T10:23:21.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010120+0000", 2024-04-26T10:23:21.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:21.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010123+0000", 2024-04-26T10:23:21.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1130000000000001e-06 2024-04-26T10:23:21.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010130+0000", 2024-04-26T10:23:21.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.511e-06 2024-04-26T10:23:21.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010135+0000", 2024-04-26T10:23:21.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1259999999999997e-06 2024-04-26T10:23:21.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.011047+0000", 2024-04-26T10:23:21.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00091142199999999995 2024-04-26T10:23:21.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.011227+0000", 2024-04-26T10:23:21.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018027599999999999 2024-04-26T10:23:21.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.011339+0000", 2024-04-26T10:23:21.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112198 2024-04-26T10:23:21.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013535+0000", 2024-04-26T10:23:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0021955 2024-04-26T10:23:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:234787 5.d 5:b8817cd0:::benchmark_data_smithi052_19421_object105315:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:21.010304+0000", 2024-04-26T10:23:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0030590629999999999, 2024-04-26T10:23:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033577920000000001, 2024-04-26T10:23:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.032 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 234787 2024-04-26T10:23:21.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.033 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010304+0000", 2024-04-26T10:23:21.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010304+0000", 2024-04-26T10:23:21.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010302+0000", 2024-04-26T10:23:21.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:21.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010308+0000", 2024-04-26T10:23:21.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5419999999999996e-06 2024-04-26T10:23:21.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010318+0000", 2024-04-26T10:23:21.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9639999999999998e-06 2024-04-26T10:23:21.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010327+0000", 2024-04-26T10:23:21.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9330000000000007e-06 2024-04-26T10:23:21.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013386+0000", 2024-04-26T10:23:21.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030588989999999999 2024-04-26T10:23:21.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013501+0000", 2024-04-26T10:23:21.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115686 2024-04-26T10:23:21.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013610+0000", 2024-04-26T10:23:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010850500000000001 2024-04-26T10:23:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:234788 5.d 5.76ac9f5d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:21.010333+0000", 2024-04-26T10:23:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0030290909999999998, 2024-04-26T10:23:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033881660000000002, 2024-04-26T10:23:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:21.036 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.037 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.037 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 234788 2024-04-26T10:23:21.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.037 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010333+0000", 2024-04-26T10:23:21.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010333+0000", 2024-04-26T10:23:21.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010333+0000", 2024-04-26T10:23:21.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:21.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010336+0000", 2024-04-26T10:23:21.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7329999999999999e-06 2024-04-26T10:23:21.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010341+0000", 2024-04-26T10:23:21.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5339999999999999e-06 2024-04-26T10:23:21.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.039 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010346+0000", 2024-04-26T10:23:21.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.955e-06 2024-04-26T10:23:21.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.039 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.039 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:234789 5.3 5:c8f5c742:::benchmark_data_smithi052_19421_object105317:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:21.039 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:21.010351+0000", 2024-04-26T10:23:21.039 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0030120450000000001, 2024-04-26T10:23:21.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0034179340000000001, 2024-04-26T10:23:21.040 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.040 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:21.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.040 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 234789 2024-04-26T10:23:21.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.040 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010351+0000", 2024-04-26T10:23:21.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010351+0000", 2024-04-26T10:23:21.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010350+0000", 2024-04-26T10:23:21.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:21.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010352+0000", 2024-04-26T10:23:21.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3080000000000002e-06 2024-04-26T10:23:21.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010359+0000", 2024-04-26T10:23:21.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1090000000000003e-06 2024-04-26T10:23:21.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.010363+0000", 2024-04-26T10:23:21.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7899999999999999e-06 2024-04-26T10:23:21.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.012271+0000", 2024-04-26T10:23:21.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019078089999999999 2024-04-26T10:23:21.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.012367+0000", 2024-04-26T10:23:21.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6268999999999996e-05 2024-04-26T10:23:21.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.044 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.044 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:234791 5.2 5:4eb2cf1b:::benchmark_data_smithi052_19421_object105319:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:21.044 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:21.011204+0000", 2024-04-26T10:23:21.044 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0021589679999999998, 2024-04-26T10:23:21.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002622835, 2024-04-26T10:23:21.044 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.045 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:21.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.045 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 234791 2024-04-26T10:23:21.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.045 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.011204+0000", 2024-04-26T10:23:21.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.045 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.045 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.011204+0000", 2024-04-26T10:23:21.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.011203+0000", 2024-04-26T10:23:21.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:21.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.011208+0000", 2024-04-26T10:23:21.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1630000000000004e-06 2024-04-26T10:23:21.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.011217+0000", 2024-04-26T10:23:21.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4460000000000007e-06 2024-04-26T10:23:21.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.011226+0000", 2024-04-26T10:23:21.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2730000000000002e-06 2024-04-26T10:23:21.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.011281+0000", 2024-04-26T10:23:21.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5621000000000002e-05 2024-04-26T10:23:21.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.011407+0000", 2024-04-26T10:23:21.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012570100000000001 2024-04-26T10:23:21.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.048 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.048 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.048 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:234792 5.9 5:9ce03ea0:::benchmark_data_smithi052_19421_object105320:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:21.048 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:21.013183+0000", 2024-04-26T10:23:21.048 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000179514, 2024-04-26T10:23:21.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069890399999999997, 2024-04-26T10:23:21.049 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.049 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:21.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.049 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.049 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 234792 2024-04-26T10:23:21.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.049 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013183+0000", 2024-04-26T10:23:21.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013183+0000", 2024-04-26T10:23:21.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013182+0000", 2024-04-26T10:23:21.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:21.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013187+0000", 2024-04-26T10:23:21.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3809999999999998e-06 2024-04-26T10:23:21.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013197+0000", 2024-04-26T10:23:21.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9720000000000004e-06 2024-04-26T10:23:21.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013205+0000", 2024-04-26T10:23:21.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1509999999999998e-06 2024-04-26T10:23:21.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.051 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013253+0000", 2024-04-26T10:23:21.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8551000000000003e-05 2024-04-26T10:23:21.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013375+0000", 2024-04-26T10:23:21.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000121786 2024-04-26T10:23:21.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013495+0000", 2024-04-26T10:23:21.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000120105 2024-04-26T10:23:21.052 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.052 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.052 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.053 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:234793 5.7 5:e0a48012:::benchmark_data_smithi052_19421_object105321:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:21.053 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:21.013221+0000", 2024-04-26T10:23:21.053 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00014199899999999999, 2024-04-26T10:23:21.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00072207399999999996, 2024-04-26T10:23:21.053 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.053 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:21.053 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.053 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.053 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.053 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 234793 2024-04-26T10:23:21.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.053 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013221+0000", 2024-04-26T10:23:21.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013221+0000", 2024-04-26T10:23:21.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013220+0000", 2024-04-26T10:23:21.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013223+0000", 2024-04-26T10:23:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7089999999999998e-06 2024-04-26T10:23:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013229+0000", 2024-04-26T10:23:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8900000000000004e-06 2024-04-26T10:23:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013233+0000", 2024-04-26T10:23:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6779999999999999e-06 2024-04-26T10:23:21.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013303+0000", 2024-04-26T10:23:21.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9070000000000001e-05 2024-04-26T10:23:21.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013430+0000", 2024-04-26T10:23:21.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012784100000000001 2024-04-26T10:23:21.056 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.056 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.056 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.056 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:234794 5.9 5.ca506ca9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:21.057 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:21.013244+0000", 2024-04-26T10:23:21.057 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000118885, 2024-04-26T10:23:21.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00075430500000000004, 2024-04-26T10:23:21.057 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.057 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:21.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.057 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.057 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 234794 2024-04-26T10:23:21.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.057 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013244+0000", 2024-04-26T10:23:21.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013244+0000", 2024-04-26T10:23:21.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013243+0000", 2024-04-26T10:23:21.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:21.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013246+0000", 2024-04-26T10:23:21.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3149999999999999e-06 2024-04-26T10:23:21.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013251+0000", 2024-04-26T10:23:21.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3979999999999998e-06 2024-04-26T10:23:21.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013255+0000", 2024-04-26T10:23:21.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4279999999999998e-06 2024-04-26T10:23:21.059 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.059 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.060 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.060 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "MOSDPGPush(5.b 67/37 [PushOp(5:d5d3dd45:::benchmark_data_smithi052_19421_object122784:head, version: 47'7613, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:d5d3dd45:::benchmark_data_smithi052_19421_object122784:head@47'7613, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-04-26T10:23:21.060 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:21.013296+0000", 2024-04-26T10:23:21.060 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 6.6736000000000006e-05, 2024-04-26T10:23:21.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00077593099999999999, 2024-04-26T10:23:21.060 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.060 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:21.060 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013296+0000", 2024-04-26T10:23:21.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013296+0000", 2024-04-26T10:23:21.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013295+0000", 2024-04-26T10:23:21.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:21.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013391+0000", 2024-04-26T10:23:21.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5278999999999994e-05 2024-04-26T10:23:21.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013406+0000", 2024-04-26T10:23:21.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5332000000000002e-05 2024-04-26T10:23:21.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013422+0000", 2024-04-26T10:23:21.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5917999999999999e-05 2024-04-26T10:23:21.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013920+0000", 2024-04-26T10:23:21.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049798500000000005 2024-04-26T10:23:21.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013930+0000", 2024-04-26T10:23:21.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0584000000000001e-05 2024-04-26T10:23:21.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.063 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.063 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "pg_backfill(progress 5.b e 67/67 lb 5:d5d1af36:::benchmark_data_smithi052_19421_object125842:head)", 2024-04-26T10:23:21.063 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:21.013435+0000", 2024-04-26T10:23:21.063 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.999928, 2024-04-26T10:23:21.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000686394, 2024-04-26T10:23:21.064 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.064 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:21.064 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013435+0000", 2024-04-26T10:23:21.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.064 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013435+0000", 2024-04-26T10:23:21.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.064 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013434+0000", 2024-04-26T10:23:21.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:21.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013444+0000", 2024-04-26T10:23:21.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4050000000000006e-06 2024-04-26T10:23:21.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013450+0000", 2024-04-26T10:23:21.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8800000000000002e-06 2024-04-26T10:23:21.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013457+0000", 2024-04-26T10:23:21.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1940000000000003e-06 2024-04-26T10:23:21.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.066 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.066 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.066 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:234795 5.f 5:f3b74f9b:::benchmark_data_smithi052_19421_object105323:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:21.066 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:21.013886+0000", 2024-04-26T10:23:21.066 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9994769, 2024-04-26T10:23:21.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027820600000000003, 2024-04-26T10:23:21.066 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.066 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-04-26T10:23:21.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.066 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.067 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.067 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 234795 2024-04-26T10:23:21.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.067 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013886+0000", 2024-04-26T10:23:21.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013886+0000", 2024-04-26T10:23:21.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013885+0000", 2024-04-26T10:23:21.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:21.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013889+0000", 2024-04-26T10:23:21.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6249999999999998e-06 2024-04-26T10:23:21.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013901+0000", 2024-04-26T10:23:21.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1796e-05 2024-04-26T10:23:21.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013908+0000", 2024-04-26T10:23:21.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:21.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.014021+0000", 2024-04-26T10:23:21.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112843 2024-04-26T10:23:21.069 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.069 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.069 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.069 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:234770 5.5 5:ad8577fc:::benchmark_data_smithi052_19421_object105298:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:21.069 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:21.003210+0000", 2024-04-26T10:23:21.070 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.010153018, 2024-04-26T10:23:21.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.011009758999999999, 2024-04-26T10:23:21.070 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.070 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:21.070 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.070 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.070 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.070 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 234770 2024-04-26T10:23:21.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.070 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.070 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.070 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.003210+0000", 2024-04-26T10:23:21.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.003210+0000", 2024-04-26T10:23:21.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.003209+0000", 2024-04-26T10:23:21.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:21.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.003211+0000", 2024-04-26T10:23:21.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2970000000000002e-06 2024-04-26T10:23:21.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.003223+0000", 2024-04-26T10:23:21.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1044e-05 2024-04-26T10:23:21.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.003227+0000", 2024-04-26T10:23:21.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5970000000000002e-06 2024-04-26T10:23:21.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004981+0000", 2024-04-26T10:23:21.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001753936 2024-04-26T10:23:21.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.005103+0000", 2024-04-26T10:23:21.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012230499999999999 2024-04-26T10:23:21.073 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.073 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.073 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.073 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:234796 5.3 5.73aa11f3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:21.074 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:21.013929+0000", 2024-04-26T10:23:21.074 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9994335, 2024-04-26T10:23:21.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00034523600000000001, 2024-04-26T10:23:21.074 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.074 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:21.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.074 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.074 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 234796 2024-04-26T10:23:21.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.074 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013929+0000", 2024-04-26T10:23:21.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013929+0000", 2024-04-26T10:23:21.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013928+0000", 2024-04-26T10:23:21.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:21.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013932+0000", 2024-04-26T10:23:21.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0389999999999998e-06 2024-04-26T10:23:21.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013940+0000", 2024-04-26T10:23:21.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8150000000000006e-06 2024-04-26T10:23:21.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.013946+0000", 2024-04-26T10:23:21.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6749999999999999e-06 2024-04-26T10:23:21.076 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.076 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.076 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.077 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:234773 5.5 5:acf182c7:::benchmark_data_smithi052_19421_object105301:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:21.077 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:21.004595+0000", 2024-04-26T10:23:21.077 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0087675540000000003, 2024-04-26T10:23:21.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0097323770000000004, 2024-04-26T10:23:21.077 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.077 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:21.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.077 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.077 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 234773 2024-04-26T10:23:21.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.077 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004595+0000", 2024-04-26T10:23:21.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004595+0000", 2024-04-26T10:23:21.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004594+0000", 2024-04-26T10:23:21.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:21.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004598+0000", 2024-04-26T10:23:21.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6629999999999999e-06 2024-04-26T10:23:21.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004607+0000", 2024-04-26T10:23:21.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9840000000000007e-06 2024-04-26T10:23:21.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004613+0000", 2024-04-26T10:23:21.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.049e-06 2024-04-26T10:23:21.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.006490+0000", 2024-04-26T10:23:21.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0018767020000000001 2024-04-26T10:23:21.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.006642+0000", 2024-04-26T10:23:21.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015183300000000001 2024-04-26T10:23:21.080 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.080 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.080 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.081 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:234774 5.5 5:a5ee26de:::benchmark_data_smithi052_19421_object105302:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-04-26T10:23:21.081 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:21.004748+0000", 2024-04-26T10:23:21.081 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0086144729999999992, 2024-04-26T10:23:21.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0096361410000000008, 2024-04-26T10:23:21.081 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.081 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:21.081 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.081 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.081 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.081 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 234774 2024-04-26T10:23:21.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.081 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004748+0000", 2024-04-26T10:23:21.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004748+0000", 2024-04-26T10:23:21.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004747+0000", 2024-04-26T10:23:21.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:21.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004752+0000", 2024-04-26T10:23:21.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9690000000000002e-06 2024-04-26T10:23:21.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004763+0000", 2024-04-26T10:23:21.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0966e-05 2024-04-26T10:23:21.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.004770+0000", 2024-04-26T10:23:21.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6340000000000003e-06 2024-04-26T10:23:21.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.007857+0000", 2024-04-26T10:23:21.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030872730000000002 2024-04-26T10:23:21.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:21.007990+0000", 2024-04-26T10:23:21.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013263399999999999 2024-04-26T10:23:21.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.084 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.084 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.084 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:23:21.084 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 18 2024-04-26T10:23:21.085 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:21.086 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:21.087 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:21.079+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:21.186 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:21.186+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:21.217 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:21.217 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:21.217 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:23:21.217 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:23:21.217 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:21.229 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:21.287 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:21.286+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:21.293 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:23:21.302 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:23:21.363 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:21.363 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:23:21.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:23:21.363 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:21.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.363 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:21.363 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:21.363 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.321274328999998, 2024-04-26T10:23:21.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:23:21.363 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.363 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.363 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.364 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.364 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:23:21.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.364 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:21.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:21.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:21.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:21.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:23:21.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:23:21.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:23:21.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:23:21.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:23:21.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:23:21.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:23:21.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:23:21.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:23:21.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:23:21.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:23:21.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:23:21.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.367 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:23:21.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:23:21.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.367 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:23:21.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:23:21.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.368 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.368 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.368 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:21.368 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:21.368 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.321165078, 2024-04-26T10:23:21.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:23:21.368 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.368 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.368 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:23:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:21.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:23:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:23:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:23:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:23:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:23:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:23:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:23:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:23:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:23:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:23:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:23:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:23:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:23:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:23:21.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:23:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:23:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.318767665999999, 2024-04-26T10:23:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:23:21.373 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:23:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:23:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:23:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:23:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:23:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:23:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:23:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:23:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:23:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:23:21.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:23:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:23:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:23:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:23:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:23:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:23:21.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:23:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:23:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:23:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:23:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:23:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:23:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 57.318581741999999, 2024-04-26T10:23:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:23:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.379 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:23:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:21.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:23:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:23:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:23:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:23:21.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:23:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:23:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:23:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:23:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:23:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:23:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:23:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:23:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:23:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:23:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:23:21.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:23:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:23:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:23:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:23:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:23:21.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:23:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.228559126, 2024-04-26T10:23:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:23:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.385 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:23:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:23:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:23:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:23:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:23:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.387 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:23:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:23:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:23:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:23:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:23:21.388 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:23:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:23:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:23:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:23:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:23:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:23:21.389 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:23:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:23:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:23:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:23:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:23:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.390 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:23:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:23:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:23:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:23:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:21.391 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.20545688, 2024-04-26T10:23:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:23:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:23:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.392 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:23:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:23:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:23:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.393 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:23:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:23:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:23:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:23:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:23:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:23:21.394 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:23:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:23:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:23:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:23:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:23:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:23:21.395 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:23:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:23:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:23:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:23:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:23:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:23:21.396 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:23:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:23:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:23:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:23:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.397 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.198773742, 2024-04-26T10:23:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:23:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:23:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.398 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:23:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.399 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:23:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:23:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:23:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:23:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:23:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:23:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.400 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:23:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:23:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:23:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:23:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:23:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:23:21.401 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:23:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:23:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:23:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:23:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:23:21.402 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:23:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:23:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:23:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:23:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:23:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.403 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:23:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:23:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.196775957, 2024-04-26T10:23:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:23:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.404 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:23:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.405 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:23:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:23:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:23:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:23:21.406 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:23:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:23:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:23:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:23:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:23:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:23:21.407 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:23:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:23:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:23:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:23:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.408 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:23:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:23:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:23:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:23:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:23:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:23:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.409 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:23:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:23:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:23:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:23:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:21.410 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.187367252000001, 2024-04-26T10:23:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:23:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:23:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:21.411 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:23:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.412 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:23:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:23:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:23:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:23:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:23:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.413 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:23:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:23:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:23:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:23:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:23:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:23:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.414 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:23:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:23:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:23:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:23:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:23:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:23:21.415 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:23:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:23:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:23:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:23:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.416 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:23:21.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:23:21.417 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.417 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.417 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.417 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.417 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.417 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:21.417 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:21.417 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.185539202999998, 2024-04-26T10:23:21.417 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:23:21.417 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.417 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.417 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.417 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.418 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.418 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:23:21.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.418 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:21.418 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.418 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.418 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.418 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.418 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:21.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:23:21.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:21.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:23:21.419 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:23:21.419 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.419 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.419 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.419 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:23:21.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:23:21.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:23:21.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:23:21.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.420 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.420 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:23:21.420 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:23:21.420 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.420 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:23:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:23:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:23:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:23:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.421 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:23:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:23:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:23:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:23:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:23:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:23:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.422 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:23:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:23:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:23:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:23:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:23:21.423 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:23:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.173959480999997, 2024-04-26T10:23:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:23:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.424 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:23:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.425 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:23:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:23:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:23:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:23:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.426 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:23:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:23:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:23:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:23:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:23:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:23:21.427 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:23:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:23:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:23:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:23:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:23:21.428 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:23:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:23:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:23:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:23:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:23:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.429 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:23:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:23:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:23:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:23:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:21.430 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.167548987000004, 2024-04-26T10:23:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:23:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:23:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.431 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:23:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.432 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:23:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:23:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:23:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:23:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:23:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.433 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:23:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:23:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:23:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:23:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:23:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:23:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.434 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:23:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:23:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:23:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:23:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:23:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:23:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.435 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:23:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:23:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:23:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:23:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:23:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:23:21.436 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.154963924, 2024-04-26T10:23:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:23:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.437 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:23:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.438 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:23:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:23:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.439 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:23:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:23:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:23:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:23:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:23:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:23:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:21.440 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:23:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:23:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:23:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:23:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:23:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.441 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:23:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:23:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:23:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:23:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:23:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:23:21.442 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:23:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:23:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:23:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:23:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.443 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.154728990999999, 2024-04-26T10:23:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:23:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:23:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:21.444 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:23:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:23:21.445 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:23:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:23:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:23:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:23:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:23:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.446 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:23:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:23:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:23:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:23:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:23:21.447 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:23:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:23:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:23:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:23:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.448 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:23:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:23:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:23:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:23:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:23:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:23:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.449 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:23:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:23:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.116854113999999, 2024-04-26T10:23:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:23:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.450 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:23:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:21.451 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:23:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:23:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:23:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.452 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:23:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:23:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:23:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:23:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:23:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:23:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:21.453 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:23:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:23:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:23:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:23:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:23:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.454 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:23:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:23:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:23:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:23:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:23:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:23:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.455 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:23:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:23:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:23:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:23:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.456 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.116409089000001, 2024-04-26T10:23:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:23:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:23:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.457 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:23:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.458 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:23:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:23:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:23:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:23:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:23:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:23:21.459 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:23:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:23:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:23:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:23:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:23:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:23:21.460 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:23:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:23:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:23:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:23:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.461 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:23:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:23:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:23:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:23:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:23:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:23:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.462 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:23:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:23:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.104806089, 2024-04-26T10:23:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:23:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.463 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:23:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.464 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:23:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:23:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:23:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.465 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:23:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:23:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:23:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:23:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:23:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:23:21.466 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:23:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:23:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:23:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:23:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:23:21.467 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:23:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:23:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:23:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:23:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:23:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.468 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:23:21.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:23:21.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:23:21.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:23:21.469 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.469 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.469 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.469 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:23:21.469 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:23:21.469 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.469 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.470 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.470 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.470 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.470 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:21.470 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:21.470 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.103532499000003, 2024-04-26T10:23:21.470 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:23:21.470 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.470 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.470 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.470 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:23:21.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.471 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:21.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.471 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.471 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:21.471 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.471 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.471 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:23:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:23:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:23:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:23:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:23:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.472 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:23:21.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:23:21.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:23:21.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:23:21.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.473 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.473 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:21.473 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:23:21.473 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:23:21.473 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:23:21.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:23:21.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:23:21.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:23:21.474 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.474 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.474 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.474 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:23:21.474 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:23:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:23:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:23:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:23:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:23:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:23:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:23:21.475 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.476 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.476 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:23:21.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:23:21.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.476 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.476 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.476 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.476 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.476 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:21.476 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:21.476 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.086775197999998, 2024-04-26T10:23:21.476 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:23:21.477 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.477 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.477 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.477 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:23:21.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.477 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.477 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:21.477 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.477 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.477 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.477 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:21.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:23:21.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:21.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.478 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.478 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:23:21.478 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:23:21.478 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.478 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:23:21.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:23:21.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:23:21.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:23:21.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.479 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.479 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.479 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:23:21.479 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:23:21.479 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:23:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:23:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:23:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:23:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:23:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:23:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.480 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:23:21.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:23:21.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:23:21.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:23:21.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.481 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.481 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:23:21.481 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:23:21.481 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.481 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:23:21.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:23:21.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.482 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.482 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:23:21.482 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:23:21.482 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.482 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.482 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.482 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.482 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.482 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:21.483 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:21.483 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 32.041863177000003, 2024-04-26T10:23:21.483 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:23:21.483 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:21.483 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:21.483 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:21.483 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:21.483 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:21.483 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:23:21.483 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.483 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:21.483 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.483 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:21.483 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:23:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.484 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:23:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:23:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:23:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:23:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:23:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:23:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.485 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:23:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:23:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:23:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:23:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:23:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:23:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:21.486 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:23:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:23:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:23:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:23:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:23:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:23:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:21.487 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:23:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:23:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:23:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:23:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:23:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:23:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.488 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.489 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:21.489 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:21.489 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:21.490 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:23:21.490 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:23:21.490 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:23:21.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:21.492 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:21.483+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:21.492 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:23:21.492 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:23:21.492 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:23:21.492 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:23:21.590 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:21.587+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:21.621 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:21.621 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:21.634 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:21.691 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:21.687+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:21.763 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:21.763 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:21.776 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:21.793 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:21.790+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:21.894 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:21.895 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:21.895 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:21.887+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:21.907 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:21.994 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:21.991+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:22.040 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:22.040 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:22.054 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:22.095 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:22.094+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:22.181 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:22.181 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:22.194 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:22.196 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:22.194+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:22.297 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:22.294+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:22.305 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T10:23:22.324 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:22.324 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:22.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:22.340 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~94s 2024-04-26T10:23:22.398 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:22.394+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:22.460 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:22.460 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:22.472 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:22.498 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:22.495+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:22.592 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:22.592 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:22.599 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:22.595+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:22.604 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:22.700 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:22.698+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:22.728 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:22.728 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:22.742 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:22.801 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:22.795+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:22.879 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:22.879 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:22.892 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:22.902 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:22.895+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:23.002 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:23.002+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:23.021 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:23.021 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:23.035 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:23.103 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:23.099+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:23.163 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:23.163 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:23.176 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:23.218 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:23.215+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:23.300 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:23.300 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:23.305 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:23.299+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:23.311 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:23.406 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:23.399+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:23.437 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:23.437 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:23.451 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:23.493 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:23:23.507 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:23.506+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:23.571 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:23.571 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:23.584 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:23.630 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:23.627+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:23.649 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:23:23.671 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:23:23.672 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:23:23.672 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:23:23.672 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:23:23.676 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:23:23.677 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:23:23.708 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:23.706+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:23.717 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop(client.4722.0:241044 5.b e68/37 5:da2416ef:::benchmark_data_smithi052_19421_object111572:head v 68'14985, mlcod=68'14983)", 2024-04-26T10:23:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.708481+0000", 2024-04-26T10:23:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0068903870000000004, 2024-04-26T10:23:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0069112089999999998, 2024-04-26T10:23:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.708481+0000", 2024-04-26T10:23:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.708481+0000", 2024-04-26T10:23:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.708480+0000", 2024-04-26T10:23:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.708485+0000", 2024-04-26T10:23:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9749999999999998e-06 2024-04-26T10:23:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.708492+0000", 2024-04-26T10:23:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6109999999999999e-06 2024-04-26T10:23:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.708498+0000", 2024-04-26T10:23:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8619999999999999e-06 2024-04-26T10:23:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.708687+0000", 2024-04-26T10:23:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000188975 2024-04-26T10:23:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.708718+0000", 2024-04-26T10:23:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0834000000000003e-05 2024-04-26T10:23:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:241046 5.f 5:f334f4f5:::benchmark_data_smithi052_19421_object111574:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.711029+0000", 2024-04-26T10:23:23.721 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.004342327, 2024-04-26T10:23:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044089519999999998, 2024-04-26T10:23:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241046 2024-04-26T10:23:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711029+0000", 2024-04-26T10:23:23.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711029+0000", 2024-04-26T10:23:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711028+0000", 2024-04-26T10:23:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711036+0000", 2024-04-26T10:23:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8450000000000003e-06 2024-04-26T10:23:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711045+0000", 2024-04-26T10:23:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.1230000000000006e-06 2024-04-26T10:23:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711052+0000", 2024-04-26T10:23:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7870000000000004e-06 2024-04-26T10:23:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711095+0000", 2024-04-26T10:23:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2956e-05 2024-04-26T10:23:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711196+0000", 2024-04-26T10:23:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000101001 2024-04-26T10:23:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:23.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711262+0000", 2024-04-26T10:23:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6527999999999997e-05 2024-04-26T10:23:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715069+0000", 2024-04-26T10:23:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003807319 2024-04-26T10:23:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:241047 5.2 5:455e0220:::benchmark_data_smithi052_19421_object111575:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.711064+0000", 2024-04-26T10:23:23.726 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0043066720000000001, 2024-04-26T10:23:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00442881, 2024-04-26T10:23:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241047 2024-04-26T10:23:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711064+0000", 2024-04-26T10:23:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711064+0000", 2024-04-26T10:23:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711064+0000", 2024-04-26T10:23:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711067+0000", 2024-04-26T10:23:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2969999999999999e-06 2024-04-26T10:23:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711074+0000", 2024-04-26T10:23:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.922e-06 2024-04-26T10:23:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711079+0000", 2024-04-26T10:23:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4989999999999996e-06 2024-04-26T10:23:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711117+0000", 2024-04-26T10:23:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8050999999999999e-05 2024-04-26T10:23:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711195+0000", 2024-04-26T10:23:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8781000000000003e-05 2024-04-26T10:23:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.730 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:241048 5.4 5:20849ce3:::benchmark_data_smithi052_19421_object111576:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.711096+0000", 2024-04-26T10:23:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0042747330000000002, 2024-04-26T10:23:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0044447990000000001, 2024-04-26T10:23:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241048 2024-04-26T10:23:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711096+0000", 2024-04-26T10:23:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711096+0000", 2024-04-26T10:23:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711096+0000", 2024-04-26T10:23:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711099+0000", 2024-04-26T10:23:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3550000000000001e-06 2024-04-26T10:23:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711107+0000", 2024-04-26T10:23:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7710000000000006e-06 2024-04-26T10:23:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711113+0000", 2024-04-26T10:23:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9349999999999999e-06 2024-04-26T10:23:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711186+0000", 2024-04-26T10:23:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3009000000000005e-05 2024-04-26T10:23:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711324+0000", 2024-04-26T10:23:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013789600000000001 2024-04-26T10:23:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711435+0000", 2024-04-26T10:23:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011146600000000001 2024-04-26T10:23:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.714903+0000", 2024-04-26T10:23:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003467333 2024-04-26T10:23:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.735 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:241049 5.3 5:cf9166fe:::benchmark_data_smithi052_19421_object111577:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.711449+0000", 2024-04-26T10:23:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0039219119999999996, 2024-04-26T10:23:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004140978, 2024-04-26T10:23:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241049 2024-04-26T10:23:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711449+0000", 2024-04-26T10:23:23.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711449+0000", 2024-04-26T10:23:23.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711448+0000", 2024-04-26T10:23:23.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:23.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711453+0000", 2024-04-26T10:23:23.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2740000000000001e-06 2024-04-26T10:23:23.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711471+0000", 2024-04-26T10:23:23.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8145e-05 2024-04-26T10:23:23.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711478+0000", 2024-04-26T10:23:23.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.52e-06 2024-04-26T10:23:23.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:23.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.713472+0000", 2024-04-26T10:23:23.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001993964 2024-04-26T10:23:23.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:23.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.713595+0000", 2024-04-26T10:23:23.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012247500000000001 2024-04-26T10:23:23.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.739 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.739 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.739 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:241051 5.9 5:921ad9b2:::benchmark_data_smithi052_19421_object111579:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:23.739 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.711526+0000", 2024-04-26T10:23:23.739 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0038452389999999999, 2024-04-26T10:23:23.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041082360000000004, 2024-04-26T10:23:23.740 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.740 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:23.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:23.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:23.740 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:23.740 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241051 2024-04-26T10:23:23.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.740 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711526+0000", 2024-04-26T10:23:23.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711526+0000", 2024-04-26T10:23:23.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711525+0000", 2024-04-26T10:23:23.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:23.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711532+0000", 2024-04-26T10:23:23.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7179999999999999e-06 2024-04-26T10:23:23.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711548+0000", 2024-04-26T10:23:23.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6087e-05 2024-04-26T10:23:23.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711555+0000", 2024-04-26T10:23:23.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.888e-06 2024-04-26T10:23:23.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:23.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711611+0000", 2024-04-26T10:23:23.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6156999999999998e-05 2024-04-26T10:23:23.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:23.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711739+0000", 2024-04-26T10:23:23.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012824700000000001 2024-04-26T10:23:23.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:23.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711849+0000", 2024-04-26T10:23:23.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109363 2024-04-26T10:23:23.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:23.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.714182+0000", 2024-04-26T10:23:23.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0023336400000000001 2024-04-26T10:23:23.744 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.744 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.744 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.744 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:241052 5.d 5:bba6a6f4:::benchmark_data_smithi052_19421_object111580:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:23.744 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.711576+0000", 2024-04-26T10:23:23.744 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0037946080000000001, 2024-04-26T10:23:23.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040962790000000004, 2024-04-26T10:23:23.744 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.744 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:23.744 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:23.745 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:23.745 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:23.745 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241052 2024-04-26T10:23:23.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.745 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711576+0000", 2024-04-26T10:23:23.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711576+0000", 2024-04-26T10:23:23.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711576+0000", 2024-04-26T10:23:23.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:23.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711580+0000", 2024-04-26T10:23:23.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.614e-06 2024-04-26T10:23:23.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711588+0000", 2024-04-26T10:23:23.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9719999999999992e-06 2024-04-26T10:23:23.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711594+0000", 2024-04-26T10:23:23.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9789999999999998e-06 2024-04-26T10:23:23.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:23.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711627+0000", 2024-04-26T10:23:23.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3494999999999997e-05 2024-04-26T10:23:23.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:23.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711741+0000", 2024-04-26T10:23:23.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113791 2024-04-26T10:23:23.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:23.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711845+0000", 2024-04-26T10:23:23.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103701 2024-04-26T10:23:23.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:23.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.714471+0000", 2024-04-26T10:23:23.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0026268670000000002 2024-04-26T10:23:23.748 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.748 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.748 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.749 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:241053 5.f 5:f765ae6f:::benchmark_data_smithi052_19421_object111581:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:23.749 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.711607+0000", 2024-04-26T10:23:23.749 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0037643249999999998, 2024-04-26T10:23:23.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041195870000000001, 2024-04-26T10:23:23.749 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.749 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:23.749 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:23.749 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:23.749 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:23.749 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241053 2024-04-26T10:23:23.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.749 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711607+0000", 2024-04-26T10:23:23.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711607+0000", 2024-04-26T10:23:23.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.750 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711606+0000", 2024-04-26T10:23:23.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:23.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711609+0000", 2024-04-26T10:23:23.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0989999999999999e-06 2024-04-26T10:23:23.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711626+0000", 2024-04-26T10:23:23.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6246e-05 2024-04-26T10:23:23.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711631+0000", 2024-04-26T10:23:23.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6160000000000001e-06 2024-04-26T10:23:23.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:23.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.713006+0000", 2024-04-26T10:23:23.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013747519999999999 2024-04-26T10:23:23.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:23.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.713143+0000", 2024-04-26T10:23:23.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013731400000000001 2024-04-26T10:23:23.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:23.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.713275+0000", 2024-04-26T10:23:23.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013165599999999999 2024-04-26T10:23:23.753 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.753 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.753 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.753 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:241024 5.3 5:c3b74670:::benchmark_data_smithi052_19421_object111552:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:23.753 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.701844+0000", 2024-04-26T10:23:23.753 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.013526777, 2024-04-26T10:23:23.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013922089, 2024-04-26T10:23:23.753 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.753 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:23.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:23.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:23.753 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:23.754 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241024 2024-04-26T10:23:23.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.754 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.701844+0000", 2024-04-26T10:23:23.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.701844+0000", 2024-04-26T10:23:23.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.701844+0000", 2024-04-26T10:23:23.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:23.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.701847+0000", 2024-04-26T10:23:23.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.942e-06 2024-04-26T10:23:23.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.701852+0000", 2024-04-26T10:23:23.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1440000000000002e-06 2024-04-26T10:23:23.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.701861+0000", 2024-04-26T10:23:23.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3209999999999994e-06 2024-04-26T10:23:23.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:23.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.704460+0000", 2024-04-26T10:23:23.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025987380000000002 2024-04-26T10:23:23.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:23.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.704620+0000", 2024-04-26T10:23:23.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016023200000000001 2024-04-26T10:23:23.757 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.757 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.757 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.757 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:241054 5.3 5:ca3c75ac:::benchmark_data_smithi052_19421_object111582:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:23.757 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.711642+0000", 2024-04-26T10:23:23.757 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0037289570000000002, 2024-04-26T10:23:23.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041678100000000001, 2024-04-26T10:23:23.758 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.758 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:23.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:23.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:23.758 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:23.758 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241054 2024-04-26T10:23:23.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.758 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711642+0000", 2024-04-26T10:23:23.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711642+0000", 2024-04-26T10:23:23.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711642+0000", 2024-04-26T10:23:23.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:23.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711645+0000", 2024-04-26T10:23:23.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3409999999999999e-06 2024-04-26T10:23:23.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711653+0000", 2024-04-26T10:23:23.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5860000000000005e-06 2024-04-26T10:23:23.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711660+0000", 2024-04-26T10:23:23.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3980000000000004e-06 2024-04-26T10:23:23.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:23.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.714806+0000", 2024-04-26T10:23:23.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0031459309999999998 2024-04-26T10:23:23.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:23.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.714898+0000", 2024-04-26T10:23:23.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2483000000000002e-05 2024-04-26T10:23:23.761 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.761 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.761 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.761 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:241055 5.c 5:3509aacc:::benchmark_data_smithi052_19421_object111583:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:23.761 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.711665+0000", 2024-04-26T10:23:23.762 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0037062649999999998, 2024-04-26T10:23:23.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0041973230000000002, 2024-04-26T10:23:23.762 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.762 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:23.762 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:23.762 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:23.762 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:23.762 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241055 2024-04-26T10:23:23.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.762 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711665+0000", 2024-04-26T10:23:23.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711665+0000", 2024-04-26T10:23:23.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711664+0000", 2024-04-26T10:23:23.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:23.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711667+0000", 2024-04-26T10:23:23.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6620000000000001e-06 2024-04-26T10:23:23.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711673+0000", 2024-04-26T10:23:23.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8629999999999996e-06 2024-04-26T10:23:23.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.764 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.764 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711678+0000", 2024-04-26T10:23:23.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9309999999999999e-06 2024-04-26T10:23:23.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:23.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711714+0000", 2024-04-26T10:23:23.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.6309000000000001e-05 2024-04-26T10:23:23.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:23.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711823+0000", 2024-04-26T10:23:23.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010902400000000001 2024-04-26T10:23:23.765 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.765 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.765 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.766 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "MOSDPGPush(5.b 68/37 [PushOp(5:da1c0d97:::benchmark_data_smithi052_19421_object121765:head, version: 47'7555, data_included: [0~65536], data_size: 65536, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(5:da1c0d97:::benchmark_data_smithi052_19421_object121765:head@47'7555, size: 65536, copy_subset: [0~65536], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:65536, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2024-04-26T10:23:23.766 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.711850+0000", 2024-04-26T10:23:23.766 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0035206370000000001, 2024-04-26T10:23:23.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040928309999999999, 2024-04-26T10:23:23.766 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.766 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:23.766 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711850+0000", 2024-04-26T10:23:23.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711850+0000", 2024-04-26T10:23:23.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711850+0000", 2024-04-26T10:23:23.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:23.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711915+0000", 2024-04-26T10:23:23.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4881000000000004e-05 2024-04-26T10:23:23.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711931+0000", 2024-04-26T10:23:23.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6192999999999999e-05 2024-04-26T10:23:23.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711946+0000", 2024-04-26T10:23:23.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5228999999999999e-05 2024-04-26T10:23:23.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:23.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.713338+0000", 2024-04-26T10:23:23.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013915589999999999 2024-04-26T10:23:23.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:23.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.713354+0000", 2024-04-26T10:23:23.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6107e-05 2024-04-26T10:23:23.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.769 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.769 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.769 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "pg_backfill(progress 5.b e 68/68 lb 5:da1b03cf:::benchmark_data_smithi052_19421_object127631:head)", 2024-04-26T10:23:23.769 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.711958+0000", 2024-04-26T10:23:23.770 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0034130499999999999, 2024-04-26T10:23:23.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0040407200000000002, 2024-04-26T10:23:23.770 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.770 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:23.770 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711958+0000", 2024-04-26T10:23:23.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711958+0000", 2024-04-26T10:23:23.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711958+0000", 2024-04-26T10:23:23.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:23.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711966+0000", 2024-04-26T10:23:23.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3350000000000007e-06 2024-04-26T10:23:23.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.771 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711973+0000", 2024-04-26T10:23:23.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9430000000000003e-06 2024-04-26T10:23:23.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.711978+0000", 2024-04-26T10:23:23.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.3290000000000001e-06 2024-04-26T10:23:23.772 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.772 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.772 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.772 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:241031 5.3 5:cb66aca2:::benchmark_data_smithi052_19421_object111559:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:23.772 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.702462+0000", 2024-04-26T10:23:23.772 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.012909090999999999, 2024-04-26T10:23:23.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.013585962, 2024-04-26T10:23:23.773 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.773 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:23.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:23.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:23.773 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:23.773 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241031 2024-04-26T10:23:23.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.773 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.702462+0000", 2024-04-26T10:23:23.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.702462+0000", 2024-04-26T10:23:23.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.702462+0000", 2024-04-26T10:23:23.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:23.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.702464+0000", 2024-04-26T10:23:23.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6469999999999998e-06 2024-04-26T10:23:23.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.702470+0000", 2024-04-26T10:23:23.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2369999999999997e-06 2024-04-26T10:23:23.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.702475+0000", 2024-04-26T10:23:23.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4710000000000001e-06 2024-04-26T10:23:23.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:23.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.706629+0000", 2024-04-26T10:23:23.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004154568 2024-04-26T10:23:23.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:23.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.706765+0000", 2024-04-26T10:23:23.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013564100000000001 2024-04-26T10:23:23.776 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.776 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.776 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.776 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:241056 5.3 5.33579d03 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:23.776 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.714847+0000", 2024-04-26T10:23:23.776 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00052431500000000002, 2024-04-26T10:23:23.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001269552, 2024-04-26T10:23:23.777 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.777 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:23.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:23.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:23.777 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:23.777 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241056 2024-04-26T10:23:23.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.777 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.714847+0000", 2024-04-26T10:23:23.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.714847+0000", 2024-04-26T10:23:23.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.778 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.714846+0000", 2024-04-26T10:23:23.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:23.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.714850+0000", 2024-04-26T10:23:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5839999999999996e-06 2024-04-26T10:23:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.714861+0000", 2024-04-26T10:23:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0424e-05 2024-04-26T10:23:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.714868+0000", 2024-04-26T10:23:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9870000000000002e-06 2024-04-26T10:23:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:241057 5.9 5:9272c6b1:::benchmark_data_smithi052_19421_object111585:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.715091+0000", 2024-04-26T10:23:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000279709, 2024-04-26T10:23:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001079186, 2024-04-26T10:23:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:23.780 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241057 2024-04-26T10:23:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715091+0000", 2024-04-26T10:23:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715091+0000", 2024-04-26T10:23:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715090+0000", 2024-04-26T10:23:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715096+0000", 2024-04-26T10:23:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6300000000000003e-06 2024-04-26T10:23:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715106+0000", 2024-04-26T10:23:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6150000000000003e-06 2024-04-26T10:23:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715113+0000", 2024-04-26T10:23:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7889999999999995e-06 2024-04-26T10:23:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715153+0000", 2024-04-26T10:23:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9544e-05 2024-04-26T10:23:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715285+0000", 2024-04-26T10:23:23.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132383 2024-04-26T10:23:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715397+0000", 2024-04-26T10:23:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000111712 2024-04-26T10:23:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:241058 5.f 5:fb79cbce:::benchmark_data_smithi052_19421_object111586:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.715254+0000", 2024-04-26T10:23:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.000116838, 2024-04-26T10:23:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00099029700000000001, 2024-04-26T10:23:23.784 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241058 2024-04-26T10:23:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715254+0000", 2024-04-26T10:23:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715254+0000", 2024-04-26T10:23:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715253+0000", 2024-04-26T10:23:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715259+0000", 2024-04-26T10:23:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4770000000000002e-06 2024-04-26T10:23:23.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715268+0000", 2024-04-26T10:23:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7669999999999992e-06 2024-04-26T10:23:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715274+0000", 2024-04-26T10:23:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6819999999999997e-06 2024-04-26T10:23:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:23.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715317+0000", 2024-04-26T10:23:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2973999999999999e-05 2024-04-26T10:23:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715402+0000", 2024-04-26T10:23:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4547000000000002e-05 2024-04-26T10:23:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715469+0000", 2024-04-26T10:23:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7121999999999999e-05 2024-04-26T10:23:23.788 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:241053 5.f e68/37)", 2024-04-26T10:23:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.715325+0000", 2024-04-26T10:23:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4.6307000000000002e-05, 2024-04-26T10:23:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00098528299999999999, 2024-04-26T10:23:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715325+0000", 2024-04-26T10:23:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715325+0000", 2024-04-26T10:23:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715324+0000", 2024-04-26T10:23:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715328+0000", 2024-04-26T10:23:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7610000000000001e-06 2024-04-26T10:23:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715334+0000", 2024-04-26T10:23:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.438e-06 2024-04-26T10:23:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.715339+0000", 2024-04-26T10:23:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6199999999999998e-06 2024-04-26T10:23:23.791 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:241036 5.3 5:cf0c72c7:::benchmark_data_smithi052_19421_object111564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:23.706102+0000", 2024-04-26T10:23:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0092689690000000002, 2024-04-26T10:23:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.010240793999999999, 2024-04-26T10:23:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:23.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 241036 2024-04-26T10:23:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.706102+0000", 2024-04-26T10:23:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.706102+0000", 2024-04-26T10:23:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.706101+0000", 2024-04-26T10:23:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.706105+0000", 2024-04-26T10:23:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2990000000000001e-06 2024-04-26T10:23:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.706111+0000", 2024-04-26T10:23:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3119999999999999e-06 2024-04-26T10:23:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.706115+0000", 2024-04-26T10:23:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9369999999999997e-06 2024-04-26T10:23:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.710031+0000", 2024-04-26T10:23:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0039162880000000004 2024-04-26T10:23:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:23.710152+0000", 2024-04-26T10:23:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012024 2024-04-26T10:23:23.795 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:23:23.796 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 19 2024-04-26T10:23:23.796 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:23.797 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:23.809 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:23.806+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:23.909 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:23.903+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:23.931 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:23.931 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:23.931 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:23:23.931 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:23:23.931 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:23.943 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:24.010 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:24.003+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:24.077 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:24.078 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:23:24.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:23:24.078 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:24.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.078 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:24.078 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:24.078 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.036024963000003, 2024-04-26T10:23:24.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:23:24.078 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.078 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.078 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.079 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.079 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:23:24.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.079 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:24.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:24.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:24.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:23:24.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:23:24.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:23:24.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:23:24.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:23:24.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:23:24.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:23:24.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:23:24.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:23:24.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:23:24.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.082 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.082 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:23:24.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:23:24.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:23:24.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:23:24.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:23:24.083 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:23:24.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.083 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.083 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.084 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:24.084 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:24.084 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.035915711999998, 2024-04-26T10:23:24.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:23:24.084 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.084 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.084 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.084 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:23:24.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.085 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:24.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:24.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:24.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:23:24.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:23:24.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:23:24.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:23:24.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:23:24.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:23:24.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:23:24.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:23:24.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:23:24.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:23:24.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:23:24.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:23:24.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:23:24.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:23:24.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:23:24.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:23:24.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.089 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.089 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.089 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:24.089 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:24.089 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.033518299999997, 2024-04-26T10:23:24.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:23:24.089 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.089 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.090 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.090 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:23:24.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.090 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:24.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:24.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:23:24.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:24.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:23:24.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:23:24.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:23:24.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:23:24.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:23:24.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:23:24.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.092 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:23:24.092 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:23:24.092 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.092 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.092 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:23:24.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:23:24.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:23:24.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:23:24.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:23:24.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:23:24.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:23:24.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:23:24.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:23:24.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:23:24.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:23:24.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:23:24.095 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.095 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.095 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.095 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:24.095 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:24.095 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 60.033332375999997, 2024-04-26T10:23:24.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:23:24.095 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.095 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:23:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.096 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:23:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:23:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:23:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:23:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:23:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:23:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:23:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:23:24.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:23:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:23:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:23:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:23:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:23:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:23:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:23:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:23:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:23:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:23:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:23:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:23:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:23:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.943309759999998, 2024-04-26T10:23:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:23:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.101 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:23:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.102 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:24.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:24.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:23:24.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:23:24.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:23:24.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:23:24.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:23:24.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:23:24.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:23:24.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:23:24.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:24.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:23:24.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:23:24.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:23:24.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:23:24.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:23:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:23:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:23:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:23:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:23:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:23:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:23:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:23:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:23:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:23:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:23:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:23:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.920207513999998, 2024-04-26T10:23:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:23:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.108 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:23:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:24.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:23:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:23:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:23:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:23:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:23:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:23:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:23:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:23:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:23:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:23:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:23:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:23:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:23:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:23:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:23:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:23:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:23:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:23:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:23:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:23:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:23:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:23:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:23:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:23:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:23:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:24.114 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.913524375999998, 2024-04-26T10:23:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:23:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:23:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:23:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:23:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:23:24.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:23:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:23:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:23:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:23:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:23:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:23:24.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:23:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:23:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:23:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:23:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:23:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:23:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:23:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:23:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:23:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:23:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:23:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:23:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:23:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:23:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:23:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:23:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.120 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.911526590999998, 2024-04-26T10:23:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:23:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.121 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:23:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:23:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:23:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:23:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:23:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:23:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:23:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:23:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:23:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:23:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:23:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:24.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:23:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:23:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:23:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:23:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:23:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:23:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:23:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:23:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:23:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:23:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:23:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:23:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:23:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:23:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.902117885999999, 2024-04-26T10:23:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:23:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:23:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:23:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:23:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:23:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:23:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:23:24.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:23:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:23:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:23:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:23:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:23:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:23:24.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:23:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:23:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:23:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:23:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:23:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:23:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:23:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:23:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:23:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:23:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:23:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:23:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:23:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.900289837000003, 2024-04-26T10:23:24.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:23:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:23:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:24.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:23:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.136 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:23:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:23:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:23:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:23:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:23:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:23:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:23:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:23:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:23:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:23:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:23:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:23:24.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:23:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:23:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:23:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:23:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:23:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:23:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:23:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:23:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:23:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:23:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:23:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:23:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.888710115000002, 2024-04-26T10:23:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:23:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.141 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:23:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.142 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:23:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:23:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:23:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:23:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:23:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:23:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:23:24.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:23:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:23:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:23:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:23:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:23:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:23:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:23:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:23:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:23:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:23:24.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:23:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:23:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:23:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:23:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:23:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:23:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:23:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.882299621000001, 2024-04-26T10:23:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:23:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.148 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:23:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:24.149 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:23:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:23:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:23:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.150 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:23:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:23:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:23:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:23:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:23:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.151 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:23:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:23:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:23:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:23:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:23:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:23:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.152 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:23:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:23:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:23:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:23:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:23:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:23:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.153 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:23:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:23:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:23:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:23:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.154 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.869714557999998, 2024-04-26T10:23:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:23:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:23:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.155 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:23:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.156 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:23:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:23:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:23:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:23:24.157 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:23:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:23:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:23:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:23:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.158 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:23:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:23:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:23:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:23:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:23:24.159 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:23:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:23:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:23:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:23:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:23:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.160 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:23:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:23:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:23:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:23:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:24.161 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.869479624999997, 2024-04-26T10:23:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:23:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:23:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:24.162 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:23:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.163 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:23:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:23:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:23:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:23:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:23:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:23:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.164 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:23:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:23:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:23:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:23:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:23:24.165 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:23:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:23:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:23:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:23:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.166 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:23:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:23:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:23:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:23:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.167 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:23:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:23:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:23:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:23:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.168 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.831604747999997, 2024-04-26T10:23:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:23:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:23:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.169 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:23:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:24.170 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:23:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:23:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:23:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:23:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:23:24.171 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:23:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:23:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:23:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:23:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.172 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:23:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:23:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:23:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:23:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:23:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:23:24.173 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:23:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:23:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:23:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:23:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:23:24.174 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:23:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:23:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:23:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.831159722999999, 2024-04-26T10:23:24.175 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:23:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:23:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.176 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:23:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:23:24.177 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:23:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:23:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:23:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:23:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:23:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.178 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:23:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:23:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:23:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:23:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:23:24.179 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:23:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:23:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:23:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:23:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:23:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:23:24.180 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:23:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:23:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:23:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:23:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:23:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.181 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:23:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:23:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.819556722999998, 2024-04-26T10:23:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:23:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.182 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:23:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.183 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:23:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:23:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:23:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.184 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:23:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:23:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:23:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:23:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:23:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:23:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.185 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:23:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:23:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:23:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:23:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.186 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:23:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:23:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:23:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:23:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:23:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:23:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.187 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:23:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:23:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:23:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:23:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:23:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:23:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.188 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.818283133000001, 2024-04-26T10:23:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:23:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:23:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.189 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.190 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:23:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:23:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:23:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:23:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:23:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.191 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:23:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:23:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:23:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:23:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:23:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:23:24.192 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:23:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:23:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:23:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:23:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:23:24.193 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:23:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:23:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:23:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:23:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:23:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.194 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:23:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:23:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:23:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:23:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:24.195 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.801525832000003, 2024-04-26T10:23:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:23:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:23:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:24.196 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:23:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.197 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:23:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:23:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:23:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:23:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:23:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:23:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.198 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:23:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:23:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:23:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:23:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:23:24.199 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:23:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:23:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:23:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:23:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:23:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.200 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:23:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:23:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:23:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:23:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:23:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:23:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.201 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:23:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:23:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 34.756613811000001, 2024-04-26T10:23:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:23:24.202 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:23:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.203 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:23:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.204 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:23:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:23:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:23:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:23:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:23:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:23:24.205 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:23:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:23:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:23:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:23:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:23:24.206 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:23:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:23:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:23:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:23:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:23:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.207 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:23:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:23:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:23:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:23:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:23:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:23:24.208 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:23:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:23:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.209 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.209 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:24.210 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:24.206+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:24.211 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:24.311 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:24.310+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:24.323 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:23:24.339 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:24.339 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:24.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.339 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:242528 5.8 5:1d8e4788:::benchmark_data_smithi052_19421_object113056:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.339 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:24.333373+0000", 2024-04-26T10:23:24.339 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0054223630000000004, 2024-04-26T10:23:24.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0054475189999999996, 2024-04-26T10:23:24.339 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.339 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:24.339 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.339 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.340 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.340 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 242528 2024-04-26T10:23:24.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.340 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.333373+0000", 2024-04-26T10:23:24.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.333373+0000", 2024-04-26T10:23:24.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.333372+0000", 2024-04-26T10:23:24.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.333378+0000", 2024-04-26T10:23:24.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.392e-06 2024-04-26T10:23:24.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.333389+0000", 2024-04-26T10:23:24.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0937e-05 2024-04-26T10:23:24.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.333404+0000", 2024-04-26T10:23:24.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5339e-05 2024-04-26T10:23:24.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.334705+0000", 2024-04-26T10:23:24.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0013005250000000001 2024-04-26T10:23:24.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.334775+0000", 2024-04-26T10:23:24.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9616999999999994e-05 2024-04-26T10:23:24.343 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.343 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.343 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.343 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:242532 5.8 5:1a1b2569:::benchmark_data_smithi052_19421_object113060:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.343 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:24.334030+0000", 2024-04-26T10:23:24.343 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0047650669999999996, 2024-04-26T10:23:24.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0048639379999999999, 2024-04-26T10:23:24.343 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.344 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:24.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.344 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 242532 2024-04-26T10:23:24.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.344 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.334030+0000", 2024-04-26T10:23:24.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.334030+0000", 2024-04-26T10:23:24.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.334029+0000", 2024-04-26T10:23:24.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.334034+0000", 2024-04-26T10:23:24.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0340000000000004e-06 2024-04-26T10:23:24.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.334044+0000", 2024-04-26T10:23:24.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0030000000000001e-05 2024-04-26T10:23:24.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.334052+0000", 2024-04-26T10:23:24.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3560000000000004e-06 2024-04-26T10:23:24.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.336211+0000", 2024-04-26T10:23:24.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021589230000000001 2024-04-26T10:23:24.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.336379+0000", 2024-04-26T10:23:24.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016817199999999999 2024-04-26T10:23:24.347 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.347 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.347 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.347 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:242534 5.b 5:d77ff08a:::benchmark_data_smithi052_19421_object113062:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.348 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:24.334478+0000", 2024-04-26T10:23:24.348 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0043173919999999998, 2024-04-26T10:23:24.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004482382, 2024-04-26T10:23:24.348 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.348 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:24.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.348 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.348 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 242534 2024-04-26T10:23:24.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.348 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.334478+0000", 2024-04-26T10:23:24.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.334478+0000", 2024-04-26T10:23:24.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.349 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.349 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.334477+0000", 2024-04-26T10:23:24.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.334483+0000", 2024-04-26T10:23:24.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.9789999999999998e-06 2024-04-26T10:23:24.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.334496+0000", 2024-04-26T10:23:24.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3410999999999999e-05 2024-04-26T10:23:24.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.334503+0000", 2024-04-26T10:23:24.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2629999999999997e-06 2024-04-26T10:23:24.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.334549+0000", 2024-04-26T10:23:24.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5420000000000002e-05 2024-04-26T10:23:24.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.334744+0000", 2024-04-26T10:23:24.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194787 2024-04-26T10:23:24.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:24.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.334889+0000", 2024-04-26T10:23:24.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014533300000000001 2024-04-26T10:23:24.352 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.352 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.352 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.352 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:242538 5.8 5:15ba850b:::benchmark_data_smithi052_19421_object113066:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.352 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:24.335131+0000", 2024-04-26T10:23:24.353 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0036641479999999999, 2024-04-26T10:23:24.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0039134520000000004, 2024-04-26T10:23:24.353 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.353 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:24.353 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.353 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.353 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.353 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 242538 2024-04-26T10:23:24.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.353 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.335131+0000", 2024-04-26T10:23:24.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.335131+0000", 2024-04-26T10:23:24.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.335130+0000", 2024-04-26T10:23:24.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.335135+0000", 2024-04-26T10:23:24.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0830000000000003e-06 2024-04-26T10:23:24.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.335150+0000", 2024-04-26T10:23:24.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4976e-05 2024-04-26T10:23:24.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.355 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.335157+0000", 2024-04-26T10:23:24.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9380000000000003e-06 2024-04-26T10:23:24.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.338403+0000", 2024-04-26T10:23:24.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.003245628 2024-04-26T10:23:24.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.338526+0000", 2024-04-26T10:23:24.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000122853 2024-04-26T10:23:24.356 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.356 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.356 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.357 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:242540 5.8 5.6aca59e8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.357 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:24.335621+0000", 2024-04-26T10:23:24.357 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0031742020000000001, 2024-04-26T10:23:24.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0034873450000000002, 2024-04-26T10:23:24.357 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.357 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:24.357 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.357 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.357 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.357 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 242540 2024-04-26T10:23:24.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.357 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.335621+0000", 2024-04-26T10:23:24.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.335621+0000", 2024-04-26T10:23:24.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.335620+0000", 2024-04-26T10:23:24.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.335626+0000", 2024-04-26T10:23:24.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.579e-06 2024-04-26T10:23:24.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.335637+0000", 2024-04-26T10:23:24.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0096e-05 2024-04-26T10:23:24.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.335644+0000", 2024-04-26T10:23:24.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:23:24.360 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.360 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.360 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.360 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:242541 5.0 e68/54 5:02a6c890:::benchmark_data_smithi052_19421_object113069:head v 68'15189, mlcod=68'15187)", 2024-04-26T10:23:24.360 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:24.337190+0000", 2024-04-26T10:23:24.360 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0016051310000000001, 2024-04-26T10:23:24.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0019791650000000002, 2024-04-26T10:23:24.360 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.360 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:24.361 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.337190+0000", 2024-04-26T10:23:24.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.361 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.337190+0000", 2024-04-26T10:23:24.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.361 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.337189+0000", 2024-04-26T10:23:24.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.337197+0000", 2024-04-26T10:23:24.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.1670000000000002e-06 2024-04-26T10:23:24.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.337218+0000", 2024-04-26T10:23:24.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.1172e-05 2024-04-26T10:23:24.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.337225+0000", 2024-04-26T10:23:24.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9380000000000003e-06 2024-04-26T10:23:24.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.338389+0000", 2024-04-26T10:23:24.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0011645589999999999 2024-04-26T10:23:24.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.338405+0000", 2024-04-26T10:23:24.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5556000000000001e-05 2024-04-26T10:23:24.364 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.364 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.364 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.364 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:242544 5.b 5:da470188:::benchmark_data_smithi052_19421_object113072:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.364 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:24.337517+0000", 2024-04-26T10:23:24.364 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0012782480000000001, 2024-04-26T10:23:24.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0017122319999999999, 2024-04-26T10:23:24.365 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.365 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:24.365 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.365 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.365 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.365 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 242544 2024-04-26T10:23:24.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.365 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.337517+0000", 2024-04-26T10:23:24.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.337517+0000", 2024-04-26T10:23:24.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.337516+0000", 2024-04-26T10:23:24.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.366 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.366 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.337522+0000", 2024-04-26T10:23:24.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6710000000000004e-06 2024-04-26T10:23:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.337531+0000", 2024-04-26T10:23:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6840000000000008e-06 2024-04-26T10:23:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.337543+0000", 2024-04-26T10:23:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1218e-05 2024-04-26T10:23:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.337723+0000", 2024-04-26T10:23:24.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018066600000000001 2024-04-26T10:23:24.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.337866+0000", 2024-04-26T10:23:24.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014243200000000001 2024-04-26T10:23:24.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:24.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.338015+0000", 2024-04-26T10:23:24.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014981400000000001 2024-04-26T10:23:24.369 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.369 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.369 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.369 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:242522 5.8 5:1ed67c2f:::benchmark_data_smithi052_19421_object113050:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.369 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:24.330708+0000", 2024-04-26T10:23:24.369 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.008087271, 2024-04-26T10:23:24.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0085938000000000004, 2024-04-26T10:23:24.370 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.370 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:24.370 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.370 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.370 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.370 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 242522 2024-04-26T10:23:24.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.370 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.330708+0000", 2024-04-26T10:23:24.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.330708+0000", 2024-04-26T10:23:24.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.371 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.371 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.330707+0000", 2024-04-26T10:23:24.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.330712+0000", 2024-04-26T10:23:24.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9030000000000003e-06 2024-04-26T10:23:24.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.330722+0000", 2024-04-26T10:23:24.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0208e-05 2024-04-26T10:23:24.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.330730+0000", 2024-04-26T10:23:24.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8280000000000003e-06 2024-04-26T10:23:24.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.332755+0000", 2024-04-26T10:23:24.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002025191 2024-04-26T10:23:24.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:24.332891+0000", 2024-04-26T10:23:24.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013609399999999999 2024-04-26T10:23:24.374 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.374 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.374 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.374 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.374 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:23:24.374 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 8 2024-04-26T10:23:24.374 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:24.375 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:24.412 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:24.410+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:24.498 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:24.498 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:24.498 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:23:24.499 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:23:24.499 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:24.510 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:24.513 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:24.507+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:24.614 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:24.611+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:24.677 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:23:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:23:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.677 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.145085046999995, 2024-04-26T10:23:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:23:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:23:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.678 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.679 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:23:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:23:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:23:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:23:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:23:24.680 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:23:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:23:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:23:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:23:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:23:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:23:24.681 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:23:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:23:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:23:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:23:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.682 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:23:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:23:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.143102819999996, 2024-04-26T10:23:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:23:24.683 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:23:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.684 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:23:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:23:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.685 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:23:24.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:23:24.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:23:24.686 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:23:24.686 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.686 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.686 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.686 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:23:24.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:23:24.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:23:24.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:23:24.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.687 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.687 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:23:24.687 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:23:24.687 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.687 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:23:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:23:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:23:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:23:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:23:24.688 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:23:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.142903435999997, 2024-04-26T10:23:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:23:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.689 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:23:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:24.690 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:23:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:23:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.691 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:23:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:23:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:23:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:23:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:23:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:23:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.692 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:23:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:23:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:23:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:23:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:23:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:23:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.693 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:23:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:23:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:23:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.142684815999999, 2024-04-26T10:23:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:23:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.694 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:23:24.695 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:23:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:23:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:23:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:23:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:23:24.696 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:23:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:23:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:23:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:23:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:23:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:23:24.697 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:23:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:23:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:23:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.140313378000002, 2024-04-26T10:23:24.698 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:23:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:23:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:23:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:23:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:23:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.700 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:23:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:23:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:23:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:23:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:23:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:23:24.701 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:23:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:23:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:23:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:23:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:23:24.702 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:23:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:23:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.140212755999997, 2024-04-26T10:23:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:23:24.703 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:23:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.704 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:23:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:23:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:23:24.705 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:23:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:23:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:23:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:23:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.706 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:23:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:23:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:23:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:23:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:23:24.707 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:23:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:23:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:23:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:23:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:23:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.708 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:23:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.140094195000003, 2024-04-26T10:23:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:23:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.709 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:23:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.710 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:23:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:23:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:23:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:23:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:23:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:23:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.711 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:23:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:23:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:23:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:23:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:23:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:23:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.712 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:23:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:23:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.139991796999993, 2024-04-26T10:23:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:23:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.713 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:23:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.714 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:23:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:23:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:23:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:23:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:23:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.715 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:23:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:23:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:23:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:23:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:23:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:24.716 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:23:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:23:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:23:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:23:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:23:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:23:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.717 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.138971240000004, 2024-04-26T10:23:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:23:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:23:24.718 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.719 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:23:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:23:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:23:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.720 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:23:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:23:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:23:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:23:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:23:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:23:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.721 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:23:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:23:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:23:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:23:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:23:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:23:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.722 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:23:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:23:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 84.137820965000003, 2024-04-26T10:23:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:23:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.723 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:23:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.724 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:23:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:23:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:23:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:23:24.725 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:23:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:23:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:23:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:23:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:23:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.726 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:23:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:23:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:23:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:23:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:23:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:23:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.727 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:23:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:23:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:24.728 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.641121722999998, 2024-04-26T10:23:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:23:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:23:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.729 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:23:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:23:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:23:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.730 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:23:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:23:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:23:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:23:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:23:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:23:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.731 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:23:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:23:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:23:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:23:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:23:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:23:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.732 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:23:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:23:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:23:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:23:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:23:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:23:24.733 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 60.640898127, 2024-04-26T10:23:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:23:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.734 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:23:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.735 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:23:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:23:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:23:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:23:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:23:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.736 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:23:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:23:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:23:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:23:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:23:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:23:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.737 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:23:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:23:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:23:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:23:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:23:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:23:24.738 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:23:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:23:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:23:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:23:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.739 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 53.610051806999998, 2024-04-26T10:23:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:23:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:23:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:24.740 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:23:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:23:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:23:24.741 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:23:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:23:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:23:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:23:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:23:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:23:24.742 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:23:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:23:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:23:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:23:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:23:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:23:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.743 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:23:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:23:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:23:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:23:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:23:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:23:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.744 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 53.608040703999997, 2024-04-26T10:23:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:23:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:23:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.745 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.746 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:23:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:23:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:23:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:23:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:23:24.747 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:23:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:23:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:23:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:23:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:23:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:23:24.748 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:23:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:23:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:23:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:23:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:23:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:23:24.749 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:23:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:23:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:23:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 53.597162599000001, 2024-04-26T10:23:24.750 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:23:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:23:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.751 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:23:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:23:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:23:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.752 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:23:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:23:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:23:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:23:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:23:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:23:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.753 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:23:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:23:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:23:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:23:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:23:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:23:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.754 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:23:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:23:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:23:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:23:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:23:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:23:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.755 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 53.594481379999998, 2024-04-26T10:23:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:23:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:23:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.756 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:23:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.757 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:23:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:23:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:23:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:23:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:23:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:23:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.758 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:23:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:23:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:23:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:23:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:24.759 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:23:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:23:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:23:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:23:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:23:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:23:24.760 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:23:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:23:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:23:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:23:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.761 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 53.594114304999998, 2024-04-26T10:23:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:23:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:23:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.762 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:23:24.763 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:23:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:23:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:23:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:23:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:23:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:23:24.764 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:23:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:23:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:23:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:23:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:23:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:23:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.765 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:23:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:23:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:23:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:23:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:24.766 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 53.594050052999997, 2024-04-26T10:23:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:23:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:23:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:24.767 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:23:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:23:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:23:24.768 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:23:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:23:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:23:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:23:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:23:24.769 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:23:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:23:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:23:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:23:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:23:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:23:24.770 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:23:24.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.771 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.771 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:23:24.771 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:23:24.771 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.771 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.771 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.771 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.771 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.771 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:24.771 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:24.771 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 53.589651379999999, 2024-04-26T10:23:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:23:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:23:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.772 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:24.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:23:24.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.773 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.773 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:23:24.773 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:23:24.773 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.773 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:23:24.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:23:24.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:23:24.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:23:24.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.774 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.774 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.774 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:23:24.774 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:23:24.774 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:23:24.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:23:24.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:24.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:23:24.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:23:24.775 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.775 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.775 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.775 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:23:24.775 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:23:24.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.776 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.776 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:23:24.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:23:24.776 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.776 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.776 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.776 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.776 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.776 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:24.776 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:24.776 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 53.587893397000002, 2024-04-26T10:23:24.776 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:23:24.777 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:24.777 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:24.777 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:24.777 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:24.777 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.777 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:23:24.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.777 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:24.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.777 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:24.777 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:24.777 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.777 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.777 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:24.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:24.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:24.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:24.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:23:24.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.778 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.778 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:24.778 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:23:24.778 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:23:24.778 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:24.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:23:24.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:23:24.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:23:24.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:23:24.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.779 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.779 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:24.779 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:23:24.779 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:23:24.779 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:24.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:23:24.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:23:24.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:24.780 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:23:24.780 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:23:24.780 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.780 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.780 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:23:24.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:23:24.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:24.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:23:24.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:23:24.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.781 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:24.781 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:23:24.781 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:23:24.781 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:24.781 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:24.782 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:24.782 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:23:24.782 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:23:24.782 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.782 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.782 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.782 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:24.782 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:24.782 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:24.783 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:24.779+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:24.784 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:24.884 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:24.882+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:24.918 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:24.918 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:24.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.918 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:243892 5.4 5:22f9b673:::benchmark_data_smithi052_19421_object114420:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.918 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:24.909070+0000", 2024-04-26T10:23:24.919 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0071353500000000004, 2024-04-26T10:23:24.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071586469999999998, 2024-04-26T10:23:24.919 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.919 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:24.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.919 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.919 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 243892 2024-04-26T10:23:24.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.919 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909070+0000", 2024-04-26T10:23:24.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909070+0000", 2024-04-26T10:23:24.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909069+0000", 2024-04-26T10:23:24.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909074+0000", 2024-04-26T10:23:24.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4309999999999996e-06 2024-04-26T10:23:24.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909083+0000", 2024-04-26T10:23:24.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3610000000000007e-06 2024-04-26T10:23:24.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909090+0000", 2024-04-26T10:23:24.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9600000000000003e-06 2024-04-26T10:23:24.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909222+0000", 2024-04-26T10:23:24.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132018 2024-04-26T10:23:24.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909328+0000", 2024-04-26T10:23:24.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105704 2024-04-26T10:23:24.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909388+0000", 2024-04-26T10:23:24.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0485000000000001e-05 2024-04-26T10:23:24.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.911594+0000", 2024-04-26T10:23:24.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022057840000000001 2024-04-26T10:23:24.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:24.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916188+0000", 2024-04-26T10:23:24.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045936520000000002 2024-04-26T10:23:24.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.923 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.923 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:243893 5.d 5:bee56ba5:::benchmark_data_smithi052_19421_object114421:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.923 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:24.909103+0000", 2024-04-26T10:23:24.924 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0071025469999999999, 2024-04-26T10:23:24.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0072219670000000001, 2024-04-26T10:23:24.924 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.924 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:24.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.924 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 243893 2024-04-26T10:23:24.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.924 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909103+0000", 2024-04-26T10:23:24.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909103+0000", 2024-04-26T10:23:24.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909102+0000", 2024-04-26T10:23:24.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909105+0000", 2024-04-26T10:23:24.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9409999999999999e-06 2024-04-26T10:23:24.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909112+0000", 2024-04-26T10:23:24.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6030000000000001e-06 2024-04-26T10:23:24.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909117+0000", 2024-04-26T10:23:24.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0359999999999997e-06 2024-04-26T10:23:24.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909495+0000", 2024-04-26T10:23:24.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00037815100000000002 2024-04-26T10:23:24.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909914+0000", 2024-04-26T10:23:24.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000418935 2024-04-26T10:23:24.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.910027+0000", 2024-04-26T10:23:24.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112697 2024-04-26T10:23:24.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.915045+0000", 2024-04-26T10:23:24.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050186220000000004 2024-04-26T10:23:24.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.928 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.928 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:243897 5.d 5:bc9d3065:::benchmark_data_smithi052_19421_object114425:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.928 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:24.909577+0000", 2024-04-26T10:23:24.928 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0066283269999999998, 2024-04-26T10:23:24.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068210450000000004, 2024-04-26T10:23:24.929 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.929 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:24.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.929 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.929 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 243897 2024-04-26T10:23:24.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.929 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909577+0000", 2024-04-26T10:23:24.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909577+0000", 2024-04-26T10:23:24.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909577+0000", 2024-04-26T10:23:24.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909579+0000", 2024-04-26T10:23:24.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4669999999999998e-06 2024-04-26T10:23:24.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909585+0000", 2024-04-26T10:23:24.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5010000000000004e-06 2024-04-26T10:23:24.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909589+0000", 2024-04-26T10:23:24.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4870000000000004e-06 2024-04-26T10:23:24.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.911640+0000", 2024-04-26T10:23:24.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002050727 2024-04-26T10:23:24.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.911794+0000", 2024-04-26T10:23:24.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015383199999999999 2024-04-26T10:23:24.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.911958+0000", 2024-04-26T10:23:24.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016432900000000001 2024-04-26T10:23:24.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.915053+0000", 2024-04-26T10:23:24.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030952520000000002 2024-04-26T10:23:24.933 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.933 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.933 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.933 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:243900 5.9 5:92b77512:::benchmark_data_smithi052_19421_object114428:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.933 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:24.909632+0000", 2024-04-26T10:23:24.933 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0065731959999999999, 2024-04-26T10:23:24.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0068377799999999999, 2024-04-26T10:23:24.933 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.934 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:24.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.934 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.934 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 243900 2024-04-26T10:23:24.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.934 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909632+0000", 2024-04-26T10:23:24.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909632+0000", 2024-04-26T10:23:24.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909632+0000", 2024-04-26T10:23:24.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909635+0000", 2024-04-26T10:23:24.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.7840000000000001e-06 2024-04-26T10:23:24.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909642+0000", 2024-04-26T10:23:24.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8809999999999998e-06 2024-04-26T10:23:24.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.909647+0000", 2024-04-26T10:23:24.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1749999999999996e-06 2024-04-26T10:23:24.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.911016+0000", 2024-04-26T10:23:24.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0013686340000000001 2024-04-26T10:23:24.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.911312+0000", 2024-04-26T10:23:24.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029576599999999999 2024-04-26T10:23:24.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.911428+0000", 2024-04-26T10:23:24.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011610100000000001 2024-04-26T10:23:24.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.913396+0000", 2024-04-26T10:23:24.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001968423 2024-04-26T10:23:24.938 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.938 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.938 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.938 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:243901 5.d 5:b7f1f472:::benchmark_data_smithi052_19421_object114429:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.938 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:24.910972+0000", 2024-04-26T10:23:24.939 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0052336860000000004, 2024-04-26T10:23:24.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055687269999999999, 2024-04-26T10:23:24.939 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.939 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:24.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.939 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.939 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 243901 2024-04-26T10:23:24.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.939 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.910972+0000", 2024-04-26T10:23:24.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.910972+0000", 2024-04-26T10:23:24.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.910971+0000", 2024-04-26T10:23:24.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.910976+0000", 2024-04-26T10:23:24.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.524e-06 2024-04-26T10:23:24.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.911062+0000", 2024-04-26T10:23:24.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5647000000000002e-05 2024-04-26T10:23:24.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.911069+0000", 2024-04-26T10:23:24.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5329999999999997e-06 2024-04-26T10:23:24.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.913452+0000", 2024-04-26T10:23:24.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002382992 2024-04-26T10:23:24.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.913596+0000", 2024-04-26T10:23:24.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000143449 2024-04-26T10:23:24.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:24.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.913736+0000", 2024-04-26T10:23:24.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000139715 2024-04-26T10:23:24.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:24.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.915343+0000", 2024-04-26T10:23:24.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0016070979999999999 2024-04-26T10:23:24.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.943 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.943 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:243903 5.3 5:ca4dd246:::benchmark_data_smithi052_19421_object114431:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.943 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:24.913578+0000", 2024-04-26T10:23:24.943 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002627557, 2024-04-26T10:23:24.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0030321430000000002, 2024-04-26T10:23:24.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:24.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.944 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 243903 2024-04-26T10:23:24.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.944 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.913578+0000", 2024-04-26T10:23:24.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.913578+0000", 2024-04-26T10:23:24.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.913577+0000", 2024-04-26T10:23:24.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.913583+0000", 2024-04-26T10:23:24.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5820000000000001e-06 2024-04-26T10:23:24.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.913601+0000", 2024-04-26T10:23:24.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8328000000000001e-05 2024-04-26T10:23:24.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.913609+0000", 2024-04-26T10:23:24.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9670000000000001e-06 2024-04-26T10:23:24.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.914126+0000", 2024-04-26T10:23:24.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00051679899999999997 2024-04-26T10:23:24.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.914341+0000", 2024-04-26T10:23:24.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000215508 2024-04-26T10:23:24.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.947 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.947 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:243905 5.6 5:6fae1d01:::benchmark_data_smithi052_19421_object114433:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.947 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:24.914428+0000", 2024-04-26T10:23:24.947 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.001777427, 2024-04-26T10:23:24.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022472130000000001, 2024-04-26T10:23:24.948 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.948 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:24.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.948 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 243905 2024-04-26T10:23:24.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.948 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.914428+0000", 2024-04-26T10:23:24.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.914428+0000", 2024-04-26T10:23:24.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.914427+0000", 2024-04-26T10:23:24.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.914431+0000", 2024-04-26T10:23:24.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8290000000000001e-06 2024-04-26T10:23:24.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.914438+0000", 2024-04-26T10:23:24.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8240000000000002e-06 2024-04-26T10:23:24.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.914443+0000", 2024-04-26T10:23:24.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6160000000000004e-06 2024-04-26T10:23:24.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.914473+0000", 2024-04-26T10:23:24.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9998e-05 2024-04-26T10:23:24.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.914546+0000", 2024-04-26T10:23:24.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3057000000000002e-05 2024-04-26T10:23:24.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.951 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.951 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.951 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:243907 5.6 5:61f7e5c7:::benchmark_data_smithi052_19421_object114435:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.951 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:24.915895+0000", 2024-04-26T10:23:24.951 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00031022299999999999, 2024-04-26T10:23:24.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00084374700000000005, 2024-04-26T10:23:24.952 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.952 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:24.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.952 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.952 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 243907 2024-04-26T10:23:24.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.952 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.915895+0000", 2024-04-26T10:23:24.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.915895+0000", 2024-04-26T10:23:24.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.915894+0000", 2024-04-26T10:23:24.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:24.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.915900+0000", 2024-04-26T10:23:24.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.772e-06 2024-04-26T10:23:24.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.915912+0000", 2024-04-26T10:23:24.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2223e-05 2024-04-26T10:23:24.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.915919+0000", 2024-04-26T10:23:24.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4449999999999999e-06 2024-04-26T10:23:24.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.915963+0000", 2024-04-26T10:23:24.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3594000000000003e-05 2024-04-26T10:23:24.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916120+0000", 2024-04-26T10:23:24.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000156494 2024-04-26T10:23:24.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.955 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.955 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.955 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:243908 5.c 5:345dff6b:::benchmark_data_smithi052_19421_object114436:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.955 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:24.916610+0000", 2024-04-26T10:23:24.956 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9995952, 2024-04-26T10:23:24.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018841100000000001, 2024-04-26T10:23:24.956 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.956 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-04-26T10:23:24.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.956 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.956 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 243908 2024-04-26T10:23:24.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.956 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916610+0000", 2024-04-26T10:23:24.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916610+0000", 2024-04-26T10:23:24.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916609+0000", 2024-04-26T10:23:24.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:24.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916613+0000", 2024-04-26T10:23:24.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1799999999999998e-06 2024-04-26T10:23:24.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916629+0000", 2024-04-26T10:23:24.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5017999999999999e-05 2024-04-26T10:23:24.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916633+0000", 2024-04-26T10:23:24.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6280000000000004e-06 2024-04-26T10:23:24.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916683+0000", 2024-04-26T10:23:24.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9913999999999997e-05 2024-04-26T10:23:24.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.959 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.959 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.959 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:243909 5.1 5:864bba45:::benchmark_data_smithi052_19421_object114437:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.959 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:24.916641+0000", 2024-04-26T10:23:24.959 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9995642, 2024-04-26T10:23:24.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00021254499999999999, 2024-04-26T10:23:24.959 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.959 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:24.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.959 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.959 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 243909 2024-04-26T10:23:24.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.960 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916641+0000", 2024-04-26T10:23:24.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916641+0000", 2024-04-26T10:23:24.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916641+0000", 2024-04-26T10:23:24.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916643+0000", 2024-04-26T10:23:24.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8950000000000001e-06 2024-04-26T10:23:24.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916650+0000", 2024-04-26T10:23:24.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1770000000000001e-06 2024-04-26T10:23:24.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916653+0000", 2024-04-26T10:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9960000000000002e-06 2024-04-26T10:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916695+0000", 2024-04-26T10:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2539e-05 2024-04-26T10:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916834+0000", 2024-04-26T10:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013853800000000001 2024-04-26T10:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.962 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.963 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:243910 5.c 5.c8e4082c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.963 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:24.916661+0000", 2024-04-26T10:23:24.963 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9995446, 2024-04-26T10:23:24.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00024998199999999999, 2024-04-26T10:23:24.963 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.963 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:24.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.963 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 243910 2024-04-26T10:23:24.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.963 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916661+0000", 2024-04-26T10:23:24.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916661+0000", 2024-04-26T10:23:24.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916661+0000", 2024-04-26T10:23:24.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916663+0000", 2024-04-26T10:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.79e-06 2024-04-26T10:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916669+0000", 2024-04-26T10:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5520000000000004e-06 2024-04-26T10:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916673+0000", 2024-04-26T10:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4850000000000003e-06 2024-04-26T10:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.965 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.966 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:243911 5.4 5.39737034 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.966 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:24.916683+0000", 2024-04-26T10:23:24.966 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9995222, 2024-04-26T10:23:24.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00027747699999999999, 2024-04-26T10:23:24.966 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.966 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:24.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.966 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.966 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 243911 2024-04-26T10:23:24.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.966 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916683+0000", 2024-04-26T10:23:24.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916683+0000", 2024-04-26T10:23:24.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916683+0000", 2024-04-26T10:23:24.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916686+0000", 2024-04-26T10:23:24.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.6860000000000002e-06 2024-04-26T10:23:24.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916691+0000", 2024-04-26T10:23:24.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4990000000000002e-06 2024-04-26T10:23:24.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916696+0000", 2024-04-26T10:23:24.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2320000000000003e-06 2024-04-26T10:23:24.968 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.968 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.968 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.969 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:243912 5.9 5:95801943:::benchmark_data_smithi052_19421_object114440:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-04-26T10:23:24.969 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:24.916768+0000", 2024-04-26T10:23:24.969 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9994369, 2024-04-26T10:23:24.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000243427, 2024-04-26T10:23:24.969 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:24.969 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-04-26T10:23:24.969 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:24.969 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:24.969 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:24.969 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 243912 2024-04-26T10:23:24.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.969 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:24.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:24.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916768+0000", 2024-04-26T10:23:24.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:24.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916768+0000", 2024-04-26T10:23:24.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:24.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:24.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916768+0000", 2024-04-26T10:23:24.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:24.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:24.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916772+0000", 2024-04-26T10:23:24.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0040000000000001e-06 2024-04-26T10:23:24.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:24.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916783+0000", 2024-04-26T10:23:24.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1534e-05 2024-04-26T10:23:24.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:24.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916798+0000", 2024-04-26T10:23:24.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5119e-05 2024-04-26T10:23:24.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:24.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:24.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:24.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:24.916931+0000", 2024-04-26T10:23:24.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000132304 2024-04-26T10:23:24.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.972 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:24.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.972 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:24.972 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:23:24.972 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 13 2024-04-26T10:23:24.972 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:24.973 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:24.985 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:24.982+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:25.086 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:25.079+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:25.105 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:25.106 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:25.106 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:23:25.106 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:23:25.106 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:25.119 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:25.187 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:25.186+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:25.256 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:25.256 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:23:25.256 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:23:25.256 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:25.256 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.256 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:25.256 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:25.256 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.214516611000001, 2024-04-26T10:23:25.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:23:25.257 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.257 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.257 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.257 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:23:25.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.257 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.257 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.257 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.257 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:25.257 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.257 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:25.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:25.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:25.258 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.258 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.258 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.258 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:23:25.258 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:23:25.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:23:25.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:23:25.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.259 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:23:25.259 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:23:25.259 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.259 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.259 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:23:25.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:23:25.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:23:25.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:23:25.260 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.260 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.260 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.260 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:23:25.260 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:23:25.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:23:25.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:23:25.261 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.261 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.261 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.261 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:23:25.261 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:23:25.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.261 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.261 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.262 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.262 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:25.262 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:25.262 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.214407360000003, 2024-04-26T10:23:25.262 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:23:25.262 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.262 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.262 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.262 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:23:25.262 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.263 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:25.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:25.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.263 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.263 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.263 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.263 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:25.263 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:25.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:23:25.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:23:25.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.264 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:23:25.264 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:23:25.264 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.264 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.264 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:23:25.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:23:25.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:23:25.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:23:25.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.265 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.265 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:23:25.265 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:23:25.265 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.265 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:23:25.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:23:25.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:23:25.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:23:25.266 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.266 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.266 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.266 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:23:25.266 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:23:25.266 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.267 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.267 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.267 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.267 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.267 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:25.267 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:25.267 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.212009948000002, 2024-04-26T10:23:25.267 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:23:25.267 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.268 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.268 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.268 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.268 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.268 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:23:25.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.268 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.268 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.268 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:25.268 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.268 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.268 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:25.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:23:25.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:25.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.269 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.269 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:23:25.269 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:23:25.269 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.269 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:23:25.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:23:25.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:23:25.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:23:25.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.270 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.270 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.270 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:23:25.270 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:23:25.270 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:23:25.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:23:25.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:25.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:23:25.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:23:25.271 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.271 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.271 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.271 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:23:25.271 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:23:25.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:25.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:23:25.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:23:25.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:23:25.272 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:23:25.272 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.272 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.272 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.272 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:23:25.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:23:25.273 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.273 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.273 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.273 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.273 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.273 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:25.273 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:25.273 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 61.211824024000002, 2024-04-26T10:23:25.273 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:23:25.273 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.273 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.273 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.274 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.274 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.274 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:23:25.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.274 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.274 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:25.274 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.274 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.274 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.274 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:25.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:23:25.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:25.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.275 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:23:25.275 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:23:25.275 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.275 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.275 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:23:25.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:23:25.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:23:25.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:23:25.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.276 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:23:25.276 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:23:25.276 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.276 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.276 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:23:25.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:23:25.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:25.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:23:25.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:23:25.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.277 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.277 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:23:25.277 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:23:25.277 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.277 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:25.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:23:25.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:23:25.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:23:25.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:23:25.278 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.278 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.278 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.278 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:23:25.278 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:23:25.278 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.279 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.279 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.279 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.279 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.279 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:25.279 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:25.279 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.121801408000003, 2024-04-26T10:23:25.279 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:23:25.279 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.279 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.279 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:23:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.280 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:25.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:25.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.281 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.281 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.281 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:23:25.281 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:23:25.281 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:23:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:23:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:23:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:23:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:23:25.282 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:23:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:23:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:23:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:23:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:23:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:23:25.283 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:23:25.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:25.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:23:25.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:23:25.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:25.284 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:23:25.284 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:23:25.284 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.284 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.284 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:23:25.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:23:25.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:23:25.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:23:25.285 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.285 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.285 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.285 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:23:25.285 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:23:25.286 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.286 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.286 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.286 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.286 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.286 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:25.286 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:25.286 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.098699162000003, 2024-04-26T10:23:25.286 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:23:25.286 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.286 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.286 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.287 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.287 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:23:25.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.287 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:25.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.287 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.287 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.287 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.287 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:25.287 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:23:25.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:25.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.288 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:23:25.288 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:23:25.288 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.288 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.288 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:23:25.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:23:25.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:23:25.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:23:25.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.289 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.289 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.289 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:23:25.289 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:23:25.289 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:25.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:23:25.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:23:25.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:23:25.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:23:25.290 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.290 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.290 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.290 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:23:25.290 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:23:25.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:25.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:23:25.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:23:25.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:25.291 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:23:25.291 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:23:25.291 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.291 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.291 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:23:25.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:23:25.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:23:25.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:23:25.292 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.292 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.292 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.292 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:23:25.292 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:23:25.292 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.292 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.293 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.293 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.293 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:25.293 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:25.293 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.092016024000003, 2024-04-26T10:23:25.293 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:23:25.293 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.293 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.293 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.293 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.293 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.293 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:23:25.293 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.294 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:25.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:25.294 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.294 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.294 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.294 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.294 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:23:25.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:25.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:23:25.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:23:25.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.295 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:23:25.295 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:23:25.295 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.295 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.295 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:23:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:23:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:23:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:23:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:23:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:23:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.296 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:23:25.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:23:25.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:23:25.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:23:25.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.297 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:25.297 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:23:25.297 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:23:25.297 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.297 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:25.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:23:25.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:23:25.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:23:25.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:23:25.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.298 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.298 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.298 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:23:25.298 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:23:25.298 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.299 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.299 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:23:25.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:23:25.299 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.299 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.299 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.299 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.299 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.299 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:25.299 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:25.299 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.090018239000003, 2024-04-26T10:23:25.299 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:23:25.300 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.300 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.300 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.300 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:23:25.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.300 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.300 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.300 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.300 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:25.300 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.300 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:23:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:23:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:23:25.301 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:23:25.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:23:25.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:23:25.302 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:23:25.302 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.302 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.302 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.302 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:23:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:23:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:23:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:23:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:23:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.303 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:23:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:23:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:23:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:23:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:23:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:23:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.304 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:23:25.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:23:25.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:23:25.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:23:25.305 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.305 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.305 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.305 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:23:25.305 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:23:25.305 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.080609533999997, 2024-04-26T10:23:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:23:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:23:25.306 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.307 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:25.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:25.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.307 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.307 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.307 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.307 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:23:25.307 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:25.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:23:25.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:23:25.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.308 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:23:25.308 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:25.308 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.308 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.308 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:23:25.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:23:25.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:23:25.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:23:25.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.309 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:25.309 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:23:25.309 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:23:25.309 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.309 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:23:25.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:23:25.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:23:25.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:23:25.310 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.310 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.310 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:25.310 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:23:25.310 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:23:25.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:23:25.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:23:25.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:25.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:23:25.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:23:25.311 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.311 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.311 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.311 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:23:25.311 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:23:25.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.312 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.312 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:23:25.312 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:23:25.312 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.312 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.312 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.312 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.312 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.312 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:25.312 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:25.312 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.078781485, 2024-04-26T10:23:25.313 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:23:25.313 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.313 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.313 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.313 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.313 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.313 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:23:25.313 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.313 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.313 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.313 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.313 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:25.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:25.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.314 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.314 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.314 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:23:25.314 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:25.314 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:23:25.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:23:25.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:23:25.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:23:25.315 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.315 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.315 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.315 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:23:25.315 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:23:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:23:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:23:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:23:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:23:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.316 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:23:25.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:23:25.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:23:25.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:23:25.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:25.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:23:25.317 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:23:25.317 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.317 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.317 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:25.317 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:23:25.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:23:25.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:23:25.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:23:25.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.318 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.318 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:23:25.318 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:23:25.318 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.318 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.319 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.319 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:23:25.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:23:25.319 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.319 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.319 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.319 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.319 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.319 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:25.319 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:25.319 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.067201763, 2024-04-26T10:23:25.319 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:23:25.319 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.320 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.320 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.320 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.320 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.320 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:23:25.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.320 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:25.320 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.320 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.320 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.320 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.320 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:25.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:25.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:25.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.321 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.321 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:23:25.321 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:23:25.321 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.321 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:23:25.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:23:25.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:23:25.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:23:25.322 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.322 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.322 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.322 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:23:25.322 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:23:25.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:25.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:23:25.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:23:25.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:23:25.323 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:23:25.323 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.323 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.323 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.323 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:23:25.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:23:25.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:25.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:23:25.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:23:25.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.324 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:23:25.324 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:23:25.324 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.324 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.324 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:25.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:23:25.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:23:25.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:23:25.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:23:25.325 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.325 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.325 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.325 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:23:25.325 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:23:25.325 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.326 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.326 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.326 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.326 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.326 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:25.326 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:25.326 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.060791268999999, 2024-04-26T10:23:25.326 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:23:25.326 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.326 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.326 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.326 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.326 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.327 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:23:25.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.327 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:25.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.327 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:25.327 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.327 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.327 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.327 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:23:25.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:25.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:23:25.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:23:25.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.328 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.328 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.328 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:23:25.328 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:23:25.328 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:23:25.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:25.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:23:25.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:23:25.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.329 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.329 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:25.329 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:23:25.329 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:23:25.329 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:23:25.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:23:25.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:23:25.330 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:23:25.330 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.330 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.330 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:25.330 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:23:25.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:23:25.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:25.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:23:25.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:23:25.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.331 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:23:25.331 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:23:25.331 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.331 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.331 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:23:25.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:23:25.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.332 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.332 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:23:25.332 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:23:25.332 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.332 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.332 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.332 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.332 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.332 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:25.332 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:25.333 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.048206206000003, 2024-04-26T10:23:25.333 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:23:25.333 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.333 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.333 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.333 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:23:25.333 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.333 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.333 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.333 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.333 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:25.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:25.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.334 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.334 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.334 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:23:25.334 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:25.334 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:23:25.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:25.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:23:25.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:23:25.335 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.335 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.335 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.335 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:23:25.335 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:23:25.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:23:25.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:23:25.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:25.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:23:25.336 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:25.336 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.336 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.336 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.336 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:23:25.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:23:25.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:23:25.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:23:25.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:25.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:23:25.337 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:23:25.337 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.337 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.337 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.337 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:23:25.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:23:25.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:25.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:23:25.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:23:25.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.338 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:23:25.338 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:23:25.338 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.338 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.338 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.339 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:23:25.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:23:25.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.339 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.339 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.339 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.339 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.339 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:25.339 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:25.339 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.047971273000002, 2024-04-26T10:23:25.339 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:23:25.339 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.339 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.339 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.340 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.340 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:23:25.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.340 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.340 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:25.340 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.340 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.340 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.340 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:25.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:23:25.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:25.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.341 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.341 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:23:25.341 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:23:25.341 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.341 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:23:25.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:23:25.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:23:25.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:23:25.342 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.342 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.342 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.342 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:23:25.342 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:23:25.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:25.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:23:25.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:25.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:23:25.343 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:23:25.343 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.343 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.343 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.343 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:23:25.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:23:25.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:25.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:23:25.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:23:25.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:25.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:23:25.344 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:23:25.344 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.344 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.344 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.344 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:23:25.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:23:25.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:23:25.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:23:25.345 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.345 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.345 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.345 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:23:25.345 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:23:25.345 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.345 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.345 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.346 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.346 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:25.346 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:25.346 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.010096396000002, 2024-04-26T10:23:25.346 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:23:25.346 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.346 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.346 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.346 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:23:25.346 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.346 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:25.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:25.347 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.347 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.347 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.347 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.347 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:23:25.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:25.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:23:25.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:23:25.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.348 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.348 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:23:25.348 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:23:25.348 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.348 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:23:25.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:23:25.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:23:25.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:23:25.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.349 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.349 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:25.349 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:23:25.349 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:25.349 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:23:25.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:23:25.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.350 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.350 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.350 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:23:25.350 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:23:25.350 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:25.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:23:25.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:23:25.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.351 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.351 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:23:25.351 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:23:25.351 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.351 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:25.352 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:23:25.352 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:23:25.352 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.352 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.352 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:23:25.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:23:25.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.353 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.353 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:23:25.353 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:23:25.353 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.353 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.353 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.353 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.353 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.353 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:25.354 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:25.354 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 36.009651370999997, 2024-04-26T10:23:25.354 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:23:25.354 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.354 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.354 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.354 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:23:25.354 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.354 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.354 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.354 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.354 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:25.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:25.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.355 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.355 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:23:25.355 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:25.355 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.355 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:23:25.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:23:25.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:23:25.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:23:25.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.356 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.356 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.356 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:23:25.356 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:23:25.356 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:23:25.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:23:25.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:25.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:23:25.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:23:25.357 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.357 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.357 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.357 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:23:25.357 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:23:25.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:23:25.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:23:25.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:25.358 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:23:25.358 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:23:25.358 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.358 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.358 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:23:25.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:23:25.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:25.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:23:25.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:23:25.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.359 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.359 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.359 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:23:25.359 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:23:25.359 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.360 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.360 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:23:25.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:23:25.360 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.360 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.360 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.360 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.360 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.360 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:25.360 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:25.360 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.998048371000003, 2024-04-26T10:23:25.360 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:23:25.360 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.361 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.361 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.361 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:23:25.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.361 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.361 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:25.361 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.361 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.361 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.361 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:25.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:23:25.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:25.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.362 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.362 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:23:25.362 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:23:25.362 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.362 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:23:25.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:23:25.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:23:25.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:23:25.363 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.363 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.363 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.363 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:23:25.363 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:23:25.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:25.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:23:25.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:23:25.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:23:25.364 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:23:25.364 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.364 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.364 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.364 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:23:25.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:23:25.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:25.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:23:25.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:23:25.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.365 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:25.365 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:23:25.365 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:23:25.365 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.365 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:23:25.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:23:25.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:23:25.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:23:25.366 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.366 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.366 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.366 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:23:25.366 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:23:25.366 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.367 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.367 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.367 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.367 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.367 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:25.367 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:25.367 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.996774780999999, 2024-04-26T10:23:25.367 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:23:25.367 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.367 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.367 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.367 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.367 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.367 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:23:25.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.368 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:25.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:25.368 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.368 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.368 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.368 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.368 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:23:25.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:25.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:23:25.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:23:25.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.369 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.369 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:23:25.369 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:23:25.369 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.369 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:23:25.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:23:25.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:23:25.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:23:25.370 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.370 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.370 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:25.370 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:23:25.370 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:23:25.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:23:25.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:23:25.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:23:25.371 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:23:25.371 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.371 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.371 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:25.371 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:23:25.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:23:25.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:25.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:23:25.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:23:25.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.372 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:23:25.372 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:23:25.372 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.372 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.372 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:23:25.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:23:25.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.373 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.373 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:23:25.373 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:23:25.373 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.373 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.373 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.373 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.373 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.373 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:25.374 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:25.374 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.980017480000001, 2024-04-26T10:23:25.374 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:23:25.374 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.374 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.374 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.374 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.374 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.374 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:23:25.374 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.374 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.374 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.374 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:25.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:25.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.375 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.375 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.375 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:23:25.375 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:25.375 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:23:25.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:23:25.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:23:25.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:23:25.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.376 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.376 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.376 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:23:25.376 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:23:25.376 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:23:25.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:23:25.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:25.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:23:25.377 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:23:25.377 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.377 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.377 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.377 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:23:25.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:23:25.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:23:25.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:23:25.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:25.378 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:23:25.378 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:23:25.378 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.378 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.378 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:23:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:23:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:23:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:23:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:23:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:23:25.379 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.380 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.380 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:23:25.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:23:25.380 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.380 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.380 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.380 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.380 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.380 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:25.380 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:25.380 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 35.935105458999999, 2024-04-26T10:23:25.380 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:23:25.380 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:25.381 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:25.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:25.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:25.381 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.381 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:23:25.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.381 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:25.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:25.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:25.381 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.381 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.381 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.381 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:25.381 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:25.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:25.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:25.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:23:25.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:25.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:25.382 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:23:25.382 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:23:25.382 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.382 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.382 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:25.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:23:25.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:23:25.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:23:25.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:23:25.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.383 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.383 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.383 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:23:25.383 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:23:25.383 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:25.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:23:25.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:23:25.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:25.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:23:25.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:23:25.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.384 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.384 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:25.384 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:23:25.384 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:23:25.384 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:25.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:23:25.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:23:25.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:25.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:23:25.385 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:23:25.385 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.385 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.385 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:25.385 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:23:25.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:23:25.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:25.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:23:25.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:23:25.386 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:25.386 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:25.386 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:25.386 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:23:25.386 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:23:25.386 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.386 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.386 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.387 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:25.387 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:25.387 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:25.388 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:25.386+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:25.389 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T10:23:25.390 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:25.489 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:25.486+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:25.516 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:25.516 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:25.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.516 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:245270 5.f e69/37 5:f9b1e1ef:::benchmark_data_smithi052_19421_object115798:head v 69'15477, mlcod=69'15474)", 2024-04-26T10:23:25.516 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:25.512113+0000", 2024-04-26T10:23:25.516 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0032353400000000002, 2024-04-26T10:23:25.516 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0032604999999999999, 2024-04-26T10:23:25.516 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:25.516 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:25.516 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:25.516 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.516 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:25.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512113+0000", 2024-04-26T10:23:25.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:25.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512113+0000", 2024-04-26T10:23:25.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.517 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:25.517 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512113+0000", 2024-04-26T10:23:25.517 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967296 2024-04-26T10:23:25.517 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.517 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:25.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512116+0000", 2024-04-26T10:23:25.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1099999999999999e-06 2024-04-26T10:23:25.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:25.518 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512128+0000", 2024-04-26T10:23:25.518 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2136e-05 2024-04-26T10:23:25.518 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.518 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.518 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512133+0000", 2024-04-26T10:23:25.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.0350000000000001e-06 2024-04-26T10:23:25.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:25.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512175+0000", 2024-04-26T10:23:25.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1612000000000001e-05 2024-04-26T10:23:25.519 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.519 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.519 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:25.519 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512198+0000", 2024-04-26T10:23:25.519 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3764000000000002e-05 2024-04-26T10:23:25.520 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.520 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:25.520 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.520 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.520 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.520 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:245273 5.b 5:d1f62560:::benchmark_data_smithi052_19421_object115801:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T10:23:25.520 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:25.512520+0000", 2024-04-26T10:23:25.520 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0028285179999999999, 2024-04-26T10:23:25.520 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0029314570000000002, 2024-04-26T10:23:25.520 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:25.520 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:25.520 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:25.521 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:25.521 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.521 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 245273 2024-04-26T10:23:25.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.521 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:25.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.521 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:25.521 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512520+0000", 2024-04-26T10:23:25.521 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.521 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.521 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:25.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512520+0000", 2024-04-26T10:23:25.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.522 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.522 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:25.522 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512518+0000", 2024-04-26T10:23:25.522 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:25.522 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:25.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512525+0000", 2024-04-26T10:23:25.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.754e-06 2024-04-26T10:23:25.523 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.523 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.523 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:25.523 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512542+0000", 2024-04-26T10:23:25.523 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6401000000000001e-05 2024-04-26T10:23:25.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512548+0000", 2024-04-26T10:23:25.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0839999999999997e-06 2024-04-26T10:23:25.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.524 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.524 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:25.524 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.513237+0000", 2024-04-26T10:23:25.524 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00068927500000000004 2024-04-26T10:23:25.524 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:25.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.513442+0000", 2024-04-26T10:23:25.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000205455 2024-04-26T10:23:25.525 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.525 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.525 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:25.525 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.513622+0000", 2024-04-26T10:23:25.525 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017964000000000001 2024-04-26T10:23:25.525 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.526 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:25.526 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.526 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.526 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.526 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:245274 5.b 5.e48f26cb (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T10:23:25.526 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:25.512559+0000", 2024-04-26T10:23:25.526 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0027892009999999998, 2024-04-26T10:23:25.526 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002978961, 2024-04-26T10:23:25.526 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:25.526 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:25.526 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:25.526 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:25.527 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.527 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 245274 2024-04-26T10:23:25.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.527 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:25.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:25.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512559+0000", 2024-04-26T10:23:25.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.527 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.527 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.527 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:25.527 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512559+0000", 2024-04-26T10:23:25.527 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:25.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512558+0000", 2024-04-26T10:23:25.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:25.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:25.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512563+0000", 2024-04-26T10:23:25.528 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.464e-06 2024-04-26T10:23:25.528 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.528 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.528 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:25.528 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512581+0000", 2024-04-26T10:23:25.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.8037999999999999e-05 2024-04-26T10:23:25.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.529 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.529 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512587+0000", 2024-04-26T10:23:25.529 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2999999999999998e-06 2024-04-26T10:23:25.529 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.529 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:25.529 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.529 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.529 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.529 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:245272 5.0 e69/54 5:030d40f7:::benchmark_data_smithi052_19421_object115800:head v 69'15366, mlcod=69'15364)", 2024-04-26T10:23:25.529 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:25.512884+0000", 2024-04-26T10:23:25.530 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0024639599999999998, 2024-04-26T10:23:25.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0027176570000000001, 2024-04-26T10:23:25.530 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:25.530 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:25.530 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:25.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:25.530 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512884+0000", 2024-04-26T10:23:25.530 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.530 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.530 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.530 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:25.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512884+0000", 2024-04-26T10:23:25.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:25.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512884+0000", 2024-04-26T10:23:25.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:25.531 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.531 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.531 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:25.531 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512890+0000", 2024-04-26T10:23:25.531 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2709999999999998e-06 2024-04-26T10:23:25.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:25.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512904+0000", 2024-04-26T10:23:25.532 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3944999999999999e-05 2024-04-26T10:23:25.532 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.532 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.532 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.532 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512914+0000", 2024-04-26T10:23:25.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0266e-05 2024-04-26T10:23:25.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:25.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.512979+0000", 2024-04-26T10:23:25.533 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4987000000000006e-05 2024-04-26T10:23:25.533 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.533 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.533 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:25.533 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.513010+0000", 2024-04-26T10:23:25.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0670000000000003e-05 2024-04-26T10:23:25.534 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.534 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:25.534 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.534 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.534 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.534 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:245276 5.e 5:7e62d5e8:::benchmark_data_smithi052_19421_object115804:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T10:23:25.534 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:25.513936+0000", 2024-04-26T10:23:25.534 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0014126169999999999, 2024-04-26T10:23:25.534 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0017468679999999999, 2024-04-26T10:23:25.534 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:25.534 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:25.534 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:25.534 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:25.535 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.535 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 245276 2024-04-26T10:23:25.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.535 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:25.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:25.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.513936+0000", 2024-04-26T10:23:25.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.535 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.535 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.535 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:25.535 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.513936+0000", 2024-04-26T10:23:25.535 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:25.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.513935+0000", 2024-04-26T10:23:25.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:25.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:25.536 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.513940+0000", 2024-04-26T10:23:25.536 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4970000000000001e-06 2024-04-26T10:23:25.536 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.536 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.536 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:25.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.513951+0000", 2024-04-26T10:23:25.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0661e-05 2024-04-26T10:23:25.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.513956+0000", 2024-04-26T10:23:25.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6169999999999998e-06 2024-04-26T10:23:25.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.537 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.537 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:25.537 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.514013+0000", 2024-04-26T10:23:25.537 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6548000000000001e-05 2024-04-26T10:23:25.537 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.538 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:25.538 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.514118+0000", 2024-04-26T10:23:25.538 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000105407 2024-04-26T10:23:25.538 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.538 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:25.538 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.538 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.538 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.538 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:245279 5.d e69/37 5:b5e0e8cf:::benchmark_data_smithi052_19421_object115807:head v 69'15460, mlcod=69'15456)", 2024-04-26T10:23:25.538 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:25.514366+0000", 2024-04-26T10:23:25.538 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00098230400000000003, 2024-04-26T10:23:25.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001389943, 2024-04-26T10:23:25.539 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:25.539 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:25.539 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:25.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:25.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.514366+0000", 2024-04-26T10:23:25.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.539 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.539 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.539 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:25.539 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.514366+0000", 2024-04-26T10:23:25.539 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:25.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.514365+0000", 2024-04-26T10:23:25.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:25.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:25.540 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.514371+0000", 2024-04-26T10:23:25.540 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0730000000000001e-06 2024-04-26T10:23:25.540 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.540 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.540 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:25.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.514382+0000", 2024-04-26T10:23:25.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0662000000000001e-05 2024-04-26T10:23:25.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.514387+0000", 2024-04-26T10:23:25.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4839999999999998e-06 2024-04-26T10:23:25.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.541 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.541 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:25.541 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.514439+0000", 2024-04-26T10:23:25.541 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2760000000000003e-05 2024-04-26T10:23:25.541 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.542 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:25.542 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.514456+0000", 2024-04-26T10:23:25.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.7091999999999998e-05 2024-04-26T10:23:25.542 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.542 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:25.542 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.542 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.542 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.542 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:245275 5.0 e69/54 5:01830071:::benchmark_data_smithi052_19421_object115803:head v 69'15367, mlcod=69'15364)", 2024-04-26T10:23:25.542 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:25.514943+0000", 2024-04-26T10:23:25.542 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00040521900000000001, 2024-04-26T10:23:25.542 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00087852799999999995, 2024-04-26T10:23:25.543 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:25.543 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:25.543 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:25.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:25.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.514943+0000", 2024-04-26T10:23:25.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.543 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.543 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:25.543 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.514943+0000", 2024-04-26T10:23:25.543 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.543 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:25.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.514942+0000", 2024-04-26T10:23:25.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:25.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.544 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:25.544 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.514949+0000", 2024-04-26T10:23:25.544 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1099999999999999e-06 2024-04-26T10:23:25.544 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.544 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:25.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.514962+0000", 2024-04-26T10:23:25.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3169e-05 2024-04-26T10:23:25.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.545 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.545 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.514968+0000", 2024-04-26T10:23:25.545 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1659999999999999e-06 2024-04-26T10:23:25.545 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.545 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:25.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.515015+0000", 2024-04-26T10:23:25.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.6958e-05 2024-04-26T10:23:25.546 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.546 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.546 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:25.546 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.515044+0000", 2024-04-26T10:23:25.546 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9584999999999999e-05 2024-04-26T10:23:25.546 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.546 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:25.547 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.547 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.547 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.547 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:245280 5.e 5.d115c8fe (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-04-26T10:23:25.547 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:25.515217+0000", 2024-04-26T10:23:25.547 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00013124799999999999, 2024-04-26T10:23:25.547 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00066901700000000005, 2024-04-26T10:23:25.547 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:25.547 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "queued for pg", 2024-04-26T10:23:25.547 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:25.548 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:25.548 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:25.548 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 245280 2024-04-26T10:23:25.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.548 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:25.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:25.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.515217+0000", 2024-04-26T10:23:25.548 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.548 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.548 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.548 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:25.548 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.515217+0000", 2024-04-26T10:23:25.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:25.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.515216+0000", 2024-04-26T10:23:25.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:25.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.549 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:25.549 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.515222+0000", 2024-04-26T10:23:25.549 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.2169999999999999e-06 2024-04-26T10:23:25.549 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.549 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:25.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.515236+0000", 2024-04-26T10:23:25.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.4221e-05 2024-04-26T10:23:25.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.550 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.550 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.515244+0000", 2024-04-26T10:23:25.550 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.038e-06 2024-04-26T10:23:25.550 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.550 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:25.550 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.550 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.550 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.551 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:245265 5.d e69/37 5:bc5701f0:::benchmark_data_smithi052_19421_object115793:head v 69'15458, mlcod=69'15456)", 2024-04-26T10:23:25.551 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:25.509585+0000", 2024-04-26T10:23:25.551 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0057636390000000001, 2024-04-26T10:23:25.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0063668079999999998, 2024-04-26T10:23:25.551 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:25.551 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:25.551 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:25.551 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.551 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:25.551 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.509585+0000", 2024-04-26T10:23:25.551 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.551 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:25.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.509585+0000", 2024-04-26T10:23:25.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.552 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.552 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.552 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:25.552 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.509584+0000", 2024-04-26T10:23:25.552 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:25.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:25.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.509589+0000", 2024-04-26T10:23:25.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9869999999999999e-06 2024-04-26T10:23:25.553 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.553 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.553 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:25.553 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.509600+0000", 2024-04-26T10:23:25.553 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0759e-05 2024-04-26T10:23:25.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.509605+0000", 2024-04-26T10:23:25.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5609999999999998e-06 2024-04-26T10:23:25.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.554 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.554 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:25.554 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.509654+0000", 2024-04-26T10:23:25.554 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.8486999999999998e-05 2024-04-26T10:23:25.554 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.555 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:25.555 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.509677+0000", 2024-04-26T10:23:25.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3153e-05 2024-04-26T10:23:25.555 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.555 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:25.555 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.555 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.555 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.555 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:245268 5.4 e69/65 5:22258986:::benchmark_data_smithi052_19421_object115796:head v 69'15460, mlcod=69'15457)", 2024-04-26T10:23:25.555 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:25.510426+0000", 2024-04-26T10:23:25.555 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0049225379999999997, 2024-04-26T10:23:25.555 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055905979999999996, 2024-04-26T10:23:25.556 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:25.556 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:25.556 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:25.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:25.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.510426+0000", 2024-04-26T10:23:25.556 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.556 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.556 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.556 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:25.556 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.510426+0000", 2024-04-26T10:23:25.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:25.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.510425+0000", 2024-04-26T10:23:25.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:25.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.557 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:25.557 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.510445+0000", 2024-04-26T10:23:25.557 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.0092e-05 2024-04-26T10:23:25.557 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.557 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:25.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.510460+0000", 2024-04-26T10:23:25.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5359e-05 2024-04-26T10:23:25.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.510470+0000", 2024-04-26T10:23:25.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6290000000000005e-06 2024-04-26T10:23:25.558 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.558 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.558 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:25.558 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.510523+0000", 2024-04-26T10:23:25.558 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3029000000000003e-05 2024-04-26T10:23:25.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.559 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:25.559 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.510550+0000", 2024-04-26T10:23:25.559 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6656999999999999e-05 2024-04-26T10:23:25.559 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.559 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:25.559 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.559 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.559 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.559 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:245266 5.d e69/37 5:bbe74a93:::benchmark_data_smithi052_19421_object115794:head v 69'15459, mlcod=69'15456)", 2024-04-26T10:23:25.559 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:25.511509+0000", 2024-04-26T10:23:25.559 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0038396039999999999, 2024-04-26T10:23:25.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.004572675, 2024-04-26T10:23:25.560 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:25.560 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:25.560 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:25.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:25.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.511509+0000", 2024-04-26T10:23:25.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.560 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:25.560 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.511509+0000", 2024-04-26T10:23:25.560 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:25.560 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.560 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:25.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.511508+0000", 2024-04-26T10:23:25.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:25.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:25.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.511514+0000", 2024-04-26T10:23:25.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7660000000000004e-06 2024-04-26T10:23:25.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.561 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.561 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:25.561 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.511524+0000", 2024-04-26T10:23:25.561 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0197000000000001e-05 2024-04-26T10:23:25.561 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:25.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.511529+0000", 2024-04-26T10:23:25.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.271e-06 2024-04-26T10:23:25.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:25.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.511576+0000", 2024-04-26T10:23:25.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7200000000000002e-05 2024-04-26T10:23:25.562 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:25.562 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:25.562 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:25.562 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:25.511603+0000", 2024-04-26T10:23:25.562 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6940999999999998e-05 2024-04-26T10:23:25.562 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.563 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:25.563 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.563 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:25.563 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:23:25.563 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 11 2024-04-26T10:23:25.563 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:25.564 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:25.592 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:25.590+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:25.678 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:23:25.687 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:25.688 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:25.688 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:23:25.688 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:23:25.688 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:25.691 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:25.690+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:25.699 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:25.792 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:25.790+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:25.830 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:23:25.859 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:23:25.860 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:23:25.860 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:23:25.860 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:23:25.864 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:23:25.864 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:23:25.868 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:25.868 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:25.880 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:25.893 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:25.890+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:25.994 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:25.990+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:26.016 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:26.016 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:26.030 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:26.098 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:26.091+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:26.163 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:26.163 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:26.177 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:26.196 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:26.194+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:26.296 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:26.294+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:26.306 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:26.306 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:26.320 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:26.397 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:26.391+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:26.434 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:26.434 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:26.445 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:26.498 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:26.495+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:26.548 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:26.548 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:26.559 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:26.599 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:26.598+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:26.665 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:26.665 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:26.674 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:26.718 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:26.715+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:26.791 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:26.791 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:26.801 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:26.801 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:26.795+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:26.902 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:26.895+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:26.909 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:26.909 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:26.919 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:27.003 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:27.002+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:27.071 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:27.071 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:27.081 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:27.131 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:27.130+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:27.200 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:27.200 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:27.204 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:27.202+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:27.210 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:27.305 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:27.299+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:27.316 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:27.316 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:27.325 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:27.391 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:23:27.406 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:27.406+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:27.429 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:27.429 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:27.439 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:27.509 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:27.503+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:27.577 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:27.578 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:27.591 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:27.608 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:27.606+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:27.709 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:27.706+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:27.722 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:27.722 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:27.735 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:27.810 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:27.806+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:27.863 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:27.863 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:27.866 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:23:27.875 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:27.913 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:27.907+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:28.003 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:28.003 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:28.013 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:28.010+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:28.015 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:28.024 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:23:28.046 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:23:28.047 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:23:28.047 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:23:28.047 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:23:28.052 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:23:28.052 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:23:28.113 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:28.107+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:28.131 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:28.131 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:28.131 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:23:28.131 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:23:28.131 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:28.142 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:28.145 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~100s 2024-04-26T10:23:28.215 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:28.214+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:28.269 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:28.269 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:23:28.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:23:28.269 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:28.269 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.269 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:28.269 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:28.269 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 87.736749552000006, 2024-04-26T10:23:28.269 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:23:28.269 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.269 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.269 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:28.270 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:28.270 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.270 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:23:28.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.270 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:28.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.270 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.270 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.270 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.270 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:28.270 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:23:28.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:28.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:23:28.271 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:23:28.271 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.271 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.271 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.271 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:23:28.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:23:28.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.272 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:23:28.272 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:23:28.272 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.272 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.272 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:23:28.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:23:28.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:23:28.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:23:28.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.273 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.273 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:28.273 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:23:28.273 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:23:28.273 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:23:28.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:23:28.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.274 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.274 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:23:28.274 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:23:28.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.274 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.274 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.274 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.274 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.275 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:28.275 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:28.275 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 87.734767325000007, 2024-04-26T10:23:28.275 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:23:28.275 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.275 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.275 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:28.275 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:28.275 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.275 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:23:28.275 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.275 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.275 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.275 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:28.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:28.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.276 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:23:28.276 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:23:28.276 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.276 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.276 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:23:28.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:23:28.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.277 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:23:28.277 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:23:28.277 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.277 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.277 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:23:28.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:23:28.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:23:28.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:23:28.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.278 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.278 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:23:28.278 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:23:28.278 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.278 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:28.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:23:28.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:23:28.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:23:28.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:23:28.279 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.279 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.279 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.279 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:23:28.279 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:23:28.279 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.280 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.280 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.280 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.280 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.280 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:28.280 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:28.280 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 87.734567940999995, 2024-04-26T10:23:28.280 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:23:28.280 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.280 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.280 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:28.280 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:28.280 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.281 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:23:28.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.281 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:28.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.281 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:28.281 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.281 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.281 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.281 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:28.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:28.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:23:28.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:23:28.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.282 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.282 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:23:28.282 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:23:28.282 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.282 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:23:28.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:23:28.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.283 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.283 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:23:28.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:23:28.283 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:23:28.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:23:28.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:28.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:23:28.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:23:28.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:23:28.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:23:28.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:23:28.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:23:28.285 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.285 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.285 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.285 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:23:28.285 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:28.285 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 87.734349320999996, 2024-04-26T10:23:28.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:23:28.285 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.285 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.286 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:28.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:28.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:23:28.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:23:28.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:23:28.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:23:28.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:23:28.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.288 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.288 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:23:28.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:23:28.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:23:28.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:23:28.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:23:28.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:23:28.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:23:28.289 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:23:28.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:23:28.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:23:28.290 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.290 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.290 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.290 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:28.290 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:28.290 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 87.731977882999999, 2024-04-26T10:23:28.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:23:28.290 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.291 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.291 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:28.291 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:28.291 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.291 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:23:28.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.291 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:28.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:28.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:23:28.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:28.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:23:28.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:23:28.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:23:28.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:23:28.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:23:28.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:23:28.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:28.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:23:28.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:23:28.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:23:28.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:28.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:23:28.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:23:28.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:23:28.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:23:28.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:23:28.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:23:28.295 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.295 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.295 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.295 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:28.295 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:28.296 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 87.731877260999994, 2024-04-26T10:23:28.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:23:28.296 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.296 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.296 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:28.296 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:28.296 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.296 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:23:28.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.296 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.296 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.296 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.296 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:28.296 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.296 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:28.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:23:28.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:28.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.297 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.297 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:23:28.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:23:28.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:23:28.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:23:28.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:23:28.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:23:28.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:23:28.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:23:28.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:23:28.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:23:28.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:28.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:23:28.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:23:28.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:23:28.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:23:28.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:23:28.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:23:28.300 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.300 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.300 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.300 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:23:28.301 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:28.301 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 87.7317587, 2024-04-26T10:23:28.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:23:28.301 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.301 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.301 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:28.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.301 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.301 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.301 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:28.301 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.301 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:23:28.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:23:28.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:23:28.302 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.302 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.302 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.302 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:23:28.302 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:23:28.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:23:28.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:23:28.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:23:28.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:23:28.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.303 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.303 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.303 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:23:28.303 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:23:28.303 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:23:28.304 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:23:28.304 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.304 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.304 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.304 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:23:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:23:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 87.731656302000005, 2024-04-26T10:23:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:23:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.305 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:23:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.306 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:23:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:23:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:23:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:23:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:23:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.307 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:23:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:23:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:23:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:23:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:23:28.308 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:23:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:23:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:23:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:23:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.309 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:23:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:23:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 87.730635745000001, 2024-04-26T10:23:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:23:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.310 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:23:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.311 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:23:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:23:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:23:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:23:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:23:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.312 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:23:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:23:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:23:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:23:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:23:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:23:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.313 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:23:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:23:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:23:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:23:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:23:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:23:28.314 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 87.72948547, 2024-04-26T10:23:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:23:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.315 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:23:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:28.316 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:23:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:23:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:23:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:23:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:23:28.317 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:23:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:23:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:23:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:23:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.318 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:23:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:23:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:23:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:23:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.319 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:23:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:23:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:23:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:23:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.232786227999995, 2024-04-26T10:23:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:23:28.320 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:23:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.321 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:23:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:23:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:23:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.322 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:23:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:23:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:23:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:23:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:23:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:23:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.323 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:23:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:23:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:23:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:23:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:23:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:23:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.324 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:23:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:23:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:23:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:23:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:23:28.325 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:23:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 64.232562631999997, 2024-04-26T10:23:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:23:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:28.326 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:23:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.327 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:23:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:23:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:23:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:23:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:23:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.328 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:23:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:23:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:23:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:23:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:23:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:23:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.329 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:23:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:23:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:23:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:23:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.330 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:23:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:23:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:23:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:23:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:23:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:23:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.331 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 57.201716312000002, 2024-04-26T10:23:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:23:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:23:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.332 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:23:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.333 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:23:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:23:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:23:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:23:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:23:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:23:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.334 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:23:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:23:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:23:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:23:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:23:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:23:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.335 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:23:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:23:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:23:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:23:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.336 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:23:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:23:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:23:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:23:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:28.337 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 57.199705209000001, 2024-04-26T10:23:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:23:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:23:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.338 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:23:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:23:28.339 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:23:28.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:23:28.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.340 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.340 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:23:28.340 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:23:28.340 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.340 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:23:28.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:23:28.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:23:28.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:23:28.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.341 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.341 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:28.341 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:23:28.341 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:23:28.341 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:23:28.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:23:28.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:28.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:23:28.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:23:28.342 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.342 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.342 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.342 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:23:28.342 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:23:28.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.343 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.343 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:23:28.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:23:28.343 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.343 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.343 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.343 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.343 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.343 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:28.343 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:28.343 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 57.188827103999998, 2024-04-26T10:23:28.343 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:23:28.343 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.343 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:28.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:28.344 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.344 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:23:28.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.344 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:28.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.344 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.344 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.344 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.344 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:28.344 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:23:28.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:28.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:23:28.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:23:28.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.345 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.345 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.345 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:23:28.345 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:23:28.345 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:23:28.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:23:28.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.346 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:23:28.346 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:23:28.346 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.346 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.346 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:23:28.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:23:28.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:28.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:23:28.347 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:23:28.347 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.347 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.347 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.347 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:23:28.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:23:28.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:28.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:23:28.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:23:28.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:23:28.348 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:23:28.348 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.348 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.348 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.348 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:23:28.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:23:28.349 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.349 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.349 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.349 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.349 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.349 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:28.349 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:28.349 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 57.186145885000002, 2024-04-26T10:23:28.349 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:23:28.349 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.349 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.349 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:28.349 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:28.349 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.350 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:23:28.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.350 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:28.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.350 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.350 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:28.350 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.350 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.350 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:23:28.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:28.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.351 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.351 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.351 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:23:28.351 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:23:28.351 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:23:28.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:23:28.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:23:28.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:23:28.352 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.352 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.352 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.352 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:23:28.352 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:23:28.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:23:28.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:23:28.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:28.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:23:28.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:23:28.353 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.353 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.353 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.353 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:23:28.353 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:23:28.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:28.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:23:28.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:23:28.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.354 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:23:28.354 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:23:28.354 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.354 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.354 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.355 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:23:28.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:23:28.355 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.355 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.355 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.355 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.355 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.355 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:28.355 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:28.355 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 57.185778810000002, 2024-04-26T10:23:28.355 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:23:28.355 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.355 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:28.355 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:28.356 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.356 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:23:28.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.356 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:28.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.356 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.356 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:28.356 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.356 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.356 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:23:28.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.357 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:23:28.357 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:23:28.357 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.357 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.357 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:23:28.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:23:28.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:23:28.358 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:23:28.358 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.358 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.358 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.358 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:23:28.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:23:28.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:23:28.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:23:28.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:28.359 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:23:28.359 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:23:28.359 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.359 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.359 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:23:28.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:23:28.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.360 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.360 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:23:28.360 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:23:28.360 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.360 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.360 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.360 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.360 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.360 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:28.361 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:28.361 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 57.185714558000001, 2024-04-26T10:23:28.361 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:23:28.361 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.361 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:28.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:28.361 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.361 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:23:28.361 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.361 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.361 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:28.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:28.362 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.362 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.362 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.362 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.362 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:23:28.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:28.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:23:28.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:23:28.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:23:28.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:23:28.363 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.363 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.363 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.363 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:23:28.363 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:23:28.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:23:28.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:23:28.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:23:28.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:23:28.364 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.364 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.364 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:28.364 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:23:28.364 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:23:28.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:23:28.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:23:28.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.365 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.365 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:23:28.365 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:23:28.365 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.365 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.365 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.365 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.365 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.366 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:28.366 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:28.366 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 57.181315884999997, 2024-04-26T10:23:28.366 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:23:28.366 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.366 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.366 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:28.366 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:28.366 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.366 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:23:28.366 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.366 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.366 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:28.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:28.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.367 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.367 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:23:28.367 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:28.367 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.367 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:23:28.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:23:28.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.368 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.368 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.368 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:23:28.368 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:23:28.368 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:23:28.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:23:28.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:23:28.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:23:28.369 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.369 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.369 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.369 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:23:28.369 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:23:28.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:28.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:23:28.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:23:28.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:23:28.370 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:23:28.370 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.370 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.370 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.370 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:23:28.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:23:28.371 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.371 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.371 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.371 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.371 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.371 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:28.371 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:28.371 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 57.179557901999999, 2024-04-26T10:23:28.371 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:23:28.371 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:28.371 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.371 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:28.371 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:28.371 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.372 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:23:28.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.372 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:28.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:28.372 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:28.372 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.372 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.372 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.372 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:28.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:28.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:28.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:28.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:23:28.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:28.373 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:23:28.373 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:23:28.373 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.373 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.373 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:28.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:23:28.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:23:28.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:23:28.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:23:28.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:28.374 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:23:28.374 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:23:28.374 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.374 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.374 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:28.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:23:28.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:23:28.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:28.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:23:28.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:23:28.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.375 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:23:28.375 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:23:28.375 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.375 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.375 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:28.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:23:28.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:23:28.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:28.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:23:28.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:23:28.376 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:28.376 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:28.376 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:28.376 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:23:28.376 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:23:28.376 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.376 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.376 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.377 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:28.377 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:28.377 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:28.378 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:28.371+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:28.379 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T10:23:28.379 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:28.478 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:28.478+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:28.510 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:28.510 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:250062 5.f 5:f49f4f4a:::benchmark_data_smithi052_19421_object120590:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:28.503291+0000", 2024-04-26T10:23:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0059162659999999999, 2024-04-26T10:23:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059354849999999999, 2024-04-26T10:23:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 250062 2024-04-26T10:23:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.511 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.503291+0000", 2024-04-26T10:23:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.503291+0000", 2024-04-26T10:23:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.503290+0000", 2024-04-26T10:23:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.512 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.503293+0000", 2024-04-26T10:23:28.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4309999999999998e-06 2024-04-26T10:23:28.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.503307+0000", 2024-04-26T10:23:28.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3132000000000001e-05 2024-04-26T10:23:28.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.513 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.513 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.503312+0000", 2024-04-26T10:23:28.513 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9549999999999997e-06 2024-04-26T10:23:28.513 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.513 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.503351+0000", 2024-04-26T10:23:28.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8723999999999997e-05 2024-04-26T10:23:28.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.514 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.514 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.503467+0000", 2024-04-26T10:23:28.514 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000115835 2024-04-26T10:23:28.514 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.514 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.515 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.515 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.503570+0000", 2024-04-26T10:23:28.515 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010267 2024-04-26T10:23:28.515 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.515 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.515 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.516 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:250065 5.9 5:909a0975:::benchmark_data_smithi052_19421_object120593:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:28.516 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:28.505714+0000", 2024-04-26T10:23:28.516 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0034930949999999999, 2024-04-26T10:23:28.516 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0035620640000000002, 2024-04-26T10:23:28.516 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.516 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:28.516 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.516 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.516 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.516 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 250065 2024-04-26T10:23:28.516 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.516 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.516 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.505714+0000", 2024-04-26T10:23:28.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.505714+0000", 2024-04-26T10:23:28.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.517 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.517 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.517 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.505713+0000", 2024-04-26T10:23:28.517 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.517 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.505716+0000", 2024-04-26T10:23:28.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3610000000000001e-06 2024-04-26T10:23:28.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.505726+0000", 2024-04-26T10:23:28.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0890000000000006e-06 2024-04-26T10:23:28.518 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.518 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.518 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.518 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.505730+0000", 2024-04-26T10:23:28.518 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7990000000000001e-06 2024-04-26T10:23:28.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.505759+0000", 2024-04-26T10:23:28.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8988000000000001e-05 2024-04-26T10:23:28.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.519 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.519 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.505847+0000", 2024-04-26T10:23:28.519 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8052000000000003e-05 2024-04-26T10:23:28.519 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.519 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.520 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.520 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.505920+0000", 2024-04-26T10:23:28.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2589999999999994e-05 2024-04-26T10:23:28.520 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.520 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.520 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.520 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.520 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.520 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:250068 5.b 5:d36faf86:::benchmark_data_smithi052_19421_object120596:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:28.520 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:28.506670+0000", 2024-04-26T10:23:28.520 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0025372350000000001, 2024-04-26T10:23:28.520 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00264533, 2024-04-26T10:23:28.520 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.521 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:28.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.521 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.521 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 250068 2024-04-26T10:23:28.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.521 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506670+0000", 2024-04-26T10:23:28.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.521 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.521 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.521 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.521 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506670+0000", 2024-04-26T10:23:28.521 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506669+0000", 2024-04-26T10:23:28.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506674+0000", 2024-04-26T10:23:28.522 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9280000000000001e-06 2024-04-26T10:23:28.522 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.522 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.522 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.522 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506682+0000", 2024-04-26T10:23:28.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.4300000000000006e-06 2024-04-26T10:23:28.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506690+0000", 2024-04-26T10:23:28.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5719999999999997e-06 2024-04-26T10:23:28.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506737+0000", 2024-04-26T10:23:28.523 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7287999999999999e-05 2024-04-26T10:23:28.523 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.523 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.523 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.523 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506865+0000", 2024-04-26T10:23:28.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012779600000000001 2024-04-26T10:23:28.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.524 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.524 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506998+0000", 2024-04-26T10:23:28.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013320300000000001 2024-04-26T10:23:28.524 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.524 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.524 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.524 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.524 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.524 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:250069 5.1 5:8d448adc:::benchmark_data_smithi052_19421_object120597:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:28.524 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:28.506824+0000", 2024-04-26T10:23:28.524 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0023831360000000001, 2024-04-26T10:23:28.524 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025281739999999998, 2024-04-26T10:23:28.525 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.525 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:28.525 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.525 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.525 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.525 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 250069 2024-04-26T10:23:28.525 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.525 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.525 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506824+0000", 2024-04-26T10:23:28.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506824+0000", 2024-04-26T10:23:28.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.526 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.526 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.526 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.526 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506823+0000", 2024-04-26T10:23:28.526 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506829+0000", 2024-04-26T10:23:28.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9889999999999997e-06 2024-04-26T10:23:28.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506847+0000", 2024-04-26T10:23:28.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8317000000000001e-05 2024-04-26T10:23:28.527 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.527 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.527 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.527 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506855+0000", 2024-04-26T10:23:28.527 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2029999999999992e-06 2024-04-26T10:23:28.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506905+0000", 2024-04-26T10:23:28.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9354000000000002e-05 2024-04-26T10:23:28.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.528 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.528 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.507033+0000", 2024-04-26T10:23:28.528 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012865700000000001 2024-04-26T10:23:28.528 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.528 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.528 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.528 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.528 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.529 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:250070 5.4 5:23eb07cc:::benchmark_data_smithi052_19421_object120598:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:28.529 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:28.506867+0000", 2024-04-26T10:23:28.529 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0023399240000000002, 2024-04-26T10:23:28.529 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025167240000000001, 2024-04-26T10:23:28.529 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.529 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:28.529 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.529 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.529 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.529 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 250070 2024-04-26T10:23:28.529 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.529 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.529 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.529 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.529 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506867+0000", 2024-04-26T10:23:28.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506867+0000", 2024-04-26T10:23:28.530 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.530 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.530 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.530 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.530 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506866+0000", 2024-04-26T10:23:28.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:28.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506870+0000", 2024-04-26T10:23:28.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5049999999999999e-06 2024-04-26T10:23:28.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.531 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506883+0000", 2024-04-26T10:23:28.531 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3526000000000001e-05 2024-04-26T10:23:28.531 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.531 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.531 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506890+0000", 2024-04-26T10:23:28.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3180000000000003e-06 2024-04-26T10:23:28.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506933+0000", 2024-04-26T10:23:28.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2948000000000003e-05 2024-04-26T10:23:28.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.532 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.507055+0000", 2024-04-26T10:23:28.532 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000122912 2024-04-26T10:23:28.532 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.532 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.532 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.533 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.507159+0000", 2024-04-26T10:23:28.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103531 2024-04-26T10:23:28.533 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.533 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.533 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.533 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.533 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.533 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:250071 5.2 5:4536fd05:::benchmark_data_smithi052_19421_object120599:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:28.533 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:28.506903+0000", 2024-04-26T10:23:28.533 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0023042700000000002, 2024-04-26T10:23:28.533 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025241450000000002, 2024-04-26T10:23:28.533 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.533 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:28.533 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.534 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.534 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.534 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 250071 2024-04-26T10:23:28.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.534 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506903+0000", 2024-04-26T10:23:28.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.534 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.534 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506903+0000", 2024-04-26T10:23:28.534 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.534 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.534 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506902+0000", 2024-04-26T10:23:28.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:28.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506906+0000", 2024-04-26T10:23:28.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5470000000000001e-06 2024-04-26T10:23:28.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.535 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506913+0000", 2024-04-26T10:23:28.535 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7649999999999993e-06 2024-04-26T10:23:28.535 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.535 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.535 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506920+0000", 2024-04-26T10:23:28.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4620000000000001e-06 2024-04-26T10:23:28.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.536 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.536 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.536 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506959+0000", 2024-04-26T10:23:28.536 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9097000000000002e-05 2024-04-26T10:23:28.536 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.537 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.537 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.507088+0000", 2024-04-26T10:23:28.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012882400000000001 2024-04-26T10:23:28.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.537 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.537 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.537 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.537 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.537 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:250072 5.c 5:3e547489:::benchmark_data_smithi052_19421_object120600:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:28.537 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:28.506937+0000", 2024-04-26T10:23:28.537 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0022695879999999999, 2024-04-26T10:23:28.537 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002526655, 2024-04-26T10:23:28.538 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.538 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:28.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.538 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.538 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 250072 2024-04-26T10:23:28.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.538 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.538 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506937+0000", 2024-04-26T10:23:28.538 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.538 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.538 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.538 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506937+0000", 2024-04-26T10:23:28.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506937+0000", 2024-04-26T10:23:28.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:28.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506940+0000", 2024-04-26T10:23:28.539 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4690000000000002e-06 2024-04-26T10:23:28.539 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.539 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.539 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.539 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506947+0000", 2024-04-26T10:23:28.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2150000000000004e-06 2024-04-26T10:23:28.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506953+0000", 2024-04-26T10:23:28.540 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6740000000000002e-06 2024-04-26T10:23:28.540 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.540 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.540 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.540 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.506986+0000", 2024-04-26T10:23:28.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3247000000000002e-05 2024-04-26T10:23:28.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.541 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.541 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.507103+0000", 2024-04-26T10:23:28.541 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000117222 2024-04-26T10:23:28.541 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.541 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.541 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.541 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.541 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.541 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:250065 5.9 e72/37)", 2024-04-26T10:23:28.541 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:28.509462+0000", 2024-04-26T10:23:28.542 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9997454, 2024-04-26T10:23:28.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0513000000000002e-05, 2024-04-26T10:23:28.542 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.542 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-04-26T10:23:28.542 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.509462+0000", 2024-04-26T10:23:28.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.542 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.542 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.542 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.509462+0000", 2024-04-26T10:23:28.542 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.542 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.509461+0000", 2024-04-26T10:23:28.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.509465+0000", 2024-04-26T10:23:28.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8299999999999998e-06 2024-04-26T10:23:28.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.543 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.543 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.543 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.509474+0000", 2024-04-26T10:23:28.543 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5550000000000008e-06 2024-04-26T10:23:28.543 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.509479+0000", 2024-04-26T10:23:28.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5360000000000003e-06 2024-04-26T10:23:28.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.544 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.544 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.509511+0000", 2024-04-26T10:23:28.544 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2635000000000002e-05 2024-04-26T10:23:28.544 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.544 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.544 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.544 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.544 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.544 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_repop_reply(client.4722.0:250062 5.f e72/37)", 2024-04-26T10:23:28.544 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:28.509493+0000", 2024-04-26T10:23:28.545 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9997134, 2024-04-26T10:23:28.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7014000000000001e-05, 2024-04-26T10:23:28.545 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.545 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "reached pg", 2024-04-26T10:23:28.545 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.509493+0000", 2024-04-26T10:23:28.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.545 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.545 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.509493+0000", 2024-04-26T10:23:28.545 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.545 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.545 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.509493+0000", 2024-04-26T10:23:28.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:28.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.509495+0000", 2024-04-26T10:23:28.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.2759999999999999e-06 2024-04-26T10:23:28.546 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.546 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.546 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.546 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.509499+0000", 2024-04-26T10:23:28.546 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4970000000000001e-06 2024-04-26T10:23:28.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.509502+0000", 2024-04-26T10:23:28.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.7130000000000001e-06 2024-04-26T10:23:28.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.547 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.547 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.547 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.509537+0000", 2024-04-26T10:23:28.547 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5697000000000001e-05 2024-04-26T10:23:28.547 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.548 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.548 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.509542+0000", 2024-04-26T10:23:28.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5519999999999998e-06 2024-04-26T10:23:28.548 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.548 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.548 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.548 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.548 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.548 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:250061 5.0 5:01c4b2c8:::benchmark_data_smithi052_19421_object120589:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:28.548 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:28.503229+0000", 2024-04-26T10:23:28.548 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00597826, 2024-04-26T10:23:28.548 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063429999999999997, 2024-04-26T10:23:28.548 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.548 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:28.549 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.549 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.549 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.549 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 250061 2024-04-26T10:23:28.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.549 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.503229+0000", 2024-04-26T10:23:28.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.549 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.549 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.549 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.503229+0000", 2024-04-26T10:23:28.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.503228+0000", 2024-04-26T10:23:28.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:28.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.503231+0000", 2024-04-26T10:23:28.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5909999999999998e-06 2024-04-26T10:23:28.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.503236+0000", 2024-04-26T10:23:28.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0969999999999996e-06 2024-04-26T10:23:28.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.503239+0000", 2024-04-26T10:23:28.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8660000000000002e-06 2024-04-26T10:23:28.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.503267+0000", 2024-04-26T10:23:28.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.8096e-05 2024-04-26T10:23:28.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.503383+0000", 2024-04-26T10:23:28.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000116301 2024-04-26T10:23:28.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.503492+0000", 2024-04-26T10:23:28.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010917300000000001 2024-04-26T10:23:28.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:28.509201+0000", 2024-04-26T10:23:28.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0057086250000000002 2024-04-26T10:23:28.553 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.553 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.553 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.553 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.553 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:23:28.553 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 10 2024-04-26T10:23:28.553 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:28.554 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:28.579 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:28.578+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:28.680 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:28.675+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:28.685 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:28.685 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:28.685 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:23:28.685 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:23:28.685 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:28.699 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:28.781 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:28.775+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:28.833 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:28.833 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:23:28.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:23:28.833 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:28.833 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.833 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:28.833 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:28.833 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.791215774999998, 2024-04-26T10:23:28.833 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:23:28.834 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.834 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.834 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.834 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:23:28.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.834 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.834 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.834 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.834 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:28.834 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.834 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:28.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:28.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:28.835 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.835 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.835 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.835 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:23:28.835 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:23:28.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:23:28.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:23:28.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:23:28.836 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:23:28.836 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.836 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.836 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.836 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:23:28.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:23:28.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:23:28.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:23:28.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.837 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:23:28.837 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:23:28.837 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.837 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.837 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:23:28.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:23:28.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.838 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.838 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:23:28.838 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:23:28.838 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.838 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.838 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.838 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.838 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.839 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:28.839 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:28.839 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.791106524, 2024-04-26T10:23:28.839 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:23:28.839 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.839 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.839 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.839 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.839 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.839 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:23:28.839 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.839 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.839 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.839 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:28.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.840 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.840 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.840 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:28.840 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.840 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:28.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:28.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:23:28.841 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:23:28.841 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.841 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.841 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.841 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:23:28.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:23:28.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:23:28.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:23:28.842 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.842 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.842 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.842 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:23:28.842 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:23:28.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:23:28.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:23:28.843 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.843 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.843 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.843 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:23:28.843 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:23:28.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:23:28.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:23:28.844 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.844 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.844 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.844 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:23:28.844 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:23:28.844 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.844 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.845 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.845 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.845 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:28.845 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:28.845 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.788709112000006, 2024-04-26T10:23:28.845 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:23:28.845 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.845 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.845 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.845 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:23:28.845 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.846 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:28.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.846 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:28.846 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.846 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.846 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.846 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:23:28.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:28.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:23:28.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:23:28.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.847 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:23:28.847 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:23:28.847 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.847 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.847 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:23:28.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:23:28.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:23:28.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:23:28.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.848 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.848 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:23:28.848 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:23:28.848 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.848 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:23:28.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:23:28.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:23:28.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:23:28.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.849 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.849 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:23:28.849 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:23:28.849 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.849 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:23:28.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:23:28.850 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.850 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.850 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.850 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:23:28.850 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:23:28.850 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.850 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.851 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.851 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.851 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.851 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:28.851 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:28.851 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 64.788523187999999, 2024-04-26T10:23:28.851 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:23:28.851 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.851 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.851 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.851 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.851 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.852 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:23:28.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.852 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:28.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.852 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.852 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:28.852 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.852 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.852 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:23:28.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:28.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:23:28.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:23:28.853 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.853 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.853 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.853 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:23:28.853 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:23:28.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:23:28.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:23:28.854 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.854 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.854 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.854 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:23:28.854 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:23:28.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:23:28.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:23:28.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:23:28.855 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:23:28.855 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.855 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.855 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.855 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:23:28.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:23:28.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:23:28.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:23:28.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:23:28.856 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:23:28.856 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.856 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.856 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.856 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:23:28.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:23:28.857 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.857 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.857 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.857 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.857 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.857 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:28.857 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:28.857 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.698500572, 2024-04-26T10:23:28.857 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:23:28.857 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.857 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.857 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.858 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:23:28.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.858 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:28.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.858 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.858 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:28.858 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.858 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.858 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:28.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:28.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:23:28.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:23:28.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.859 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.859 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.859 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:23:28.859 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:23:28.859 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:23:28.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:23:28.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:23:28.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:23:28.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.860 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.860 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:28.860 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:23:28.860 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:23:28.860 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:23:28.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:23:28.861 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.861 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.861 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.861 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:23:28.861 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:23:28.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:23:28.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:23:28.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.862 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:23:28.862 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:23:28.862 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.862 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.862 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:23:28.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:23:28.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:23:28.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:23:28.863 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.863 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.863 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.863 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:23:28.863 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:23:28.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.865 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.865 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.865 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.865 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.866 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:28.866 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:28.866 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.675398326, 2024-04-26T10:23:28.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:23:28.866 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.866 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.866 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:23:28.866 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.866 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.866 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:23:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:23:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:23:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:23:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:23:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:23:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:23:28.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:23:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:23:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:23:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:23:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:23:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:23:28.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:23:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:23:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:23:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:23:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:23:28.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:23:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:23:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:23:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:23:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:23:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:23:28.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:23:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:28.872 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.668715188, 2024-04-26T10:23:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:23:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:23:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:23:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:23:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:23:28.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:23:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:23:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:23:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:23:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:23:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:23:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:23:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:23:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:23:28.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:23:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:23:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:23:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:23:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:23:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:23:28.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:23:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:23:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:23:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:23:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:23:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:23:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:23:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.666717403, 2024-04-26T10:23:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:23:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.879 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:23:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:23:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:23:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:23:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:23:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:23:28.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:23:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:23:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:23:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:23:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:28.882 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:23:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:23:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:23:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:23:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:23:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:23:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:23:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:23:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:23:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:23:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:23:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:23:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:23:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:23:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:23:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.657308698000001, 2024-04-26T10:23:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:23:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.886 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:23:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:23:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:23:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:23:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:23:28.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:23:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:23:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:23:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:23:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:28.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:23:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:23:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:23:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:23:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:23:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:23:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:23:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:23:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:23:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:23:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:23:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:23:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:23:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:23:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:23:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:23:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:28.892 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.655480648999998, 2024-04-26T10:23:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:23:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:23:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:23:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:23:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:23:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:23:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:23:28.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:23:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:23:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:23:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:23:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:23:28.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:23:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:23:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:23:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:23:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:23:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:23:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:23:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:23:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:23:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:23:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:23:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:23:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:23:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:23:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:23:28.899 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.643900926999997, 2024-04-26T10:23:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:23:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:23:28.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:28.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:23:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:23:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:23:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:23:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:23:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:23:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:23:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:23:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:23:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:23:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:23:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:23:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:23:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:23:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:23:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:23:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:23:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:23:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:23:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:23:28.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:23:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:23:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:23:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:23:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.637490432999996, 2024-04-26T10:23:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:23:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:23:28.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:23:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:23:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:23:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:23:28.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:23:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:23:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:23:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:23:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:23:28.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:23:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:23:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:23:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:23:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:23:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:23:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:23:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:23:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:23:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:23:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:23:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:23:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:23:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:23:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:23:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.913 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.62490537, 2024-04-26T10:23:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:23:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:23:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:23:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:23:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:23:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:23:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:23:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:23:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:23:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:23:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:23:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:28.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:23:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:23:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:23:28.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:23:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:23:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:23:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:23:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:23:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:23:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:23:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:23:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:23:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:23:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:23:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.920 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.624670436999999, 2024-04-26T10:23:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:23:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:23:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:23:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:23:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:23:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:23:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:23:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:23:28.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:23:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:23:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:23:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:23:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:23:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:23:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:23:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:23:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:23:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:23:28.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:23:28.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:23:28.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:23:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:23:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:23:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:23:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:23:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:23:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.927 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.586795559999999, 2024-04-26T10:23:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:23:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.928 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:23:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:23:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:23:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:23:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:23:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:23:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:23:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:23:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:23:28.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:23:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:23:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:23:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:23:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:23:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:23:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:23:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:23:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:23:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:23:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:23:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:23:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:23:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:23:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:23:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:23:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.934 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.586350535000001, 2024-04-26T10:23:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:23:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:23:28.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:23:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:23:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:23:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:23:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:23:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:23:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:23:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:23:28.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:23:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:23:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:23:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:23:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:23:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:23:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:23:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:23:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:23:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:23:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:23:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:23:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:23:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:23:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:23:28.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:23:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:23:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.942 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.574747535, 2024-04-26T10:23:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:23:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:23:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:23:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:23:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:23:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:23:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:23:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:23:28.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:23:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:23:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:23:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:23:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:23:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:23:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:23:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:23:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:23:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:23:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:23:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:23:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:23:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:23:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:23:28.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:23:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:23:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:23:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:23:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.573473945000003, 2024-04-26T10:23:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:23:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.950 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:23:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:23:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:23:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:23:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:23:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:23:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:23:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:23:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:23:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:23:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:23:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:23:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:23:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:23:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:23:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:23:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:23:28.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:23:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:23:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:23:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:23:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:23:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:23:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:23:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:23:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:23:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.556716643999998, 2024-04-26T10:23:28.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:23:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:23:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:23:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:23:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:23:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:23:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:23:28.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:23:28.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:23:28.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:23:28.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:23:28.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:28.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:23:28.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:23:28.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:23:28.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:23:28.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:23:28.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:23:28.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:23:28.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:23:28.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:23:28.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:23:28.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:23:28.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:23:28.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:23:28.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:23:28.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:23:28.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:23:28.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.963 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.964 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:28.964 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:28.964 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 39.511804623000003, 2024-04-26T10:23:28.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:23:28.964 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:28.964 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:28.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:28.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:28.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:28.964 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:23:28.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.965 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:28.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:28.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:28.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:28.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:28.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:28.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:28.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:23:28.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:28.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:28.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:23:28.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:23:28.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:28.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:23:28.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:23:28.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:28.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:23:28.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:23:28.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:23:28.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:23:28.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:28.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:23:28.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:23:28.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:28.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:23:28.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:23:28.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:28.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:23:28.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:23:28.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:28.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:23:28.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:23:28.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:28.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:23:28.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:23:28.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:28.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:23:28.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:23:28.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:28.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:23:28.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:23:28.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:28.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:28.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:28.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:23:28.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:23:28.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.970 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.970 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:28.971 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:28.971 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:28.972 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:28.973 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:28.970+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:29.072 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:29.070+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:29.096 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:29.096 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:29.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.096 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:251454 5.a 5:55dd0ca4:::benchmark_data_smithi052_19421_object121982:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:29.096 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:29.089231+0000", 2024-04-26T10:23:29.096 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0064631799999999998, 2024-04-26T10:23:29.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0064916110000000004, 2024-04-26T10:23:29.096 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.097 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:29.097 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.097 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.097 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.097 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 251454 2024-04-26T10:23:29.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.097 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.089231+0000", 2024-04-26T10:23:29.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.089231+0000", 2024-04-26T10:23:29.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.089231+0000", 2024-04-26T10:23:29.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.089234+0000", 2024-04-26T10:23:29.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.929e-06 2024-04-26T10:23:29.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.089246+0000", 2024-04-26T10:23:29.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1276e-05 2024-04-26T10:23:29.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.089252+0000", 2024-04-26T10:23:29.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.8250000000000001e-06 2024-04-26T10:23:29.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.093439+0000", 2024-04-26T10:23:29.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041878169999999999 2024-04-26T10:23:29.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.093528+0000", 2024-04-26T10:23:29.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8270999999999996e-05 2024-04-26T10:23:29.100 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.100 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.100 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.100 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:251462 5.e 5:749def4f:::benchmark_data_smithi052_19421_object121990:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:29.100 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:29.090996+0000", 2024-04-26T10:23:29.100 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.004698692, 2024-04-26T10:23:29.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047986180000000002, 2024-04-26T10:23:29.100 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.100 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.101 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.101 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.101 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.101 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 251462 2024-04-26T10:23:29.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.101 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.090996+0000", 2024-04-26T10:23:29.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.090996+0000", 2024-04-26T10:23:29.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.090995+0000", 2024-04-26T10:23:29.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.091000+0000", 2024-04-26T10:23:29.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1560000000000003e-06 2024-04-26T10:23:29.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.091013+0000", 2024-04-26T10:23:29.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2971e-05 2024-04-26T10:23:29.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.091020+0000", 2024-04-26T10:23:29.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7020000000000004e-06 2024-04-26T10:23:29.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.091084+0000", 2024-04-26T10:23:29.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4221999999999996e-05 2024-04-26T10:23:29.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.091260+0000", 2024-04-26T10:23:29.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000176467 2024-04-26T10:23:29.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095595+0000", 2024-04-26T10:23:29.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043348930000000003 2024-04-26T10:23:29.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095695+0000", 2024-04-26T10:23:29.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000100037 2024-04-26T10:23:29.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095794+0000", 2024-04-26T10:23:29.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9171000000000003e-05 2024-04-26T10:23:29.105 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.105 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.105 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.105 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:251465 5.8 5:164274ac:::benchmark_data_smithi052_19421_object121993:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:29.105 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:29.092820+0000", 2024-04-26T10:23:29.105 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0028743110000000001, 2024-04-26T10:23:29.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030659910000000001, 2024-04-26T10:23:29.106 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.106 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:29.106 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.106 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.106 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.106 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 251465 2024-04-26T10:23:29.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.106 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.106 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.092820+0000", 2024-04-26T10:23:29.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.092820+0000", 2024-04-26T10:23:29.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.092819+0000", 2024-04-26T10:23:29.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.092824+0000", 2024-04-26T10:23:29.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.9439999999999996e-06 2024-04-26T10:23:29.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.092835+0000", 2024-04-26T10:23:29.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.11e-05 2024-04-26T10:23:29.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.092841+0000", 2024-04-26T10:23:29.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1410000000000002e-06 2024-04-26T10:23:29.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.092894+0000", 2024-04-26T10:23:29.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.2816999999999999e-05 2024-04-26T10:23:29.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.093041+0000", 2024-04-26T10:23:29.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014667 2024-04-26T10:23:29.109 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.109 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.109 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.109 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:251463 5.9 e72/37 5:987eadba:::benchmark_data_smithi052_19421_object121991:head v 72'15821, mlcod=72'15819)", 2024-04-26T10:23:29.109 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:29.092916+0000", 2024-04-26T10:23:29.109 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0027783920000000002, 2024-04-26T10:23:29.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030274519999999999, 2024-04-26T10:23:29.109 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.109 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:29.110 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.092916+0000", 2024-04-26T10:23:29.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.092916+0000", 2024-04-26T10:23:29.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.092916+0000", 2024-04-26T10:23:29.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:29.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.111 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.111 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.092920+0000", 2024-04-26T10:23:29.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2950000000000004e-06 2024-04-26T10:23:29.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.092926+0000", 2024-04-26T10:23:29.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.981e-06 2024-04-26T10:23:29.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.092930+0000", 2024-04-26T10:23:29.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2810000000000002e-06 2024-04-26T10:23:29.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.092969+0000", 2024-04-26T10:23:29.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9107999999999999e-05 2024-04-26T10:23:29.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.092989+0000", 2024-04-26T10:23:29.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9143e-05 2024-04-26T10:23:29.113 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.113 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.113 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.113 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:251471 5.8 5:19b7875c:::benchmark_data_smithi052_19421_object121999:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:29.113 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:29.095116+0000", 2024-04-26T10:23:29.114 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00057892399999999998, 2024-04-26T10:23:29.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00088157800000000005, 2024-04-26T10:23:29.114 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.114 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:29.114 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.114 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.114 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.114 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 251471 2024-04-26T10:23:29.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.114 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095116+0000", 2024-04-26T10:23:29.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095116+0000", 2024-04-26T10:23:29.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095114+0000", 2024-04-26T10:23:29.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095121+0000", 2024-04-26T10:23:29.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1580000000000002e-06 2024-04-26T10:23:29.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095132+0000", 2024-04-26T10:23:29.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1725999999999999e-05 2024-04-26T10:23:29.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095141+0000", 2024-04-26T10:23:29.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.5580000000000001e-06 2024-04-26T10:23:29.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095375+0000", 2024-04-26T10:23:29.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00023425299999999999 2024-04-26T10:23:29.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095487+0000", 2024-04-26T10:23:29.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011189899999999999 2024-04-26T10:23:29.117 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.118 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.118 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.118 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:251473 5.a 5:554aefbf:::benchmark_data_smithi052_19421_object122001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:29.118 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:29.095342+0000", 2024-04-26T10:23:29.118 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00035222299999999998, 2024-04-26T10:23:29.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00071193700000000005, 2024-04-26T10:23:29.118 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.118 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:29.118 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.118 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.118 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.118 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 251473 2024-04-26T10:23:29.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.119 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095342+0000", 2024-04-26T10:23:29.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095342+0000", 2024-04-26T10:23:29.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095341+0000", 2024-04-26T10:23:29.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095347+0000", 2024-04-26T10:23:29.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6690000000000003e-06 2024-04-26T10:23:29.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.120 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095362+0000", 2024-04-26T10:23:29.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5218999999999999e-05 2024-04-26T10:23:29.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.120 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095367+0000", 2024-04-26T10:23:29.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.1340000000000003e-06 2024-04-26T10:23:29.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095412+0000", 2024-04-26T10:23:29.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4669000000000002e-05 2024-04-26T10:23:29.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095564+0000", 2024-04-26T10:23:29.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015201799999999999 2024-04-26T10:23:29.121 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.121 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.121 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.122 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:251470 5.d e72/37 5:ba591e04:::benchmark_data_smithi052_19421_object121998:head v 72'15861, mlcod=72'15859)", 2024-04-26T10:23:29.122 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:29.095445+0000", 2024-04-26T10:23:29.122 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.00024977799999999998, 2024-04-26T10:23:29.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00066383800000000004, 2024-04-26T10:23:29.122 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.122 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:29.122 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095445+0000", 2024-04-26T10:23:29.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095445+0000", 2024-04-26T10:23:29.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095444+0000", 2024-04-26T10:23:29.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095457+0000", 2024-04-26T10:23:29.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3559e-05 2024-04-26T10:23:29.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095466+0000", 2024-04-26T10:23:29.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9460000000000004e-06 2024-04-26T10:23:29.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095473+0000", 2024-04-26T10:23:29.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3350000000000003e-06 2024-04-26T10:23:29.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095515+0000", 2024-04-26T10:23:29.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2781000000000003e-05 2024-04-26T10:23:29.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.125 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095535+0000", 2024-04-26T10:23:29.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.9848999999999999e-05 2024-04-26T10:23:29.125 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.125 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.125 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.125 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:251467 5.9 e72/37 5:9c3bfab7:::benchmark_data_smithi052_19421_object121995:head v 72'15822, mlcod=72'15819)", 2024-04-26T10:23:29.125 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:29.095486+0000", 2024-04-26T10:23:29.125 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.000208657, 2024-04-26T10:23:29.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00067449999999999997, 2024-04-26T10:23:29.126 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.126 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:29.126 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095486+0000", 2024-04-26T10:23:29.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095486+0000", 2024-04-26T10:23:29.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095485+0000", 2024-04-26T10:23:29.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:29.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095490+0000", 2024-04-26T10:23:29.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.4769999999999997e-06 2024-04-26T10:23:29.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095496+0000", 2024-04-26T10:23:29.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6710000000000004e-06 2024-04-26T10:23:29.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095500+0000", 2024-04-26T10:23:29.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2130000000000002e-06 2024-04-26T10:23:29.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095543+0000", 2024-04-26T10:23:29.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3511999999999999e-05 2024-04-26T10:23:29.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095564+0000", 2024-04-26T10:23:29.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.033e-05 2024-04-26T10:23:29.129 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.129 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.129 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.129 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:251475 5.e 5:75ec51b1:::benchmark_data_smithi052_19421_object122003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:29.129 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:29.095756+0000", 2024-04-26T10:23:29.129 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9999385, 2024-04-26T10:23:29.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000456322, 2024-04-26T10:23:29.129 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.130 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:29.130 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.130 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.130 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.130 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 251475 2024-04-26T10:23:29.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.130 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.130 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095756+0000", 2024-04-26T10:23:29.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.130 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095756+0000", 2024-04-26T10:23:29.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095755+0000", 2024-04-26T10:23:29.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095761+0000", 2024-04-26T10:23:29.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1020000000000002e-06 2024-04-26T10:23:29.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095771+0000", 2024-04-26T10:23:29.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0421000000000001e-05 2024-04-26T10:23:29.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095779+0000", 2024-04-26T10:23:29.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5320000000000001e-06 2024-04-26T10:23:29.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.095899+0000", 2024-04-26T10:23:29.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120054 2024-04-26T10:23:29.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:29.096074+0000", 2024-04-26T10:23:29.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017474 2024-04-26T10:23:29.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.133 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.133 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.133 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:23:29.133 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 9 2024-04-26T10:23:29.133 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:29.134 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:29.173 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:29.167+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:29.260 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:29.260 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:29.261 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:23:29.261 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:23:29.261 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:29.272 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:29.273 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:29.267+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:29.375 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:29.371+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:29.400 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:29.400 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:23:29.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:23:29.400 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:29.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.401 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:29.401 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:29.401 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.867133921999994, 2024-04-26T10:23:29.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:23:29.401 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.401 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.402 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.402 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.402 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.402 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:23:29.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.402 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:29.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:29.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:23:29.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:29.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:23:29.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:23:29.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:23:29.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:23:29.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:23:29.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:23:29.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:23:29.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:23:29.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:23:29.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:23:29.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:23:29.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:23:29.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:23:29.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:23:29.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:23:29.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:23:29.410 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.410 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.410 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.410 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:29.410 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:29.410 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.865151694999994, 2024-04-26T10:23:29.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:23:29.411 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.411 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.411 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.411 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.411 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.411 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:23:29.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.411 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:29.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:29.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:23:29.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:23:29.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:23:29.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:23:29.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:23:29.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:23:29.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:23:29.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:23:29.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:23:29.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:23:29.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:23:29.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:23:29.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:23:29.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:23:29.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:23:29.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:23:29.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:23:29.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:23:29.415 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.415 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.415 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.415 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:29.415 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:29.415 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.864952310999996, 2024-04-26T10:23:29.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:23:29.415 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.416 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.416 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.416 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.416 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.416 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:23:29.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.416 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:29.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:29.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:29.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:29.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:23:29.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:23:29.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:23:29.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:23:29.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:23:29.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:23:29.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:23:29.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:23:29.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:23:29.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:23:29.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:23:29.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:23:29.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:23:29.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:23:29.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:23:29.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:23:29.420 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.420 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.420 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.420 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:23:29.420 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:29.420 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.864733690999998, 2024-04-26T10:23:29.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:23:29.420 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.420 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.421 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:29.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:29.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:23:29.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:23:29.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:23:29.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:23:29.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:23:29.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:23:29.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:23:29.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:23:29.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:23:29.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:23:29.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:23:29.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:23:29.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:23:29.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:23:29.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:23:29.424 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.424 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.424 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.424 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:29.424 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:29.424 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.862362253000001, 2024-04-26T10:23:29.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:23:29.425 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.425 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.425 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.425 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.425 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.425 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:23:29.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.425 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:29.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:29.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:23:29.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:29.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:23:29.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:23:29.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:23:29.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:23:29.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:23:29.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:23:29.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:29.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:23:29.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:23:29.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:23:29.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:23:29.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:23:29.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:23:29.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:23:29.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:23:29.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:23:29.429 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.429 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.429 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.429 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:29.429 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:29.429 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.862261630999996, 2024-04-26T10:23:29.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:23:29.429 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.430 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.430 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.430 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.430 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.430 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:23:29.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.430 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:29.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:29.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:23:29.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:29.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:23:29.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:23:29.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:23:29.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:23:29.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:23:29.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:23:29.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:23:29.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:23:29.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:23:29.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:23:29.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:23:29.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:23:29.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.433 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:23:29.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:23:29.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:23:29.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:23:29.434 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.434 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.434 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.434 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:23:29.434 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:29.434 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.862143070000002, 2024-04-26T10:23:29.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:23:29.434 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.434 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.434 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:29.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:29.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:23:29.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:23:29.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:23:29.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:23:29.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:23:29.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:23:29.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:23:29.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:23:29.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:23:29.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:23:29.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:23:29.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:23:29.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:23:29.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:23:29.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:23:29.438 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.438 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.438 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.438 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:29.438 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:29.438 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.862040672000006, 2024-04-26T10:23:29.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:23:29.439 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.439 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.439 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.439 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.439 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.439 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:23:29.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.439 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:29.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:29.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:23:29.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:29.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:23:29.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:23:29.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:23:29.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:23:29.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:23:29.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:23:29.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:29.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:23:29.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:23:29.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:23:29.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:23:29.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:23:29.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:23:29.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:23:29.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:23:29.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:23:29.443 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.443 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.443 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.443 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:29.443 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:29.443 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.861020115000002, 2024-04-26T10:23:29.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:23:29.443 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.443 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.444 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.444 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.444 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.444 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:23:29.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.444 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:29.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:29.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:23:29.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:23:29.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:23:29.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:23:29.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:23:29.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:23:29.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:23:29.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:23:29.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:23:29.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:23:29.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:23:29.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:23:29.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:23:29.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:23:29.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:23:29.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:23:29.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:23:29.448 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.448 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.448 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.448 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:29.448 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:29.448 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 88.859869840000002, 2024-04-26T10:23:29.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:23:29.449 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.449 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.449 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.449 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.449 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.449 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:23:29.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.449 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:29.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:29.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:23:29.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:29.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:23:29.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:23:29.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:23:29.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:23:29.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:23:29.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:23:29.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:23:29.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:23:29.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:23:29.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:23:29.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:23:29.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:23:29.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:23:29.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:23:29.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:23:29.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:23:29.453 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.453 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.453 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.453 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:29.453 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:29.453 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 65.363170597999996, 2024-04-26T10:23:29.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:23:29.454 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.454 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.454 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.454 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.454 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.454 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:23:29.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.454 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:29.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:29.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:23:29.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:23:29.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:23:29.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:23:29.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:23:29.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:23:29.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:23:29.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:23:29.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:23:29.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:23:29.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:23:29.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:29.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:23:29.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:23:29.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:23:29.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:23:29.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:29.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:23:29.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:23:29.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:23:29.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:23:29.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:23:29.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:23:29.459 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.459 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.459 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.460 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:29.460 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:29.460 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 65.362947001999999, 2024-04-26T10:23:29.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:23:29.460 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.460 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.460 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.460 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.460 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.460 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:23:29.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.460 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:29.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:29.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:23:29.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:29.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:23:29.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:23:29.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:23:29.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:23:29.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:23:29.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:23:29.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:23:29.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:23:29.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:23:29.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:23:29.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:29.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:23:29.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:23:29.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:23:29.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:23:29.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:29.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:23:29.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:23:29.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:23:29.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:23:29.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:23:29.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:23:29.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.465 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.465 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:29.465 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:29.465 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.332100681999997, 2024-04-26T10:23:29.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:23:29.465 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.465 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.465 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.466 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.466 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.466 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:23:29.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.466 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:29.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:29.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:23:29.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:23:29.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:23:29.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:23:29.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:23:29.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:23:29.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:23:29.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:23:29.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:23:29.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:23:29.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:23:29.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:29.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:23:29.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:23:29.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:29.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:23:29.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:23:29.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:23:29.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:23:29.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:23:29.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:23:29.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:23:29.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:23:29.471 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.471 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.471 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.471 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:29.471 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:29.471 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.330089579000003, 2024-04-26T10:23:29.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:23:29.472 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.472 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.472 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.472 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.472 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.472 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:23:29.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.472 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:29.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:29.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:29.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:29.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:23:29.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:23:29.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:23:29.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:23:29.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:23:29.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:23:29.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:23:29.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:23:29.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:23:29.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:23:29.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:29.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:23:29.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:23:29.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:29.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:23:29.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:23:29.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:23:29.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:23:29.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:23:29.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:23:29.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:23:29.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:23:29.477 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.477 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.477 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.477 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:29.477 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:29.477 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.319211473999999, 2024-04-26T10:23:29.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:23:29.477 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.478 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.478 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.478 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.478 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.478 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:23:29.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.478 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:29.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:29.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:23:29.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:29.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:23:29.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:23:29.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:23:29.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:23:29.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:23:29.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:23:29.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:23:29.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:23:29.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:23:29.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:23:29.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:29.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:23:29.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:23:29.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:29.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:23:29.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:23:29.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:23:29.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:23:29.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:23:29.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:23:29.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:23:29.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:23:29.483 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.483 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.483 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.483 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:29.483 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:29.483 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.316530255000004, 2024-04-26T10:23:29.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:23:29.483 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.484 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.484 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.484 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.484 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.484 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:23:29.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.484 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:29.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:29.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:23:29.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:29.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:23:29.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:23:29.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:23:29.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:23:29.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:23:29.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:23:29.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:23:29.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:23:29.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:23:29.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:23:29.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:29.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:23:29.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:23:29.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:29.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:23:29.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:23:29.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:23:29.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:23:29.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:23:29.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:23:29.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:23:29.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:23:29.489 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.489 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.489 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.489 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:29.489 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:29.489 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.316163179999997, 2024-04-26T10:23:29.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:23:29.489 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.489 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.489 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.489 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.489 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.490 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:23:29.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.490 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:29.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:29.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:23:29.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.491 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.491 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:23:29.491 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:23:29.491 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.491 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:23:29.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:23:29.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:23:29.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:23:29.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.492 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.492 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.492 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:23:29.492 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:23:29.492 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:23:29.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:23:29.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:23:29.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:23:29.493 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.493 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.493 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.493 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:23:29.493 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:23:29.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.494 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.494 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:23:29.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:23:29.494 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.494 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.494 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.494 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.494 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.494 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:29.494 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:29.494 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.316098928000002, 2024-04-26T10:23:29.494 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:23:29.495 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.495 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.495 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.495 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.495 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.495 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:23:29.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.495 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.495 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.495 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:29.495 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.495 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.495 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:29.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:23:29.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:29.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.496 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.496 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:23:29.496 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:23:29.496 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.496 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:23:29.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:23:29.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:23:29.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:23:29.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.497 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.497 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:23:29.497 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:23:29.497 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.497 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:23:29.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:23:29.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:23:29.498 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:23:29.498 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.498 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.498 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.498 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:23:29.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:23:29.499 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.499 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.499 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.499 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:23:29.499 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:23:29.499 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.499 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.499 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.500 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.500 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:29.500 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:29.500 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.311700254999998, 2024-04-26T10:23:29.500 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:23:29.500 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.500 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.500 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.500 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.500 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.500 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:23:29.500 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.501 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:29.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.501 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.501 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.501 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:29.501 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.501 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:23:29.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:29.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:23:29.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:23:29.502 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.502 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.502 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.502 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:23:29.502 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:23:29.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:23:29.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:23:29.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:23:29.503 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:23:29.503 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.503 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.503 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.503 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:23:29.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:23:29.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:23:29.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:23:29.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:23:29.504 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:23:29.504 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.504 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.504 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.504 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:23:29.505 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:23:29.505 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.505 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.505 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.505 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.505 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.505 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:29.506 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:29.506 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 58.309942272000001, 2024-04-26T10:23:29.506 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:23:29.506 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:29.506 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:29.506 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:29.506 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:29.506 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.507 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:23:29.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.507 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:29.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:29.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:29.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:29.507 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:29.507 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:29.507 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.507 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.507 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:29.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:23:29.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:29.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:23:29.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:23:29.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.508 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:29.508 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:23:29.508 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:23:29.508 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.508 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:23:29.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:23:29.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:29.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:23:29.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:23:29.509 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.509 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.509 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:29.509 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:23:29.509 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:23:29.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:29.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:23:29.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:23:29.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:29.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:23:29.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:23:29.510 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.510 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.510 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:29.510 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:23:29.510 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:23:29.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:29.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:23:29.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:23:29.511 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:29.511 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:29.511 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:29.511 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:23:29.511 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:23:29.511 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.512 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.512 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.512 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:29.512 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:29.512 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:29.513 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:29.514 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:29.507+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:29.614 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:29.611+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:29.642 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:29.642 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:29.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.642 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:252805 5.4 5:2cf0e64b:::benchmark_data_smithi052_19421_object123333:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:29.642 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:29.631245+0000", 2024-04-26T10:23:29.642 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0090193540000000003, 2024-04-26T10:23:29.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090361529999999999, 2024-04-26T10:23:29.642 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:29.642 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 252805 2024-04-26T10:23:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631245+0000", 2024-04-26T10:23:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631245+0000", 2024-04-26T10:23:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:29.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631244+0000", 2024-04-26T10:23:29.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:29.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631250+0000", 2024-04-26T10:23:29.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4099999999999999e-06 2024-04-26T10:23:29.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:29.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631267+0000", 2024-04-26T10:23:29.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.7481000000000001e-05 2024-04-26T10:23:29.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631274+0000", 2024-04-26T10:23:29.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1600000000000001e-06 2024-04-26T10:23:29.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:29.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631307+0000", 2024-04-26T10:23:29.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3142999999999998e-05 2024-04-26T10:23:29.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:29.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631443+0000", 2024-04-26T10:23:29.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00013578400000000001 2024-04-26T10:23:29.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:29.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631541+0000", 2024-04-26T10:23:29.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8344000000000006e-05 2024-04-26T10:23:29.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:29.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.637111+0000", 2024-04-26T10:23:29.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0055693519999999996 2024-04-26T10:23:29.646 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.646 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:29.646 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.647 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:252806 5.f 5:fb67b41b:::benchmark_data_smithi052_19421_object123334:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:29.647 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:29.631296+0000", 2024-04-26T10:23:29.647 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0089684320000000001, 2024-04-26T10:23:29.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090353350000000002, 2024-04-26T10:23:29.647 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:29.647 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:29.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:29.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:29.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.647 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 252806 2024-04-26T10:23:29.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.647 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:29.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:29.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631296+0000", 2024-04-26T10:23:29.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:29.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631296+0000", 2024-04-26T10:23:29.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:29.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631295+0000", 2024-04-26T10:23:29.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:29.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:29.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631299+0000", 2024-04-26T10:23:29.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9469999999999996e-06 2024-04-26T10:23:29.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:29.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631306+0000", 2024-04-26T10:23:29.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9310000000000002e-06 2024-04-26T10:23:29.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631312+0000", 2024-04-26T10:23:29.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.224e-06 2024-04-26T10:23:29.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:29.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631358+0000", 2024-04-26T10:23:29.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5074999999999998e-05 2024-04-26T10:23:29.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:29.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631484+0000", 2024-04-26T10:23:29.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012610900000000001 2024-04-26T10:23:29.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:29.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631589+0000", 2024-04-26T10:23:29.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105451 2024-04-26T10:23:29.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:29.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.634137+0000", 2024-04-26T10:23:29.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0025474899999999999 2024-04-26T10:23:29.651 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.651 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:29.651 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.651 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:252807 5.d 5:b1637646:::benchmark_data_smithi052_19421_object123335:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:29.651 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:29.631330+0000", 2024-04-26T10:23:29.651 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0089346700000000005, 2024-04-26T10:23:29.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0090633410000000008, 2024-04-26T10:23:29.651 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:29.651 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:29.651 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:29.651 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:29.651 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.652 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 252807 2024-04-26T10:23:29.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.652 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:29.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:29.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631330+0000", 2024-04-26T10:23:29.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:29.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631330+0000", 2024-04-26T10:23:29.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:29.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631329+0000", 2024-04-26T10:23:29.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:29.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:29.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631332+0000", 2024-04-26T10:23:29.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5979999999999999e-06 2024-04-26T10:23:29.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:29.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631343+0000", 2024-04-26T10:23:29.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1481000000000001e-05 2024-04-26T10:23:29.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631349+0000", 2024-04-26T10:23:29.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4229999999999996e-06 2024-04-26T10:23:29.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:29.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631416+0000", 2024-04-26T10:23:29.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7340000000000002e-05 2024-04-26T10:23:29.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:29.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631538+0000", 2024-04-26T10:23:29.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012199 2024-04-26T10:23:29.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:29.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.631647+0000", 2024-04-26T10:23:29.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010880899999999999 2024-04-26T10:23:29.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:29.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.635376+0000", 2024-04-26T10:23:29.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037284850000000001 2024-04-26T10:23:29.655 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.655 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:29.655 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.655 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:252808 5.4 5:27f399fd:::benchmark_data_smithi052_19421_object123336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:29.656 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:29.633467+0000", 2024-04-26T10:23:29.656 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0067974580000000001, 2024-04-26T10:23:29.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070030329999999997, 2024-04-26T10:23:29.656 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:29.656 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:29.656 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:29.656 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:29.656 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.656 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 252808 2024-04-26T10:23:29.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.656 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:29.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:29.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633467+0000", 2024-04-26T10:23:29.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:29.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633467+0000", 2024-04-26T10:23:29.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:29.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633466+0000", 2024-04-26T10:23:29.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:29.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:29.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633470+0000", 2024-04-26T10:23:29.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8800000000000001e-06 2024-04-26T10:23:29.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:29.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633477+0000", 2024-04-26T10:23:29.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3430000000000001e-06 2024-04-26T10:23:29.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633481+0000", 2024-04-26T10:23:29.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9890000000000003e-06 2024-04-26T10:23:29.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:29.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633576+0000", 2024-04-26T10:23:29.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5242999999999996e-05 2024-04-26T10:23:29.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:29.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633662+0000", 2024-04-26T10:23:29.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5945000000000005e-05 2024-04-26T10:23:29.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:29.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633781+0000", 2024-04-26T10:23:29.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119455 2024-04-26T10:23:29.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:29.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.637119+0000", 2024-04-26T10:23:29.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0033374920000000001 2024-04-26T10:23:29.660 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.660 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:29.660 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.660 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:252809 5.4 5:291ccfa0:::benchmark_data_smithi052_19421_object123337:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:29.660 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:29.633485+0000", 2024-04-26T10:23:29.660 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0067794320000000002, 2024-04-26T10:23:29.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0070619519999999998, 2024-04-26T10:23:29.660 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:29.660 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:29.660 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:29.660 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:29.660 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.661 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 252809 2024-04-26T10:23:29.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.661 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:29.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:29.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633485+0000", 2024-04-26T10:23:29.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:29.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633485+0000", 2024-04-26T10:23:29.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:29.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633485+0000", 2024-04-26T10:23:29.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:29.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:29.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633487+0000", 2024-04-26T10:23:29.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.03e-06 2024-04-26T10:23:29.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:29.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633490+0000", 2024-04-26T10:23:29.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.9950000000000001e-06 2024-04-26T10:23:29.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633494+0000", 2024-04-26T10:23:29.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.0459999999999999e-06 2024-04-26T10:23:29.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:29.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.635453+0000", 2024-04-26T10:23:29.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019589160000000002 2024-04-26T10:23:29.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:29.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.635560+0000", 2024-04-26T10:23:29.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107694 2024-04-26T10:23:29.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:29.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.635658+0000", 2024-04-26T10:23:29.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7845999999999998e-05 2024-04-26T10:23:29.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:29.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.637395+0000", 2024-04-26T10:23:29.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0017373429999999999 2024-04-26T10:23:29.664 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.664 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:29.664 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.664 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:252811 5.0 5:07273fc3:::benchmark_data_smithi052_19421_object123339:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:29.664 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:29.633712+0000", 2024-04-26T10:23:29.664 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0065525970000000003, 2024-04-26T10:23:29.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00690932, 2024-04-26T10:23:29.664 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:29.665 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:29.665 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:29.665 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:29.665 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.665 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 252811 2024-04-26T10:23:29.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.665 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:29.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:29.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633712+0000", 2024-04-26T10:23:29.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:29.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633712+0000", 2024-04-26T10:23:29.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:29.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633711+0000", 2024-04-26T10:23:29.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:29.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:29.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633720+0000", 2024-04-26T10:23:29.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8859999999999993e-06 2024-04-26T10:23:29.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:29.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633727+0000", 2024-04-26T10:23:29.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.8229999999999997e-06 2024-04-26T10:23:29.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633733+0000", 2024-04-26T10:23:29.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.6559999999999997e-06 2024-04-26T10:23:29.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:29.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633764+0000", 2024-04-26T10:23:29.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1735e-05 2024-04-26T10:23:29.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:29.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633850+0000", 2024-04-26T10:23:29.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.5048000000000003e-05 2024-04-26T10:23:29.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:29.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.633911+0000", 2024-04-26T10:23:29.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1611000000000004e-05 2024-04-26T10:23:29.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:29.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.635714+0000", 2024-04-26T10:23:29.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.001802398 2024-04-26T10:23:29.668 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.668 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:29.668 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.668 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:252815 5.0 5:0dc09ee4:::benchmark_data_smithi052_19421_object123343:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:29.669 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:29.635728+0000", 2024-04-26T10:23:29.669 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0045369090000000004, 2024-04-26T10:23:29.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.004971456, 2024-04-26T10:23:29.669 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:29.669 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:29.669 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:29.669 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:29.669 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.669 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 252815 2024-04-26T10:23:29.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.669 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:29.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:29.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.635728+0000", 2024-04-26T10:23:29.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:29.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.635728+0000", 2024-04-26T10:23:29.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:29.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.635727+0000", 2024-04-26T10:23:29.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:29.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.635732+0000", 2024-04-26T10:23:29.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7169999999999996e-06 2024-04-26T10:23:29.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:29.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.635742+0000", 2024-04-26T10:23:29.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7650000000000005e-06 2024-04-26T10:23:29.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.635749+0000", 2024-04-26T10:23:29.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1919999999999999e-06 2024-04-26T10:23:29.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:29.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.635781+0000", 2024-04-26T10:23:29.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1724999999999999e-05 2024-04-26T10:23:29.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:29.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.635900+0000", 2024-04-26T10:23:29.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000119454 2024-04-26T10:23:29.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:29.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.636042+0000", 2024-04-26T10:23:29.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000141874 2024-04-26T10:23:29.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:29.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.637979+0000", 2024-04-26T10:23:29.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019365230000000001 2024-04-26T10:23:29.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.673 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:29.673 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.673 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:252819 5.b 5:d38bfa39:::benchmark_data_smithi052_19421_object123347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:29.673 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:29.638027+0000", 2024-04-26T10:23:29.673 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.002236994, 2024-04-26T10:23:29.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0027518579999999998, 2024-04-26T10:23:29.673 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:29.673 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:29.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:29.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:29.674 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.674 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 252819 2024-04-26T10:23:29.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.674 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:29.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:29.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.638027+0000", 2024-04-26T10:23:29.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:29.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.638027+0000", 2024-04-26T10:23:29.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:29.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.638027+0000", 2024-04-26T10:23:29.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:29.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.638031+0000", 2024-04-26T10:23:29.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6820000000000002e-06 2024-04-26T10:23:29.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:29.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.638040+0000", 2024-04-26T10:23:29.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0070000000000003e-06 2024-04-26T10:23:29.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.638047+0000", 2024-04-26T10:23:29.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3029999999999996e-06 2024-04-26T10:23:29.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:29.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.638088+0000", 2024-04-26T10:23:29.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1794e-05 2024-04-26T10:23:29.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:29.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.638248+0000", 2024-04-26T10:23:29.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015967600000000001 2024-04-26T10:23:29.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:29.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.638361+0000", 2024-04-26T10:23:29.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112693 2024-04-26T10:23:29.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:29.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640505+0000", 2024-04-26T10:23:29.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002144469 2024-04-26T10:23:29.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.677 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:29.677 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.678 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:252821 5.f 5:f04d2f63:::benchmark_data_smithi052_19421_object123349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:29.678 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:29.638098+0000", 2024-04-26T10:23:29.678 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.0021666659999999998, 2024-04-26T10:23:29.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.002749413, 2024-04-26T10:23:29.678 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:29.678 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:29.678 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:29.678 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:29.679 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.679 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 252821 2024-04-26T10:23:29.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.679 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:29.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:29.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.638098+0000", 2024-04-26T10:23:29.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:29.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.638098+0000", 2024-04-26T10:23:29.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:29.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.638097+0000", 2024-04-26T10:23:29.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:29.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:29.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.638100+0000", 2024-04-26T10:23:29.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0709999999999999e-06 2024-04-26T10:23:29.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:29.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.638240+0000", 2024-04-26T10:23:29.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001392 2024-04-26T10:23:29.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.638249+0000", 2024-04-26T10:23:29.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2359999999999993e-06 2024-04-26T10:23:29.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:29.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.638283+0000", 2024-04-26T10:23:29.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.3900999999999999e-05 2024-04-26T10:23:29.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:29.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.638392+0000", 2024-04-26T10:23:29.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000109455 2024-04-26T10:23:29.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:29.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.638496+0000", 2024-04-26T10:23:29.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000103959 2024-04-26T10:23:29.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:29.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640723+0000", 2024-04-26T10:23:29.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0022264400000000001 2024-04-26T10:23:29.682 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.682 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:29.682 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.683 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:252823 5.0 5:021ed70d:::benchmark_data_smithi052_19421_object123351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:29.683 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:29.639937+0000", 2024-04-26T10:23:29.683 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 0.00032777799999999998, 2024-04-26T10:23:29.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00097611099999999999, 2024-04-26T10:23:29.683 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:29.683 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:29.683 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:29.683 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:29.683 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.683 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 252823 2024-04-26T10:23:29.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.683 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:29.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:29.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.639937+0000", 2024-04-26T10:23:29.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:29.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.639937+0000", 2024-04-26T10:23:29.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:29.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.639936+0000", 2024-04-26T10:23:29.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:29.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.639942+0000", 2024-04-26T10:23:29.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9680000000000003e-06 2024-04-26T10:23:29.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:29.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.639958+0000", 2024-04-26T10:23:29.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6223999999999999e-05 2024-04-26T10:23:29.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.639966+0000", 2024-04-26T10:23:29.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6320000000000008e-06 2024-04-26T10:23:29.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:29.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640014+0000", 2024-04-26T10:23:29.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8052e-05 2024-04-26T10:23:29.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:29.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640159+0000", 2024-04-26T10:23:29.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000145029 2024-04-26T10:23:29.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:29.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640302+0000", 2024-04-26T10:23:29.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014382899999999999 2024-04-26T10:23:29.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.686 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:29.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.687 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:252824 5.3 5:c098a4d3:::benchmark_data_smithi052_19421_object123352:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:29.687 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:29.640275+0000", 2024-04-26T10:23:29.687 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999895, 2024-04-26T10:23:29.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00069972999999999997, 2024-04-26T10:23:29.687 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:29.687 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "started", 2024-04-26T10:23:29.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:29.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:29.688 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.688 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 252824 2024-04-26T10:23:29.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.688 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:29.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:29.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640275+0000", 2024-04-26T10:23:29.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:29.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640275+0000", 2024-04-26T10:23:29.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:29.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640274+0000", 2024-04-26T10:23:29.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:29.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:29.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640279+0000", 2024-04-26T10:23:29.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0880000000000002e-06 2024-04-26T10:23:29.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:29.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640295+0000", 2024-04-26T10:23:29.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5690999999999999e-05 2024-04-26T10:23:29.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640302+0000", 2024-04-26T10:23:29.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1849999999999998e-06 2024-04-26T10:23:29.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:29.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640349+0000", 2024-04-26T10:23:29.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7021999999999998e-05 2024-04-26T10:23:29.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:29.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640466+0000", 2024-04-26T10:23:29.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0001175 2024-04-26T10:23:29.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.691 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:29.691 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.691 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:252825 5.9 5:9079ce62:::benchmark_data_smithi052_19421_object123353:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:29.691 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:23:29.640325+0000", 2024-04-26T10:23:29.691 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 4294967295.9999394, 2024-04-26T10:23:29.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071351800000000001, 2024-04-26T10:23:29.691 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:29.691 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "waiting for sub ops", 2024-04-26T10:23:29.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:29.691 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:29.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:29.692 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 252825 2024-04-26T10:23:29.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.692 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:29.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:29.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640325+0000", 2024-04-26T10:23:29.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:29.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640325+0000", 2024-04-26T10:23:29.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:29.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:29.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640324+0000", 2024-04-26T10:23:29.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:29.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:29.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640329+0000", 2024-04-26T10:23:29.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.2400000000000001e-06 2024-04-26T10:23:29.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:29.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640336+0000", 2024-04-26T10:23:29.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3370000000000002e-06 2024-04-26T10:23:29.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:29.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640342+0000", 2024-04-26T10:23:29.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0129999999999999e-06 2024-04-26T10:23:29.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:29.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640387+0000", 2024-04-26T10:23:29.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4539000000000002e-05 2024-04-26T10:23:29.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:29.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640509+0000", 2024-04-26T10:23:29.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012244999999999999 2024-04-26T10:23:29.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:29.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:29.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:29.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:23:29.640622+0000", 2024-04-26T10:23:29.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113489 2024-04-26T10:23:29.696 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.696 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:29.696 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.696 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:29.696 INFO:teuthology.orchestra.run.smithi120.stdout: ], 2024-04-26T10:23:29.696 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 12 2024-04-26T10:23:29.696 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:29.697 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:29.715 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:29.714+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:29.819 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:29.811+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:29.826 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:29.827 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:29.827 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:23:29.827 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:23:29.827 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:29.840 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:29.918 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:29.914+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:30.019 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:30.015+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:30.022 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:23:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:23:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.982025413000002, 2024-04-26T10:23:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:23:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.023 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:23:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:30.024 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:23:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:23:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.025 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:23:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:23:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:23:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:23:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:23:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:23:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.026 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:23:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:23:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:23:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:23:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:23:30.027 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:23:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:23:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:23:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.981916162000005, 2024-04-26T10:23:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:23:30.028 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:23:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.029 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:23:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:23:30.030 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:23:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:23:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:23:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:23:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:23:30.031 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:23:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:23:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:23:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:23:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:23:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:23:30.032 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:23:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:23:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:23:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.979518749999997, 2024-04-26T10:23:30.033 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:23:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:23:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.034 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:23:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:23:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:23:30.035 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:23:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:23:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:23:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:23:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:23:30.036 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:23:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:23:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:23:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:23:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:23:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.037 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:23:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:23:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:23:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:23:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:23:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:23:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.038 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:23:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:23:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 65.979332826000004, 2024-04-26T10:23:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:23:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.039 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:23:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:30.040 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:23:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:23:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:23:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:23:30.041 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:23:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:23:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:23:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:23:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:23:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.042 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:23:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:23:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:23:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:23:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:23:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:23:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.043 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:23:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:23:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:23:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:23:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:23:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:23:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.044 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.889310209999998, 2024-04-26T10:23:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:23:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:23:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.045 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:30.046 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:23:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:23:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:23:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:23:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:23:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:23:30.047 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:23:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:23:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:23:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:23:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:23:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:23:30.048 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:23:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:23:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:23:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:23:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:23:30.049 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:23:30.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:23:30.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:23:30.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.050 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:23:30.050 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:23:30.050 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.050 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.050 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:23:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:23:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.866207963999997, 2024-04-26T10:23:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:23:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.051 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:23:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.052 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:23:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:23:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:23:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:23:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:23:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.053 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:23:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:23:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:23:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:23:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:23:30.054 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:23:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:23:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:23:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:23:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:23:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:23:30.055 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:23:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:23:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:23:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:23:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:23:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.056 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:23:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:23:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:23:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:23:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:30.057 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.859524825999998, 2024-04-26T10:23:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:23:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:23:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.058 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:23:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:23:30.059 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:23:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:23:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:23:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:23:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:23:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:23:30.060 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:23:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:23:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:23:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:23:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:23:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:23:30.061 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:23:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:23:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:23:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:23:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:23:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.062 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:23:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:23:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:23:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:23:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:23:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:23:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.063 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.857527040999997, 2024-04-26T10:23:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:23:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:23:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.064 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:23:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.065 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:23:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:23:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:23:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:23:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:23:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:23:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.066 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:23:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:23:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:23:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:23:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:23:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.067 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:23:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:23:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:23:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:23:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:23:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:23:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.068 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:23:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:23:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:23:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:23:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:23:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:23:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.069 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.848118335999999, 2024-04-26T10:23:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:23:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:23:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.070 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:23:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.071 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:23:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:23:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:23:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:23:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:23:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.072 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:23:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:23:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:23:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:23:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:23:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:23:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.073 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:23:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:23:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:23:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:23:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:23:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:23:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:30.074 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:23:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:23:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:23:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:23:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:23:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:23:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.075 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.846290287000002, 2024-04-26T10:23:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:23:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:23:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:30.076 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:23:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:23:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:23:30.077 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:23:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:23:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:23:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:23:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:23:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:23:30.078 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:23:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:23:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:23:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:23:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:23:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:23:30.079 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:23:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:23:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:23:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:23:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:23:30.080 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:23:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:23:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:23:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:23:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:23:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.081 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.834710565000002, 2024-04-26T10:23:30.082 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:23:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:23:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.083 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:23:30.084 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:23:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:23:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:23:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:23:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:23:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:23:30.085 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:23:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:23:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:23:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:23:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:23:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:23:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:23:30.086 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:23:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:23:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:23:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:23:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:23:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:23:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.087 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:23:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:23:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:23:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:23:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:30.088 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.828300071000001, 2024-04-26T10:23:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:23:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:23:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.089 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:23:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:23:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:23:30.090 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:23:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:23:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:23:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.091 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:23:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:23:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:23:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:23:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.093 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:23:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:23:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:23:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:23:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:23:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:23:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:30.094 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:23:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:23:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:23:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:23:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:23:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:23:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:23:30.095 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:23:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.815715007999998, 2024-04-26T10:23:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:23:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.096 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:23:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.097 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:23:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:23:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:23:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:23:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.098 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:23:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:23:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:23:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:23:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:23:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.099 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:23:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:23:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:23:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:23:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:23:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:23:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:23:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:23:30.100 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:23:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:23:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:23:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:23:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:23:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:23:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.101 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.815480074999996, 2024-04-26T10:23:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:23:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:23:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.102 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:23:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:30.103 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:23:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:23:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:23:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:23:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:23:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:23:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.104 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:23:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:23:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:23:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.105 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:23:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:23:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:23:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:23:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:23:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:23:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.106 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:23:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:23:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:23:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:23:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:23:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:23:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.107 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:23:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:23:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.777605198000003, 2024-04-26T10:23:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:23:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.108 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:23:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:30.109 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.110 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:30.110 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.110 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.110 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.110 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:23:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:23:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:23:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:23:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:23:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.111 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:23:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:23:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:23:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:23:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:23:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.112 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:23:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:23:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:23:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:23:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:23:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:23:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.113 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:23:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:23:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:23:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:23:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:23:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:23:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.114 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:23:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:23:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.777160172999999, 2024-04-26T10:23:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:23:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.115 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:23:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.116 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:23:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:23:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:23:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:23:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:23:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.117 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:23:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:23:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:23:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:23:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:23:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:23:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.118 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:23:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:23:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:23:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:23:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:23:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:23:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.119 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:23:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:23:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:23:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:23:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:23:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:23:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.120 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:23:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:23:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.765557172999998, 2024-04-26T10:23:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:23:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.121 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:23:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.122 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.123 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.123 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:23:30.123 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:30.123 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.123 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.124 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:23:30.124 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:23:30.124 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.124 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.124 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:23:30.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:23:30.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.125 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.125 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.125 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:23:30.125 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:23:30.125 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:23:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:23:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:23:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:23:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.126 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:23:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:23:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:23:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:23:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:23:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:23:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.127 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:23:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:23:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:23:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:23:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.128 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:23:30.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:23:30.129 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.129 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.129 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.129 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:23:30.129 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:23:30.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.129 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.129 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.764283583000001, 2024-04-26T10:23:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:23:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:23:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.130 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:23:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.131 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:23:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:23:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:23:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:23:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:23:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:23:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.132 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:23:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:23:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:23:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:23:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:23:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:23:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.133 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:23:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:23:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:23:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:23:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:23:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:23:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.134 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:23:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:23:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:23:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:23:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:23:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:23:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.135 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.747526282000003, 2024-04-26T10:23:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:23:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:23:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.136 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:23:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.137 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:23:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:23:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:23:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:23:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:23:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:23:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.138 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:23:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:23:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:23:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:23:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:23:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:23:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.139 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:23:30.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:23:30.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:30.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:23:30.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:23:30.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:30.140 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:23:30.140 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:23:30.140 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.140 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.140 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:23:30.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:23:30.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:23:30.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:23:30.141 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.141 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.141 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.141 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:23:30.141 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:23:30.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.141 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.141 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.142 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:30.142 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:30.142 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 40.702614261000001, 2024-04-26T10:23:30.142 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:23:30.142 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:30.142 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:30.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:30.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:30.142 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.142 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:23:30.142 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.142 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:30.142 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:30.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:30.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:30.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:30.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:30.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:30.143 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:23:30.143 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:30.143 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.143 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.143 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:30.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:23:30.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:23:30.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:30.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:23:30.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:23:30.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:23:30.144 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:23:30.144 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.144 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.144 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.144 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:23:30.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:23:30.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:30.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:23:30.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:23:30.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:30.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:23:30.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:23:30.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.145 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.145 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:30.145 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:23:30.145 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:23:30.145 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:30.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:23:30.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:23:30.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:30.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:23:30.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:23:30.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.146 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:30.146 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:23:30.146 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:23:30.146 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.146 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:30.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:23:30.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:23:30.147 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:30.147 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:30.147 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:30.147 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:23:30.147 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:23:30.147 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.147 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.147 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.147 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:30.147 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:30.147 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:30.148 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:23:30.150 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:30.150 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:30.143+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:30.250 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:30.250+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:30.283 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:30.283 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:30.283 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.283 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:254398 5.e 5:708aacd7:::benchmark_data_smithi052_19421_object124926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:30.283 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:30.280001+0000", 2024-04-26T10:23:30.283 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0032250479999999999, 2024-04-26T10:23:30.283 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0032503639999999999, 2024-04-26T10:23:30.283 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:30.283 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:30.283 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:30.283 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:30.284 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.284 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 254398 2024-04-26T10:23:30.284 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.284 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:30.284 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.284 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:30.284 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.280001+0000", 2024-04-26T10:23:30.284 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:30.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:30.285 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.280001+0000", 2024-04-26T10:23:30.285 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:30.285 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.285 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.285 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:30.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.280000+0000", 2024-04-26T10:23:30.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:30.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:30.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.280005+0000", 2024-04-26T10:23:30.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4539999999999998e-06 2024-04-26T10:23:30.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:30.286 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.280036+0000", 2024-04-26T10:23:30.286 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0654999999999997e-05 2024-04-26T10:23:30.286 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.286 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.286 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.280042+0000", 2024-04-26T10:23:30.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7420000000000003e-06 2024-04-26T10:23:30.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:30.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.280078+0000", 2024-04-26T10:23:30.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.6414000000000001e-05 2024-04-26T10:23:30.287 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.287 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.287 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:30.287 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.280182+0000", 2024-04-26T10:23:30.287 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000103831 2024-04-26T10:23:30.287 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:30.287 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:30.287 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:30.288 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.288 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.288 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:254407 5.e 5:7d3f9e2a:::benchmark_data_smithi052_19421_object124935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-04-26T10:23:30.288 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:30.281881+0000", 2024-04-26T10:23:30.288 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.0013450980000000001, 2024-04-26T10:23:30.288 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001420291, 2024-04-26T10:23:30.288 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:30.288 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:30.288 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:30.288 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:30.289 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:30.289 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 254407 2024-04-26T10:23:30.289 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.289 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:30.289 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.289 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:30.289 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.281881+0000", 2024-04-26T10:23:30.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:30.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:30.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.281881+0000", 2024-04-26T10:23:30.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:30.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:30.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.281879+0000", 2024-04-26T10:23:30.290 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:30.290 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.290 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.290 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:30.290 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.281885+0000", 2024-04-26T10:23:30.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.0000000000000002e-06 2024-04-26T10:23:30.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:30.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.281899+0000", 2024-04-26T10:23:30.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.331e-05 2024-04-26T10:23:30.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.281906+0000", 2024-04-26T10:23:30.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.0520000000000004e-06 2024-04-26T10:23:30.291 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.291 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.291 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:30.291 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.282268+0000", 2024-04-26T10:23:30.291 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00036230000000000002 2024-04-26T10:23:30.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.292 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:30.292 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.282364+0000", 2024-04-26T10:23:30.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6238999999999998e-05 2024-04-26T10:23:30.292 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:30.292 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:30.292 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:30.292 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.292 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.292 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:254397 5.9 e72/37 5:94b65996:::benchmark_data_smithi052_19421_object124925:head v 72'15995, mlcod=72'15990)", 2024-04-26T10:23:30.292 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:30.283086+0000", 2024-04-26T10:23:30.292 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 0.000140142, 2024-04-26T10:23:30.292 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00028034799999999998, 2024-04-26T10:23:30.292 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:30.292 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:30.293 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:30.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:30.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.283086+0000", 2024-04-26T10:23:30.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:30.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:30.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.283086+0000", 2024-04-26T10:23:30.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:30.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.293 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.293 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:30.293 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.283085+0000", 2024-04-26T10:23:30.293 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:30.293 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:30.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.283091+0000", 2024-04-26T10:23:30.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4219999999999999e-06 2024-04-26T10:23:30.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:30.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.283100+0000", 2024-04-26T10:23:30.294 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.9029999999999993e-06 2024-04-26T10:23:30.294 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.294 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.294 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.294 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.283104+0000", 2024-04-26T10:23:30.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2540000000000003e-06 2024-04-26T10:23:30.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:30.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.283135+0000", 2024-04-26T10:23:30.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1081000000000003e-05 2024-04-26T10:23:30.295 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.295 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.295 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:30.295 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.283151+0000", 2024-04-26T10:23:30.295 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5668e-05 2024-04-26T10:23:30.297 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:30.297 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:30.297 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:30.297 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.297 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.297 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:254404 5.0 e72/54 5:05678831:::benchmark_data_smithi052_19421_object124932:head v 72'15944, mlcod=72'15941)", 2024-04-26T10:23:30.297 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:23:30.283259+0000", 2024-04-26T10:23:30.297 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 4294967295.9999671, 2024-04-26T10:23:30.297 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000163664, 2024-04-26T10:23:30.297 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:30.298 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "started", 2024-04-26T10:23:30.298 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:30.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:30.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.283259+0000", 2024-04-26T10:23:30.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:30.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:30.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.283259+0000", 2024-04-26T10:23:30.298 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:30.298 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.298 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.298 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:30.298 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.283258+0000", 2024-04-26T10:23:30.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:30.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:30.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.283264+0000", 2024-04-26T10:23:30.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3149999999999997e-06 2024-04-26T10:23:30.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.299 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:30.299 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.283274+0000", 2024-04-26T10:23:30.299 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0025e-05 2024-04-26T10:23:30.299 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.299 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:30.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.283279+0000", 2024-04-26T10:23:30.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7119999999999999e-06 2024-04-26T10:23:30.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:30.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.283321+0000", 2024-04-26T10:23:30.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1428999999999999e-05 2024-04-26T10:23:30.300 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:30.300 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:30.300 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:30.300 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:23:30.283346+0000", 2024-04-26T10:23:30.300 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.5789e-05 2024-04-26T10:23:30.300 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:30.300 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:30.300 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:30.301 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:30.301 INFO:teuthology.orchestra.run.smithi154.stdout: ], 2024-04-26T10:23:30.301 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 4 2024-04-26T10:23:30.301 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:30.301 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:23:30.302 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:30.321 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:23:30.322 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:23:30.322 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:23:30.322 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:23:30.327 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:23:30.327 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:23:30.352 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:30.350+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:30.380 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-26T10:23:30.418 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:30.418 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:30.430 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:30.471 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:30.470+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:30.553 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:30.550+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:30.588 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:30.588 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:30.600 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:30.654 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:30.650+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:30.729 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:30.729 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:30.742 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:30.755 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:30.751+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:30.856 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:30.851+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:30.873 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:30.874 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:30.886 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:30.958 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:30.951+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:31.059 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:31.058+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:31.064 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:31.064 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:31.077 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:31.160 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:31.158+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:31.207 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:31.208 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:31.219 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:31.260 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:31.255+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:31.339 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:31.339 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:31.351 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:31.374 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is set 2024-04-26T10:23:31.400 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:31.398+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:31.464 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:31.459+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:31.474 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:31.474 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:31.486 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:31.563 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:31.562+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:31.612 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:31.612 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:31.627 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:31.664 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:31.662+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:31.762 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:31.763 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:31.764 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:31.759+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:31.775 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:31.866 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:31.862+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:31.906 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:31.906 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:31.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:31.967 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:31.966+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:32.042 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:32.042 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:32.053 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:32.067 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:32.063+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:32.138 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Removed 129469 objects 2024-04-26T10:23:32.139 INFO:tasks.radosbench.radosbench.0.smithi052.stdout:Clean up completed and total clean up time :58.5108 2024-04-26T10:23:32.166 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:32.166 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:32.169 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:32.163+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:32.175 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:32.270 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:32.263+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:32.276 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:32.276 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:32.285 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:32.328 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:23:32.371 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:32.367+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:32.400 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:32.401 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:32.410 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:32.472 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:32.467+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:32.479 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:23:32.502 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:23:32.503 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:23:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:23:32.504 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:23:32.508 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:23:32.508 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:23:32.515 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:32.515 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:32.515 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:23:32.515 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:23:32.515 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:32.525 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:32.572 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:32.570+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:32.673 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:32.670+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:32.675 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:32.675 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:23:32.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:23:32.676 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:32.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.676 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:32.676 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:32.676 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 68.632859495999995, 2024-04-26T10:23:32.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:23:32.676 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.676 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.676 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.676 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:23:32.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.677 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:32.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:32.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:32.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:32.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:23:32.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:23:32.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.678 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.678 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:23:32.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:23:32.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:23:32.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:23:32.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:23:32.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:23:32.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:23:32.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:23:32.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:23:32.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:23:32.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:23:32.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:23:32.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:23:32.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:23:32.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.681 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.681 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.681 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:32.681 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:32.681 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 68.632750244999997, 2024-04-26T10:23:32.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:23:32.681 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.681 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.682 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.682 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:23:32.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.682 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:32.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:32.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:32.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:32.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:23:32.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:23:32.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:23:32.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:23:32.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:23:32.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:23:32.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.684 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.684 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:23:32.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:23:32.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:23:32.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:23:32.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:23:32.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:23:32.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:23:32.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:23:32.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:23:32.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:23:32.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.686 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.686 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.686 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:32.686 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:32.686 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 68.630352833000003, 2024-04-26T10:23:32.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:23:32.686 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.686 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.686 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.687 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.687 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:23:32.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.687 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:32.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:32.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:23:32.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:32.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:23:32.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:23:32.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:23:32.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:23:32.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:23:32.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:23:32.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:23:32.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:23:32.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:23:32.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:23:32.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:32.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:23:32.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:23:32.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:23:32.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:23:32.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:32.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:23:32.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:23:32.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:23:32.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:23:32.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:23:32.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:23:32.692 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.692 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.692 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.692 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:32.692 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:32.692 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 68.630166908999996, 2024-04-26T10:23:32.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:23:32.692 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.692 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.692 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.693 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.693 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:23:32.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.693 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:32.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:32.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:23:32.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:32.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:23:32.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:23:32.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:23:32.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:23:32.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:23:32.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:23:32.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:23:32.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:23:32.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:23:32.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:23:32.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:32.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:23:32.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:23:32.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:23:32.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:23:32.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:32.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:23:32.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:23:32.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:23:32.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:23:32.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:23:32.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:23:32.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.697 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.697 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.697 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:32.697 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:32.698 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.540144292999997, 2024-04-26T10:23:32.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:23:32.698 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.698 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.698 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.698 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:23:32.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.698 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:32.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:32.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:32.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:32.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:23:32.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:23:32.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:23:32.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:23:32.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:23:32.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:23:32.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:23:32.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:23:32.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:32.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:23:32.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:23:32.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:23:32.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:23:32.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:23:32.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:23:32.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:32.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:23:32.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:23:32.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:32.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:23:32.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:23:32.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:23:32.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:23:32.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:23:32.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:23:32.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:23:32.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:23:32.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.703 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.703 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.704 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:32.704 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:32.704 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.517042046999997, 2024-04-26T10:23:32.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:23:32.704 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.704 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.704 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.704 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:23:32.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.704 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:32.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:32.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:23:32.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:32.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:23:32.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:23:32.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:23:32.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:23:32.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:23:32.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:23:32.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:23:32.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:23:32.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:32.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:23:32.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:23:32.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:23:32.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:23:32.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:23:32.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:23:32.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:32.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:23:32.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:23:32.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:32.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:23:32.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:23:32.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:23:32.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:23:32.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:23:32.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:23:32.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:23:32.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:23:32.709 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.510358908999997, 2024-04-26T10:23:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:23:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.710 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:23:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:23:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:23:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:23:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:23:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:23:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:23:32.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:23:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:23:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:23:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:23:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:23:32.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:23:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:23:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:23:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:23:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:32.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:23:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:23:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:23:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:23:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:23:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:23:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:23:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:23:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:23:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:23:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.716 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.508361123999997, 2024-04-26T10:23:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:23:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:23:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:23:32.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:23:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:23:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:23:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:23:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:23:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:23:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:23:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:23:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:32.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:23:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:23:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:23:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:23:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:23:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:32.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:23:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:23:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:23:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:23:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:23:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:23:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:23:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:23:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:23:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:23:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:32.723 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.498952418999998, 2024-04-26T10:23:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:23:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:23:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:32.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:23:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:23:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:23:32.725 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:23:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:23:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:23:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:23:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:23:32.726 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:23:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:23:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:23:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:23:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:23:32.727 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:23:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:23:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:23:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:23:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:23:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:23:32.728 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:23:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:23:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:23:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:23:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:23:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.729 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.497124370000002, 2024-04-26T10:23:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:23:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:23:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.730 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:23:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.731 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:23:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:23:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:23:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:23:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:23:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:23:32.732 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:23:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:23:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:23:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:23:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:23:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:23:32.733 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:23:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:23:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:23:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:23:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:32.734 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:23:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:23:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:23:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:23:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:23:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:23:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:23:32.735 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:23:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.485544648000001, 2024-04-26T10:23:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:23:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:23:32.736 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:32.737 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:23:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:23:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:23:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:23:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.738 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:23:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:23:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:23:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:23:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:23:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:23:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.739 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:23:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:23:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:23:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:23:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:23:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:23:32.740 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:23:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:23:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:23:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:23:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:23:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:23:32.741 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:23:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:23:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:32.742 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.479134154, 2024-04-26T10:23:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:23:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:23:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.743 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:23:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:23:32.744 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:23:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:23:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:23:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:23:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.745 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:23:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:23:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:23:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:23:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.746 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:23:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:23:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:23:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:23:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:23:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:23:32.747 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:23:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:23:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:23:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:23:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:23:32.748 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:23:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:23:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:23:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.749 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.466549090999997, 2024-04-26T10:23:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:23:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:23:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.750 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:23:32.751 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:23:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:23:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:23:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:23:32.752 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:23:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:23:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:23:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:23:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.753 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:23:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:23:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:23:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:23:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:23:32.754 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:23:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:23:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:23:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:23:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:23:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.755 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:23:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:23:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:23:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:23:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.756 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.466314158000003, 2024-04-26T10:23:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:23:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:23:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.757 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:23:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:32.758 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:23:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:23:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:23:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:23:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.759 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:23:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:23:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:23:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:23:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:32.760 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:23:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:23:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:23:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:23:32.761 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:23:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:23:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:23:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:23:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:23:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.762 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:23:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:23:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:23:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:23:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:23:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:23:32.763 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.428439281000003, 2024-04-26T10:23:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:23:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.764 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:23:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:32.765 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:23:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:23:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:23:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.766 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:23:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:23:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:23:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:23:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:23:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:23:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.767 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:23:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:23:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:23:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.768 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:23:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:23:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:23:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:23:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:23:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:23:32.769 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:23:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:23:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:23:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:23:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.770 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:23:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:23:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.427994255999998, 2024-04-26T10:23:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:23:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.771 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:23:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.772 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:23:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:23:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:23:32.773 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:23:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:23:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:23:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:23:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.774 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:23:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:23:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:23:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:23:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:23:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:23:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.775 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:23:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:23:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:23:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:23:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:23:32.776 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:23:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:23:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:23:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:23:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:23:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.777 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:23:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:23:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.416391255999997, 2024-04-26T10:23:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:23:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.778 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:23:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.779 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:23:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:23:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:23:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.780 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:23:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:23:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:23:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:23:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:23:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:23:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.781 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:23:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:23:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:23:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:23:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:23:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:23:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.782 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:23:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:23:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:23:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:23:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.783 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:23:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:23:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:23:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:23:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:23:32.784 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:23:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.415117666, 2024-04-26T10:23:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:23:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.785 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:23:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.786 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:23:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:23:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:23:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:23:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:23:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.787 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:23:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:23:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:23:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:23:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:23:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:23:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.788 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:23:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:23:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:23:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:23:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:23:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:23:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:32.789 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:23:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:23:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:23:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:23:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:23:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:23:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.790 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:23:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:23:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.398360365000002, 2024-04-26T10:23:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:23:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.791 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:23:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.792 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:23:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:23:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:23:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:23:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:23:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.793 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:23:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:23:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:23:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:23:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:23:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:23:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.794 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:23:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:23:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:23:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:23:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:23:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:23:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:32.795 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:23:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:23:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:23:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:23:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:23:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:23:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.796 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:23:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:23:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 43.353448344, 2024-04-26T10:23:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:23:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:32.797 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:23:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:32.798 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:23:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:23:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:23:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:23:32.799 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:23:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:23:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:23:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:23:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:23:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:32.800 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:23:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:23:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:23:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:23:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:23:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:23:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:23:32.801 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:23:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:23:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:23:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:23:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:23:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:32.802 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:23:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:23:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:23:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:23:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:32.803 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:32.803 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:32.805 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:32.806 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:32.802+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:32.905 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:32.899+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:32.923 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:32.923 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:32.923 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T10:23:32.923 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:32.932 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:33.006 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:32.999+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:33.037 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:33.037 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:33.037 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:23:33.037 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:23:33.037 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:33.047 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:33.107 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:33.103+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:33.154 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:33.154 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:23:33.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:23:33.154 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:33.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.154 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:33.154 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:33.154 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.622173961000001, 2024-04-26T10:23:33.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:23:33.155 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.155 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.155 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:33.155 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:33.155 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.155 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:23:33.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.155 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:33.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:33.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:23:33.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:33.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:23:33.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:23:33.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:23:33.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:23:33.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:23:33.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:23:33.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:23:33.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:23:33.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:23:33.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:23:33.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:33.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:23:33.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:23:33.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:23:33.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:23:33.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.159 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.159 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:23:33.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:23:33.159 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.159 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.160 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.160 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:33.160 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:33.160 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.620191734000002, 2024-04-26T10:23:33.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:23:33.160 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.160 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.160 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:33.160 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:33.160 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.160 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:23:33.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.161 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:33.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:33.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:23:33.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:23:33.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:23:33.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:23:33.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:23:33.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:23:33.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:23:33.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:23:33.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:23:33.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:23:33.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:23:33.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:23:33.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:33.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:23:33.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:23:33.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:23:33.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:23:33.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:23:33.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:23:33.165 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.165 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.165 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.165 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:33.165 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:33.165 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.619992350000004, 2024-04-26T10:23:33.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:23:33.165 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.165 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.165 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:33.166 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:33.166 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.166 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:23:33.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.166 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:33.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:33.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:33.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:33.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:23:33.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:23:33.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:23:33.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:23:33.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:23:33.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:23:33.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:23:33.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:23:33.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:23:33.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:23:33.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:33.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:23:33.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:23:33.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:23:33.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:23:33.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:23:33.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:23:33.170 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.170 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.170 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.171 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:23:33.171 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:33.171 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.619773730000006, 2024-04-26T10:23:33.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:23:33.171 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.171 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.171 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:33.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:33.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:23:33.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:33.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:23:33.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:23:33.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:23:33.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:23:33.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:23:33.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:23:33.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:23:33.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:23:33.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:23:33.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:23:33.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:23:33.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:23:33.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:23:33.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:23:33.175 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.175 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.175 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.175 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:33.175 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:33.175 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.617402291999994, 2024-04-26T10:23:33.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:23:33.175 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.175 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.175 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:33.175 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:33.176 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.176 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:23:33.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.176 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:33.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:33.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:23:33.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:33.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:23:33.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:23:33.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:23:33.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:23:33.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:23:33.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:23:33.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:33.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:23:33.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:23:33.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:23:33.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:33.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:23:33.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:23:33.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:23:33.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:23:33.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:23:33.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:23:33.179 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.180 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.180 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.180 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:33.180 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:33.180 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.617301670000003, 2024-04-26T10:23:33.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:23:33.180 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.180 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.180 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:33.180 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:33.180 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.180 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:23:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:23:33.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:33.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:23:33.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:23:33.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:23:33.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:23:33.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:23:33.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:23:33.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:23:33.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:23:33.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:23:33.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:23:33.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:33.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:23:33.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:23:33.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:23:33.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:23:33.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:23:33.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:23:33.184 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.184 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.184 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.185 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:23:33.185 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:33.185 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.617183108999996, 2024-04-26T10:23:33.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:23:33.185 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.185 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.185 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:33.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:33.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:23:33.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:33.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.186 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.186 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:23:33.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:23:33.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:23:33.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:23:33.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:23:33.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:23:33.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:23:33.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:23:33.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:23:33.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:23:33.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:23:33.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:23:33.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:23:33.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:23:33.188 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.188 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.188 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.189 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:33.189 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:33.189 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.617080711, 2024-04-26T10:23:33.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:23:33.189 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.189 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.189 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:33.189 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:33.189 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.189 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:23:33.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.189 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:33.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:33.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:23:33.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:33.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:23:33.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:23:33.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:23:33.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:23:33.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:23:33.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:23:33.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:33.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:23:33.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:23:33.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:23:33.192 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.192 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.192 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:33.192 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:23:33.192 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:23:33.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:23:33.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:23:33.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.193 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.193 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.193 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:23:33.193 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:23:33.193 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.193 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.193 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.193 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.194 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:33.194 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:33.194 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.616060153999996, 2024-04-26T10:23:33.194 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:23:33.194 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.194 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.194 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:33.194 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:33.194 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.194 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:23:33.194 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.194 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.194 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:33.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:33.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.195 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.195 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:23:33.195 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:33.195 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.195 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:23:33.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:23:33.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:23:33.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:23:33.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.196 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:23:33.196 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:23:33.196 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.196 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.196 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:23:33.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:23:33.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:23:33.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:23:33.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:33.197 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:23:33.197 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:23:33.197 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.197 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.197 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:23:33.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:23:33.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.198 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.198 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:23:33.198 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:23:33.198 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.198 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.198 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.198 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.198 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.198 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:33.198 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:33.199 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 92.614909878999995, 2024-04-26T10:23:33.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:23:33.199 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.199 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.199 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:33.199 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:33.199 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.199 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:23:33.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.199 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.199 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.199 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.199 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:33.199 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.199 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:33.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:23:33.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:33.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.200 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.200 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:23:33.200 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:23:33.200 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.200 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:23:33.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:23:33.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:23:33.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:23:33.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.201 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.201 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:23:33.201 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:23:33.201 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.201 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:23:33.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:23:33.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:33.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:23:33.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:23:33.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.202 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.202 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:23:33.202 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:23:33.202 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.202 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.203 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.203 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:23:33.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:23:33.203 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.203 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.203 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.203 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.203 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.203 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:33.203 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:33.203 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 69.118210637000004, 2024-04-26T10:23:33.203 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:23:33.203 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.203 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.204 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:33.204 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:33.204 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.204 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:23:33.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.204 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:33.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.204 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.204 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.204 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.204 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:33.204 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:23:33.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:33.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:23:33.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:23:33.205 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.205 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.205 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.205 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:23:33.205 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:23:33.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:23:33.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:23:33.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:23:33.206 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:23:33.206 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.206 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.206 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.206 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:23:33.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:23:33.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:33.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:23:33.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:23:33.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:33.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:23:33.207 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:23:33.207 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.207 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.207 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.207 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:23:33.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:23:33.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:23:33.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:23:33.208 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.208 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.208 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.208 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:23:33.208 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:23:33.208 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.208 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.208 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.209 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:33.209 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:33.209 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 69.117987041000006, 2024-04-26T10:23:33.209 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:23:33.209 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.209 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.209 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:33.209 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:33.209 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.209 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:23:33.209 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.209 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.209 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:33.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:33.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.210 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.210 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.210 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:23:33.210 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:33.210 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:23:33.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:23:33.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:23:33.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:23:33.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.211 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.211 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.211 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:23:33.211 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:23:33.211 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:23:33.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:23:33.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:23:33.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:23:33.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.212 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.212 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:33.212 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:23:33.212 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:23:33.212 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:33.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:23:33.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:23:33.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:23:33.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:23:33.213 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.213 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.213 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.213 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:23:33.213 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:23:33.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.214 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.214 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:23:33.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:23:33.214 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.214 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.214 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.214 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.214 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.214 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:33.214 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:33.214 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.087140720999997, 2024-04-26T10:23:33.214 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:23:33.214 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.215 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.215 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:33.215 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:33.215 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.215 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:23:33.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.215 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.215 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:33.215 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.215 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.215 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.215 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:33.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:23:33.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:33.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.216 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:23:33.216 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:23:33.216 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.216 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.216 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:23:33.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:23:33.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:23:33.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:23:33.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.217 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:23:33.217 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:23:33.217 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.217 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.217 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:23:33.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:23:33.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:33.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:23:33.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:23:33.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.218 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.218 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.218 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:23:33.218 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:23:33.218 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:33.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:23:33.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:23:33.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:23:33.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:23:33.219 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.219 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.219 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.219 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:23:33.219 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:23:33.220 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.220 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.220 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.220 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.220 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.220 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:33.220 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:33.220 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.085129618000003, 2024-04-26T10:23:33.220 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:23:33.220 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.220 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.220 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:33.220 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:33.220 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.221 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:23:33.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.221 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:33.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.221 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:33.221 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.221 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.221 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.221 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:33.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:33.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:23:33.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:23:33.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.222 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.222 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.222 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:23:33.222 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:23:33.222 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:23:33.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:23:33.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:23:33.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:23:33.223 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.223 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.223 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.223 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:23:33.223 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:23:33.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:33.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:23:33.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:23:33.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:23:33.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:23:33.224 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.224 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.224 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:33.224 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:23:33.224 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:23:33.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:23:33.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:23:33.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.225 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.225 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.225 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:23:33.225 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:23:33.225 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.225 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.225 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.225 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.226 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:33.226 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:33.226 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.074251513, 2024-04-26T10:23:33.226 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:23:33.226 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.226 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.226 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:33.226 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:33.226 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.226 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:23:33.226 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.226 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.226 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:33.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:33.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.227 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.227 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.227 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:23:33.227 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:33.227 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:23:33.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:23:33.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:23:33.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:23:33.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.228 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.228 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.228 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:23:33.228 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:23:33.228 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:23:33.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:23:33.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:23:33.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:23:33.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.229 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.229 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:33.229 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:23:33.229 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:23:33.229 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:23:33.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:23:33.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:33.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:23:33.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:23:33.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.230 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.230 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:23:33.230 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:23:33.230 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.230 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.231 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.231 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:23:33.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:23:33.231 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.231 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.231 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.231 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.231 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.231 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:33.231 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:33.231 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.071570293999997, 2024-04-26T10:23:33.231 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:23:33.231 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.231 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.232 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:33.232 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:33.232 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.232 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:23:33.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.232 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:33.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.232 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.232 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.232 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.232 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:33.232 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:23:33.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:33.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:23:33.233 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:23:33.233 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.233 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.233 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.233 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:23:33.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:23:33.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:23:33.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:23:33.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.234 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.234 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:23:33.234 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:23:33.234 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.234 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:23:33.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:23:33.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:33.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:23:33.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:23:33.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.235 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.235 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.235 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:23:33.235 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:23:33.235 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:33.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:23:33.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:23:33.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:23:33.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:23:33.236 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.236 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.236 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.236 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:23:33.236 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:23:33.236 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.236 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.237 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.237 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.237 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.237 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:33.237 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:33.237 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.071203218999997, 2024-04-26T10:23:33.237 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:23:33.237 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.237 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.237 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:33.237 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:33.237 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.237 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:23:33.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.238 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:33.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.238 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:33.238 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.238 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.238 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.238 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:23:33.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:33.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:23:33.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:23:33.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.239 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.239 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:23:33.239 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:23:33.239 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.239 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:23:33.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:23:33.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:23:33.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:23:33.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.240 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.240 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:23:33.240 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:23:33.240 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.240 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:33.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:23:33.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:23:33.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:23:33.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:23:33.241 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.241 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.241 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.241 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:23:33.241 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:23:33.241 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.241 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.242 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.242 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.242 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:33.242 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:33.242 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.071138967000003, 2024-04-26T10:23:33.242 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:23:33.242 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.242 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.242 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:33.242 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:33.242 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.242 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:23:33.242 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.243 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:33.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:33.243 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.243 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.243 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.243 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.243 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:23:33.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:33.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:23:33.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:23:33.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:23:33.244 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:23:33.244 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.244 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.244 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.244 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:23:33.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:23:33.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:23:33.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:23:33.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.245 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:23:33.245 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:23:33.245 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.245 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.245 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:33.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:23:33.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:23:33.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:23:33.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:23:33.246 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.246 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.246 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.246 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:23:33.246 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:23:33.246 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.247 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.247 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.247 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.247 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.247 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:33.247 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:33.247 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.066740293999999, 2024-04-26T10:23:33.247 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:23:33.247 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.247 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.247 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:33.248 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:33.248 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.248 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:23:33.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.248 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:33.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.248 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.248 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.248 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.248 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:33.248 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:23:33.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:33.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:23:33.249 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:23:33.249 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.249 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.249 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.249 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:23:33.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:23:33.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:23:33.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:23:33.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.250 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.250 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:23:33.250 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:23:33.250 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.250 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:23:33.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:23:33.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:33.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:23:33.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:23:33.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.251 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.251 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.251 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:23:33.251 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:23:33.251 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.252 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.252 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:23:33.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:23:33.252 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.252 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.252 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.252 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.252 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.252 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:33.252 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:33.252 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.064982311000001, 2024-04-26T10:23:33.252 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:23:33.252 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:33.252 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.253 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:33.253 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:33.253 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.253 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:23:33.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.253 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:33.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:33.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:33.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.253 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.253 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.253 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:33.253 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:33.253 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:33.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:33.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:23:33.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:33.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:33.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:23:33.254 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:23:33.254 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.254 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.254 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:33.254 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:23:33.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:23:33.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:23:33.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:23:33.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:33.255 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:23:33.255 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:23:33.255 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.255 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.255 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:33.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:23:33.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:23:33.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:33.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:23:33.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:23:33.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.256 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:23:33.256 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:23:33.256 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.256 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.256 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:33.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:23:33.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:23:33.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:33.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:23:33.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:23:33.257 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:33.257 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:33.257 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:33.257 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:23:33.257 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:23:33.257 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.257 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.257 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.258 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:33.258 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:33.258 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:33.259 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:33.258+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:33.259 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:33.360 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:33.358+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:33.374 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:33.374 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:33.374 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-04-26T10:23:33.374 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:33.384 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:33.389 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-26T10:23:33.461 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:33.458+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:33.489 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:33.489 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:33.489 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:23:33.489 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:23:33.489 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:33.499 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:33.563 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:33.562+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:33.605 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:33.605 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:23:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:23:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.562896398999996, 2024-04-26T10:23:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:23:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.606 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:23:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:23:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:23:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:23:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:23:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:23:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:23:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:23:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:23:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:23:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:23:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:23:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:23:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:23:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:23:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:23:33.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:23:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.562787147999998, 2024-04-26T10:23:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:23:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:23:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:23:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:23:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:23:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:23:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:23:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:23:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:23:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:23:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:23:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:23:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:23:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:23:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:23:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:23:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:23:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:23:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.615 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.560389736000005, 2024-04-26T10:23:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:23:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:23:33.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:23:33.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:23:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:23:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:23:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:23:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:23:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:23:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:23:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:23:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:23:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:23:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:23:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:23:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:23:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:23:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:23:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:23:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:23:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:23:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:23:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:23:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.621 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 69.560203811999997, 2024-04-26T10:23:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:23:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:23:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:23:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:23:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:23:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:23:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:23:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:23:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:23:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:23:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:23:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:23:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:23:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:23:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:23:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:23:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:23:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:23:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:23:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:23:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:23:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:23:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:23:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.470181195999999, 2024-04-26T10:23:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:23:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.627 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:23:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:33.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:23:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:23:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:23:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:23:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:23:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:23:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:23:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:23:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:23:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:23:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:23:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:23:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:23:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:23:33.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:23:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:23:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:23:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:23:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:23:33.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:23:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:23:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:23:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:23:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:23:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.447078949999998, 2024-04-26T10:23:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:23:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:23:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.634 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:23:33.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:23:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:23:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:23:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:23:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:23:33.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:23:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:23:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:23:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:23:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:23:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:23:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:23:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:23:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:23:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:23:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:23:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:23:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:23:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:23:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:23:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:23:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:23:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:23:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:23:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.440395811999998, 2024-04-26T10:23:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:23:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.640 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:23:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:23:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:23:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:23:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:23:33.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:23:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:23:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:23:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:23:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:23:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:23:33.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:23:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:23:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:23:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:23:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:23:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:23:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:23:33.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:23:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:23:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:23:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:23:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:23:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:23:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:23:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:23:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:33.646 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.438398026999998, 2024-04-26T10:23:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:23:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:23:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:33.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:23:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:33.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:23:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:23:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:23:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:23:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:23:33.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:23:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:23:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:23:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:23:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.650 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:23:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:23:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:23:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:23:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:23:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:23:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:23:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:23:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:23:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:23:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:23:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:23:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:23:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:23:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.428989322, 2024-04-26T10:23:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:23:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.653 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:23:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:23:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:23:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:23:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:23:33.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:23:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:23:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:23:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:23:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:33.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:23:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:23:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:23:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:23:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:23:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:23:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:33.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:23:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:23:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:23:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:23:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:23:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:23:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:23:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:23:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:23:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:23:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:33.659 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.427161273000003, 2024-04-26T10:23:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:23:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:23:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:23:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:23:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:23:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:23:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:23:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:23:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:23:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:23:33.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:23:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:23:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:23:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:23:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:23:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:23:33.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:23:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:23:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:23:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:23:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:23:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:23:33.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:23:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:23:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:23:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:23:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:23:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.415581551000002, 2024-04-26T10:23:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:23:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:23:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.666 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:33.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:23:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:23:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:23:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:23:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:23:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:23:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:23:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:23:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:23:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:23:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:23:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:23:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:23:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:23:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:23:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:23:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.670 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:23:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:23:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:23:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:23:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:23:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:23:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:23:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:23:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.409171057000002, 2024-04-26T10:23:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:23:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.672 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:23:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:23:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:23:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:23:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:23:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:23:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:23:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:23:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:23:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:23:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:23:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:23:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:23:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:23:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:23:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:23:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:23:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:23:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:23:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:23:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:23:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:23:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:23:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.677 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:23:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:23:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.396585993999999, 2024-04-26T10:23:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:23:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.678 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:23:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.679 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:23:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:23:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:23:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:23:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:23:33.680 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:23:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:23:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:23:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:23:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:23:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:23:33.681 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:23:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:23:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:23:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:23:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:23:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:23:33.682 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:23:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:23:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:23:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:23:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:23:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:23:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.683 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.396351060999997, 2024-04-26T10:23:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:23:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:23:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.684 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:33.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:33.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.685 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:23:33.685 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:33.685 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.685 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.685 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:23:33.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:23:33.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:23:33.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:23:33.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.686 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:23:33.686 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:23:33.686 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.686 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.686 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:23:33.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:23:33.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:33.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:23:33.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:33.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.687 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:23:33.687 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:23:33.687 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.687 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.687 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:23:33.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:23:33.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:33.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:23:33.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:23:33.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:23:33.688 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:23:33.688 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.688 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.688 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.688 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:23:33.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:23:33.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:23:33.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:23:33.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.689 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.689 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.689 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:23:33.689 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:23:33.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.689 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.689 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.689 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.690 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:33.690 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:33.690 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.358476183999997, 2024-04-26T10:23:33.690 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:23:33.690 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.690 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.690 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.690 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:23:33.690 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.690 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.690 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.690 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.690 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:33.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:33.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:23:33.691 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:33.691 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.691 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.691 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.691 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:23:33.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:23:33.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:23:33.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:23:33.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:23:33.692 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:23:33.692 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.692 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.692 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.692 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:23:33.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:23:33.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:33.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:23:33.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:33.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.693 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:23:33.693 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:23:33.693 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.693 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.693 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:23:33.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:23:33.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:33.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:23:33.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:23:33.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.694 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:23:33.694 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:23:33.694 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.694 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.694 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:23:33.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:23:33.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:23:33.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:23:33.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.695 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.695 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.695 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:23:33.695 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:23:33.695 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.695 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.695 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.695 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.696 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:33.696 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:33.696 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.358031158999999, 2024-04-26T10:23:33.696 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:23:33.696 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.696 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.696 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.696 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:23:33.696 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.696 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.696 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.696 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.696 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:33.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:33.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:23:33.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:33.697 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.697 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.697 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.697 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:23:33.697 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:23:33.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:23:33.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:23:33.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:23:33.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:23:33.698 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.698 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.698 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.698 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:23:33.698 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:23:33.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:33.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:23:33.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:23:33.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:23:33.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:23:33.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.699 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.699 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.699 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:23:33.699 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:23:33.699 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:33.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:23:33.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:23:33.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:23:33.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:23:33.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.700 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.700 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:23:33.700 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:23:33.700 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.700 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:23:33.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:23:33.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.701 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.701 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:23:33.701 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:23:33.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.701 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.701 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.701 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.701 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.701 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:33.701 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:33.701 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.346428158999998, 2024-04-26T10:23:33.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:23:33.702 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.702 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.702 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.702 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:23:33.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.702 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.702 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.702 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.702 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:33.702 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.702 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:33.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:23:33.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:33.703 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.703 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.703 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.703 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:23:33.703 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:23:33.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:23:33.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:23:33.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:23:33.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:23:33.704 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.704 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.704 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.704 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:23:33.704 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:23:33.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:33.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:23:33.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:23:33.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:23:33.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:23:33.705 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.705 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.705 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.705 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:23:33.705 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:23:33.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:33.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:23:33.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:23:33.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:23:33.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:23:33.706 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.706 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.706 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.706 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:23:33.706 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:23:33.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:23:33.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:23:33.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.707 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.707 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:23:33.707 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:23:33.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.707 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.707 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.707 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.707 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.707 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:33.708 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:33.708 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.345154569000002, 2024-04-26T10:23:33.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:23:33.708 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.708 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.708 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.708 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:23:33.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.708 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.708 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.708 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.708 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:33.708 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.708 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:33.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:23:33.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:33.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.709 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.709 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:23:33.709 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:23:33.709 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.709 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:23:33.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:23:33.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:23:33.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:23:33.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.710 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.710 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.710 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:23:33.710 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:23:33.710 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:33.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:23:33.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:23:33.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:23:33.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:23:33.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.711 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.711 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:23:33.711 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:23:33.711 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.711 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:33.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:23:33.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:23:33.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:23:33.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:23:33.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.712 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.712 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:23:33.712 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:23:33.712 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.712 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:23:33.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:23:33.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.713 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.713 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:23:33.713 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:23:33.713 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.713 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.713 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.713 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.713 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.713 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:33.713 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:33.714 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.328397268000003, 2024-04-26T10:23:33.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:23:33.714 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.714 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.714 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.714 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.714 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.714 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:23:33.714 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.714 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.714 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.714 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.714 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:33.714 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:33.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:23:33.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:33.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.715 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.715 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.715 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:23:33.715 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:23:33.715 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:23:33.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:23:33.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:23:33.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:23:33.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.716 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.716 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:23:33.716 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:23:33.716 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.716 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:33.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:23:33.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:23:33.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:23:33.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:23:33.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.717 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:23:33.717 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:23:33.717 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.717 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.717 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:33.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:23:33.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:23:33.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:23:33.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:23:33.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.718 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:23:33.718 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:23:33.718 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.718 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.718 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:23:33.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:23:33.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.719 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.719 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:23:33.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:23:33.719 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.719 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.719 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.719 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.719 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.719 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:33.719 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:33.719 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 44.283485247000002, 2024-04-26T10:23:33.719 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:23:33.719 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:33.720 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:33.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:33.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:33.720 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:33.720 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:23:33.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.720 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:33.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:33.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:33.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.720 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.720 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.720 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:33.720 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:33.720 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:33.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:33.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:23:33.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:33.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:33.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:23:33.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:23:33.721 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.721 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.721 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:33.721 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:23:33.721 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:23:33.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:33.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:23:33.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:23:33.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:23:33.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:23:33.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.722 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.722 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:33.722 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:23:33.722 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:23:33.722 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:33.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:23:33.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:23:33.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:33.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:23:33.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:23:33.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.723 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.723 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:33.723 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:23:33.723 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:23:33.723 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:33.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:23:33.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:23:33.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:33.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:23:33.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:23:33.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.724 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:33.724 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:23:33.724 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:23:33.724 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:33.724 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:33.725 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:33.725 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:23:33.725 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:23:33.725 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.725 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.725 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.725 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:33.725 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:33.725 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:33.726 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:33.727 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:33.723+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:33.827 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:33.823+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:33.844 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:33.844 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:33.844 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T10:23:33.844 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:33.854 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:33.928 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:33.923+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:33.963 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:33.963 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:33.963 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:23:33.963 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:23:33.963 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:33.973 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:34.029 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~105s 2024-04-26T10:23:34.029 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:34.027+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:34.087 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:34.087 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:23:34.087 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:23:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.554161786999998, 2024-04-26T10:23:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:23:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:23:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.088 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:23:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:34.089 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:23:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:23:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:23:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:23:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:23:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:23:34.090 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:23:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:23:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:23:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:23:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:23:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:23:34.091 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:23:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:23:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:23:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:23:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:34.092 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.552179559999999, 2024-04-26T10:23:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:23:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:23:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.093 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:23:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:23:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:23:34.094 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:23:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:23:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:23:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:23:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:23:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:23:34.095 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:23:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:23:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:23:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:23:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:23:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:23:34.096 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:23:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:23:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:23:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.551980176000001, 2024-04-26T10:23:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:23:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.097 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:23:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:34.098 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:23:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:23:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:23:34.099 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:23:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:23:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:23:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:23:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:23:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:23:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:23:34.100 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:23:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:23:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:23:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:23:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:23:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:23:34.101 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:23:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.551761556000002, 2024-04-26T10:23:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:23:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.102 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:23:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.103 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:23:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:23:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:23:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:23:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:23:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:23:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:23:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:23:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:23:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:23:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:23:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:23:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.105 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:23:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:23:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.549390118000005, 2024-04-26T10:23:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:23:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.106 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:23:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.107 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:23:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:23:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:23:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:23:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:23:34.108 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:23:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:23:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:23:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:23:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:23:34.109 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:23:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:23:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:23:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:23:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:23:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:23:34.110 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.549289496, 2024-04-26T10:23:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:23:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:23:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.111 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:23:34.112 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:23:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:23:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:23:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:23:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.113 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:23:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:23:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:23:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:23:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:23:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:23:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.114 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:23:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:23:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:23:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:23:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:23:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:23:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.115 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:23:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.549170935000006, 2024-04-26T10:23:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:23:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.116 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:23:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:23:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:23:34.117 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:23:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:23:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:23:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:23:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.118 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:23:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:23:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:23:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:23:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:23:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:23:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.119 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:23:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:23:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.549068536999997, 2024-04-26T10:23:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:23:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:34.120 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:23:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:34.121 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:23:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:23:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:23:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.122 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:23:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:23:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:23:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:23:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:23:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.123 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:23:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:23:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:23:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:23:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:23:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:23:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.124 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:23:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:23:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.548047980000007, 2024-04-26T10:23:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:23:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:34.125 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:23:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.126 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:23:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:23:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:23:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:23:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:23:34.127 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:23:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:23:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:23:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:23:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:23:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:23:34.128 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:23:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:23:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:23:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:23:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:23:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:23:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.129 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 93.546897705000006, 2024-04-26T10:23:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:23:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.130 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:23:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:23:34.131 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:23:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:23:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:23:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:23:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:23:34.132 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:23:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:23:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:23:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:23:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:23:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:34.133 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:23:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:23:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:23:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:23:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:23:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:23:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.134 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 70.050198463000001, 2024-04-26T10:23:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:23:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:23:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.135 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:23:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:34.136 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:23:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:23:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:23:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:23:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.137 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:23:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:23:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:23:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:23:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:23:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:23:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.138 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:23:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:23:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:23:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:23:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:23:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:23:34.139 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:23:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:23:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:23:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:23:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.140 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 70.049974867000003, 2024-04-26T10:23:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:23:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:23:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.141 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.142 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:23:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:23:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:23:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:23:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:23:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.143 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:23:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:23:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:23:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:23:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:23:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:23:34.144 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:23:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:23:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:23:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:23:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.145 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:23:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:23:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:23:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:23:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:23:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:23:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.146 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 63.019128547000001, 2024-04-26T10:23:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:23:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:23:34.147 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.148 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:23:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:23:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:23:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:23:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:23:34.149 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:23:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:23:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:23:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:23:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.150 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:23:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:23:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:23:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:23:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:23:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:23:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:34.151 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:23:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:23:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:23:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:23:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:23:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:23:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.152 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 63.017117444, 2024-04-26T10:23:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:23:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:23:34.153 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.154 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:23:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:23:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:23:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:23:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.155 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:23:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:23:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:23:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:23:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:23:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:23:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.156 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:23:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:23:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:23:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:23:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:23:34.157 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:23:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:23:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:23:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:23:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:23:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.158 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 63.006239338999997, 2024-04-26T10:23:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:23:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:23:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.159 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:23:34.160 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:23:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:23:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:23:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:23:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.161 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:23:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:23:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:23:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:23:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:23:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:23:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.162 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:23:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:23:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:23:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:23:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:23:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:23:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.163 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:23:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:23:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:23:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:23:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.164 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 63.003558120000001, 2024-04-26T10:23:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:23:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:23:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.165 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:23:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.166 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:23:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:23:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:23:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:23:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:23:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:23:34.167 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:23:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:23:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:23:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:23:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:23:34.168 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:23:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:23:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:23:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:23:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:23:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.169 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:23:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:23:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:23:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:23:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:34.170 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 63.003191045000001, 2024-04-26T10:23:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:23:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:23:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:34.171 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:23:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.172 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:23:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:23:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:23:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:23:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:23:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:23:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.173 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:23:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:23:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:23:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:23:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:23:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:23:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.174 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:23:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:23:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:23:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:23:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.175 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 63.003126793, 2024-04-26T10:23:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:23:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:23:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.176 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:23:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.177 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:23:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:23:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:23:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:23:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:23:34.178 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:23:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:23:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:23:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:23:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:23:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:34.179 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:23:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:23:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:23:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:23:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:23:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:23:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.180 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.998728120000003, 2024-04-26T10:23:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:23:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:23:34.181 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.182 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:23:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:23:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:23:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:23:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:23:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.183 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:23:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:23:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:23:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:23:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:23:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:23:34.184 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:23:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:23:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:23:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:23:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:23:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:23:34.185 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 62.996970136999998, 2024-04-26T10:23:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:23:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:34.186 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:23:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.187 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:23:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:23:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:23:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:23:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:23:34.188 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:23:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:23:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:23:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:23:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:34.189 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:23:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:23:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:23:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:23:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:23:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:23:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.190 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:23:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:23:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:23:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:23:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:23:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:23:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.191 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.192 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.192 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:34.192 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:34.192 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:34.193 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:34.194 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:34.187+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:34.294 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:34.290+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:34.307 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:34.307 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:34.307 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-04-26T10:23:34.307 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:34.317 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:34.388 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is set 2024-04-26T10:23:34.395 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:34.394+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:34.429 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:34.429 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:34.429 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:23:34.429 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:23:34.429 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:34.438 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:34.496 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:34.494+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:34.509 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-26T10:23:34.549 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:23:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:23:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.505857317999997, 2024-04-26T10:23:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:23:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.549 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:23:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.550 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:23:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:23:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.551 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:23:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:23:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:23:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:23:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:23:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:23:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.552 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:23:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:23:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:23:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:23:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:23:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:23:34.553 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:23:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:23:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:34.554 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.505748066999999, 2024-04-26T10:23:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:23:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:23:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.555 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:34.556 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:23:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:23:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:23:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:23:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.557 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:23:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:23:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:23:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:23:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:23:34.558 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:23:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:23:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:23:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:23:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:23:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.559 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:23:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:23:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.503350655000006, 2024-04-26T10:23:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:23:34.560 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:23:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.561 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:23:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:23:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:23:34.562 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:23:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:23:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:23:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:23:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.563 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:23:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:23:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:23:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:23:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:23:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:23:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.564 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:23:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:23:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:23:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:23:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:23:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:23:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.565 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:23:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:23:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 70.503164730999998, 2024-04-26T10:23:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:23:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.566 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:23:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.567 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:23:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:23:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:23:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.568 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:23:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:23:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:23:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:23:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:23:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:23:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.569 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:23:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:23:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:23:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:23:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:23:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:23:34.570 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:23:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:23:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:23:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:23:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:23:34.571 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:23:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.413142114999999, 2024-04-26T10:23:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:23:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.572 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:23:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.573 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:23:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:23:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:23:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:23:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.574 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:23:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:23:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:23:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:23:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:23:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:23:34.575 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:23:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:23:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:23:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:23:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:34.576 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:23:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:23:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:23:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:23:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:23:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:23:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.577 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:23:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:23:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:23:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:23:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:34.578 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.390039868999999, 2024-04-26T10:23:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:23:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:23:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.579 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:23:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:23:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:23:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.580 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:23:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:23:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:23:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:23:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:23:34.581 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:23:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:23:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:23:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:23:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:23:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.582 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:23:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:23:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:23:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:23:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:23:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:23:34.583 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:23:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:23:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:23:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:23:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:23:34.584 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:23:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.383356730999999, 2024-04-26T10:23:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:23:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.585 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:23:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.586 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:23:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:23:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:23:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:23:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:23:34.587 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:23:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:23:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:23:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:23:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:34.588 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:23:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:23:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:23:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:23:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:23:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:23:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.589 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:23:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:23:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:23:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:23:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:23:34.590 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:23:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:23:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:23:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:23:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:23:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.591 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.381358945999999, 2024-04-26T10:23:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:23:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:23:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.592 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:23:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.593 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:23:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:23:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:23:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:23:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:23:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:23:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.594 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:23:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:23:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:23:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:23:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:23:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.595 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:23:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:23:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:23:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:23:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:23:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:23:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.596 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:23:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:23:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:23:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:23:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:23:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:23:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.597 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.371950241, 2024-04-26T10:23:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:23:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:23:34.598 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.599 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:23:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:23:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:23:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:23:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.600 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:23:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:23:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:23:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:23:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:23:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:23:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.601 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.602 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.603 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:23:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:23:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.370122191999997, 2024-04-26T10:23:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:23:34.604 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:23:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.605 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:23:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:23:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:23:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.606 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:23:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:23:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:23:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:23:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:23:34.607 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:23:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:23:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:23:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:23:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:23:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.608 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:23:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:23:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:23:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:23:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:23:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:23:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.609 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:23:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:23:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:23:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:23:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:23:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:23:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.610 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.358542470000003, 2024-04-26T10:23:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:23:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:23:34.611 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:34.612 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:23:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:23:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:23:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:23:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.613 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:23:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:23:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:23:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:23:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:23:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:23:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.614 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:23:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:23:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:23:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:23:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:23:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:23:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.615 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:23:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:23:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:23:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:23:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:23:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:23:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.616 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:23:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:23:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.352131976000003, 2024-04-26T10:23:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:23:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.617 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:23:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:34.618 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:23:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:23:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:23:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:23:34.619 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:23:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:23:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:23:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:23:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:23:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:23:34.620 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:23:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:23:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:23:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:23:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:23:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:23:34.621 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:23:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:23:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:23:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:23:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.622 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:23:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:23:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:23:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:23:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:34.623 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.339546913, 2024-04-26T10:23:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:23:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:23:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.624 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:23:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.625 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:23:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:23:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:23:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.626 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:23:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:23:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:23:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:23:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:23:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.627 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:23:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:23:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:23:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:23:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:23:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:23:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.628 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:23:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:23:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:23:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:23:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:23:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:23:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.629 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:23:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:23:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.339311979999998, 2024-04-26T10:23:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:23:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.630 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:23:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:34.631 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:23:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:23:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:23:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:23:34.632 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:23:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:23:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:23:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:23:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:23:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:23:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:34.633 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:23:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:23:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:23:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:23:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:23:34.634 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:23:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:23:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:23:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:23:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:23:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.635 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:23:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:23:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:23:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:23:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:34.636 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.301437102999998, 2024-04-26T10:23:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:23:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:23:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.637 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:23:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.638 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:23:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:23:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:23:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:23:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:23:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:23:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.639 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:23:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:23:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:23:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:23:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:23:34.640 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:23:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:23:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:23:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:23:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.641 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:23:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:23:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:23:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:23:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:23:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:23:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.642 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:23:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:23:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.300992078, 2024-04-26T10:23:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:23:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.643 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:23:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.644 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:23:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:23:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:23:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.645 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:23:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:23:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:23:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:23:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:23:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:23:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.646 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:23:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:23:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:23:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:23:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:23:34.647 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:23:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:23:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:23:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:23:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:23:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.648 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:23:34.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:23:34.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:23:34.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:23:34.649 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.649 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.649 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.649 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:23:34.649 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:23:34.649 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.649 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.650 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.650 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.650 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.650 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:34.650 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:34.650 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.289389077999999, 2024-04-26T10:23:34.650 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:23:34.650 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.650 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.650 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.650 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.650 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.651 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:23:34.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.651 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:34.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.651 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.651 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:34.651 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.651 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.651 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:23:34.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:34.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:23:34.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:23:34.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.652 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.652 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.652 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:23:34.652 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:23:34.652 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:23:34.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:23:34.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:23:34.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:23:34.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.653 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.653 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:34.653 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:23:34.653 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:23:34.653 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:23:34.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:23:34.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:23:34.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:23:34.654 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.654 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.654 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:34.654 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:23:34.654 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:23:34.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:23:34.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:23:34.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:23:34.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:23:34.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.655 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.655 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.655 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:23:34.655 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:23:34.655 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.656 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.656 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:23:34.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:23:34.656 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.656 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.656 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.656 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.656 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.656 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:34.656 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:34.656 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.288115488000003, 2024-04-26T10:23:34.656 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:23:34.656 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.656 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.657 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.657 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:23:34.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.657 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.657 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:34.657 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.657 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.657 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.657 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:34.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:23:34.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:34.658 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.658 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.658 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.658 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:23:34.658 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:23:34.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:23:34.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:23:34.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.659 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.659 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:23:34.659 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:23:34.659 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.659 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:23:34.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:23:34.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:34.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:23:34.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:23:34.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.660 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.660 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.660 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:23:34.660 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:23:34.660 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:23:34.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:23:34.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:34.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:23:34.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:23:34.661 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.661 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.661 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.661 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:23:34.661 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:23:34.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:23:34.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:23:34.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.662 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:23:34.662 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:23:34.662 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.662 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.662 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.663 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:23:34.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:23:34.663 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.663 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.663 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.663 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.663 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.663 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:34.663 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:34.663 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.271358186999997, 2024-04-26T10:23:34.663 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:23:34.663 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.663 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.663 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.664 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.664 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:23:34.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.664 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:34.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.664 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.664 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.664 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:34.664 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.664 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:23:34.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:34.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:23:34.665 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:23:34.665 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.665 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.665 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.665 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:23:34.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:23:34.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:23:34.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:23:34.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.666 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.666 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.666 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:23:34.666 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:23:34.666 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:34.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:23:34.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:23:34.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.667 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:23:34.667 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:23:34.667 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.667 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.667 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:23:34.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:23:34.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:34.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:23:34.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:23:34.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.668 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.668 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.668 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:23:34.668 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:23:34.668 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:23:34.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:23:34.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:23:34.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:23:34.669 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.669 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.669 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.669 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:23:34.669 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:23:34.670 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.670 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.670 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.670 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.670 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.670 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:34.670 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:34.670 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 45.226446166000002, 2024-04-26T10:23:34.670 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:23:34.670 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:34.670 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:34.670 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:34.670 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:34.671 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:34.671 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:23:34.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.671 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:34.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:34.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:34.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.671 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:34.671 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:34.671 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:34.671 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.671 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:34.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:23:34.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:34.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:34.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:23:34.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:23:34.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.672 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.672 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:34.672 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:23:34.672 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:23:34.672 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:34.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:23:34.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:23:34.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:23:34.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:23:34.673 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.673 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.673 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:34.673 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:23:34.673 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:23:34.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:34.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:23:34.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:23:34.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.674 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:34.674 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:23:34.674 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:23:34.674 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.674 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:34.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:23:34.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:23:34.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:34.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:23:34.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:23:34.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.675 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.675 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:34.675 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:23:34.675 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:23:34.675 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:34.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:23:34.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:23:34.676 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:34.676 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:34.676 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:34.676 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:23:34.676 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:23:34.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.676 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.676 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:34.676 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:34.676 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:34.677 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:23:34.678 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:34.679 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:34.671+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:34.690 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:23:34.691 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:23:34.691 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:23:34.692 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:23:34.696 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:23:34.696 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:23:34.779 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:34.775+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:34.789 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:34.789 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:34.799 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:34.880 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:34.878+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:34.905 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:34.905 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:34.915 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:34.981 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:34.979+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:35.022 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:35.023 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:35.032 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:35.082 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:35.075+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:35.153 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:35.153 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:35.164 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:35.182 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:35.178+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:35.272 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:35.272 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:35.282 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:35.283 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:35.282+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:35.384 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:35.379+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:35.387 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:35.387 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:35.397 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:35.486 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:35.481+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:35.511 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:35.511 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:35.521 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:35.586 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:35.581+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:35.632 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:35.632 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:35.643 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:35.687 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:35.683+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:35.788 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:35.785+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:35.795 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:35.795 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:35.805 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:35.889 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:35.885+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:35.918 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:35.918 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:35.928 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:35.990 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:35.985+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:36.039 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:36.039 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:36.048 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:36.091 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:36.087+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:36.152 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:36.152 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:36.162 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:36.206 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:36.203+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:36.272 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:36.272 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:36.283 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:36.292 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:36.287+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:36.389 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:36.389 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:36.394 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:36.391+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:36.399 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:36.403 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:23:36.495 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:36.491+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:36.506 INFO:teuthology.orchestra.run.smithi154.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:36.506 INFO:teuthology.orchestra.run.smithi154.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:36.516 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:36.595 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:36.593+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:36.633 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:36.633 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:36.643 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:36.696 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:36.693+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:36.697 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-26T10:23:36.749 INFO:teuthology.orchestra.run.smithi120.stdout:ERROR: (22) Invalid argument 2024-04-26T10:23:36.749 INFO:teuthology.orchestra.run.smithi120.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-26T10:23:36.759 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:36.796 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:36.791+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:36.845 INFO:teuthology.orchestra.run.smithi052.stdout:osd.0: {} 2024-04-26T10:23:36.865 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:23:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:23:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.822894169999998, 2024-04-26T10:23:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:23:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.866 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:23:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.867 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:23:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:23:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:23:36.868 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:23:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:23:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:23:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:23:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:23:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.869 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:23:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:23:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:23:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:23:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:23:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:23:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.870 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:23:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:23:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.822784919, 2024-04-26T10:23:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:23:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.871 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:23:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.872 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:23:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:23:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:23:36.873 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:23:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:23:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:23:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:23:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:23:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.874 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:23:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:23:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:23:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:23:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:23:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:23:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.875 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:23:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:23:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.820387507000007, 2024-04-26T10:23:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:23:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.876 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:23:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.877 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:23:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:23:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:23:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.878 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:23:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:23:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:23:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:23:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:23:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:23:36.879 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:23:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:23:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:23:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:23:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.880 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:23:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:23:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:23:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:23:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:23:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:23:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.881 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:23:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:23:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 72.820201582999999, 2024-04-26T10:23:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:23:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.882 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:23:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.883 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:23:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:23:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:23:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:23:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:23:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.884 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:23:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:23:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:23:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:23:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:23:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:23:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.885 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:23:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:23:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:23:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:23:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:23:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:23:36.886 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:23:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:23:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:23:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:23:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.887 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.730178967000001, 2024-04-26T10:23:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:23:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:23:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:36.888 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.889 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:23:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:23:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:23:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:23:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:23:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:23:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:23:36.890 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:23:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:23:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:23:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:23:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:23:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:23:36.891 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:23:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:23:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:23:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:23:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:23:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.892 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:23:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:23:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:23:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:23:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:23:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:23:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.893 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.707076721, 2024-04-26T10:23:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:23:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.894 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:23:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:23:36.895 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:23:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:23:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:23:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:23:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:23:36.896 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:23:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:23:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:23:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:23:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:23:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:23:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:23:36.897 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:23:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:23:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:23:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:23:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:23:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:23:36.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:23:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:23:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:23:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:23:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:23:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:23:36.899 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.700393583, 2024-04-26T10:23:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:23:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:23:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.900 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:23:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:23:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:23:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:23:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:23:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:23:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:23:36.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:23:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:23:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:23:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:23:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:23:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:23:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:23:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:23:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:23:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:23:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:23:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:23:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:23:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:23:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:23:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:23:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:23:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:23:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.905 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.906 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:36.906 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:36.906 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.698395798, 2024-04-26T10:23:36.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:23:36.906 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.906 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.906 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.906 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.906 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.906 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:23:36.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.906 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:36.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:36.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.907 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:23:36.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:36.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:23:36.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:23:36.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:23:36.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:23:36.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:23:36.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:23:36.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:23:36.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:23:36.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:36.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:23:36.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:36.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:23:36.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:23:36.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:23:36.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:23:36.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:36.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:23:36.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:23:36.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:36.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:23:36.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:23:36.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:23:36.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:23:36.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:23:36.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:23:36.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:23:36.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:23:36.911 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.911 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.912 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.912 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:36.912 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:36.912 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.688987093000001, 2024-04-26T10:23:36.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:23:36.912 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.912 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.912 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.912 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.912 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.912 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:23:36.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.912 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:36.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:36.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:23:36.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:36.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:23:36.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:23:36.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:23:36.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:36.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:23:36.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:23:36.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:23:36.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:23:36.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:36.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:23:36.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:23:36.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:23:36.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:23:36.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:23:36.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:23:36.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:36.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:23:36.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:23:36.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:23:36.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:23:36.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:36.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:23:36.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:23:36.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:23:36.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:23:36.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:23:36.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:23:36.918 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.918 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.918 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.918 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:36.918 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:36.918 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.687159043999998, 2024-04-26T10:23:36.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:23:36.918 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.918 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.918 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.918 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.918 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.918 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:23:36.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.919 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:36.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:36.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:23:36.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:36.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:23:36.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:23:36.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:23:36.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:23:36.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:23:36.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:23:36.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:23:36.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:23:36.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:36.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:23:36.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:23:36.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:23:36.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:23:36.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:23:36.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:23:36.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:36.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:23:36.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:23:36.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:36.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:23:36.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:23:36.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:23:36.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:23:36.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:23:36.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:23:36.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:23:36.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:23:36.924 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.924 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.924 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.924 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:36.924 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:36.924 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.675579321999997, 2024-04-26T10:23:36.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:23:36.924 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.924 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.925 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.925 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.925 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.925 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:23:36.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.925 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:36.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:36.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:36.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:36.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:23:36.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:23:36.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:23:36.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:23:36.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:23:36.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:23:36.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:23:36.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:23:36.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:36.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:23:36.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:23:36.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:23:36.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:23:36.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:23:36.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:23:36.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:36.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:23:36.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:23:36.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:23:36.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:23:36.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:36.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:23:36.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:23:36.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:23:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:23:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:23:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:23:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:36.930 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.669168827999997, 2024-04-26T10:23:36.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:23:36.931 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.931 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.931 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.931 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:23:36.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.931 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:36.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:36.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:23:36.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:36.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:23:36.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:23:36.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:23:36.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:23:36.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:23:36.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:36.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:23:36.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:23:36.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:36.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:23:36.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:23:36.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:23:36.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:23:36.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:23:36.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:23:36.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:36.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:23:36.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:23:36.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:36.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:23:36.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:23:36.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:23:36.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:23:36.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:23:36.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:23:36.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:23:36.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:23:36.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.937 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.937 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.937 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:36.937 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:36.937 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.656583765000001, 2024-04-26T10:23:36.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:23:36.937 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.937 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.937 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.938 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.938 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:23:36.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.938 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:36.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:36.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:23:36.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:36.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:23:36.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:36.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:23:36.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:23:36.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:23:36.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:23:36.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:23:36.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:23:36.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:36.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:23:36.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:36.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:23:36.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:23:36.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:23:36.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:23:36.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:36.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:23:36.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:23:36.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:23:36.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:23:36.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:36.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:23:36.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:23:36.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:23:36.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:23:36.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:23:36.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:23:36.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.943 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.943 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.943 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:36.944 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:36.944 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.656348831999999, 2024-04-26T10:23:36.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:23:36.944 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.944 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.944 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.944 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:23:36.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.944 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:36.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:36.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:23:36.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:36.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:23:36.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:23:36.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:23:36.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:23:36.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:23:36.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:23:36.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:23:36.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:23:36.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:36.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:23:36.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:36.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:23:36.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:23:36.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:23:36.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:23:36.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:36.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:23:36.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:23:36.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:36.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:23:36.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:23:36.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:23:36.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:23:36.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:23:36.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:23:36.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:23:36.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:23:36.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.950 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.950 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.950 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:36.950 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:36.950 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.618473954999999, 2024-04-26T10:23:36.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:23:36.950 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.950 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.950 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.951 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.951 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:23:36.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.951 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:36.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:36.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:23:36.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:36.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:23:36.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:23:36.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:23:36.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:23:36.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:23:36.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:23:36.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:23:36.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:23:36.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:36.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:23:36.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:36.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:23:36.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:23:36.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.954 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.954 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:23:36.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:23:36.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:36.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:23:36.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:23:36.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:23:36.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:23:36.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:36.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:23:36.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:23:36.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:23:36.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:23:36.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:23:36.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:23:36.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.956 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.956 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.956 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:36.957 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:36.957 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.618028930000001, 2024-04-26T10:23:36.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:23:36.957 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.957 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.957 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.957 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:23:36.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.957 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:36.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:36.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:23:36.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:36.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:23:36.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:23:36.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:23:36.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:23:36.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:23:36.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:23:36.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:23:36.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:23:36.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:36.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:23:36.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:23:36.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:23:36.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:23:36.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:23:36.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:23:36.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:36.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:23:36.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:23:36.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:23:36.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:23:36.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:36.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:23:36.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:23:36.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:23:36.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:23:36.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:23:36.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:23:36.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.963 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.963 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.963 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:36.963 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:36.963 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.60642593, 2024-04-26T10:23:36.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:23:36.963 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.963 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.963 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.964 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.964 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:23:36.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.964 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:36.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:36.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:23:36.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:36.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:23:36.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:23:36.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:23:36.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:23:36.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:23:36.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:23:36.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:23:36.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:23:36.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:36.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:23:36.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:23:36.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:23:36.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:23:36.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.967 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:23:36.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:23:36.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:36.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:23:36.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:23:36.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:36.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:23:36.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:23:36.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:23:36.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:23:36.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:23:36.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:23:36.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:23:36.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:23:36.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.969 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.969 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.970 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:36.970 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:36.970 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.605152339999997, 2024-04-26T10:23:36.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:23:36.970 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.970 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.970 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.970 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:23:36.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.971 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:36.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:36.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:23:36.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:36.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:23:36.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:23:36.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:23:36.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:23:36.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:23:36.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:23:36.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:23:36.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:23:36.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:36.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:23:36.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:23:36.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:23:36.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:23:36.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:23:36.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:23:36.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:36.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:23:36.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:23:36.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:36.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:23:36.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:23:36.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:23:36.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:23:36.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:23:36.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:23:36.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:23:36.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:23:36.976 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.976 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.976 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.976 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:36.976 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:36.976 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.588395038999998, 2024-04-26T10:23:36.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:23:36.976 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.977 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.977 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.977 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.977 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.977 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:23:36.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.977 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:36.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:36.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:23:36.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:36.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:23:36.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:23:36.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:23:36.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:23:36.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:23:36.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:23:36.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:23:36.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:23:36.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:36.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:23:36.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:23:36.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.980 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:23:36.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:23:36.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.980 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:23:36.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:23:36.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:36.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:23:36.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:23:36.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:36.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:23:36.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:23:36.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:23:36.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:23:36.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:23:36.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:23:36.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:23:36.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:23:36.982 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 47.543483018000003, 2024-04-26T10:23:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:23:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:36.983 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:23:36.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.984 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:36.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:36.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:36.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:36.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:36.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:36.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:36.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:23:36.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:36.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:36.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:23:36.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:23:36.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:36.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:23:36.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:23:36.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:36.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:23:36.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:23:36.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:23:36.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:23:36.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:36.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:23:36.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:23:36.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:36.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:23:36.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:23:36.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:36.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:23:36.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:23:36.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:36.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:23:36.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:23:36.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:36.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:23:36.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:23:36.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:36.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:23:36.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:23:36.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:36.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:23:36.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:23:36.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:36.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:36.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:36.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:23:36.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:23:36.989 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.989 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.989 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.989 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:36.989 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:36.989 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:36.990 INFO:teuthology.orchestra.run.smithi052.stdout:osd.1: {} 2024-04-26T10:23:36.991 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-26T10:23:36.993 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:36.994 INFO:teuthology.orchestra.run.smithi052.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-26T10:23:36.994 INFO:teuthology.orchestra.run.smithi052.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-26T10:23:36.994 INFO:teuthology.orchestra.run.smithi052.stderr:Error ENXIO: problem getting command descriptions from osd.2 2024-04-26T10:23:36.994 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-26T10:23:36.995 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:36.989+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:37.092 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:37.089+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:37.108 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:37.108 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:37.108 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T10:23:37.108 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:37.118 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:37.192 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:37.189+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:37.222 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:37.222 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:37.222 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:23:37.222 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:23:37.222 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:37.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:37.293 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:37.289+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:37.389 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:23:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:23:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.857539521999996, 2024-04-26T10:23:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:23:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:23:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:23:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:23:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:23:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:23:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:23:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:23:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:23:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:23:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:23:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:23:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:23:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:23:37.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:23:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:23:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:23:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:23:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:23:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.855557294999997, 2024-04-26T10:23:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:23:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:23:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:23:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:23:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:23:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:23:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:23:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:23:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:23:37.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:23:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:23:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:23:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:23:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:23:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:37.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:23:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:23:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:23:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:23:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:23:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:23:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.855357910999999, 2024-04-26T10:23:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:23:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:23:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:23:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:23:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:23:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:23:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:23:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:23:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:23:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:23:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:23:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:23:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:23:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:23:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:23:37.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:23:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:23:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:23:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:23:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.855139291, 2024-04-26T10:23:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:23:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.404 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:23:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:23:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:23:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:23:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:23:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:23:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:23:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:23:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:23:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:23:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:23:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:23:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:23:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:23:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:23:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.408 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.852767853000003, 2024-04-26T10:23:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:23:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.409 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:23:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:23:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:23:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:23:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:23:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:23:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:23:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:23:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:23:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:23:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:23:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:23:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:23:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:23:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:23:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:23:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:23:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.413 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.852667230999998, 2024-04-26T10:23:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:23:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:23:37.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:23:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:37.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:23:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:23:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:23:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:23:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:23:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:23:37.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:23:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:23:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:23:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:23:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:23:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:23:37.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:23:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:23:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:23:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:23:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:23:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.852548670000004, 2024-04-26T10:23:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:23:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:23:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:23:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:23:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:23:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:23:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:23:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:23:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:23:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:23:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:23:37.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:23:37.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:23:37.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:23:37.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:23:37.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:23:37.422 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.422 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.423 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.423 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:37.423 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:37.423 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.852446271999995, 2024-04-26T10:23:37.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:23:37.423 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.423 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.423 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:37.423 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:37.423 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.423 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:23:37.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.423 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:37.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:37.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:23:37.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:37.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:23:37.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:23:37.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:23:37.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:23:37.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:23:37.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:23:37.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:37.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:23:37.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:23:37.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:23:37.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:37.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:23:37.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:23:37.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:23:37.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:23:37.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:23:37.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:23:37.427 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.427 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.427 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.427 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:37.428 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:37.428 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.851425715000005, 2024-04-26T10:23:37.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:23:37.428 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.428 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.428 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:37.428 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:37.428 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.428 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:23:37.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.428 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.428 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.428 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:37.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:37.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:23:37.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:37.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:23:37.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:23:37.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:23:37.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:23:37.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:23:37.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:23:37.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:23:37.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:23:37.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:23:37.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:23:37.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:37.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:23:37.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:23:37.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:23:37.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:23:37.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:23:37.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:23:37.432 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.432 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.432 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.433 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:37.433 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:37.433 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 96.850275440000004, 2024-04-26T10:23:37.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:23:37.433 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.433 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.433 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:37.433 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:37.433 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.433 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:23:37.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.433 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.433 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:37.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:37.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:23:37.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:37.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:23:37.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:23:37.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:23:37.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:23:37.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:23:37.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:23:37.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:23:37.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:23:37.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:23:37.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:23:37.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:37.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:23:37.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:23:37.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:23:37.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:23:37.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:23:37.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:23:37.437 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.437 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.437 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.437 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:37.437 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:37.438 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.353576197999999, 2024-04-26T10:23:37.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:23:37.438 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.438 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.438 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:37.438 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:37.438 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.438 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:23:37.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.438 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:37.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:37.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:23:37.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:37.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:23:37.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:23:37.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:23:37.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:23:37.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:23:37.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:23:37.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:23:37.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:23:37.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:23:37.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:23:37.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:37.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:23:37.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:23:37.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:37.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:23:37.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:23:37.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:23:37.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:23:37.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:23:37.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:23:37.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:23:37.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:23:37.443 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.443 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.443 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.443 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:37.443 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:37.443 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 73.353352602000001, 2024-04-26T10:23:37.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:23:37.443 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.443 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.443 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:37.443 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:37.443 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.444 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:23:37.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.444 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:37.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:37.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:23:37.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:37.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:23:37.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:23:37.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:23:37.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:23:37.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:23:37.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:23:37.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:23:37.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:23:37.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:23:37.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:23:37.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:37.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:23:37.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:23:37.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:37.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:23:37.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:23:37.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:23:37.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:23:37.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:23:37.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:23:37.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:23:37.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:23:37.448 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.448 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.448 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.449 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:37.449 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:37.449 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 66.322506282000006, 2024-04-26T10:23:37.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:23:37.449 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.449 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.449 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:37.449 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:37.449 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.449 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:23:37.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.449 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:37.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:37.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:23:37.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:37.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:23:37.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:23:37.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:23:37.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:23:37.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:23:37.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:23:37.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:23:37.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:23:37.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:23:37.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:23:37.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:37.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:23:37.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:23:37.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:23:37.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:23:37.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:23:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:23:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:23:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:23:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:23:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:23:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.454 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 66.320495179000005, 2024-04-26T10:23:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:23:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.455 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:23:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.456 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:23:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:23:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:23:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:23:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:23:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:23:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:23:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:23:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:23:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:23:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:23:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:23:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:23:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:23:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:23:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:23:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:23:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:23:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:23:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:23:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 66.309617074000002, 2024-04-26T10:23:37.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:23:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:23:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:23:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:23:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:23:37.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:23:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:23:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:23:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:23:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:23:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:23:37.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:23:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:23:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:23:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:23:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:23:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:23:37.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:23:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:23:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:23:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:23:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:23:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:23:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.465 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 66.306935855000006, 2024-04-26T10:23:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:23:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:23:37.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:23:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:37.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:23:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:23:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:23:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:23:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:23:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:23:37.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:23:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:23:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:23:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:23:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:23:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:23:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:23:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:23:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:23:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:23:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:23:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:23:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:23:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:23:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 66.306568780000006, 2024-04-26T10:23:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:23:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.471 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:23:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:37.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:23:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:23:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:23:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:23:37.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:23:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:23:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:23:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:23:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:23:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:23:37.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:23:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:23:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:23:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:23:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:23:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:23:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:23:37.475 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 66.306504528000005, 2024-04-26T10:23:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:23:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:23:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.476 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:23:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:23:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:23:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:23:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:23:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:23:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:23:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:23:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:23:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:23:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:23:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:23:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:23:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:23:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:23:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:23:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:23:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:37.480 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 66.302105854999994, 2024-04-26T10:23:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:23:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:23:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:23:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:23:37.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:23:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:23:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:23:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:23:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:23:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:23:37.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:23:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:23:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:23:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:23:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:23:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:23:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:23:37.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:23:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:23:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 66.300347872000003, 2024-04-26T10:23:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:23:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:37.485 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:23:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:37.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:23:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:23:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:23:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:37.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:23:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:23:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:23:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:23:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:23:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:23:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:37.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:23:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:23:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:23:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:23:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:23:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:23:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:37.489 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:23:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:23:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:23:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:23:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:23:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:23:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.490 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:37.491 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:37.491 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:37.493 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T10:23:37.493 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:37.489+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:37.493 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-26T10:23:37.593 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:37.593+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:37.612 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:37.612 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:37.612 INFO:teuthology.orchestra.run.smithi120.stdout: "num_ops": 0 2024-04-26T10:23:37.612 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:37.623 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-26T10:23:37.694 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-04-26T10:23:37.694 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-04-26T10:23:37.695 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:37.691+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:37.730 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:37.731 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [], 2024-04-26T10:23:37.731 INFO:teuthology.orchestra.run.smithi120.stdout: "complaint_time": 30, 2024-04-26T10:23:37.731 INFO:teuthology.orchestra.run.smithi120.stdout: "num_blocked_ops": 0 2024-04-26T10:23:37.731 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:37.740 DEBUG:teuthology.orchestra.run.smithi120:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-26T10:23:37.795 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:37.793+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:37.896 INFO:tasks.ceph.osd.1.smithi154.stderr:2024-04-26T10:23:37.893+0000 7f00d89fe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18224) UID: 0 2024-04-26T10:23:37.897 INFO:teuthology.orchestra.run.smithi120.stdout:{ 2024-04-26T10:23:37.897 INFO:teuthology.orchestra.run.smithi120.stdout: "size": 20, 2024-04-26T10:23:37.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 600, 2024-04-26T10:23:37.897 INFO:teuthology.orchestra.run.smithi120.stdout: "ops": [ 2024-04-26T10:23:37.897 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.897 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110562 5.2 5:45fd9e2c:::benchmark_data_smithi052_19421_object110561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:37.897 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:37.897 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 73.854184359000001, 2024-04-26T10:23:37.897 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12981701400000001, 2024-04-26T10:23:37.898 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:37.898 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:37.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:37.898 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.898 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110562 2024-04-26T10:23:37.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.898 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:37.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.898 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:37.898 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:37.898 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.898 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.898 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:37.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:37.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:37.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038051+0000", 2024-04-26T10:23:37.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:37.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.899 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:37.899 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038082+0000", 2024-04-26T10:23:37.899 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.1204999999999997e-05 2024-04-26T10:23:37.899 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.899 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:37.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038089+0000", 2024-04-26T10:23:37.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7970000000000003e-06 2024-04-26T10:23:37.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038095+0000", 2024-04-26T10:23:37.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.6170000000000003e-06 2024-04-26T10:23:37.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.900 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040060+0000", 2024-04-26T10:23:37.900 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0019651870000000002 2024-04-26T10:23:37.900 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.900 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.900 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:37.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040173+0000", 2024-04-26T10:23:37.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000112606 2024-04-26T10:23:37.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:37.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167516+0000", 2024-04-26T10:23:37.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12734273500000001 2024-04-26T10:23:37.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:37.901 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167646+0000", 2024-04-26T10:23:37.901 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012993100000000001 2024-04-26T10:23:37.901 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.901 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.901 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:37.902 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.167868+0000", 2024-04-26T10:23:37.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000222456 2024-04-26T10:23:37.902 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.902 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:37.902 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.902 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.902 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.902 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110565 5.3 5:c6ed148b:::benchmark_data_smithi052_19421_object110564:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:37.902 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:37.902 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 73.854075108000004, 2024-04-26T10:23:37.902 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130226382, 2024-04-26T10:23:37.902 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:37.902 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.902 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:37.902 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:37.902 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.903 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110565 2024-04-26T10:23:37.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.903 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:37.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:37.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:37.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:37.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:37.903 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.903 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.903 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.903 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:37.903 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038160+0000", 2024-04-26T10:23:37.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:37.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:37.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038190+0000", 2024-04-26T10:23:37.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0026e-05 2024-04-26T10:23:37.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:37.904 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038198+0000", 2024-04-26T10:23:37.904 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3129999999999999e-06 2024-04-26T10:23:37.904 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.904 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.904 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.038204+0000", 2024-04-26T10:23:37.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5079999999999996e-06 2024-04-26T10:23:37.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162329+0000", 2024-04-26T10:23:37.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.12412480300000001 2024-04-26T10:23:37.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:37.905 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.162840+0000", 2024-04-26T10:23:37.905 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000511313 2024-04-26T10:23:37.905 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.905 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.905 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:37.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168040+0000", 2024-04-26T10:23:37.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0052003190000000001 2024-04-26T10:23:37.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:37.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168155+0000", 2024-04-26T10:23:37.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000114772 2024-04-26T10:23:37.906 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.906 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.906 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:37.906 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.168387+0000", 2024-04-26T10:23:37.906 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000231888 2024-04-26T10:23:37.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.906 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:37.906 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.907 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110567 5.d 5:b9a45b32:::benchmark_data_smithi052_19421_object110566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:37.907 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:37.907 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 73.851677695999996, 2024-04-26T10:23:37.907 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13203365, 2024-04-26T10:23:37.907 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:37.907 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:37.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:37.907 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.907 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110567 2024-04-26T10:23:37.907 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.907 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:37.907 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.907 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:37.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:37.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:37.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040558+0000", 2024-04-26T10:23:37.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:37.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040557+0000", 2024-04-26T10:23:37.908 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:37.908 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.908 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.908 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:37.908 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040640+0000", 2024-04-26T10:23:37.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3424999999999995e-05 2024-04-26T10:23:37.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:37.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040650+0000", 2024-04-26T10:23:37.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.8910000000000007e-06 2024-04-26T10:23:37.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040657+0000", 2024-04-26T10:23:37.909 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.618e-06 2024-04-26T10:23:37.909 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.909 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.909 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.909 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040700+0000", 2024-04-26T10:23:37.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3384999999999999e-05 2024-04-26T10:23:37.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:37.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040807+0000", 2024-04-26T10:23:37.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000107296 2024-04-26T10:23:37.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:37.910 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040897+0000", 2024-04-26T10:23:37.910 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.9981000000000005e-05 2024-04-26T10:23:37.910 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.910 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.910 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:37.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171429+0000", 2024-04-26T10:23:37.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.130531643 2024-04-26T10:23:37.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172467+0000", 2024-04-26T10:23:37.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0010382429999999999 2024-04-26T10:23:37.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:37.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172512+0000", 2024-04-26T10:23:37.911 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5228999999999997e-05 2024-04-26T10:23:37.911 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.911 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.911 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:37.911 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.172591+0000", 2024-04-26T10:23:37.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9202000000000005e-05 2024-04-26T10:23:37.912 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.912 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:37.912 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.912 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.912 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.912 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:110569 5.f 5:fdebd0a3:::benchmark_data_smithi052_19421_object110568:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:37.912 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:37.912 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 73.851491772000003, 2024-04-26T10:23:37.912 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.13101317600000001, 2024-04-26T10:23:37.912 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:37.912 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.912 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:37.912 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:37.912 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.912 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 110569 2024-04-26T10:23:37.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.913 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:37.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:37.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:37.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:37.913 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040744+0000", 2024-04-26T10:23:37.913 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.913 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.913 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.913 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:37.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040743+0000", 2024-04-26T10:23:37.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:37.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:37.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040840+0000", 2024-04-26T10:23:37.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6621999999999997e-05 2024-04-26T10:23:37.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.914 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:37.914 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040847+0000", 2024-04-26T10:23:37.914 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4019999999999996e-06 2024-04-26T10:23:37.914 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.914 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040853+0000", 2024-04-26T10:23:37.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4349999999999996e-06 2024-04-26T10:23:37.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.040898+0000", 2024-04-26T10:23:37.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.5275000000000003e-05 2024-04-26T10:23:37.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.915 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:37.915 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041012+0000", 2024-04-26T10:23:37.915 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011391399999999999 2024-04-26T10:23:37.915 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.915 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:37.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.041135+0000", 2024-04-26T10:23:37.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012297499999999999 2024-04-26T10:23:37.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:37.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.165192+0000", 2024-04-26T10:23:37.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.124056951 2024-04-26T10:23:37.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.916 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.916 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171563+0000", 2024-04-26T10:23:37.916 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0063716959999999996 2024-04-26T10:23:37.916 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.916 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:37.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171643+0000", 2024-04-26T10:23:37.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.9617999999999996e-05 2024-04-26T10:23:37.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.917 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:37.917 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:24.171757+0000", 2024-04-26T10:23:37.917 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000113835 2024-04-26T10:23:37.917 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.917 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:37.917 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.917 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.917 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.917 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165866 5.0 5:070f21b4:::benchmark_data_smithi052_19421_object36394:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:37.917 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:37.918 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.761469155999997, 2024-04-26T10:23:37.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.059494631, 2024-04-26T10:23:37.918 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:37.918 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.918 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:37.918 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:37.918 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.918 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165866 2024-04-26T10:23:37.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.918 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:37.918 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.918 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:37.918 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:37.918 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.918 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:37.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:37.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:37.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130766+0000", 2024-04-26T10:23:37.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:37.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.919 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:37.919 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130770+0000", 2024-04-26T10:23:37.919 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8870000000000002e-06 2024-04-26T10:23:37.919 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.919 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:37.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130777+0000", 2024-04-26T10:23:37.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9659999999999999e-06 2024-04-26T10:23:37.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130782+0000", 2024-04-26T10:23:37.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7930000000000003e-06 2024-04-26T10:23:37.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.920 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130833+0000", 2024-04-26T10:23:37.920 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.0742999999999999e-05 2024-04-26T10:23:37.920 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.920 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.920 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:37.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.130848+0000", 2024-04-26T10:23:37.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4508999999999999e-05 2024-04-26T10:23:37.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167254+0000", 2024-04-26T10:23:37.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.036406282 2024-04-26T10:23:37.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:37.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.167561+0000", 2024-04-26T10:23:37.921 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00030710600000000002 2024-04-26T10:23:37.921 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.921 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.921 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:37.921 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.168060+0000", 2024-04-26T10:23:37.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00049872000000000002 2024-04-26T10:23:37.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183569+0000", 2024-04-26T10:23:37.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.015509237 2024-04-26T10:23:37.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:37.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189747+0000", 2024-04-26T10:23:37.922 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0061781040000000002 2024-04-26T10:23:37.922 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.922 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.922 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:37.922 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189935+0000", 2024-04-26T10:23:37.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018744500000000001 2024-04-26T10:23:37.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.923 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:37.923 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190261+0000", 2024-04-26T10:23:37.923 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00032649300000000002 2024-04-26T10:23:37.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.923 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:37.923 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.923 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.923 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.923 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165922 5.0 5:03f1f645:::benchmark_data_smithi052_19421_object36450:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:37.923 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:37.923 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.738366910000003, 2024-04-26T10:23:37.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0366678789999999, 2024-04-26T10:23:37.924 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:37.924 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:37.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:37.924 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.924 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165922 2024-04-26T10:23:37.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.924 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:37.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:37.924 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:37.924 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.924 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.924 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.924 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:37.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153869+0000", 2024-04-26T10:23:37.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:37.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153867+0000", 2024-04-26T10:23:37.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:37.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.925 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:37.925 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153873+0000", 2024-04-26T10:23:37.925 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9830000000000001e-06 2024-04-26T10:23:37.925 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.925 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:37.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153898+0000", 2024-04-26T10:23:37.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.4573999999999999e-05 2024-04-26T10:23:37.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153919+0000", 2024-04-26T10:23:37.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.0900999999999999e-05 2024-04-26T10:23:37.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.926 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.926 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153976+0000", 2024-04-26T10:23:37.926 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.7176999999999998e-05 2024-04-26T10:23:37.926 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.926 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:37.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.153985+0000", 2024-04-26T10:23:37.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8950000000000004e-06 2024-04-26T10:23:37.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183590+0000", 2024-04-26T10:23:37.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0296048069999999 2024-04-26T10:23:37.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:37.927 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183682+0000", 2024-04-26T10:23:37.927 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2040000000000006e-05 2024-04-26T10:23:37.927 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.927 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.927 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:37.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.183752+0000", 2024-04-26T10:23:37.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0056999999999997e-05 2024-04-26T10:23:37.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.189707+0000", 2024-04-26T10:23:37.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0059551659999999996 2024-04-26T10:23:37.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:37.928 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190424+0000", 2024-04-26T10:23:37.928 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00071724500000000004 2024-04-26T10:23:37.928 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.928 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.928 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:37.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190466+0000", 2024-04-26T10:23:37.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.1306000000000001e-05 2024-04-26T10:23:37.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.929 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:37.929 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190537+0000", 2024-04-26T10:23:37.929 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0992000000000001e-05 2024-04-26T10:23:37.929 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.929 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:37.929 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.929 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.929 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.929 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165946 5.0 5:08fda4cb:::benchmark_data_smithi052_19421_object36474:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:37.929 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:37.929 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.731683771999997, 2024-04-26T10:23:37.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0319386070000001, 2024-04-26T10:23:37.930 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:37.930 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.930 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:37.930 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:37.930 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.930 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165946 2024-04-26T10:23:37.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.930 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:37.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:37.930 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:37.930 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.930 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.930 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.930 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:37.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160552+0000", 2024-04-26T10:23:37.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:37.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160551+0000", 2024-04-26T10:23:37.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:37.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:37.931 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160555+0000", 2024-04-26T10:23:37.931 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.109e-06 2024-04-26T10:23:37.931 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.931 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.931 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:37.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160564+0000", 2024-04-26T10:23:37.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8049999999999996e-06 2024-04-26T10:23:37.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160570+0000", 2024-04-26T10:23:37.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.4309999999999999e-06 2024-04-26T10:23:37.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160631+0000", 2024-04-26T10:23:37.932 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.0291000000000003e-05 2024-04-26T10:23:37.932 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.932 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.932 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:37.932 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.160639+0000", 2024-04-26T10:23:37.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.6370000000000005e-06 2024-04-26T10:23:37.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.184949+0000", 2024-04-26T10:23:37.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0243098049999999 2024-04-26T10:23:37.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:37.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185344+0000", 2024-04-26T10:23:37.933 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039459800000000002 2024-04-26T10:23:37.933 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.933 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.933 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:37.933 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.185612+0000", 2024-04-26T10:23:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026854599999999999 2024-04-26T10:23:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190303+0000", 2024-04-26T10:23:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0046907099999999998 2024-04-26T10:23:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192336+0000", 2024-04-26T10:23:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0020329440000000001 2024-04-26T10:23:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.934 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192385+0000", 2024-04-26T10:23:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.9249000000000002e-05 2024-04-26T10:23:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192490+0000", 2024-04-26T10:23:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105209 2024-04-26T10:23:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165947 5.0 5:0632e394:::benchmark_data_smithi052_19421_object36475:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.729685987000003, 2024-04-26T10:23:37.935 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0300521, 2024-04-26T10:23:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165947 2024-04-26T10:23:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.936 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162550+0000", 2024-04-26T10:23:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162548+0000", 2024-04-26T10:23:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162555+0000", 2024-04-26T10:23:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7880000000000001e-06 2024-04-26T10:23:37.937 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162566+0000", 2024-04-26T10:23:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.116e-05 2024-04-26T10:23:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162574+0000", 2024-04-26T10:23:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6879999999999999e-06 2024-04-26T10:23:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162618+0000", 2024-04-26T10:23:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.4082999999999998e-05 2024-04-26T10:23:37.938 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.162626+0000", 2024-04-26T10:23:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.6769999999999995e-06 2024-04-26T10:23:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187642+0000", 2024-04-26T10:23:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.02501679 2024-04-26T10:23:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187737+0000", 2024-04-26T10:23:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4207000000000001e-05 2024-04-26T10:23:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.939 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.187809+0000", 2024-04-26T10:23:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2527999999999994e-05 2024-04-26T10:23:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192320+0000", 2024-04-26T10:23:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0045109879999999996 2024-04-26T10:23:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192500+0000", 2024-04-26T10:23:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018031199999999999 2024-04-26T10:23:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.940 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192536+0000", 2024-04-26T10:23:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.5707999999999998e-05 2024-04-26T10:23:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192602+0000", 2024-04-26T10:23:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5495999999999998e-05 2024-04-26T10:23:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165976 5.0 5:0a594495:::benchmark_data_smithi052_19421_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:37.941 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.720277281999998, 2024-04-26T10:23:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0208836910000001, 2024-04-26T10:23:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165976 2024-04-26T10:23:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.942 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171958+0000", 2024-04-26T10:23:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171957+0000", 2024-04-26T10:23:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171962+0000", 2024-04-26T10:23:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1649999999999997e-06 2024-04-26T10:23:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.943 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171972+0000", 2024-04-26T10:23:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.7359999999999996e-06 2024-04-26T10:23:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.171980+0000", 2024-04-26T10:23:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4989999999999997e-06 2024-04-26T10:23:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172039+0000", 2024-04-26T10:23:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9311000000000002e-05 2024-04-26T10:23:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.944 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.172047+0000", 2024-04-26T10:23:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2169999999999994e-06 2024-04-26T10:23:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188698+0000", 2024-04-26T10:23:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0166506529999999 2024-04-26T10:23:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188763+0000", 2024-04-26T10:23:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.5542000000000004e-05 2024-04-26T10:23:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.945 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.188822+0000", 2024-04-26T10:23:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8943999999999997e-05 2024-04-26T10:23:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192610+0000", 2024-04-26T10:23:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0037872380000000001 2024-04-26T10:23:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192669+0000", 2024-04-26T10:23:37.946 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9252999999999997e-05 2024-04-26T10:23:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192732+0000", 2024-04-26T10:23:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.2656000000000005e-05 2024-04-26T10:23:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192842+0000", 2024-04-26T10:23:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110401 2024-04-26T10:23:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.947 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:165981 5.0 5:0b9911ca:::benchmark_data_smithi052_19421_object36509:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.718449233000001, 2024-04-26T10:23:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0223044400000001, 2024-04-26T10:23:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 165981 2024-04-26T10:23:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:37.948 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173786+0000", 2024-04-26T10:23:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173785+0000", 2024-04-26T10:23:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.949 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173791+0000", 2024-04-26T10:23:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.519e-06 2024-04-26T10:23:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173801+0000", 2024-04-26T10:23:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0033e-05 2024-04-26T10:23:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173808+0000", 2024-04-26T10:23:37.950 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.1019999999999999e-06 2024-04-26T10:23:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173856+0000", 2024-04-26T10:23:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.8083e-05 2024-04-26T10:23:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.173867+0000", 2024-04-26T10:23:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1184e-05 2024-04-26T10:23:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190582+0000", 2024-04-26T10:23:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.016714822 2024-04-26T10:23:37.951 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190725+0000", 2024-04-26T10:23:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014245600000000001 2024-04-26T10:23:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.190878+0000", 2024-04-26T10:23:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015325899999999999 2024-04-26T10:23:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195961+0000", 2024-04-26T10:23:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0050833629999999996 2024-04-26T10:23:37.952 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.195974+0000", 2024-04-26T10:23:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2662e-05 2024-04-26T10:23:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196020+0000", 2024-04-26T10:23:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6499000000000003e-05 2024-04-26T10:23:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196091+0000", 2024-04-26T10:23:37.953 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.0295000000000004e-05 2024-04-26T10:23:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166003 5.0 5:0007cadd:::benchmark_data_smithi052_19421_object36531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.706869511000001, 2024-04-26T10:23:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.014253007, 2024-04-26T10:23:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:37.954 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166003 2024-04-26T10:23:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.955 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185366+0000", 2024-04-26T10:23:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185368+0000", 2024-04-26T10:23:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8819999999999999e-06 2024-04-26T10:23:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185375+0000", 2024-04-26T10:23:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5240000000000003e-06 2024-04-26T10:23:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.956 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185379+0000", 2024-04-26T10:23:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4539999999999999e-06 2024-04-26T10:23:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185422+0000", 2024-04-26T10:23:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3151000000000001e-05 2024-04-26T10:23:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.185431+0000", 2024-04-26T10:23:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4849999999999998e-06 2024-04-26T10:23:37.957 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.192902+0000", 2024-04-26T10:23:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0074711089999999 2024-04-26T10:23:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193027+0000", 2024-04-26T10:23:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00012434800000000001 2024-04-26T10:23:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.193188+0000", 2024-04-26T10:23:37.958 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000160922 2024-04-26T10:23:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199409+0000", 2024-04-26T10:23:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0062217929999999998 2024-04-26T10:23:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199473+0000", 2024-04-26T10:23:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.3257999999999996e-05 2024-04-26T10:23:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199525+0000", 2024-04-26T10:23:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2065999999999999e-05 2024-04-26T10:23:37.959 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199619+0000", 2024-04-26T10:23:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4303999999999997e-05 2024-04-26T10:23:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166018 5.0 5:0a9b4a86:::benchmark_data_smithi052_19421_object36546:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.700459017, 2024-04-26T10:23:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.008175222, 2024-04-26T10:23:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:37.960 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166018 2024-04-26T10:23:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:37.961 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191777+0000", 2024-04-26T10:23:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191776+0000", 2024-04-26T10:23:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191781+0000", 2024-04-26T10:23:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.8030000000000002e-06 2024-04-26T10:23:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.962 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191791+0000", 2024-04-26T10:23:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0111e-05 2024-04-26T10:23:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191799+0000", 2024-04-26T10:23:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.2779999999999996e-06 2024-04-26T10:23:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191851+0000", 2024-04-26T10:23:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.1989e-05 2024-04-26T10:23:37.963 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.191859+0000", 2024-04-26T10:23:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.3259999999999996e-06 2024-04-26T10:23:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194499+0000", 2024-04-26T10:23:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0026399340000001 2024-04-26T10:23:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194667+0000", 2024-04-26T10:23:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016760899999999999 2024-04-26T10:23:37.964 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.194817+0000", 2024-04-26T10:23:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015044900000000001 2024-04-26T10:23:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199690+0000", 2024-04-26T10:23:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048731069999999998 2024-04-26T10:23:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199705+0000", 2024-04-26T10:23:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4663e-05 2024-04-26T10:23:37.965 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199783+0000", 2024-04-26T10:23:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.8374999999999994e-05 2024-04-26T10:23:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199952+0000", 2024-04-26T10:23:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016851400000000001 2024-04-26T10:23:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.966 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166042 5.0 5:0bfdbb42:::benchmark_data_smithi052_19421_object36570:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.687873953999997, 2024-04-26T10:23:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.0011195470000001, 2024-04-26T10:23:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166042 2024-04-26T10:23:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.967 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204362+0000", 2024-04-26T10:23:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204361+0000", 2024-04-26T10:23:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.968 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204367+0000", 2024-04-26T10:23:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9510000000000003e-06 2024-04-26T10:23:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204378+0000", 2024-04-26T10:23:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1223000000000001e-05 2024-04-26T10:23:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204387+0000", 2024-04-26T10:23:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.0610000000000002e-06 2024-04-26T10:23:37.969 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204461+0000", 2024-04-26T10:23:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.4319000000000005e-05 2024-04-26T10:23:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204467+0000", 2024-04-26T10:23:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.970 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196119+0000", 2024-04-26T10:23:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99165195100000003 2024-04-26T10:23:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196225+0000", 2024-04-26T10:23:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000105905 2024-04-26T10:23:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.196326+0000", 2024-04-26T10:23:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00010070599999999999 2024-04-26T10:23:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.971 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.199970+0000", 2024-04-26T10:23:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0036443909999999999 2024-04-26T10:23:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205315+0000", 2024-04-26T10:23:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053453069999999997 2024-04-26T10:23:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205384+0000", 2024-04-26T10:23:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.9099999999999999e-05 2024-04-26T10:23:37.972 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205481+0000", 2024-04-26T10:23:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.6670999999999997e-05 2024-04-26T10:23:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166045 5.0 5:07c854b4:::benchmark_data_smithi052_19421_object36573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.687639021000003, 2024-04-26T10:23:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.001117169, 2024-04-26T10:23:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:37.973 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166045 2024-04-26T10:23:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.974 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204597+0000", 2024-04-26T10:23:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204596+0000", 2024-04-26T10:23:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204600+0000", 2024-04-26T10:23:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6709999999999998e-06 2024-04-26T10:23:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.975 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204612+0000", 2024-04-26T10:23:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1979e-05 2024-04-26T10:23:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204619+0000", 2024-04-26T10:23:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.596e-06 2024-04-26T10:23:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204654+0000", 2024-04-26T10:23:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.4626999999999999e-05 2024-04-26T10:23:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.976 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.204659+0000", 2024-04-26T10:23:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.9610000000000002e-06 2024-04-26T10:23:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197651+0000", 2024-04-26T10:23:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.99299119999999996 2024-04-26T10:23:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197820+0000", 2024-04-26T10:23:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000169693 2024-04-26T10:23:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.977 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.197938+0000", 2024-04-26T10:23:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00011769000000000001 2024-04-26T10:23:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205550+0000", 2024-04-26T10:23:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0076120789999999999 2024-04-26T10:23:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205562+0000", 2024-04-26T10:23:37.978 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.2286000000000001e-05 2024-04-26T10:23:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205615+0000", 2024-04-26T10:23:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.2126999999999997e-05 2024-04-26T10:23:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205714+0000", 2024-04-26T10:23:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9135999999999994e-05 2024-04-26T10:23:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.979 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166087 5.0 5:0c7bad39:::benchmark_data_smithi052_19421_object36615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.649764144000002, 2024-04-26T10:23:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.968131458, 2024-04-26T10:23:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166087 2024-04-26T10:23:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:37.980 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242471+0000", 2024-04-26T10:23:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242470+0000", 2024-04-26T10:23:37.981 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242478+0000", 2024-04-26T10:23:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.5499999999999997e-06 2024-04-26T10:23:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242499+0000", 2024-04-26T10:23:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.1627000000000001e-05 2024-04-26T10:23:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.982 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242509+0000", 2024-04-26T10:23:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.5119999999999997e-06 2024-04-26T10:23:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242553+0000", 2024-04-26T10:23:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.3785999999999997e-05 2024-04-26T10:23:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242564+0000", 2024-04-26T10:23:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1912e-05 2024-04-26T10:23:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.983 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200019+0000", 2024-04-26T10:23:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95745438900000002 2024-04-26T10:23:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200185+0000", 2024-04-26T10:23:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00016573299999999999 2024-04-26T10:23:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.200343+0000", 2024-04-26T10:23:37.984 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000158713 2024-04-26T10:23:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205728+0000", 2024-04-26T10:23:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0053841970000000003 2024-04-26T10:23:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210525+0000", 2024-04-26T10:23:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0047978059999999999 2024-04-26T10:23:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:37.985 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210556+0000", 2024-04-26T10:23:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.0614999999999997e-05 2024-04-26T10:23:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210603+0000", 2024-04-26T10:23:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6901999999999999e-05 2024-04-26T10:23:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166088 5.0 5:00d77eee:::benchmark_data_smithi052_19421_object36616:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:37.986 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.649319118999998, 2024-04-26T10:23:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.96790094699999996, 2024-04-26T10:23:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166088 2024-04-26T10:23:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.987 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242916+0000", 2024-04-26T10:23:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242915+0000", 2024-04-26T10:23:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:37.988 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242921+0000", 2024-04-26T10:23:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.5879999999999997e-06 2024-04-26T10:23:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242937+0000", 2024-04-26T10:23:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.6583999999999999e-05 2024-04-26T10:23:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242945+0000", 2024-04-26T10:23:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.3050000000000004e-06 2024-04-26T10:23:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.989 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.242999+0000", 2024-04-26T10:23:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4026000000000001e-05 2024-04-26T10:23:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.243009+0000", 2024-04-26T10:23:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.9010000000000006e-06 2024-04-26T10:23:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201737+0000", 2024-04-26T10:23:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95872822700000004 2024-04-26T10:23:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.990 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.201918+0000", 2024-04-26T10:23:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00018079200000000001 2024-04-26T10:23:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.202059+0000", 2024-04-26T10:23:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014097 2024-04-26T10:23:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205734+0000", 2024-04-26T10:23:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.003675827 2024-04-26T10:23:37.991 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210669+0000", 2024-04-26T10:23:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0049344139999999998 2024-04-26T10:23:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210723+0000", 2024-04-26T10:23:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.4095999999999998e-05 2024-04-26T10:23:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210817+0000", 2024-04-26T10:23:37.992 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.4357000000000005e-05 2024-04-26T10:23:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166097 5.0 5:0d4a4ef3:::benchmark_data_smithi052_19421_object36625:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.637716118999997, 2024-04-26T10:23:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95646661200000005, 2024-04-26T10:23:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:37.993 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166097 2024-04-26T10:23:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254519+0000", 2024-04-26T10:23:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:37.994 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254518+0000", 2024-04-26T10:23:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254525+0000", 2024-04-26T10:23:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.956e-06 2024-04-26T10:23:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254541+0000", 2024-04-26T10:23:37.995 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5509999999999999e-05 2024-04-26T10:23:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254552+0000", 2024-04-26T10:23:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.1131000000000001e-05 2024-04-26T10:23:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254590+0000", 2024-04-26T10:23:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8117000000000001e-05 2024-04-26T10:23:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:37.996 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.254599+0000", 2024-04-26T10:23:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7930000000000003e-06 2024-04-26T10:23:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203281+0000", 2024-04-26T10:23:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94868228600000004 2024-04-26T10:23:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203542+0000", 2024-04-26T10:23:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00026090100000000001 2024-04-26T10:23:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.203700+0000", 2024-04-26T10:23:37.997 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00015794299999999999 2024-04-26T10:23:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210848+0000", 2024-04-26T10:23:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0071481690000000002 2024-04-26T10:23:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210887+0000", 2024-04-26T10:23:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.8739999999999998e-05 2024-04-26T10:23:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:37.998 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210919+0000", 2024-04-26T10:23:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.2076999999999998e-05 2024-04-26T10:23:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210986+0000", 2024-04-26T10:23:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.7191000000000001e-05 2024-04-26T10:23:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166098 5.0 5:030cb41e:::benchmark_data_smithi052_19421_object36626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:37.999 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.636442529, 2024-04-26T10:23:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.95952243599999998, 2024-04-26T10:23:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166098 2024-04-26T10:23:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.000 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255793+0000", 2024-04-26T10:23:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255792+0000", 2024-04-26T10:23:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255798+0000", 2024-04-26T10:23:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 5.648e-06 2024-04-26T10:23:38.001 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255812+0000", 2024-04-26T10:23:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3848e-05 2024-04-26T10:23:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255830+0000", 2024-04-26T10:23:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.8451999999999999e-05 2024-04-26T10:23:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255908+0000", 2024-04-26T10:23:38.002 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 7.7523999999999998e-05 2024-04-26T10:23:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.255931+0000", 2024-04-26T10:23:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.3629999999999999e-05 2024-04-26T10:23:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205770+0000", 2024-04-26T10:23:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94983906799999995 2024-04-26T10:23:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.003 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.205935+0000", 2024-04-26T10:23:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000165272 2024-04-26T10:23:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.206076+0000", 2024-04-26T10:23:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014016399999999999 2024-04-26T10:23:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.210878+0000", 2024-04-26T10:23:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0048018929999999998 2024-04-26T10:23:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.004 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215174+0000", 2024-04-26T10:23:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0042966239999999998 2024-04-26T10:23:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215222+0000", 2024-04-26T10:23:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.7710999999999998e-05 2024-04-26T10:23:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215315+0000", 2024-04-26T10:23:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.3572000000000005e-05 2024-04-26T10:23:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:38.005 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166107 5.0 5:04caf377:::benchmark_data_smithi052_19421_object36635:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.619685228000002, 2024-04-26T10:23:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.94290359099999999, 2024-04-26T10:23:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.006 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166107 2024-04-26T10:23:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272550+0000", 2024-04-26T10:23:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.007 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272549+0000", 2024-04-26T10:23:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272555+0000", 2024-04-26T10:23:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1630000000000001e-06 2024-04-26T10:23:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272570+0000", 2024-04-26T10:23:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.4114000000000001e-05 2024-04-26T10:23:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.008 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272578+0000", 2024-04-26T10:23:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.7220000000000005e-06 2024-04-26T10:23:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272689+0000", 2024-04-26T10:23:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000110536 2024-04-26T10:23:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.272702+0000", 2024-04-26T10:23:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.3607e-05 2024-04-26T10:23:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:38.009 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207409+0000", 2024-04-26T10:23:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.934706547 2024-04-26T10:23:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207572+0000", 2024-04-26T10:23:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000163191 2024-04-26T10:23:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.207775+0000", 2024-04-26T10:23:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00020287500000000001 2024-04-26T10:23:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:38.010 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.214925+0000", 2024-04-26T10:23:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.007150333 2024-04-26T10:23:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215325+0000", 2024-04-26T10:23:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00039942299999999999 2024-04-26T10:23:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215371+0000", 2024-04-26T10:23:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4.6656999999999997e-05 2024-04-26T10:23:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215454+0000", 2024-04-26T10:23:38.011 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.2468999999999999e-05 2024-04-26T10:23:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: "description": "osd_op(client.4722.0:166118 5.0 5:0ed87079:::benchmark_data_smithi052_19421_object36646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-26T10:23:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: "initiated_at": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: "age": 48.574773207, 2024-04-26T10:23:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89813280100000004, 2024-04-26T10:23:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: "type_data": { 2024-04-26T10:23:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: "client_info": { 2024-04-26T10:23:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: "client": "client.4722", 2024-04-26T10:23:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.012 INFO:teuthology.orchestra.run.smithi120.stdout: "tid": 166118 2024-04-26T10:23:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: "events": [ 2024-04-26T10:23:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "initiated", 2024-04-26T10:23:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "throttled", 2024-04-26T10:23:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317462+0000", 2024-04-26T10:23:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0 2024-04-26T10:23:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "header_read", 2024-04-26T10:23:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317461+0000", 2024-04-26T10:23:38.013 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 4294967295.999999 2024-04-26T10:23:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "all_read", 2024-04-26T10:23:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317467+0000", 2024-04-26T10:23:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 6.1999999999999999e-06 2024-04-26T10:23:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "dispatched", 2024-04-26T10:23:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317488+0000", 2024-04-26T10:23:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.048e-05 2024-04-26T10:23:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.014 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317503+0000", 2024-04-26T10:23:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 1.5079000000000001e-05 2024-04-26T10:23:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317591+0000", 2024-04-26T10:23:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 8.8572000000000005e-05 2024-04-26T10:23:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for peered", 2024-04-26T10:23:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:49.317617+0000", 2024-04-26T10:23:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 2.5663000000000001e-05 2024-04-26T10:23:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.015 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "reached_pg", 2024-04-26T10:23:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209245+0000", 2024-04-26T10:23:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.89162798499999996 2024-04-26T10:23:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "started", 2024-04-26T10:23:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209394+0000", 2024-04-26T10:23:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00014921499999999999 2024-04-26T10:23:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "waiting for subops from 1", 2024-04-26T10:23:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.209539+0000", 2024-04-26T10:23:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.000144602 2024-04-26T10:23:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:38.016 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215166+0000", 2024-04-26T10:23:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.0056265880000000001 2024-04-26T10:23:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "op_commit", 2024-04-26T10:23:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215463+0000", 2024-04-26T10:23:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 0.00029776599999999998 2024-04-26T10:23:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "commit_sent", 2024-04-26T10:23:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215502+0000", 2024-04-26T10:23:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 3.9110000000000003e-05 2024-04-26T10:23:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: }, 2024-04-26T10:23:38.017 INFO:teuthology.orchestra.run.smithi120.stdout: { 2024-04-26T10:23:38.018 INFO:teuthology.orchestra.run.smithi120.stdout: "event": "done", 2024-04-26T10:23:38.018 INFO:teuthology.orchestra.run.smithi120.stdout: "time": "2024-04-26T10:22:50.215595+0000", 2024-04-26T10:23:38.018 INFO:teuthology.orchestra.run.smithi120.stdout: "duration": 9.2717e-05 2024-04-26T10:23:38.018 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:38.018 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:38.018 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:38.018 INFO:teuthology.orchestra.run.smithi120.stdout: } 2024-04-26T10:23:38.018 INFO:teuthology.orchestra.run.smithi120.stdout: ] 2024-04-26T10:23:38.018 INFO:teuthology.orchestra.run.smithi120.stdout:} 2024-04-26T10:23:38.020 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-26T10:23:38.020 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:38.015+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:38.121 INFO:tasks.ceph.osd.0.smithi120.stderr:2024-04-26T10:23:38.119+0000 7f5cedbb8700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18191) UID: 0 2024-04-26T10:23:38.135 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:38.135 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:38.135 INFO:teuthology.orchestra.run.smithi154.stdout: "num_ops": 0 2024-04-26T10:23:38.135 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:38.145 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-26T10:23:38.168 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'unique_pool_0' removed 2024-04-26T10:23:38.180 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-26T10:23:38.191 INFO:tasks.thrashosds:joining thrashosds 2024-04-26T10:23:38.269 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:38.270 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [], 2024-04-26T10:23:38.270 INFO:teuthology.orchestra.run.smithi154.stdout: "complaint_time": 30, 2024-04-26T10:23:38.270 INFO:teuthology.orchestra.run.smithi154.stdout: "num_blocked_ops": 0 2024-04-26T10:23:38.270 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:38.282 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-26T10:23:38.383 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2024-04-26T10:23:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "size": 20, 2024-04-26T10:23:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 600, 2024-04-26T10:23:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "ops": [ 2024-04-26T10:23:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65281 5.8 5:1e42f2c4:::benchmark_data_smithi052_19421_object65280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.851538496000003, 2024-04-26T10:23:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100721535, 2024-04-26T10:23:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.384 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65281 2024-04-26T10:23:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530641+0000", 2024-04-26T10:23:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.385 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530640+0000", 2024-04-26T10:23:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530721+0000", 2024-04-26T10:23:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0748999999999995e-05 2024-04-26T10:23:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530732+0000", 2024-04-26T10:23:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1342000000000001e-05 2024-04-26T10:23:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.386 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.530738+0000", 2024-04-26T10:23:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4620000000000004e-06 2024-04-26T10:23:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532555+0000", 2024-04-26T10:23:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.001817379 2024-04-26T10:23:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532755+0000", 2024-04-26T10:23:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000199905 2024-04-26T10:23:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:38.387 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631249+0000", 2024-04-26T10:23:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098493965000000003 2024-04-26T10:23:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631295+0000", 2024-04-26T10:23:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.5618999999999998e-05 2024-04-26T10:23:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631362+0000", 2024-04-26T10:23:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7824999999999995e-05 2024-04-26T10:23:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.388 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65283 5.0 5:001837a0:::benchmark_data_smithi052_19421_object65282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.849556269000004, 2024-04-26T10:23:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098613477000000005, 2024-04-26T10:23:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65283 2024-04-26T10:23:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.389 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532623+0000", 2024-04-26T10:23:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532617+0000", 2024-04-26T10:23:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999938 2024-04-26T10:23:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.390 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532684+0000", 2024-04-26T10:23:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7620000000000006e-05 2024-04-26T10:23:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532696+0000", 2024-04-26T10:23:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.1788e-05 2024-04-26T10:23:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532705+0000", 2024-04-26T10:23:38.391 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2500000000000006e-06 2024-04-26T10:23:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532786+0000", 2024-04-26T10:23:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1029e-05 2024-04-26T10:23:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532946+0000", 2024-04-26T10:23:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016090500000000001 2024-04-26T10:23:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.392 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631079+0000", 2024-04-26T10:23:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098132062000000006 2024-04-26T10:23:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631161+0000", 2024-04-26T10:23:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.2008999999999994e-05 2024-04-26T10:23:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631237+0000", 2024-04-26T10:23:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.6044000000000006e-05 2024-04-26T10:23:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.393 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65285 5.4 5:2a3b9f3a:::benchmark_data_smithi052_19421_object65284:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.849356885000006, 2024-04-26T10:23:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099698235999999996, 2024-04-26T10:23:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65285 2024-04-26T10:23:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.394 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532822+0000", 2024-04-26T10:23:38.395 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532868+0000", 2024-04-26T10:23:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.672e-05 2024-04-26T10:23:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532878+0000", 2024-04-26T10:23:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.4960000000000002e-06 2024-04-26T10:23:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.396 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532885+0000", 2024-04-26T10:23:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.5310000000000004e-06 2024-04-26T10:23:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.532954+0000", 2024-04-26T10:23:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8317000000000003e-05 2024-04-26T10:23:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533163+0000", 2024-04-26T10:23:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00020892400000000001 2024-04-26T10:23:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.397 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632303+0000", 2024-04-26T10:23:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.099140480000000003 2024-04-26T10:23:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632400+0000", 2024-04-26T10:23:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7180000000000001e-05 2024-04-26T10:23:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632521+0000", 2024-04-26T10:23:38.398 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000120301 2024-04-26T10:23:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65280 5.f e34/22 5:f2fb4dc7:::benchmark_data_smithi052_19421_object65279:head v 34'4127, mlcod=34'4124)", 2024-04-26T10:23:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.849138264999993, 2024-04-26T10:23:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097690880999999993, 2024-04-26T10:23:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.399 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533041+0000", 2024-04-26T10:23:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533040+0000", 2024-04-26T10:23:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.400 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533106+0000", 2024-04-26T10:23:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5580000000000006e-05 2024-04-26T10:23:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533121+0000", 2024-04-26T10:23:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.5196e-05 2024-04-26T10:23:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.533128+0000", 2024-04-26T10:23:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8700000000000003e-06 2024-04-26T10:23:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.401 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535151+0000", 2024-04-26T10:23:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.002023164 2024-04-26T10:23:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535183+0000", 2024-04-26T10:23:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2342000000000003e-05 2024-04-26T10:23:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630671+0000", 2024-04-26T10:23:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095487246999999997 2024-04-26T10:23:38.402 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630732+0000", 2024-04-26T10:23:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.1346999999999994e-05 2024-04-26T10:23:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65289 5.0 5:02654866:::benchmark_data_smithi052_19421_object65288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.846766826999996, 2024-04-26T10:23:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096119144000000004, 2024-04-26T10:23:38.403 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65289 2024-04-26T10:23:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.404 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535413+0000", 2024-04-26T10:23:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535411+0000", 2024-04-26T10:23:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535478+0000", 2024-04-26T10:23:38.405 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7096999999999998e-05 2024-04-26T10:23:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535491+0000", 2024-04-26T10:23:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3359e-05 2024-04-26T10:23:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535501+0000", 2024-04-26T10:23:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.7229999999999999e-06 2024-04-26T10:23:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.406 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00047365299999999999 2024-04-26T10:23:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536164+0000", 2024-04-26T10:23:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00018951699999999999 2024-04-26T10:23:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631371+0000", 2024-04-26T10:23:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095207179000000003 2024-04-26T10:23:38.407 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631413+0000", 2024-04-26T10:23:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1547e-05 2024-04-26T10:23:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631532+0000", 2024-04-26T10:23:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000118639 2024-04-26T10:23:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.408 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65290 5.8 5:1fecd416:::benchmark_data_smithi052_19421_object65289:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.846666205000005, 2024-04-26T10:23:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096441273999999994, 2024-04-26T10:23:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65290 2024-04-26T10:23:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.409 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535513+0000", 2024-04-26T10:23:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535512+0000", 2024-04-26T10:23:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.410 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535545+0000", 2024-04-26T10:23:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.2685000000000003e-05 2024-04-26T10:23:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535553+0000", 2024-04-26T10:23:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.0479999999999999e-06 2024-04-26T10:23:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535559+0000", 2024-04-26T10:23:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.3069999999999999e-06 2024-04-26T10:23:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.411 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536069+0000", 2024-04-26T10:23:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000509137 2024-04-26T10:23:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536174+0000", 2024-04-26T10:23:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010578600000000001 2024-04-26T10:23:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631541+0000", 2024-04-26T10:23:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095366192000000002 2024-04-26T10:23:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.412 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631726+0000", 2024-04-26T10:23:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000185195 2024-04-26T10:23:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.631954+0000", 2024-04-26T10:23:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000228633 2024-04-26T10:23:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.413 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_repop(client.4722.0:65287 5.f e34/22 5:f2323d81:::benchmark_data_smithi052_19421_object65286:head v 34'4128, mlcod=34'4124)", 2024-04-26T10:23:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.846547643999997, 2024-04-26T10:23:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095151819999999998, 2024-04-26T10:23:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.414 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535632+0000", 2024-04-26T10:23:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535631+0000", 2024-04-26T10:23:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535767+0000", 2024-04-26T10:23:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00013608199999999999 2024-04-26T10:23:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.415 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535786+0000", 2024-04-26T10:23:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.91e-05 2024-04-26T10:23:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535812+0000", 2024-04-26T10:23:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6265999999999999e-05 2024-04-26T10:23:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537232+0000", 2024-04-26T10:23:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0014193929999999999 2024-04-26T10:23:38.416 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537256+0000", 2024-04-26T10:23:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.3986e-05 2024-04-26T10:23:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630740+0000", 2024-04-26T10:23:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.093484315999999998 2024-04-26T10:23:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.417 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.630784+0000", 2024-04-26T10:23:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3451000000000001e-05 2024-04-26T10:23:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65291 5.a 5:57028af3:::benchmark_data_smithi052_19421_object65290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.846445246000002, 2024-04-26T10:23:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.100883018, 2024-04-26T10:23:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.418 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65291 2024-04-26T10:23:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535734+0000", 2024-04-26T10:23:38.419 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535733+0000", 2024-04-26T10:23:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535807+0000", 2024-04-26T10:23:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3775000000000004e-05 2024-04-26T10:23:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.420 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535823+0000", 2024-04-26T10:23:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6507999999999998e-05 2024-04-26T10:23:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535834+0000", 2024-04-26T10:23:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0920999999999999e-05 2024-04-26T10:23:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.535975+0000", 2024-04-26T10:23:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014082100000000001 2024-04-26T10:23:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.421 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536137+0000", 2024-04-26T10:23:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000162201 2024-04-26T10:23:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636358+0000", 2024-04-26T10:23:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10022134000000001 2024-04-26T10:23:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636457+0000", 2024-04-26T10:23:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.8661999999999998e-05 2024-04-26T10:23:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.422 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.636617+0000", 2024-04-26T10:23:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000159987 2024-04-26T10:23:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65295 5.4 5:2a8a5633:::benchmark_data_smithi052_19421_object65294:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.845424688999998, 2024-04-26T10:23:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095953448999999996, 2024-04-26T10:23:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.423 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65295 2024-04-26T10:23:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536755+0000", 2024-04-26T10:23:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.424 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536754+0000", 2024-04-26T10:23:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536827+0000", 2024-04-26T10:23:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.3073999999999999e-05 2024-04-26T10:23:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536840+0000", 2024-04-26T10:23:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.2933e-05 2024-04-26T10:23:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.425 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536847+0000", 2024-04-26T10:23:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2400000000000001e-06 2024-04-26T10:23:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.536902+0000", 2024-04-26T10:23:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4580000000000003e-05 2024-04-26T10:23:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537060+0000", 2024-04-26T10:23:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000158572 2024-04-26T10:23:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.426 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632542+0000", 2024-04-26T10:23:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.095481441 2024-04-26T10:23:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632606+0000", 2024-04-26T10:23:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4312000000000004e-05 2024-04-26T10:23:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.632708+0000", 2024-04-26T10:23:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000102137 2024-04-26T10:23:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.427 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:65296 5.a 5:51e7edfc:::benchmark_data_smithi052_19421_object65295:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-26T10:23:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 97.844274413999997, 2024-04-26T10:23:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10197139199999999, 2024-04-26T10:23:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 65296 2024-04-26T10:23:38.428 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537905+0000", 2024-04-26T10:23:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537904+0000", 2024-04-26T10:23:38.429 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537983+0000", 2024-04-26T10:23:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.9079000000000006e-05 2024-04-26T10:23:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.537996+0000", 2024-04-26T10:23:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.3056e-05 2024-04-26T10:23:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.430 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538005+0000", 2024-04-26T10:23:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.8359999999999998e-06 2024-04-26T10:23:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.538510+0000", 2024-04-26T10:23:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00050521799999999999 2024-04-26T10:23:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.627175+0000", 2024-04-26T10:23:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.088665472999999995 2024-04-26T10:23:38.431 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639748+0000", 2024-04-26T10:23:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012572853 2024-04-26T10:23:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639802+0000", 2024-04-26T10:23:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4129000000000003e-05 2024-04-26T10:23:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.432 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:00.639876+0000", 2024-04-26T10:23:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.4062999999999999e-05 2024-04-26T10:23:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110554 5.0 5:04324c12:::benchmark_data_smithi052_19421_object110553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 74.347575172000006, 2024-04-26T10:23:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12965531899999999, 2024-04-26T10:23:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.433 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110554 2024-04-26T10:23:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034604+0000", 2024-04-26T10:23:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.434 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034603+0000", 2024-04-26T10:23:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034756+0000", 2024-04-26T10:23:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015290900000000001 2024-04-26T10:23:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034813+0000", 2024-04-26T10:23:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.7470999999999999e-05 2024-04-26T10:23:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.435 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034820+0000", 2024-04-26T10:23:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9480000000000002e-06 2024-04-26T10:23:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037005+0000", 2024-04-26T10:23:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0021842820000000001 2024-04-26T10:23:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037201+0000", 2024-04-26T10:23:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000196276 2024-04-26T10:23:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:38.436 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.037363+0000", 2024-04-26T10:23:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00016201200000000001 2024-04-26T10:23:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.040760+0000", 2024-04-26T10:23:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0033974529999999999 2024-04-26T10:23:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163836+0000", 2024-04-26T10:23:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.123075565 2024-04-26T10:23:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.437 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.163990+0000", 2024-04-26T10:23:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015417299999999999 2024-04-26T10:23:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164259+0000", 2024-04-26T10:23:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00026932699999999998 2024-04-26T10:23:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:110557 5.b 5:d659544e:::benchmark_data_smithi052_19421_object110556:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-26T10:23:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:38.438 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 74.347351575999994, 2024-04-26T10:23:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.12985108400000001, 2024-04-26T10:23:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 110557 2024-04-26T10:23:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:38.439 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034828+0000", 2024-04-26T10:23:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034827+0000", 2024-04-26T10:23:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.440 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034857+0000", 2024-04-26T10:23:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0298999999999999e-05 2024-04-26T10:23:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034864+0000", 2024-04-26T10:23:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.5189999999999998e-06 2024-04-26T10:23:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034868+0000", 2024-04-26T10:23:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.2010000000000001e-06 2024-04-26T10:23:38.441 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.034932+0000", 2024-04-26T10:23:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4122999999999996e-05 2024-04-26T10:23:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035044+0000", 2024-04-26T10:23:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000112166 2024-04-26T10:23:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.035154+0000", 2024-04-26T10:23:38.442 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000109336 2024-04-26T10:23:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.038168+0000", 2024-04-26T10:23:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0030145219999999999 2024-04-26T10:23:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164372+0000", 2024-04-26T10:23:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.126204117 2024-04-26T10:23:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.443 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164485+0000", 2024-04-26T10:23:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00011234 2024-04-26T10:23:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:24.164679+0000", 2024-04-26T10:23:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000194107 2024-04-26T10:23:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124446 5.0 5:015ab57f:::benchmark_data_smithi052_19421_object124445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:38.444 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 67.316505255999999, 2024-04-26T10:23:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098170398000000006, 2024-04-26T10:23:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124446 2024-04-26T10:23:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:38.445 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065674+0000", 2024-04-26T10:23:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065673+0000", 2024-04-26T10:23:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.446 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065705+0000", 2024-04-26T10:23:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.1470000000000002e-05 2024-04-26T10:23:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065713+0000", 2024-04-26T10:23:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.1880000000000002e-06 2024-04-26T10:23:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.065720+0000", 2024-04-26T10:23:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.9240000000000001e-06 2024-04-26T10:23:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.447 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077353+0000", 2024-04-26T10:23:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011632807 2024-04-26T10:23:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077508+0000", 2024-04-26T10:23:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015521 2024-04-26T10:23:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.077682+0000", 2024-04-26T10:23:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000174141 2024-04-26T10:23:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.448 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083231+0000", 2024-04-26T10:23:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0055485350000000003 2024-04-26T10:23:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163603+0000", 2024-04-26T10:23:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080372386000000004 2024-04-26T10:23:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163715+0000", 2024-04-26T10:23:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111834 2024-04-26T10:23:38.449 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163844+0000", 2024-04-26T10:23:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000129713 2024-04-26T10:23:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124451 5.0 5:0ef9b8d4:::benchmark_data_smithi052_19421_object124450:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 67.314494152999998, 2024-04-26T10:23:38.450 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.10175034500000001, 2024-04-26T10:23:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124451 2024-04-26T10:23:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.451 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067685+0000", 2024-04-26T10:23:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067709+0000", 2024-04-26T10:23:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4470000000000001e-05 2024-04-26T10:23:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.452 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067714+0000", 2024-04-26T10:23:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7530000000000001e-06 2024-04-26T10:23:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.067717+0000", 2024-04-26T10:23:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.3809999999999999e-06 2024-04-26T10:23:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080475+0000", 2024-04-26T10:23:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.012758024999999999 2024-04-26T10:23:38.453 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080627+0000", 2024-04-26T10:23:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000151822 2024-04-26T10:23:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.080804+0000", 2024-04-26T10:23:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00017729099999999999 2024-04-26T10:23:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:38.454 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.163946+0000", 2024-04-26T10:23:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.083141796000000004 2024-04-26T10:23:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169285+0000", 2024-04-26T10:23:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0053389459999999998 2024-04-26T10:23:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169342+0000", 2024-04-26T10:23:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.6793000000000003e-05 2024-04-26T10:23:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.455 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169436+0000", 2024-04-26T10:23:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3523000000000006e-05 2024-04-26T10:23:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124472 5.0 5:03378b59:::benchmark_data_smithi052_19421_object124471:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 67.303616047999995, 2024-04-26T10:23:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097473819000000003, 2024-04-26T10:23:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:38.456 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124472 2024-04-26T10:23:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078563+0000", 2024-04-26T10:23:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.457 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078562+0000", 2024-04-26T10:23:38.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:38.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078658+0000", 2024-04-26T10:23:38.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.6071999999999998e-05 2024-04-26T10:23:38.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.458 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.458 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078682+0000", 2024-04-26T10:23:38.458 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.4176999999999999e-05 2024-04-26T10:23:38.458 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.458 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.078691+0000", 2024-04-26T10:23:38.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.3889999999999994e-06 2024-04-26T10:23:38.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083474+0000", 2024-04-26T10:23:38.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0047825239999999998 2024-04-26T10:23:38.459 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.459 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.459 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.459 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083598+0000", 2024-04-26T10:23:38.459 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00012438999999999999 2024-04-26T10:23:38.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:38.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.083756+0000", 2024-04-26T10:23:38.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00015796399999999999 2024-04-26T10:23:38.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:38.460 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164022+0000", 2024-04-26T10:23:38.460 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.080266119999999996 2024-04-26T10:23:38.460 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.460 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.460 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:38.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175922+0000", 2024-04-26T10:23:38.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.011899147000000001 2024-04-26T10:23:38.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175965+0000", 2024-04-26T10:23:38.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.3510000000000002e-05 2024-04-26T10:23:38.461 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.461 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.461 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.461 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176037+0000", 2024-04-26T10:23:38.461 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2039000000000006e-05 2024-04-26T10:23:38.461 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.462 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.462 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.462 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.462 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.462 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124478 5.0 5:0d1d46d7:::benchmark_data_smithi052_19421_object124477:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:38.462 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:38.462 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 67.300934828999999, 2024-04-26T10:23:38.462 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.097131787999999997, 2024-04-26T10:23:38.462 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.462 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.462 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:38.462 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:38.462 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.463 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124478 2024-04-26T10:23:38.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.463 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:38.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.463 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.463 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081245+0000", 2024-04-26T10:23:38.463 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.463 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.463 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081243+0000", 2024-04-26T10:23:38.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999986 2024-04-26T10:23:38.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081285+0000", 2024-04-26T10:23:38.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1804000000000002e-05 2024-04-26T10:23:38.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.464 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.464 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.464 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081301+0000", 2024-04-26T10:23:38.464 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.6342e-05 2024-04-26T10:23:38.464 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081310+0000", 2024-04-26T10:23:38.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 8.4349999999999997e-06 2024-04-26T10:23:38.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164072+0000", 2024-04-26T10:23:38.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.082761989999999994 2024-04-26T10:23:38.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.465 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.465 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.465 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164397+0000", 2024-04-26T10:23:38.465 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00032538499999999998 2024-04-26T10:23:38.465 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:38.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.164807+0000", 2024-04-26T10:23:38.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00041036099999999998 2024-04-26T10:23:38.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.466 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:38.466 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174108+0000", 2024-04-26T10:23:38.466 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.009300193 2024-04-26T10:23:38.466 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.466 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:38.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178259+0000", 2024-04-26T10:23:38.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0041515359999999999 2024-04-26T10:23:38.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178298+0000", 2024-04-26T10:23:38.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.9082000000000003e-05 2024-04-26T10:23:38.467 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.467 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.467 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.467 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178376+0000", 2024-04-26T10:23:38.467 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.8127999999999995e-05 2024-04-26T10:23:38.467 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.468 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.468 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.468 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.468 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124479 5.8 5:10535379:::benchmark_data_smithi052_19421_object124478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:38.468 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:38.468 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 67.300567753999999, 2024-04-26T10:23:38.468 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.096857925999999997, 2024-04-26T10:23:38.468 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.468 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.468 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:38.468 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:38.468 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.468 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124479 2024-04-26T10:23:38.468 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.469 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:38.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.469 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081612+0000", 2024-04-26T10:23:38.469 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.469 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.469 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.469 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081611+0000", 2024-04-26T10:23:38.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:38.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081652+0000", 2024-04-26T10:23:38.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.1006e-05 2024-04-26T10:23:38.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.470 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.470 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.470 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081663+0000", 2024-04-26T10:23:38.470 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 1.0993e-05 2024-04-26T10:23:38.470 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081669+0000", 2024-04-26T10:23:38.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.601e-06 2024-04-26T10:23:38.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169343+0000", 2024-04-26T10:23:38.471 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.087673317000000001 2024-04-26T10:23:38.471 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.471 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.471 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.471 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.169694+0000", 2024-04-26T10:23:38.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035149200000000002 2024-04-26T10:23:38.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:38.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178387+0000", 2024-04-26T10:23:38.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0086924499999999991 2024-04-26T10:23:38.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.472 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.472 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178414+0000", 2024-04-26T10:23:38.472 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.7123000000000001e-05 2024-04-26T10:23:38.472 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.472 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.473 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.473 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.178470+0000", 2024-04-26T10:23:38.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.5841000000000003e-05 2024-04-26T10:23:38.473 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.473 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.473 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.473 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.473 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.473 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124480 5.8 5:1f7ea379:::benchmark_data_smithi052_19421_object124479:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:38.473 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:38.473 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 67.300503501999998, 2024-04-26T10:23:38.473 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.098789600000000005, 2024-04-26T10:23:38.473 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.473 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.474 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:38.474 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:38.474 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.474 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124480 2024-04-26T10:23:38.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.474 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.474 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.474 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.474 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:38.474 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.474 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081676+0000", 2024-04-26T10:23:38.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081675+0000", 2024-04-26T10:23:38.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:38.475 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.475 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.475 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.475 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081713+0000", 2024-04-26T10:23:38.475 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.7395999999999999e-05 2024-04-26T10:23:38.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081720+0000", 2024-04-26T10:23:38.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.798e-06 2024-04-26T10:23:38.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.476 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.476 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.476 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.081725+0000", 2024-04-26T10:23:38.476 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.4e-06 2024-04-26T10:23:38.476 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174103+0000", 2024-04-26T10:23:38.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.092377631000000002 2024-04-26T10:23:38.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.174214+0000", 2024-04-26T10:23:38.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.000111084 2024-04-26T10:23:38.477 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.477 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.477 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:38.477 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180371+0000", 2024-04-26T10:23:38.477 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0061576959999999998 2024-04-26T10:23:38.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180401+0000", 2024-04-26T10:23:38.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.9397e-05 2024-04-26T10:23:38.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.478 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.478 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180465+0000", 2024-04-26T10:23:38.478 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.4691999999999997e-05 2024-04-26T10:23:38.478 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.478 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.478 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.478 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.478 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.479 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124489 5.8 5:1c472b28:::benchmark_data_smithi052_19421_object124488:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:38.479 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:38.479 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 67.296104829000001, 2024-04-26T10:23:38.479 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094469988000000005, 2024-04-26T10:23:38.479 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.479 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.479 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:38.479 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:38.479 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.479 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124489 2024-04-26T10:23:38.479 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.479 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.479 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.479 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.479 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:38.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086075+0000", 2024-04-26T10:23:38.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086074+0000", 2024-04-26T10:23:38.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.9999995 2024-04-26T10:23:38.480 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.480 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.480 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.480 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086127+0000", 2024-04-26T10:23:38.480 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 5.3168999999999999e-05 2024-04-26T10:23:38.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086134+0000", 2024-04-26T10:23:38.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.8739999999999997e-06 2024-04-26T10:23:38.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.086138+0000", 2024-04-26T10:23:38.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.738e-06 2024-04-26T10:23:38.481 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.481 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.481 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.481 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.175939+0000", 2024-04-26T10:23:38.481 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.089801708999999993 2024-04-26T10:23:38.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176086+0000", 2024-04-26T10:23:38.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00014692399999999999 2024-04-26T10:23:38.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:38.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180471+0000", 2024-04-26T10:23:38.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0043841590000000003 2024-04-26T10:23:38.482 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.482 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.482 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.482 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180497+0000", 2024-04-26T10:23:38.482 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 2.6800000000000001e-05 2024-04-26T10:23:38.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.483 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.483 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.180545+0000", 2024-04-26T10:23:38.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4.7188999999999998e-05 2024-04-26T10:23:38.483 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.483 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.483 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.483 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.483 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.483 INFO:teuthology.orchestra.run.smithi154.stdout: "description": "osd_op(client.4722.0:124491 5.0 5:0a8f7ac8:::benchmark_data_smithi052_19421_object124490:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-26T10:23:38.483 INFO:teuthology.orchestra.run.smithi154.stdout: "initiated_at": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:38.483 INFO:teuthology.orchestra.run.smithi154.stdout: "age": 67.294346845999996, 2024-04-26T10:23:38.483 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.094782544999999996, 2024-04-26T10:23:38.483 INFO:teuthology.orchestra.run.smithi154.stdout: "type_data": { 2024-04-26T10:23:38.484 INFO:teuthology.orchestra.run.smithi154.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-26T10:23:38.484 INFO:teuthology.orchestra.run.smithi154.stdout: "client_info": { 2024-04-26T10:23:38.484 INFO:teuthology.orchestra.run.smithi154.stdout: "client": "client.4722", 2024-04-26T10:23:38.484 INFO:teuthology.orchestra.run.smithi154.stdout: "client_addr": "172.21.15.52:0/834338982", 2024-04-26T10:23:38.484 INFO:teuthology.orchestra.run.smithi154.stdout: "tid": 124491 2024-04-26T10:23:38.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.484 INFO:teuthology.orchestra.run.smithi154.stdout: "events": [ 2024-04-26T10:23:38.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "initiated", 2024-04-26T10:23:38.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:38.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.484 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.484 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "throttled", 2024-04-26T10:23:38.484 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087833+0000", 2024-04-26T10:23:38.484 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0 2024-04-26T10:23:38.484 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "header_read", 2024-04-26T10:23:38.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087832+0000", 2024-04-26T10:23:38.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 4294967295.999999 2024-04-26T10:23:38.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "all_read", 2024-04-26T10:23:38.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.087899+0000", 2024-04-26T10:23:38.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 6.7150000000000006e-05 2024-04-26T10:23:38.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.485 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "dispatched", 2024-04-26T10:23:38.485 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162557+0000", 2024-04-26T10:23:38.485 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.074658594999999994 2024-04-26T10:23:38.485 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.485 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "queued_for_pg", 2024-04-26T10:23:38.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.162587+0000", 2024-04-26T10:23:38.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0028000000000001e-05 2024-04-26T10:23:38.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "reached_pg", 2024-04-26T10:23:38.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176067+0000", 2024-04-26T10:23:38.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.013479542000000001 2024-04-26T10:23:38.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.486 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "started", 2024-04-26T10:23:38.486 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176176+0000", 2024-04-26T10:23:38.486 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00010912399999999999 2024-04-26T10:23:38.486 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.486 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "waiting for subops from 0", 2024-04-26T10:23:38.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.176275+0000", 2024-04-26T10:23:38.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 9.9214000000000002e-05 2024-04-26T10:23:38.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "sub_op_commit_rec", 2024-04-26T10:23:38.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182161+0000", 2024-04-26T10:23:38.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.0058856120000000001 2024-04-26T10:23:38.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "op_commit", 2024-04-26T10:23:38.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182512+0000", 2024-04-26T10:23:38.487 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 0.00035119799999999999 2024-04-26T10:23:38.487 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.487 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.487 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "commit_sent", 2024-04-26T10:23:38.487 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182542+0000", 2024-04-26T10:23:38.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 3.0491999999999999e-05 2024-04-26T10:23:38.488 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2024-04-26T10:23:38.488 INFO:teuthology.orchestra.run.smithi154.stdout: { 2024-04-26T10:23:38.488 INFO:teuthology.orchestra.run.smithi154.stdout: "event": "done", 2024-04-26T10:23:38.488 INFO:teuthology.orchestra.run.smithi154.stdout: "time": "2024-04-26T10:22:31.182615+0000", 2024-04-26T10:23:38.488 INFO:teuthology.orchestra.run.smithi154.stdout: "duration": 7.2563000000000003e-05 2024-04-26T10:23:38.488 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.488 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.488 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.488 INFO:teuthology.orchestra.run.smithi154.stdout: } 2024-04-26T10:23:38.488 INFO:teuthology.orchestra.run.smithi154.stdout: ] 2024-04-26T10:23:38.488 INFO:teuthology.orchestra.run.smithi154.stdout:} 2024-04-26T10:23:39.495 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-26T10:23:39.835 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~111s 2024-04-26T10:23:40.415 INFO:teuthology.orchestra.run.smithi052.stderr:noscrub is unset 2024-04-26T10:23:40.427 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-26T10:23:41.423 INFO:teuthology.orchestra.run.smithi052.stderr:nodeep-scrub is unset 2024-04-26T10:23:45.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~117s 2024-04-26T10:23:51.447 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~123s 2024-04-26T10:23:57.254 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~129s 2024-04-26T10:24:03.060 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~135s 2024-04-26T10:24:08.866 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~140s 2024-04-26T10:24:09.795 DEBUG:teuthology.orchestra.console.smithi164:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  nt XE v PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 73 F3 GUID: 00000000 0000 0000 0000 0CC47AD934F4 DHCP.|                    DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\  21.15.164 MA : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.164 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:73:f3)... Configuring (net0 0c:c4:7a:88:73:f3).... Configuring (net0 0c:c4:7a:88:73:f3)..... Configuring (net0 0c:c4:7a:88:73:f3)...... ok     * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 5s.  GNU GRUB version 2.04  ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.4.0-177-generic (buildd@lcy02-amd64-112) (gcc version 9.4.0 (Ubuntu 9.4.0-1ubuntu1~20.04.2)) #197-Ubuntu SMP Thu Mar 28 22:45:47 UTC 2024 (Ubuntu 5.4.0-177.197-generic 5.4.268) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-177-generic root=UUID=1168b92c-82ac-47e1-87d9-5d77414c7738 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.202 MHz processor [ 0.001007] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.001455] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.002003] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.007498] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.007540] check: Scanning 1 areas for low memory corruption [ 0.007544] Using GB pages for direct mapping [ 0.007701] RAMDISK: [mem 0x3157d000-0x34ab5fff] [ 0.007705] ACPI: Early table checksum verification disabled [ 0.007708] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.007711] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.007715] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007719] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.007721] ACPI: FACS 0x0000000079D43F80 000040 [ 0.007723] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007725] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007727] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007729] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.007731] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.007732] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.007734] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007736] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.007738] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.007740] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007742] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.007744] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.007746] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.007748] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007750] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007752] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007754] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007755] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007757] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.007758] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.007759] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.007760] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.007760] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.007761] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.007762] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.007762] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.007763] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.007764] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.007764] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.007765] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.007766] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.007766] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.007767] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.007768] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.007768] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.007769] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.007770] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.007770] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.007771] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.007842] No NUMA configuration found [ 0.007843] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.007851] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.008022] Zone ranges: [ 0.008022] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008024] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008024] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008025] Device empty [ 0.008026] Movable zone start for each node [ 0.008029] Early memory node ranges [ 0.008029] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.008030] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.008031] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008265] Zeroed struct page in unavailable ranges: 29105 pages [ 0.008266] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.085660] ACPI: PM-Timer IO Port: 0x408 [ 0.085669] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.085669] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.085670] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.085670] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.085671] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.085672] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.085672] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.085673] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.085682] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.085685] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.085687] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.085688] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.085691] Using ACPI (MADT) for SMP configuration information [ 0.085693] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.085696] TSC deadline timer available [ 0.085697] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.085706] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.085707] PM: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.085707] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.085708] PM: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.085709] PM: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.085710] PM: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.085710] PM: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.085711] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.085711] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.085712] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.085712] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.085714] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.085715] Booting paravirtualized kernel on bare hardware [ 0.085717] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.085721] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.085929] percpu: Embedded 60 pages/cpu s208896 r8192 d28672 u262144 [ 0.085952] Built 1 zonelists, mobility grouping on. Total pages: 8228862 [ 0.085953] Policy zone: Normal [ 0.085954] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-177-generic root=UUID=1168b92c-82ac-47e1-87d9-5d77414c7738 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.088153] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.089290] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.089371] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.168055] Memory: 32692644K/33438012K available (14339K kernel code, 2395K rwdata, 9292K rodata, 2768K init, 17228K bss, 745368K reserved, 0K cma-reserved) [ 0.168280] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.168295] Kernel/User page tables isolation: enabled [ 0.168322] ftrace: allocating 44725 entries in 175 pages [ 0.180711] ftrace: allocated 175 pages with 6 groups [ 0.180821] rcu: Hierarchical RCU implementation. [ 0.180822] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.180823] Tasks RCU enabled. [ 0.180824] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.180824] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.183036] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.183217] random: crng init done [ 0.188089] Console: colour VGA+ 80x25 [ 0.198703] printk: console [tty0] enabled [ 1.145388] printk: console [ttyS1] enabled [ 1.149643] ACPI: Core revision 20190816 [ 1.153799] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.163017] APIC: Switch to symmetric I/O mode setup [ 1.168054] DMAR: Host address width 46 [ 1.171955] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.177334] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.185424] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.191762] DMAR: ATSR flags: 0x0 [ 1.195145] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.201479] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.207900] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.214321] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.219786] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.219786] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.234915] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.240286] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.246581] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.271011] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32740fa2d06, max_idle_ns: 440795302662 ns [ 1.281613] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.40 BogoMIPS (lpj=14000808) [ 1.285647] mce: CPU0: Thermal monitoring enabled (TM1) [ 1.289651] process: using mwait in idle threads [ 1.293613] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.297612] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.301613] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.305612] Spectre V2 : Mitigation: Retpolines [ 1.309612] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.313611] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.317611] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.321612] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.325612] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.329612] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.333615] MDS: Mitigation: Clear CPU buffers [ 1.337612] TAA: Mitigation: Clear CPU buffers [ 1.341611] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.345615] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.349612] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.353611] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.357612] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.361612] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.365794] Freeing SMP alternatives memory: 40K [ 1.370945] pid_max: default: 32768 minimum: 301 [ 1.373633] LSM: Security Framework initializing [ 1.377618] Yama: becoming mindful. [ 1.381635] AppArmor: AppArmor initialized [ 1.385672] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.389651] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.393621] *** VALIDATE tmpfs *** [ 1.397709] *** VALIDATE proc *** [ 1.401652] *** VALIDATE cgroup1 *** [ 1.405612] *** VALIDATE cgroup2 *** [ 1.409805] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.413674] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.417613] ... version: 3 [ 1.421612] ... bit width: 48 [ 1.425612] ... generic registers: 4 [ 1.429612] ... value mask: 0000ffffffffffff [ 1.433612] ... max period: 00007fffffffffff [ 1.437612] ... fixed-purpose events: 3 [ 1.441612] ... event mask: 000000070000000f [ 1.445639] rcu: Hierarchical SRCU implementation. [ 1.450438] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.453673] smp: Bringing up secondary CPUs ... [ 1.457681] x86: Booting SMP configuration: [ 1.461614] .... node #0, CPUs: #1 #2 #3 #4 [ 1.469704] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.477612] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.481612] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.485708] #5 #6 #7 [ 1.486240] smp: Brought up 1 node, 8 CPUs [ 1.493614] smpboot: Max logical packages: 1 [ 1.497612] smpboot: Total of 8 processors activated (56003.23 BogoMIPS) [ 1.503778] devtmpfs: initialized [ 1.505651] x86/mm: Memory block size: 128MB [ 1.512639] PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.513685] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.517624] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.521654] pinctrl core: initialized pinctrl subsystem [ 1.525689] PM: RTC time: 10:23:49, date: 2024-04-26 [ 1.529701] NET: Registered protocol family 16 [ 1.533682] audit: initializing netlink subsys (disabled) [ 1.537618] audit: type=2000 audit(1714127027.332:1): state=initialized audit_enabled=0 res=1 [ 1.537692] EISA bus registered [ 1.544820] cpuidle: using governor ladder [ 1.545614] cpuidle: using governor menu [ 1.549624] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.553613] ACPI: bus type PCI registered [ 1.557613] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.561660] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.565614] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.569622] PCI: Using configuration type 1 for base access [ 1.575614] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.577614] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.581673] ACPI: Added _OSI(Module Device) [ 1.585614] ACPI: Added _OSI(Processor Device) [ 1.589618] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.593612] ACPI: Added _OSI(Processor Aggregator Device) [ 1.597612] ACPI: Added _OSI(Linux-Dell-Video) [ 1.601612] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.605612] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.651629] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.656960] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.661746] ACPI: Dynamic OEM Table Load: [ 1.689820] ACPI: Interpreter enabled [ 1.693553] ACPI: (supports S0 S4 S5) [ 1.693613] ACPI: Using IOAPIC for interrupt routing [ 1.697631] HEST: Enabling Firmware First mode for corrected errors. [ 1.701695] HEST: Table parsing has been initialized. [ 1.705613] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.710280] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.743710] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.749616] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 1.761624] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR] [ 1.766559] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.777612] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.785646] PCI host bridge to bus 0000:ff [ 1.789613] pci_bus 0000:ff: root bus resource [bus ff] [ 1.793620] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.801673] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.805662] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.813661] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.817662] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.825664] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.829663] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.837661] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.841664] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.849659] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.853661] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.861660] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.865660] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.873660] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.877660] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.885661] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.889662] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.897659] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.905660] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.909634] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.917665] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.921702] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.929673] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.933674] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.941675] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.945674] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.953671] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.957663] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.965664] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 1.969672] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 1.977672] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 1.981672] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 1.989674] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 1.997663] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.001662] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.009662] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.013663] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.021674] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.025673] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.033672] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.037677] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.045669] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.049663] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.057662] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.061665] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.069663] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.073662] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.081662] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.085668] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.093662] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.101661] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.105661] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.113634] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.117666] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.125661] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.133419] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.141615] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 2.157913] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR] [ 2.166028] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.173612] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.181873] PCI host bridge to bus 0000:00 [ 2.185613] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.193612] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.201612] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.205612] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.213612] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.221613] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.229612] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.233618] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.241759] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.249682] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.253713] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.261681] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.265708] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.273680] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.277707] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.285631] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.293748] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.297631] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.305747] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.309631] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.317746] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.325631] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.329746] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.337631] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.345750] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.349631] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.357746] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.361631] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.369746] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.377631] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.381747] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.389729] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.397748] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.401728] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.409626] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.413751] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.421838] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.425636] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.433623] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.437623] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.445623] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.449623] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.453624] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.461654] pci 0000:00:11.4: PME# supported from D3hot [ 2.465706] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.473639] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.481690] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.485698] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.493639] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.497691] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.505696] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.509639] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.517691] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.525708] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.529638] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.537716] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.541702] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.549704] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.553710] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.561704] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.569710] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.573704] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.581719] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.585638] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.593717] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.597703] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.605823] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.609634] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.617622] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.621622] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.629622] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.633622] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.641622] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.645648] pci 0000:00:1f.2: PME# supported from D3hot [ 2.649695] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.657637] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.665643] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.669847] acpiphp: Slot [1] registered [ 2.673628] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.677755] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.685634] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.693654] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.697615] pci 0000:02:00.0: enabling Extended Tags [ 2.705706] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.709614] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.717762] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.721636] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.729621] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.733635] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.741622] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.749655] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.757633] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.761613] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.773625] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.781612] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.789743] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.797635] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.805621] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.809635] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.817621] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.825654] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.829629] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.837612] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.849625] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.857612] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.865737] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.869614] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.877613] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.885614] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.893642] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.897669] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.901705] pci 0000:05:00.0: enabling Extended Tags [ 2.909690] pci 0000:05:00.0: supports D1 D2 [ 2.913612] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.917711] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.925614] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.929614] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.937660] pci_bus 0000:06: extended config space not accessible [ 2.945639] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.949642] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.957629] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.961629] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.969732] pci 0000:06:00.0: supports D1 D2 [ 2.973612] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.981713] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.985619] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.989615] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.997690] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 3.005648] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 3.009640] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 3.017626] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 3.021743] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 3.029665] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.037613] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.045638] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.053612] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.065691] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 3.069648] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 3.077640] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 3.081626] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 3.089741] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 3.093650] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.101612] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.113638] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.121612] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.129743] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.133614] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.149614] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.157615] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 3.162474] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 *11 12 14 15) [ 3.169657] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *10 11 12 14 15) [ 3.177656] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15) [ 3.185656] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15) [ 3.193655] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.201655] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.209655] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.217655] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.225823] iommu: Default domain type: Translated [ 3.229739] SCSI subsystem initialized [ 3.233630] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 3.237611] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 3.249613] pci 0000:06:00.0: vgaarb: bridge control possible [ 3.253612] vgaarb: loaded [ 3.256391] ACPI: bus type USB registered [ 3.261621] usbcore: registered new interface driver usbfs [ 3.265616] usbcore: registered new interface driver hub [ 3.273617] usbcore: registered new device driver usb [ 3.277632] pps_core: LinuxPPS API ver. 1 registered [ 3.281612] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 3.293613] PTP clock support registered [ 3.297618] EDAC MC: Ver: 3.0.0 [ 3.300922] PCI: Using ACPI for IRQ routing [ 3.306921] NetLabel: Initializing [ 3.313612] NetLabel: domain hash size = 128 [ 3.317612] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 3.321621] NetLabel: unlabeled traffic allowed by default [ 3.330383] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 3.333613] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 3.343644] clocksource: Switched to clocksource tsc-early [ 3.356115] *** VALIDATE bpf *** [ 3.359460] VFS: Disk quotas dquot_6.6.0 [ 3.363460] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 3.370416] *** VALIDATE ramfs *** [ 3.373882] *** VALIDATE hugetlbfs *** [ 3.377757] AppArmor: AppArmor Filesystem Enabled [ 3.382546] pnp: PnP ACPI init [ 3.386104] system 00:01: [io 0x0500-0x057f] has been reserved [ 3.392087] system 00:01: [io 0x0400-0x047f] has been reserved [ 3.398066] system 00:01: [io 0x0580-0x059f] has been reserved [ 3.404045] system 00:01: [io 0x0600-0x061f] has been reserved [ 3.410025] system 00:01: [io 0x0880-0x0883] has been reserved [ 3.416004] system 00:01: [io 0x0800-0x081f] has been reserved [ 3.421986] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 3.428670] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 3.435349] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 3.442030] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 3.448704] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 3.455385] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 3.462060] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 3.468942] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 3.474929] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 3.480914] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.486895] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.492875] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.499736] pnp: PnP ACPI: found 5 devices [ 3.504798] thermal_sys: Registered thermal governor 'fair_share' [ 3.504799] thermal_sys: Registered thermal governor 'bang_bang' [ 3.510955] thermal_sys: Registered thermal governor 'step_wise' [ 3.517028] thermal_sys: Registered thermal governor 'user_space' [ 3.523095] thermal_sys: Registered thermal governor 'power_allocator' [ 3.533732] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.549306] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.560875] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.568789] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.573832] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.578865] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.585732] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.593381] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.601385] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.609121] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.617208] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.624860] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.632860] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.640596] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.648685] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.656335] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.664336] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.672072] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.680159] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.687812] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.695811] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.703549] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.711637] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.716665] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.722824] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.729678] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.737511] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.742559] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.747586] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.753748] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.760614] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.765906] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.772066] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.778932] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.786760] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.794672] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.802497] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.810411] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.815434] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.821595] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.828449] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.836285] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.842528] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.848767] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.855701] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 3.862634] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 3.869568] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 3.876509] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.882833] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.888467] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.894794] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.902095] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.907731] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.914060] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.919692] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.926018] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.931651] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.937978] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.945403] NET: Registered protocol family 2 [ 3.949991] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.959220] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.968199] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.976608] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.984141] TCP: Hash tables configured (established 262144 bind 65536) [ 3.990889] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.997908] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 4.005361] NET: Registered protocol family 1 [ 4.009788] NET: Registered protocol family 44 [ 4.014358] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 4.042563] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x670 took 20417 usecs [ 4.074563] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x670 took 23931 usecs [ 4.082053] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 4.088572] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 4.097038] Trying to unpack rootfs image as initramfs... [ 4.204484] Freeing initrd memory: 54500K [ 4.214438] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.228720] software IO TLB: mapped [mem 0x74ec6000-0x78ec6000] (64MB) [ 4.235627] check: Scanning for low memory corruption every 60 seconds [ 4.242667] Initialise system trusted keyrings [ 4.247180] Key type blacklist registered [ 4.251272] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 4.258682] zbud: loaded [ 4.261529] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 4.267532] fuse: init (API version 7.31) [ 4.271614] *** VALIDATE fuse *** [ 4.274990] *** VALIDATE fuse *** [ 4.278441] Platform Keyring initialized [ 4.285194] Key type asymmetric registered [ 4.289351] Asymmetric key parser 'x509' registered [ 4.294297] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244) [ 4.301798] io scheduler mq-deadline registered [ 4.306759] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 4.312769] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 4.318770] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 4.324730] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 4.330689] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 4.336644] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 4.342543] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 4.349899] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 4.358356] ACPI: Power Button [PWRB] [ 4.362104] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 4.369605] ACPI: Power Button [PWRF] [ 4.374540] ERST: Error Record Serialization Table (ERST) support is initialized. [ 4.382109] pstore: Registered erst as persistent store backend [ 4.388267] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 4.395851] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 4.422767] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 4.450710] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 4.459143] Linux agpgart interface v0.103 [ 4.590474] loop: module loaded [ 4.593863] tun: Universal TUN/TAP device driver, 1.6 [ 4.599032] PPP generic driver version 2.4.2 [ 4.603432] VFIO - User Level meta-driver version: 0.3 [ 4.608725] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 4.615319] ehci-pci: EHCI PCI platform driver [ 4.619967] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 4.625262] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 4.632748] ehci-pci 0000:00:1a.0: debug port 2 [ 4.641245] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported [ 4.648101] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 4.666465] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 4.672312] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.680659] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.687961] usb usb1: Product: EHCI Host Controller [ 4.692902] usb usb1: Manufacturer: Linux 5.4.0-177-generic ehci_hcd [ 4.699319] usb usb1: SerialNumber: 0000:00:1a.0 [ 4.704098] hub 1-0:1.0: USB hub found [ 4.707915] hub 1-0:1.0: 2 ports detected [ 4.712192] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 4.717483] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 4.724962] ehci-pci 0000:00:1d.0: debug port 2 [ 4.733466] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported [ 4.740323] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.758464] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.764306] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.772659] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.779961] usb usb2: Product: EHCI Host Controller [ 4.784903] usb usb2: Manufacturer: Linux 5.4.0-177-generic ehci_hcd [ 4.791321] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.796095] hub 2-0:1.0: USB hub found [ 4.799916] hub 2-0:1.0: 2 ports detected [ 4.804115] ehci-platform: EHCI generic platform driver [ 4.809414] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.815661] ohci-pci: OHCI PCI platform driver [ 4.820178] ohci-platform: OHCI generic platform driver [ 4.825468] uhci_hcd: USB Universal Host Controller Interface driver [ 4.832023] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.837317] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.845841] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.855066] xhci_hcd 0000:00:14.0: cache line size of 64 is not supported [ 4.862062] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.867349] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.874824] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.881174] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.889524] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.896826] usb usb3: Product: xHCI Host Controller [ 4.901769] usb usb3: Manufacturer: Linux 5.4.0-177-generic xhci-hcd [ 4.908186] usb usb3: SerialNumber: 0000:00:14.0 [ 4.912958] hub 3-0:1.0: USB hub found [ 4.916786] hub 3-0:1.0: 15 ports detected [ 4.922672] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.04 [ 4.931019] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.938321] usb usb4: Product: xHCI Host Controller [ 4.943263] usb usb4: Manufacturer: Linux 5.4.0-177-generic xhci-hcd [ 4.949680] usb usb4: SerialNumber: 0000:00:14.0 [ 4.954439] hub 4-0:1.0: USB hub found [ 4.958268] hub 4-0:1.0: 6 ports detected [ 4.963264] i8042: PNP: No PS/2 controller found. [ 4.968097] mousedev: PS/2 mouse device common for all mice [ 4.970433] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.973841] rtc_cmos 00:00: RTC can wake from S4 [ 4.985184] rtc_cmos 00:00: registered as rtc0 [ 4.989700] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 4.997439] i2c /dev entries driver [ 5.001014] device-mapper: uevent: version 1.0.3 [ 5.005760] device-mapper: ioctl: 4.41.0-ioctl (2019-09-16) initialised: dm-devel@redhat.com [ 5.014299] platform eisa.0: Probing EISA bus 0 [ 5.018896] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 5.025746] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 5.032253] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 5.038760] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 5.045260] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 5.051759] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 5.058260] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 5.058431] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 5.064760] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 5.064760] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 5.064761] platform eisa.0: EISA: Detected 0 cards [ 5.064767] intel_pstate: Intel P-state driver initializing [ 5.095700] ledtrig-cpu: registered to indicate activity on CPUs [ 5.101864] drop_monitor: Initializing network drop monitor service [ 5.108299] NET: Registered protocol family 10 [ 5.116838] Segment Routing with IPv6 [ 5.120579] NET: Registered protocol family 17 [ 5.125141] Key type dns_resolver registered [ 5.129865] RAS: Correctable Errors collector initialized. [ 5.134838] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 5.135454] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 5.143674] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.156843] microcode: Microcode Update Driver: v2.2. [ 5.156978] *** VALIDATE rdt *** [ 5.157100] hub 1-1:1.0: USB hub found [ 5.162094] resctrl: L3 allocation detected [ 5.169488] hub 1-1:1.0: 6 ports detected [ 5.173473] resctrl: L3DATA allocation detected [ 5.173474] resctrl: L3CODE allocation detected [ 5.173474] resctrl: L3 monitoring detected [ 5.173477] IPI shorthand broadcast: enabled [ 5.182409] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.186814] sched_clock: Marking stable (4164384860, 1022400076)->(5516740410, -329955474) [ 5.210492] registered taskstats version 1 [ 5.214663] Loading compiled-in X.509 certificates [ 5.220084] Loaded X.509 cert 'Build time autogenerated kernel key: 1224c9b81ccdd6d5fadad4fbd6b8ad2b6b069117' [ 5.230529] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 5.240761] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 5.242831] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 5.250845] blacklist: Loading compiled-in revocation X.509 certificates [ 5.259127] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.265938] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 5.273341] hub 2-1:1.0: USB hub found [ 5.283084] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 5.283099] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 5.283114] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 5.283129] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 5.283144] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 5.283160] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 5.283175] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 5.283190] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 5.283237] zswap: loaded using pool lzo/zbud [ 5.286952] hub 2-1:1.0: 8 ports detected [ 5.293156] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 5.293230] Key type ._fscrypt registered [ 5.293230] Key type .fscrypt registered [ 5.293300] pstore: Using crash dump compression: deflate [ 5.298274] Key type big_key registered [ 5.300894] Key type encrypted registered [ 5.300897] AppArmor: AppArmor sha1 policy hashing enabled [ 5.300906] ima: No TPM chip found, activating TPM-bypass! [ 5.300910] ima: Allocated hash algorithm: sha1 [ 5.300914] ima: No architecture policies found [ 5.300920] evm: Initialising EVM extended attributes: [ 5.300920] evm: security.selinux [ 5.300921] evm: security.SMACK64 [ 5.300921] evm: security.SMACK64EXEC [ 5.300921] evm: security.SMACK64TRANSMUTE [ 5.300921] evm: security.SMACK64MMAP [ 5.300922] evm: security.apparmor [ 5.300922] evm: security.ima [ 5.300922] evm: security.capability [ 5.300923] evm: HMAC attrs: 0x1 [ 5.301282] PM: Magic number: 4:823:376 [ 5.301386] acpi LNXCPU:ad: hash matches [ 5.303687] rtc_cmos 00:00: setting system clock to 2024-04-26T10:23:53 UTC (1714127033) [ 5.350637] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.498798] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.506106] clocksource: Switched to clocksource tsc [ 5.506356] hub 3-12:1.0: USB hub found [ 5.515136] hub 3-12:1.0: 4 ports detected [ 5.520004] Freeing unused decrypted memory: 2040K [ 5.525269] Freeing unused kernel image memory: 2768K [ 5.550457] Write protecting the kernel read-only data: 26624k [ 5.556738] Freeing unused kernel image memory: 2036K [ 5.562025] Freeing unused kernel image memory: 948K [ 5.573517] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.580019] x86/mm: Checking user space page tables [ 5.591271] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.597777] Run /init as init process Loading, please wait... Starting version 245.4-4ubuntu3.17 [ 5.715215] dca service started, version 1.12.1 [ 5.721443] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 46] ahci 0000:00orts 6 Gbps 0xf impl SATA mode [ 5.737435] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.745220] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k [ 5.752976] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.762959] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.6.0-k [ 5.769989] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.787362] nvme nvme0: pci function 0000:02:00.0 [ 5.792629] scsi host0: ahci [ 5.795766] scsi host1: ahci [ 5.798911] scsi host2: ahci [ 5.801946] scsi host3: ahci [ 5.804915] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 34 [ 5.812398] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 34 [ 5.819877] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 34 [ 5.826453] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.827358] aabar m2048@0xfb4[ 5.841810] a0 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.850076] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.897563] igb 0000:07:00.0: added PHC on eth0 [ 5.899151] nvme nvme0: 8/0/0 default/read/poll queues [ 5.902189] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.914301] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:34:f4 [ 5.921582] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.926789] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.958750] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.958769] scsi host4: ahci [ 5.967279] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.970370] scsi host5: ahci [ 5.981580] scsi host6: ahci [ 5.984645] scsi host7: ahci [ 5.984646] hidraw: raw HID events driver (C) Jiri Kosina [ 5.987650] scsi host8: ahci [ 5.998410] scsi host9: ahci [ 6.001739] igb 0000:07:00.1: added PHC on eth1 [ 6.006354] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.013292] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:34:f5 [ 6.020576] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.025777] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.033825] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 45 [ 6.041308] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 45 [ 6.048785] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 45 [ 6.056265] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 45 [ 6.063744] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 45 [ 6.071223] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 45 [ 6.157308] ata3: SATA link down (SStatus 0 SControl 300) [ 6.162792] ata1: SATA link down (SStatus 0 SControl 300) [ 6.168268] ata2: SATA link down (SStatus 0 SControl 300) [ 6.173744] ata4: SATA link down (SStatus 0 SControl 300) [ 6.393817] ata8: SATA link down (SStatus 0 SControl 300) [ 6.399302] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.405557] ata10: SATA link down (SStatus 0 SControl 300) [ 6.411119] ata7: SATA link down (SStatus 0 SControl 300) [ 6.416596] ata9: SATA link down (SStatus 0 SControl 300) [ 6.422072] ata6: SATA link down (SStatus 0 SControl 300) [ 6.428261] ata5.00: NCQ Send/Recv Log not supported [ 6.433294] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.439620] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.448132] ata5.00: NCQ Send/Recv Log not supported [ 6.453169] ata5.00: configured for UDMA/133 [ 6.457608] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.465885] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.465966] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.479024] sd 4:0:0:0: [sda] Write Protect is off [ 6.483888] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.523772] sda: sda1 [ 6.538502] sd 4:0:0:0: [sda] Attached SCSI disk [ 6.544673] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.550975] usbcore: registered new interface driver usbhid [ 6.556616] usbhid: USB HID core driver [ 6.562523] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.574638] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.634603] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.646522] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.658327] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.982624] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.992990] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.001586] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.007828] ixgbe 0000:03:00.0: 0c:c4:7a:88:73:f2 [ 7.015514] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.182485] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.192855] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.201452] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.208561] ixgbe 0000:03:00.1: 0c:c4:7a:88:73:f3 [ 7.216214] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.223571] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.250509] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.34 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: clean, 303194/61054976 files, 7960146/244190336 blocks done. [ 7.427454] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 8.175622] systemd[1]: Inserted module 'autofs4' [ 8.236361] systemd[1]: systemd 245.4-4ubuntu3.17 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid) [ 8.278620] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 20.04.4 LTS! [ 8.331109] systemd[1]: Set hostname to . [ 9.440680] systemd[1]: Created slice system-modprobe.slice. [ OK ] Created slice system-modprobe.slice. [ 9.462769] systemd[1]: Created slice system-serial\x2dgetty.slice. [ OK ] Created slice system-serial\x2dgetty.slice. [ 9.494764] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 9.514532] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 9.538944] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 9.566577] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 9.594543] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 9.622550] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 9.650545] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 9.678512] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 9.706543] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 9.734590] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 9.758576] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 9.778576] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 9.802568] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 9.825598] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 9.850790] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 9.870582] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 9.894559] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 9.918753] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 9.938572] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 9.958723] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 9.978695] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 9.998643] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 10.019411] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 10.039301] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 10.063378] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 10.087314] systemd[1]: Mounting RPC Pipe File System... Mounting RPC Pipe File System... [ 10.107612] systemd[1]: Mounting Kernel Debug File System... Mounting Kerne[ 10.114754] RPC: Registered named UNIX socket transport module. l Debug File Sys[ 10.122224] RPC: Registered udp transport module. tem... [ 10.128343] RPC: Registered tcp transport module. [ 10.134102] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 10.141600] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 10.163556] systemd[1]: Starting Journal Service... Starting Journal Service... [ 10.182528] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 10.192321] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 10.193525] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 10.223678] systemd[1]: Starting Create list of static device nodes for the current kernel... Starting Create list of st…odes for the current kernel... [ 10.251400] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 10.279123] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 10.298502] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 10.309161] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped. [ 10.318318] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 10.328579] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 10.347274] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 10.362040] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr [ 10.371163] systemd[1]: Starting udev Coldplug all Devices... Starting udev Coldplug all Devices... [ 10.381096] lp: driver loaded but no devices found [ 10.387923] systemd[1]: Starting Uncomplicated firewall... Starting Uncomplicated firewall... [ 10.407928] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ 10.416851] Loading iSCSI transport class v2.0-870. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted RPC Pipe File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create list of st… nodes for the current kernel. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Finished Uncomplicated firewall. Activating swap /swapfile... Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting pNFS block layout mapping daemon... Starting Flush Journal to Pers[ 10.714426] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS istent Storage[[ 10.724031] systemd-journald[365]: Received client request to flush runtime journal. 0m... Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished udev Coldplug all Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Reached target Swap. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Preprocess NFS configuration... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting udev Kernel Device Manager... [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Preprocess NFS configuration. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. Starting NFSv4 ID-name mapping service... [ OK ] Reached target NFS client services. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Finished Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... [ OK ] Started udev Kernel Device Manager. [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. Starting Network Service... [ OK ] Finished Load AppArmor profiles. [ OK ] Finished Create Volatile Files and Directories. Starting RPC bind portmap service... Starting Update UTMP about System Boot/Shutdown... [ OK ] Finished Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API. [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. [ OK ] Started Network Service. [ OK ] Listening on Docker Socket for the API. [ OK ] Started RPC bind portmap service. [ OK ] Found device /dev/ttyS1. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice system-lvm2\x2dpvscan.slice. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting LVM event activation on device 259:0... Starting Dispatcher daemon for systemd-networkd... [ OK ] Started Set the CPU Frequency Scaling governor. Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting Resets System Activity Data Collector... Starting Login Service... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Found device 82599ES 10-Gi…ion (AOC-STGN-I2S [REV 1.01]). [ OK ] Started ifup for enp3s0f1. [ OK ] Finished Resets System Activity Data Collector. [ OK ] Started Login Service. [ OK ] Started System Logging Service. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Finished Helper to synchronize boot up for ifupdown. Starting Raise network interfaces... [ OK ] Finished GRUB failed boot detection. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [ OK ] Finished Wait for Network to be Configured. [* ] A start job is running for Raise network interfaces (9s / 5min 5s) M  Stopping Network Name Resolution... [ OK ] Stopped Network Name Resolution. Starting Network Name Resolution... [ OK ] Started Network Name Resolution. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips=172.21.15.164 + attempts=1 + sleep 1 Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Started Network Time Service. [ OK ] Finished Map RBD devices. + '[' 172.21.15.164 '!=' '' ']' + set -e + '[' -n 172.21.15.164 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.164 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.164 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi164.front.sepia.ceph.com + '[' -n smithi164.front.sepia.ceph.com ']' + hostname smithi164.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi164 + echo smithi164 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.164 smithi164.front.sepia.ceph.com smithi164/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished NFS server and services. [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice system-getty.slice. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... Ubuntu 20.04.4 LTS smithi164.front.sepia.ceph.com ttyS1 2024-04-26T10:24:09.796 DEBUG:teuthology.orchestra.console.smithi164:expect after: smithi164 login: 2024-04-26T10:24:09.850 DEBUG:teuthology.orchestra.console.smithi164:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  nt XE v PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.72 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 73 F3 GUID: 00000000 0000 0000 0000 0CC47AD934F4 DHCP.|                    DHCP.- DHCP.\ DHCP.| DHCP./ DHCP.- DHCP.\  21.15.164 MA : 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 95D3:0070, entry point at 95D3:0106  UNDI code segment 95D3:3E70, data segment 8E94:73F0 (570-615kB)  UNDI device is PCI 03:00.1, type DIX+802.3  570kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.164 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:73:f3)... Configuring (net0 0c:c4:7a:88:73:f3).... Configuring (net0 0c:c4:7a:88:73:f3)..... Configuring (net0 0c:c4:7a:88:73:f3)...... ok     * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 5s.  GNU GRUB version 2.04  ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.4.0-177-generic (buildd@lcy02-amd64-112) (gcc version 9.4.0 (Ubuntu 9.4.0-1ubuntu1~20.04.2)) #197-Ubuntu SMP Thu Mar 28 22:45:47 UTC 2024 (Ubuntu 5.4.0-177.197-generic 5.4.268) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-177-generic root=UUID=1168b92c-82ac-47e1-87d9-5d77414c7738 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008abff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec5fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f78000-0x00000000798a7fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798a8000-0x0000000079d44fff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d45000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0a 08/02/2016 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.202 MHz processor [ 0.001007] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.001455] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.002003] last_pfn = 0x78ec6 max_arch_pfn = 0x400000000 [ 0.007498] found SMP MP-table at [mem 0x000fcd40-0x000fcd4f] [ 0.007540] check: Scanning 1 areas for low memory corruption [ 0.007544] Using GB pages for direct mapping [ 0.007701] RAMDISK: [mem 0x3157d000-0x34ab5fff] [ 0.007705] ACPI: Early table checksum verification disabled [ 0.007708] ACPI: RSDP 0x00000000000F05B0 000024 (v02 SUPERM) [ 0.007711] ACPI: XSDT 0x00000000798A80A0 0000BC (v01 01072009 AMI 00010013) [ 0.007715] ACPI: FACP 0x00000000798DB838 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007719] ACPI: DSDT 0x00000000798A81F0 033641 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.007721] ACPI: FACS 0x0000000079D43F80 000040 [ 0.007723] ACPI: APIC 0x00000000798DB948 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007725] ACPI: FPDT 0x00000000798DBA10 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007727] ACPI: FIDT 0x00000000798DBA58 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007729] ACPI: SPMI 0x00000000798DBAF8 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.007731] ACPI: MCFG 0x00000000798DBB38 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.007732] ACPI: UEFI 0x00000000798DBB78 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.007734] ACPI: HPET 0x00000000798DBBC0 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007736] ACPI: WDDT 0x00000000798DBBF8 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.007738] ACPI: SSDT 0x00000000798DBC38 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.007740] ACPI: NITR 0x00000000798F2DB8 000071 (v02 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007742] ACPI: SSDT 0x00000000798F2E30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.007744] ACPI: SSDT 0x00000000798F5480 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.007746] ACPI: PRAD 0x00000000798F54E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.007748] ACPI: DMAR 0x00000000798F55F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007750] ACPI: HEST 0x00000000798F56B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007752] ACPI: BERT 0x00000000798F5930 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007754] ACPI: ERST 0x00000000798F5960 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007755] ACPI: EINJ 0x00000000798F5B90 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007757] ACPI: Reserving FACP table memory at [mem 0x798db838-0x798db943] [ 0.007758] ACPI: Reserving DSDT table memory at [mem 0x798a81f0-0x798db830] [ 0.007759] ACPI: Reserving FACS table memory at [mem 0x79d43f80-0x79d43fbf] [ 0.007760] ACPI: Reserving APIC table memory at [mem 0x798db948-0x798dba0f] [ 0.007760] ACPI: Reserving FPDT table memory at [mem 0x798dba10-0x798dba53] [ 0.007761] ACPI: Reserving FIDT table memory at [mem 0x798dba58-0x798dbaf3] [ 0.007762] ACPI: Reserving SPMI table memory at [mem 0x798dbaf8-0x798dbb37] [ 0.007762] ACPI: Reserving MCFG table memory at [mem 0x798dbb38-0x798dbb73] [ 0.007763] ACPI: Reserving UEFI table memory at [mem 0x798dbb78-0x798dbbb9] [ 0.007764] ACPI: Reserving HPET table memory at [mem 0x798dbbc0-0x798dbbf7] [ 0.007764] ACPI: Reserving WDDT table memory at [mem 0x798dbbf8-0x798dbc37] [ 0.007765] ACPI: Reserving SSDT table memory at [mem 0x798dbc38-0x798f2db6] [ 0.007766] ACPI: Reserving NITR table memory at [mem 0x798f2db8-0x798f2e28] [ 0.007766] ACPI: Reserving SSDT table memory at [mem 0x798f2e30-0x798f547b] [ 0.007767] ACPI: Reserving SSDT table memory at [mem 0x798f5480-0x798f54e3] [ 0.007768] ACPI: Reserving PRAD table memory at [mem 0x798f54e8-0x798f55e9] [ 0.007768] ACPI: Reserving DMAR table memory at [mem 0x798f55f0-0x798f56ab] [ 0.007769] ACPI: Reserving HEST table memory at [mem 0x798f56b0-0x798f592b] [ 0.007770] ACPI: Reserving BERT table memory at [mem 0x798f5930-0x798f595f] [ 0.007770] ACPI: Reserving ERST table memory at [mem 0x798f5960-0x798f5b8f] [ 0.007771] ACPI: Reserving EINJ table memory at [mem 0x798f5b90-0x798f5cbf] [ 0.007842] No NUMA configuration found [ 0.007843] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.007851] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.008022] Zone ranges: [ 0.008022] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008024] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008024] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008025] Device empty [ 0.008026] Movable zone start for each node [ 0.008029] Early memory node ranges [ 0.008029] node 0: [mem 0x0000000000001000-0x0000000000089fff] [ 0.008030] node 0: [mem 0x0000000000100000-0x0000000078ec5fff] [ 0.008031] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008265] Zeroed struct page in unavailable ranges: 29105 pages [ 0.008266] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.085660] ACPI: PM-Timer IO Port: 0x408 [ 0.085669] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.085669] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.085670] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.085670] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.085671] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.085672] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.085672] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.085673] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.085682] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.085685] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.085687] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.085688] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.085691] Using ACPI (MADT) for SMP configuration information [ 0.085693] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.085696] TSC deadline timer available [ 0.085697] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.085706] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.085707] PM: Registered nosave memory: [mem 0x0008a000-0x000dffff] [ 0.085707] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.085708] PM: Registered nosave memory: [mem 0x78ec6000-0x78f77fff] [ 0.085709] PM: Registered nosave memory: [mem 0x78f78000-0x798a7fff] [ 0.085710] PM: Registered nosave memory: [mem 0x798a8000-0x79d44fff] [ 0.085710] PM: Registered nosave memory: [mem 0x79d45000-0x8fffffff] [ 0.085711] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.085711] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.085712] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.085712] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.085714] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.085715] Booting paravirtualized kernel on bare hardware [ 0.085717] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.085721] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.085929] percpu: Embedded 60 pages/cpu s208896 r8192 d28672 u262144 [ 0.085952] Built 1 zonelists, mobility grouping on. Total pages: 8228862 [ 0.085953] Policy zone: Normal [ 0.085954] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-177-generic root=UUID=1168b92c-82ac-47e1-87d9-5d77414c7738 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.088153] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.089290] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.089371] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.168055] Memory: 32692644K/33438012K available (14339K kernel code, 2395K rwdata, 9292K rodata, 2768K init, 17228K bss, 745368K reserved, 0K cma-reserved) [ 0.168280] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.168295] Kernel/User page tables isolation: enabled [ 0.168322] ftrace: allocating 44725 entries in 175 pages [ 0.180711] ftrace: allocated 175 pages with 6 groups [ 0.180821] rcu: Hierarchical RCU implementation. [ 0.180822] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.180823] Tasks RCU enabled. [ 0.180824] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.180824] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.183036] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.183217] random: crng init done [ 0.188089] Console: colour VGA+ 80x25 [ 0.198703] printk: console [tty0] enabled [ 1.145388] printk: console [ttyS1] enabled [ 1.149643] ACPI: Core revision 20190816 [ 1.153799] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.163017] APIC: Switch to symmetric I/O mode setup [ 1.168054] DMAR: Host address width 46 [ 1.171955] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.177334] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.185424] DMAR: RMRR base: 0x0000007ba6e000 end: 0x0000007ba7dfff [ 1.191762] DMAR: ATSR flags: 0x0 [ 1.195145] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.201479] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.207900] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.214321] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.219786] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.219786] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.234915] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.240286] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.246581] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.271011] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32740fa2d06, max_idle_ns: 440795302662 ns [ 1.281613] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.40 BogoMIPS (lpj=14000808) [ 1.285647] mce: CPU0: Thermal monitoring enabled (TM1) [ 1.289651] process: using mwait in idle threads [ 1.293613] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.297612] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.301613] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.305612] Spectre V2 : Mitigation: Retpolines [ 1.309612] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.313611] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.317611] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.321612] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.325612] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.329612] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.333615] MDS: Mitigation: Clear CPU buffers [ 1.337612] TAA: Mitigation: Clear CPU buffers [ 1.341611] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.345615] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.349612] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.353611] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.357612] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.361612] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.365794] Freeing SMP alternatives memory: 40K [ 1.370945] pid_max: default: 32768 minimum: 301 [ 1.373633] LSM: Security Framework initializing [ 1.377618] Yama: becoming mindful. [ 1.381635] AppArmor: AppArmor initialized [ 1.385672] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.389651] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.393621] *** VALIDATE tmpfs *** [ 1.397709] *** VALIDATE proc *** [ 1.401652] *** VALIDATE cgroup1 *** [ 1.405612] *** VALIDATE cgroup2 *** [ 1.409805] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.413674] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.417613] ... version: 3 [ 1.421612] ... bit width: 48 [ 1.425612] ... generic registers: 4 [ 1.429612] ... value mask: 0000ffffffffffff [ 1.433612] ... max period: 00007fffffffffff [ 1.437612] ... fixed-purpose events: 3 [ 1.441612] ... event mask: 000000070000000f [ 1.445639] rcu: Hierarchical SRCU implementation. [ 1.450438] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.453673] smp: Bringing up secondary CPUs ... [ 1.457681] x86: Booting SMP configuration: [ 1.461614] .... node #0, CPUs: #1 #2 #3 #4 [ 1.469704] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.477612] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.481612] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.485708] #5 #6 #7 [ 1.486240] smp: Brought up 1 node, 8 CPUs [ 1.493614] smpboot: Max logical packages: 1 [ 1.497612] smpboot: Total of 8 processors activated (56003.23 BogoMIPS) [ 1.503778] devtmpfs: initialized [ 1.505651] x86/mm: Memory block size: 128MB [ 1.512639] PM: Registering ACPI NVS region [mem 0x798a8000-0x79d44fff] (4837376 bytes) [ 1.513685] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.517624] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.521654] pinctrl core: initialized pinctrl subsystem [ 1.525689] PM: RTC time: 10:23:49, date: 2024-04-26 [ 1.529701] NET: Registered protocol family 16 [ 1.533682] audit: initializing netlink subsys (disabled) [ 1.537618] audit: type=2000 audit(1714127027.332:1): state=initialized audit_enabled=0 res=1 [ 1.537692] EISA bus registered [ 1.544820] cpuidle: using governor ladder [ 1.545614] cpuidle: using governor menu [ 1.549624] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.553613] ACPI: bus type PCI registered [ 1.557613] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.561660] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.565614] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.569622] PCI: Using configuration type 1 for base access [ 1.575614] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.577614] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.581673] ACPI: Added _OSI(Module Device) [ 1.585614] ACPI: Added _OSI(Processor Device) [ 1.589618] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.593612] ACPI: Added _OSI(Processor Aggregator Device) [ 1.597612] ACPI: Added _OSI(Linux-Dell-Video) [ 1.601612] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.605612] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.651629] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.656960] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.661746] ACPI: Dynamic OEM Table Load: [ 1.689820] ACPI: Interpreter enabled [ 1.693553] ACPI: (supports S0 S4 S5) [ 1.693613] ACPI: Using IOAPIC for interrupt routing [ 1.697631] HEST: Enabling Firmware First mode for corrected errors. [ 1.701695] HEST: Table parsing has been initialized. [ 1.705613] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.710280] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.743710] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.749616] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 1.761624] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR] [ 1.766559] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.777612] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.785646] PCI host bridge to bus 0000:ff [ 1.789613] pci_bus 0000:ff: root bus resource [bus ff] [ 1.793620] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.801673] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.805662] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.813661] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.817662] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.825664] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.829663] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.837661] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.841664] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.849659] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.853661] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.861660] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.865660] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.873660] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.877660] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.885661] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.889662] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.897659] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.905660] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.909634] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.917665] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.921702] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.929673] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.933674] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.941675] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.945674] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.953671] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.957663] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.965664] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 1.969672] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 1.977672] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 1.981672] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 1.989674] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 1.997663] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 2.001662] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 2.009662] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 2.013663] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.021674] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.025673] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.033672] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.037677] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.045669] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.049663] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.057662] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.061665] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.069663] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.073662] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.081662] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.085668] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.093662] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.101661] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.105661] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.113634] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.117666] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.125661] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.133419] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.141615] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 2.157913] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR] [ 2.166028] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.173612] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.181873] PCI host bridge to bus 0000:00 [ 2.185613] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.193612] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.201612] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.205612] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.213612] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.221613] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.229612] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.233618] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.241759] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.249682] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.253713] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.261681] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.265708] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.273680] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.277707] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.285631] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.293748] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.297631] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.305747] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.309631] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.317746] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.325631] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.329746] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.337631] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.345750] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.349631] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.357746] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.361631] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.369746] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.377631] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.381747] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.389729] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.397748] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.401728] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.409626] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.413751] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.421838] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.425636] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.433623] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.437623] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.445623] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.449623] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.453624] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.461654] pci 0000:00:11.4: PME# supported from D3hot [ 2.465706] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.473639] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.481690] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.485698] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.493639] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.497691] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.505696] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.509639] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.517691] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.525708] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.529638] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.537716] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.541702] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.549704] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.553710] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.561704] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.569710] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.573704] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.581719] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.585638] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.593717] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.597703] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.605823] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.609634] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.617622] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.621622] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.629622] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.633622] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.641622] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.645648] pci 0000:00:1f.2: PME# supported from D3hot [ 2.649695] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.657637] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.665643] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.669847] acpiphp: Slot [1] registered [ 2.673628] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.677755] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.685634] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.693654] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.697615] pci 0000:02:00.0: enabling Extended Tags [ 2.705706] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.709614] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.717762] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.721636] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.729621] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.733635] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.741622] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.749655] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.757633] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.761613] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.773625] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.781612] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.789743] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.797635] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.805621] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.809635] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.817621] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.825654] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.829629] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.837612] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.849625] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.857612] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.865737] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.869614] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.877613] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.885614] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.893642] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.897669] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.901705] pci 0000:05:00.0: enabling Extended Tags [ 2.909690] pci 0000:05:00.0: supports D1 D2 [ 2.913612] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.917711] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.925614] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.929614] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.937660] pci_bus 0000:06: extended config space not accessible [ 2.945639] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.949642] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.957629] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.961629] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.969732] pci 0000:06:00.0: supports D1 D2 [ 2.973612] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.981713] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.985619] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.989615] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.997690] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 3.005648] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 3.009640] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 3.017626] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 3.021743] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 3.029665] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.037613] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.045638] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.053612] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.065691] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 3.069648] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 3.077640] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 3.081626] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 3.089741] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 3.093650] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.101612] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.113638] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.121612] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.129743] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.133614] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.149614] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.157615] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 3.162474] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 *11 12 14 15) [ 3.169657] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *10 11 12 14 15) [ 3.177656] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15) [ 3.185656] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15) [ 3.193655] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.201655] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.209655] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.217655] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.225823] iommu: Default domain type: Translated [ 3.229739] SCSI subsystem initialized [ 3.233630] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 3.237611] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 3.249613] pci 0000:06:00.0: vgaarb: bridge control possible [ 3.253612] vgaarb: loaded [ 3.256391] ACPI: bus type USB registered [ 3.261621] usbcore: registered new interface driver usbfs [ 3.265616] usbcore: registered new interface driver hub [ 3.273617] usbcore: registered new device driver usb [ 3.277632] pps_core: LinuxPPS API ver. 1 registered [ 3.281612] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 3.293613] PTP clock support registered [ 3.297618] EDAC MC: Ver: 3.0.0 [ 3.300922] PCI: Using ACPI for IRQ routing [ 3.306921] NetLabel: Initializing [ 3.313612] NetLabel: domain hash size = 128 [ 3.317612] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 3.321621] NetLabel: unlabeled traffic allowed by default [ 3.330383] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 3.333613] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 3.343644] clocksource: Switched to clocksource tsc-early [ 3.356115] *** VALIDATE bpf *** [ 3.359460] VFS: Disk quotas dquot_6.6.0 [ 3.363460] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 3.370416] *** VALIDATE ramfs *** [ 3.373882] *** VALIDATE hugetlbfs *** [ 3.377757] AppArmor: AppArmor Filesystem Enabled [ 3.382546] pnp: PnP ACPI init [ 3.386104] system 00:01: [io 0x0500-0x057f] has been reserved [ 3.392087] system 00:01: [io 0x0400-0x047f] has been reserved [ 3.398066] system 00:01: [io 0x0580-0x059f] has been reserved [ 3.404045] system 00:01: [io 0x0600-0x061f] has been reserved [ 3.410025] system 00:01: [io 0x0880-0x0883] has been reserved [ 3.416004] system 00:01: [io 0x0800-0x081f] has been reserved [ 3.421986] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 3.428670] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 3.435349] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 3.442030] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 3.448704] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 3.455385] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 3.462060] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 3.468942] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 3.474929] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 3.480914] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.486895] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.492875] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.499736] pnp: PnP ACPI: found 5 devices [ 3.504798] thermal_sys: Registered thermal governor 'fair_share' [ 3.504799] thermal_sys: Registered thermal governor 'bang_bang' [ 3.510955] thermal_sys: Registered thermal governor 'step_wise' [ 3.517028] thermal_sys: Registered thermal governor 'user_space' [ 3.523095] thermal_sys: Registered thermal governor 'power_allocator' [ 3.533732] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.549306] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.560875] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.568789] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.573832] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.578865] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.585732] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.593381] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.601385] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.609121] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.617208] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.624860] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.632860] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.640596] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.648685] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.656335] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.664336] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.672072] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.680159] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.687812] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.695811] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.703549] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.711637] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.716665] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.722824] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.729678] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.737511] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.742559] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.747586] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.753748] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.760614] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.765906] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.772066] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.778932] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.786760] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.794672] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.802497] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.810411] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.815434] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.821595] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.828449] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.836285] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.842528] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.848767] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.855701] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 3.862634] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 3.869568] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 3.876509] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.882833] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.888467] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.894794] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.902095] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.907731] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.914060] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.919692] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.926018] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.931651] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.937978] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.945403] NET: Registered protocol family 2 [ 3.949991] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.959220] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.968199] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.976608] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.984141] TCP: Hash tables configured (established 262144 bind 65536) [ 3.990889] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.997908] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 4.005361] NET: Registered protocol family 1 [ 4.009788] NET: Registered protocol family 44 [ 4.014358] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 4.042563] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x670 took 20417 usecs [ 4.074563] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x670 took 23931 usecs [ 4.082053] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 4.088572] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 4.097038] Trying to unpack rootfs image as initramfs... [ 4.204484] Freeing initrd memory: 54500K [ 4.214438] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.228720] software IO TLB: mapped [mem 0x74ec6000-0x78ec6000] (64MB) [ 4.235627] check: Scanning for low memory corruption every 60 seconds [ 4.242667] Initialise system trusted keyrings [ 4.247180] Key type blacklist registered [ 4.251272] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 4.258682] zbud: loaded [ 4.261529] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 4.267532] fuse: init (API version 7.31) [ 4.271614] *** VALIDATE fuse *** [ 4.274990] *** VALIDATE fuse *** [ 4.278441] Platform Keyring initialized [ 4.285194] Key type asymmetric registered [ 4.289351] Asymmetric key parser 'x509' registered [ 4.294297] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244) [ 4.301798] io scheduler mq-deadline registered [ 4.306759] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 4.312769] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 4.318770] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 4.324730] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 4.330689] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 4.336644] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 4.342543] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 4.349899] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 4.358356] ACPI: Power Button [PWRB] [ 4.362104] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 4.369605] ACPI: Power Button [PWRF] [ 4.374540] ERST: Error Record Serialization Table (ERST) support is initialized. [ 4.382109] pstore: Registered erst as persistent store backend [ 4.388267] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 4.395851] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 4.422767] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 4.450710] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 4.459143] Linux agpgart interface v0.103 [ 4.590474] loop: module loaded [ 4.593863] tun: Universal TUN/TAP device driver, 1.6 [ 4.599032] PPP generic driver version 2.4.2 [ 4.603432] VFIO - User Level meta-driver version: 0.3 [ 4.608725] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 4.615319] ehci-pci: EHCI PCI platform driver [ 4.619967] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 4.625262] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 4.632748] ehci-pci 0000:00:1a.0: debug port 2 [ 4.641245] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported [ 4.648101] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 4.666465] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 4.672312] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.680659] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.687961] usb usb1: Product: EHCI Host Controller [ 4.692902] usb usb1: Manufacturer: Linux 5.4.0-177-generic ehci_hcd [ 4.699319] usb usb1: SerialNumber: 0000:00:1a.0 [ 4.704098] hub 1-0:1.0: USB hub found [ 4.707915] hub 1-0:1.0: 2 ports detected [ 4.712192] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 4.717483] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 4.724962] ehci-pci 0000:00:1d.0: debug port 2 [ 4.733466] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported [ 4.740323] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.758464] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.764306] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.772659] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.779961] usb usb2: Product: EHCI Host Controller [ 4.784903] usb usb2: Manufacturer: Linux 5.4.0-177-generic ehci_hcd [ 4.791321] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.796095] hub 2-0:1.0: USB hub found [ 4.799916] hub 2-0:1.0: 2 ports detected [ 4.804115] ehci-platform: EHCI generic platform driver [ 4.809414] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.815661] ohci-pci: OHCI PCI platform driver [ 4.820178] ohci-platform: OHCI generic platform driver [ 4.825468] uhci_hcd: USB Universal Host Controller Interface driver [ 4.832023] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.837317] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.845841] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.855066] xhci_hcd 0000:00:14.0: cache line size of 64 is not supported [ 4.862062] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.867349] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.874824] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.881174] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.889524] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.896826] usb usb3: Product: xHCI Host Controller [ 4.901769] usb usb3: Manufacturer: Linux 5.4.0-177-generic xhci-hcd [ 4.908186] usb usb3: SerialNumber: 0000:00:14.0 [ 4.912958] hub 3-0:1.0: USB hub found [ 4.916786] hub 3-0:1.0: 15 ports detected [ 4.922672] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.04 [ 4.931019] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.938321] usb usb4: Product: xHCI Host Controller [ 4.943263] usb usb4: Manufacturer: Linux 5.4.0-177-generic xhci-hcd [ 4.949680] usb usb4: SerialNumber: 0000:00:14.0 [ 4.954439] hub 4-0:1.0: USB hub found [ 4.958268] hub 4-0:1.0: 6 ports detected [ 4.963264] i8042: PNP: No PS/2 controller found. [ 4.968097] mousedev: PS/2 mouse device common for all mice [ 4.970433] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.973841] rtc_cmos 00:00: RTC can wake from S4 [ 4.985184] rtc_cmos 00:00: registered as rtc0 [ 4.989700] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 4.997439] i2c /dev entries driver [ 5.001014] device-mapper: uevent: version 1.0.3 [ 5.005760] device-mapper: ioctl: 4.41.0-ioctl (2019-09-16) initialised: dm-devel@redhat.com [ 5.014299] platform eisa.0: Probing EISA bus 0 [ 5.018896] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 5.025746] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 5.032253] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 5.038760] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 5.045260] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 5.051759] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 5.058260] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 5.058431] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 5.064760] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 5.064760] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 5.064761] platform eisa.0: EISA: Detected 0 cards [ 5.064767] intel_pstate: Intel P-state driver initializing [ 5.095700] ledtrig-cpu: registered to indicate activity on CPUs [ 5.101864] drop_monitor: Initializing network drop monitor service [ 5.108299] NET: Registered protocol family 10 [ 5.116838] Segment Routing with IPv6 [ 5.120579] NET: Registered protocol family 17 [ 5.125141] Key type dns_resolver registered [ 5.129865] RAS: Correctable Errors collector initialized. [ 5.134838] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 5.135454] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 5.143674] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.156843] microcode: Microcode Update Driver: v2.2. [ 5.156978] *** VALIDATE rdt *** [ 5.157100] hub 1-1:1.0: USB hub found [ 5.162094] resctrl: L3 allocation detected [ 5.169488] hub 1-1:1.0: 6 ports detected [ 5.173473] resctrl: L3DATA allocation detected [ 5.173474] resctrl: L3CODE allocation detected [ 5.173474] resctrl: L3 monitoring detected [ 5.173477] IPI shorthand broadcast: enabled [ 5.182409] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 5.186814] sched_clock: Marking stable (4164384860, 1022400076)->(5516740410, -329955474) [ 5.210492] registered taskstats version 1 [ 5.214663] Loading compiled-in X.509 certificates [ 5.220084] Loaded X.509 cert 'Build time autogenerated kernel key: 1224c9b81ccdd6d5fadad4fbd6b8ad2b6b069117' [ 5.230529] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 5.240761] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 5.242831] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 5.250845] blacklist: Loading compiled-in revocation X.509 certificates [ 5.259127] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.265938] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 5.273341] hub 2-1:1.0: USB hub found [ 5.283084] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 5.283099] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 5.283114] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 5.283129] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 5.283144] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 5.283160] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 5.283175] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 5.283190] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 5.283237] zswap: loaded using pool lzo/zbud [ 5.286952] hub 2-1:1.0: 8 ports detected [ 5.293156] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 5.293230] Key type ._fscrypt registered [ 5.293230] Key type .fscrypt registered [ 5.293300] pstore: Using crash dump compression: deflate [ 5.298274] Key type big_key registered [ 5.300894] Key type encrypted registered [ 5.300897] AppArmor: AppArmor sha1 policy hashing enabled [ 5.300906] ima: No TPM chip found, activating TPM-bypass! [ 5.300910] ima: Allocated hash algorithm: sha1 [ 5.300914] ima: No architecture policies found [ 5.300920] evm: Initialising EVM extended attributes: [ 5.300920] evm: security.selinux [ 5.300921] evm: security.SMACK64 [ 5.300921] evm: security.SMACK64EXEC [ 5.300921] evm: security.SMACK64TRANSMUTE [ 5.300921] evm: security.SMACK64MMAP [ 5.300922] evm: security.apparmor [ 5.300922] evm: security.ima [ 5.300922] evm: security.capability [ 5.300923] evm: HMAC attrs: 0x1 [ 5.301282] PM: Magic number: 4:823:376 [ 5.301386] acpi LNXCPU:ad: hash matches [ 5.303687] rtc_cmos 00:00: setting system clock to 2024-04-26T10:23:53 UTC (1714127033) [ 5.350637] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.498798] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.506106] clocksource: Switched to clocksource tsc [ 5.506356] hub 3-12:1.0: USB hub found [ 5.515136] hub 3-12:1.0: 4 ports detected [ 5.520004] Freeing unused decrypted memory: 2040K [ 5.525269] Freeing unused kernel image memory: 2768K [ 5.550457] Write protecting the kernel read-only data: 26624k [ 5.556738] Freeing unused kernel image memory: 2036K [ 5.562025] Freeing unused kernel image memory: 948K [ 5.573517] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.580019] x86/mm: Checking user space page tables [ 5.591271] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.597777] Run /init as init process Loading, please wait... Starting version 245.4-4ubuntu3.17 [ 5.715215] dca service started, version 1.12.1 [ 5.721443] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 46] ahci 0000:00orts 6 Gbps 0xf impl SATA mode [ 5.737435] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.745220] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k [ 5.752976] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.762959] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.6.0-k [ 5.769989] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.787362] nvme nvme0: pci function 0000:02:00.0 [ 5.792629] scsi host0: ahci [ 5.795766] scsi host1: ahci [ 5.798911] scsi host2: ahci [ 5.801946] scsi host3: ahci [ 5.804915] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 34 [ 5.812398] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 34 [ 5.819877] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 34 [ 5.826453] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.827358] aabar m2048@0xfb4[ 5.841810] a0 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.850076] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.897563] igb 0000:07:00.0: added PHC on eth0 [ 5.899151] nvme nvme0: 8/0/0 default/read/poll queues [ 5.902189] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.914301] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:34:f4 [ 5.921582] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.926789] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.958750] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.958769] scsi host4: ahci [ 5.967279] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.970370] scsi host5: ahci [ 5.981580] scsi host6: ahci [ 5.984645] scsi host7: ahci [ 5.984646] hidraw: raw HID events driver (C) Jiri Kosina [ 5.987650] scsi host8: ahci [ 5.998410] scsi host9: ahci [ 6.001739] igb 0000:07:00.1: added PHC on eth1 [ 6.006354] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.013292] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:34:f5 [ 6.020576] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.025777] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.033825] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 45 [ 6.041308] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 45 [ 6.048785] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 45 [ 6.056265] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 45 [ 6.063744] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 45 [ 6.071223] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 45 [ 6.157308] ata3: SATA link down (SStatus 0 SControl 300) [ 6.162792] ata1: SATA link down (SStatus 0 SControl 300) [ 6.168268] ata2: SATA link down (SStatus 0 SControl 300) [ 6.173744] ata4: SATA link down (SStatus 0 SControl 300) [ 6.393817] ata8: SATA link down (SStatus 0 SControl 300) [ 6.399302] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.405557] ata10: SATA link down (SStatus 0 SControl 300) [ 6.411119] ata7: SATA link down (SStatus 0 SControl 300) [ 6.416596] ata9: SATA link down (SStatus 0 SControl 300) [ 6.422072] ata6: SATA link down (SStatus 0 SControl 300) [ 6.428261] ata5.00: NCQ Send/Recv Log not supported [ 6.433294] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.439620] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.448132] ata5.00: NCQ Send/Recv Log not supported [ 6.453169] ata5.00: configured for UDMA/133 [ 6.457608] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.465885] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.465966] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.479024] sd 4:0:0:0: [sda] Write Protect is off [ 6.483888] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.523772] sda: sda1 [ 6.538502] sd 4:0:0:0: [sda] Attached SCSI disk [ 6.544673] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.550975] usbcore: registered new interface driver usbhid [ 6.556616] usbhid: USB HID core driver [ 6.562523] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.574638] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.634603] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.646522] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.658327] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 6.982624] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 6.992990] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.001586] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.007828] ixgbe 0000:03:00.0: 0c:c4:7a:88:73:f2 [ 7.015514] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.182485] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.192855] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.201452] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.208561] ixgbe 0000:03:00.1: 0c:c4:7a:88:73:f3 [ 7.216214] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.223571] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.250509] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.34 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: clean, 303194/61054976 files, 7960146/244190336 blocks done. [ 7.427454] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 8.175622] systemd[1]: Inserted module 'autofs4' [ 8.236361] systemd[1]: systemd 245.4-4ubuntu3.17 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid) [ 8.278620] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 20.04.4 LTS! [ 8.331109] systemd[1]: Set hostname to . [ 9.440680] systemd[1]: Created slice system-modprobe.slice. [ OK ] Created slice system-modprobe.slice. [ 9.462769] systemd[1]: Created slice system-serial\x2dgetty.slice. [ OK ] Created slice system-serial\x2dgetty.slice. [ 9.494764] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 9.514532] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 9.538944] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 9.566577] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 9.594543] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 9.622550] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 9.650545] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 9.678512] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 9.706543] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 9.734590] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 9.758576] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 9.778576] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 9.802568] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 9.825598] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 9.850790] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 9.870582] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 9.894559] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 9.918753] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 9.938572] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 9.958723] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 9.978695] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 9.998643] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 10.019411] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 10.039301] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 10.063378] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 10.087314] systemd[1]: Mounting RPC Pipe File System... Mounting RPC Pipe File System... [ 10.107612] systemd[1]: Mounting Kernel Debug File System... Mounting Kerne[ 10.114754] RPC: Registered named UNIX socket transport module. l Debug File Sys[ 10.122224] RPC: Registered udp transport module. tem... [ 10.128343] RPC: Registered tcp transport module. [ 10.134102] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 10.141600] systemd[1]: Mounting Kernel Trace File System... Mounting Kernel Trace File System... [ 10.163556] systemd[1]: Starting Journal Service... Starting Journal Service... [ 10.182528] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 10.192321] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 10.193525] systemd[1]: Starting Set the console keyboard layout... Starting Set the console keyboard layout... [ 10.223678] systemd[1]: Starting Create list of static device nodes for the current kernel... Starting Create list of st…odes for the current kernel... [ 10.251400] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 10.279123] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 10.298502] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 10.309161] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped. [ 10.318318] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 10.328579] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 10.347274] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 10.362040] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr [ 10.371163] systemd[1]: Starting udev Coldplug all Devices... Starting udev Coldplug all Devices... [ 10.381096] lp: driver loaded but no devices found [ 10.387923] systemd[1]: Starting Uncomplicated firewall... Starting Uncomplicated firewall... [ 10.407928] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ 10.416851] Loading iSCSI transport class v2.0-870. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted RPC Pipe File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create list of st… nodes for the current kernel. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Finished Uncomplicated firewall. Activating swap /swapfile... Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting pNFS block layout mapping daemon... Starting Flush Journal to Pers[ 10.714426] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS istent Storage[[ 10.724031] systemd-journald[365]: Received client request to flush runtime journal. 0m... Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished udev Coldplug all Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Reached target Swap. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Create System Users. Starting Create Static Device Nodes in /dev... [ OK ] Finished Apply Kernel Variables. [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Preprocess NFS configuration... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting udev Kernel Device Manager... [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Preprocess NFS configuration. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. Starting NFSv4 ID-name mapping service... [ OK ] Reached target NFS client services. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Finished Flush Journal to Persistent Storage. Starting Create Volatile Files and Directories... [ OK ] Started udev Kernel Device Manager. [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. Starting Network Service... [ OK ] Finished Load AppArmor profiles. [ OK ] Finished Create Volatile Files and Directories. Starting RPC bind portmap service... Starting Update UTMP about System Boot/Shutdown... [ OK ] Finished Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API. [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. [ OK ] Started Network Service. [ OK ] Listening on Docker Socket for the API. [ OK ] Started RPC bind portmap service. [ OK ] Found device /dev/ttyS1. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice system-lvm2\x2dpvscan.slice. [ OK ] Reached target RPC Port Mapper. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting LVM event activation on device 259:0... Starting Dispatcher daemon for systemd-networkd... [ OK ] Started Set the CPU Frequency Scaling governor. Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting Resets System Activity Data Collector... Starting Login Service... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Found device 82599ES 10-Gi…ion (AOC-STGN-I2S [REV 1.01]). [ OK ] Started ifup for enp3s0f1. [ OK ] Finished Resets System Activity Data Collector. [ OK ] Started Login Service. [ OK ] Started System Logging Service. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Finished Helper to synchronize boot up for ifupdown. Starting Raise network interfaces... [ OK ] Finished GRUB failed boot detection. [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [ OK ] Finished Wait for Network to be Configured. [* ] A start job is running for Raise network interfaces (9s / 5min 5s) M  Stopping Network Name Resolution... [ OK ] Stopped Network Name Resolution. Starting Network Name Resolution... [ OK ] Started Network Name Resolution. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips=172.21.15.164 + attempts=1 + sleep 1 Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Started Network Time Service. [ OK ] Finished Map RBD devices. + '[' 172.21.15.164 '!=' '' ']' + set -e + '[' -n 172.21.15.164 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.164 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.164 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi164.front.sepia.ceph.com + '[' -n smithi164.front.sepia.ceph.com ']' + hostname smithi164.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi164 + echo smithi164 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.164 smithi164.front.sepia.ceph.com smithi164/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished NFS server and services. [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice system-getty.slice. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started LSB: Collectl monitors system performance.. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... Ubuntu 20.04.4 LTS smithi164.front.sepia.ceph.com ttyS1 smithi164 login: [disconnect] 2024-04-26T10:24:09.953 INFO:teuthology.misc:Re-opening connections... 2024-04-26T10:24:09.953 INFO:teuthology.misc:trying to connect to ubuntu@smithi164.front.sepia.ceph.com 2024-04-26T10:24:09.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-26T10:24:09.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-26T10:24:10.360 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-04-26T10:24:11.290 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-04-26T10:24:11.290 DEBUG:teuthology.misc:waited 1.3368611335754395 2024-04-26T10:24:12.291 DEBUG:tasks.ceph_manager:Mounting data for osd.2 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-26T10:24:12.292 INFO:tasks.ceph_manager:Mounting osd.2: dev: ubuntu@smithi164.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-2, type: xfs, options: ['noatime'] 2024-04-26T10:24:12.292 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-26T10:24:12.501 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2024-04-26T10:24:12.523 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-26T10:24:12.523 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-26T10:24:12.525 INFO:tasks.ceph.osd.2:Started 2024-04-26T10:24:12.525 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:24:12.647 INFO:teuthology.orchestra.run.smithi164.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-26T10:24:12.649 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T10:24:12.649 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-04-26T10:24:14.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-26T10:24:14.813 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:24:14.952+0000 7fda42e41880 -1 Falling back to public interface 2024-04-26T10:24:17.651 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:24:17.760 INFO:teuthology.orchestra.run.smithi164.stderr:no valid command found; 10 closest matches: 2024-04-26T10:24:17.760 INFO:teuthology.orchestra.run.smithi164.stderr:0 2024-04-26T10:24:17.760 INFO:teuthology.orchestra.run.smithi164.stderr:1 2024-04-26T10:24:17.760 INFO:teuthology.orchestra.run.smithi164.stderr:2 2024-04-26T10:24:17.760 INFO:teuthology.orchestra.run.smithi164.stderr:abort 2024-04-26T10:24:17.760 INFO:teuthology.orchestra.run.smithi164.stderr:assert 2024-04-26T10:24:17.760 INFO:teuthology.orchestra.run.smithi164.stderr:bluefs debug_inject_read_zeros 2024-04-26T10:24:17.760 INFO:teuthology.orchestra.run.smithi164.stderr:bluefs files list 2024-04-26T10:24:17.760 INFO:teuthology.orchestra.run.smithi164.stderr:bluefs stats 2024-04-26T10:24:17.760 INFO:teuthology.orchestra.run.smithi164.stderr:bluestore bluefs device info [] 2024-04-26T10:24:17.760 INFO:teuthology.orchestra.run.smithi164.stderr:config diff 2024-04-26T10:24:17.761 INFO:teuthology.orchestra.run.smithi164.stderr:admin_socket: invalid command 2024-04-26T10:24:17.762 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-26T10:24:17.763 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2024-04-26T10:24:20.464 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:24:20.604+0000 7fda42e41880 -1 osd.2 28 log_to_monitors true 2024-04-26T10:24:20.651 INFO:tasks.ceph.osd.2.smithi164.stderr:2024-04-26T10:24:20.792+0000 7fda3672f700 -1 osd.2 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-26T10:24:22.764 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-26T10:24:22.873 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-04-26T10:24:22.873 INFO:teuthology.orchestra.run.smithi164.stdout: "ops": [], 2024-04-26T10:24:22.873 INFO:teuthology.orchestra.run.smithi164.stdout: "num_ops": 0 2024-04-26T10:24:22.873 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-04-26T10:24:27.884 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-26T10:24:28.031 INFO:teuthology.orchestra.run.smithi052.stdout:mon.a: {} 2024-04-26T10:24:28.050 INFO:teuthology.orchestra.run.smithi052.stdout:mon.b: {} 2024-04-26T10:24:28.063 INFO:teuthology.orchestra.run.smithi052.stdout:mon.c: {} 2024-04-26T10:24:28.065 INFO:teuthology.orchestra.run.smithi052.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T10:24:28.065 INFO:teuthology.orchestra.run.smithi052.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T10:24:28.065 INFO:teuthology.orchestra.run.smithi052.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-26T10:24:28.078 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-26T10:24:28.571 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.0 to 1 (10000) 2024-04-26T10:24:28.585 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-26T10:24:29.586 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-26T10:24:29.601 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-26T10:24:30.591 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.1 to 1 (10000) 2024-04-26T10:24:30.605 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-26T10:24:31.594 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-26T10:24:31.607 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-26T10:24:32.606 INFO:teuthology.orchestra.run.smithi052.stderr:reweighted osd.2 to 1 (10000) 2024-04-26T10:24:32.620 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-26T10:24:33.182 INFO:teuthology.orchestra.run.smithi052.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-26T10:24:33.196 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-26T10:24:33.196 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-26T10:24:33.196 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-26T10:24:33.196 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-26T10:24:33.196 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-26T10:24:33.197 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:24:33.513 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:24:33.513 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":90,"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","created":"2024-04-26T10:20:48.363934+0000","modified":"2024-04-26T10:24:33.166496+0000","last_up_change":"2024-04-26T10:24:21.506586+0000","last_in_change":"2024-04-26T10:20:49.575442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:20:59.994755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:21:03.866927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:21:07.853429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:21:08.285131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5e76c47-dfc4-40ca-88d3-2084cac6e35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":18193},{"type":"v1","addr":"172.21.15.120:6801","nonce":18193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":18193},{"type":"v1","addr":"172.21.15.120:6803","nonce":18193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":18193},{"type":"v1","addr":"172.21.15.120:6807","nonce":18193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":18193},{"type":"v1","addr":"172.21.15.120:6805","nonce":18193}]},"public_addr":"172.21.15.120:6801/18193","cluster_addr":"172.21.15.120:6803/18193","heartbeat_back_addr":"172.21.15.120:6807/18193","heartbeat_front_addr":"172.21.15.120:6805/18193","state":["exists","up"]},{"osd":1,"uuid":"2a8d530c-cf33-4540-9240-6bd7485e06ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":18226},{"type":"v1","addr":"172.21.15.154:6801","nonce":18226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":18226},{"type":"v1","addr":"172.21.15.154:6803","nonce":18226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":18226},{"type":"v1","addr":"172.21.15.154:6807","nonce":18226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":18226},{"type":"v1","addr":"172.21.15.154:6805","nonce":18226}]},"public_addr":"172.21.15.154:6801/18226","cluster_addr":"172.21.15.154:6803/18226","heartbeat_back_addr":"172.21.15.154:6807/18226","heartbeat_front_addr":"172.21.15.154:6805/18226","state":["exists","up"]},{"osd":2,"uuid":"484ab70f-4cad-4ff6-9405-8865ec5ee327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":28,"up_from":80,"up_thru":87,"down_at":29,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":1327},{"type":"v1","addr":"172.21.15.164:6801","nonce":1327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1327},{"type":"v1","addr":"172.21.15.164:6803","nonce":1327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":1327},{"type":"v1","addr":"172.21.15.164:6807","nonce":1327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":1327},{"type":"v1","addr":"172.21.15.164:6805","nonce":1327}]},"public_addr":"172.21.15.164:6801/1327","cluster_addr":"172.21.15.164:6803/1327","heartbeat_back_addr":"172.21.15.164:6807/1327","heartbeat_front_addr":"172.21.15.164:6805/1327","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.871567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.910527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.761919+0000","dead_epoch":28}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:24:33.527 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-26T10:24:33.527 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:24:33.826 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:24:33.826 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":90,"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","created":"2024-04-26T10:20:48.363934+0000","modified":"2024-04-26T10:24:33.166496+0000","last_up_change":"2024-04-26T10:24:21.506586+0000","last_in_change":"2024-04-26T10:20:49.575442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:20:59.994755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:21:03.866927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:21:07.853429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:21:08.285131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5e76c47-dfc4-40ca-88d3-2084cac6e35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":18193},{"type":"v1","addr":"172.21.15.120:6801","nonce":18193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":18193},{"type":"v1","addr":"172.21.15.120:6803","nonce":18193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":18193},{"type":"v1","addr":"172.21.15.120:6807","nonce":18193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":18193},{"type":"v1","addr":"172.21.15.120:6805","nonce":18193}]},"public_addr":"172.21.15.120:6801/18193","cluster_addr":"172.21.15.120:6803/18193","heartbeat_back_addr":"172.21.15.120:6807/18193","heartbeat_front_addr":"172.21.15.120:6805/18193","state":["exists","up"]},{"osd":1,"uuid":"2a8d530c-cf33-4540-9240-6bd7485e06ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":18226},{"type":"v1","addr":"172.21.15.154:6801","nonce":18226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":18226},{"type":"v1","addr":"172.21.15.154:6803","nonce":18226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":18226},{"type":"v1","addr":"172.21.15.154:6807","nonce":18226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":18226},{"type":"v1","addr":"172.21.15.154:6805","nonce":18226}]},"public_addr":"172.21.15.154:6801/18226","cluster_addr":"172.21.15.154:6803/18226","heartbeat_back_addr":"172.21.15.154:6807/18226","heartbeat_front_addr":"172.21.15.154:6805/18226","state":["exists","up"]},{"osd":2,"uuid":"484ab70f-4cad-4ff6-9405-8865ec5ee327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":28,"up_from":80,"up_thru":87,"down_at":29,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":1327},{"type":"v1","addr":"172.21.15.164:6801","nonce":1327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1327},{"type":"v1","addr":"172.21.15.164:6803","nonce":1327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":1327},{"type":"v1","addr":"172.21.15.164:6807","nonce":1327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":1327},{"type":"v1","addr":"172.21.15.164:6805","nonce":1327}]},"public_addr":"172.21.15.164:6801/1327","cluster_addr":"172.21.15.164:6803/1327","heartbeat_back_addr":"172.21.15.164:6807/1327","heartbeat_front_addr":"172.21.15.164:6805/1327","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.871567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.910527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.761919+0000","dead_epoch":28}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:24:33.842 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-26T10:24:33.842 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-26T10:24:33.843 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-26T10:24:33.992 INFO:teuthology.orchestra.run.smithi052.stdout:42949673006 2024-04-26T10:24:33.992 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T10:24:33.999 INFO:teuthology.orchestra.run.smithi052.stdout:343597383684 2024-04-26T10:24:33.999 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T10:24:34.000 INFO:teuthology.orchestra.run.smithi052.stdout:42949673008 2024-04-26T10:24:34.000 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T10:24:34.288 INFO:teuthology.orchestra.run.smithi052.stdout:343597383683 2024-04-26T10:24:34.303 INFO:teuthology.orchestra.run.smithi052.stdout:42949673005 2024-04-26T10:24:34.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 343597383684 got 343597383683 for osd.2 2024-04-26T10:24:34.313 INFO:teuthology.orchestra.run.smithi052.stdout:42949673006 2024-04-26T10:24:34.317 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673006 got 42949673005 for osd.0 2024-04-26T10:24:34.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673008 got 42949673006 for osd.1 2024-04-26T10:24:35.307 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-26T10:24:35.319 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-26T10:24:35.329 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-26T10:24:35.620 INFO:teuthology.orchestra.run.smithi052.stdout:343597383684 2024-04-26T10:24:35.638 INFO:tasks.ceph.ceph_manager.ceph:need seq 343597383684 got 343597383684 for osd.2 2024-04-26T10:24:35.638 DEBUG:teuthology.parallel:result is None 2024-04-26T10:24:35.659 INFO:teuthology.orchestra.run.smithi052.stdout:42949673007 2024-04-26T10:24:35.673 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673006 got 42949673007 for osd.0 2024-04-26T10:24:35.673 DEBUG:teuthology.parallel:result is None 2024-04-26T10:24:35.675 INFO:teuthology.orchestra.run.smithi052.stdout:42949673008 2024-04-26T10:24:35.695 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673008 got 42949673008 for osd.1 2024-04-26T10:24:35.695 DEBUG:teuthology.parallel:result is None 2024-04-26T10:24:35.696 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-26T10:24:35.696 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:24:36.069 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:24:36.071 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:24:36.082 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2024-04-26T10:24:36.041254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1184088,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":804904,"kb_used_data":3064,"kb_used_omap":9,"kb_used_meta":801782,"kb_avail":282310616,"statfs":{"total":289910292480,"available":289086070784,"internally_reserved":0,"allocated":3137536,"data_stored":2503406,"data_compressed":14075,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":10067,"internal_metadata":821024941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":592044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.458837"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183068+0000","last_change":"2024-04-26T10:24:31.598789+0000","last_active":"2024-04-26T10:24:33.183068+0000","last_peered":"2024-04-26T10:24:33.183068+0000","last_clean":"2024-04-26T10:24:33.183068+0000","last_became_active":"2024-04-26T10:24:31.598170+0000","last_became_peered":"2024-04-26T10:24:31.598170+0000","last_unstale":"2024-04-26T10:24:33.183068+0000","last_undegraded":"2024-04-26T10:24:33.183068+0000","last_fullsized":"2024-04-26T10:24:33.183068+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:46.718423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":85,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744370+0000","last_change":"2024-04-26T10:24:22.536264+0000","last_active":"2024-04-26T10:24:32.744370+0000","last_peered":"2024-04-26T10:24:32.744370+0000","last_clean":"2024-04-26T10:24:32.744370+0000","last_became_active":"2024-04-26T10:24:22.535998+0000","last_became_peered":"2024-04-26T10:24:22.535998+0000","last_unstale":"2024-04-26T10:24:32.744370+0000","last_undegraded":"2024-04-26T10:24:32.744370+0000","last_fullsized":"2024-04-26T10:24:32.744370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:54.491369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":78,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599563+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:24:32.599563+0000","last_peered":"2024-04-26T10:24:32.599563+0000","last_clean":"2024-04-26T10:24:32.599563+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:24:32.599563+0000","last_undegraded":"2024-04-26T10:24:32.599563+0000","last_fullsized":"2024-04-26T10:24:32.599563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:01.883964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599310+0000","last_change":"2024-04-26T10:24:22.549067+0000","last_active":"2024-04-26T10:24:32.599310+0000","last_peered":"2024-04-26T10:24:32.599310+0000","last_clean":"2024-04-26T10:24:32.599310+0000","last_became_active":"2024-04-26T10:24:22.548485+0000","last_became_peered":"2024-04-26T10:24:22.548485+0000","last_unstale":"2024-04-26T10:24:32.599310+0000","last_undegraded":"2024-04-26T10:24:32.599310+0000","last_fullsized":"2024-04-26T10:24:32.599310+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:19.263146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181618+0000","last_change":"2024-04-26T10:24:31.601925+0000","last_active":"2024-04-26T10:24:33.181618+0000","last_peered":"2024-04-26T10:24:33.181618+0000","last_clean":"2024-04-26T10:24:33.181618+0000","last_became_active":"2024-04-26T10:24:31.600986+0000","last_became_peered":"2024-04-26T10:24:31.600986+0000","last_unstale":"2024-04-26T10:24:33.181618+0000","last_undegraded":"2024-04-26T10:24:33.181618+0000","last_fullsized":"2024-04-26T10:24:33.181618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:52.125249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596629+0000","last_change":"2024-04-26T10:24:22.548245+0000","last_active":"2024-04-26T10:24:32.596629+0000","last_peered":"2024-04-26T10:24:32.596629+0000","last_clean":"2024-04-26T10:24:32.596629+0000","last_became_active":"2024-04-26T10:24:22.547731+0000","last_became_peered":"2024-04-26T10:24:22.547731+0000","last_unstale":"2024-04-26T10:24:32.596629+0000","last_undegraded":"2024-04-26T10:24:32.596629+0000","last_fullsized":"2024-04-26T10:24:32.596629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:52.538672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597733+0000","last_change":"2024-04-26T10:24:22.549424+0000","last_active":"2024-04-26T10:24:32.597733+0000","last_peered":"2024-04-26T10:24:32.597733+0000","last_clean":"2024-04-26T10:24:32.597733+0000","last_became_active":"2024-04-26T10:24:22.549180+0000","last_became_peered":"2024-04-26T10:24:22.549180+0000","last_unstale":"2024-04-26T10:24:32.597733+0000","last_undegraded":"2024-04-26T10:24:32.597733+0000","last_fullsized":"2024-04-26T10:24:32.597733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.915633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597437+0000","last_change":"2024-04-26T10:24:22.547840+0000","last_active":"2024-04-26T10:24:32.597437+0000","last_peered":"2024-04-26T10:24:32.597437+0000","last_clean":"2024-04-26T10:24:32.597437+0000","last_became_active":"2024-04-26T10:24:22.547284+0000","last_became_peered":"2024-04-26T10:24:22.547284+0000","last_unstale":"2024-04-26T10:24:32.597437+0000","last_undegraded":"2024-04-26T10:24:32.597437+0000","last_fullsized":"2024-04-26T10:24:32.597437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:09.731025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318637+0000","last_change":"2024-04-26T10:24:22.680232+0000","last_active":"2024-04-26T10:24:33.318637+0000","last_peered":"2024-04-26T10:24:33.318637+0000","last_clean":"2024-04-26T10:24:33.318637+0000","last_became_active":"2024-04-26T10:24:22.679648+0000","last_became_peered":"2024-04-26T10:24:22.679648+0000","last_unstale":"2024-04-26T10:24:33.318637+0000","last_undegraded":"2024-04-26T10:24:33.318637+0000","last_fullsized":"2024-04-26T10:24:33.318637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:58.174215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182358+0000","last_change":"2024-04-26T10:24:31.599182+0000","last_active":"2024-04-26T10:24:33.182358+0000","last_peered":"2024-04-26T10:24:33.182358+0000","last_clean":"2024-04-26T10:24:33.182358+0000","last_became_active":"2024-04-26T10:24:31.598187+0000","last_became_peered":"2024-04-26T10:24:31.598187+0000","last_unstale":"2024-04-26T10:24:33.182358+0000","last_undegraded":"2024-04-26T10:24:33.182358+0000","last_fullsized":"2024-04-26T10:24:33.182358+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:24.255353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599420+0000","last_change":"2024-04-26T10:24:22.547601+0000","last_active":"2024-04-26T10:24:32.599420+0000","last_peered":"2024-04-26T10:24:32.599420+0000","last_clean":"2024-04-26T10:24:32.599420+0000","last_became_active":"2024-04-26T10:24:22.546506+0000","last_became_peered":"2024-04-26T10:24:22.546506+0000","last_unstale":"2024-04-26T10:24:32.599420+0000","last_undegraded":"2024-04-26T10:24:32.599420+0000","last_fullsized":"2024-04-26T10:24:32.599420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:21.263835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.745021+0000","last_change":"2024-04-26T10:22:09.748232+0000","last_active":"2024-04-26T10:24:32.745021+0000","last_peered":"2024-04-26T10:24:32.745021+0000","last_clean":"2024-04-26T10:24:32.745021+0000","last_became_active":"2024-04-26T10:22:09.747822+0000","last_became_peered":"2024-04-26T10:22:09.747822+0000","last_unstale":"2024-04-26T10:24:32.745021+0000","last_undegraded":"2024-04-26T10:24:32.745021+0000","last_fullsized":"2024-04-26T10:24:32.745021+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.223031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181391+0000","last_change":"2024-04-26T10:24:31.598330+0000","last_active":"2024-04-26T10:24:33.181391+0000","last_peered":"2024-04-26T10:24:33.181391+0000","last_clean":"2024-04-26T10:24:33.181391+0000","last_became_active":"2024-04-26T10:24:31.597980+0000","last_became_peered":"2024-04-26T10:24:31.597980+0000","last_unstale":"2024-04-26T10:24:33.181391+0000","last_undegraded":"2024-04-26T10:24:33.181391+0000","last_fullsized":"2024-04-26T10:24:33.181391+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:38.711968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596786+0000","last_change":"2024-04-26T10:24:31.602827+0000","last_active":"2024-04-26T10:24:32.596786+0000","last_peered":"2024-04-26T10:24:32.596786+0000","last_clean":"2024-04-26T10:24:32.596786+0000","last_became_active":"2024-04-26T10:24:31.602539+0000","last_became_peered":"2024-04-26T10:24:31.602539+0000","last_unstale":"2024-04-26T10:24:32.596786+0000","last_undegraded":"2024-04-26T10:24:32.596786+0000","last_fullsized":"2024-04-26T10:24:32.596786+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:45.294898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596427+0000","last_change":"2024-04-26T10:24:31.602863+0000","last_active":"2024-04-26T10:24:32.596427+0000","last_peered":"2024-04-26T10:24:32.596427+0000","last_clean":"2024-04-26T10:24:32.596427+0000","last_became_active":"2024-04-26T10:24:31.602453+0000","last_became_peered":"2024-04-26T10:24:31.602453+0000","last_unstale":"2024-04-26T10:24:32.596427+0000","last_undegraded":"2024-04-26T10:24:32.596427+0000","last_fullsized":"2024-04-26T10:24:32.596427+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:51.661774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596948+0000","last_change":"2024-04-26T10:24:22.547543+0000","last_active":"2024-04-26T10:24:32.596948+0000","last_peered":"2024-04-26T10:24:32.596948+0000","last_clean":"2024-04-26T10:24:32.596948+0000","last_became_active":"2024-04-26T10:24:22.546856+0000","last_became_peered":"2024-04-26T10:24:22.546856+0000","last_unstale":"2024-04-26T10:24:32.596948+0000","last_undegraded":"2024-04-26T10:24:32.596948+0000","last_fullsized":"2024-04-26T10:24:32.596948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:34.240590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318406+0000","last_change":"2024-04-26T10:24:22.679885+0000","last_active":"2024-04-26T10:24:33.318406+0000","last_peered":"2024-04-26T10:24:33.318406+0000","last_clean":"2024-04-26T10:24:33.318406+0000","last_became_active":"2024-04-26T10:24:22.679350+0000","last_became_peered":"2024-04-26T10:24:22.679350+0000","last_unstale":"2024-04-26T10:24:33.318406+0000","last_undegraded":"2024-04-26T10:24:33.318406+0000","last_fullsized":"2024-04-26T10:24:33.318406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:06.039983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182466+0000","last_change":"2024-04-26T10:24:31.598857+0000","last_active":"2024-04-26T10:24:33.182466+0000","last_peered":"2024-04-26T10:24:33.182466+0000","last_clean":"2024-04-26T10:24:33.182466+0000","last_became_active":"2024-04-26T10:24:31.597563+0000","last_became_peered":"2024-04-26T10:24:31.597563+0000","last_unstale":"2024-04-26T10:24:33.182466+0000","last_undegraded":"2024-04-26T10:24:33.182466+0000","last_fullsized":"2024-04-26T10:24:33.182466+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:26.624180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317832+0000","last_change":"2024-04-26T10:24:22.679291+0000","last_active":"2024-04-26T10:24:33.317832+0000","last_peered":"2024-04-26T10:24:33.317832+0000","last_clean":"2024-04-26T10:24:33.317832+0000","last_became_active":"2024-04-26T10:24:22.678912+0000","last_became_peered":"2024-04-26T10:24:22.678912+0000","last_unstale":"2024-04-26T10:24:33.317832+0000","last_undegraded":"2024-04-26T10:24:33.317832+0000","last_fullsized":"2024-04-26T10:24:33.317832+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:49.260130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.598414+0000","last_change":"2024-04-26T10:24:22.546669+0000","last_active":"2024-04-26T10:24:32.598414+0000","last_peered":"2024-04-26T10:24:32.598414+0000","last_clean":"2024-04-26T10:24:32.598414+0000","last_became_active":"2024-04-26T10:24:22.546052+0000","last_became_peered":"2024-04-26T10:24:22.546052+0000","last_unstale":"2024-04-26T10:24:32.598414+0000","last_undegraded":"2024-04-26T10:24:32.598414+0000","last_fullsized":"2024-04-26T10:24:32.598414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:26.334069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597042+0000","last_change":"2024-04-26T10:24:22.547981+0000","last_active":"2024-04-26T10:24:32.597042+0000","last_peered":"2024-04-26T10:24:32.597042+0000","last_clean":"2024-04-26T10:24:32.597042+0000","last_became_active":"2024-04-26T10:24:22.547663+0000","last_became_peered":"2024-04-26T10:24:22.547663+0000","last_unstale":"2024-04-26T10:24:32.597042+0000","last_undegraded":"2024-04-26T10:24:32.597042+0000","last_fullsized":"2024-04-26T10:24:32.597042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:07.105037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.743605+0000","last_change":"2024-04-26T10:22:09.749283+0000","last_active":"2024-04-26T10:24:32.743605+0000","last_peered":"2024-04-26T10:24:32.743605+0000","last_clean":"2024-04-26T10:24:32.743605+0000","last_became_active":"2024-04-26T10:22:09.748755+0000","last_became_peered":"2024-04-26T10:22:09.748755+0000","last_unstale":"2024-04-26T10:24:32.743605+0000","last_undegraded":"2024-04-26T10:24:32.743605+0000","last_fullsized":"2024-04-26T10:24:32.743605+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:40.910715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317029+0000","last_change":"2024-04-26T10:24:22.684668+0000","last_active":"2024-04-26T10:24:33.317029+0000","last_peered":"2024-04-26T10:24:33.317029+0000","last_clean":"2024-04-26T10:24:33.317029+0000","last_became_active":"2024-04-26T10:24:22.683921+0000","last_became_peered":"2024-04-26T10:24:22.683921+0000","last_unstale":"2024-04-26T10:24:33.317029+0000","last_undegraded":"2024-04-26T10:24:33.317029+0000","last_fullsized":"2024-04-26T10:24:33.317029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.930781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":85,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.749646+0000","last_change":"2024-04-26T10:24:22.535052+0000","last_active":"2024-04-26T10:24:32.749646+0000","last_peered":"2024-04-26T10:24:32.749646+0000","last_clean":"2024-04-26T10:24:32.749646+0000","last_became_active":"2024-04-26T10:24:22.534674+0000","last_became_peered":"2024-04-26T10:24:22.534674+0000","last_unstale":"2024-04-26T10:24:32.749646+0000","last_undegraded":"2024-04-26T10:24:32.749646+0000","last_fullsized":"2024-04-26T10:24:32.749646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:10.969425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183059+0000","last_change":"2024-04-26T10:24:31.601262+0000","last_active":"2024-04-26T10:24:33.183059+0000","last_peered":"2024-04-26T10:24:33.183059+0000","last_clean":"2024-04-26T10:24:33.183059+0000","last_became_active":"2024-04-26T10:24:31.600815+0000","last_became_peered":"2024-04-26T10:24:31.600815+0000","last_unstale":"2024-04-26T10:24:33.183059+0000","last_undegraded":"2024-04-26T10:24:33.183059+0000","last_fullsized":"2024-04-26T10:24:33.183059+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:02.552727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319258+0000","last_change":"2024-04-26T10:24:22.684739+0000","last_active":"2024-04-26T10:24:33.319258+0000","last_peered":"2024-04-26T10:24:33.319258+0000","last_clean":"2024-04-26T10:24:33.319258+0000","last_became_active":"2024-04-26T10:24:22.683959+0000","last_became_peered":"2024-04-26T10:24:22.683959+0000","last_unstale":"2024-04-26T10:24:33.319258+0000","last_undegraded":"2024-04-26T10:24:33.319258+0000","last_fullsized":"2024-04-26T10:24:33.319258+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:07.840236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":78,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599362+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:24:32.599362+0000","last_peered":"2024-04-26T10:24:32.599362+0000","last_clean":"2024-04-26T10:24:32.599362+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:24:32.599362+0000","last_undegraded":"2024-04-26T10:24:32.599362+0000","last_fullsized":"2024-04-26T10:24:32.599362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:39.394937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182858+0000","last_change":"2024-04-26T10:24:31.602078+0000","last_active":"2024-04-26T10:24:33.182858+0000","last_peered":"2024-04-26T10:24:33.182858+0000","last_clean":"2024-04-26T10:24:33.182858+0000","last_became_active":"2024-04-26T10:24:31.601299+0000","last_became_peered":"2024-04-26T10:24:31.601299+0000","last_unstale":"2024-04-26T10:24:33.182858+0000","last_undegraded":"2024-04-26T10:24:33.182858+0000","last_fullsized":"2024-04-26T10:24:33.182858+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:43.374493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317271+0000","last_change":"2024-04-26T10:24:31.741152+0000","last_active":"2024-04-26T10:24:33.317271+0000","last_peered":"2024-04-26T10:24:33.317271+0000","last_clean":"2024-04-26T10:24:33.317271+0000","last_became_active":"2024-04-26T10:24:31.740626+0000","last_became_peered":"2024-04-26T10:24:31.740626+0000","last_unstale":"2024-04-26T10:24:33.317271+0000","last_undegraded":"2024-04-26T10:24:33.317271+0000","last_fullsized":"2024-04-26T10:24:33.317271+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:23.323149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.743742+0000","last_change":"2024-04-26T10:22:09.750562+0000","last_active":"2024-04-26T10:24:32.743742+0000","last_peered":"2024-04-26T10:24:32.743742+0000","last_clean":"2024-04-26T10:24:32.743742+0000","last_became_active":"2024-04-26T10:22:09.750286+0000","last_became_peered":"2024-04-26T10:22:09.750286+0000","last_unstale":"2024-04-26T10:24:32.743742+0000","last_undegraded":"2024-04-26T10:24:32.743742+0000","last_fullsized":"2024-04-26T10:24:32.743742+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:52.795517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317979+0000","last_change":"2024-04-26T10:24:31.741008+0000","last_active":"2024-04-26T10:24:33.317979+0000","last_peered":"2024-04-26T10:24:33.317979+0000","last_clean":"2024-04-26T10:24:33.317979+0000","last_became_active":"2024-04-26T10:24:31.740518+0000","last_became_peered":"2024-04-26T10:24:31.740518+0000","last_unstale":"2024-04-26T10:24:33.317979+0000","last_undegraded":"2024-04-26T10:24:33.317979+0000","last_fullsized":"2024-04-26T10:24:33.317979+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:11:59.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596725+0000","last_change":"2024-04-26T10:24:22.540161+0000","last_active":"2024-04-26T10:24:32.596725+0000","last_peered":"2024-04-26T10:24:32.596725+0000","last_clean":"2024-04-26T10:24:32.596725+0000","last_became_active":"2024-04-26T10:24:22.539106+0000","last_became_peered":"2024-04-26T10:24:22.539106+0000","last_unstale":"2024-04-26T10:24:32.596725+0000","last_undegraded":"2024-04-26T10:24:32.596725+0000","last_fullsized":"2024-04-26T10:24:32.596725+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:09.208422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182259+0000","last_change":"2024-04-26T10:24:31.599487+0000","last_active":"2024-04-26T10:24:33.182259+0000","last_peered":"2024-04-26T10:24:33.182259+0000","last_clean":"2024-04-26T10:24:33.182259+0000","last_became_active":"2024-04-26T10:24:31.598307+0000","last_became_peered":"2024-04-26T10:24:31.598307+0000","last_unstale":"2024-04-26T10:24:33.182259+0000","last_undegraded":"2024-04-26T10:24:33.182259+0000","last_fullsized":"2024-04-26T10:24:33.182259+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:11.881961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":94,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596974+0000","last_change":"2024-04-26T10:24:22.547974+0000","last_active":"2024-04-26T10:24:32.596974+0000","last_peered":"2024-04-26T10:24:32.596974+0000","last_clean":"2024-04-26T10:24:32.596974+0000","last_became_active":"2024-04-26T10:24:22.546794+0000","last_became_peered":"2024-04-26T10:24:22.546794+0000","last_unstale":"2024-04-26T10:24:32.596974+0000","last_undegraded":"2024-04-26T10:24:32.596974+0000","last_fullsized":"2024-04-26T10:24:32.596974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:28.897600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182230+0000","last_change":"2024-04-26T10:24:31.597848+0000","last_active":"2024-04-26T10:24:33.182230+0000","last_peered":"2024-04-26T10:24:33.182230+0000","last_clean":"2024-04-26T10:24:33.182230+0000","last_became_active":"2024-04-26T10:24:31.596297+0000","last_became_peered":"2024-04-26T10:24:31.596297+0000","last_unstale":"2024-04-26T10:24:33.182230+0000","last_undegraded":"2024-04-26T10:24:33.182230+0000","last_fullsized":"2024-04-26T10:24:33.182230+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:09.585450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317333+0000","last_change":"2024-04-26T10:24:22.684913+0000","last_active":"2024-04-26T10:24:33.317333+0000","last_peered":"2024-04-26T10:24:33.317333+0000","last_clean":"2024-04-26T10:24:33.317333+0000","last_became_active":"2024-04-26T10:24:22.684541+0000","last_became_peered":"2024-04-26T10:24:22.684541+0000","last_unstale":"2024-04-26T10:24:33.317333+0000","last_undegraded":"2024-04-26T10:24:33.317333+0000","last_fullsized":"2024-04-26T10:24:33.317333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:32.802131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318520+0000","last_change":"2024-04-26T10:24:22.683787+0000","last_active":"2024-04-26T10:24:33.318520+0000","last_peered":"2024-04-26T10:24:33.318520+0000","last_clean":"2024-04-26T10:24:33.318520+0000","last_became_active":"2024-04-26T10:24:22.682650+0000","last_became_peered":"2024-04-26T10:24:22.682650+0000","last_unstale":"2024-04-26T10:24:33.318520+0000","last_undegraded":"2024-04-26T10:24:33.318520+0000","last_fullsized":"2024-04-26T10:24:33.318520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:29.301512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.180845+0000","last_change":"2024-04-26T10:24:31.601959+0000","last_active":"2024-04-26T10:24:33.180845+0000","last_peered":"2024-04-26T10:24:33.180845+0000","last_clean":"2024-04-26T10:24:33.180845+0000","last_became_active":"2024-04-26T10:24:31.601091+0000","last_became_peered":"2024-04-26T10:24:31.601091+0000","last_unstale":"2024-04-26T10:24:33.180845+0000","last_undegraded":"2024-04-26T10:24:33.180845+0000","last_fullsized":"2024-04-26T10:24:33.180845+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:46.182880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318431+0000","last_change":"2024-04-26T10:24:22.684603+0000","last_active":"2024-04-26T10:24:33.318431+0000","last_peered":"2024-04-26T10:24:33.318431+0000","last_clean":"2024-04-26T10:24:33.318431+0000","last_became_active":"2024-04-26T10:24:22.684213+0000","last_became_peered":"2024-04-26T10:24:22.684213+0000","last_unstale":"2024-04-26T10:24:33.318431+0000","last_undegraded":"2024-04-26T10:24:33.318431+0000","last_fullsized":"2024-04-26T10:24:33.318431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:41.006428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596275+0000","last_change":"2024-04-26T10:24:31.613086+0000","last_active":"2024-04-26T10:24:32.596275+0000","last_peered":"2024-04-26T10:24:32.596275+0000","last_clean":"2024-04-26T10:24:32.596275+0000","last_became_active":"2024-04-26T10:24:31.604402+0000","last_became_peered":"2024-04-26T10:24:31.604402+0000","last_unstale":"2024-04-26T10:24:32.596275+0000","last_undegraded":"2024-04-26T10:24:32.596275+0000","last_fullsized":"2024-04-26T10:24:32.596275+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:52.355783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":114,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599278+0000","last_change":"2024-04-26T10:24:31.624641+0000","last_active":"2024-04-26T10:24:32.599278+0000","last_peered":"2024-04-26T10:24:32.599278+0000","last_clean":"2024-04-26T10:24:32.599278+0000","last_became_active":"2024-04-26T10:24:31.604744+0000","last_became_peered":"2024-04-26T10:24:31.604744+0000","last_unstale":"2024-04-26T10:24:32.599278+0000","last_undegraded":"2024-04-26T10:24:32.599278+0000","last_fullsized":"2024-04-26T10:24:32.599278+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:44.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.749706+0000","last_change":"2024-04-26T10:22:09.750173+0000","last_active":"2024-04-26T10:24:32.749706+0000","last_peered":"2024-04-26T10:24:32.749706+0000","last_clean":"2024-04-26T10:24:32.749706+0000","last_became_active":"2024-04-26T10:22:09.749862+0000","last_became_peered":"2024-04-26T10:22:09.749862+0000","last_unstale":"2024-04-26T10:24:32.749706+0000","last_undegraded":"2024-04-26T10:24:32.749706+0000","last_fullsized":"2024-04-26T10:24:32.749706+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:53.204364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":72,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744851+0000","last_change":"2024-04-26T10:22:09.750224+0000","last_active":"2024-04-26T10:24:32.744851+0000","last_peered":"2024-04-26T10:24:32.744851+0000","last_clean":"2024-04-26T10:24:32.744851+0000","last_became_active":"2024-04-26T10:22:09.749852+0000","last_became_peered":"2024-04-26T10:22:09.749852+0000","last_unstale":"2024-04-26T10:24:32.744851+0000","last_undegraded":"2024-04-26T10:24:32.744851+0000","last_fullsized":"2024-04-26T10:24:32.744851+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:44.923542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.180773+0000","last_change":"2024-04-26T10:24:31.597157+0000","last_active":"2024-04-26T10:24:33.180773+0000","last_peered":"2024-04-26T10:24:33.180773+0000","last_clean":"2024-04-26T10:24:33.180773+0000","last_became_active":"2024-04-26T10:24:31.596335+0000","last_became_peered":"2024-04-26T10:24:31.596335+0000","last_unstale":"2024-04-26T10:24:33.180773+0000","last_undegraded":"2024-04-26T10:24:33.180773+0000","last_fullsized":"2024-04-26T10:24:33.180773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:07.652892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":80,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.598951+0000","last_change":"2024-04-26T10:21:08.935133+0000","last_active":"2024-04-26T10:24:32.598951+0000","last_peered":"2024-04-26T10:24:32.598951+0000","last_clean":"2024-04-26T10:24:32.598951+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:24:32.598951+0000","last_undegraded":"2024-04-26T10:24:32.598951+0000","last_fullsized":"2024-04-26T10:24:32.598951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:25.498249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596919+0000","last_change":"2024-04-26T10:24:22.549411+0000","last_active":"2024-04-26T10:24:32.596919+0000","last_peered":"2024-04-26T10:24:32.596919+0000","last_clean":"2024-04-26T10:24:32.596919+0000","last_became_active":"2024-04-26T10:24:22.549230+0000","last_became_peered":"2024-04-26T10:24:22.549230+0000","last_unstale":"2024-04-26T10:24:32.596919+0000","last_undegraded":"2024-04-26T10:24:32.596919+0000","last_fullsized":"2024-04-26T10:24:32.596919+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:00.343304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.598250+0000","last_change":"2024-04-26T10:24:22.541409+0000","last_active":"2024-04-26T10:24:32.598250+0000","last_peered":"2024-04-26T10:24:32.598250+0000","last_clean":"2024-04-26T10:24:32.598250+0000","last_became_active":"2024-04-26T10:24:22.540611+0000","last_became_peered":"2024-04-26T10:24:22.540611+0000","last_unstale":"2024-04-26T10:24:32.598250+0000","last_undegraded":"2024-04-26T10:24:32.598250+0000","last_fullsized":"2024-04-26T10:24:32.598250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:48.882187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319142+0000","last_change":"2024-04-26T10:24:22.687178+0000","last_active":"2024-04-26T10:24:33.319142+0000","last_peered":"2024-04-26T10:24:33.319142+0000","last_clean":"2024-04-26T10:24:33.319142+0000","last_became_active":"2024-04-26T10:24:22.686841+0000","last_became_peered":"2024-04-26T10:24:22.686841+0000","last_unstale":"2024-04-26T10:24:33.319142+0000","last_undegraded":"2024-04-26T10:24:33.319142+0000","last_fullsized":"2024-04-26T10:24:33.319142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:52.907696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318078+0000","last_change":"2024-04-26T10:24:22.687183+0000","last_active":"2024-04-26T10:24:33.318078+0000","last_peered":"2024-04-26T10:24:33.318078+0000","last_clean":"2024-04-26T10:24:33.318078+0000","last_became_active":"2024-04-26T10:24:22.686846+0000","last_became_peered":"2024-04-26T10:24:22.686846+0000","last_unstale":"2024-04-26T10:24:33.318078+0000","last_undegraded":"2024-04-26T10:24:33.318078+0000","last_fullsized":"2024-04-26T10:24:33.318078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:37.083683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.598176+0000","last_change":"2024-04-26T10:24:22.546117+0000","last_active":"2024-04-26T10:24:32.598176+0000","last_peered":"2024-04-26T10:24:32.598176+0000","last_clean":"2024-04-26T10:24:32.598176+0000","last_became_active":"2024-04-26T10:24:22.545616+0000","last_became_peered":"2024-04-26T10:24:22.545616+0000","last_unstale":"2024-04-26T10:24:32.598176+0000","last_undegraded":"2024-04-26T10:24:32.598176+0000","last_fullsized":"2024-04-26T10:24:32.598176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:09.247826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597257+0000","last_change":"2024-04-26T10:24:22.540185+0000","last_active":"2024-04-26T10:24:32.597257+0000","last_peered":"2024-04-26T10:24:32.597257+0000","last_clean":"2024-04-26T10:24:32.597257+0000","last_became_active":"2024-04-26T10:24:22.538982+0000","last_became_peered":"2024-04-26T10:24:22.538982+0000","last_unstale":"2024-04-26T10:24:32.597257+0000","last_undegraded":"2024-04-26T10:24:32.597257+0000","last_fullsized":"2024-04-26T10:24:32.597257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:27.225284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":78,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.598908+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:24:32.598908+0000","last_peered":"2024-04-26T10:24:32.598908+0000","last_clean":"2024-04-26T10:24:32.598908+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:24:32.598908+0000","last_undegraded":"2024-04-26T10:24:32.598908+0000","last_fullsized":"2024-04-26T10:24:32.598908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":70,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.743499+0000","last_change":"2024-04-26T10:22:09.748616+0000","last_active":"2024-04-26T10:24:32.743499+0000","last_peered":"2024-04-26T10:24:32.743499+0000","last_clean":"2024-04-26T10:24:32.743499+0000","last_became_active":"2024-04-26T10:22:09.748256+0000","last_became_peered":"2024-04-26T10:22:09.748256+0000","last_unstale":"2024-04-26T10:24:32.743499+0000","last_undegraded":"2024-04-26T10:24:32.743499+0000","last_fullsized":"2024-04-26T10:24:32.743499+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:19.402647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597229+0000","last_change":"2024-04-26T10:24:31.604150+0000","last_active":"2024-04-26T10:24:32.597229+0000","last_peered":"2024-04-26T10:24:32.597229+0000","last_clean":"2024-04-26T10:24:32.597229+0000","last_became_active":"2024-04-26T10:24:31.603620+0000","last_became_peered":"2024-04-26T10:24:31.603620+0000","last_unstale":"2024-04-26T10:24:32.597229+0000","last_undegraded":"2024-04-26T10:24:32.597229+0000","last_fullsized":"2024-04-26T10:24:32.597229+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:17.085344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181993+0000","last_change":"2024-04-26T10:24:31.598521+0000","last_active":"2024-04-26T10:24:33.181993+0000","last_peered":"2024-04-26T10:24:33.181993+0000","last_clean":"2024-04-26T10:24:33.181993+0000","last_became_active":"2024-04-26T10:24:31.598120+0000","last_became_peered":"2024-04-26T10:24:31.598120+0000","last_unstale":"2024-04-26T10:24:33.181993+0000","last_undegraded":"2024-04-26T10:24:33.181993+0000","last_fullsized":"2024-04-26T10:24:33.181993+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:23.723355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319166+0000","last_change":"2024-04-26T10:24:22.680557+0000","last_active":"2024-04-26T10:24:33.319166+0000","last_peered":"2024-04-26T10:24:33.319166+0000","last_clean":"2024-04-26T10:24:33.319166+0000","last_became_active":"2024-04-26T10:24:22.679940+0000","last_became_peered":"2024-04-26T10:24:22.679940+0000","last_unstale":"2024-04-26T10:24:33.319166+0000","last_undegraded":"2024-04-26T10:24:33.319166+0000","last_fullsized":"2024-04-26T10:24:33.319166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:06.379234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":325,"reported_epoch":90,"state":"peering","last_fresh":"2024-04-26T10:24:33.174823+0000","last_change":"2024-04-26T10:24:33.175683+0000","last_active":"2024-04-26T10:24:33.174823+0000","last_peered":"2024-04-26T10:24:32.759338+0000","last_clean":"2024-04-26T10:24:29.608470+0000","last_became_active":"2024-04-26T10:24:32.749223+0000","last_became_peered":"2024-04-26T10:24:32.749223+0000","last_unstale":"2024-04-26T10:24:33.174823+0000","last_undegraded":"2024-04-26T10:24:33.174823+0000","last_fullsized":"2024-04-26T10:24:33.174823+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:07.600717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":95,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596699+0000","last_change":"2024-04-26T10:24:22.547708+0000","last_active":"2024-04-26T10:24:32.596699+0000","last_peered":"2024-04-26T10:24:32.596699+0000","last_clean":"2024-04-26T10:24:32.596699+0000","last_became_active":"2024-04-26T10:24:22.546650+0000","last_became_peered":"2024-04-26T10:24:22.546650+0000","last_unstale":"2024-04-26T10:24:32.596699+0000","last_undegraded":"2024-04-26T10:24:32.596699+0000","last_fullsized":"2024-04-26T10:24:32.596699+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:55.474931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317752+0000","last_change":"2024-04-26T10:24:22.676755+0000","last_active":"2024-04-26T10:24:33.317752+0000","last_peered":"2024-04-26T10:24:33.317752+0000","last_clean":"2024-04-26T10:24:33.317752+0000","last_became_active":"2024-04-26T10:24:22.676489+0000","last_became_peered":"2024-04-26T10:24:22.676489+0000","last_unstale":"2024-04-26T10:24:33.317752+0000","last_undegraded":"2024-04-26T10:24:33.317752+0000","last_fullsized":"2024-04-26T10:24:33.317752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:38.979532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599143+0000","last_change":"2024-04-26T10:24:31.603833+0000","last_active":"2024-04-26T10:24:32.599143+0000","last_peered":"2024-04-26T10:24:32.599143+0000","last_clean":"2024-04-26T10:24:32.599143+0000","last_became_active":"2024-04-26T10:24:31.603498+0000","last_became_peered":"2024-04-26T10:24:31.603498+0000","last_unstale":"2024-04-26T10:24:32.599143+0000","last_undegraded":"2024-04-26T10:24:32.599143+0000","last_fullsized":"2024-04-26T10:24:32.599143+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:58.952460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":108,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597168+0000","last_change":"2024-04-26T10:24:31.603067+0000","last_active":"2024-04-26T10:24:32.597168+0000","last_peered":"2024-04-26T10:24:32.597168+0000","last_clean":"2024-04-26T10:24:32.597168+0000","last_became_active":"2024-04-26T10:24:31.602611+0000","last_became_peered":"2024-04-26T10:24:31.602611+0000","last_unstale":"2024-04-26T10:24:32.597168+0000","last_undegraded":"2024-04-26T10:24:32.597168+0000","last_fullsized":"2024-04-26T10:24:32.597168+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:14.943135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316711+0000","last_change":"2024-04-26T10:24:22.685554+0000","last_active":"2024-04-26T10:24:33.316711+0000","last_peered":"2024-04-26T10:24:33.316711+0000","last_clean":"2024-04-26T10:24:33.316711+0000","last_became_active":"2024-04-26T10:24:22.685051+0000","last_became_peered":"2024-04-26T10:24:22.685051+0000","last_unstale":"2024-04-26T10:24:33.316711+0000","last_undegraded":"2024-04-26T10:24:33.316711+0000","last_fullsized":"2024-04-26T10:24:33.316711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:59.389895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":85,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744680+0000","last_change":"2024-04-26T10:24:22.538294+0000","last_active":"2024-04-26T10:24:32.744680+0000","last_peered":"2024-04-26T10:24:32.744680+0000","last_clean":"2024-04-26T10:24:32.744680+0000","last_became_active":"2024-04-26T10:24:22.537983+0000","last_became_peered":"2024-04-26T10:24:22.537983+0000","last_unstale":"2024-04-26T10:24:32.744680+0000","last_undegraded":"2024-04-26T10:24:32.744680+0000","last_fullsized":"2024-04-26T10:24:32.744680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:54.064158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317277+0000","last_change":"2024-04-26T10:24:22.679231+0000","last_active":"2024-04-26T10:24:33.317277+0000","last_peered":"2024-04-26T10:24:33.317277+0000","last_clean":"2024-04-26T10:24:33.317277+0000","last_became_active":"2024-04-26T10:24:22.678866+0000","last_became_peered":"2024-04-26T10:24:22.678866+0000","last_unstale":"2024-04-26T10:24:33.317277+0000","last_undegraded":"2024-04-26T10:24:33.317277+0000","last_fullsized":"2024-04-26T10:24:33.317277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:26.179423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":70,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.749762+0000","last_change":"2024-04-26T10:22:09.750297+0000","last_active":"2024-04-26T10:24:32.749762+0000","last_peered":"2024-04-26T10:24:32.749762+0000","last_clean":"2024-04-26T10:24:32.749762+0000","last_became_active":"2024-04-26T10:22:09.749935+0000","last_became_peered":"2024-04-26T10:22:09.749935+0000","last_unstale":"2024-04-26T10:24:32.749762+0000","last_undegraded":"2024-04-26T10:24:32.749762+0000","last_fullsized":"2024-04-26T10:24:32.749762+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:51.197306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319145+0000","last_change":"2024-04-26T10:24:31.745820+0000","last_active":"2024-04-26T10:24:33.319145+0000","last_peered":"2024-04-26T10:24:33.319145+0000","last_clean":"2024-04-26T10:24:33.319145+0000","last_became_active":"2024-04-26T10:24:31.745487+0000","last_became_peered":"2024-04-26T10:24:31.745487+0000","last_unstale":"2024-04-26T10:24:33.319145+0000","last_undegraded":"2024-04-26T10:24:33.319145+0000","last_fullsized":"2024-04-26T10:24:33.319145+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:00.239650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":95,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597357+0000","last_change":"2024-04-26T10:24:22.539761+0000","last_active":"2024-04-26T10:24:32.597357+0000","last_peered":"2024-04-26T10:24:32.597357+0000","last_clean":"2024-04-26T10:24:32.597357+0000","last_became_active":"2024-04-26T10:24:22.538993+0000","last_became_peered":"2024-04-26T10:24:22.538993+0000","last_unstale":"2024-04-26T10:24:32.597357+0000","last_undegraded":"2024-04-26T10:24:32.597357+0000","last_fullsized":"2024-04-26T10:24:32.597357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:24.782191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596822+0000","last_change":"2024-04-26T10:24:22.542774+0000","last_active":"2024-04-26T10:24:32.596822+0000","last_peered":"2024-04-26T10:24:32.596822+0000","last_clean":"2024-04-26T10:24:32.596822+0000","last_became_active":"2024-04-26T10:24:22.541795+0000","last_became_peered":"2024-04-26T10:24:22.541795+0000","last_unstale":"2024-04-26T10:24:32.596822+0000","last_undegraded":"2024-04-26T10:24:32.596822+0000","last_fullsized":"2024-04-26T10:24:32.596822+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:07.303056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317944+0000","last_change":"2024-04-26T10:24:31.744717+0000","last_active":"2024-04-26T10:24:33.317944+0000","last_peered":"2024-04-26T10:24:33.317944+0000","last_clean":"2024-04-26T10:24:33.317944+0000","last_became_active":"2024-04-26T10:24:31.744373+0000","last_became_peered":"2024-04-26T10:24:31.744373+0000","last_unstale":"2024-04-26T10:24:33.317944+0000","last_undegraded":"2024-04-26T10:24:33.317944+0000","last_fullsized":"2024-04-26T10:24:33.317944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:10.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597810+0000","last_change":"2024-04-26T10:24:22.538573+0000","last_active":"2024-04-26T10:24:32.597810+0000","last_peered":"2024-04-26T10:24:32.597810+0000","last_clean":"2024-04-26T10:24:32.597810+0000","last_became_active":"2024-04-26T10:24:22.537041+0000","last_became_peered":"2024-04-26T10:24:22.537041+0000","last_unstale":"2024-04-26T10:24:32.597810+0000","last_undegraded":"2024-04-26T10:24:32.597810+0000","last_fullsized":"2024-04-26T10:24:32.597810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:48.026637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318800+0000","last_change":"2024-04-26T10:24:31.744776+0000","last_active":"2024-04-26T10:24:33.318800+0000","last_peered":"2024-04-26T10:24:33.318800+0000","last_clean":"2024-04-26T10:24:33.318800+0000","last_became_active":"2024-04-26T10:24:31.744342+0000","last_became_peered":"2024-04-26T10:24:31.744342+0000","last_unstale":"2024-04-26T10:24:33.318800+0000","last_undegraded":"2024-04-26T10:24:33.318800+0000","last_fullsized":"2024-04-26T10:24:33.318800+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:08:33.941367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.180923+0000","last_change":"2024-04-26T10:24:31.599193+0000","last_active":"2024-04-26T10:24:33.180923+0000","last_peered":"2024-04-26T10:24:33.180923+0000","last_clean":"2024-04-26T10:24:33.180923+0000","last_became_active":"2024-04-26T10:24:31.598432+0000","last_became_peered":"2024-04-26T10:24:31.598432+0000","last_unstale":"2024-04-26T10:24:33.180923+0000","last_undegraded":"2024-04-26T10:24:33.180923+0000","last_fullsized":"2024-04-26T10:24:33.180923+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:41.515775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318555+0000","last_change":"2024-04-26T10:24:31.745336+0000","last_active":"2024-04-26T10:24:33.318555+0000","last_peered":"2024-04-26T10:24:33.318555+0000","last_clean":"2024-04-26T10:24:33.318555+0000","last_became_active":"2024-04-26T10:24:31.745004+0000","last_became_peered":"2024-04-26T10:24:31.745004+0000","last_unstale":"2024-04-26T10:24:33.318555+0000","last_undegraded":"2024-04-26T10:24:33.318555+0000","last_fullsized":"2024-04-26T10:24:33.318555+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:15.275549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183054+0000","last_change":"2024-04-26T10:24:31.601585+0000","last_active":"2024-04-26T10:24:33.183054+0000","last_peered":"2024-04-26T10:24:33.183054+0000","last_clean":"2024-04-26T10:24:33.183054+0000","last_became_active":"2024-04-26T10:24:31.600977+0000","last_became_peered":"2024-04-26T10:24:31.600977+0000","last_unstale":"2024-04-26T10:24:33.183054+0000","last_undegraded":"2024-04-26T10:24:33.183054+0000","last_fullsized":"2024-04-26T10:24:33.183054+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.329801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744310+0000","last_change":"2024-04-26T10:22:09.758116+0000","last_active":"2024-04-26T10:24:32.744310+0000","last_peered":"2024-04-26T10:24:32.744310+0000","last_clean":"2024-04-26T10:24:32.744310+0000","last_became_active":"2024-04-26T10:22:09.757813+0000","last_became_peered":"2024-04-26T10:22:09.757813+0000","last_unstale":"2024-04-26T10:24:32.744310+0000","last_undegraded":"2024-04-26T10:24:32.744310+0000","last_fullsized":"2024-04-26T10:24:32.744310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:01.195987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318177+0000","last_change":"2024-04-26T10:24:22.680137+0000","last_active":"2024-04-26T10:24:33.318177+0000","last_peered":"2024-04-26T10:24:33.318177+0000","last_clean":"2024-04-26T10:24:33.318177+0000","last_became_active":"2024-04-26T10:24:22.679497+0000","last_became_peered":"2024-04-26T10:24:22.679497+0000","last_unstale":"2024-04-26T10:24:33.318177+0000","last_undegraded":"2024-04-26T10:24:33.318177+0000","last_fullsized":"2024-04-26T10:24:33.318177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:00.401135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318093+0000","last_change":"2024-04-26T10:24:31.741102+0000","last_active":"2024-04-26T10:24:33.318093+0000","last_peered":"2024-04-26T10:24:33.318093+0000","last_clean":"2024-04-26T10:24:33.318093+0000","last_became_active":"2024-04-26T10:24:31.740589+0000","last_became_peered":"2024-04-26T10:24:31.740589+0000","last_unstale":"2024-04-26T10:24:33.318093+0000","last_undegraded":"2024-04-26T10:24:33.318093+0000","last_fullsized":"2024-04-26T10:24:33.318093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:38.170544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317410+0000","last_change":"2024-04-26T10:24:22.686404+0000","last_active":"2024-04-26T10:24:33.317410+0000","last_peered":"2024-04-26T10:24:33.317410+0000","last_clean":"2024-04-26T10:24:33.317410+0000","last_became_active":"2024-04-26T10:24:22.686094+0000","last_became_peered":"2024-04-26T10:24:22.686094+0000","last_unstale":"2024-04-26T10:24:33.317410+0000","last_undegraded":"2024-04-26T10:24:33.317410+0000","last_fullsized":"2024-04-26T10:24:33.317410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:37.911705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318296+0000","last_change":"2024-04-26T10:24:22.682344+0000","last_active":"2024-04-26T10:24:33.318296+0000","last_peered":"2024-04-26T10:24:33.318296+0000","last_clean":"2024-04-26T10:24:33.318296+0000","last_became_active":"2024-04-26T10:24:22.681977+0000","last_became_peered":"2024-04-26T10:24:22.681977+0000","last_unstale":"2024-04-26T10:24:33.318296+0000","last_undegraded":"2024-04-26T10:24:33.318296+0000","last_fullsized":"2024-04-26T10:24:33.318296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:56.544667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":108,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599518+0000","last_change":"2024-04-26T10:24:31.605320+0000","last_active":"2024-04-26T10:24:32.599518+0000","last_peered":"2024-04-26T10:24:32.599518+0000","last_clean":"2024-04-26T10:24:32.599518+0000","last_became_active":"2024-04-26T10:24:31.604158+0000","last_became_peered":"2024-04-26T10:24:31.604158+0000","last_unstale":"2024-04-26T10:24:32.599518+0000","last_undegraded":"2024-04-26T10:24:32.599518+0000","last_fullsized":"2024-04-26T10:24:32.599518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:53.955856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181706+0000","last_change":"2024-04-26T10:24:31.601291+0000","last_active":"2024-04-26T10:24:33.181706+0000","last_peered":"2024-04-26T10:24:33.181706+0000","last_clean":"2024-04-26T10:24:33.181706+0000","last_became_active":"2024-04-26T10:24:31.600474+0000","last_became_peered":"2024-04-26T10:24:31.600474+0000","last_unstale":"2024-04-26T10:24:33.181706+0000","last_undegraded":"2024-04-26T10:24:33.181706+0000","last_fullsized":"2024-04-26T10:24:33.181706+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:30.284416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597907+0000","last_change":"2024-04-26T10:24:31.604975+0000","last_active":"2024-04-26T10:24:32.597907+0000","last_peered":"2024-04-26T10:24:32.597907+0000","last_clean":"2024-04-26T10:24:32.597907+0000","last_became_active":"2024-04-26T10:24:31.604609+0000","last_became_peered":"2024-04-26T10:24:31.604609+0000","last_unstale":"2024-04-26T10:24:32.597907+0000","last_undegraded":"2024-04-26T10:24:32.597907+0000","last_fullsized":"2024-04-26T10:24:32.597907+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:04.412544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":131,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597647+0000","last_change":"2024-04-26T10:24:31.622111+0000","last_active":"2024-04-26T10:24:32.597647+0000","last_peered":"2024-04-26T10:24:32.597647+0000","last_clean":"2024-04-26T10:24:32.597647+0000","last_became_active":"2024-04-26T10:24:31.604884+0000","last_became_peered":"2024-04-26T10:24:31.604884+0000","last_unstale":"2024-04-26T10:24:32.597647+0000","last_undegraded":"2024-04-26T10:24:32.597647+0000","last_fullsized":"2024-04-26T10:24:32.597647+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:18.600081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317264+0000","last_change":"2024-04-26T10:24:31.739955+0000","last_active":"2024-04-26T10:24:33.317264+0000","last_peered":"2024-04-26T10:24:33.317264+0000","last_clean":"2024-04-26T10:24:33.317264+0000","last_became_active":"2024-04-26T10:24:31.739550+0000","last_became_peered":"2024-04-26T10:24:31.739550+0000","last_unstale":"2024-04-26T10:24:33.317264+0000","last_undegraded":"2024-04-26T10:24:33.317264+0000","last_fullsized":"2024-04-26T10:24:33.317264+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:31.253486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182681+0000","last_change":"2024-04-26T10:24:31.609788+0000","last_active":"2024-04-26T10:24:33.182681+0000","last_peered":"2024-04-26T10:24:33.182681+0000","last_clean":"2024-04-26T10:24:33.182681+0000","last_became_active":"2024-04-26T10:24:31.601218+0000","last_became_peered":"2024-04-26T10:24:31.601218+0000","last_unstale":"2024-04-26T10:24:33.182681+0000","last_undegraded":"2024-04-26T10:24:33.182681+0000","last_fullsized":"2024-04-26T10:24:33.182681+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:39.380483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597918+0000","last_change":"2024-04-26T10:24:22.546807+0000","last_active":"2024-04-26T10:24:32.597918+0000","last_peered":"2024-04-26T10:24:32.597918+0000","last_clean":"2024-04-26T10:24:32.597918+0000","last_became_active":"2024-04-26T10:24:22.546378+0000","last_became_peered":"2024-04-26T10:24:22.546378+0000","last_unstale":"2024-04-26T10:24:32.597918+0000","last_undegraded":"2024-04-26T10:24:32.597918+0000","last_fullsized":"2024-04-26T10:24:32.597918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:06.866157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317068+0000","last_change":"2024-04-26T10:24:22.684096+0000","last_active":"2024-04-26T10:24:33.317068+0000","last_peered":"2024-04-26T10:24:33.317068+0000","last_clean":"2024-04-26T10:24:33.317068+0000","last_became_active":"2024-04-26T10:24:22.683558+0000","last_became_peered":"2024-04-26T10:24:22.683558+0000","last_unstale":"2024-04-26T10:24:33.317068+0000","last_undegraded":"2024-04-26T10:24:33.317068+0000","last_fullsized":"2024-04-26T10:24:33.317068+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:05.316682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318841+0000","last_change":"2024-04-26T10:24:22.684541+0000","last_active":"2024-04-26T10:24:33.318841+0000","last_peered":"2024-04-26T10:24:33.318841+0000","last_clean":"2024-04-26T10:24:33.318841+0000","last_became_active":"2024-04-26T10:24:22.684166+0000","last_became_peered":"2024-04-26T10:24:22.684166+0000","last_unstale":"2024-04-26T10:24:33.318841+0000","last_undegraded":"2024-04-26T10:24:33.318841+0000","last_fullsized":"2024-04-26T10:24:33.318841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:30.164642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317049+0000","last_change":"2024-04-26T10:24:31.745539+0000","last_active":"2024-04-26T10:24:33.317049+0000","last_peered":"2024-04-26T10:24:33.317049+0000","last_clean":"2024-04-26T10:24:33.317049+0000","last_became_active":"2024-04-26T10:24:31.745216+0000","last_became_peered":"2024-04-26T10:24:31.745216+0000","last_unstale":"2024-04-26T10:24:33.317049+0000","last_undegraded":"2024-04-26T10:24:33.317049+0000","last_fullsized":"2024-04-26T10:24:33.317049+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:55.390023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.745094+0000","last_change":"2024-04-26T10:22:09.750605+0000","last_active":"2024-04-26T10:24:32.745094+0000","last_peered":"2024-04-26T10:24:32.745094+0000","last_clean":"2024-04-26T10:24:32.745094+0000","last_became_active":"2024-04-26T10:22:09.750359+0000","last_became_peered":"2024-04-26T10:22:09.750359+0000","last_unstale":"2024-04-26T10:24:32.745094+0000","last_undegraded":"2024-04-26T10:24:32.745094+0000","last_fullsized":"2024-04-26T10:24:32.745094+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:56.948741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316663+0000","last_change":"2024-04-26T10:24:31.740907+0000","last_active":"2024-04-26T10:24:33.316663+0000","last_peered":"2024-04-26T10:24:33.316663+0000","last_clean":"2024-04-26T10:24:33.316663+0000","last_became_active":"2024-04-26T10:24:31.740477+0000","last_became_peered":"2024-04-26T10:24:31.740477+0000","last_unstale":"2024-04-26T10:24:33.316663+0000","last_undegraded":"2024-04-26T10:24:33.316663+0000","last_fullsized":"2024-04-26T10:24:33.316663+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:30.206347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318888+0000","last_change":"2024-04-26T10:24:22.684108+0000","last_active":"2024-04-26T10:24:33.318888+0000","last_peered":"2024-04-26T10:24:33.318888+0000","last_clean":"2024-04-26T10:24:33.318888+0000","last_became_active":"2024-04-26T10:24:22.683501+0000","last_became_peered":"2024-04-26T10:24:22.683501+0000","last_unstale":"2024-04-26T10:24:33.318888+0000","last_undegraded":"2024-04-26T10:24:33.318888+0000","last_fullsized":"2024-04-26T10:24:33.318888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:17.355758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316745+0000","last_change":"2024-04-26T10:24:22.685228+0000","last_active":"2024-04-26T10:24:33.316745+0000","last_peered":"2024-04-26T10:24:33.316745+0000","last_clean":"2024-04-26T10:24:33.316745+0000","last_became_active":"2024-04-26T10:24:22.684469+0000","last_became_peered":"2024-04-26T10:24:22.684469+0000","last_unstale":"2024-04-26T10:24:33.316745+0000","last_undegraded":"2024-04-26T10:24:33.316745+0000","last_fullsized":"2024-04-26T10:24:33.316745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:53.834583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744530+0000","last_change":"2024-04-26T10:22:09.753136+0000","last_active":"2024-04-26T10:24:32.744530+0000","last_peered":"2024-04-26T10:24:32.744530+0000","last_clean":"2024-04-26T10:24:32.744530+0000","last_became_active":"2024-04-26T10:22:09.752856+0000","last_became_peered":"2024-04-26T10:22:09.752856+0000","last_unstale":"2024-04-26T10:24:32.744530+0000","last_undegraded":"2024-04-26T10:24:32.744530+0000","last_fullsized":"2024-04-26T10:24:32.744530+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:48.541930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":87,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.743929+0000","last_change":"2024-04-26T10:24:22.535413+0000","last_active":"2024-04-26T10:24:32.743929+0000","last_peered":"2024-04-26T10:24:32.743929+0000","last_clean":"2024-04-26T10:24:32.743929+0000","last_became_active":"2024-04-26T10:24:22.535036+0000","last_became_peered":"2024-04-26T10:24:22.535036+0000","last_unstale":"2024-04-26T10:24:32.743929+0000","last_undegraded":"2024-04-26T10:24:32.743929+0000","last_fullsized":"2024-04-26T10:24:32.743929+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:43.756504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":85,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744946+0000","last_change":"2024-04-26T10:24:22.535819+0000","last_active":"2024-04-26T10:24:32.744946+0000","last_peered":"2024-04-26T10:24:32.744946+0000","last_clean":"2024-04-26T10:24:32.744946+0000","last_became_active":"2024-04-26T10:24:22.535562+0000","last_became_peered":"2024-04-26T10:24:22.535562+0000","last_unstale":"2024-04-26T10:24:32.744946+0000","last_undegraded":"2024-04-26T10:24:32.744946+0000","last_fullsized":"2024-04-26T10:24:32.744946+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:24.845621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181500+0000","last_change":"2024-04-26T10:24:31.600594+0000","last_active":"2024-04-26T10:24:33.181500+0000","last_peered":"2024-04-26T10:24:33.181500+0000","last_clean":"2024-04-26T10:24:33.181500+0000","last_became_active":"2024-04-26T10:24:31.600121+0000","last_became_peered":"2024-04-26T10:24:31.600121+0000","last_unstale":"2024-04-26T10:24:33.181500+0000","last_undegraded":"2024-04-26T10:24:33.181500+0000","last_fullsized":"2024-04-26T10:24:33.181500+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:05.491069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.598128+0000","last_change":"2024-04-26T10:24:22.542755+0000","last_active":"2024-04-26T10:24:32.598128+0000","last_peered":"2024-04-26T10:24:32.598128+0000","last_clean":"2024-04-26T10:24:32.598128+0000","last_became_active":"2024-04-26T10:24:22.541543+0000","last_became_peered":"2024-04-26T10:24:22.541543+0000","last_unstale":"2024-04-26T10:24:32.598128+0000","last_undegraded":"2024-04-26T10:24:32.598128+0000","last_fullsized":"2024-04-26T10:24:32.598128+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:50.942528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":94,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597902+0000","last_change":"2024-04-26T10:24:22.541418+0000","last_active":"2024-04-26T10:24:32.597902+0000","last_peered":"2024-04-26T10:24:32.597902+0000","last_clean":"2024-04-26T10:24:32.597902+0000","last_became_active":"2024-04-26T10:24:22.540767+0000","last_became_peered":"2024-04-26T10:24:22.540767+0000","last_unstale":"2024-04-26T10:24:32.597902+0000","last_undegraded":"2024-04-26T10:24:32.597902+0000","last_fullsized":"2024-04-26T10:24:32.597902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:26.684306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597124+0000","last_change":"2024-04-26T10:24:22.547294+0000","last_active":"2024-04-26T10:24:32.597124+0000","last_peered":"2024-04-26T10:24:32.597124+0000","last_clean":"2024-04-26T10:24:32.597124+0000","last_became_active":"2024-04-26T10:24:22.546811+0000","last_became_peered":"2024-04-26T10:24:22.546811+0000","last_unstale":"2024-04-26T10:24:32.597124+0000","last_undegraded":"2024-04-26T10:24:32.597124+0000","last_fullsized":"2024-04-26T10:24:32.597124+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:03.037283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":72,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744948+0000","last_change":"2024-04-26T10:22:09.753438+0000","last_active":"2024-04-26T10:24:32.744948+0000","last_peered":"2024-04-26T10:24:32.744948+0000","last_clean":"2024-04-26T10:24:32.744948+0000","last_became_active":"2024-04-26T10:22:09.753211+0000","last_became_peered":"2024-04-26T10:22:09.753211+0000","last_unstale":"2024-04-26T10:24:32.744948+0000","last_undegraded":"2024-04-26T10:24:32.744948+0000","last_fullsized":"2024-04-26T10:24:32.744948+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:39.406859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181346+0000","last_change":"2024-04-26T10:24:31.600935+0000","last_active":"2024-04-26T10:24:33.181346+0000","last_peered":"2024-04-26T10:24:33.181346+0000","last_clean":"2024-04-26T10:24:33.181346+0000","last_became_active":"2024-04-26T10:24:31.600088+0000","last_became_peered":"2024-04-26T10:24:31.600088+0000","last_unstale":"2024-04-26T10:24:33.181346+0000","last_undegraded":"2024-04-26T10:24:33.181346+0000","last_fullsized":"2024-04-26T10:24:33.181346+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:58.341684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319737+0000","last_change":"2024-04-26T10:24:22.680082+0000","last_active":"2024-04-26T10:24:33.319737+0000","last_peered":"2024-04-26T10:24:33.319737+0000","last_clean":"2024-04-26T10:24:33.319737+0000","last_became_active":"2024-04-26T10:24:22.679652+0000","last_became_peered":"2024-04-26T10:24:22.679652+0000","last_unstale":"2024-04-26T10:24:33.319737+0000","last_undegraded":"2024-04-26T10:24:33.319737+0000","last_fullsized":"2024-04-26T10:24:33.319737+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:37.821623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596041+0000","last_change":"2024-04-26T10:24:22.540326+0000","last_active":"2024-04-26T10:24:32.596041+0000","last_peered":"2024-04-26T10:24:32.596041+0000","last_clean":"2024-04-26T10:24:32.596041+0000","last_became_active":"2024-04-26T10:24:22.538895+0000","last_became_peered":"2024-04-26T10:24:22.538895+0000","last_unstale":"2024-04-26T10:24:32.596041+0000","last_undegraded":"2024-04-26T10:24:32.596041+0000","last_fullsized":"2024-04-26T10:24:32.596041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:29.709972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319358+0000","last_change":"2024-04-26T10:24:22.685454+0000","last_active":"2024-04-26T10:24:33.319358+0000","last_peered":"2024-04-26T10:24:33.319358+0000","last_clean":"2024-04-26T10:24:33.319358+0000","last_became_active":"2024-04-26T10:24:22.684863+0000","last_became_peered":"2024-04-26T10:24:22.684863+0000","last_unstale":"2024-04-26T10:24:33.319358+0000","last_undegraded":"2024-04-26T10:24:33.319358+0000","last_fullsized":"2024-04-26T10:24:33.319358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:33.027447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":21541,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673008,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279064,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":278014,"kb_avail":94092776,"statfs":{"total":96636764160,"available":96351002624,"internally_reserved":0,"allocated":1056768,"data_stored":1031439,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":284686790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:24:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55000000000000004,"15min":0.51600000000000001},"min":{"1min":0.25800000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.67500000000000004,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.53900000000000003},"min":{"1min":0.28000000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.754,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":0,"up_from":10,"seq":42949673007,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487460,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":486398,"kb_avail":93884380,"statfs":{"total":96636764160,"available":96137605120,"internally_reserved":0,"allocated":1073152,"data_stored":1027794,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":498072006},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:24:04 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.65600000000000003,"15min":0.56599999999999995},"min":{"1min":0.21099999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":4.1369999999999996,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.25900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.748,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":2,"up_from":80,"seq":343597383685,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38380,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":37369,"kb_avail":94333460,"statfs":{"total":96636764160,"available":96597463040,"internally_reserved":0,"allocated":1007616,"data_stored":444173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6879,"internal_metadata":38266145},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:24:36.088 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:24:36.413 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:24:36.415 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:24:36.429 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2024-04-26T10:24:36.041254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1184088,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":804904,"kb_used_data":3064,"kb_used_omap":9,"kb_used_meta":801782,"kb_avail":282310616,"statfs":{"total":289910292480,"available":289086070784,"internally_reserved":0,"allocated":3137536,"data_stored":2503406,"data_compressed":14075,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":10067,"internal_metadata":821024941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":592044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.458837"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183068+0000","last_change":"2024-04-26T10:24:31.598789+0000","last_active":"2024-04-26T10:24:33.183068+0000","last_peered":"2024-04-26T10:24:33.183068+0000","last_clean":"2024-04-26T10:24:33.183068+0000","last_became_active":"2024-04-26T10:24:31.598170+0000","last_became_peered":"2024-04-26T10:24:31.598170+0000","last_unstale":"2024-04-26T10:24:33.183068+0000","last_undegraded":"2024-04-26T10:24:33.183068+0000","last_fullsized":"2024-04-26T10:24:33.183068+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:46.718423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":85,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744370+0000","last_change":"2024-04-26T10:24:22.536264+0000","last_active":"2024-04-26T10:24:32.744370+0000","last_peered":"2024-04-26T10:24:32.744370+0000","last_clean":"2024-04-26T10:24:32.744370+0000","last_became_active":"2024-04-26T10:24:22.535998+0000","last_became_peered":"2024-04-26T10:24:22.535998+0000","last_unstale":"2024-04-26T10:24:32.744370+0000","last_undegraded":"2024-04-26T10:24:32.744370+0000","last_fullsized":"2024-04-26T10:24:32.744370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:54.491369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":78,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599563+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:24:32.599563+0000","last_peered":"2024-04-26T10:24:32.599563+0000","last_clean":"2024-04-26T10:24:32.599563+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:24:32.599563+0000","last_undegraded":"2024-04-26T10:24:32.599563+0000","last_fullsized":"2024-04-26T10:24:32.599563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:01.883964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599310+0000","last_change":"2024-04-26T10:24:22.549067+0000","last_active":"2024-04-26T10:24:32.599310+0000","last_peered":"2024-04-26T10:24:32.599310+0000","last_clean":"2024-04-26T10:24:32.599310+0000","last_became_active":"2024-04-26T10:24:22.548485+0000","last_became_peered":"2024-04-26T10:24:22.548485+0000","last_unstale":"2024-04-26T10:24:32.599310+0000","last_undegraded":"2024-04-26T10:24:32.599310+0000","last_fullsized":"2024-04-26T10:24:32.599310+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:19.263146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181618+0000","last_change":"2024-04-26T10:24:31.601925+0000","last_active":"2024-04-26T10:24:33.181618+0000","last_peered":"2024-04-26T10:24:33.181618+0000","last_clean":"2024-04-26T10:24:33.181618+0000","last_became_active":"2024-04-26T10:24:31.600986+0000","last_became_peered":"2024-04-26T10:24:31.600986+0000","last_unstale":"2024-04-26T10:24:33.181618+0000","last_undegraded":"2024-04-26T10:24:33.181618+0000","last_fullsized":"2024-04-26T10:24:33.181618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:52.125249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596629+0000","last_change":"2024-04-26T10:24:22.548245+0000","last_active":"2024-04-26T10:24:32.596629+0000","last_peered":"2024-04-26T10:24:32.596629+0000","last_clean":"2024-04-26T10:24:32.596629+0000","last_became_active":"2024-04-26T10:24:22.547731+0000","last_became_peered":"2024-04-26T10:24:22.547731+0000","last_unstale":"2024-04-26T10:24:32.596629+0000","last_undegraded":"2024-04-26T10:24:32.596629+0000","last_fullsized":"2024-04-26T10:24:32.596629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:52.538672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597733+0000","last_change":"2024-04-26T10:24:22.549424+0000","last_active":"2024-04-26T10:24:32.597733+0000","last_peered":"2024-04-26T10:24:32.597733+0000","last_clean":"2024-04-26T10:24:32.597733+0000","last_became_active":"2024-04-26T10:24:22.549180+0000","last_became_peered":"2024-04-26T10:24:22.549180+0000","last_unstale":"2024-04-26T10:24:32.597733+0000","last_undegraded":"2024-04-26T10:24:32.597733+0000","last_fullsized":"2024-04-26T10:24:32.597733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.915633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597437+0000","last_change":"2024-04-26T10:24:22.547840+0000","last_active":"2024-04-26T10:24:32.597437+0000","last_peered":"2024-04-26T10:24:32.597437+0000","last_clean":"2024-04-26T10:24:32.597437+0000","last_became_active":"2024-04-26T10:24:22.547284+0000","last_became_peered":"2024-04-26T10:24:22.547284+0000","last_unstale":"2024-04-26T10:24:32.597437+0000","last_undegraded":"2024-04-26T10:24:32.597437+0000","last_fullsized":"2024-04-26T10:24:32.597437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:09.731025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318637+0000","last_change":"2024-04-26T10:24:22.680232+0000","last_active":"2024-04-26T10:24:33.318637+0000","last_peered":"2024-04-26T10:24:33.318637+0000","last_clean":"2024-04-26T10:24:33.318637+0000","last_became_active":"2024-04-26T10:24:22.679648+0000","last_became_peered":"2024-04-26T10:24:22.679648+0000","last_unstale":"2024-04-26T10:24:33.318637+0000","last_undegraded":"2024-04-26T10:24:33.318637+0000","last_fullsized":"2024-04-26T10:24:33.318637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:58.174215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182358+0000","last_change":"2024-04-26T10:24:31.599182+0000","last_active":"2024-04-26T10:24:33.182358+0000","last_peered":"2024-04-26T10:24:33.182358+0000","last_clean":"2024-04-26T10:24:33.182358+0000","last_became_active":"2024-04-26T10:24:31.598187+0000","last_became_peered":"2024-04-26T10:24:31.598187+0000","last_unstale":"2024-04-26T10:24:33.182358+0000","last_undegraded":"2024-04-26T10:24:33.182358+0000","last_fullsized":"2024-04-26T10:24:33.182358+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:24.255353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599420+0000","last_change":"2024-04-26T10:24:22.547601+0000","last_active":"2024-04-26T10:24:32.599420+0000","last_peered":"2024-04-26T10:24:32.599420+0000","last_clean":"2024-04-26T10:24:32.599420+0000","last_became_active":"2024-04-26T10:24:22.546506+0000","last_became_peered":"2024-04-26T10:24:22.546506+0000","last_unstale":"2024-04-26T10:24:32.599420+0000","last_undegraded":"2024-04-26T10:24:32.599420+0000","last_fullsized":"2024-04-26T10:24:32.599420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:21.263835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.745021+0000","last_change":"2024-04-26T10:22:09.748232+0000","last_active":"2024-04-26T10:24:32.745021+0000","last_peered":"2024-04-26T10:24:32.745021+0000","last_clean":"2024-04-26T10:24:32.745021+0000","last_became_active":"2024-04-26T10:22:09.747822+0000","last_became_peered":"2024-04-26T10:22:09.747822+0000","last_unstale":"2024-04-26T10:24:32.745021+0000","last_undegraded":"2024-04-26T10:24:32.745021+0000","last_fullsized":"2024-04-26T10:24:32.745021+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.223031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181391+0000","last_change":"2024-04-26T10:24:31.598330+0000","last_active":"2024-04-26T10:24:33.181391+0000","last_peered":"2024-04-26T10:24:33.181391+0000","last_clean":"2024-04-26T10:24:33.181391+0000","last_became_active":"2024-04-26T10:24:31.597980+0000","last_became_peered":"2024-04-26T10:24:31.597980+0000","last_unstale":"2024-04-26T10:24:33.181391+0000","last_undegraded":"2024-04-26T10:24:33.181391+0000","last_fullsized":"2024-04-26T10:24:33.181391+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:38.711968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596786+0000","last_change":"2024-04-26T10:24:31.602827+0000","last_active":"2024-04-26T10:24:32.596786+0000","last_peered":"2024-04-26T10:24:32.596786+0000","last_clean":"2024-04-26T10:24:32.596786+0000","last_became_active":"2024-04-26T10:24:31.602539+0000","last_became_peered":"2024-04-26T10:24:31.602539+0000","last_unstale":"2024-04-26T10:24:32.596786+0000","last_undegraded":"2024-04-26T10:24:32.596786+0000","last_fullsized":"2024-04-26T10:24:32.596786+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:45.294898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596427+0000","last_change":"2024-04-26T10:24:31.602863+0000","last_active":"2024-04-26T10:24:32.596427+0000","last_peered":"2024-04-26T10:24:32.596427+0000","last_clean":"2024-04-26T10:24:32.596427+0000","last_became_active":"2024-04-26T10:24:31.602453+0000","last_became_peered":"2024-04-26T10:24:31.602453+0000","last_unstale":"2024-04-26T10:24:32.596427+0000","last_undegraded":"2024-04-26T10:24:32.596427+0000","last_fullsized":"2024-04-26T10:24:32.596427+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:51.661774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596948+0000","last_change":"2024-04-26T10:24:22.547543+0000","last_active":"2024-04-26T10:24:32.596948+0000","last_peered":"2024-04-26T10:24:32.596948+0000","last_clean":"2024-04-26T10:24:32.596948+0000","last_became_active":"2024-04-26T10:24:22.546856+0000","last_became_peered":"2024-04-26T10:24:22.546856+0000","last_unstale":"2024-04-26T10:24:32.596948+0000","last_undegraded":"2024-04-26T10:24:32.596948+0000","last_fullsized":"2024-04-26T10:24:32.596948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:34.240590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318406+0000","last_change":"2024-04-26T10:24:22.679885+0000","last_active":"2024-04-26T10:24:33.318406+0000","last_peered":"2024-04-26T10:24:33.318406+0000","last_clean":"2024-04-26T10:24:33.318406+0000","last_became_active":"2024-04-26T10:24:22.679350+0000","last_became_peered":"2024-04-26T10:24:22.679350+0000","last_unstale":"2024-04-26T10:24:33.318406+0000","last_undegraded":"2024-04-26T10:24:33.318406+0000","last_fullsized":"2024-04-26T10:24:33.318406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:06.039983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182466+0000","last_change":"2024-04-26T10:24:31.598857+0000","last_active":"2024-04-26T10:24:33.182466+0000","last_peered":"2024-04-26T10:24:33.182466+0000","last_clean":"2024-04-26T10:24:33.182466+0000","last_became_active":"2024-04-26T10:24:31.597563+0000","last_became_peered":"2024-04-26T10:24:31.597563+0000","last_unstale":"2024-04-26T10:24:33.182466+0000","last_undegraded":"2024-04-26T10:24:33.182466+0000","last_fullsized":"2024-04-26T10:24:33.182466+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:26.624180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317832+0000","last_change":"2024-04-26T10:24:22.679291+0000","last_active":"2024-04-26T10:24:33.317832+0000","last_peered":"2024-04-26T10:24:33.317832+0000","last_clean":"2024-04-26T10:24:33.317832+0000","last_became_active":"2024-04-26T10:24:22.678912+0000","last_became_peered":"2024-04-26T10:24:22.678912+0000","last_unstale":"2024-04-26T10:24:33.317832+0000","last_undegraded":"2024-04-26T10:24:33.317832+0000","last_fullsized":"2024-04-26T10:24:33.317832+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:49.260130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.598414+0000","last_change":"2024-04-26T10:24:22.546669+0000","last_active":"2024-04-26T10:24:32.598414+0000","last_peered":"2024-04-26T10:24:32.598414+0000","last_clean":"2024-04-26T10:24:32.598414+0000","last_became_active":"2024-04-26T10:24:22.546052+0000","last_became_peered":"2024-04-26T10:24:22.546052+0000","last_unstale":"2024-04-26T10:24:32.598414+0000","last_undegraded":"2024-04-26T10:24:32.598414+0000","last_fullsized":"2024-04-26T10:24:32.598414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:26.334069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597042+0000","last_change":"2024-04-26T10:24:22.547981+0000","last_active":"2024-04-26T10:24:32.597042+0000","last_peered":"2024-04-26T10:24:32.597042+0000","last_clean":"2024-04-26T10:24:32.597042+0000","last_became_active":"2024-04-26T10:24:22.547663+0000","last_became_peered":"2024-04-26T10:24:22.547663+0000","last_unstale":"2024-04-26T10:24:32.597042+0000","last_undegraded":"2024-04-26T10:24:32.597042+0000","last_fullsized":"2024-04-26T10:24:32.597042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:07.105037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.743605+0000","last_change":"2024-04-26T10:22:09.749283+0000","last_active":"2024-04-26T10:24:32.743605+0000","last_peered":"2024-04-26T10:24:32.743605+0000","last_clean":"2024-04-26T10:24:32.743605+0000","last_became_active":"2024-04-26T10:22:09.748755+0000","last_became_peered":"2024-04-26T10:22:09.748755+0000","last_unstale":"2024-04-26T10:24:32.743605+0000","last_undegraded":"2024-04-26T10:24:32.743605+0000","last_fullsized":"2024-04-26T10:24:32.743605+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:40.910715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317029+0000","last_change":"2024-04-26T10:24:22.684668+0000","last_active":"2024-04-26T10:24:33.317029+0000","last_peered":"2024-04-26T10:24:33.317029+0000","last_clean":"2024-04-26T10:24:33.317029+0000","last_became_active":"2024-04-26T10:24:22.683921+0000","last_became_peered":"2024-04-26T10:24:22.683921+0000","last_unstale":"2024-04-26T10:24:33.317029+0000","last_undegraded":"2024-04-26T10:24:33.317029+0000","last_fullsized":"2024-04-26T10:24:33.317029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.930781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":85,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.749646+0000","last_change":"2024-04-26T10:24:22.535052+0000","last_active":"2024-04-26T10:24:32.749646+0000","last_peered":"2024-04-26T10:24:32.749646+0000","last_clean":"2024-04-26T10:24:32.749646+0000","last_became_active":"2024-04-26T10:24:22.534674+0000","last_became_peered":"2024-04-26T10:24:22.534674+0000","last_unstale":"2024-04-26T10:24:32.749646+0000","last_undegraded":"2024-04-26T10:24:32.749646+0000","last_fullsized":"2024-04-26T10:24:32.749646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:10.969425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183059+0000","last_change":"2024-04-26T10:24:31.601262+0000","last_active":"2024-04-26T10:24:33.183059+0000","last_peered":"2024-04-26T10:24:33.183059+0000","last_clean":"2024-04-26T10:24:33.183059+0000","last_became_active":"2024-04-26T10:24:31.600815+0000","last_became_peered":"2024-04-26T10:24:31.600815+0000","last_unstale":"2024-04-26T10:24:33.183059+0000","last_undegraded":"2024-04-26T10:24:33.183059+0000","last_fullsized":"2024-04-26T10:24:33.183059+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:02.552727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319258+0000","last_change":"2024-04-26T10:24:22.684739+0000","last_active":"2024-04-26T10:24:33.319258+0000","last_peered":"2024-04-26T10:24:33.319258+0000","last_clean":"2024-04-26T10:24:33.319258+0000","last_became_active":"2024-04-26T10:24:22.683959+0000","last_became_peered":"2024-04-26T10:24:22.683959+0000","last_unstale":"2024-04-26T10:24:33.319258+0000","last_undegraded":"2024-04-26T10:24:33.319258+0000","last_fullsized":"2024-04-26T10:24:33.319258+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:07.840236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":78,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599362+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:24:32.599362+0000","last_peered":"2024-04-26T10:24:32.599362+0000","last_clean":"2024-04-26T10:24:32.599362+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:24:32.599362+0000","last_undegraded":"2024-04-26T10:24:32.599362+0000","last_fullsized":"2024-04-26T10:24:32.599362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:39.394937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182858+0000","last_change":"2024-04-26T10:24:31.602078+0000","last_active":"2024-04-26T10:24:33.182858+0000","last_peered":"2024-04-26T10:24:33.182858+0000","last_clean":"2024-04-26T10:24:33.182858+0000","last_became_active":"2024-04-26T10:24:31.601299+0000","last_became_peered":"2024-04-26T10:24:31.601299+0000","last_unstale":"2024-04-26T10:24:33.182858+0000","last_undegraded":"2024-04-26T10:24:33.182858+0000","last_fullsized":"2024-04-26T10:24:33.182858+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:43.374493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317271+0000","last_change":"2024-04-26T10:24:31.741152+0000","last_active":"2024-04-26T10:24:33.317271+0000","last_peered":"2024-04-26T10:24:33.317271+0000","last_clean":"2024-04-26T10:24:33.317271+0000","last_became_active":"2024-04-26T10:24:31.740626+0000","last_became_peered":"2024-04-26T10:24:31.740626+0000","last_unstale":"2024-04-26T10:24:33.317271+0000","last_undegraded":"2024-04-26T10:24:33.317271+0000","last_fullsized":"2024-04-26T10:24:33.317271+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:23.323149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.743742+0000","last_change":"2024-04-26T10:22:09.750562+0000","last_active":"2024-04-26T10:24:32.743742+0000","last_peered":"2024-04-26T10:24:32.743742+0000","last_clean":"2024-04-26T10:24:32.743742+0000","last_became_active":"2024-04-26T10:22:09.750286+0000","last_became_peered":"2024-04-26T10:22:09.750286+0000","last_unstale":"2024-04-26T10:24:32.743742+0000","last_undegraded":"2024-04-26T10:24:32.743742+0000","last_fullsized":"2024-04-26T10:24:32.743742+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:52.795517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317979+0000","last_change":"2024-04-26T10:24:31.741008+0000","last_active":"2024-04-26T10:24:33.317979+0000","last_peered":"2024-04-26T10:24:33.317979+0000","last_clean":"2024-04-26T10:24:33.317979+0000","last_became_active":"2024-04-26T10:24:31.740518+0000","last_became_peered":"2024-04-26T10:24:31.740518+0000","last_unstale":"2024-04-26T10:24:33.317979+0000","last_undegraded":"2024-04-26T10:24:33.317979+0000","last_fullsized":"2024-04-26T10:24:33.317979+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:11:59.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596725+0000","last_change":"2024-04-26T10:24:22.540161+0000","last_active":"2024-04-26T10:24:32.596725+0000","last_peered":"2024-04-26T10:24:32.596725+0000","last_clean":"2024-04-26T10:24:32.596725+0000","last_became_active":"2024-04-26T10:24:22.539106+0000","last_became_peered":"2024-04-26T10:24:22.539106+0000","last_unstale":"2024-04-26T10:24:32.596725+0000","last_undegraded":"2024-04-26T10:24:32.596725+0000","last_fullsized":"2024-04-26T10:24:32.596725+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:09.208422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182259+0000","last_change":"2024-04-26T10:24:31.599487+0000","last_active":"2024-04-26T10:24:33.182259+0000","last_peered":"2024-04-26T10:24:33.182259+0000","last_clean":"2024-04-26T10:24:33.182259+0000","last_became_active":"2024-04-26T10:24:31.598307+0000","last_became_peered":"2024-04-26T10:24:31.598307+0000","last_unstale":"2024-04-26T10:24:33.182259+0000","last_undegraded":"2024-04-26T10:24:33.182259+0000","last_fullsized":"2024-04-26T10:24:33.182259+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:11.881961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":94,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596974+0000","last_change":"2024-04-26T10:24:22.547974+0000","last_active":"2024-04-26T10:24:32.596974+0000","last_peered":"2024-04-26T10:24:32.596974+0000","last_clean":"2024-04-26T10:24:32.596974+0000","last_became_active":"2024-04-26T10:24:22.546794+0000","last_became_peered":"2024-04-26T10:24:22.546794+0000","last_unstale":"2024-04-26T10:24:32.596974+0000","last_undegraded":"2024-04-26T10:24:32.596974+0000","last_fullsized":"2024-04-26T10:24:32.596974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:28.897600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182230+0000","last_change":"2024-04-26T10:24:31.597848+0000","last_active":"2024-04-26T10:24:33.182230+0000","last_peered":"2024-04-26T10:24:33.182230+0000","last_clean":"2024-04-26T10:24:33.182230+0000","last_became_active":"2024-04-26T10:24:31.596297+0000","last_became_peered":"2024-04-26T10:24:31.596297+0000","last_unstale":"2024-04-26T10:24:33.182230+0000","last_undegraded":"2024-04-26T10:24:33.182230+0000","last_fullsized":"2024-04-26T10:24:33.182230+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:09.585450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317333+0000","last_change":"2024-04-26T10:24:22.684913+0000","last_active":"2024-04-26T10:24:33.317333+0000","last_peered":"2024-04-26T10:24:33.317333+0000","last_clean":"2024-04-26T10:24:33.317333+0000","last_became_active":"2024-04-26T10:24:22.684541+0000","last_became_peered":"2024-04-26T10:24:22.684541+0000","last_unstale":"2024-04-26T10:24:33.317333+0000","last_undegraded":"2024-04-26T10:24:33.317333+0000","last_fullsized":"2024-04-26T10:24:33.317333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:32.802131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318520+0000","last_change":"2024-04-26T10:24:22.683787+0000","last_active":"2024-04-26T10:24:33.318520+0000","last_peered":"2024-04-26T10:24:33.318520+0000","last_clean":"2024-04-26T10:24:33.318520+0000","last_became_active":"2024-04-26T10:24:22.682650+0000","last_became_peered":"2024-04-26T10:24:22.682650+0000","last_unstale":"2024-04-26T10:24:33.318520+0000","last_undegraded":"2024-04-26T10:24:33.318520+0000","last_fullsized":"2024-04-26T10:24:33.318520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:29.301512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.180845+0000","last_change":"2024-04-26T10:24:31.601959+0000","last_active":"2024-04-26T10:24:33.180845+0000","last_peered":"2024-04-26T10:24:33.180845+0000","last_clean":"2024-04-26T10:24:33.180845+0000","last_became_active":"2024-04-26T10:24:31.601091+0000","last_became_peered":"2024-04-26T10:24:31.601091+0000","last_unstale":"2024-04-26T10:24:33.180845+0000","last_undegraded":"2024-04-26T10:24:33.180845+0000","last_fullsized":"2024-04-26T10:24:33.180845+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:46.182880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318431+0000","last_change":"2024-04-26T10:24:22.684603+0000","last_active":"2024-04-26T10:24:33.318431+0000","last_peered":"2024-04-26T10:24:33.318431+0000","last_clean":"2024-04-26T10:24:33.318431+0000","last_became_active":"2024-04-26T10:24:22.684213+0000","last_became_peered":"2024-04-26T10:24:22.684213+0000","last_unstale":"2024-04-26T10:24:33.318431+0000","last_undegraded":"2024-04-26T10:24:33.318431+0000","last_fullsized":"2024-04-26T10:24:33.318431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:41.006428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596275+0000","last_change":"2024-04-26T10:24:31.613086+0000","last_active":"2024-04-26T10:24:32.596275+0000","last_peered":"2024-04-26T10:24:32.596275+0000","last_clean":"2024-04-26T10:24:32.596275+0000","last_became_active":"2024-04-26T10:24:31.604402+0000","last_became_peered":"2024-04-26T10:24:31.604402+0000","last_unstale":"2024-04-26T10:24:32.596275+0000","last_undegraded":"2024-04-26T10:24:32.596275+0000","last_fullsized":"2024-04-26T10:24:32.596275+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:52.355783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":114,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599278+0000","last_change":"2024-04-26T10:24:31.624641+0000","last_active":"2024-04-26T10:24:32.599278+0000","last_peered":"2024-04-26T10:24:32.599278+0000","last_clean":"2024-04-26T10:24:32.599278+0000","last_became_active":"2024-04-26T10:24:31.604744+0000","last_became_peered":"2024-04-26T10:24:31.604744+0000","last_unstale":"2024-04-26T10:24:32.599278+0000","last_undegraded":"2024-04-26T10:24:32.599278+0000","last_fullsized":"2024-04-26T10:24:32.599278+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:44.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.749706+0000","last_change":"2024-04-26T10:22:09.750173+0000","last_active":"2024-04-26T10:24:32.749706+0000","last_peered":"2024-04-26T10:24:32.749706+0000","last_clean":"2024-04-26T10:24:32.749706+0000","last_became_active":"2024-04-26T10:22:09.749862+0000","last_became_peered":"2024-04-26T10:22:09.749862+0000","last_unstale":"2024-04-26T10:24:32.749706+0000","last_undegraded":"2024-04-26T10:24:32.749706+0000","last_fullsized":"2024-04-26T10:24:32.749706+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:53.204364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":72,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744851+0000","last_change":"2024-04-26T10:22:09.750224+0000","last_active":"2024-04-26T10:24:32.744851+0000","last_peered":"2024-04-26T10:24:32.744851+0000","last_clean":"2024-04-26T10:24:32.744851+0000","last_became_active":"2024-04-26T10:22:09.749852+0000","last_became_peered":"2024-04-26T10:22:09.749852+0000","last_unstale":"2024-04-26T10:24:32.744851+0000","last_undegraded":"2024-04-26T10:24:32.744851+0000","last_fullsized":"2024-04-26T10:24:32.744851+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:44.923542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.180773+0000","last_change":"2024-04-26T10:24:31.597157+0000","last_active":"2024-04-26T10:24:33.180773+0000","last_peered":"2024-04-26T10:24:33.180773+0000","last_clean":"2024-04-26T10:24:33.180773+0000","last_became_active":"2024-04-26T10:24:31.596335+0000","last_became_peered":"2024-04-26T10:24:31.596335+0000","last_unstale":"2024-04-26T10:24:33.180773+0000","last_undegraded":"2024-04-26T10:24:33.180773+0000","last_fullsized":"2024-04-26T10:24:33.180773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:07.652892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":80,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.598951+0000","last_change":"2024-04-26T10:21:08.935133+0000","last_active":"2024-04-26T10:24:32.598951+0000","last_peered":"2024-04-26T10:24:32.598951+0000","last_clean":"2024-04-26T10:24:32.598951+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:24:32.598951+0000","last_undegraded":"2024-04-26T10:24:32.598951+0000","last_fullsized":"2024-04-26T10:24:32.598951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:25.498249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596919+0000","last_change":"2024-04-26T10:24:22.549411+0000","last_active":"2024-04-26T10:24:32.596919+0000","last_peered":"2024-04-26T10:24:32.596919+0000","last_clean":"2024-04-26T10:24:32.596919+0000","last_became_active":"2024-04-26T10:24:22.549230+0000","last_became_peered":"2024-04-26T10:24:22.549230+0000","last_unstale":"2024-04-26T10:24:32.596919+0000","last_undegraded":"2024-04-26T10:24:32.596919+0000","last_fullsized":"2024-04-26T10:24:32.596919+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:00.343304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.598250+0000","last_change":"2024-04-26T10:24:22.541409+0000","last_active":"2024-04-26T10:24:32.598250+0000","last_peered":"2024-04-26T10:24:32.598250+0000","last_clean":"2024-04-26T10:24:32.598250+0000","last_became_active":"2024-04-26T10:24:22.540611+0000","last_became_peered":"2024-04-26T10:24:22.540611+0000","last_unstale":"2024-04-26T10:24:32.598250+0000","last_undegraded":"2024-04-26T10:24:32.598250+0000","last_fullsized":"2024-04-26T10:24:32.598250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:48.882187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319142+0000","last_change":"2024-04-26T10:24:22.687178+0000","last_active":"2024-04-26T10:24:33.319142+0000","last_peered":"2024-04-26T10:24:33.319142+0000","last_clean":"2024-04-26T10:24:33.319142+0000","last_became_active":"2024-04-26T10:24:22.686841+0000","last_became_peered":"2024-04-26T10:24:22.686841+0000","last_unstale":"2024-04-26T10:24:33.319142+0000","last_undegraded":"2024-04-26T10:24:33.319142+0000","last_fullsized":"2024-04-26T10:24:33.319142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:52.907696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318078+0000","last_change":"2024-04-26T10:24:22.687183+0000","last_active":"2024-04-26T10:24:33.318078+0000","last_peered":"2024-04-26T10:24:33.318078+0000","last_clean":"2024-04-26T10:24:33.318078+0000","last_became_active":"2024-04-26T10:24:22.686846+0000","last_became_peered":"2024-04-26T10:24:22.686846+0000","last_unstale":"2024-04-26T10:24:33.318078+0000","last_undegraded":"2024-04-26T10:24:33.318078+0000","last_fullsized":"2024-04-26T10:24:33.318078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:37.083683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.598176+0000","last_change":"2024-04-26T10:24:22.546117+0000","last_active":"2024-04-26T10:24:32.598176+0000","last_peered":"2024-04-26T10:24:32.598176+0000","last_clean":"2024-04-26T10:24:32.598176+0000","last_became_active":"2024-04-26T10:24:22.545616+0000","last_became_peered":"2024-04-26T10:24:22.545616+0000","last_unstale":"2024-04-26T10:24:32.598176+0000","last_undegraded":"2024-04-26T10:24:32.598176+0000","last_fullsized":"2024-04-26T10:24:32.598176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:09.247826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597257+0000","last_change":"2024-04-26T10:24:22.540185+0000","last_active":"2024-04-26T10:24:32.597257+0000","last_peered":"2024-04-26T10:24:32.597257+0000","last_clean":"2024-04-26T10:24:32.597257+0000","last_became_active":"2024-04-26T10:24:22.538982+0000","last_became_peered":"2024-04-26T10:24:22.538982+0000","last_unstale":"2024-04-26T10:24:32.597257+0000","last_undegraded":"2024-04-26T10:24:32.597257+0000","last_fullsized":"2024-04-26T10:24:32.597257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:27.225284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":78,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.598908+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:24:32.598908+0000","last_peered":"2024-04-26T10:24:32.598908+0000","last_clean":"2024-04-26T10:24:32.598908+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:24:32.598908+0000","last_undegraded":"2024-04-26T10:24:32.598908+0000","last_fullsized":"2024-04-26T10:24:32.598908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":70,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.743499+0000","last_change":"2024-04-26T10:22:09.748616+0000","last_active":"2024-04-26T10:24:32.743499+0000","last_peered":"2024-04-26T10:24:32.743499+0000","last_clean":"2024-04-26T10:24:32.743499+0000","last_became_active":"2024-04-26T10:22:09.748256+0000","last_became_peered":"2024-04-26T10:22:09.748256+0000","last_unstale":"2024-04-26T10:24:32.743499+0000","last_undegraded":"2024-04-26T10:24:32.743499+0000","last_fullsized":"2024-04-26T10:24:32.743499+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:19.402647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597229+0000","last_change":"2024-04-26T10:24:31.604150+0000","last_active":"2024-04-26T10:24:32.597229+0000","last_peered":"2024-04-26T10:24:32.597229+0000","last_clean":"2024-04-26T10:24:32.597229+0000","last_became_active":"2024-04-26T10:24:31.603620+0000","last_became_peered":"2024-04-26T10:24:31.603620+0000","last_unstale":"2024-04-26T10:24:32.597229+0000","last_undegraded":"2024-04-26T10:24:32.597229+0000","last_fullsized":"2024-04-26T10:24:32.597229+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:17.085344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181993+0000","last_change":"2024-04-26T10:24:31.598521+0000","last_active":"2024-04-26T10:24:33.181993+0000","last_peered":"2024-04-26T10:24:33.181993+0000","last_clean":"2024-04-26T10:24:33.181993+0000","last_became_active":"2024-04-26T10:24:31.598120+0000","last_became_peered":"2024-04-26T10:24:31.598120+0000","last_unstale":"2024-04-26T10:24:33.181993+0000","last_undegraded":"2024-04-26T10:24:33.181993+0000","last_fullsized":"2024-04-26T10:24:33.181993+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:23.723355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319166+0000","last_change":"2024-04-26T10:24:22.680557+0000","last_active":"2024-04-26T10:24:33.319166+0000","last_peered":"2024-04-26T10:24:33.319166+0000","last_clean":"2024-04-26T10:24:33.319166+0000","last_became_active":"2024-04-26T10:24:22.679940+0000","last_became_peered":"2024-04-26T10:24:22.679940+0000","last_unstale":"2024-04-26T10:24:33.319166+0000","last_undegraded":"2024-04-26T10:24:33.319166+0000","last_fullsized":"2024-04-26T10:24:33.319166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:06.379234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":325,"reported_epoch":90,"state":"peering","last_fresh":"2024-04-26T10:24:33.174823+0000","last_change":"2024-04-26T10:24:33.175683+0000","last_active":"2024-04-26T10:24:33.174823+0000","last_peered":"2024-04-26T10:24:32.759338+0000","last_clean":"2024-04-26T10:24:29.608470+0000","last_became_active":"2024-04-26T10:24:32.749223+0000","last_became_peered":"2024-04-26T10:24:32.749223+0000","last_unstale":"2024-04-26T10:24:33.174823+0000","last_undegraded":"2024-04-26T10:24:33.174823+0000","last_fullsized":"2024-04-26T10:24:33.174823+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:07.600717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":95,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596699+0000","last_change":"2024-04-26T10:24:22.547708+0000","last_active":"2024-04-26T10:24:32.596699+0000","last_peered":"2024-04-26T10:24:32.596699+0000","last_clean":"2024-04-26T10:24:32.596699+0000","last_became_active":"2024-04-26T10:24:22.546650+0000","last_became_peered":"2024-04-26T10:24:22.546650+0000","last_unstale":"2024-04-26T10:24:32.596699+0000","last_undegraded":"2024-04-26T10:24:32.596699+0000","last_fullsized":"2024-04-26T10:24:32.596699+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:55.474931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317752+0000","last_change":"2024-04-26T10:24:22.676755+0000","last_active":"2024-04-26T10:24:33.317752+0000","last_peered":"2024-04-26T10:24:33.317752+0000","last_clean":"2024-04-26T10:24:33.317752+0000","last_became_active":"2024-04-26T10:24:22.676489+0000","last_became_peered":"2024-04-26T10:24:22.676489+0000","last_unstale":"2024-04-26T10:24:33.317752+0000","last_undegraded":"2024-04-26T10:24:33.317752+0000","last_fullsized":"2024-04-26T10:24:33.317752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:38.979532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599143+0000","last_change":"2024-04-26T10:24:31.603833+0000","last_active":"2024-04-26T10:24:32.599143+0000","last_peered":"2024-04-26T10:24:32.599143+0000","last_clean":"2024-04-26T10:24:32.599143+0000","last_became_active":"2024-04-26T10:24:31.603498+0000","last_became_peered":"2024-04-26T10:24:31.603498+0000","last_unstale":"2024-04-26T10:24:32.599143+0000","last_undegraded":"2024-04-26T10:24:32.599143+0000","last_fullsized":"2024-04-26T10:24:32.599143+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:58.952460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":108,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597168+0000","last_change":"2024-04-26T10:24:31.603067+0000","last_active":"2024-04-26T10:24:32.597168+0000","last_peered":"2024-04-26T10:24:32.597168+0000","last_clean":"2024-04-26T10:24:32.597168+0000","last_became_active":"2024-04-26T10:24:31.602611+0000","last_became_peered":"2024-04-26T10:24:31.602611+0000","last_unstale":"2024-04-26T10:24:32.597168+0000","last_undegraded":"2024-04-26T10:24:32.597168+0000","last_fullsized":"2024-04-26T10:24:32.597168+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:14.943135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316711+0000","last_change":"2024-04-26T10:24:22.685554+0000","last_active":"2024-04-26T10:24:33.316711+0000","last_peered":"2024-04-26T10:24:33.316711+0000","last_clean":"2024-04-26T10:24:33.316711+0000","last_became_active":"2024-04-26T10:24:22.685051+0000","last_became_peered":"2024-04-26T10:24:22.685051+0000","last_unstale":"2024-04-26T10:24:33.316711+0000","last_undegraded":"2024-04-26T10:24:33.316711+0000","last_fullsized":"2024-04-26T10:24:33.316711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:59.389895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":85,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744680+0000","last_change":"2024-04-26T10:24:22.538294+0000","last_active":"2024-04-26T10:24:32.744680+0000","last_peered":"2024-04-26T10:24:32.744680+0000","last_clean":"2024-04-26T10:24:32.744680+0000","last_became_active":"2024-04-26T10:24:22.537983+0000","last_became_peered":"2024-04-26T10:24:22.537983+0000","last_unstale":"2024-04-26T10:24:32.744680+0000","last_undegraded":"2024-04-26T10:24:32.744680+0000","last_fullsized":"2024-04-26T10:24:32.744680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:54.064158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317277+0000","last_change":"2024-04-26T10:24:22.679231+0000","last_active":"2024-04-26T10:24:33.317277+0000","last_peered":"2024-04-26T10:24:33.317277+0000","last_clean":"2024-04-26T10:24:33.317277+0000","last_became_active":"2024-04-26T10:24:22.678866+0000","last_became_peered":"2024-04-26T10:24:22.678866+0000","last_unstale":"2024-04-26T10:24:33.317277+0000","last_undegraded":"2024-04-26T10:24:33.317277+0000","last_fullsized":"2024-04-26T10:24:33.317277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:26.179423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":70,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.749762+0000","last_change":"2024-04-26T10:22:09.750297+0000","last_active":"2024-04-26T10:24:32.749762+0000","last_peered":"2024-04-26T10:24:32.749762+0000","last_clean":"2024-04-26T10:24:32.749762+0000","last_became_active":"2024-04-26T10:22:09.749935+0000","last_became_peered":"2024-04-26T10:22:09.749935+0000","last_unstale":"2024-04-26T10:24:32.749762+0000","last_undegraded":"2024-04-26T10:24:32.749762+0000","last_fullsized":"2024-04-26T10:24:32.749762+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:51.197306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319145+0000","last_change":"2024-04-26T10:24:31.745820+0000","last_active":"2024-04-26T10:24:33.319145+0000","last_peered":"2024-04-26T10:24:33.319145+0000","last_clean":"2024-04-26T10:24:33.319145+0000","last_became_active":"2024-04-26T10:24:31.745487+0000","last_became_peered":"2024-04-26T10:24:31.745487+0000","last_unstale":"2024-04-26T10:24:33.319145+0000","last_undegraded":"2024-04-26T10:24:33.319145+0000","last_fullsized":"2024-04-26T10:24:33.319145+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:00.239650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":95,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597357+0000","last_change":"2024-04-26T10:24:22.539761+0000","last_active":"2024-04-26T10:24:32.597357+0000","last_peered":"2024-04-26T10:24:32.597357+0000","last_clean":"2024-04-26T10:24:32.597357+0000","last_became_active":"2024-04-26T10:24:22.538993+0000","last_became_peered":"2024-04-26T10:24:22.538993+0000","last_unstale":"2024-04-26T10:24:32.597357+0000","last_undegraded":"2024-04-26T10:24:32.597357+0000","last_fullsized":"2024-04-26T10:24:32.597357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:24.782191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596822+0000","last_change":"2024-04-26T10:24:22.542774+0000","last_active":"2024-04-26T10:24:32.596822+0000","last_peered":"2024-04-26T10:24:32.596822+0000","last_clean":"2024-04-26T10:24:32.596822+0000","last_became_active":"2024-04-26T10:24:22.541795+0000","last_became_peered":"2024-04-26T10:24:22.541795+0000","last_unstale":"2024-04-26T10:24:32.596822+0000","last_undegraded":"2024-04-26T10:24:32.596822+0000","last_fullsized":"2024-04-26T10:24:32.596822+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:07.303056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317944+0000","last_change":"2024-04-26T10:24:31.744717+0000","last_active":"2024-04-26T10:24:33.317944+0000","last_peered":"2024-04-26T10:24:33.317944+0000","last_clean":"2024-04-26T10:24:33.317944+0000","last_became_active":"2024-04-26T10:24:31.744373+0000","last_became_peered":"2024-04-26T10:24:31.744373+0000","last_unstale":"2024-04-26T10:24:33.317944+0000","last_undegraded":"2024-04-26T10:24:33.317944+0000","last_fullsized":"2024-04-26T10:24:33.317944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:10.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597810+0000","last_change":"2024-04-26T10:24:22.538573+0000","last_active":"2024-04-26T10:24:32.597810+0000","last_peered":"2024-04-26T10:24:32.597810+0000","last_clean":"2024-04-26T10:24:32.597810+0000","last_became_active":"2024-04-26T10:24:22.537041+0000","last_became_peered":"2024-04-26T10:24:22.537041+0000","last_unstale":"2024-04-26T10:24:32.597810+0000","last_undegraded":"2024-04-26T10:24:32.597810+0000","last_fullsized":"2024-04-26T10:24:32.597810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:48.026637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318800+0000","last_change":"2024-04-26T10:24:31.744776+0000","last_active":"2024-04-26T10:24:33.318800+0000","last_peered":"2024-04-26T10:24:33.318800+0000","last_clean":"2024-04-26T10:24:33.318800+0000","last_became_active":"2024-04-26T10:24:31.744342+0000","last_became_peered":"2024-04-26T10:24:31.744342+0000","last_unstale":"2024-04-26T10:24:33.318800+0000","last_undegraded":"2024-04-26T10:24:33.318800+0000","last_fullsized":"2024-04-26T10:24:33.318800+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:08:33.941367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.180923+0000","last_change":"2024-04-26T10:24:31.599193+0000","last_active":"2024-04-26T10:24:33.180923+0000","last_peered":"2024-04-26T10:24:33.180923+0000","last_clean":"2024-04-26T10:24:33.180923+0000","last_became_active":"2024-04-26T10:24:31.598432+0000","last_became_peered":"2024-04-26T10:24:31.598432+0000","last_unstale":"2024-04-26T10:24:33.180923+0000","last_undegraded":"2024-04-26T10:24:33.180923+0000","last_fullsized":"2024-04-26T10:24:33.180923+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:41.515775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318555+0000","last_change":"2024-04-26T10:24:31.745336+0000","last_active":"2024-04-26T10:24:33.318555+0000","last_peered":"2024-04-26T10:24:33.318555+0000","last_clean":"2024-04-26T10:24:33.318555+0000","last_became_active":"2024-04-26T10:24:31.745004+0000","last_became_peered":"2024-04-26T10:24:31.745004+0000","last_unstale":"2024-04-26T10:24:33.318555+0000","last_undegraded":"2024-04-26T10:24:33.318555+0000","last_fullsized":"2024-04-26T10:24:33.318555+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:15.275549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183054+0000","last_change":"2024-04-26T10:24:31.601585+0000","last_active":"2024-04-26T10:24:33.183054+0000","last_peered":"2024-04-26T10:24:33.183054+0000","last_clean":"2024-04-26T10:24:33.183054+0000","last_became_active":"2024-04-26T10:24:31.600977+0000","last_became_peered":"2024-04-26T10:24:31.600977+0000","last_unstale":"2024-04-26T10:24:33.183054+0000","last_undegraded":"2024-04-26T10:24:33.183054+0000","last_fullsized":"2024-04-26T10:24:33.183054+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.329801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744310+0000","last_change":"2024-04-26T10:22:09.758116+0000","last_active":"2024-04-26T10:24:32.744310+0000","last_peered":"2024-04-26T10:24:32.744310+0000","last_clean":"2024-04-26T10:24:32.744310+0000","last_became_active":"2024-04-26T10:22:09.757813+0000","last_became_peered":"2024-04-26T10:22:09.757813+0000","last_unstale":"2024-04-26T10:24:32.744310+0000","last_undegraded":"2024-04-26T10:24:32.744310+0000","last_fullsized":"2024-04-26T10:24:32.744310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:01.195987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318177+0000","last_change":"2024-04-26T10:24:22.680137+0000","last_active":"2024-04-26T10:24:33.318177+0000","last_peered":"2024-04-26T10:24:33.318177+0000","last_clean":"2024-04-26T10:24:33.318177+0000","last_became_active":"2024-04-26T10:24:22.679497+0000","last_became_peered":"2024-04-26T10:24:22.679497+0000","last_unstale":"2024-04-26T10:24:33.318177+0000","last_undegraded":"2024-04-26T10:24:33.318177+0000","last_fullsized":"2024-04-26T10:24:33.318177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:00.401135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318093+0000","last_change":"2024-04-26T10:24:31.741102+0000","last_active":"2024-04-26T10:24:33.318093+0000","last_peered":"2024-04-26T10:24:33.318093+0000","last_clean":"2024-04-26T10:24:33.318093+0000","last_became_active":"2024-04-26T10:24:31.740589+0000","last_became_peered":"2024-04-26T10:24:31.740589+0000","last_unstale":"2024-04-26T10:24:33.318093+0000","last_undegraded":"2024-04-26T10:24:33.318093+0000","last_fullsized":"2024-04-26T10:24:33.318093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:38.170544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317410+0000","last_change":"2024-04-26T10:24:22.686404+0000","last_active":"2024-04-26T10:24:33.317410+0000","last_peered":"2024-04-26T10:24:33.317410+0000","last_clean":"2024-04-26T10:24:33.317410+0000","last_became_active":"2024-04-26T10:24:22.686094+0000","last_became_peered":"2024-04-26T10:24:22.686094+0000","last_unstale":"2024-04-26T10:24:33.317410+0000","last_undegraded":"2024-04-26T10:24:33.317410+0000","last_fullsized":"2024-04-26T10:24:33.317410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:37.911705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318296+0000","last_change":"2024-04-26T10:24:22.682344+0000","last_active":"2024-04-26T10:24:33.318296+0000","last_peered":"2024-04-26T10:24:33.318296+0000","last_clean":"2024-04-26T10:24:33.318296+0000","last_became_active":"2024-04-26T10:24:22.681977+0000","last_became_peered":"2024-04-26T10:24:22.681977+0000","last_unstale":"2024-04-26T10:24:33.318296+0000","last_undegraded":"2024-04-26T10:24:33.318296+0000","last_fullsized":"2024-04-26T10:24:33.318296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:56.544667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":108,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599518+0000","last_change":"2024-04-26T10:24:31.605320+0000","last_active":"2024-04-26T10:24:32.599518+0000","last_peered":"2024-04-26T10:24:32.599518+0000","last_clean":"2024-04-26T10:24:32.599518+0000","last_became_active":"2024-04-26T10:24:31.604158+0000","last_became_peered":"2024-04-26T10:24:31.604158+0000","last_unstale":"2024-04-26T10:24:32.599518+0000","last_undegraded":"2024-04-26T10:24:32.599518+0000","last_fullsized":"2024-04-26T10:24:32.599518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:53.955856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181706+0000","last_change":"2024-04-26T10:24:31.601291+0000","last_active":"2024-04-26T10:24:33.181706+0000","last_peered":"2024-04-26T10:24:33.181706+0000","last_clean":"2024-04-26T10:24:33.181706+0000","last_became_active":"2024-04-26T10:24:31.600474+0000","last_became_peered":"2024-04-26T10:24:31.600474+0000","last_unstale":"2024-04-26T10:24:33.181706+0000","last_undegraded":"2024-04-26T10:24:33.181706+0000","last_fullsized":"2024-04-26T10:24:33.181706+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:30.284416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597907+0000","last_change":"2024-04-26T10:24:31.604975+0000","last_active":"2024-04-26T10:24:32.597907+0000","last_peered":"2024-04-26T10:24:32.597907+0000","last_clean":"2024-04-26T10:24:32.597907+0000","last_became_active":"2024-04-26T10:24:31.604609+0000","last_became_peered":"2024-04-26T10:24:31.604609+0000","last_unstale":"2024-04-26T10:24:32.597907+0000","last_undegraded":"2024-04-26T10:24:32.597907+0000","last_fullsized":"2024-04-26T10:24:32.597907+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:04.412544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":131,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597647+0000","last_change":"2024-04-26T10:24:31.622111+0000","last_active":"2024-04-26T10:24:32.597647+0000","last_peered":"2024-04-26T10:24:32.597647+0000","last_clean":"2024-04-26T10:24:32.597647+0000","last_became_active":"2024-04-26T10:24:31.604884+0000","last_became_peered":"2024-04-26T10:24:31.604884+0000","last_unstale":"2024-04-26T10:24:32.597647+0000","last_undegraded":"2024-04-26T10:24:32.597647+0000","last_fullsized":"2024-04-26T10:24:32.597647+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:18.600081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317264+0000","last_change":"2024-04-26T10:24:31.739955+0000","last_active":"2024-04-26T10:24:33.317264+0000","last_peered":"2024-04-26T10:24:33.317264+0000","last_clean":"2024-04-26T10:24:33.317264+0000","last_became_active":"2024-04-26T10:24:31.739550+0000","last_became_peered":"2024-04-26T10:24:31.739550+0000","last_unstale":"2024-04-26T10:24:33.317264+0000","last_undegraded":"2024-04-26T10:24:33.317264+0000","last_fullsized":"2024-04-26T10:24:33.317264+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:31.253486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182681+0000","last_change":"2024-04-26T10:24:31.609788+0000","last_active":"2024-04-26T10:24:33.182681+0000","last_peered":"2024-04-26T10:24:33.182681+0000","last_clean":"2024-04-26T10:24:33.182681+0000","last_became_active":"2024-04-26T10:24:31.601218+0000","last_became_peered":"2024-04-26T10:24:31.601218+0000","last_unstale":"2024-04-26T10:24:33.182681+0000","last_undegraded":"2024-04-26T10:24:33.182681+0000","last_fullsized":"2024-04-26T10:24:33.182681+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:39.380483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597918+0000","last_change":"2024-04-26T10:24:22.546807+0000","last_active":"2024-04-26T10:24:32.597918+0000","last_peered":"2024-04-26T10:24:32.597918+0000","last_clean":"2024-04-26T10:24:32.597918+0000","last_became_active":"2024-04-26T10:24:22.546378+0000","last_became_peered":"2024-04-26T10:24:22.546378+0000","last_unstale":"2024-04-26T10:24:32.597918+0000","last_undegraded":"2024-04-26T10:24:32.597918+0000","last_fullsized":"2024-04-26T10:24:32.597918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:06.866157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317068+0000","last_change":"2024-04-26T10:24:22.684096+0000","last_active":"2024-04-26T10:24:33.317068+0000","last_peered":"2024-04-26T10:24:33.317068+0000","last_clean":"2024-04-26T10:24:33.317068+0000","last_became_active":"2024-04-26T10:24:22.683558+0000","last_became_peered":"2024-04-26T10:24:22.683558+0000","last_unstale":"2024-04-26T10:24:33.317068+0000","last_undegraded":"2024-04-26T10:24:33.317068+0000","last_fullsized":"2024-04-26T10:24:33.317068+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:05.316682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318841+0000","last_change":"2024-04-26T10:24:22.684541+0000","last_active":"2024-04-26T10:24:33.318841+0000","last_peered":"2024-04-26T10:24:33.318841+0000","last_clean":"2024-04-26T10:24:33.318841+0000","last_became_active":"2024-04-26T10:24:22.684166+0000","last_became_peered":"2024-04-26T10:24:22.684166+0000","last_unstale":"2024-04-26T10:24:33.318841+0000","last_undegraded":"2024-04-26T10:24:33.318841+0000","last_fullsized":"2024-04-26T10:24:33.318841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:30.164642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317049+0000","last_change":"2024-04-26T10:24:31.745539+0000","last_active":"2024-04-26T10:24:33.317049+0000","last_peered":"2024-04-26T10:24:33.317049+0000","last_clean":"2024-04-26T10:24:33.317049+0000","last_became_active":"2024-04-26T10:24:31.745216+0000","last_became_peered":"2024-04-26T10:24:31.745216+0000","last_unstale":"2024-04-26T10:24:33.317049+0000","last_undegraded":"2024-04-26T10:24:33.317049+0000","last_fullsized":"2024-04-26T10:24:33.317049+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:55.390023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.745094+0000","last_change":"2024-04-26T10:22:09.750605+0000","last_active":"2024-04-26T10:24:32.745094+0000","last_peered":"2024-04-26T10:24:32.745094+0000","last_clean":"2024-04-26T10:24:32.745094+0000","last_became_active":"2024-04-26T10:22:09.750359+0000","last_became_peered":"2024-04-26T10:22:09.750359+0000","last_unstale":"2024-04-26T10:24:32.745094+0000","last_undegraded":"2024-04-26T10:24:32.745094+0000","last_fullsized":"2024-04-26T10:24:32.745094+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:56.948741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316663+0000","last_change":"2024-04-26T10:24:31.740907+0000","last_active":"2024-04-26T10:24:33.316663+0000","last_peered":"2024-04-26T10:24:33.316663+0000","last_clean":"2024-04-26T10:24:33.316663+0000","last_became_active":"2024-04-26T10:24:31.740477+0000","last_became_peered":"2024-04-26T10:24:31.740477+0000","last_unstale":"2024-04-26T10:24:33.316663+0000","last_undegraded":"2024-04-26T10:24:33.316663+0000","last_fullsized":"2024-04-26T10:24:33.316663+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:30.206347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318888+0000","last_change":"2024-04-26T10:24:22.684108+0000","last_active":"2024-04-26T10:24:33.318888+0000","last_peered":"2024-04-26T10:24:33.318888+0000","last_clean":"2024-04-26T10:24:33.318888+0000","last_became_active":"2024-04-26T10:24:22.683501+0000","last_became_peered":"2024-04-26T10:24:22.683501+0000","last_unstale":"2024-04-26T10:24:33.318888+0000","last_undegraded":"2024-04-26T10:24:33.318888+0000","last_fullsized":"2024-04-26T10:24:33.318888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:17.355758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316745+0000","last_change":"2024-04-26T10:24:22.685228+0000","last_active":"2024-04-26T10:24:33.316745+0000","last_peered":"2024-04-26T10:24:33.316745+0000","last_clean":"2024-04-26T10:24:33.316745+0000","last_became_active":"2024-04-26T10:24:22.684469+0000","last_became_peered":"2024-04-26T10:24:22.684469+0000","last_unstale":"2024-04-26T10:24:33.316745+0000","last_undegraded":"2024-04-26T10:24:33.316745+0000","last_fullsized":"2024-04-26T10:24:33.316745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:53.834583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744530+0000","last_change":"2024-04-26T10:22:09.753136+0000","last_active":"2024-04-26T10:24:32.744530+0000","last_peered":"2024-04-26T10:24:32.744530+0000","last_clean":"2024-04-26T10:24:32.744530+0000","last_became_active":"2024-04-26T10:22:09.752856+0000","last_became_peered":"2024-04-26T10:22:09.752856+0000","last_unstale":"2024-04-26T10:24:32.744530+0000","last_undegraded":"2024-04-26T10:24:32.744530+0000","last_fullsized":"2024-04-26T10:24:32.744530+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:48.541930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":87,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.743929+0000","last_change":"2024-04-26T10:24:22.535413+0000","last_active":"2024-04-26T10:24:32.743929+0000","last_peered":"2024-04-26T10:24:32.743929+0000","last_clean":"2024-04-26T10:24:32.743929+0000","last_became_active":"2024-04-26T10:24:22.535036+0000","last_became_peered":"2024-04-26T10:24:22.535036+0000","last_unstale":"2024-04-26T10:24:32.743929+0000","last_undegraded":"2024-04-26T10:24:32.743929+0000","last_fullsized":"2024-04-26T10:24:32.743929+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:43.756504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":85,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744946+0000","last_change":"2024-04-26T10:24:22.535819+0000","last_active":"2024-04-26T10:24:32.744946+0000","last_peered":"2024-04-26T10:24:32.744946+0000","last_clean":"2024-04-26T10:24:32.744946+0000","last_became_active":"2024-04-26T10:24:22.535562+0000","last_became_peered":"2024-04-26T10:24:22.535562+0000","last_unstale":"2024-04-26T10:24:32.744946+0000","last_undegraded":"2024-04-26T10:24:32.744946+0000","last_fullsized":"2024-04-26T10:24:32.744946+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:24.845621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181500+0000","last_change":"2024-04-26T10:24:31.600594+0000","last_active":"2024-04-26T10:24:33.181500+0000","last_peered":"2024-04-26T10:24:33.181500+0000","last_clean":"2024-04-26T10:24:33.181500+0000","last_became_active":"2024-04-26T10:24:31.600121+0000","last_became_peered":"2024-04-26T10:24:31.600121+0000","last_unstale":"2024-04-26T10:24:33.181500+0000","last_undegraded":"2024-04-26T10:24:33.181500+0000","last_fullsized":"2024-04-26T10:24:33.181500+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:05.491069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.598128+0000","last_change":"2024-04-26T10:24:22.542755+0000","last_active":"2024-04-26T10:24:32.598128+0000","last_peered":"2024-04-26T10:24:32.598128+0000","last_clean":"2024-04-26T10:24:32.598128+0000","last_became_active":"2024-04-26T10:24:22.541543+0000","last_became_peered":"2024-04-26T10:24:22.541543+0000","last_unstale":"2024-04-26T10:24:32.598128+0000","last_undegraded":"2024-04-26T10:24:32.598128+0000","last_fullsized":"2024-04-26T10:24:32.598128+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:50.942528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":94,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597902+0000","last_change":"2024-04-26T10:24:22.541418+0000","last_active":"2024-04-26T10:24:32.597902+0000","last_peered":"2024-04-26T10:24:32.597902+0000","last_clean":"2024-04-26T10:24:32.597902+0000","last_became_active":"2024-04-26T10:24:22.540767+0000","last_became_peered":"2024-04-26T10:24:22.540767+0000","last_unstale":"2024-04-26T10:24:32.597902+0000","last_undegraded":"2024-04-26T10:24:32.597902+0000","last_fullsized":"2024-04-26T10:24:32.597902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:26.684306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597124+0000","last_change":"2024-04-26T10:24:22.547294+0000","last_active":"2024-04-26T10:24:32.597124+0000","last_peered":"2024-04-26T10:24:32.597124+0000","last_clean":"2024-04-26T10:24:32.597124+0000","last_became_active":"2024-04-26T10:24:22.546811+0000","last_became_peered":"2024-04-26T10:24:22.546811+0000","last_unstale":"2024-04-26T10:24:32.597124+0000","last_undegraded":"2024-04-26T10:24:32.597124+0000","last_fullsized":"2024-04-26T10:24:32.597124+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:03.037283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":72,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744948+0000","last_change":"2024-04-26T10:22:09.753438+0000","last_active":"2024-04-26T10:24:32.744948+0000","last_peered":"2024-04-26T10:24:32.744948+0000","last_clean":"2024-04-26T10:24:32.744948+0000","last_became_active":"2024-04-26T10:22:09.753211+0000","last_became_peered":"2024-04-26T10:22:09.753211+0000","last_unstale":"2024-04-26T10:24:32.744948+0000","last_undegraded":"2024-04-26T10:24:32.744948+0000","last_fullsized":"2024-04-26T10:24:32.744948+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:39.406859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181346+0000","last_change":"2024-04-26T10:24:31.600935+0000","last_active":"2024-04-26T10:24:33.181346+0000","last_peered":"2024-04-26T10:24:33.181346+0000","last_clean":"2024-04-26T10:24:33.181346+0000","last_became_active":"2024-04-26T10:24:31.600088+0000","last_became_peered":"2024-04-26T10:24:31.600088+0000","last_unstale":"2024-04-26T10:24:33.181346+0000","last_undegraded":"2024-04-26T10:24:33.181346+0000","last_fullsized":"2024-04-26T10:24:33.181346+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:58.341684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319737+0000","last_change":"2024-04-26T10:24:22.680082+0000","last_active":"2024-04-26T10:24:33.319737+0000","last_peered":"2024-04-26T10:24:33.319737+0000","last_clean":"2024-04-26T10:24:33.319737+0000","last_became_active":"2024-04-26T10:24:22.679652+0000","last_became_peered":"2024-04-26T10:24:22.679652+0000","last_unstale":"2024-04-26T10:24:33.319737+0000","last_undegraded":"2024-04-26T10:24:33.319737+0000","last_fullsized":"2024-04-26T10:24:33.319737+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:37.821623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596041+0000","last_change":"2024-04-26T10:24:22.540326+0000","last_active":"2024-04-26T10:24:32.596041+0000","last_peered":"2024-04-26T10:24:32.596041+0000","last_clean":"2024-04-26T10:24:32.596041+0000","last_became_active":"2024-04-26T10:24:22.538895+0000","last_became_peered":"2024-04-26T10:24:22.538895+0000","last_unstale":"2024-04-26T10:24:32.596041+0000","last_undegraded":"2024-04-26T10:24:32.596041+0000","last_fullsized":"2024-04-26T10:24:32.596041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:29.709972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319358+0000","last_change":"2024-04-26T10:24:22.685454+0000","last_active":"2024-04-26T10:24:33.319358+0000","last_peered":"2024-04-26T10:24:33.319358+0000","last_clean":"2024-04-26T10:24:33.319358+0000","last_became_active":"2024-04-26T10:24:22.684863+0000","last_became_peered":"2024-04-26T10:24:22.684863+0000","last_unstale":"2024-04-26T10:24:33.319358+0000","last_undegraded":"2024-04-26T10:24:33.319358+0000","last_fullsized":"2024-04-26T10:24:33.319358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:33.027447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":21541,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673008,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279064,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":278014,"kb_avail":94092776,"statfs":{"total":96636764160,"available":96351002624,"internally_reserved":0,"allocated":1056768,"data_stored":1031439,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":284686790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:24:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55000000000000004,"15min":0.51600000000000001},"min":{"1min":0.25800000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.67500000000000004,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.53900000000000003},"min":{"1min":0.28000000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.754,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":0,"up_from":10,"seq":42949673007,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487460,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":486398,"kb_avail":93884380,"statfs":{"total":96636764160,"available":96137605120,"internally_reserved":0,"allocated":1073152,"data_stored":1027794,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":498072006},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:24:04 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.65600000000000003,"15min":0.56599999999999995},"min":{"1min":0.21099999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":4.1369999999999996,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.25900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.748,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":2,"up_from":80,"seq":343597383685,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38380,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":37369,"kb_avail":94333460,"statfs":{"total":96636764160,"available":96597463040,"internally_reserved":0,"allocated":1007616,"data_stored":444173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6879,"internal_metadata":38266145},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:24:36.434 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-26T10:24:36.800 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:24:36.800 INFO:teuthology.orchestra.run.smithi052.stdout:{"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":228,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":91,"num_osds":3,"num_up_osds":3,"osd_up_since":1714127061,"num_in_osds":3,"osd_in_since":1714126849,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":104},{"state_name":"peering","count":1}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592730,"bytes_used":824221696,"bytes_avail":289086070784,"bytes_total":289910292480,"inactive_pgs_ratio":0.0095238098874688148,"recovering_objects_per_sec":2,"recovering_bytes_per_sec":132779,"recovering_keys_per_sec":0,"num_objects_recovered":13,"num_bytes_recovered":592044,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4233}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-26T10:22:15.961479+0000","services":{}},"progress_events":{}} 2024-04-26T10:24:36.814 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2024-04-26T10:24:36.814 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:24:37.122 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:24:37.124 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:24:37.139 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":197,"stamp":"2024-04-26T10:24:36.041254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1184088,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":804904,"kb_used_data":3064,"kb_used_omap":9,"kb_used_meta":801782,"kb_avail":282310616,"statfs":{"total":289910292480,"available":289086070784,"internally_reserved":0,"allocated":3137536,"data_stored":2503406,"data_compressed":14075,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":10067,"internal_metadata":821024941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":592044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.458837"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183068+0000","last_change":"2024-04-26T10:24:31.598789+0000","last_active":"2024-04-26T10:24:33.183068+0000","last_peered":"2024-04-26T10:24:33.183068+0000","last_clean":"2024-04-26T10:24:33.183068+0000","last_became_active":"2024-04-26T10:24:31.598170+0000","last_became_peered":"2024-04-26T10:24:31.598170+0000","last_unstale":"2024-04-26T10:24:33.183068+0000","last_undegraded":"2024-04-26T10:24:33.183068+0000","last_fullsized":"2024-04-26T10:24:33.183068+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:46.718423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":85,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744370+0000","last_change":"2024-04-26T10:24:22.536264+0000","last_active":"2024-04-26T10:24:32.744370+0000","last_peered":"2024-04-26T10:24:32.744370+0000","last_clean":"2024-04-26T10:24:32.744370+0000","last_became_active":"2024-04-26T10:24:22.535998+0000","last_became_peered":"2024-04-26T10:24:22.535998+0000","last_unstale":"2024-04-26T10:24:32.744370+0000","last_undegraded":"2024-04-26T10:24:32.744370+0000","last_fullsized":"2024-04-26T10:24:32.744370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:54.491369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":78,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599563+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:24:32.599563+0000","last_peered":"2024-04-26T10:24:32.599563+0000","last_clean":"2024-04-26T10:24:32.599563+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:24:32.599563+0000","last_undegraded":"2024-04-26T10:24:32.599563+0000","last_fullsized":"2024-04-26T10:24:32.599563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:01.883964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599310+0000","last_change":"2024-04-26T10:24:22.549067+0000","last_active":"2024-04-26T10:24:32.599310+0000","last_peered":"2024-04-26T10:24:32.599310+0000","last_clean":"2024-04-26T10:24:32.599310+0000","last_became_active":"2024-04-26T10:24:22.548485+0000","last_became_peered":"2024-04-26T10:24:22.548485+0000","last_unstale":"2024-04-26T10:24:32.599310+0000","last_undegraded":"2024-04-26T10:24:32.599310+0000","last_fullsized":"2024-04-26T10:24:32.599310+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:19.263146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181618+0000","last_change":"2024-04-26T10:24:31.601925+0000","last_active":"2024-04-26T10:24:33.181618+0000","last_peered":"2024-04-26T10:24:33.181618+0000","last_clean":"2024-04-26T10:24:33.181618+0000","last_became_active":"2024-04-26T10:24:31.600986+0000","last_became_peered":"2024-04-26T10:24:31.600986+0000","last_unstale":"2024-04-26T10:24:33.181618+0000","last_undegraded":"2024-04-26T10:24:33.181618+0000","last_fullsized":"2024-04-26T10:24:33.181618+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:52.125249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596629+0000","last_change":"2024-04-26T10:24:22.548245+0000","last_active":"2024-04-26T10:24:32.596629+0000","last_peered":"2024-04-26T10:24:32.596629+0000","last_clean":"2024-04-26T10:24:32.596629+0000","last_became_active":"2024-04-26T10:24:22.547731+0000","last_became_peered":"2024-04-26T10:24:22.547731+0000","last_unstale":"2024-04-26T10:24:32.596629+0000","last_undegraded":"2024-04-26T10:24:32.596629+0000","last_fullsized":"2024-04-26T10:24:32.596629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:52.538672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597733+0000","last_change":"2024-04-26T10:24:22.549424+0000","last_active":"2024-04-26T10:24:32.597733+0000","last_peered":"2024-04-26T10:24:32.597733+0000","last_clean":"2024-04-26T10:24:32.597733+0000","last_became_active":"2024-04-26T10:24:22.549180+0000","last_became_peered":"2024-04-26T10:24:22.549180+0000","last_unstale":"2024-04-26T10:24:32.597733+0000","last_undegraded":"2024-04-26T10:24:32.597733+0000","last_fullsized":"2024-04-26T10:24:32.597733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.915633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597437+0000","last_change":"2024-04-26T10:24:22.547840+0000","last_active":"2024-04-26T10:24:32.597437+0000","last_peered":"2024-04-26T10:24:32.597437+0000","last_clean":"2024-04-26T10:24:32.597437+0000","last_became_active":"2024-04-26T10:24:22.547284+0000","last_became_peered":"2024-04-26T10:24:22.547284+0000","last_unstale":"2024-04-26T10:24:32.597437+0000","last_undegraded":"2024-04-26T10:24:32.597437+0000","last_fullsized":"2024-04-26T10:24:32.597437+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:09.731025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318637+0000","last_change":"2024-04-26T10:24:22.680232+0000","last_active":"2024-04-26T10:24:33.318637+0000","last_peered":"2024-04-26T10:24:33.318637+0000","last_clean":"2024-04-26T10:24:33.318637+0000","last_became_active":"2024-04-26T10:24:22.679648+0000","last_became_peered":"2024-04-26T10:24:22.679648+0000","last_unstale":"2024-04-26T10:24:33.318637+0000","last_undegraded":"2024-04-26T10:24:33.318637+0000","last_fullsized":"2024-04-26T10:24:33.318637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:58.174215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182358+0000","last_change":"2024-04-26T10:24:31.599182+0000","last_active":"2024-04-26T10:24:33.182358+0000","last_peered":"2024-04-26T10:24:33.182358+0000","last_clean":"2024-04-26T10:24:33.182358+0000","last_became_active":"2024-04-26T10:24:31.598187+0000","last_became_peered":"2024-04-26T10:24:31.598187+0000","last_unstale":"2024-04-26T10:24:33.182358+0000","last_undegraded":"2024-04-26T10:24:33.182358+0000","last_fullsized":"2024-04-26T10:24:33.182358+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:24.255353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599420+0000","last_change":"2024-04-26T10:24:22.547601+0000","last_active":"2024-04-26T10:24:32.599420+0000","last_peered":"2024-04-26T10:24:32.599420+0000","last_clean":"2024-04-26T10:24:32.599420+0000","last_became_active":"2024-04-26T10:24:22.546506+0000","last_became_peered":"2024-04-26T10:24:22.546506+0000","last_unstale":"2024-04-26T10:24:32.599420+0000","last_undegraded":"2024-04-26T10:24:32.599420+0000","last_fullsized":"2024-04-26T10:24:32.599420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:21.263835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.745021+0000","last_change":"2024-04-26T10:22:09.748232+0000","last_active":"2024-04-26T10:24:32.745021+0000","last_peered":"2024-04-26T10:24:32.745021+0000","last_clean":"2024-04-26T10:24:32.745021+0000","last_became_active":"2024-04-26T10:22:09.747822+0000","last_became_peered":"2024-04-26T10:22:09.747822+0000","last_unstale":"2024-04-26T10:24:32.745021+0000","last_undegraded":"2024-04-26T10:24:32.745021+0000","last_fullsized":"2024-04-26T10:24:32.745021+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.223031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181391+0000","last_change":"2024-04-26T10:24:31.598330+0000","last_active":"2024-04-26T10:24:33.181391+0000","last_peered":"2024-04-26T10:24:33.181391+0000","last_clean":"2024-04-26T10:24:33.181391+0000","last_became_active":"2024-04-26T10:24:31.597980+0000","last_became_peered":"2024-04-26T10:24:31.597980+0000","last_unstale":"2024-04-26T10:24:33.181391+0000","last_undegraded":"2024-04-26T10:24:33.181391+0000","last_fullsized":"2024-04-26T10:24:33.181391+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:38.711968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596786+0000","last_change":"2024-04-26T10:24:31.602827+0000","last_active":"2024-04-26T10:24:32.596786+0000","last_peered":"2024-04-26T10:24:32.596786+0000","last_clean":"2024-04-26T10:24:32.596786+0000","last_became_active":"2024-04-26T10:24:31.602539+0000","last_became_peered":"2024-04-26T10:24:31.602539+0000","last_unstale":"2024-04-26T10:24:32.596786+0000","last_undegraded":"2024-04-26T10:24:32.596786+0000","last_fullsized":"2024-04-26T10:24:32.596786+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:45.294898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596427+0000","last_change":"2024-04-26T10:24:31.602863+0000","last_active":"2024-04-26T10:24:32.596427+0000","last_peered":"2024-04-26T10:24:32.596427+0000","last_clean":"2024-04-26T10:24:32.596427+0000","last_became_active":"2024-04-26T10:24:31.602453+0000","last_became_peered":"2024-04-26T10:24:31.602453+0000","last_unstale":"2024-04-26T10:24:32.596427+0000","last_undegraded":"2024-04-26T10:24:32.596427+0000","last_fullsized":"2024-04-26T10:24:32.596427+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:51.661774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596948+0000","last_change":"2024-04-26T10:24:22.547543+0000","last_active":"2024-04-26T10:24:32.596948+0000","last_peered":"2024-04-26T10:24:32.596948+0000","last_clean":"2024-04-26T10:24:32.596948+0000","last_became_active":"2024-04-26T10:24:22.546856+0000","last_became_peered":"2024-04-26T10:24:22.546856+0000","last_unstale":"2024-04-26T10:24:32.596948+0000","last_undegraded":"2024-04-26T10:24:32.596948+0000","last_fullsized":"2024-04-26T10:24:32.596948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:34.240590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318406+0000","last_change":"2024-04-26T10:24:22.679885+0000","last_active":"2024-04-26T10:24:33.318406+0000","last_peered":"2024-04-26T10:24:33.318406+0000","last_clean":"2024-04-26T10:24:33.318406+0000","last_became_active":"2024-04-26T10:24:22.679350+0000","last_became_peered":"2024-04-26T10:24:22.679350+0000","last_unstale":"2024-04-26T10:24:33.318406+0000","last_undegraded":"2024-04-26T10:24:33.318406+0000","last_fullsized":"2024-04-26T10:24:33.318406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:06.039983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182466+0000","last_change":"2024-04-26T10:24:31.598857+0000","last_active":"2024-04-26T10:24:33.182466+0000","last_peered":"2024-04-26T10:24:33.182466+0000","last_clean":"2024-04-26T10:24:33.182466+0000","last_became_active":"2024-04-26T10:24:31.597563+0000","last_became_peered":"2024-04-26T10:24:31.597563+0000","last_unstale":"2024-04-26T10:24:33.182466+0000","last_undegraded":"2024-04-26T10:24:33.182466+0000","last_fullsized":"2024-04-26T10:24:33.182466+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:26.624180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317832+0000","last_change":"2024-04-26T10:24:22.679291+0000","last_active":"2024-04-26T10:24:33.317832+0000","last_peered":"2024-04-26T10:24:33.317832+0000","last_clean":"2024-04-26T10:24:33.317832+0000","last_became_active":"2024-04-26T10:24:22.678912+0000","last_became_peered":"2024-04-26T10:24:22.678912+0000","last_unstale":"2024-04-26T10:24:33.317832+0000","last_undegraded":"2024-04-26T10:24:33.317832+0000","last_fullsized":"2024-04-26T10:24:33.317832+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:49.260130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.598414+0000","last_change":"2024-04-26T10:24:22.546669+0000","last_active":"2024-04-26T10:24:32.598414+0000","last_peered":"2024-04-26T10:24:32.598414+0000","last_clean":"2024-04-26T10:24:32.598414+0000","last_became_active":"2024-04-26T10:24:22.546052+0000","last_became_peered":"2024-04-26T10:24:22.546052+0000","last_unstale":"2024-04-26T10:24:32.598414+0000","last_undegraded":"2024-04-26T10:24:32.598414+0000","last_fullsized":"2024-04-26T10:24:32.598414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:26.334069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597042+0000","last_change":"2024-04-26T10:24:22.547981+0000","last_active":"2024-04-26T10:24:32.597042+0000","last_peered":"2024-04-26T10:24:32.597042+0000","last_clean":"2024-04-26T10:24:32.597042+0000","last_became_active":"2024-04-26T10:24:22.547663+0000","last_became_peered":"2024-04-26T10:24:22.547663+0000","last_unstale":"2024-04-26T10:24:32.597042+0000","last_undegraded":"2024-04-26T10:24:32.597042+0000","last_fullsized":"2024-04-26T10:24:32.597042+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:07.105037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.743605+0000","last_change":"2024-04-26T10:22:09.749283+0000","last_active":"2024-04-26T10:24:32.743605+0000","last_peered":"2024-04-26T10:24:32.743605+0000","last_clean":"2024-04-26T10:24:32.743605+0000","last_became_active":"2024-04-26T10:22:09.748755+0000","last_became_peered":"2024-04-26T10:22:09.748755+0000","last_unstale":"2024-04-26T10:24:32.743605+0000","last_undegraded":"2024-04-26T10:24:32.743605+0000","last_fullsized":"2024-04-26T10:24:32.743605+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:40.910715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317029+0000","last_change":"2024-04-26T10:24:22.684668+0000","last_active":"2024-04-26T10:24:33.317029+0000","last_peered":"2024-04-26T10:24:33.317029+0000","last_clean":"2024-04-26T10:24:33.317029+0000","last_became_active":"2024-04-26T10:24:22.683921+0000","last_became_peered":"2024-04-26T10:24:22.683921+0000","last_unstale":"2024-04-26T10:24:33.317029+0000","last_undegraded":"2024-04-26T10:24:33.317029+0000","last_fullsized":"2024-04-26T10:24:33.317029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.930781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":85,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.749646+0000","last_change":"2024-04-26T10:24:22.535052+0000","last_active":"2024-04-26T10:24:32.749646+0000","last_peered":"2024-04-26T10:24:32.749646+0000","last_clean":"2024-04-26T10:24:32.749646+0000","last_became_active":"2024-04-26T10:24:22.534674+0000","last_became_peered":"2024-04-26T10:24:22.534674+0000","last_unstale":"2024-04-26T10:24:32.749646+0000","last_undegraded":"2024-04-26T10:24:32.749646+0000","last_fullsized":"2024-04-26T10:24:32.749646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:10.969425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183059+0000","last_change":"2024-04-26T10:24:31.601262+0000","last_active":"2024-04-26T10:24:33.183059+0000","last_peered":"2024-04-26T10:24:33.183059+0000","last_clean":"2024-04-26T10:24:33.183059+0000","last_became_active":"2024-04-26T10:24:31.600815+0000","last_became_peered":"2024-04-26T10:24:31.600815+0000","last_unstale":"2024-04-26T10:24:33.183059+0000","last_undegraded":"2024-04-26T10:24:33.183059+0000","last_fullsized":"2024-04-26T10:24:33.183059+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:02.552727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319258+0000","last_change":"2024-04-26T10:24:22.684739+0000","last_active":"2024-04-26T10:24:33.319258+0000","last_peered":"2024-04-26T10:24:33.319258+0000","last_clean":"2024-04-26T10:24:33.319258+0000","last_became_active":"2024-04-26T10:24:22.683959+0000","last_became_peered":"2024-04-26T10:24:22.683959+0000","last_unstale":"2024-04-26T10:24:33.319258+0000","last_undegraded":"2024-04-26T10:24:33.319258+0000","last_fullsized":"2024-04-26T10:24:33.319258+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:07.840236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":78,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599362+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:24:32.599362+0000","last_peered":"2024-04-26T10:24:32.599362+0000","last_clean":"2024-04-26T10:24:32.599362+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:24:32.599362+0000","last_undegraded":"2024-04-26T10:24:32.599362+0000","last_fullsized":"2024-04-26T10:24:32.599362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:39.394937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182858+0000","last_change":"2024-04-26T10:24:31.602078+0000","last_active":"2024-04-26T10:24:33.182858+0000","last_peered":"2024-04-26T10:24:33.182858+0000","last_clean":"2024-04-26T10:24:33.182858+0000","last_became_active":"2024-04-26T10:24:31.601299+0000","last_became_peered":"2024-04-26T10:24:31.601299+0000","last_unstale":"2024-04-26T10:24:33.182858+0000","last_undegraded":"2024-04-26T10:24:33.182858+0000","last_fullsized":"2024-04-26T10:24:33.182858+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:43.374493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317271+0000","last_change":"2024-04-26T10:24:31.741152+0000","last_active":"2024-04-26T10:24:33.317271+0000","last_peered":"2024-04-26T10:24:33.317271+0000","last_clean":"2024-04-26T10:24:33.317271+0000","last_became_active":"2024-04-26T10:24:31.740626+0000","last_became_peered":"2024-04-26T10:24:31.740626+0000","last_unstale":"2024-04-26T10:24:33.317271+0000","last_undegraded":"2024-04-26T10:24:33.317271+0000","last_fullsized":"2024-04-26T10:24:33.317271+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:23.323149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.743742+0000","last_change":"2024-04-26T10:22:09.750562+0000","last_active":"2024-04-26T10:24:32.743742+0000","last_peered":"2024-04-26T10:24:32.743742+0000","last_clean":"2024-04-26T10:24:32.743742+0000","last_became_active":"2024-04-26T10:22:09.750286+0000","last_became_peered":"2024-04-26T10:22:09.750286+0000","last_unstale":"2024-04-26T10:24:32.743742+0000","last_undegraded":"2024-04-26T10:24:32.743742+0000","last_fullsized":"2024-04-26T10:24:32.743742+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:52.795517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317979+0000","last_change":"2024-04-26T10:24:31.741008+0000","last_active":"2024-04-26T10:24:33.317979+0000","last_peered":"2024-04-26T10:24:33.317979+0000","last_clean":"2024-04-26T10:24:33.317979+0000","last_became_active":"2024-04-26T10:24:31.740518+0000","last_became_peered":"2024-04-26T10:24:31.740518+0000","last_unstale":"2024-04-26T10:24:33.317979+0000","last_undegraded":"2024-04-26T10:24:33.317979+0000","last_fullsized":"2024-04-26T10:24:33.317979+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:11:59.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596725+0000","last_change":"2024-04-26T10:24:22.540161+0000","last_active":"2024-04-26T10:24:32.596725+0000","last_peered":"2024-04-26T10:24:32.596725+0000","last_clean":"2024-04-26T10:24:32.596725+0000","last_became_active":"2024-04-26T10:24:22.539106+0000","last_became_peered":"2024-04-26T10:24:22.539106+0000","last_unstale":"2024-04-26T10:24:32.596725+0000","last_undegraded":"2024-04-26T10:24:32.596725+0000","last_fullsized":"2024-04-26T10:24:32.596725+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:09.208422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182259+0000","last_change":"2024-04-26T10:24:31.599487+0000","last_active":"2024-04-26T10:24:33.182259+0000","last_peered":"2024-04-26T10:24:33.182259+0000","last_clean":"2024-04-26T10:24:33.182259+0000","last_became_active":"2024-04-26T10:24:31.598307+0000","last_became_peered":"2024-04-26T10:24:31.598307+0000","last_unstale":"2024-04-26T10:24:33.182259+0000","last_undegraded":"2024-04-26T10:24:33.182259+0000","last_fullsized":"2024-04-26T10:24:33.182259+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:11.881961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":94,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596974+0000","last_change":"2024-04-26T10:24:22.547974+0000","last_active":"2024-04-26T10:24:32.596974+0000","last_peered":"2024-04-26T10:24:32.596974+0000","last_clean":"2024-04-26T10:24:32.596974+0000","last_became_active":"2024-04-26T10:24:22.546794+0000","last_became_peered":"2024-04-26T10:24:22.546794+0000","last_unstale":"2024-04-26T10:24:32.596974+0000","last_undegraded":"2024-04-26T10:24:32.596974+0000","last_fullsized":"2024-04-26T10:24:32.596974+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:28.897600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182230+0000","last_change":"2024-04-26T10:24:31.597848+0000","last_active":"2024-04-26T10:24:33.182230+0000","last_peered":"2024-04-26T10:24:33.182230+0000","last_clean":"2024-04-26T10:24:33.182230+0000","last_became_active":"2024-04-26T10:24:31.596297+0000","last_became_peered":"2024-04-26T10:24:31.596297+0000","last_unstale":"2024-04-26T10:24:33.182230+0000","last_undegraded":"2024-04-26T10:24:33.182230+0000","last_fullsized":"2024-04-26T10:24:33.182230+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:09.585450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317333+0000","last_change":"2024-04-26T10:24:22.684913+0000","last_active":"2024-04-26T10:24:33.317333+0000","last_peered":"2024-04-26T10:24:33.317333+0000","last_clean":"2024-04-26T10:24:33.317333+0000","last_became_active":"2024-04-26T10:24:22.684541+0000","last_became_peered":"2024-04-26T10:24:22.684541+0000","last_unstale":"2024-04-26T10:24:33.317333+0000","last_undegraded":"2024-04-26T10:24:33.317333+0000","last_fullsized":"2024-04-26T10:24:33.317333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:32.802131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318520+0000","last_change":"2024-04-26T10:24:22.683787+0000","last_active":"2024-04-26T10:24:33.318520+0000","last_peered":"2024-04-26T10:24:33.318520+0000","last_clean":"2024-04-26T10:24:33.318520+0000","last_became_active":"2024-04-26T10:24:22.682650+0000","last_became_peered":"2024-04-26T10:24:22.682650+0000","last_unstale":"2024-04-26T10:24:33.318520+0000","last_undegraded":"2024-04-26T10:24:33.318520+0000","last_fullsized":"2024-04-26T10:24:33.318520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:29.301512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.180845+0000","last_change":"2024-04-26T10:24:31.601959+0000","last_active":"2024-04-26T10:24:33.180845+0000","last_peered":"2024-04-26T10:24:33.180845+0000","last_clean":"2024-04-26T10:24:33.180845+0000","last_became_active":"2024-04-26T10:24:31.601091+0000","last_became_peered":"2024-04-26T10:24:31.601091+0000","last_unstale":"2024-04-26T10:24:33.180845+0000","last_undegraded":"2024-04-26T10:24:33.180845+0000","last_fullsized":"2024-04-26T10:24:33.180845+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:46.182880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318431+0000","last_change":"2024-04-26T10:24:22.684603+0000","last_active":"2024-04-26T10:24:33.318431+0000","last_peered":"2024-04-26T10:24:33.318431+0000","last_clean":"2024-04-26T10:24:33.318431+0000","last_became_active":"2024-04-26T10:24:22.684213+0000","last_became_peered":"2024-04-26T10:24:22.684213+0000","last_unstale":"2024-04-26T10:24:33.318431+0000","last_undegraded":"2024-04-26T10:24:33.318431+0000","last_fullsized":"2024-04-26T10:24:33.318431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:41.006428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":133,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596275+0000","last_change":"2024-04-26T10:24:31.613086+0000","last_active":"2024-04-26T10:24:32.596275+0000","last_peered":"2024-04-26T10:24:32.596275+0000","last_clean":"2024-04-26T10:24:32.596275+0000","last_became_active":"2024-04-26T10:24:31.604402+0000","last_became_peered":"2024-04-26T10:24:31.604402+0000","last_unstale":"2024-04-26T10:24:32.596275+0000","last_undegraded":"2024-04-26T10:24:32.596275+0000","last_fullsized":"2024-04-26T10:24:32.596275+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:52.355783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":114,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599278+0000","last_change":"2024-04-26T10:24:31.624641+0000","last_active":"2024-04-26T10:24:32.599278+0000","last_peered":"2024-04-26T10:24:32.599278+0000","last_clean":"2024-04-26T10:24:32.599278+0000","last_became_active":"2024-04-26T10:24:31.604744+0000","last_became_peered":"2024-04-26T10:24:31.604744+0000","last_unstale":"2024-04-26T10:24:32.599278+0000","last_undegraded":"2024-04-26T10:24:32.599278+0000","last_fullsized":"2024-04-26T10:24:32.599278+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:44.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.749706+0000","last_change":"2024-04-26T10:22:09.750173+0000","last_active":"2024-04-26T10:24:32.749706+0000","last_peered":"2024-04-26T10:24:32.749706+0000","last_clean":"2024-04-26T10:24:32.749706+0000","last_became_active":"2024-04-26T10:22:09.749862+0000","last_became_peered":"2024-04-26T10:22:09.749862+0000","last_unstale":"2024-04-26T10:24:32.749706+0000","last_undegraded":"2024-04-26T10:24:32.749706+0000","last_fullsized":"2024-04-26T10:24:32.749706+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:53.204364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":72,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744851+0000","last_change":"2024-04-26T10:22:09.750224+0000","last_active":"2024-04-26T10:24:32.744851+0000","last_peered":"2024-04-26T10:24:32.744851+0000","last_clean":"2024-04-26T10:24:32.744851+0000","last_became_active":"2024-04-26T10:22:09.749852+0000","last_became_peered":"2024-04-26T10:22:09.749852+0000","last_unstale":"2024-04-26T10:24:32.744851+0000","last_undegraded":"2024-04-26T10:24:32.744851+0000","last_fullsized":"2024-04-26T10:24:32.744851+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:44.923542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.180773+0000","last_change":"2024-04-26T10:24:31.597157+0000","last_active":"2024-04-26T10:24:33.180773+0000","last_peered":"2024-04-26T10:24:33.180773+0000","last_clean":"2024-04-26T10:24:33.180773+0000","last_became_active":"2024-04-26T10:24:31.596335+0000","last_became_peered":"2024-04-26T10:24:31.596335+0000","last_unstale":"2024-04-26T10:24:33.180773+0000","last_undegraded":"2024-04-26T10:24:33.180773+0000","last_fullsized":"2024-04-26T10:24:33.180773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:07.652892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":80,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.598951+0000","last_change":"2024-04-26T10:21:08.935133+0000","last_active":"2024-04-26T10:24:32.598951+0000","last_peered":"2024-04-26T10:24:32.598951+0000","last_clean":"2024-04-26T10:24:32.598951+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:24:32.598951+0000","last_undegraded":"2024-04-26T10:24:32.598951+0000","last_fullsized":"2024-04-26T10:24:32.598951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:25.498249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596919+0000","last_change":"2024-04-26T10:24:22.549411+0000","last_active":"2024-04-26T10:24:32.596919+0000","last_peered":"2024-04-26T10:24:32.596919+0000","last_clean":"2024-04-26T10:24:32.596919+0000","last_became_active":"2024-04-26T10:24:22.549230+0000","last_became_peered":"2024-04-26T10:24:22.549230+0000","last_unstale":"2024-04-26T10:24:32.596919+0000","last_undegraded":"2024-04-26T10:24:32.596919+0000","last_fullsized":"2024-04-26T10:24:32.596919+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:00.343304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.598250+0000","last_change":"2024-04-26T10:24:22.541409+0000","last_active":"2024-04-26T10:24:32.598250+0000","last_peered":"2024-04-26T10:24:32.598250+0000","last_clean":"2024-04-26T10:24:32.598250+0000","last_became_active":"2024-04-26T10:24:22.540611+0000","last_became_peered":"2024-04-26T10:24:22.540611+0000","last_unstale":"2024-04-26T10:24:32.598250+0000","last_undegraded":"2024-04-26T10:24:32.598250+0000","last_fullsized":"2024-04-26T10:24:32.598250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:48.882187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319142+0000","last_change":"2024-04-26T10:24:22.687178+0000","last_active":"2024-04-26T10:24:33.319142+0000","last_peered":"2024-04-26T10:24:33.319142+0000","last_clean":"2024-04-26T10:24:33.319142+0000","last_became_active":"2024-04-26T10:24:22.686841+0000","last_became_peered":"2024-04-26T10:24:22.686841+0000","last_unstale":"2024-04-26T10:24:33.319142+0000","last_undegraded":"2024-04-26T10:24:33.319142+0000","last_fullsized":"2024-04-26T10:24:33.319142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:52.907696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318078+0000","last_change":"2024-04-26T10:24:22.687183+0000","last_active":"2024-04-26T10:24:33.318078+0000","last_peered":"2024-04-26T10:24:33.318078+0000","last_clean":"2024-04-26T10:24:33.318078+0000","last_became_active":"2024-04-26T10:24:22.686846+0000","last_became_peered":"2024-04-26T10:24:22.686846+0000","last_unstale":"2024-04-26T10:24:33.318078+0000","last_undegraded":"2024-04-26T10:24:33.318078+0000","last_fullsized":"2024-04-26T10:24:33.318078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:37.083683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.598176+0000","last_change":"2024-04-26T10:24:22.546117+0000","last_active":"2024-04-26T10:24:32.598176+0000","last_peered":"2024-04-26T10:24:32.598176+0000","last_clean":"2024-04-26T10:24:32.598176+0000","last_became_active":"2024-04-26T10:24:22.545616+0000","last_became_peered":"2024-04-26T10:24:22.545616+0000","last_unstale":"2024-04-26T10:24:32.598176+0000","last_undegraded":"2024-04-26T10:24:32.598176+0000","last_fullsized":"2024-04-26T10:24:32.598176+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:09.247826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597257+0000","last_change":"2024-04-26T10:24:22.540185+0000","last_active":"2024-04-26T10:24:32.597257+0000","last_peered":"2024-04-26T10:24:32.597257+0000","last_clean":"2024-04-26T10:24:32.597257+0000","last_became_active":"2024-04-26T10:24:22.538982+0000","last_became_peered":"2024-04-26T10:24:22.538982+0000","last_unstale":"2024-04-26T10:24:32.597257+0000","last_undegraded":"2024-04-26T10:24:32.597257+0000","last_fullsized":"2024-04-26T10:24:32.597257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:27.225284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":78,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.598908+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:24:32.598908+0000","last_peered":"2024-04-26T10:24:32.598908+0000","last_clean":"2024-04-26T10:24:32.598908+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:24:32.598908+0000","last_undegraded":"2024-04-26T10:24:32.598908+0000","last_fullsized":"2024-04-26T10:24:32.598908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":70,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.743499+0000","last_change":"2024-04-26T10:22:09.748616+0000","last_active":"2024-04-26T10:24:32.743499+0000","last_peered":"2024-04-26T10:24:32.743499+0000","last_clean":"2024-04-26T10:24:32.743499+0000","last_became_active":"2024-04-26T10:22:09.748256+0000","last_became_peered":"2024-04-26T10:22:09.748256+0000","last_unstale":"2024-04-26T10:24:32.743499+0000","last_undegraded":"2024-04-26T10:24:32.743499+0000","last_fullsized":"2024-04-26T10:24:32.743499+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:19.402647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597229+0000","last_change":"2024-04-26T10:24:31.604150+0000","last_active":"2024-04-26T10:24:32.597229+0000","last_peered":"2024-04-26T10:24:32.597229+0000","last_clean":"2024-04-26T10:24:32.597229+0000","last_became_active":"2024-04-26T10:24:31.603620+0000","last_became_peered":"2024-04-26T10:24:31.603620+0000","last_unstale":"2024-04-26T10:24:32.597229+0000","last_undegraded":"2024-04-26T10:24:32.597229+0000","last_fullsized":"2024-04-26T10:24:32.597229+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:17.085344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181993+0000","last_change":"2024-04-26T10:24:31.598521+0000","last_active":"2024-04-26T10:24:33.181993+0000","last_peered":"2024-04-26T10:24:33.181993+0000","last_clean":"2024-04-26T10:24:33.181993+0000","last_became_active":"2024-04-26T10:24:31.598120+0000","last_became_peered":"2024-04-26T10:24:31.598120+0000","last_unstale":"2024-04-26T10:24:33.181993+0000","last_undegraded":"2024-04-26T10:24:33.181993+0000","last_fullsized":"2024-04-26T10:24:33.181993+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:23.723355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319166+0000","last_change":"2024-04-26T10:24:22.680557+0000","last_active":"2024-04-26T10:24:33.319166+0000","last_peered":"2024-04-26T10:24:33.319166+0000","last_clean":"2024-04-26T10:24:33.319166+0000","last_became_active":"2024-04-26T10:24:22.679940+0000","last_became_peered":"2024-04-26T10:24:22.679940+0000","last_unstale":"2024-04-26T10:24:33.319166+0000","last_undegraded":"2024-04-26T10:24:33.319166+0000","last_fullsized":"2024-04-26T10:24:33.319166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:06.379234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":325,"reported_epoch":90,"state":"peering","last_fresh":"2024-04-26T10:24:33.174823+0000","last_change":"2024-04-26T10:24:33.175683+0000","last_active":"2024-04-26T10:24:33.174823+0000","last_peered":"2024-04-26T10:24:32.759338+0000","last_clean":"2024-04-26T10:24:29.608470+0000","last_became_active":"2024-04-26T10:24:32.749223+0000","last_became_peered":"2024-04-26T10:24:32.749223+0000","last_unstale":"2024-04-26T10:24:33.174823+0000","last_undegraded":"2024-04-26T10:24:33.174823+0000","last_fullsized":"2024-04-26T10:24:33.174823+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:07.600717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":95,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596699+0000","last_change":"2024-04-26T10:24:22.547708+0000","last_active":"2024-04-26T10:24:32.596699+0000","last_peered":"2024-04-26T10:24:32.596699+0000","last_clean":"2024-04-26T10:24:32.596699+0000","last_became_active":"2024-04-26T10:24:22.546650+0000","last_became_peered":"2024-04-26T10:24:22.546650+0000","last_unstale":"2024-04-26T10:24:32.596699+0000","last_undegraded":"2024-04-26T10:24:32.596699+0000","last_fullsized":"2024-04-26T10:24:32.596699+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:55.474931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317752+0000","last_change":"2024-04-26T10:24:22.676755+0000","last_active":"2024-04-26T10:24:33.317752+0000","last_peered":"2024-04-26T10:24:33.317752+0000","last_clean":"2024-04-26T10:24:33.317752+0000","last_became_active":"2024-04-26T10:24:22.676489+0000","last_became_peered":"2024-04-26T10:24:22.676489+0000","last_unstale":"2024-04-26T10:24:33.317752+0000","last_undegraded":"2024-04-26T10:24:33.317752+0000","last_fullsized":"2024-04-26T10:24:33.317752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:38.979532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599143+0000","last_change":"2024-04-26T10:24:31.603833+0000","last_active":"2024-04-26T10:24:32.599143+0000","last_peered":"2024-04-26T10:24:32.599143+0000","last_clean":"2024-04-26T10:24:32.599143+0000","last_became_active":"2024-04-26T10:24:31.603498+0000","last_became_peered":"2024-04-26T10:24:31.603498+0000","last_unstale":"2024-04-26T10:24:32.599143+0000","last_undegraded":"2024-04-26T10:24:32.599143+0000","last_fullsized":"2024-04-26T10:24:32.599143+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:58.952460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":108,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597168+0000","last_change":"2024-04-26T10:24:31.603067+0000","last_active":"2024-04-26T10:24:32.597168+0000","last_peered":"2024-04-26T10:24:32.597168+0000","last_clean":"2024-04-26T10:24:32.597168+0000","last_became_active":"2024-04-26T10:24:31.602611+0000","last_became_peered":"2024-04-26T10:24:31.602611+0000","last_unstale":"2024-04-26T10:24:32.597168+0000","last_undegraded":"2024-04-26T10:24:32.597168+0000","last_fullsized":"2024-04-26T10:24:32.597168+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:14.943135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316711+0000","last_change":"2024-04-26T10:24:22.685554+0000","last_active":"2024-04-26T10:24:33.316711+0000","last_peered":"2024-04-26T10:24:33.316711+0000","last_clean":"2024-04-26T10:24:33.316711+0000","last_became_active":"2024-04-26T10:24:22.685051+0000","last_became_peered":"2024-04-26T10:24:22.685051+0000","last_unstale":"2024-04-26T10:24:33.316711+0000","last_undegraded":"2024-04-26T10:24:33.316711+0000","last_fullsized":"2024-04-26T10:24:33.316711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:59.389895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":85,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744680+0000","last_change":"2024-04-26T10:24:22.538294+0000","last_active":"2024-04-26T10:24:32.744680+0000","last_peered":"2024-04-26T10:24:32.744680+0000","last_clean":"2024-04-26T10:24:32.744680+0000","last_became_active":"2024-04-26T10:24:22.537983+0000","last_became_peered":"2024-04-26T10:24:22.537983+0000","last_unstale":"2024-04-26T10:24:32.744680+0000","last_undegraded":"2024-04-26T10:24:32.744680+0000","last_fullsized":"2024-04-26T10:24:32.744680+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:54.064158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317277+0000","last_change":"2024-04-26T10:24:22.679231+0000","last_active":"2024-04-26T10:24:33.317277+0000","last_peered":"2024-04-26T10:24:33.317277+0000","last_clean":"2024-04-26T10:24:33.317277+0000","last_became_active":"2024-04-26T10:24:22.678866+0000","last_became_peered":"2024-04-26T10:24:22.678866+0000","last_unstale":"2024-04-26T10:24:33.317277+0000","last_undegraded":"2024-04-26T10:24:33.317277+0000","last_fullsized":"2024-04-26T10:24:33.317277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:26.179423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":70,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.749762+0000","last_change":"2024-04-26T10:22:09.750297+0000","last_active":"2024-04-26T10:24:32.749762+0000","last_peered":"2024-04-26T10:24:32.749762+0000","last_clean":"2024-04-26T10:24:32.749762+0000","last_became_active":"2024-04-26T10:22:09.749935+0000","last_became_peered":"2024-04-26T10:22:09.749935+0000","last_unstale":"2024-04-26T10:24:32.749762+0000","last_undegraded":"2024-04-26T10:24:32.749762+0000","last_fullsized":"2024-04-26T10:24:32.749762+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:51.197306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319145+0000","last_change":"2024-04-26T10:24:31.745820+0000","last_active":"2024-04-26T10:24:33.319145+0000","last_peered":"2024-04-26T10:24:33.319145+0000","last_clean":"2024-04-26T10:24:33.319145+0000","last_became_active":"2024-04-26T10:24:31.745487+0000","last_became_peered":"2024-04-26T10:24:31.745487+0000","last_unstale":"2024-04-26T10:24:33.319145+0000","last_undegraded":"2024-04-26T10:24:33.319145+0000","last_fullsized":"2024-04-26T10:24:33.319145+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:00.239650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":95,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597357+0000","last_change":"2024-04-26T10:24:22.539761+0000","last_active":"2024-04-26T10:24:32.597357+0000","last_peered":"2024-04-26T10:24:32.597357+0000","last_clean":"2024-04-26T10:24:32.597357+0000","last_became_active":"2024-04-26T10:24:22.538993+0000","last_became_peered":"2024-04-26T10:24:22.538993+0000","last_unstale":"2024-04-26T10:24:32.597357+0000","last_undegraded":"2024-04-26T10:24:32.597357+0000","last_fullsized":"2024-04-26T10:24:32.597357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:24.782191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596822+0000","last_change":"2024-04-26T10:24:22.542774+0000","last_active":"2024-04-26T10:24:32.596822+0000","last_peered":"2024-04-26T10:24:32.596822+0000","last_clean":"2024-04-26T10:24:32.596822+0000","last_became_active":"2024-04-26T10:24:22.541795+0000","last_became_peered":"2024-04-26T10:24:22.541795+0000","last_unstale":"2024-04-26T10:24:32.596822+0000","last_undegraded":"2024-04-26T10:24:32.596822+0000","last_fullsized":"2024-04-26T10:24:32.596822+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:07.303056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317944+0000","last_change":"2024-04-26T10:24:31.744717+0000","last_active":"2024-04-26T10:24:33.317944+0000","last_peered":"2024-04-26T10:24:33.317944+0000","last_clean":"2024-04-26T10:24:33.317944+0000","last_became_active":"2024-04-26T10:24:31.744373+0000","last_became_peered":"2024-04-26T10:24:31.744373+0000","last_unstale":"2024-04-26T10:24:33.317944+0000","last_undegraded":"2024-04-26T10:24:33.317944+0000","last_fullsized":"2024-04-26T10:24:33.317944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:10.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597810+0000","last_change":"2024-04-26T10:24:22.538573+0000","last_active":"2024-04-26T10:24:32.597810+0000","last_peered":"2024-04-26T10:24:32.597810+0000","last_clean":"2024-04-26T10:24:32.597810+0000","last_became_active":"2024-04-26T10:24:22.537041+0000","last_became_peered":"2024-04-26T10:24:22.537041+0000","last_unstale":"2024-04-26T10:24:32.597810+0000","last_undegraded":"2024-04-26T10:24:32.597810+0000","last_fullsized":"2024-04-26T10:24:32.597810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:48.026637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318800+0000","last_change":"2024-04-26T10:24:31.744776+0000","last_active":"2024-04-26T10:24:33.318800+0000","last_peered":"2024-04-26T10:24:33.318800+0000","last_clean":"2024-04-26T10:24:33.318800+0000","last_became_active":"2024-04-26T10:24:31.744342+0000","last_became_peered":"2024-04-26T10:24:31.744342+0000","last_unstale":"2024-04-26T10:24:33.318800+0000","last_undegraded":"2024-04-26T10:24:33.318800+0000","last_fullsized":"2024-04-26T10:24:33.318800+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:08:33.941367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.180923+0000","last_change":"2024-04-26T10:24:31.599193+0000","last_active":"2024-04-26T10:24:33.180923+0000","last_peered":"2024-04-26T10:24:33.180923+0000","last_clean":"2024-04-26T10:24:33.180923+0000","last_became_active":"2024-04-26T10:24:31.598432+0000","last_became_peered":"2024-04-26T10:24:31.598432+0000","last_unstale":"2024-04-26T10:24:33.180923+0000","last_undegraded":"2024-04-26T10:24:33.180923+0000","last_fullsized":"2024-04-26T10:24:33.180923+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:41.515775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318555+0000","last_change":"2024-04-26T10:24:31.745336+0000","last_active":"2024-04-26T10:24:33.318555+0000","last_peered":"2024-04-26T10:24:33.318555+0000","last_clean":"2024-04-26T10:24:33.318555+0000","last_became_active":"2024-04-26T10:24:31.745004+0000","last_became_peered":"2024-04-26T10:24:31.745004+0000","last_unstale":"2024-04-26T10:24:33.318555+0000","last_undegraded":"2024-04-26T10:24:33.318555+0000","last_fullsized":"2024-04-26T10:24:33.318555+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:15.275549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183054+0000","last_change":"2024-04-26T10:24:31.601585+0000","last_active":"2024-04-26T10:24:33.183054+0000","last_peered":"2024-04-26T10:24:33.183054+0000","last_clean":"2024-04-26T10:24:33.183054+0000","last_became_active":"2024-04-26T10:24:31.600977+0000","last_became_peered":"2024-04-26T10:24:31.600977+0000","last_unstale":"2024-04-26T10:24:33.183054+0000","last_undegraded":"2024-04-26T10:24:33.183054+0000","last_fullsized":"2024-04-26T10:24:33.183054+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.329801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744310+0000","last_change":"2024-04-26T10:22:09.758116+0000","last_active":"2024-04-26T10:24:32.744310+0000","last_peered":"2024-04-26T10:24:32.744310+0000","last_clean":"2024-04-26T10:24:32.744310+0000","last_became_active":"2024-04-26T10:22:09.757813+0000","last_became_peered":"2024-04-26T10:22:09.757813+0000","last_unstale":"2024-04-26T10:24:32.744310+0000","last_undegraded":"2024-04-26T10:24:32.744310+0000","last_fullsized":"2024-04-26T10:24:32.744310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:01.195987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318177+0000","last_change":"2024-04-26T10:24:22.680137+0000","last_active":"2024-04-26T10:24:33.318177+0000","last_peered":"2024-04-26T10:24:33.318177+0000","last_clean":"2024-04-26T10:24:33.318177+0000","last_became_active":"2024-04-26T10:24:22.679497+0000","last_became_peered":"2024-04-26T10:24:22.679497+0000","last_unstale":"2024-04-26T10:24:33.318177+0000","last_undegraded":"2024-04-26T10:24:33.318177+0000","last_fullsized":"2024-04-26T10:24:33.318177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:00.401135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318093+0000","last_change":"2024-04-26T10:24:31.741102+0000","last_active":"2024-04-26T10:24:33.318093+0000","last_peered":"2024-04-26T10:24:33.318093+0000","last_clean":"2024-04-26T10:24:33.318093+0000","last_became_active":"2024-04-26T10:24:31.740589+0000","last_became_peered":"2024-04-26T10:24:31.740589+0000","last_unstale":"2024-04-26T10:24:33.318093+0000","last_undegraded":"2024-04-26T10:24:33.318093+0000","last_fullsized":"2024-04-26T10:24:33.318093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:38.170544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317410+0000","last_change":"2024-04-26T10:24:22.686404+0000","last_active":"2024-04-26T10:24:33.317410+0000","last_peered":"2024-04-26T10:24:33.317410+0000","last_clean":"2024-04-26T10:24:33.317410+0000","last_became_active":"2024-04-26T10:24:22.686094+0000","last_became_peered":"2024-04-26T10:24:22.686094+0000","last_unstale":"2024-04-26T10:24:33.317410+0000","last_undegraded":"2024-04-26T10:24:33.317410+0000","last_fullsized":"2024-04-26T10:24:33.317410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:37.911705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318296+0000","last_change":"2024-04-26T10:24:22.682344+0000","last_active":"2024-04-26T10:24:33.318296+0000","last_peered":"2024-04-26T10:24:33.318296+0000","last_clean":"2024-04-26T10:24:33.318296+0000","last_became_active":"2024-04-26T10:24:22.681977+0000","last_became_peered":"2024-04-26T10:24:22.681977+0000","last_unstale":"2024-04-26T10:24:33.318296+0000","last_undegraded":"2024-04-26T10:24:33.318296+0000","last_fullsized":"2024-04-26T10:24:33.318296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:56.544667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":108,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.599518+0000","last_change":"2024-04-26T10:24:31.605320+0000","last_active":"2024-04-26T10:24:32.599518+0000","last_peered":"2024-04-26T10:24:32.599518+0000","last_clean":"2024-04-26T10:24:32.599518+0000","last_became_active":"2024-04-26T10:24:31.604158+0000","last_became_peered":"2024-04-26T10:24:31.604158+0000","last_unstale":"2024-04-26T10:24:32.599518+0000","last_undegraded":"2024-04-26T10:24:32.599518+0000","last_fullsized":"2024-04-26T10:24:32.599518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:53.955856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181706+0000","last_change":"2024-04-26T10:24:31.601291+0000","last_active":"2024-04-26T10:24:33.181706+0000","last_peered":"2024-04-26T10:24:33.181706+0000","last_clean":"2024-04-26T10:24:33.181706+0000","last_became_active":"2024-04-26T10:24:31.600474+0000","last_became_peered":"2024-04-26T10:24:31.600474+0000","last_unstale":"2024-04-26T10:24:33.181706+0000","last_undegraded":"2024-04-26T10:24:33.181706+0000","last_fullsized":"2024-04-26T10:24:33.181706+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:30.284416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":104,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597907+0000","last_change":"2024-04-26T10:24:31.604975+0000","last_active":"2024-04-26T10:24:32.597907+0000","last_peered":"2024-04-26T10:24:32.597907+0000","last_clean":"2024-04-26T10:24:32.597907+0000","last_became_active":"2024-04-26T10:24:31.604609+0000","last_became_peered":"2024-04-26T10:24:31.604609+0000","last_unstale":"2024-04-26T10:24:32.597907+0000","last_undegraded":"2024-04-26T10:24:32.597907+0000","last_fullsized":"2024-04-26T10:24:32.597907+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:04.412544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":131,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597647+0000","last_change":"2024-04-26T10:24:31.622111+0000","last_active":"2024-04-26T10:24:32.597647+0000","last_peered":"2024-04-26T10:24:32.597647+0000","last_clean":"2024-04-26T10:24:32.597647+0000","last_became_active":"2024-04-26T10:24:31.604884+0000","last_became_peered":"2024-04-26T10:24:31.604884+0000","last_unstale":"2024-04-26T10:24:32.597647+0000","last_undegraded":"2024-04-26T10:24:32.597647+0000","last_fullsized":"2024-04-26T10:24:32.597647+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:18.600081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317264+0000","last_change":"2024-04-26T10:24:31.739955+0000","last_active":"2024-04-26T10:24:33.317264+0000","last_peered":"2024-04-26T10:24:33.317264+0000","last_clean":"2024-04-26T10:24:33.317264+0000","last_became_active":"2024-04-26T10:24:31.739550+0000","last_became_peered":"2024-04-26T10:24:31.739550+0000","last_unstale":"2024-04-26T10:24:33.317264+0000","last_undegraded":"2024-04-26T10:24:33.317264+0000","last_fullsized":"2024-04-26T10:24:33.317264+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:31.253486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182681+0000","last_change":"2024-04-26T10:24:31.609788+0000","last_active":"2024-04-26T10:24:33.182681+0000","last_peered":"2024-04-26T10:24:33.182681+0000","last_clean":"2024-04-26T10:24:33.182681+0000","last_became_active":"2024-04-26T10:24:31.601218+0000","last_became_peered":"2024-04-26T10:24:31.601218+0000","last_unstale":"2024-04-26T10:24:33.182681+0000","last_undegraded":"2024-04-26T10:24:33.182681+0000","last_fullsized":"2024-04-26T10:24:33.182681+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:39.380483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":92,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597918+0000","last_change":"2024-04-26T10:24:22.546807+0000","last_active":"2024-04-26T10:24:32.597918+0000","last_peered":"2024-04-26T10:24:32.597918+0000","last_clean":"2024-04-26T10:24:32.597918+0000","last_became_active":"2024-04-26T10:24:22.546378+0000","last_became_peered":"2024-04-26T10:24:22.546378+0000","last_unstale":"2024-04-26T10:24:32.597918+0000","last_undegraded":"2024-04-26T10:24:32.597918+0000","last_fullsized":"2024-04-26T10:24:32.597918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:06.866157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317068+0000","last_change":"2024-04-26T10:24:22.684096+0000","last_active":"2024-04-26T10:24:33.317068+0000","last_peered":"2024-04-26T10:24:33.317068+0000","last_clean":"2024-04-26T10:24:33.317068+0000","last_became_active":"2024-04-26T10:24:22.683558+0000","last_became_peered":"2024-04-26T10:24:22.683558+0000","last_unstale":"2024-04-26T10:24:33.317068+0000","last_undegraded":"2024-04-26T10:24:33.317068+0000","last_fullsized":"2024-04-26T10:24:33.317068+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:05.316682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318841+0000","last_change":"2024-04-26T10:24:22.684541+0000","last_active":"2024-04-26T10:24:33.318841+0000","last_peered":"2024-04-26T10:24:33.318841+0000","last_clean":"2024-04-26T10:24:33.318841+0000","last_became_active":"2024-04-26T10:24:22.684166+0000","last_became_peered":"2024-04-26T10:24:22.684166+0000","last_unstale":"2024-04-26T10:24:33.318841+0000","last_undegraded":"2024-04-26T10:24:33.318841+0000","last_fullsized":"2024-04-26T10:24:33.318841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:30.164642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317049+0000","last_change":"2024-04-26T10:24:31.745539+0000","last_active":"2024-04-26T10:24:33.317049+0000","last_peered":"2024-04-26T10:24:33.317049+0000","last_clean":"2024-04-26T10:24:33.317049+0000","last_became_active":"2024-04-26T10:24:31.745216+0000","last_became_peered":"2024-04-26T10:24:31.745216+0000","last_unstale":"2024-04-26T10:24:33.317049+0000","last_undegraded":"2024-04-26T10:24:33.317049+0000","last_fullsized":"2024-04-26T10:24:33.317049+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:55.390023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.745094+0000","last_change":"2024-04-26T10:22:09.750605+0000","last_active":"2024-04-26T10:24:32.745094+0000","last_peered":"2024-04-26T10:24:32.745094+0000","last_clean":"2024-04-26T10:24:32.745094+0000","last_became_active":"2024-04-26T10:22:09.750359+0000","last_became_peered":"2024-04-26T10:22:09.750359+0000","last_unstale":"2024-04-26T10:24:32.745094+0000","last_undegraded":"2024-04-26T10:24:32.745094+0000","last_fullsized":"2024-04-26T10:24:32.745094+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:56.948741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316663+0000","last_change":"2024-04-26T10:24:31.740907+0000","last_active":"2024-04-26T10:24:33.316663+0000","last_peered":"2024-04-26T10:24:33.316663+0000","last_clean":"2024-04-26T10:24:33.316663+0000","last_became_active":"2024-04-26T10:24:31.740477+0000","last_became_peered":"2024-04-26T10:24:31.740477+0000","last_unstale":"2024-04-26T10:24:33.316663+0000","last_undegraded":"2024-04-26T10:24:33.316663+0000","last_fullsized":"2024-04-26T10:24:33.316663+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:30.206347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318888+0000","last_change":"2024-04-26T10:24:22.684108+0000","last_active":"2024-04-26T10:24:33.318888+0000","last_peered":"2024-04-26T10:24:33.318888+0000","last_clean":"2024-04-26T10:24:33.318888+0000","last_became_active":"2024-04-26T10:24:22.683501+0000","last_became_peered":"2024-04-26T10:24:22.683501+0000","last_unstale":"2024-04-26T10:24:33.318888+0000","last_undegraded":"2024-04-26T10:24:33.318888+0000","last_fullsized":"2024-04-26T10:24:33.318888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:17.355758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316745+0000","last_change":"2024-04-26T10:24:22.685228+0000","last_active":"2024-04-26T10:24:33.316745+0000","last_peered":"2024-04-26T10:24:33.316745+0000","last_clean":"2024-04-26T10:24:33.316745+0000","last_became_active":"2024-04-26T10:24:22.684469+0000","last_became_peered":"2024-04-26T10:24:22.684469+0000","last_unstale":"2024-04-26T10:24:33.316745+0000","last_undegraded":"2024-04-26T10:24:33.316745+0000","last_fullsized":"2024-04-26T10:24:33.316745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:53.834583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":69,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744530+0000","last_change":"2024-04-26T10:22:09.753136+0000","last_active":"2024-04-26T10:24:32.744530+0000","last_peered":"2024-04-26T10:24:32.744530+0000","last_clean":"2024-04-26T10:24:32.744530+0000","last_became_active":"2024-04-26T10:22:09.752856+0000","last_became_peered":"2024-04-26T10:22:09.752856+0000","last_unstale":"2024-04-26T10:24:32.744530+0000","last_undegraded":"2024-04-26T10:24:32.744530+0000","last_fullsized":"2024-04-26T10:24:32.744530+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:48.541930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":87,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.743929+0000","last_change":"2024-04-26T10:24:22.535413+0000","last_active":"2024-04-26T10:24:32.743929+0000","last_peered":"2024-04-26T10:24:32.743929+0000","last_clean":"2024-04-26T10:24:32.743929+0000","last_became_active":"2024-04-26T10:24:22.535036+0000","last_became_peered":"2024-04-26T10:24:22.535036+0000","last_unstale":"2024-04-26T10:24:32.743929+0000","last_undegraded":"2024-04-26T10:24:32.743929+0000","last_fullsized":"2024-04-26T10:24:32.743929+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:43.756504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":85,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744946+0000","last_change":"2024-04-26T10:24:22.535819+0000","last_active":"2024-04-26T10:24:32.744946+0000","last_peered":"2024-04-26T10:24:32.744946+0000","last_clean":"2024-04-26T10:24:32.744946+0000","last_became_active":"2024-04-26T10:24:22.535562+0000","last_became_peered":"2024-04-26T10:24:22.535562+0000","last_unstale":"2024-04-26T10:24:32.744946+0000","last_undegraded":"2024-04-26T10:24:32.744946+0000","last_fullsized":"2024-04-26T10:24:32.744946+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:24.845621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181500+0000","last_change":"2024-04-26T10:24:31.600594+0000","last_active":"2024-04-26T10:24:33.181500+0000","last_peered":"2024-04-26T10:24:33.181500+0000","last_clean":"2024-04-26T10:24:33.181500+0000","last_became_active":"2024-04-26T10:24:31.600121+0000","last_became_peered":"2024-04-26T10:24:31.600121+0000","last_unstale":"2024-04-26T10:24:33.181500+0000","last_undegraded":"2024-04-26T10:24:33.181500+0000","last_fullsized":"2024-04-26T10:24:33.181500+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:05.491069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.598128+0000","last_change":"2024-04-26T10:24:22.542755+0000","last_active":"2024-04-26T10:24:32.598128+0000","last_peered":"2024-04-26T10:24:32.598128+0000","last_clean":"2024-04-26T10:24:32.598128+0000","last_became_active":"2024-04-26T10:24:22.541543+0000","last_became_peered":"2024-04-26T10:24:22.541543+0000","last_unstale":"2024-04-26T10:24:32.598128+0000","last_undegraded":"2024-04-26T10:24:32.598128+0000","last_fullsized":"2024-04-26T10:24:32.598128+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:50.942528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":94,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597902+0000","last_change":"2024-04-26T10:24:22.541418+0000","last_active":"2024-04-26T10:24:32.597902+0000","last_peered":"2024-04-26T10:24:32.597902+0000","last_clean":"2024-04-26T10:24:32.597902+0000","last_became_active":"2024-04-26T10:24:22.540767+0000","last_became_peered":"2024-04-26T10:24:22.540767+0000","last_unstale":"2024-04-26T10:24:32.597902+0000","last_undegraded":"2024-04-26T10:24:32.597902+0000","last_fullsized":"2024-04-26T10:24:32.597902+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:26.684306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.597124+0000","last_change":"2024-04-26T10:24:22.547294+0000","last_active":"2024-04-26T10:24:32.597124+0000","last_peered":"2024-04-26T10:24:32.597124+0000","last_clean":"2024-04-26T10:24:32.597124+0000","last_became_active":"2024-04-26T10:24:22.546811+0000","last_became_peered":"2024-04-26T10:24:22.546811+0000","last_unstale":"2024-04-26T10:24:32.597124+0000","last_undegraded":"2024-04-26T10:24:32.597124+0000","last_fullsized":"2024-04-26T10:24:32.597124+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:03.037283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":72,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.744948+0000","last_change":"2024-04-26T10:22:09.753438+0000","last_active":"2024-04-26T10:24:32.744948+0000","last_peered":"2024-04-26T10:24:32.744948+0000","last_clean":"2024-04-26T10:24:32.744948+0000","last_became_active":"2024-04-26T10:22:09.753211+0000","last_became_peered":"2024-04-26T10:22:09.753211+0000","last_unstale":"2024-04-26T10:24:32.744948+0000","last_undegraded":"2024-04-26T10:24:32.744948+0000","last_fullsized":"2024-04-26T10:24:32.744948+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:39.406859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181346+0000","last_change":"2024-04-26T10:24:31.600935+0000","last_active":"2024-04-26T10:24:33.181346+0000","last_peered":"2024-04-26T10:24:33.181346+0000","last_clean":"2024-04-26T10:24:33.181346+0000","last_became_active":"2024-04-26T10:24:31.600088+0000","last_became_peered":"2024-04-26T10:24:31.600088+0000","last_unstale":"2024-04-26T10:24:33.181346+0000","last_undegraded":"2024-04-26T10:24:33.181346+0000","last_fullsized":"2024-04-26T10:24:33.181346+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:58.341684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319737+0000","last_change":"2024-04-26T10:24:22.680082+0000","last_active":"2024-04-26T10:24:33.319737+0000","last_peered":"2024-04-26T10:24:33.319737+0000","last_clean":"2024-04-26T10:24:33.319737+0000","last_became_active":"2024-04-26T10:24:22.679652+0000","last_became_peered":"2024-04-26T10:24:22.679652+0000","last_unstale":"2024-04-26T10:24:33.319737+0000","last_undegraded":"2024-04-26T10:24:33.319737+0000","last_fullsized":"2024-04-26T10:24:33.319737+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:37.821623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-04-26T10:24:32.596041+0000","last_change":"2024-04-26T10:24:22.540326+0000","last_active":"2024-04-26T10:24:32.596041+0000","last_peered":"2024-04-26T10:24:32.596041+0000","last_clean":"2024-04-26T10:24:32.596041+0000","last_became_active":"2024-04-26T10:24:22.538895+0000","last_became_peered":"2024-04-26T10:24:22.538895+0000","last_unstale":"2024-04-26T10:24:32.596041+0000","last_undegraded":"2024-04-26T10:24:32.596041+0000","last_fullsized":"2024-04-26T10:24:32.596041+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:29.709972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319358+0000","last_change":"2024-04-26T10:24:22.685454+0000","last_active":"2024-04-26T10:24:33.319358+0000","last_peered":"2024-04-26T10:24:33.319358+0000","last_clean":"2024-04-26T10:24:33.319358+0000","last_became_active":"2024-04-26T10:24:22.684863+0000","last_became_peered":"2024-04-26T10:24:22.684863+0000","last_unstale":"2024-04-26T10:24:33.319358+0000","last_undegraded":"2024-04-26T10:24:33.319358+0000","last_fullsized":"2024-04-26T10:24:33.319358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:33.027447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":21541,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673008,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279064,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":278014,"kb_avail":94092776,"statfs":{"total":96636764160,"available":96351002624,"internally_reserved":0,"allocated":1056768,"data_stored":1031439,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":284686790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:24:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55000000000000004,"15min":0.51600000000000001},"min":{"1min":0.25800000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.67500000000000004,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.53900000000000003},"min":{"1min":0.28000000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.754,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":0,"up_from":10,"seq":42949673007,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487460,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":486398,"kb_avail":93884380,"statfs":{"total":96636764160,"available":96137605120,"internally_reserved":0,"allocated":1073152,"data_stored":1027794,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":498072006},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:24:04 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.65600000000000003,"15min":0.56599999999999995},"min":{"1min":0.21099999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":4.1369999999999996,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.25900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.748,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":2,"up_from":80,"seq":343597383685,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38380,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":37369,"kb_avail":94333460,"statfs":{"total":96636764160,"available":96597463040,"internally_reserved":0,"allocated":1007616,"data_stored":444173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6879,"internal_metadata":38266145},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:24:40.145 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:24:40.464 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:24:40.467 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:24:40.478 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-04-26T10:24:40.042309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1184088,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":804940,"kb_used_data":3088,"kb_used_omap":9,"kb_used_meta":801782,"kb_avail":282310580,"statfs":{"total":289910292480,"available":289086033920,"internally_reserved":0,"allocated":3162112,"data_stored":2516131,"data_compressed":14075,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":10067,"internal_metadata":821024941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":592044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.449631"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974365+0000","last_change":"2024-04-26T10:24:31.598789+0000","last_active":"2024-04-26T10:24:33.974365+0000","last_peered":"2024-04-26T10:24:33.974365+0000","last_clean":"2024-04-26T10:24:33.974365+0000","last_became_active":"2024-04-26T10:24:31.598170+0000","last_became_peered":"2024-04-26T10:24:31.598170+0000","last_unstale":"2024-04-26T10:24:33.974365+0000","last_undegraded":"2024-04-26T10:24:33.974365+0000","last_fullsized":"2024-04-26T10:24:33.974365+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:46.718423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182259+0000","last_change":"2024-04-26T10:24:22.536264+0000","last_active":"2024-04-26T10:24:33.182259+0000","last_peered":"2024-04-26T10:24:33.182259+0000","last_clean":"2024-04-26T10:24:33.182259+0000","last_became_active":"2024-04-26T10:24:22.535998+0000","last_became_peered":"2024-04-26T10:24:22.535998+0000","last_unstale":"2024-04-26T10:24:33.182259+0000","last_undegraded":"2024-04-26T10:24:33.182259+0000","last_fullsized":"2024-04-26T10:24:33.182259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:54.491369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":79,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.176175+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:24:33.176175+0000","last_peered":"2024-04-26T10:24:33.176175+0000","last_clean":"2024-04-26T10:24:33.176175+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:24:33.176175+0000","last_undegraded":"2024-04-26T10:24:33.176175+0000","last_fullsized":"2024-04-26T10:24:33.176175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:01.883964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175776+0000","last_change":"2024-04-26T10:24:22.549067+0000","last_active":"2024-04-26T10:24:33.175776+0000","last_peered":"2024-04-26T10:24:33.175776+0000","last_clean":"2024-04-26T10:24:33.175776+0000","last_became_active":"2024-04-26T10:24:22.548485+0000","last_became_peered":"2024-04-26T10:24:22.548485+0000","last_unstale":"2024-04-26T10:24:33.175776+0000","last_undegraded":"2024-04-26T10:24:33.175776+0000","last_fullsized":"2024-04-26T10:24:33.175776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:19.263146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974073+0000","last_change":"2024-04-26T10:24:31.601925+0000","last_active":"2024-04-26T10:24:33.974073+0000","last_peered":"2024-04-26T10:24:33.974073+0000","last_clean":"2024-04-26T10:24:33.974073+0000","last_became_active":"2024-04-26T10:24:31.600986+0000","last_became_peered":"2024-04-26T10:24:31.600986+0000","last_unstale":"2024-04-26T10:24:33.974073+0000","last_undegraded":"2024-04-26T10:24:33.974073+0000","last_fullsized":"2024-04-26T10:24:33.974073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:52.125249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173997+0000","last_change":"2024-04-26T10:24:22.548245+0000","last_active":"2024-04-26T10:24:33.173997+0000","last_peered":"2024-04-26T10:24:33.173997+0000","last_clean":"2024-04-26T10:24:33.173997+0000","last_became_active":"2024-04-26T10:24:22.547731+0000","last_became_peered":"2024-04-26T10:24:22.547731+0000","last_unstale":"2024-04-26T10:24:33.173997+0000","last_undegraded":"2024-04-26T10:24:33.173997+0000","last_fullsized":"2024-04-26T10:24:33.173997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:52.538672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173800+0000","last_change":"2024-04-26T10:24:22.549424+0000","last_active":"2024-04-26T10:24:33.173800+0000","last_peered":"2024-04-26T10:24:33.173800+0000","last_clean":"2024-04-26T10:24:33.173800+0000","last_became_active":"2024-04-26T10:24:22.549180+0000","last_became_peered":"2024-04-26T10:24:22.549180+0000","last_unstale":"2024-04-26T10:24:33.173800+0000","last_undegraded":"2024-04-26T10:24:33.173800+0000","last_fullsized":"2024-04-26T10:24:33.173800+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.915633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174913+0000","last_change":"2024-04-26T10:24:22.547840+0000","last_active":"2024-04-26T10:24:33.174913+0000","last_peered":"2024-04-26T10:24:33.174913+0000","last_clean":"2024-04-26T10:24:33.174913+0000","last_became_active":"2024-04-26T10:24:22.547284+0000","last_became_peered":"2024-04-26T10:24:22.547284+0000","last_unstale":"2024-04-26T10:24:33.174913+0000","last_undegraded":"2024-04-26T10:24:33.174913+0000","last_fullsized":"2024-04-26T10:24:33.174913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:09.731025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318637+0000","last_change":"2024-04-26T10:24:22.680232+0000","last_active":"2024-04-26T10:24:33.318637+0000","last_peered":"2024-04-26T10:24:33.318637+0000","last_clean":"2024-04-26T10:24:33.318637+0000","last_became_active":"2024-04-26T10:24:22.679648+0000","last_became_peered":"2024-04-26T10:24:22.679648+0000","last_unstale":"2024-04-26T10:24:33.318637+0000","last_undegraded":"2024-04-26T10:24:33.318637+0000","last_fullsized":"2024-04-26T10:24:33.318637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:58.174215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974286+0000","last_change":"2024-04-26T10:24:31.599182+0000","last_active":"2024-04-26T10:24:33.974286+0000","last_peered":"2024-04-26T10:24:33.974286+0000","last_clean":"2024-04-26T10:24:33.974286+0000","last_became_active":"2024-04-26T10:24:31.598187+0000","last_became_peered":"2024-04-26T10:24:31.598187+0000","last_unstale":"2024-04-26T10:24:33.974286+0000","last_undegraded":"2024-04-26T10:24:33.974286+0000","last_fullsized":"2024-04-26T10:24:33.974286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:24.255353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.176053+0000","last_change":"2024-04-26T10:24:22.547601+0000","last_active":"2024-04-26T10:24:33.176053+0000","last_peered":"2024-04-26T10:24:33.176053+0000","last_clean":"2024-04-26T10:24:33.176053+0000","last_became_active":"2024-04-26T10:24:22.546506+0000","last_became_peered":"2024-04-26T10:24:22.546506+0000","last_unstale":"2024-04-26T10:24:33.176053+0000","last_undegraded":"2024-04-26T10:24:33.176053+0000","last_fullsized":"2024-04-26T10:24:33.176053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:21.263835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182904+0000","last_change":"2024-04-26T10:22:09.748232+0000","last_active":"2024-04-26T10:24:33.182904+0000","last_peered":"2024-04-26T10:24:33.182904+0000","last_clean":"2024-04-26T10:24:33.182904+0000","last_became_active":"2024-04-26T10:22:09.747822+0000","last_became_peered":"2024-04-26T10:22:09.747822+0000","last_unstale":"2024-04-26T10:24:33.182904+0000","last_undegraded":"2024-04-26T10:24:33.182904+0000","last_fullsized":"2024-04-26T10:24:33.182904+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.223031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974030+0000","last_change":"2024-04-26T10:24:31.598330+0000","last_active":"2024-04-26T10:24:33.974030+0000","last_peered":"2024-04-26T10:24:33.974030+0000","last_clean":"2024-04-26T10:24:33.974030+0000","last_became_active":"2024-04-26T10:24:31.597980+0000","last_became_peered":"2024-04-26T10:24:31.597980+0000","last_unstale":"2024-04-26T10:24:33.974030+0000","last_undegraded":"2024-04-26T10:24:33.974030+0000","last_fullsized":"2024-04-26T10:24:33.974030+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:38.711968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174108+0000","last_change":"2024-04-26T10:24:31.602827+0000","last_active":"2024-04-26T10:24:33.174108+0000","last_peered":"2024-04-26T10:24:33.174108+0000","last_clean":"2024-04-26T10:24:33.174108+0000","last_became_active":"2024-04-26T10:24:31.602539+0000","last_became_peered":"2024-04-26T10:24:31.602539+0000","last_unstale":"2024-04-26T10:24:33.174108+0000","last_undegraded":"2024-04-26T10:24:33.174108+0000","last_fullsized":"2024-04-26T10:24:33.174108+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:45.294898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173774+0000","last_change":"2024-04-26T10:24:31.602863+0000","last_active":"2024-04-26T10:24:33.173774+0000","last_peered":"2024-04-26T10:24:33.173774+0000","last_clean":"2024-04-26T10:24:33.173774+0000","last_became_active":"2024-04-26T10:24:31.602453+0000","last_became_peered":"2024-04-26T10:24:31.602453+0000","last_unstale":"2024-04-26T10:24:33.173774+0000","last_undegraded":"2024-04-26T10:24:33.173774+0000","last_fullsized":"2024-04-26T10:24:33.173774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:51.661774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174475+0000","last_change":"2024-04-26T10:24:22.547543+0000","last_active":"2024-04-26T10:24:33.174475+0000","last_peered":"2024-04-26T10:24:33.174475+0000","last_clean":"2024-04-26T10:24:33.174475+0000","last_became_active":"2024-04-26T10:24:22.546856+0000","last_became_peered":"2024-04-26T10:24:22.546856+0000","last_unstale":"2024-04-26T10:24:33.174475+0000","last_undegraded":"2024-04-26T10:24:33.174475+0000","last_fullsized":"2024-04-26T10:24:33.174475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:34.240590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318406+0000","last_change":"2024-04-26T10:24:22.679885+0000","last_active":"2024-04-26T10:24:33.318406+0000","last_peered":"2024-04-26T10:24:33.318406+0000","last_clean":"2024-04-26T10:24:33.318406+0000","last_became_active":"2024-04-26T10:24:22.679350+0000","last_became_peered":"2024-04-26T10:24:22.679350+0000","last_unstale":"2024-04-26T10:24:33.318406+0000","last_undegraded":"2024-04-26T10:24:33.318406+0000","last_fullsized":"2024-04-26T10:24:33.318406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:06.039983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974316+0000","last_change":"2024-04-26T10:24:31.598857+0000","last_active":"2024-04-26T10:24:33.974316+0000","last_peered":"2024-04-26T10:24:33.974316+0000","last_clean":"2024-04-26T10:24:33.974316+0000","last_became_active":"2024-04-26T10:24:31.597563+0000","last_became_peered":"2024-04-26T10:24:31.597563+0000","last_unstale":"2024-04-26T10:24:33.974316+0000","last_undegraded":"2024-04-26T10:24:33.974316+0000","last_fullsized":"2024-04-26T10:24:33.974316+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:26.624180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317832+0000","last_change":"2024-04-26T10:24:22.679291+0000","last_active":"2024-04-26T10:24:33.317832+0000","last_peered":"2024-04-26T10:24:33.317832+0000","last_clean":"2024-04-26T10:24:33.317832+0000","last_became_active":"2024-04-26T10:24:22.678912+0000","last_became_peered":"2024-04-26T10:24:22.678912+0000","last_unstale":"2024-04-26T10:24:33.317832+0000","last_undegraded":"2024-04-26T10:24:33.317832+0000","last_fullsized":"2024-04-26T10:24:33.317832+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:49.260130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175676+0000","last_change":"2024-04-26T10:24:22.546669+0000","last_active":"2024-04-26T10:24:33.175676+0000","last_peered":"2024-04-26T10:24:33.175676+0000","last_clean":"2024-04-26T10:24:33.175676+0000","last_became_active":"2024-04-26T10:24:22.546052+0000","last_became_peered":"2024-04-26T10:24:22.546052+0000","last_unstale":"2024-04-26T10:24:33.175676+0000","last_undegraded":"2024-04-26T10:24:33.175676+0000","last_fullsized":"2024-04-26T10:24:33.175676+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:26.334069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174879+0000","last_change":"2024-04-26T10:24:22.547981+0000","last_active":"2024-04-26T10:24:33.174879+0000","last_peered":"2024-04-26T10:24:33.174879+0000","last_clean":"2024-04-26T10:24:33.174879+0000","last_became_active":"2024-04-26T10:24:22.547663+0000","last_became_peered":"2024-04-26T10:24:22.547663+0000","last_unstale":"2024-04-26T10:24:33.174879+0000","last_undegraded":"2024-04-26T10:24:33.174879+0000","last_fullsized":"2024-04-26T10:24:33.174879+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:07.105037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181281+0000","last_change":"2024-04-26T10:22:09.749283+0000","last_active":"2024-04-26T10:24:33.181281+0000","last_peered":"2024-04-26T10:24:33.181281+0000","last_clean":"2024-04-26T10:24:33.181281+0000","last_became_active":"2024-04-26T10:22:09.748755+0000","last_became_peered":"2024-04-26T10:22:09.748755+0000","last_unstale":"2024-04-26T10:24:33.181281+0000","last_undegraded":"2024-04-26T10:24:33.181281+0000","last_fullsized":"2024-04-26T10:24:33.181281+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:40.910715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317029+0000","last_change":"2024-04-26T10:24:22.684668+0000","last_active":"2024-04-26T10:24:33.317029+0000","last_peered":"2024-04-26T10:24:33.317029+0000","last_clean":"2024-04-26T10:24:33.317029+0000","last_became_active":"2024-04-26T10:24:22.683921+0000","last_became_peered":"2024-04-26T10:24:22.683921+0000","last_unstale":"2024-04-26T10:24:33.317029+0000","last_undegraded":"2024-04-26T10:24:33.317029+0000","last_fullsized":"2024-04-26T10:24:33.317029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.930781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182162+0000","last_change":"2024-04-26T10:24:22.535052+0000","last_active":"2024-04-26T10:24:33.182162+0000","last_peered":"2024-04-26T10:24:33.182162+0000","last_clean":"2024-04-26T10:24:33.182162+0000","last_became_active":"2024-04-26T10:24:22.534674+0000","last_became_peered":"2024-04-26T10:24:22.534674+0000","last_unstale":"2024-04-26T10:24:33.182162+0000","last_undegraded":"2024-04-26T10:24:33.182162+0000","last_fullsized":"2024-04-26T10:24:33.182162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:10.969425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974384+0000","last_change":"2024-04-26T10:24:31.601262+0000","last_active":"2024-04-26T10:24:33.974384+0000","last_peered":"2024-04-26T10:24:33.974384+0000","last_clean":"2024-04-26T10:24:33.974384+0000","last_became_active":"2024-04-26T10:24:31.600815+0000","last_became_peered":"2024-04-26T10:24:31.600815+0000","last_unstale":"2024-04-26T10:24:33.974384+0000","last_undegraded":"2024-04-26T10:24:33.974384+0000","last_fullsized":"2024-04-26T10:24:33.974384+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:02.552727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319258+0000","last_change":"2024-04-26T10:24:22.684739+0000","last_active":"2024-04-26T10:24:33.319258+0000","last_peered":"2024-04-26T10:24:33.319258+0000","last_clean":"2024-04-26T10:24:33.319258+0000","last_became_active":"2024-04-26T10:24:22.683959+0000","last_became_peered":"2024-04-26T10:24:22.683959+0000","last_unstale":"2024-04-26T10:24:33.319258+0000","last_undegraded":"2024-04-26T10:24:33.319258+0000","last_fullsized":"2024-04-26T10:24:33.319258+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:07.840236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":79,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175977+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:24:33.175977+0000","last_peered":"2024-04-26T10:24:33.175977+0000","last_clean":"2024-04-26T10:24:33.175977+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:24:33.175977+0000","last_undegraded":"2024-04-26T10:24:33.175977+0000","last_fullsized":"2024-04-26T10:24:33.175977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:39.394937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974137+0000","last_change":"2024-04-26T10:24:31.602078+0000","last_active":"2024-04-26T10:24:33.974137+0000","last_peered":"2024-04-26T10:24:33.974137+0000","last_clean":"2024-04-26T10:24:33.974137+0000","last_became_active":"2024-04-26T10:24:31.601299+0000","last_became_peered":"2024-04-26T10:24:31.601299+0000","last_unstale":"2024-04-26T10:24:33.974137+0000","last_undegraded":"2024-04-26T10:24:33.974137+0000","last_fullsized":"2024-04-26T10:24:33.974137+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:43.374493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317271+0000","last_change":"2024-04-26T10:24:31.741152+0000","last_active":"2024-04-26T10:24:33.317271+0000","last_peered":"2024-04-26T10:24:33.317271+0000","last_clean":"2024-04-26T10:24:33.317271+0000","last_became_active":"2024-04-26T10:24:31.740626+0000","last_became_peered":"2024-04-26T10:24:31.740626+0000","last_unstale":"2024-04-26T10:24:33.317271+0000","last_undegraded":"2024-04-26T10:24:33.317271+0000","last_fullsized":"2024-04-26T10:24:33.317271+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:23.323149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181503+0000","last_change":"2024-04-26T10:22:09.750562+0000","last_active":"2024-04-26T10:24:33.181503+0000","last_peered":"2024-04-26T10:24:33.181503+0000","last_clean":"2024-04-26T10:24:33.181503+0000","last_became_active":"2024-04-26T10:22:09.750286+0000","last_became_peered":"2024-04-26T10:22:09.750286+0000","last_unstale":"2024-04-26T10:24:33.181503+0000","last_undegraded":"2024-04-26T10:24:33.181503+0000","last_fullsized":"2024-04-26T10:24:33.181503+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:52.795517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317979+0000","last_change":"2024-04-26T10:24:31.741008+0000","last_active":"2024-04-26T10:24:33.317979+0000","last_peered":"2024-04-26T10:24:33.317979+0000","last_clean":"2024-04-26T10:24:33.317979+0000","last_became_active":"2024-04-26T10:24:31.740518+0000","last_became_peered":"2024-04-26T10:24:31.740518+0000","last_unstale":"2024-04-26T10:24:33.317979+0000","last_undegraded":"2024-04-26T10:24:33.317979+0000","last_fullsized":"2024-04-26T10:24:33.317979+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:11:59.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173926+0000","last_change":"2024-04-26T10:24:22.540161+0000","last_active":"2024-04-26T10:24:33.173926+0000","last_peered":"2024-04-26T10:24:33.173926+0000","last_clean":"2024-04-26T10:24:33.173926+0000","last_became_active":"2024-04-26T10:24:22.539106+0000","last_became_peered":"2024-04-26T10:24:22.539106+0000","last_unstale":"2024-04-26T10:24:33.173926+0000","last_undegraded":"2024-04-26T10:24:33.173926+0000","last_fullsized":"2024-04-26T10:24:33.173926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:09.208422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974115+0000","last_change":"2024-04-26T10:24:31.599487+0000","last_active":"2024-04-26T10:24:33.974115+0000","last_peered":"2024-04-26T10:24:33.974115+0000","last_clean":"2024-04-26T10:24:33.974115+0000","last_became_active":"2024-04-26T10:24:31.598307+0000","last_became_peered":"2024-04-26T10:24:31.598307+0000","last_unstale":"2024-04-26T10:24:33.974115+0000","last_undegraded":"2024-04-26T10:24:33.974115+0000","last_fullsized":"2024-04-26T10:24:33.974115+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:11.881961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174602+0000","last_change":"2024-04-26T10:24:22.547974+0000","last_active":"2024-04-26T10:24:33.174602+0000","last_peered":"2024-04-26T10:24:33.174602+0000","last_clean":"2024-04-26T10:24:33.174602+0000","last_became_active":"2024-04-26T10:24:22.546794+0000","last_became_peered":"2024-04-26T10:24:22.546794+0000","last_unstale":"2024-04-26T10:24:33.174602+0000","last_undegraded":"2024-04-26T10:24:33.174602+0000","last_fullsized":"2024-04-26T10:24:33.174602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:28.897600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974196+0000","last_change":"2024-04-26T10:24:31.597848+0000","last_active":"2024-04-26T10:24:33.974196+0000","last_peered":"2024-04-26T10:24:33.974196+0000","last_clean":"2024-04-26T10:24:33.974196+0000","last_became_active":"2024-04-26T10:24:31.596297+0000","last_became_peered":"2024-04-26T10:24:31.596297+0000","last_unstale":"2024-04-26T10:24:33.974196+0000","last_undegraded":"2024-04-26T10:24:33.974196+0000","last_fullsized":"2024-04-26T10:24:33.974196+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:09.585450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317333+0000","last_change":"2024-04-26T10:24:22.684913+0000","last_active":"2024-04-26T10:24:33.317333+0000","last_peered":"2024-04-26T10:24:33.317333+0000","last_clean":"2024-04-26T10:24:33.317333+0000","last_became_active":"2024-04-26T10:24:22.684541+0000","last_became_peered":"2024-04-26T10:24:22.684541+0000","last_unstale":"2024-04-26T10:24:33.317333+0000","last_undegraded":"2024-04-26T10:24:33.317333+0000","last_fullsized":"2024-04-26T10:24:33.317333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:32.802131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318520+0000","last_change":"2024-04-26T10:24:22.683787+0000","last_active":"2024-04-26T10:24:33.318520+0000","last_peered":"2024-04-26T10:24:33.318520+0000","last_clean":"2024-04-26T10:24:33.318520+0000","last_became_active":"2024-04-26T10:24:22.682650+0000","last_became_peered":"2024-04-26T10:24:22.682650+0000","last_unstale":"2024-04-26T10:24:33.318520+0000","last_undegraded":"2024-04-26T10:24:33.318520+0000","last_fullsized":"2024-04-26T10:24:33.318520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:29.301512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973911+0000","last_change":"2024-04-26T10:24:31.601959+0000","last_active":"2024-04-26T10:24:33.973911+0000","last_peered":"2024-04-26T10:24:33.973911+0000","last_clean":"2024-04-26T10:24:33.973911+0000","last_became_active":"2024-04-26T10:24:31.601091+0000","last_became_peered":"2024-04-26T10:24:31.601091+0000","last_unstale":"2024-04-26T10:24:33.973911+0000","last_undegraded":"2024-04-26T10:24:33.973911+0000","last_fullsized":"2024-04-26T10:24:33.973911+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:46.182880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318431+0000","last_change":"2024-04-26T10:24:22.684603+0000","last_active":"2024-04-26T10:24:33.318431+0000","last_peered":"2024-04-26T10:24:33.318431+0000","last_clean":"2024-04-26T10:24:33.318431+0000","last_became_active":"2024-04-26T10:24:22.684213+0000","last_became_peered":"2024-04-26T10:24:22.684213+0000","last_unstale":"2024-04-26T10:24:33.318431+0000","last_undegraded":"2024-04-26T10:24:33.318431+0000","last_fullsized":"2024-04-26T10:24:33.318431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:41.006428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":134,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173541+0000","last_change":"2024-04-26T10:24:31.613086+0000","last_active":"2024-04-26T10:24:33.173541+0000","last_peered":"2024-04-26T10:24:33.173541+0000","last_clean":"2024-04-26T10:24:33.173541+0000","last_became_active":"2024-04-26T10:24:31.604402+0000","last_became_peered":"2024-04-26T10:24:31.604402+0000","last_unstale":"2024-04-26T10:24:33.173541+0000","last_undegraded":"2024-04-26T10:24:33.173541+0000","last_fullsized":"2024-04-26T10:24:33.173541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:52.355783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":115,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175870+0000","last_change":"2024-04-26T10:24:31.624641+0000","last_active":"2024-04-26T10:24:33.175870+0000","last_peered":"2024-04-26T10:24:33.175870+0000","last_clean":"2024-04-26T10:24:33.175870+0000","last_became_active":"2024-04-26T10:24:31.604744+0000","last_became_peered":"2024-04-26T10:24:31.604744+0000","last_unstale":"2024-04-26T10:24:33.175870+0000","last_undegraded":"2024-04-26T10:24:33.175870+0000","last_fullsized":"2024-04-26T10:24:33.175870+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:44.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182275+0000","last_change":"2024-04-26T10:22:09.750173+0000","last_active":"2024-04-26T10:24:33.182275+0000","last_peered":"2024-04-26T10:24:33.182275+0000","last_clean":"2024-04-26T10:24:33.182275+0000","last_became_active":"2024-04-26T10:22:09.749862+0000","last_became_peered":"2024-04-26T10:22:09.749862+0000","last_unstale":"2024-04-26T10:24:33.182275+0000","last_undegraded":"2024-04-26T10:24:33.182275+0000","last_fullsized":"2024-04-26T10:24:33.182275+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:53.204364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182816+0000","last_change":"2024-04-26T10:22:09.750224+0000","last_active":"2024-04-26T10:24:33.182816+0000","last_peered":"2024-04-26T10:24:33.182816+0000","last_clean":"2024-04-26T10:24:33.182816+0000","last_became_active":"2024-04-26T10:22:09.749852+0000","last_became_peered":"2024-04-26T10:22:09.749852+0000","last_unstale":"2024-04-26T10:24:33.182816+0000","last_undegraded":"2024-04-26T10:24:33.182816+0000","last_fullsized":"2024-04-26T10:24:33.182816+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:44.923542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973891+0000","last_change":"2024-04-26T10:24:31.597157+0000","last_active":"2024-04-26T10:24:33.973891+0000","last_peered":"2024-04-26T10:24:33.973891+0000","last_clean":"2024-04-26T10:24:33.973891+0000","last_became_active":"2024-04-26T10:24:31.596335+0000","last_became_peered":"2024-04-26T10:24:31.596335+0000","last_unstale":"2024-04-26T10:24:33.973891+0000","last_undegraded":"2024-04-26T10:24:33.973891+0000","last_fullsized":"2024-04-26T10:24:33.973891+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:07.652892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":81,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175501+0000","last_change":"2024-04-26T10:21:08.935133+0000","last_active":"2024-04-26T10:24:33.175501+0000","last_peered":"2024-04-26T10:24:33.175501+0000","last_clean":"2024-04-26T10:24:33.175501+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:24:33.175501+0000","last_undegraded":"2024-04-26T10:24:33.175501+0000","last_fullsized":"2024-04-26T10:24:33.175501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:25.498249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174259+0000","last_change":"2024-04-26T10:24:22.549411+0000","last_active":"2024-04-26T10:24:33.174259+0000","last_peered":"2024-04-26T10:24:33.174259+0000","last_clean":"2024-04-26T10:24:33.174259+0000","last_became_active":"2024-04-26T10:24:22.549230+0000","last_became_peered":"2024-04-26T10:24:22.549230+0000","last_unstale":"2024-04-26T10:24:33.174259+0000","last_undegraded":"2024-04-26T10:24:33.174259+0000","last_fullsized":"2024-04-26T10:24:33.174259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:00.343304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175419+0000","last_change":"2024-04-26T10:24:22.541409+0000","last_active":"2024-04-26T10:24:33.175419+0000","last_peered":"2024-04-26T10:24:33.175419+0000","last_clean":"2024-04-26T10:24:33.175419+0000","last_became_active":"2024-04-26T10:24:22.540611+0000","last_became_peered":"2024-04-26T10:24:22.540611+0000","last_unstale":"2024-04-26T10:24:33.175419+0000","last_undegraded":"2024-04-26T10:24:33.175419+0000","last_fullsized":"2024-04-26T10:24:33.175419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:48.882187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319142+0000","last_change":"2024-04-26T10:24:22.687178+0000","last_active":"2024-04-26T10:24:33.319142+0000","last_peered":"2024-04-26T10:24:33.319142+0000","last_clean":"2024-04-26T10:24:33.319142+0000","last_became_active":"2024-04-26T10:24:22.686841+0000","last_became_peered":"2024-04-26T10:24:22.686841+0000","last_unstale":"2024-04-26T10:24:33.319142+0000","last_undegraded":"2024-04-26T10:24:33.319142+0000","last_fullsized":"2024-04-26T10:24:33.319142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:52.907696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318078+0000","last_change":"2024-04-26T10:24:22.687183+0000","last_active":"2024-04-26T10:24:33.318078+0000","last_peered":"2024-04-26T10:24:33.318078+0000","last_clean":"2024-04-26T10:24:33.318078+0000","last_became_active":"2024-04-26T10:24:22.686846+0000","last_became_peered":"2024-04-26T10:24:22.686846+0000","last_unstale":"2024-04-26T10:24:33.318078+0000","last_undegraded":"2024-04-26T10:24:33.318078+0000","last_fullsized":"2024-04-26T10:24:33.318078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:37.083683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175590+0000","last_change":"2024-04-26T10:24:22.546117+0000","last_active":"2024-04-26T10:24:33.175590+0000","last_peered":"2024-04-26T10:24:33.175590+0000","last_clean":"2024-04-26T10:24:33.175590+0000","last_became_active":"2024-04-26T10:24:22.545616+0000","last_became_peered":"2024-04-26T10:24:22.545616+0000","last_unstale":"2024-04-26T10:24:33.175590+0000","last_undegraded":"2024-04-26T10:24:33.175590+0000","last_fullsized":"2024-04-26T10:24:33.175590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:09.247826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174530+0000","last_change":"2024-04-26T10:24:22.540185+0000","last_active":"2024-04-26T10:24:33.174530+0000","last_peered":"2024-04-26T10:24:33.174530+0000","last_clean":"2024-04-26T10:24:33.174530+0000","last_became_active":"2024-04-26T10:24:22.538982+0000","last_became_peered":"2024-04-26T10:24:22.538982+0000","last_unstale":"2024-04-26T10:24:33.174530+0000","last_undegraded":"2024-04-26T10:24:33.174530+0000","last_fullsized":"2024-04-26T10:24:33.174530+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:27.225284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":79,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174662+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:24:33.174662+0000","last_peered":"2024-04-26T10:24:33.174662+0000","last_clean":"2024-04-26T10:24:33.174662+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:24:33.174662+0000","last_undegraded":"2024-04-26T10:24:33.174662+0000","last_fullsized":"2024-04-26T10:24:33.174662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181167+0000","last_change":"2024-04-26T10:22:09.748616+0000","last_active":"2024-04-26T10:24:33.181167+0000","last_peered":"2024-04-26T10:24:33.181167+0000","last_clean":"2024-04-26T10:24:33.181167+0000","last_became_active":"2024-04-26T10:22:09.748256+0000","last_became_peered":"2024-04-26T10:22:09.748256+0000","last_unstale":"2024-04-26T10:24:33.181167+0000","last_undegraded":"2024-04-26T10:24:33.181167+0000","last_fullsized":"2024-04-26T10:24:33.181167+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:19.402647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174461+0000","last_change":"2024-04-26T10:24:31.604150+0000","last_active":"2024-04-26T10:24:33.174461+0000","last_peered":"2024-04-26T10:24:33.174461+0000","last_clean":"2024-04-26T10:24:33.174461+0000","last_became_active":"2024-04-26T10:24:31.603620+0000","last_became_peered":"2024-04-26T10:24:31.603620+0000","last_unstale":"2024-04-26T10:24:33.174461+0000","last_undegraded":"2024-04-26T10:24:33.174461+0000","last_fullsized":"2024-04-26T10:24:33.174461+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:17.085344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973830+0000","last_change":"2024-04-26T10:24:31.598521+0000","last_active":"2024-04-26T10:24:33.973830+0000","last_peered":"2024-04-26T10:24:33.973830+0000","last_clean":"2024-04-26T10:24:33.973830+0000","last_became_active":"2024-04-26T10:24:31.598120+0000","last_became_peered":"2024-04-26T10:24:31.598120+0000","last_unstale":"2024-04-26T10:24:33.973830+0000","last_undegraded":"2024-04-26T10:24:33.973830+0000","last_fullsized":"2024-04-26T10:24:33.973830+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:23.723355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319166+0000","last_change":"2024-04-26T10:24:22.680557+0000","last_active":"2024-04-26T10:24:33.319166+0000","last_peered":"2024-04-26T10:24:33.319166+0000","last_clean":"2024-04-26T10:24:33.319166+0000","last_became_active":"2024-04-26T10:24:22.679940+0000","last_became_peered":"2024-04-26T10:24:22.679940+0000","last_unstale":"2024-04-26T10:24:33.319166+0000","last_undegraded":"2024-04-26T10:24:33.319166+0000","last_fullsized":"2024-04-26T10:24:33.319166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:06.379234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":333,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185235+0000","last_change":"2024-04-26T10:24:34.185235+0000","last_active":"2024-04-26T10:24:34.185235+0000","last_peered":"2024-04-26T10:24:34.185235+0000","last_clean":"2024-04-26T10:24:34.185235+0000","last_became_active":"2024-04-26T10:24:34.184490+0000","last_became_peered":"2024-04-26T10:24:34.184490+0000","last_unstale":"2024-04-26T10:24:34.185235+0000","last_undegraded":"2024-04-26T10:24:34.185235+0000","last_fullsized":"2024-04-26T10:24:34.185235+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:33.812288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174100+0000","last_change":"2024-04-26T10:24:22.547708+0000","last_active":"2024-04-26T10:24:33.174100+0000","last_peered":"2024-04-26T10:24:33.174100+0000","last_clean":"2024-04-26T10:24:33.174100+0000","last_became_active":"2024-04-26T10:24:22.546650+0000","last_became_peered":"2024-04-26T10:24:22.546650+0000","last_unstale":"2024-04-26T10:24:33.174100+0000","last_undegraded":"2024-04-26T10:24:33.174100+0000","last_fullsized":"2024-04-26T10:24:33.174100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:55.474931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317752+0000","last_change":"2024-04-26T10:24:22.676755+0000","last_active":"2024-04-26T10:24:33.317752+0000","last_peered":"2024-04-26T10:24:33.317752+0000","last_clean":"2024-04-26T10:24:33.317752+0000","last_became_active":"2024-04-26T10:24:22.676489+0000","last_became_peered":"2024-04-26T10:24:22.676489+0000","last_unstale":"2024-04-26T10:24:33.317752+0000","last_undegraded":"2024-04-26T10:24:33.317752+0000","last_fullsized":"2024-04-26T10:24:33.317752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:38.979532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174906+0000","last_change":"2024-04-26T10:24:31.603833+0000","last_active":"2024-04-26T10:24:33.174906+0000","last_peered":"2024-04-26T10:24:33.174906+0000","last_clean":"2024-04-26T10:24:33.174906+0000","last_became_active":"2024-04-26T10:24:31.603498+0000","last_became_peered":"2024-04-26T10:24:31.603498+0000","last_unstale":"2024-04-26T10:24:33.174906+0000","last_undegraded":"2024-04-26T10:24:33.174906+0000","last_fullsized":"2024-04-26T10:24:33.174906+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:58.952460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174671+0000","last_change":"2024-04-26T10:24:31.603067+0000","last_active":"2024-04-26T10:24:33.174671+0000","last_peered":"2024-04-26T10:24:33.174671+0000","last_clean":"2024-04-26T10:24:33.174671+0000","last_became_active":"2024-04-26T10:24:31.602611+0000","last_became_peered":"2024-04-26T10:24:31.602611+0000","last_unstale":"2024-04-26T10:24:33.174671+0000","last_undegraded":"2024-04-26T10:24:33.174671+0000","last_fullsized":"2024-04-26T10:24:33.174671+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:14.943135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316711+0000","last_change":"2024-04-26T10:24:22.685554+0000","last_active":"2024-04-26T10:24:33.316711+0000","last_peered":"2024-04-26T10:24:33.316711+0000","last_clean":"2024-04-26T10:24:33.316711+0000","last_became_active":"2024-04-26T10:24:22.685051+0000","last_became_peered":"2024-04-26T10:24:22.685051+0000","last_unstale":"2024-04-26T10:24:33.316711+0000","last_undegraded":"2024-04-26T10:24:33.316711+0000","last_fullsized":"2024-04-26T10:24:33.316711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:59.389895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182836+0000","last_change":"2024-04-26T10:24:22.538294+0000","last_active":"2024-04-26T10:24:33.182836+0000","last_peered":"2024-04-26T10:24:33.182836+0000","last_clean":"2024-04-26T10:24:33.182836+0000","last_became_active":"2024-04-26T10:24:22.537983+0000","last_became_peered":"2024-04-26T10:24:22.537983+0000","last_unstale":"2024-04-26T10:24:33.182836+0000","last_undegraded":"2024-04-26T10:24:33.182836+0000","last_fullsized":"2024-04-26T10:24:33.182836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:54.064158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317277+0000","last_change":"2024-04-26T10:24:22.679231+0000","last_active":"2024-04-26T10:24:33.317277+0000","last_peered":"2024-04-26T10:24:33.317277+0000","last_clean":"2024-04-26T10:24:33.317277+0000","last_became_active":"2024-04-26T10:24:22.678866+0000","last_became_peered":"2024-04-26T10:24:22.678866+0000","last_unstale":"2024-04-26T10:24:33.317277+0000","last_undegraded":"2024-04-26T10:24:33.317277+0000","last_fullsized":"2024-04-26T10:24:33.317277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:26.179423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182367+0000","last_change":"2024-04-26T10:22:09.750297+0000","last_active":"2024-04-26T10:24:33.182367+0000","last_peered":"2024-04-26T10:24:33.182367+0000","last_clean":"2024-04-26T10:24:33.182367+0000","last_became_active":"2024-04-26T10:22:09.749935+0000","last_became_peered":"2024-04-26T10:22:09.749935+0000","last_unstale":"2024-04-26T10:24:33.182367+0000","last_undegraded":"2024-04-26T10:24:33.182367+0000","last_fullsized":"2024-04-26T10:24:33.182367+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:51.197306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319145+0000","last_change":"2024-04-26T10:24:31.745820+0000","last_active":"2024-04-26T10:24:33.319145+0000","last_peered":"2024-04-26T10:24:33.319145+0000","last_clean":"2024-04-26T10:24:33.319145+0000","last_became_active":"2024-04-26T10:24:31.745487+0000","last_became_peered":"2024-04-26T10:24:31.745487+0000","last_unstale":"2024-04-26T10:24:33.319145+0000","last_undegraded":"2024-04-26T10:24:33.319145+0000","last_fullsized":"2024-04-26T10:24:33.319145+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:00.239650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174768+0000","last_change":"2024-04-26T10:24:22.539761+0000","last_active":"2024-04-26T10:24:33.174768+0000","last_peered":"2024-04-26T10:24:33.174768+0000","last_clean":"2024-04-26T10:24:33.174768+0000","last_became_active":"2024-04-26T10:24:22.538993+0000","last_became_peered":"2024-04-26T10:24:22.538993+0000","last_unstale":"2024-04-26T10:24:33.174768+0000","last_undegraded":"2024-04-26T10:24:33.174768+0000","last_fullsized":"2024-04-26T10:24:33.174768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:24.782191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174356+0000","last_change":"2024-04-26T10:24:22.542774+0000","last_active":"2024-04-26T10:24:33.174356+0000","last_peered":"2024-04-26T10:24:33.174356+0000","last_clean":"2024-04-26T10:24:33.174356+0000","last_became_active":"2024-04-26T10:24:22.541795+0000","last_became_peered":"2024-04-26T10:24:22.541795+0000","last_unstale":"2024-04-26T10:24:33.174356+0000","last_undegraded":"2024-04-26T10:24:33.174356+0000","last_fullsized":"2024-04-26T10:24:33.174356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:07.303056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317944+0000","last_change":"2024-04-26T10:24:31.744717+0000","last_active":"2024-04-26T10:24:33.317944+0000","last_peered":"2024-04-26T10:24:33.317944+0000","last_clean":"2024-04-26T10:24:33.317944+0000","last_became_active":"2024-04-26T10:24:31.744373+0000","last_became_peered":"2024-04-26T10:24:31.744373+0000","last_unstale":"2024-04-26T10:24:33.317944+0000","last_undegraded":"2024-04-26T10:24:33.317944+0000","last_fullsized":"2024-04-26T10:24:33.317944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:10.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174262+0000","last_change":"2024-04-26T10:24:22.538573+0000","last_active":"2024-04-26T10:24:33.174262+0000","last_peered":"2024-04-26T10:24:33.174262+0000","last_clean":"2024-04-26T10:24:33.174262+0000","last_became_active":"2024-04-26T10:24:22.537041+0000","last_became_peered":"2024-04-26T10:24:22.537041+0000","last_unstale":"2024-04-26T10:24:33.174262+0000","last_undegraded":"2024-04-26T10:24:33.174262+0000","last_fullsized":"2024-04-26T10:24:33.174262+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:48.026637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318800+0000","last_change":"2024-04-26T10:24:31.744776+0000","last_active":"2024-04-26T10:24:33.318800+0000","last_peered":"2024-04-26T10:24:33.318800+0000","last_clean":"2024-04-26T10:24:33.318800+0000","last_became_active":"2024-04-26T10:24:31.744342+0000","last_became_peered":"2024-04-26T10:24:31.744342+0000","last_unstale":"2024-04-26T10:24:33.318800+0000","last_undegraded":"2024-04-26T10:24:33.318800+0000","last_fullsized":"2024-04-26T10:24:33.318800+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:08:33.941367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973980+0000","last_change":"2024-04-26T10:24:31.599193+0000","last_active":"2024-04-26T10:24:33.973980+0000","last_peered":"2024-04-26T10:24:33.973980+0000","last_clean":"2024-04-26T10:24:33.973980+0000","last_became_active":"2024-04-26T10:24:31.598432+0000","last_became_peered":"2024-04-26T10:24:31.598432+0000","last_unstale":"2024-04-26T10:24:33.973980+0000","last_undegraded":"2024-04-26T10:24:33.973980+0000","last_fullsized":"2024-04-26T10:24:33.973980+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:41.515775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318555+0000","last_change":"2024-04-26T10:24:31.745336+0000","last_active":"2024-04-26T10:24:33.318555+0000","last_peered":"2024-04-26T10:24:33.318555+0000","last_clean":"2024-04-26T10:24:33.318555+0000","last_became_active":"2024-04-26T10:24:31.745004+0000","last_became_peered":"2024-04-26T10:24:31.745004+0000","last_unstale":"2024-04-26T10:24:33.318555+0000","last_undegraded":"2024-04-26T10:24:33.318555+0000","last_fullsized":"2024-04-26T10:24:33.318555+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:15.275549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974267+0000","last_change":"2024-04-26T10:24:31.601585+0000","last_active":"2024-04-26T10:24:33.974267+0000","last_peered":"2024-04-26T10:24:33.974267+0000","last_clean":"2024-04-26T10:24:33.974267+0000","last_became_active":"2024-04-26T10:24:31.600977+0000","last_became_peered":"2024-04-26T10:24:31.600977+0000","last_unstale":"2024-04-26T10:24:33.974267+0000","last_undegraded":"2024-04-26T10:24:33.974267+0000","last_fullsized":"2024-04-26T10:24:33.974267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.329801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181771+0000","last_change":"2024-04-26T10:22:09.758116+0000","last_active":"2024-04-26T10:24:33.181771+0000","last_peered":"2024-04-26T10:24:33.181771+0000","last_clean":"2024-04-26T10:24:33.181771+0000","last_became_active":"2024-04-26T10:22:09.757813+0000","last_became_peered":"2024-04-26T10:22:09.757813+0000","last_unstale":"2024-04-26T10:24:33.181771+0000","last_undegraded":"2024-04-26T10:24:33.181771+0000","last_fullsized":"2024-04-26T10:24:33.181771+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:01.195987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318177+0000","last_change":"2024-04-26T10:24:22.680137+0000","last_active":"2024-04-26T10:24:33.318177+0000","last_peered":"2024-04-26T10:24:33.318177+0000","last_clean":"2024-04-26T10:24:33.318177+0000","last_became_active":"2024-04-26T10:24:22.679497+0000","last_became_peered":"2024-04-26T10:24:22.679497+0000","last_unstale":"2024-04-26T10:24:33.318177+0000","last_undegraded":"2024-04-26T10:24:33.318177+0000","last_fullsized":"2024-04-26T10:24:33.318177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:00.401135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318093+0000","last_change":"2024-04-26T10:24:31.741102+0000","last_active":"2024-04-26T10:24:33.318093+0000","last_peered":"2024-04-26T10:24:33.318093+0000","last_clean":"2024-04-26T10:24:33.318093+0000","last_became_active":"2024-04-26T10:24:31.740589+0000","last_became_peered":"2024-04-26T10:24:31.740589+0000","last_unstale":"2024-04-26T10:24:33.318093+0000","last_undegraded":"2024-04-26T10:24:33.318093+0000","last_fullsized":"2024-04-26T10:24:33.318093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:38.170544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317410+0000","last_change":"2024-04-26T10:24:22.686404+0000","last_active":"2024-04-26T10:24:33.317410+0000","last_peered":"2024-04-26T10:24:33.317410+0000","last_clean":"2024-04-26T10:24:33.317410+0000","last_became_active":"2024-04-26T10:24:22.686094+0000","last_became_peered":"2024-04-26T10:24:22.686094+0000","last_unstale":"2024-04-26T10:24:33.317410+0000","last_undegraded":"2024-04-26T10:24:33.317410+0000","last_fullsized":"2024-04-26T10:24:33.317410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:37.911705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318296+0000","last_change":"2024-04-26T10:24:22.682344+0000","last_active":"2024-04-26T10:24:33.318296+0000","last_peered":"2024-04-26T10:24:33.318296+0000","last_clean":"2024-04-26T10:24:33.318296+0000","last_became_active":"2024-04-26T10:24:22.681977+0000","last_became_peered":"2024-04-26T10:24:22.681977+0000","last_unstale":"2024-04-26T10:24:33.318296+0000","last_undegraded":"2024-04-26T10:24:33.318296+0000","last_fullsized":"2024-04-26T10:24:33.318296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:56.544667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175850+0000","last_change":"2024-04-26T10:24:31.605320+0000","last_active":"2024-04-26T10:24:33.175850+0000","last_peered":"2024-04-26T10:24:33.175850+0000","last_clean":"2024-04-26T10:24:33.175850+0000","last_became_active":"2024-04-26T10:24:31.604158+0000","last_became_peered":"2024-04-26T10:24:31.604158+0000","last_unstale":"2024-04-26T10:24:33.175850+0000","last_undegraded":"2024-04-26T10:24:33.175850+0000","last_fullsized":"2024-04-26T10:24:33.175850+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:53.955856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973931+0000","last_change":"2024-04-26T10:24:31.601291+0000","last_active":"2024-04-26T10:24:33.973931+0000","last_peered":"2024-04-26T10:24:33.973931+0000","last_clean":"2024-04-26T10:24:33.973931+0000","last_became_active":"2024-04-26T10:24:31.600474+0000","last_became_peered":"2024-04-26T10:24:31.600474+0000","last_unstale":"2024-04-26T10:24:33.973931+0000","last_undegraded":"2024-04-26T10:24:33.973931+0000","last_fullsized":"2024-04-26T10:24:33.973931+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:30.284416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175157+0000","last_change":"2024-04-26T10:24:31.604975+0000","last_active":"2024-04-26T10:24:33.175157+0000","last_peered":"2024-04-26T10:24:33.175157+0000","last_clean":"2024-04-26T10:24:33.175157+0000","last_became_active":"2024-04-26T10:24:31.604609+0000","last_became_peered":"2024-04-26T10:24:31.604609+0000","last_unstale":"2024-04-26T10:24:33.175157+0000","last_undegraded":"2024-04-26T10:24:33.175157+0000","last_fullsized":"2024-04-26T10:24:33.175157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:04.412544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":132,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175190+0000","last_change":"2024-04-26T10:24:31.622111+0000","last_active":"2024-04-26T10:24:33.175190+0000","last_peered":"2024-04-26T10:24:33.175190+0000","last_clean":"2024-04-26T10:24:33.175190+0000","last_became_active":"2024-04-26T10:24:31.604884+0000","last_became_peered":"2024-04-26T10:24:31.604884+0000","last_unstale":"2024-04-26T10:24:33.175190+0000","last_undegraded":"2024-04-26T10:24:33.175190+0000","last_fullsized":"2024-04-26T10:24:33.175190+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:18.600081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317264+0000","last_change":"2024-04-26T10:24:31.739955+0000","last_active":"2024-04-26T10:24:33.317264+0000","last_peered":"2024-04-26T10:24:33.317264+0000","last_clean":"2024-04-26T10:24:33.317264+0000","last_became_active":"2024-04-26T10:24:31.739550+0000","last_became_peered":"2024-04-26T10:24:31.739550+0000","last_unstale":"2024-04-26T10:24:33.317264+0000","last_undegraded":"2024-04-26T10:24:33.317264+0000","last_fullsized":"2024-04-26T10:24:33.317264+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:31.253486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974245+0000","last_change":"2024-04-26T10:24:31.609788+0000","last_active":"2024-04-26T10:24:33.974245+0000","last_peered":"2024-04-26T10:24:33.974245+0000","last_clean":"2024-04-26T10:24:33.974245+0000","last_became_active":"2024-04-26T10:24:31.601218+0000","last_became_peered":"2024-04-26T10:24:31.601218+0000","last_unstale":"2024-04-26T10:24:33.974245+0000","last_undegraded":"2024-04-26T10:24:33.974245+0000","last_fullsized":"2024-04-26T10:24:33.974245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:39.380483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175533+0000","last_change":"2024-04-26T10:24:22.546807+0000","last_active":"2024-04-26T10:24:33.175533+0000","last_peered":"2024-04-26T10:24:33.175533+0000","last_clean":"2024-04-26T10:24:33.175533+0000","last_became_active":"2024-04-26T10:24:22.546378+0000","last_became_peered":"2024-04-26T10:24:22.546378+0000","last_unstale":"2024-04-26T10:24:33.175533+0000","last_undegraded":"2024-04-26T10:24:33.175533+0000","last_fullsized":"2024-04-26T10:24:33.175533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:06.866157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317068+0000","last_change":"2024-04-26T10:24:22.684096+0000","last_active":"2024-04-26T10:24:33.317068+0000","last_peered":"2024-04-26T10:24:33.317068+0000","last_clean":"2024-04-26T10:24:33.317068+0000","last_became_active":"2024-04-26T10:24:22.683558+0000","last_became_peered":"2024-04-26T10:24:22.683558+0000","last_unstale":"2024-04-26T10:24:33.317068+0000","last_undegraded":"2024-04-26T10:24:33.317068+0000","last_fullsized":"2024-04-26T10:24:33.317068+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:05.316682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318841+0000","last_change":"2024-04-26T10:24:22.684541+0000","last_active":"2024-04-26T10:24:33.318841+0000","last_peered":"2024-04-26T10:24:33.318841+0000","last_clean":"2024-04-26T10:24:33.318841+0000","last_became_active":"2024-04-26T10:24:22.684166+0000","last_became_peered":"2024-04-26T10:24:22.684166+0000","last_unstale":"2024-04-26T10:24:33.318841+0000","last_undegraded":"2024-04-26T10:24:33.318841+0000","last_fullsized":"2024-04-26T10:24:33.318841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:30.164642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317049+0000","last_change":"2024-04-26T10:24:31.745539+0000","last_active":"2024-04-26T10:24:33.317049+0000","last_peered":"2024-04-26T10:24:33.317049+0000","last_clean":"2024-04-26T10:24:33.317049+0000","last_became_active":"2024-04-26T10:24:31.745216+0000","last_became_peered":"2024-04-26T10:24:31.745216+0000","last_unstale":"2024-04-26T10:24:33.317049+0000","last_undegraded":"2024-04-26T10:24:33.317049+0000","last_fullsized":"2024-04-26T10:24:33.317049+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:55.390023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183305+0000","last_change":"2024-04-26T10:22:09.750605+0000","last_active":"2024-04-26T10:24:33.183305+0000","last_peered":"2024-04-26T10:24:33.183305+0000","last_clean":"2024-04-26T10:24:33.183305+0000","last_became_active":"2024-04-26T10:22:09.750359+0000","last_became_peered":"2024-04-26T10:22:09.750359+0000","last_unstale":"2024-04-26T10:24:33.183305+0000","last_undegraded":"2024-04-26T10:24:33.183305+0000","last_fullsized":"2024-04-26T10:24:33.183305+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:56.948741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316663+0000","last_change":"2024-04-26T10:24:31.740907+0000","last_active":"2024-04-26T10:24:33.316663+0000","last_peered":"2024-04-26T10:24:33.316663+0000","last_clean":"2024-04-26T10:24:33.316663+0000","last_became_active":"2024-04-26T10:24:31.740477+0000","last_became_peered":"2024-04-26T10:24:31.740477+0000","last_unstale":"2024-04-26T10:24:33.316663+0000","last_undegraded":"2024-04-26T10:24:33.316663+0000","last_fullsized":"2024-04-26T10:24:33.316663+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:30.206347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318888+0000","last_change":"2024-04-26T10:24:22.684108+0000","last_active":"2024-04-26T10:24:33.318888+0000","last_peered":"2024-04-26T10:24:33.318888+0000","last_clean":"2024-04-26T10:24:33.318888+0000","last_became_active":"2024-04-26T10:24:22.683501+0000","last_became_peered":"2024-04-26T10:24:22.683501+0000","last_unstale":"2024-04-26T10:24:33.318888+0000","last_undegraded":"2024-04-26T10:24:33.318888+0000","last_fullsized":"2024-04-26T10:24:33.318888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:17.355758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316745+0000","last_change":"2024-04-26T10:24:22.685228+0000","last_active":"2024-04-26T10:24:33.316745+0000","last_peered":"2024-04-26T10:24:33.316745+0000","last_clean":"2024-04-26T10:24:33.316745+0000","last_became_active":"2024-04-26T10:24:22.684469+0000","last_became_peered":"2024-04-26T10:24:22.684469+0000","last_unstale":"2024-04-26T10:24:33.316745+0000","last_undegraded":"2024-04-26T10:24:33.316745+0000","last_fullsized":"2024-04-26T10:24:33.316745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:53.834583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182003+0000","last_change":"2024-04-26T10:22:09.753136+0000","last_active":"2024-04-26T10:24:33.182003+0000","last_peered":"2024-04-26T10:24:33.182003+0000","last_clean":"2024-04-26T10:24:33.182003+0000","last_became_active":"2024-04-26T10:22:09.752856+0000","last_became_peered":"2024-04-26T10:22:09.752856+0000","last_unstale":"2024-04-26T10:24:33.182003+0000","last_undegraded":"2024-04-26T10:24:33.182003+0000","last_fullsized":"2024-04-26T10:24:33.182003+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:48.541930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":88,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181723+0000","last_change":"2024-04-26T10:24:22.535413+0000","last_active":"2024-04-26T10:24:33.181723+0000","last_peered":"2024-04-26T10:24:33.181723+0000","last_clean":"2024-04-26T10:24:33.181723+0000","last_became_active":"2024-04-26T10:24:22.535036+0000","last_became_peered":"2024-04-26T10:24:22.535036+0000","last_unstale":"2024-04-26T10:24:33.181723+0000","last_undegraded":"2024-04-26T10:24:33.181723+0000","last_fullsized":"2024-04-26T10:24:33.181723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:43.756504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183058+0000","last_change":"2024-04-26T10:24:22.535819+0000","last_active":"2024-04-26T10:24:33.183058+0000","last_peered":"2024-04-26T10:24:33.183058+0000","last_clean":"2024-04-26T10:24:33.183058+0000","last_became_active":"2024-04-26T10:24:22.535562+0000","last_became_peered":"2024-04-26T10:24:22.535562+0000","last_unstale":"2024-04-26T10:24:33.183058+0000","last_undegraded":"2024-04-26T10:24:33.183058+0000","last_fullsized":"2024-04-26T10:24:33.183058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:24.845621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974051+0000","last_change":"2024-04-26T10:24:31.600594+0000","last_active":"2024-04-26T10:24:33.974051+0000","last_peered":"2024-04-26T10:24:33.974051+0000","last_clean":"2024-04-26T10:24:33.974051+0000","last_became_active":"2024-04-26T10:24:31.600121+0000","last_became_peered":"2024-04-26T10:24:31.600121+0000","last_unstale":"2024-04-26T10:24:33.974051+0000","last_undegraded":"2024-04-26T10:24:33.974051+0000","last_fullsized":"2024-04-26T10:24:33.974051+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:05.491069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175273+0000","last_change":"2024-04-26T10:24:22.542755+0000","last_active":"2024-04-26T10:24:33.175273+0000","last_peered":"2024-04-26T10:24:33.175273+0000","last_clean":"2024-04-26T10:24:33.175273+0000","last_became_active":"2024-04-26T10:24:22.541543+0000","last_became_peered":"2024-04-26T10:24:22.541543+0000","last_unstale":"2024-04-26T10:24:33.175273+0000","last_undegraded":"2024-04-26T10:24:33.175273+0000","last_fullsized":"2024-04-26T10:24:33.175273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:50.942528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175459+0000","last_change":"2024-04-26T10:24:22.541418+0000","last_active":"2024-04-26T10:24:33.175459+0000","last_peered":"2024-04-26T10:24:33.175459+0000","last_clean":"2024-04-26T10:24:33.175459+0000","last_became_active":"2024-04-26T10:24:22.540767+0000","last_became_peered":"2024-04-26T10:24:22.540767+0000","last_unstale":"2024-04-26T10:24:33.175459+0000","last_undegraded":"2024-04-26T10:24:33.175459+0000","last_fullsized":"2024-04-26T10:24:33.175459+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:26.684306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174534+0000","last_change":"2024-04-26T10:24:22.547294+0000","last_active":"2024-04-26T10:24:33.174534+0000","last_peered":"2024-04-26T10:24:33.174534+0000","last_clean":"2024-04-26T10:24:33.174534+0000","last_became_active":"2024-04-26T10:24:22.546811+0000","last_became_peered":"2024-04-26T10:24:22.546811+0000","last_unstale":"2024-04-26T10:24:33.174534+0000","last_undegraded":"2024-04-26T10:24:33.174534+0000","last_fullsized":"2024-04-26T10:24:33.174534+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:03.037283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182738+0000","last_change":"2024-04-26T10:22:09.753438+0000","last_active":"2024-04-26T10:24:33.182738+0000","last_peered":"2024-04-26T10:24:33.182738+0000","last_clean":"2024-04-26T10:24:33.182738+0000","last_became_active":"2024-04-26T10:22:09.753211+0000","last_became_peered":"2024-04-26T10:22:09.753211+0000","last_unstale":"2024-04-26T10:24:33.182738+0000","last_undegraded":"2024-04-26T10:24:33.182738+0000","last_fullsized":"2024-04-26T10:24:33.182738+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:39.406859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973960+0000","last_change":"2024-04-26T10:24:31.600935+0000","last_active":"2024-04-26T10:24:33.973960+0000","last_peered":"2024-04-26T10:24:33.973960+0000","last_clean":"2024-04-26T10:24:33.973960+0000","last_became_active":"2024-04-26T10:24:31.600088+0000","last_became_peered":"2024-04-26T10:24:31.600088+0000","last_unstale":"2024-04-26T10:24:33.973960+0000","last_undegraded":"2024-04-26T10:24:33.973960+0000","last_fullsized":"2024-04-26T10:24:33.973960+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:58.341684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319737+0000","last_change":"2024-04-26T10:24:22.680082+0000","last_active":"2024-04-26T10:24:33.319737+0000","last_peered":"2024-04-26T10:24:33.319737+0000","last_clean":"2024-04-26T10:24:33.319737+0000","last_became_active":"2024-04-26T10:24:22.679652+0000","last_became_peered":"2024-04-26T10:24:22.679652+0000","last_unstale":"2024-04-26T10:24:33.319737+0000","last_undegraded":"2024-04-26T10:24:33.319737+0000","last_fullsized":"2024-04-26T10:24:33.319737+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:37.821623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173304+0000","last_change":"2024-04-26T10:24:22.540326+0000","last_active":"2024-04-26T10:24:33.173304+0000","last_peered":"2024-04-26T10:24:33.173304+0000","last_clean":"2024-04-26T10:24:33.173304+0000","last_became_active":"2024-04-26T10:24:22.538895+0000","last_became_peered":"2024-04-26T10:24:22.538895+0000","last_unstale":"2024-04-26T10:24:33.173304+0000","last_undegraded":"2024-04-26T10:24:33.173304+0000","last_fullsized":"2024-04-26T10:24:33.173304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:29.709972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319358+0000","last_change":"2024-04-26T10:24:22.685454+0000","last_active":"2024-04-26T10:24:33.319358+0000","last_peered":"2024-04-26T10:24:33.319358+0000","last_clean":"2024-04-26T10:24:33.319358+0000","last_became_active":"2024-04-26T10:24:22.684863+0000","last_became_peered":"2024-04-26T10:24:22.684863+0000","last_unstale":"2024-04-26T10:24:33.319358+0000","last_undegraded":"2024-04-26T10:24:33.319358+0000","last_fullsized":"2024-04-26T10:24:33.319358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:33.027447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":21541,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673009,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279076,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":278014,"kb_avail":94092764,"statfs":{"total":96636764160,"available":96350990336,"internally_reserved":0,"allocated":1064960,"data_stored":1035671,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":284686790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:24:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55000000000000004,"15min":0.51600000000000001},"min":{"1min":0.25800000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.67500000000000004,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.53900000000000003},"min":{"1min":0.28000000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.754,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":0,"up_from":10,"seq":42949673008,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487484,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":486398,"kb_avail":93884356,"statfs":{"total":96636764160,"available":96137580544,"internally_reserved":0,"allocated":1089536,"data_stored":1036287,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":498072006},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:24:04 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.65600000000000003,"15min":0.56599999999999995},"min":{"1min":0.21099999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":4.1369999999999996,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.25900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.748,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":2,"up_from":80,"seq":343597383685,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38380,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":37369,"kb_avail":94333460,"statfs":{"total":96636764160,"available":96597463040,"internally_reserved":0,"allocated":1007616,"data_stored":444173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6879,"internal_metadata":38266145},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:24:40.482 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-26T10:24:40.483 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-26T10:24:40.808 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T10:24:40.817 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T10:24:40.817 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:24:41.124 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:24:41.127 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:24:41.139 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-04-26T10:24:40.042309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1184088,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":804940,"kb_used_data":3088,"kb_used_omap":9,"kb_used_meta":801782,"kb_avail":282310580,"statfs":{"total":289910292480,"available":289086033920,"internally_reserved":0,"allocated":3162112,"data_stored":2516131,"data_compressed":14075,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":10067,"internal_metadata":821024941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":592044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.449631"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974365+0000","last_change":"2024-04-26T10:24:31.598789+0000","last_active":"2024-04-26T10:24:33.974365+0000","last_peered":"2024-04-26T10:24:33.974365+0000","last_clean":"2024-04-26T10:24:33.974365+0000","last_became_active":"2024-04-26T10:24:31.598170+0000","last_became_peered":"2024-04-26T10:24:31.598170+0000","last_unstale":"2024-04-26T10:24:33.974365+0000","last_undegraded":"2024-04-26T10:24:33.974365+0000","last_fullsized":"2024-04-26T10:24:33.974365+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:46.718423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182259+0000","last_change":"2024-04-26T10:24:22.536264+0000","last_active":"2024-04-26T10:24:33.182259+0000","last_peered":"2024-04-26T10:24:33.182259+0000","last_clean":"2024-04-26T10:24:33.182259+0000","last_became_active":"2024-04-26T10:24:22.535998+0000","last_became_peered":"2024-04-26T10:24:22.535998+0000","last_unstale":"2024-04-26T10:24:33.182259+0000","last_undegraded":"2024-04-26T10:24:33.182259+0000","last_fullsized":"2024-04-26T10:24:33.182259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:54.491369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":79,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.176175+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:24:33.176175+0000","last_peered":"2024-04-26T10:24:33.176175+0000","last_clean":"2024-04-26T10:24:33.176175+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:24:33.176175+0000","last_undegraded":"2024-04-26T10:24:33.176175+0000","last_fullsized":"2024-04-26T10:24:33.176175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:01.883964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175776+0000","last_change":"2024-04-26T10:24:22.549067+0000","last_active":"2024-04-26T10:24:33.175776+0000","last_peered":"2024-04-26T10:24:33.175776+0000","last_clean":"2024-04-26T10:24:33.175776+0000","last_became_active":"2024-04-26T10:24:22.548485+0000","last_became_peered":"2024-04-26T10:24:22.548485+0000","last_unstale":"2024-04-26T10:24:33.175776+0000","last_undegraded":"2024-04-26T10:24:33.175776+0000","last_fullsized":"2024-04-26T10:24:33.175776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:19.263146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974073+0000","last_change":"2024-04-26T10:24:31.601925+0000","last_active":"2024-04-26T10:24:33.974073+0000","last_peered":"2024-04-26T10:24:33.974073+0000","last_clean":"2024-04-26T10:24:33.974073+0000","last_became_active":"2024-04-26T10:24:31.600986+0000","last_became_peered":"2024-04-26T10:24:31.600986+0000","last_unstale":"2024-04-26T10:24:33.974073+0000","last_undegraded":"2024-04-26T10:24:33.974073+0000","last_fullsized":"2024-04-26T10:24:33.974073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:52.125249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173997+0000","last_change":"2024-04-26T10:24:22.548245+0000","last_active":"2024-04-26T10:24:33.173997+0000","last_peered":"2024-04-26T10:24:33.173997+0000","last_clean":"2024-04-26T10:24:33.173997+0000","last_became_active":"2024-04-26T10:24:22.547731+0000","last_became_peered":"2024-04-26T10:24:22.547731+0000","last_unstale":"2024-04-26T10:24:33.173997+0000","last_undegraded":"2024-04-26T10:24:33.173997+0000","last_fullsized":"2024-04-26T10:24:33.173997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:52.538672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173800+0000","last_change":"2024-04-26T10:24:22.549424+0000","last_active":"2024-04-26T10:24:33.173800+0000","last_peered":"2024-04-26T10:24:33.173800+0000","last_clean":"2024-04-26T10:24:33.173800+0000","last_became_active":"2024-04-26T10:24:22.549180+0000","last_became_peered":"2024-04-26T10:24:22.549180+0000","last_unstale":"2024-04-26T10:24:33.173800+0000","last_undegraded":"2024-04-26T10:24:33.173800+0000","last_fullsized":"2024-04-26T10:24:33.173800+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.915633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174913+0000","last_change":"2024-04-26T10:24:22.547840+0000","last_active":"2024-04-26T10:24:33.174913+0000","last_peered":"2024-04-26T10:24:33.174913+0000","last_clean":"2024-04-26T10:24:33.174913+0000","last_became_active":"2024-04-26T10:24:22.547284+0000","last_became_peered":"2024-04-26T10:24:22.547284+0000","last_unstale":"2024-04-26T10:24:33.174913+0000","last_undegraded":"2024-04-26T10:24:33.174913+0000","last_fullsized":"2024-04-26T10:24:33.174913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:09.731025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318637+0000","last_change":"2024-04-26T10:24:22.680232+0000","last_active":"2024-04-26T10:24:33.318637+0000","last_peered":"2024-04-26T10:24:33.318637+0000","last_clean":"2024-04-26T10:24:33.318637+0000","last_became_active":"2024-04-26T10:24:22.679648+0000","last_became_peered":"2024-04-26T10:24:22.679648+0000","last_unstale":"2024-04-26T10:24:33.318637+0000","last_undegraded":"2024-04-26T10:24:33.318637+0000","last_fullsized":"2024-04-26T10:24:33.318637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:58.174215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974286+0000","last_change":"2024-04-26T10:24:31.599182+0000","last_active":"2024-04-26T10:24:33.974286+0000","last_peered":"2024-04-26T10:24:33.974286+0000","last_clean":"2024-04-26T10:24:33.974286+0000","last_became_active":"2024-04-26T10:24:31.598187+0000","last_became_peered":"2024-04-26T10:24:31.598187+0000","last_unstale":"2024-04-26T10:24:33.974286+0000","last_undegraded":"2024-04-26T10:24:33.974286+0000","last_fullsized":"2024-04-26T10:24:33.974286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:24.255353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.176053+0000","last_change":"2024-04-26T10:24:22.547601+0000","last_active":"2024-04-26T10:24:33.176053+0000","last_peered":"2024-04-26T10:24:33.176053+0000","last_clean":"2024-04-26T10:24:33.176053+0000","last_became_active":"2024-04-26T10:24:22.546506+0000","last_became_peered":"2024-04-26T10:24:22.546506+0000","last_unstale":"2024-04-26T10:24:33.176053+0000","last_undegraded":"2024-04-26T10:24:33.176053+0000","last_fullsized":"2024-04-26T10:24:33.176053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:21.263835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182904+0000","last_change":"2024-04-26T10:22:09.748232+0000","last_active":"2024-04-26T10:24:33.182904+0000","last_peered":"2024-04-26T10:24:33.182904+0000","last_clean":"2024-04-26T10:24:33.182904+0000","last_became_active":"2024-04-26T10:22:09.747822+0000","last_became_peered":"2024-04-26T10:22:09.747822+0000","last_unstale":"2024-04-26T10:24:33.182904+0000","last_undegraded":"2024-04-26T10:24:33.182904+0000","last_fullsized":"2024-04-26T10:24:33.182904+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.223031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974030+0000","last_change":"2024-04-26T10:24:31.598330+0000","last_active":"2024-04-26T10:24:33.974030+0000","last_peered":"2024-04-26T10:24:33.974030+0000","last_clean":"2024-04-26T10:24:33.974030+0000","last_became_active":"2024-04-26T10:24:31.597980+0000","last_became_peered":"2024-04-26T10:24:31.597980+0000","last_unstale":"2024-04-26T10:24:33.974030+0000","last_undegraded":"2024-04-26T10:24:33.974030+0000","last_fullsized":"2024-04-26T10:24:33.974030+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:38.711968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174108+0000","last_change":"2024-04-26T10:24:31.602827+0000","last_active":"2024-04-26T10:24:33.174108+0000","last_peered":"2024-04-26T10:24:33.174108+0000","last_clean":"2024-04-26T10:24:33.174108+0000","last_became_active":"2024-04-26T10:24:31.602539+0000","last_became_peered":"2024-04-26T10:24:31.602539+0000","last_unstale":"2024-04-26T10:24:33.174108+0000","last_undegraded":"2024-04-26T10:24:33.174108+0000","last_fullsized":"2024-04-26T10:24:33.174108+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:45.294898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173774+0000","last_change":"2024-04-26T10:24:31.602863+0000","last_active":"2024-04-26T10:24:33.173774+0000","last_peered":"2024-04-26T10:24:33.173774+0000","last_clean":"2024-04-26T10:24:33.173774+0000","last_became_active":"2024-04-26T10:24:31.602453+0000","last_became_peered":"2024-04-26T10:24:31.602453+0000","last_unstale":"2024-04-26T10:24:33.173774+0000","last_undegraded":"2024-04-26T10:24:33.173774+0000","last_fullsized":"2024-04-26T10:24:33.173774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:51.661774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174475+0000","last_change":"2024-04-26T10:24:22.547543+0000","last_active":"2024-04-26T10:24:33.174475+0000","last_peered":"2024-04-26T10:24:33.174475+0000","last_clean":"2024-04-26T10:24:33.174475+0000","last_became_active":"2024-04-26T10:24:22.546856+0000","last_became_peered":"2024-04-26T10:24:22.546856+0000","last_unstale":"2024-04-26T10:24:33.174475+0000","last_undegraded":"2024-04-26T10:24:33.174475+0000","last_fullsized":"2024-04-26T10:24:33.174475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:34.240590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318406+0000","last_change":"2024-04-26T10:24:22.679885+0000","last_active":"2024-04-26T10:24:33.318406+0000","last_peered":"2024-04-26T10:24:33.318406+0000","last_clean":"2024-04-26T10:24:33.318406+0000","last_became_active":"2024-04-26T10:24:22.679350+0000","last_became_peered":"2024-04-26T10:24:22.679350+0000","last_unstale":"2024-04-26T10:24:33.318406+0000","last_undegraded":"2024-04-26T10:24:33.318406+0000","last_fullsized":"2024-04-26T10:24:33.318406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:06.039983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974316+0000","last_change":"2024-04-26T10:24:31.598857+0000","last_active":"2024-04-26T10:24:33.974316+0000","last_peered":"2024-04-26T10:24:33.974316+0000","last_clean":"2024-04-26T10:24:33.974316+0000","last_became_active":"2024-04-26T10:24:31.597563+0000","last_became_peered":"2024-04-26T10:24:31.597563+0000","last_unstale":"2024-04-26T10:24:33.974316+0000","last_undegraded":"2024-04-26T10:24:33.974316+0000","last_fullsized":"2024-04-26T10:24:33.974316+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:26.624180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317832+0000","last_change":"2024-04-26T10:24:22.679291+0000","last_active":"2024-04-26T10:24:33.317832+0000","last_peered":"2024-04-26T10:24:33.317832+0000","last_clean":"2024-04-26T10:24:33.317832+0000","last_became_active":"2024-04-26T10:24:22.678912+0000","last_became_peered":"2024-04-26T10:24:22.678912+0000","last_unstale":"2024-04-26T10:24:33.317832+0000","last_undegraded":"2024-04-26T10:24:33.317832+0000","last_fullsized":"2024-04-26T10:24:33.317832+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:49.260130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175676+0000","last_change":"2024-04-26T10:24:22.546669+0000","last_active":"2024-04-26T10:24:33.175676+0000","last_peered":"2024-04-26T10:24:33.175676+0000","last_clean":"2024-04-26T10:24:33.175676+0000","last_became_active":"2024-04-26T10:24:22.546052+0000","last_became_peered":"2024-04-26T10:24:22.546052+0000","last_unstale":"2024-04-26T10:24:33.175676+0000","last_undegraded":"2024-04-26T10:24:33.175676+0000","last_fullsized":"2024-04-26T10:24:33.175676+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:26.334069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174879+0000","last_change":"2024-04-26T10:24:22.547981+0000","last_active":"2024-04-26T10:24:33.174879+0000","last_peered":"2024-04-26T10:24:33.174879+0000","last_clean":"2024-04-26T10:24:33.174879+0000","last_became_active":"2024-04-26T10:24:22.547663+0000","last_became_peered":"2024-04-26T10:24:22.547663+0000","last_unstale":"2024-04-26T10:24:33.174879+0000","last_undegraded":"2024-04-26T10:24:33.174879+0000","last_fullsized":"2024-04-26T10:24:33.174879+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:07.105037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181281+0000","last_change":"2024-04-26T10:22:09.749283+0000","last_active":"2024-04-26T10:24:33.181281+0000","last_peered":"2024-04-26T10:24:33.181281+0000","last_clean":"2024-04-26T10:24:33.181281+0000","last_became_active":"2024-04-26T10:22:09.748755+0000","last_became_peered":"2024-04-26T10:22:09.748755+0000","last_unstale":"2024-04-26T10:24:33.181281+0000","last_undegraded":"2024-04-26T10:24:33.181281+0000","last_fullsized":"2024-04-26T10:24:33.181281+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:40.910715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317029+0000","last_change":"2024-04-26T10:24:22.684668+0000","last_active":"2024-04-26T10:24:33.317029+0000","last_peered":"2024-04-26T10:24:33.317029+0000","last_clean":"2024-04-26T10:24:33.317029+0000","last_became_active":"2024-04-26T10:24:22.683921+0000","last_became_peered":"2024-04-26T10:24:22.683921+0000","last_unstale":"2024-04-26T10:24:33.317029+0000","last_undegraded":"2024-04-26T10:24:33.317029+0000","last_fullsized":"2024-04-26T10:24:33.317029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.930781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182162+0000","last_change":"2024-04-26T10:24:22.535052+0000","last_active":"2024-04-26T10:24:33.182162+0000","last_peered":"2024-04-26T10:24:33.182162+0000","last_clean":"2024-04-26T10:24:33.182162+0000","last_became_active":"2024-04-26T10:24:22.534674+0000","last_became_peered":"2024-04-26T10:24:22.534674+0000","last_unstale":"2024-04-26T10:24:33.182162+0000","last_undegraded":"2024-04-26T10:24:33.182162+0000","last_fullsized":"2024-04-26T10:24:33.182162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:10.969425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974384+0000","last_change":"2024-04-26T10:24:31.601262+0000","last_active":"2024-04-26T10:24:33.974384+0000","last_peered":"2024-04-26T10:24:33.974384+0000","last_clean":"2024-04-26T10:24:33.974384+0000","last_became_active":"2024-04-26T10:24:31.600815+0000","last_became_peered":"2024-04-26T10:24:31.600815+0000","last_unstale":"2024-04-26T10:24:33.974384+0000","last_undegraded":"2024-04-26T10:24:33.974384+0000","last_fullsized":"2024-04-26T10:24:33.974384+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:02.552727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319258+0000","last_change":"2024-04-26T10:24:22.684739+0000","last_active":"2024-04-26T10:24:33.319258+0000","last_peered":"2024-04-26T10:24:33.319258+0000","last_clean":"2024-04-26T10:24:33.319258+0000","last_became_active":"2024-04-26T10:24:22.683959+0000","last_became_peered":"2024-04-26T10:24:22.683959+0000","last_unstale":"2024-04-26T10:24:33.319258+0000","last_undegraded":"2024-04-26T10:24:33.319258+0000","last_fullsized":"2024-04-26T10:24:33.319258+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:07.840236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":79,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175977+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:24:33.175977+0000","last_peered":"2024-04-26T10:24:33.175977+0000","last_clean":"2024-04-26T10:24:33.175977+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:24:33.175977+0000","last_undegraded":"2024-04-26T10:24:33.175977+0000","last_fullsized":"2024-04-26T10:24:33.175977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:39.394937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974137+0000","last_change":"2024-04-26T10:24:31.602078+0000","last_active":"2024-04-26T10:24:33.974137+0000","last_peered":"2024-04-26T10:24:33.974137+0000","last_clean":"2024-04-26T10:24:33.974137+0000","last_became_active":"2024-04-26T10:24:31.601299+0000","last_became_peered":"2024-04-26T10:24:31.601299+0000","last_unstale":"2024-04-26T10:24:33.974137+0000","last_undegraded":"2024-04-26T10:24:33.974137+0000","last_fullsized":"2024-04-26T10:24:33.974137+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:43.374493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317271+0000","last_change":"2024-04-26T10:24:31.741152+0000","last_active":"2024-04-26T10:24:33.317271+0000","last_peered":"2024-04-26T10:24:33.317271+0000","last_clean":"2024-04-26T10:24:33.317271+0000","last_became_active":"2024-04-26T10:24:31.740626+0000","last_became_peered":"2024-04-26T10:24:31.740626+0000","last_unstale":"2024-04-26T10:24:33.317271+0000","last_undegraded":"2024-04-26T10:24:33.317271+0000","last_fullsized":"2024-04-26T10:24:33.317271+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:23.323149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181503+0000","last_change":"2024-04-26T10:22:09.750562+0000","last_active":"2024-04-26T10:24:33.181503+0000","last_peered":"2024-04-26T10:24:33.181503+0000","last_clean":"2024-04-26T10:24:33.181503+0000","last_became_active":"2024-04-26T10:22:09.750286+0000","last_became_peered":"2024-04-26T10:22:09.750286+0000","last_unstale":"2024-04-26T10:24:33.181503+0000","last_undegraded":"2024-04-26T10:24:33.181503+0000","last_fullsized":"2024-04-26T10:24:33.181503+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:52.795517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317979+0000","last_change":"2024-04-26T10:24:31.741008+0000","last_active":"2024-04-26T10:24:33.317979+0000","last_peered":"2024-04-26T10:24:33.317979+0000","last_clean":"2024-04-26T10:24:33.317979+0000","last_became_active":"2024-04-26T10:24:31.740518+0000","last_became_peered":"2024-04-26T10:24:31.740518+0000","last_unstale":"2024-04-26T10:24:33.317979+0000","last_undegraded":"2024-04-26T10:24:33.317979+0000","last_fullsized":"2024-04-26T10:24:33.317979+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:11:59.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173926+0000","last_change":"2024-04-26T10:24:22.540161+0000","last_active":"2024-04-26T10:24:33.173926+0000","last_peered":"2024-04-26T10:24:33.173926+0000","last_clean":"2024-04-26T10:24:33.173926+0000","last_became_active":"2024-04-26T10:24:22.539106+0000","last_became_peered":"2024-04-26T10:24:22.539106+0000","last_unstale":"2024-04-26T10:24:33.173926+0000","last_undegraded":"2024-04-26T10:24:33.173926+0000","last_fullsized":"2024-04-26T10:24:33.173926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:09.208422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974115+0000","last_change":"2024-04-26T10:24:31.599487+0000","last_active":"2024-04-26T10:24:33.974115+0000","last_peered":"2024-04-26T10:24:33.974115+0000","last_clean":"2024-04-26T10:24:33.974115+0000","last_became_active":"2024-04-26T10:24:31.598307+0000","last_became_peered":"2024-04-26T10:24:31.598307+0000","last_unstale":"2024-04-26T10:24:33.974115+0000","last_undegraded":"2024-04-26T10:24:33.974115+0000","last_fullsized":"2024-04-26T10:24:33.974115+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:11.881961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174602+0000","last_change":"2024-04-26T10:24:22.547974+0000","last_active":"2024-04-26T10:24:33.174602+0000","last_peered":"2024-04-26T10:24:33.174602+0000","last_clean":"2024-04-26T10:24:33.174602+0000","last_became_active":"2024-04-26T10:24:22.546794+0000","last_became_peered":"2024-04-26T10:24:22.546794+0000","last_unstale":"2024-04-26T10:24:33.174602+0000","last_undegraded":"2024-04-26T10:24:33.174602+0000","last_fullsized":"2024-04-26T10:24:33.174602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:28.897600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974196+0000","last_change":"2024-04-26T10:24:31.597848+0000","last_active":"2024-04-26T10:24:33.974196+0000","last_peered":"2024-04-26T10:24:33.974196+0000","last_clean":"2024-04-26T10:24:33.974196+0000","last_became_active":"2024-04-26T10:24:31.596297+0000","last_became_peered":"2024-04-26T10:24:31.596297+0000","last_unstale":"2024-04-26T10:24:33.974196+0000","last_undegraded":"2024-04-26T10:24:33.974196+0000","last_fullsized":"2024-04-26T10:24:33.974196+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:09.585450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317333+0000","last_change":"2024-04-26T10:24:22.684913+0000","last_active":"2024-04-26T10:24:33.317333+0000","last_peered":"2024-04-26T10:24:33.317333+0000","last_clean":"2024-04-26T10:24:33.317333+0000","last_became_active":"2024-04-26T10:24:22.684541+0000","last_became_peered":"2024-04-26T10:24:22.684541+0000","last_unstale":"2024-04-26T10:24:33.317333+0000","last_undegraded":"2024-04-26T10:24:33.317333+0000","last_fullsized":"2024-04-26T10:24:33.317333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:32.802131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318520+0000","last_change":"2024-04-26T10:24:22.683787+0000","last_active":"2024-04-26T10:24:33.318520+0000","last_peered":"2024-04-26T10:24:33.318520+0000","last_clean":"2024-04-26T10:24:33.318520+0000","last_became_active":"2024-04-26T10:24:22.682650+0000","last_became_peered":"2024-04-26T10:24:22.682650+0000","last_unstale":"2024-04-26T10:24:33.318520+0000","last_undegraded":"2024-04-26T10:24:33.318520+0000","last_fullsized":"2024-04-26T10:24:33.318520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:29.301512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973911+0000","last_change":"2024-04-26T10:24:31.601959+0000","last_active":"2024-04-26T10:24:33.973911+0000","last_peered":"2024-04-26T10:24:33.973911+0000","last_clean":"2024-04-26T10:24:33.973911+0000","last_became_active":"2024-04-26T10:24:31.601091+0000","last_became_peered":"2024-04-26T10:24:31.601091+0000","last_unstale":"2024-04-26T10:24:33.973911+0000","last_undegraded":"2024-04-26T10:24:33.973911+0000","last_fullsized":"2024-04-26T10:24:33.973911+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:46.182880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318431+0000","last_change":"2024-04-26T10:24:22.684603+0000","last_active":"2024-04-26T10:24:33.318431+0000","last_peered":"2024-04-26T10:24:33.318431+0000","last_clean":"2024-04-26T10:24:33.318431+0000","last_became_active":"2024-04-26T10:24:22.684213+0000","last_became_peered":"2024-04-26T10:24:22.684213+0000","last_unstale":"2024-04-26T10:24:33.318431+0000","last_undegraded":"2024-04-26T10:24:33.318431+0000","last_fullsized":"2024-04-26T10:24:33.318431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:41.006428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":134,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173541+0000","last_change":"2024-04-26T10:24:31.613086+0000","last_active":"2024-04-26T10:24:33.173541+0000","last_peered":"2024-04-26T10:24:33.173541+0000","last_clean":"2024-04-26T10:24:33.173541+0000","last_became_active":"2024-04-26T10:24:31.604402+0000","last_became_peered":"2024-04-26T10:24:31.604402+0000","last_unstale":"2024-04-26T10:24:33.173541+0000","last_undegraded":"2024-04-26T10:24:33.173541+0000","last_fullsized":"2024-04-26T10:24:33.173541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:52.355783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":115,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175870+0000","last_change":"2024-04-26T10:24:31.624641+0000","last_active":"2024-04-26T10:24:33.175870+0000","last_peered":"2024-04-26T10:24:33.175870+0000","last_clean":"2024-04-26T10:24:33.175870+0000","last_became_active":"2024-04-26T10:24:31.604744+0000","last_became_peered":"2024-04-26T10:24:31.604744+0000","last_unstale":"2024-04-26T10:24:33.175870+0000","last_undegraded":"2024-04-26T10:24:33.175870+0000","last_fullsized":"2024-04-26T10:24:33.175870+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:44.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182275+0000","last_change":"2024-04-26T10:22:09.750173+0000","last_active":"2024-04-26T10:24:33.182275+0000","last_peered":"2024-04-26T10:24:33.182275+0000","last_clean":"2024-04-26T10:24:33.182275+0000","last_became_active":"2024-04-26T10:22:09.749862+0000","last_became_peered":"2024-04-26T10:22:09.749862+0000","last_unstale":"2024-04-26T10:24:33.182275+0000","last_undegraded":"2024-04-26T10:24:33.182275+0000","last_fullsized":"2024-04-26T10:24:33.182275+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:53.204364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182816+0000","last_change":"2024-04-26T10:22:09.750224+0000","last_active":"2024-04-26T10:24:33.182816+0000","last_peered":"2024-04-26T10:24:33.182816+0000","last_clean":"2024-04-26T10:24:33.182816+0000","last_became_active":"2024-04-26T10:22:09.749852+0000","last_became_peered":"2024-04-26T10:22:09.749852+0000","last_unstale":"2024-04-26T10:24:33.182816+0000","last_undegraded":"2024-04-26T10:24:33.182816+0000","last_fullsized":"2024-04-26T10:24:33.182816+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:44.923542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973891+0000","last_change":"2024-04-26T10:24:31.597157+0000","last_active":"2024-04-26T10:24:33.973891+0000","last_peered":"2024-04-26T10:24:33.973891+0000","last_clean":"2024-04-26T10:24:33.973891+0000","last_became_active":"2024-04-26T10:24:31.596335+0000","last_became_peered":"2024-04-26T10:24:31.596335+0000","last_unstale":"2024-04-26T10:24:33.973891+0000","last_undegraded":"2024-04-26T10:24:33.973891+0000","last_fullsized":"2024-04-26T10:24:33.973891+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:07.652892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":81,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175501+0000","last_change":"2024-04-26T10:21:08.935133+0000","last_active":"2024-04-26T10:24:33.175501+0000","last_peered":"2024-04-26T10:24:33.175501+0000","last_clean":"2024-04-26T10:24:33.175501+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:24:33.175501+0000","last_undegraded":"2024-04-26T10:24:33.175501+0000","last_fullsized":"2024-04-26T10:24:33.175501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:25.498249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174259+0000","last_change":"2024-04-26T10:24:22.549411+0000","last_active":"2024-04-26T10:24:33.174259+0000","last_peered":"2024-04-26T10:24:33.174259+0000","last_clean":"2024-04-26T10:24:33.174259+0000","last_became_active":"2024-04-26T10:24:22.549230+0000","last_became_peered":"2024-04-26T10:24:22.549230+0000","last_unstale":"2024-04-26T10:24:33.174259+0000","last_undegraded":"2024-04-26T10:24:33.174259+0000","last_fullsized":"2024-04-26T10:24:33.174259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:00.343304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175419+0000","last_change":"2024-04-26T10:24:22.541409+0000","last_active":"2024-04-26T10:24:33.175419+0000","last_peered":"2024-04-26T10:24:33.175419+0000","last_clean":"2024-04-26T10:24:33.175419+0000","last_became_active":"2024-04-26T10:24:22.540611+0000","last_became_peered":"2024-04-26T10:24:22.540611+0000","last_unstale":"2024-04-26T10:24:33.175419+0000","last_undegraded":"2024-04-26T10:24:33.175419+0000","last_fullsized":"2024-04-26T10:24:33.175419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:48.882187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319142+0000","last_change":"2024-04-26T10:24:22.687178+0000","last_active":"2024-04-26T10:24:33.319142+0000","last_peered":"2024-04-26T10:24:33.319142+0000","last_clean":"2024-04-26T10:24:33.319142+0000","last_became_active":"2024-04-26T10:24:22.686841+0000","last_became_peered":"2024-04-26T10:24:22.686841+0000","last_unstale":"2024-04-26T10:24:33.319142+0000","last_undegraded":"2024-04-26T10:24:33.319142+0000","last_fullsized":"2024-04-26T10:24:33.319142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:52.907696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318078+0000","last_change":"2024-04-26T10:24:22.687183+0000","last_active":"2024-04-26T10:24:33.318078+0000","last_peered":"2024-04-26T10:24:33.318078+0000","last_clean":"2024-04-26T10:24:33.318078+0000","last_became_active":"2024-04-26T10:24:22.686846+0000","last_became_peered":"2024-04-26T10:24:22.686846+0000","last_unstale":"2024-04-26T10:24:33.318078+0000","last_undegraded":"2024-04-26T10:24:33.318078+0000","last_fullsized":"2024-04-26T10:24:33.318078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:37.083683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175590+0000","last_change":"2024-04-26T10:24:22.546117+0000","last_active":"2024-04-26T10:24:33.175590+0000","last_peered":"2024-04-26T10:24:33.175590+0000","last_clean":"2024-04-26T10:24:33.175590+0000","last_became_active":"2024-04-26T10:24:22.545616+0000","last_became_peered":"2024-04-26T10:24:22.545616+0000","last_unstale":"2024-04-26T10:24:33.175590+0000","last_undegraded":"2024-04-26T10:24:33.175590+0000","last_fullsized":"2024-04-26T10:24:33.175590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:09.247826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174530+0000","last_change":"2024-04-26T10:24:22.540185+0000","last_active":"2024-04-26T10:24:33.174530+0000","last_peered":"2024-04-26T10:24:33.174530+0000","last_clean":"2024-04-26T10:24:33.174530+0000","last_became_active":"2024-04-26T10:24:22.538982+0000","last_became_peered":"2024-04-26T10:24:22.538982+0000","last_unstale":"2024-04-26T10:24:33.174530+0000","last_undegraded":"2024-04-26T10:24:33.174530+0000","last_fullsized":"2024-04-26T10:24:33.174530+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:27.225284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":79,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174662+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:24:33.174662+0000","last_peered":"2024-04-26T10:24:33.174662+0000","last_clean":"2024-04-26T10:24:33.174662+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:24:33.174662+0000","last_undegraded":"2024-04-26T10:24:33.174662+0000","last_fullsized":"2024-04-26T10:24:33.174662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181167+0000","last_change":"2024-04-26T10:22:09.748616+0000","last_active":"2024-04-26T10:24:33.181167+0000","last_peered":"2024-04-26T10:24:33.181167+0000","last_clean":"2024-04-26T10:24:33.181167+0000","last_became_active":"2024-04-26T10:22:09.748256+0000","last_became_peered":"2024-04-26T10:22:09.748256+0000","last_unstale":"2024-04-26T10:24:33.181167+0000","last_undegraded":"2024-04-26T10:24:33.181167+0000","last_fullsized":"2024-04-26T10:24:33.181167+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:19.402647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174461+0000","last_change":"2024-04-26T10:24:31.604150+0000","last_active":"2024-04-26T10:24:33.174461+0000","last_peered":"2024-04-26T10:24:33.174461+0000","last_clean":"2024-04-26T10:24:33.174461+0000","last_became_active":"2024-04-26T10:24:31.603620+0000","last_became_peered":"2024-04-26T10:24:31.603620+0000","last_unstale":"2024-04-26T10:24:33.174461+0000","last_undegraded":"2024-04-26T10:24:33.174461+0000","last_fullsized":"2024-04-26T10:24:33.174461+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:17.085344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973830+0000","last_change":"2024-04-26T10:24:31.598521+0000","last_active":"2024-04-26T10:24:33.973830+0000","last_peered":"2024-04-26T10:24:33.973830+0000","last_clean":"2024-04-26T10:24:33.973830+0000","last_became_active":"2024-04-26T10:24:31.598120+0000","last_became_peered":"2024-04-26T10:24:31.598120+0000","last_unstale":"2024-04-26T10:24:33.973830+0000","last_undegraded":"2024-04-26T10:24:33.973830+0000","last_fullsized":"2024-04-26T10:24:33.973830+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:23.723355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319166+0000","last_change":"2024-04-26T10:24:22.680557+0000","last_active":"2024-04-26T10:24:33.319166+0000","last_peered":"2024-04-26T10:24:33.319166+0000","last_clean":"2024-04-26T10:24:33.319166+0000","last_became_active":"2024-04-26T10:24:22.679940+0000","last_became_peered":"2024-04-26T10:24:22.679940+0000","last_unstale":"2024-04-26T10:24:33.319166+0000","last_undegraded":"2024-04-26T10:24:33.319166+0000","last_fullsized":"2024-04-26T10:24:33.319166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:06.379234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":333,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185235+0000","last_change":"2024-04-26T10:24:34.185235+0000","last_active":"2024-04-26T10:24:34.185235+0000","last_peered":"2024-04-26T10:24:34.185235+0000","last_clean":"2024-04-26T10:24:34.185235+0000","last_became_active":"2024-04-26T10:24:34.184490+0000","last_became_peered":"2024-04-26T10:24:34.184490+0000","last_unstale":"2024-04-26T10:24:34.185235+0000","last_undegraded":"2024-04-26T10:24:34.185235+0000","last_fullsized":"2024-04-26T10:24:34.185235+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:33.812288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174100+0000","last_change":"2024-04-26T10:24:22.547708+0000","last_active":"2024-04-26T10:24:33.174100+0000","last_peered":"2024-04-26T10:24:33.174100+0000","last_clean":"2024-04-26T10:24:33.174100+0000","last_became_active":"2024-04-26T10:24:22.546650+0000","last_became_peered":"2024-04-26T10:24:22.546650+0000","last_unstale":"2024-04-26T10:24:33.174100+0000","last_undegraded":"2024-04-26T10:24:33.174100+0000","last_fullsized":"2024-04-26T10:24:33.174100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:55.474931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317752+0000","last_change":"2024-04-26T10:24:22.676755+0000","last_active":"2024-04-26T10:24:33.317752+0000","last_peered":"2024-04-26T10:24:33.317752+0000","last_clean":"2024-04-26T10:24:33.317752+0000","last_became_active":"2024-04-26T10:24:22.676489+0000","last_became_peered":"2024-04-26T10:24:22.676489+0000","last_unstale":"2024-04-26T10:24:33.317752+0000","last_undegraded":"2024-04-26T10:24:33.317752+0000","last_fullsized":"2024-04-26T10:24:33.317752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:38.979532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174906+0000","last_change":"2024-04-26T10:24:31.603833+0000","last_active":"2024-04-26T10:24:33.174906+0000","last_peered":"2024-04-26T10:24:33.174906+0000","last_clean":"2024-04-26T10:24:33.174906+0000","last_became_active":"2024-04-26T10:24:31.603498+0000","last_became_peered":"2024-04-26T10:24:31.603498+0000","last_unstale":"2024-04-26T10:24:33.174906+0000","last_undegraded":"2024-04-26T10:24:33.174906+0000","last_fullsized":"2024-04-26T10:24:33.174906+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:58.952460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174671+0000","last_change":"2024-04-26T10:24:31.603067+0000","last_active":"2024-04-26T10:24:33.174671+0000","last_peered":"2024-04-26T10:24:33.174671+0000","last_clean":"2024-04-26T10:24:33.174671+0000","last_became_active":"2024-04-26T10:24:31.602611+0000","last_became_peered":"2024-04-26T10:24:31.602611+0000","last_unstale":"2024-04-26T10:24:33.174671+0000","last_undegraded":"2024-04-26T10:24:33.174671+0000","last_fullsized":"2024-04-26T10:24:33.174671+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:14.943135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316711+0000","last_change":"2024-04-26T10:24:22.685554+0000","last_active":"2024-04-26T10:24:33.316711+0000","last_peered":"2024-04-26T10:24:33.316711+0000","last_clean":"2024-04-26T10:24:33.316711+0000","last_became_active":"2024-04-26T10:24:22.685051+0000","last_became_peered":"2024-04-26T10:24:22.685051+0000","last_unstale":"2024-04-26T10:24:33.316711+0000","last_undegraded":"2024-04-26T10:24:33.316711+0000","last_fullsized":"2024-04-26T10:24:33.316711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:59.389895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182836+0000","last_change":"2024-04-26T10:24:22.538294+0000","last_active":"2024-04-26T10:24:33.182836+0000","last_peered":"2024-04-26T10:24:33.182836+0000","last_clean":"2024-04-26T10:24:33.182836+0000","last_became_active":"2024-04-26T10:24:22.537983+0000","last_became_peered":"2024-04-26T10:24:22.537983+0000","last_unstale":"2024-04-26T10:24:33.182836+0000","last_undegraded":"2024-04-26T10:24:33.182836+0000","last_fullsized":"2024-04-26T10:24:33.182836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:54.064158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317277+0000","last_change":"2024-04-26T10:24:22.679231+0000","last_active":"2024-04-26T10:24:33.317277+0000","last_peered":"2024-04-26T10:24:33.317277+0000","last_clean":"2024-04-26T10:24:33.317277+0000","last_became_active":"2024-04-26T10:24:22.678866+0000","last_became_peered":"2024-04-26T10:24:22.678866+0000","last_unstale":"2024-04-26T10:24:33.317277+0000","last_undegraded":"2024-04-26T10:24:33.317277+0000","last_fullsized":"2024-04-26T10:24:33.317277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:26.179423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182367+0000","last_change":"2024-04-26T10:22:09.750297+0000","last_active":"2024-04-26T10:24:33.182367+0000","last_peered":"2024-04-26T10:24:33.182367+0000","last_clean":"2024-04-26T10:24:33.182367+0000","last_became_active":"2024-04-26T10:22:09.749935+0000","last_became_peered":"2024-04-26T10:22:09.749935+0000","last_unstale":"2024-04-26T10:24:33.182367+0000","last_undegraded":"2024-04-26T10:24:33.182367+0000","last_fullsized":"2024-04-26T10:24:33.182367+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:51.197306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319145+0000","last_change":"2024-04-26T10:24:31.745820+0000","last_active":"2024-04-26T10:24:33.319145+0000","last_peered":"2024-04-26T10:24:33.319145+0000","last_clean":"2024-04-26T10:24:33.319145+0000","last_became_active":"2024-04-26T10:24:31.745487+0000","last_became_peered":"2024-04-26T10:24:31.745487+0000","last_unstale":"2024-04-26T10:24:33.319145+0000","last_undegraded":"2024-04-26T10:24:33.319145+0000","last_fullsized":"2024-04-26T10:24:33.319145+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:00.239650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174768+0000","last_change":"2024-04-26T10:24:22.539761+0000","last_active":"2024-04-26T10:24:33.174768+0000","last_peered":"2024-04-26T10:24:33.174768+0000","last_clean":"2024-04-26T10:24:33.174768+0000","last_became_active":"2024-04-26T10:24:22.538993+0000","last_became_peered":"2024-04-26T10:24:22.538993+0000","last_unstale":"2024-04-26T10:24:33.174768+0000","last_undegraded":"2024-04-26T10:24:33.174768+0000","last_fullsized":"2024-04-26T10:24:33.174768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:24.782191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174356+0000","last_change":"2024-04-26T10:24:22.542774+0000","last_active":"2024-04-26T10:24:33.174356+0000","last_peered":"2024-04-26T10:24:33.174356+0000","last_clean":"2024-04-26T10:24:33.174356+0000","last_became_active":"2024-04-26T10:24:22.541795+0000","last_became_peered":"2024-04-26T10:24:22.541795+0000","last_unstale":"2024-04-26T10:24:33.174356+0000","last_undegraded":"2024-04-26T10:24:33.174356+0000","last_fullsized":"2024-04-26T10:24:33.174356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:07.303056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317944+0000","last_change":"2024-04-26T10:24:31.744717+0000","last_active":"2024-04-26T10:24:33.317944+0000","last_peered":"2024-04-26T10:24:33.317944+0000","last_clean":"2024-04-26T10:24:33.317944+0000","last_became_active":"2024-04-26T10:24:31.744373+0000","last_became_peered":"2024-04-26T10:24:31.744373+0000","last_unstale":"2024-04-26T10:24:33.317944+0000","last_undegraded":"2024-04-26T10:24:33.317944+0000","last_fullsized":"2024-04-26T10:24:33.317944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:10.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174262+0000","last_change":"2024-04-26T10:24:22.538573+0000","last_active":"2024-04-26T10:24:33.174262+0000","last_peered":"2024-04-26T10:24:33.174262+0000","last_clean":"2024-04-26T10:24:33.174262+0000","last_became_active":"2024-04-26T10:24:22.537041+0000","last_became_peered":"2024-04-26T10:24:22.537041+0000","last_unstale":"2024-04-26T10:24:33.174262+0000","last_undegraded":"2024-04-26T10:24:33.174262+0000","last_fullsized":"2024-04-26T10:24:33.174262+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:48.026637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318800+0000","last_change":"2024-04-26T10:24:31.744776+0000","last_active":"2024-04-26T10:24:33.318800+0000","last_peered":"2024-04-26T10:24:33.318800+0000","last_clean":"2024-04-26T10:24:33.318800+0000","last_became_active":"2024-04-26T10:24:31.744342+0000","last_became_peered":"2024-04-26T10:24:31.744342+0000","last_unstale":"2024-04-26T10:24:33.318800+0000","last_undegraded":"2024-04-26T10:24:33.318800+0000","last_fullsized":"2024-04-26T10:24:33.318800+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:08:33.941367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973980+0000","last_change":"2024-04-26T10:24:31.599193+0000","last_active":"2024-04-26T10:24:33.973980+0000","last_peered":"2024-04-26T10:24:33.973980+0000","last_clean":"2024-04-26T10:24:33.973980+0000","last_became_active":"2024-04-26T10:24:31.598432+0000","last_became_peered":"2024-04-26T10:24:31.598432+0000","last_unstale":"2024-04-26T10:24:33.973980+0000","last_undegraded":"2024-04-26T10:24:33.973980+0000","last_fullsized":"2024-04-26T10:24:33.973980+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:41.515775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318555+0000","last_change":"2024-04-26T10:24:31.745336+0000","last_active":"2024-04-26T10:24:33.318555+0000","last_peered":"2024-04-26T10:24:33.318555+0000","last_clean":"2024-04-26T10:24:33.318555+0000","last_became_active":"2024-04-26T10:24:31.745004+0000","last_became_peered":"2024-04-26T10:24:31.745004+0000","last_unstale":"2024-04-26T10:24:33.318555+0000","last_undegraded":"2024-04-26T10:24:33.318555+0000","last_fullsized":"2024-04-26T10:24:33.318555+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:15.275549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974267+0000","last_change":"2024-04-26T10:24:31.601585+0000","last_active":"2024-04-26T10:24:33.974267+0000","last_peered":"2024-04-26T10:24:33.974267+0000","last_clean":"2024-04-26T10:24:33.974267+0000","last_became_active":"2024-04-26T10:24:31.600977+0000","last_became_peered":"2024-04-26T10:24:31.600977+0000","last_unstale":"2024-04-26T10:24:33.974267+0000","last_undegraded":"2024-04-26T10:24:33.974267+0000","last_fullsized":"2024-04-26T10:24:33.974267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.329801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181771+0000","last_change":"2024-04-26T10:22:09.758116+0000","last_active":"2024-04-26T10:24:33.181771+0000","last_peered":"2024-04-26T10:24:33.181771+0000","last_clean":"2024-04-26T10:24:33.181771+0000","last_became_active":"2024-04-26T10:22:09.757813+0000","last_became_peered":"2024-04-26T10:22:09.757813+0000","last_unstale":"2024-04-26T10:24:33.181771+0000","last_undegraded":"2024-04-26T10:24:33.181771+0000","last_fullsized":"2024-04-26T10:24:33.181771+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:01.195987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318177+0000","last_change":"2024-04-26T10:24:22.680137+0000","last_active":"2024-04-26T10:24:33.318177+0000","last_peered":"2024-04-26T10:24:33.318177+0000","last_clean":"2024-04-26T10:24:33.318177+0000","last_became_active":"2024-04-26T10:24:22.679497+0000","last_became_peered":"2024-04-26T10:24:22.679497+0000","last_unstale":"2024-04-26T10:24:33.318177+0000","last_undegraded":"2024-04-26T10:24:33.318177+0000","last_fullsized":"2024-04-26T10:24:33.318177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:00.401135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318093+0000","last_change":"2024-04-26T10:24:31.741102+0000","last_active":"2024-04-26T10:24:33.318093+0000","last_peered":"2024-04-26T10:24:33.318093+0000","last_clean":"2024-04-26T10:24:33.318093+0000","last_became_active":"2024-04-26T10:24:31.740589+0000","last_became_peered":"2024-04-26T10:24:31.740589+0000","last_unstale":"2024-04-26T10:24:33.318093+0000","last_undegraded":"2024-04-26T10:24:33.318093+0000","last_fullsized":"2024-04-26T10:24:33.318093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:38.170544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317410+0000","last_change":"2024-04-26T10:24:22.686404+0000","last_active":"2024-04-26T10:24:33.317410+0000","last_peered":"2024-04-26T10:24:33.317410+0000","last_clean":"2024-04-26T10:24:33.317410+0000","last_became_active":"2024-04-26T10:24:22.686094+0000","last_became_peered":"2024-04-26T10:24:22.686094+0000","last_unstale":"2024-04-26T10:24:33.317410+0000","last_undegraded":"2024-04-26T10:24:33.317410+0000","last_fullsized":"2024-04-26T10:24:33.317410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:37.911705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318296+0000","last_change":"2024-04-26T10:24:22.682344+0000","last_active":"2024-04-26T10:24:33.318296+0000","last_peered":"2024-04-26T10:24:33.318296+0000","last_clean":"2024-04-26T10:24:33.318296+0000","last_became_active":"2024-04-26T10:24:22.681977+0000","last_became_peered":"2024-04-26T10:24:22.681977+0000","last_unstale":"2024-04-26T10:24:33.318296+0000","last_undegraded":"2024-04-26T10:24:33.318296+0000","last_fullsized":"2024-04-26T10:24:33.318296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:56.544667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175850+0000","last_change":"2024-04-26T10:24:31.605320+0000","last_active":"2024-04-26T10:24:33.175850+0000","last_peered":"2024-04-26T10:24:33.175850+0000","last_clean":"2024-04-26T10:24:33.175850+0000","last_became_active":"2024-04-26T10:24:31.604158+0000","last_became_peered":"2024-04-26T10:24:31.604158+0000","last_unstale":"2024-04-26T10:24:33.175850+0000","last_undegraded":"2024-04-26T10:24:33.175850+0000","last_fullsized":"2024-04-26T10:24:33.175850+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:53.955856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973931+0000","last_change":"2024-04-26T10:24:31.601291+0000","last_active":"2024-04-26T10:24:33.973931+0000","last_peered":"2024-04-26T10:24:33.973931+0000","last_clean":"2024-04-26T10:24:33.973931+0000","last_became_active":"2024-04-26T10:24:31.600474+0000","last_became_peered":"2024-04-26T10:24:31.600474+0000","last_unstale":"2024-04-26T10:24:33.973931+0000","last_undegraded":"2024-04-26T10:24:33.973931+0000","last_fullsized":"2024-04-26T10:24:33.973931+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:30.284416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175157+0000","last_change":"2024-04-26T10:24:31.604975+0000","last_active":"2024-04-26T10:24:33.175157+0000","last_peered":"2024-04-26T10:24:33.175157+0000","last_clean":"2024-04-26T10:24:33.175157+0000","last_became_active":"2024-04-26T10:24:31.604609+0000","last_became_peered":"2024-04-26T10:24:31.604609+0000","last_unstale":"2024-04-26T10:24:33.175157+0000","last_undegraded":"2024-04-26T10:24:33.175157+0000","last_fullsized":"2024-04-26T10:24:33.175157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:04.412544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":132,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175190+0000","last_change":"2024-04-26T10:24:31.622111+0000","last_active":"2024-04-26T10:24:33.175190+0000","last_peered":"2024-04-26T10:24:33.175190+0000","last_clean":"2024-04-26T10:24:33.175190+0000","last_became_active":"2024-04-26T10:24:31.604884+0000","last_became_peered":"2024-04-26T10:24:31.604884+0000","last_unstale":"2024-04-26T10:24:33.175190+0000","last_undegraded":"2024-04-26T10:24:33.175190+0000","last_fullsized":"2024-04-26T10:24:33.175190+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:18.600081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317264+0000","last_change":"2024-04-26T10:24:31.739955+0000","last_active":"2024-04-26T10:24:33.317264+0000","last_peered":"2024-04-26T10:24:33.317264+0000","last_clean":"2024-04-26T10:24:33.317264+0000","last_became_active":"2024-04-26T10:24:31.739550+0000","last_became_peered":"2024-04-26T10:24:31.739550+0000","last_unstale":"2024-04-26T10:24:33.317264+0000","last_undegraded":"2024-04-26T10:24:33.317264+0000","last_fullsized":"2024-04-26T10:24:33.317264+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:31.253486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974245+0000","last_change":"2024-04-26T10:24:31.609788+0000","last_active":"2024-04-26T10:24:33.974245+0000","last_peered":"2024-04-26T10:24:33.974245+0000","last_clean":"2024-04-26T10:24:33.974245+0000","last_became_active":"2024-04-26T10:24:31.601218+0000","last_became_peered":"2024-04-26T10:24:31.601218+0000","last_unstale":"2024-04-26T10:24:33.974245+0000","last_undegraded":"2024-04-26T10:24:33.974245+0000","last_fullsized":"2024-04-26T10:24:33.974245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:39.380483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175533+0000","last_change":"2024-04-26T10:24:22.546807+0000","last_active":"2024-04-26T10:24:33.175533+0000","last_peered":"2024-04-26T10:24:33.175533+0000","last_clean":"2024-04-26T10:24:33.175533+0000","last_became_active":"2024-04-26T10:24:22.546378+0000","last_became_peered":"2024-04-26T10:24:22.546378+0000","last_unstale":"2024-04-26T10:24:33.175533+0000","last_undegraded":"2024-04-26T10:24:33.175533+0000","last_fullsized":"2024-04-26T10:24:33.175533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:06.866157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317068+0000","last_change":"2024-04-26T10:24:22.684096+0000","last_active":"2024-04-26T10:24:33.317068+0000","last_peered":"2024-04-26T10:24:33.317068+0000","last_clean":"2024-04-26T10:24:33.317068+0000","last_became_active":"2024-04-26T10:24:22.683558+0000","last_became_peered":"2024-04-26T10:24:22.683558+0000","last_unstale":"2024-04-26T10:24:33.317068+0000","last_undegraded":"2024-04-26T10:24:33.317068+0000","last_fullsized":"2024-04-26T10:24:33.317068+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:05.316682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318841+0000","last_change":"2024-04-26T10:24:22.684541+0000","last_active":"2024-04-26T10:24:33.318841+0000","last_peered":"2024-04-26T10:24:33.318841+0000","last_clean":"2024-04-26T10:24:33.318841+0000","last_became_active":"2024-04-26T10:24:22.684166+0000","last_became_peered":"2024-04-26T10:24:22.684166+0000","last_unstale":"2024-04-26T10:24:33.318841+0000","last_undegraded":"2024-04-26T10:24:33.318841+0000","last_fullsized":"2024-04-26T10:24:33.318841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:30.164642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317049+0000","last_change":"2024-04-26T10:24:31.745539+0000","last_active":"2024-04-26T10:24:33.317049+0000","last_peered":"2024-04-26T10:24:33.317049+0000","last_clean":"2024-04-26T10:24:33.317049+0000","last_became_active":"2024-04-26T10:24:31.745216+0000","last_became_peered":"2024-04-26T10:24:31.745216+0000","last_unstale":"2024-04-26T10:24:33.317049+0000","last_undegraded":"2024-04-26T10:24:33.317049+0000","last_fullsized":"2024-04-26T10:24:33.317049+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:55.390023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183305+0000","last_change":"2024-04-26T10:22:09.750605+0000","last_active":"2024-04-26T10:24:33.183305+0000","last_peered":"2024-04-26T10:24:33.183305+0000","last_clean":"2024-04-26T10:24:33.183305+0000","last_became_active":"2024-04-26T10:22:09.750359+0000","last_became_peered":"2024-04-26T10:22:09.750359+0000","last_unstale":"2024-04-26T10:24:33.183305+0000","last_undegraded":"2024-04-26T10:24:33.183305+0000","last_fullsized":"2024-04-26T10:24:33.183305+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:56.948741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316663+0000","last_change":"2024-04-26T10:24:31.740907+0000","last_active":"2024-04-26T10:24:33.316663+0000","last_peered":"2024-04-26T10:24:33.316663+0000","last_clean":"2024-04-26T10:24:33.316663+0000","last_became_active":"2024-04-26T10:24:31.740477+0000","last_became_peered":"2024-04-26T10:24:31.740477+0000","last_unstale":"2024-04-26T10:24:33.316663+0000","last_undegraded":"2024-04-26T10:24:33.316663+0000","last_fullsized":"2024-04-26T10:24:33.316663+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:30.206347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318888+0000","last_change":"2024-04-26T10:24:22.684108+0000","last_active":"2024-04-26T10:24:33.318888+0000","last_peered":"2024-04-26T10:24:33.318888+0000","last_clean":"2024-04-26T10:24:33.318888+0000","last_became_active":"2024-04-26T10:24:22.683501+0000","last_became_peered":"2024-04-26T10:24:22.683501+0000","last_unstale":"2024-04-26T10:24:33.318888+0000","last_undegraded":"2024-04-26T10:24:33.318888+0000","last_fullsized":"2024-04-26T10:24:33.318888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:17.355758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316745+0000","last_change":"2024-04-26T10:24:22.685228+0000","last_active":"2024-04-26T10:24:33.316745+0000","last_peered":"2024-04-26T10:24:33.316745+0000","last_clean":"2024-04-26T10:24:33.316745+0000","last_became_active":"2024-04-26T10:24:22.684469+0000","last_became_peered":"2024-04-26T10:24:22.684469+0000","last_unstale":"2024-04-26T10:24:33.316745+0000","last_undegraded":"2024-04-26T10:24:33.316745+0000","last_fullsized":"2024-04-26T10:24:33.316745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:53.834583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182003+0000","last_change":"2024-04-26T10:22:09.753136+0000","last_active":"2024-04-26T10:24:33.182003+0000","last_peered":"2024-04-26T10:24:33.182003+0000","last_clean":"2024-04-26T10:24:33.182003+0000","last_became_active":"2024-04-26T10:22:09.752856+0000","last_became_peered":"2024-04-26T10:22:09.752856+0000","last_unstale":"2024-04-26T10:24:33.182003+0000","last_undegraded":"2024-04-26T10:24:33.182003+0000","last_fullsized":"2024-04-26T10:24:33.182003+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:48.541930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":88,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181723+0000","last_change":"2024-04-26T10:24:22.535413+0000","last_active":"2024-04-26T10:24:33.181723+0000","last_peered":"2024-04-26T10:24:33.181723+0000","last_clean":"2024-04-26T10:24:33.181723+0000","last_became_active":"2024-04-26T10:24:22.535036+0000","last_became_peered":"2024-04-26T10:24:22.535036+0000","last_unstale":"2024-04-26T10:24:33.181723+0000","last_undegraded":"2024-04-26T10:24:33.181723+0000","last_fullsized":"2024-04-26T10:24:33.181723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:43.756504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183058+0000","last_change":"2024-04-26T10:24:22.535819+0000","last_active":"2024-04-26T10:24:33.183058+0000","last_peered":"2024-04-26T10:24:33.183058+0000","last_clean":"2024-04-26T10:24:33.183058+0000","last_became_active":"2024-04-26T10:24:22.535562+0000","last_became_peered":"2024-04-26T10:24:22.535562+0000","last_unstale":"2024-04-26T10:24:33.183058+0000","last_undegraded":"2024-04-26T10:24:33.183058+0000","last_fullsized":"2024-04-26T10:24:33.183058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:24.845621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974051+0000","last_change":"2024-04-26T10:24:31.600594+0000","last_active":"2024-04-26T10:24:33.974051+0000","last_peered":"2024-04-26T10:24:33.974051+0000","last_clean":"2024-04-26T10:24:33.974051+0000","last_became_active":"2024-04-26T10:24:31.600121+0000","last_became_peered":"2024-04-26T10:24:31.600121+0000","last_unstale":"2024-04-26T10:24:33.974051+0000","last_undegraded":"2024-04-26T10:24:33.974051+0000","last_fullsized":"2024-04-26T10:24:33.974051+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:05.491069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175273+0000","last_change":"2024-04-26T10:24:22.542755+0000","last_active":"2024-04-26T10:24:33.175273+0000","last_peered":"2024-04-26T10:24:33.175273+0000","last_clean":"2024-04-26T10:24:33.175273+0000","last_became_active":"2024-04-26T10:24:22.541543+0000","last_became_peered":"2024-04-26T10:24:22.541543+0000","last_unstale":"2024-04-26T10:24:33.175273+0000","last_undegraded":"2024-04-26T10:24:33.175273+0000","last_fullsized":"2024-04-26T10:24:33.175273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:50.942528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175459+0000","last_change":"2024-04-26T10:24:22.541418+0000","last_active":"2024-04-26T10:24:33.175459+0000","last_peered":"2024-04-26T10:24:33.175459+0000","last_clean":"2024-04-26T10:24:33.175459+0000","last_became_active":"2024-04-26T10:24:22.540767+0000","last_became_peered":"2024-04-26T10:24:22.540767+0000","last_unstale":"2024-04-26T10:24:33.175459+0000","last_undegraded":"2024-04-26T10:24:33.175459+0000","last_fullsized":"2024-04-26T10:24:33.175459+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:26.684306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174534+0000","last_change":"2024-04-26T10:24:22.547294+0000","last_active":"2024-04-26T10:24:33.174534+0000","last_peered":"2024-04-26T10:24:33.174534+0000","last_clean":"2024-04-26T10:24:33.174534+0000","last_became_active":"2024-04-26T10:24:22.546811+0000","last_became_peered":"2024-04-26T10:24:22.546811+0000","last_unstale":"2024-04-26T10:24:33.174534+0000","last_undegraded":"2024-04-26T10:24:33.174534+0000","last_fullsized":"2024-04-26T10:24:33.174534+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:03.037283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182738+0000","last_change":"2024-04-26T10:22:09.753438+0000","last_active":"2024-04-26T10:24:33.182738+0000","last_peered":"2024-04-26T10:24:33.182738+0000","last_clean":"2024-04-26T10:24:33.182738+0000","last_became_active":"2024-04-26T10:22:09.753211+0000","last_became_peered":"2024-04-26T10:22:09.753211+0000","last_unstale":"2024-04-26T10:24:33.182738+0000","last_undegraded":"2024-04-26T10:24:33.182738+0000","last_fullsized":"2024-04-26T10:24:33.182738+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:39.406859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973960+0000","last_change":"2024-04-26T10:24:31.600935+0000","last_active":"2024-04-26T10:24:33.973960+0000","last_peered":"2024-04-26T10:24:33.973960+0000","last_clean":"2024-04-26T10:24:33.973960+0000","last_became_active":"2024-04-26T10:24:31.600088+0000","last_became_peered":"2024-04-26T10:24:31.600088+0000","last_unstale":"2024-04-26T10:24:33.973960+0000","last_undegraded":"2024-04-26T10:24:33.973960+0000","last_fullsized":"2024-04-26T10:24:33.973960+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:58.341684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319737+0000","last_change":"2024-04-26T10:24:22.680082+0000","last_active":"2024-04-26T10:24:33.319737+0000","last_peered":"2024-04-26T10:24:33.319737+0000","last_clean":"2024-04-26T10:24:33.319737+0000","last_became_active":"2024-04-26T10:24:22.679652+0000","last_became_peered":"2024-04-26T10:24:22.679652+0000","last_unstale":"2024-04-26T10:24:33.319737+0000","last_undegraded":"2024-04-26T10:24:33.319737+0000","last_fullsized":"2024-04-26T10:24:33.319737+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:37.821623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173304+0000","last_change":"2024-04-26T10:24:22.540326+0000","last_active":"2024-04-26T10:24:33.173304+0000","last_peered":"2024-04-26T10:24:33.173304+0000","last_clean":"2024-04-26T10:24:33.173304+0000","last_became_active":"2024-04-26T10:24:22.538895+0000","last_became_peered":"2024-04-26T10:24:22.538895+0000","last_unstale":"2024-04-26T10:24:33.173304+0000","last_undegraded":"2024-04-26T10:24:33.173304+0000","last_fullsized":"2024-04-26T10:24:33.173304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:29.709972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319358+0000","last_change":"2024-04-26T10:24:22.685454+0000","last_active":"2024-04-26T10:24:33.319358+0000","last_peered":"2024-04-26T10:24:33.319358+0000","last_clean":"2024-04-26T10:24:33.319358+0000","last_became_active":"2024-04-26T10:24:22.684863+0000","last_became_peered":"2024-04-26T10:24:22.684863+0000","last_unstale":"2024-04-26T10:24:33.319358+0000","last_undegraded":"2024-04-26T10:24:33.319358+0000","last_fullsized":"2024-04-26T10:24:33.319358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:33.027447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":21541,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673009,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279076,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":278014,"kb_avail":94092764,"statfs":{"total":96636764160,"available":96350990336,"internally_reserved":0,"allocated":1064960,"data_stored":1035671,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":284686790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:24:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55000000000000004,"15min":0.51600000000000001},"min":{"1min":0.25800000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.67500000000000004,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.53900000000000003},"min":{"1min":0.28000000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.754,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":0,"up_from":10,"seq":42949673008,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487484,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":486398,"kb_avail":93884356,"statfs":{"total":96636764160,"available":96137580544,"internally_reserved":0,"allocated":1089536,"data_stored":1036287,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":498072006},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:24:04 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.65600000000000003,"15min":0.56599999999999995},"min":{"1min":0.21099999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":4.1369999999999996,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.25900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.748,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":2,"up_from":80,"seq":343597383685,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38380,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":37369,"kb_avail":94333460,"statfs":{"total":96636764160,"available":96597463040,"internally_reserved":0,"allocated":1007616,"data_stored":444173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6879,"internal_metadata":38266145},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:24:41.143 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:24:41.460 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:24:41.463 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:24:41.476 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-04-26T10:24:40.042309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1184088,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":804940,"kb_used_data":3088,"kb_used_omap":9,"kb_used_meta":801782,"kb_avail":282310580,"statfs":{"total":289910292480,"available":289086033920,"internally_reserved":0,"allocated":3162112,"data_stored":2516131,"data_compressed":14075,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":10067,"internal_metadata":821024941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":592044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.449631"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974365+0000","last_change":"2024-04-26T10:24:31.598789+0000","last_active":"2024-04-26T10:24:33.974365+0000","last_peered":"2024-04-26T10:24:33.974365+0000","last_clean":"2024-04-26T10:24:33.974365+0000","last_became_active":"2024-04-26T10:24:31.598170+0000","last_became_peered":"2024-04-26T10:24:31.598170+0000","last_unstale":"2024-04-26T10:24:33.974365+0000","last_undegraded":"2024-04-26T10:24:33.974365+0000","last_fullsized":"2024-04-26T10:24:33.974365+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:46.718423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182259+0000","last_change":"2024-04-26T10:24:22.536264+0000","last_active":"2024-04-26T10:24:33.182259+0000","last_peered":"2024-04-26T10:24:33.182259+0000","last_clean":"2024-04-26T10:24:33.182259+0000","last_became_active":"2024-04-26T10:24:22.535998+0000","last_became_peered":"2024-04-26T10:24:22.535998+0000","last_unstale":"2024-04-26T10:24:33.182259+0000","last_undegraded":"2024-04-26T10:24:33.182259+0000","last_fullsized":"2024-04-26T10:24:33.182259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:54.491369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":79,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.176175+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:24:33.176175+0000","last_peered":"2024-04-26T10:24:33.176175+0000","last_clean":"2024-04-26T10:24:33.176175+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:24:33.176175+0000","last_undegraded":"2024-04-26T10:24:33.176175+0000","last_fullsized":"2024-04-26T10:24:33.176175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:01.883964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175776+0000","last_change":"2024-04-26T10:24:22.549067+0000","last_active":"2024-04-26T10:24:33.175776+0000","last_peered":"2024-04-26T10:24:33.175776+0000","last_clean":"2024-04-26T10:24:33.175776+0000","last_became_active":"2024-04-26T10:24:22.548485+0000","last_became_peered":"2024-04-26T10:24:22.548485+0000","last_unstale":"2024-04-26T10:24:33.175776+0000","last_undegraded":"2024-04-26T10:24:33.175776+0000","last_fullsized":"2024-04-26T10:24:33.175776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:19.263146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974073+0000","last_change":"2024-04-26T10:24:31.601925+0000","last_active":"2024-04-26T10:24:33.974073+0000","last_peered":"2024-04-26T10:24:33.974073+0000","last_clean":"2024-04-26T10:24:33.974073+0000","last_became_active":"2024-04-26T10:24:31.600986+0000","last_became_peered":"2024-04-26T10:24:31.600986+0000","last_unstale":"2024-04-26T10:24:33.974073+0000","last_undegraded":"2024-04-26T10:24:33.974073+0000","last_fullsized":"2024-04-26T10:24:33.974073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:52.125249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173997+0000","last_change":"2024-04-26T10:24:22.548245+0000","last_active":"2024-04-26T10:24:33.173997+0000","last_peered":"2024-04-26T10:24:33.173997+0000","last_clean":"2024-04-26T10:24:33.173997+0000","last_became_active":"2024-04-26T10:24:22.547731+0000","last_became_peered":"2024-04-26T10:24:22.547731+0000","last_unstale":"2024-04-26T10:24:33.173997+0000","last_undegraded":"2024-04-26T10:24:33.173997+0000","last_fullsized":"2024-04-26T10:24:33.173997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:52.538672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173800+0000","last_change":"2024-04-26T10:24:22.549424+0000","last_active":"2024-04-26T10:24:33.173800+0000","last_peered":"2024-04-26T10:24:33.173800+0000","last_clean":"2024-04-26T10:24:33.173800+0000","last_became_active":"2024-04-26T10:24:22.549180+0000","last_became_peered":"2024-04-26T10:24:22.549180+0000","last_unstale":"2024-04-26T10:24:33.173800+0000","last_undegraded":"2024-04-26T10:24:33.173800+0000","last_fullsized":"2024-04-26T10:24:33.173800+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.915633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174913+0000","last_change":"2024-04-26T10:24:22.547840+0000","last_active":"2024-04-26T10:24:33.174913+0000","last_peered":"2024-04-26T10:24:33.174913+0000","last_clean":"2024-04-26T10:24:33.174913+0000","last_became_active":"2024-04-26T10:24:22.547284+0000","last_became_peered":"2024-04-26T10:24:22.547284+0000","last_unstale":"2024-04-26T10:24:33.174913+0000","last_undegraded":"2024-04-26T10:24:33.174913+0000","last_fullsized":"2024-04-26T10:24:33.174913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:09.731025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318637+0000","last_change":"2024-04-26T10:24:22.680232+0000","last_active":"2024-04-26T10:24:33.318637+0000","last_peered":"2024-04-26T10:24:33.318637+0000","last_clean":"2024-04-26T10:24:33.318637+0000","last_became_active":"2024-04-26T10:24:22.679648+0000","last_became_peered":"2024-04-26T10:24:22.679648+0000","last_unstale":"2024-04-26T10:24:33.318637+0000","last_undegraded":"2024-04-26T10:24:33.318637+0000","last_fullsized":"2024-04-26T10:24:33.318637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:58.174215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974286+0000","last_change":"2024-04-26T10:24:31.599182+0000","last_active":"2024-04-26T10:24:33.974286+0000","last_peered":"2024-04-26T10:24:33.974286+0000","last_clean":"2024-04-26T10:24:33.974286+0000","last_became_active":"2024-04-26T10:24:31.598187+0000","last_became_peered":"2024-04-26T10:24:31.598187+0000","last_unstale":"2024-04-26T10:24:33.974286+0000","last_undegraded":"2024-04-26T10:24:33.974286+0000","last_fullsized":"2024-04-26T10:24:33.974286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:24.255353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.176053+0000","last_change":"2024-04-26T10:24:22.547601+0000","last_active":"2024-04-26T10:24:33.176053+0000","last_peered":"2024-04-26T10:24:33.176053+0000","last_clean":"2024-04-26T10:24:33.176053+0000","last_became_active":"2024-04-26T10:24:22.546506+0000","last_became_peered":"2024-04-26T10:24:22.546506+0000","last_unstale":"2024-04-26T10:24:33.176053+0000","last_undegraded":"2024-04-26T10:24:33.176053+0000","last_fullsized":"2024-04-26T10:24:33.176053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:21.263835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182904+0000","last_change":"2024-04-26T10:22:09.748232+0000","last_active":"2024-04-26T10:24:33.182904+0000","last_peered":"2024-04-26T10:24:33.182904+0000","last_clean":"2024-04-26T10:24:33.182904+0000","last_became_active":"2024-04-26T10:22:09.747822+0000","last_became_peered":"2024-04-26T10:22:09.747822+0000","last_unstale":"2024-04-26T10:24:33.182904+0000","last_undegraded":"2024-04-26T10:24:33.182904+0000","last_fullsized":"2024-04-26T10:24:33.182904+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.223031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974030+0000","last_change":"2024-04-26T10:24:31.598330+0000","last_active":"2024-04-26T10:24:33.974030+0000","last_peered":"2024-04-26T10:24:33.974030+0000","last_clean":"2024-04-26T10:24:33.974030+0000","last_became_active":"2024-04-26T10:24:31.597980+0000","last_became_peered":"2024-04-26T10:24:31.597980+0000","last_unstale":"2024-04-26T10:24:33.974030+0000","last_undegraded":"2024-04-26T10:24:33.974030+0000","last_fullsized":"2024-04-26T10:24:33.974030+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:38.711968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174108+0000","last_change":"2024-04-26T10:24:31.602827+0000","last_active":"2024-04-26T10:24:33.174108+0000","last_peered":"2024-04-26T10:24:33.174108+0000","last_clean":"2024-04-26T10:24:33.174108+0000","last_became_active":"2024-04-26T10:24:31.602539+0000","last_became_peered":"2024-04-26T10:24:31.602539+0000","last_unstale":"2024-04-26T10:24:33.174108+0000","last_undegraded":"2024-04-26T10:24:33.174108+0000","last_fullsized":"2024-04-26T10:24:33.174108+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:45.294898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173774+0000","last_change":"2024-04-26T10:24:31.602863+0000","last_active":"2024-04-26T10:24:33.173774+0000","last_peered":"2024-04-26T10:24:33.173774+0000","last_clean":"2024-04-26T10:24:33.173774+0000","last_became_active":"2024-04-26T10:24:31.602453+0000","last_became_peered":"2024-04-26T10:24:31.602453+0000","last_unstale":"2024-04-26T10:24:33.173774+0000","last_undegraded":"2024-04-26T10:24:33.173774+0000","last_fullsized":"2024-04-26T10:24:33.173774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:51.661774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174475+0000","last_change":"2024-04-26T10:24:22.547543+0000","last_active":"2024-04-26T10:24:33.174475+0000","last_peered":"2024-04-26T10:24:33.174475+0000","last_clean":"2024-04-26T10:24:33.174475+0000","last_became_active":"2024-04-26T10:24:22.546856+0000","last_became_peered":"2024-04-26T10:24:22.546856+0000","last_unstale":"2024-04-26T10:24:33.174475+0000","last_undegraded":"2024-04-26T10:24:33.174475+0000","last_fullsized":"2024-04-26T10:24:33.174475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:34.240590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318406+0000","last_change":"2024-04-26T10:24:22.679885+0000","last_active":"2024-04-26T10:24:33.318406+0000","last_peered":"2024-04-26T10:24:33.318406+0000","last_clean":"2024-04-26T10:24:33.318406+0000","last_became_active":"2024-04-26T10:24:22.679350+0000","last_became_peered":"2024-04-26T10:24:22.679350+0000","last_unstale":"2024-04-26T10:24:33.318406+0000","last_undegraded":"2024-04-26T10:24:33.318406+0000","last_fullsized":"2024-04-26T10:24:33.318406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:06.039983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974316+0000","last_change":"2024-04-26T10:24:31.598857+0000","last_active":"2024-04-26T10:24:33.974316+0000","last_peered":"2024-04-26T10:24:33.974316+0000","last_clean":"2024-04-26T10:24:33.974316+0000","last_became_active":"2024-04-26T10:24:31.597563+0000","last_became_peered":"2024-04-26T10:24:31.597563+0000","last_unstale":"2024-04-26T10:24:33.974316+0000","last_undegraded":"2024-04-26T10:24:33.974316+0000","last_fullsized":"2024-04-26T10:24:33.974316+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:26.624180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317832+0000","last_change":"2024-04-26T10:24:22.679291+0000","last_active":"2024-04-26T10:24:33.317832+0000","last_peered":"2024-04-26T10:24:33.317832+0000","last_clean":"2024-04-26T10:24:33.317832+0000","last_became_active":"2024-04-26T10:24:22.678912+0000","last_became_peered":"2024-04-26T10:24:22.678912+0000","last_unstale":"2024-04-26T10:24:33.317832+0000","last_undegraded":"2024-04-26T10:24:33.317832+0000","last_fullsized":"2024-04-26T10:24:33.317832+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:49.260130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175676+0000","last_change":"2024-04-26T10:24:22.546669+0000","last_active":"2024-04-26T10:24:33.175676+0000","last_peered":"2024-04-26T10:24:33.175676+0000","last_clean":"2024-04-26T10:24:33.175676+0000","last_became_active":"2024-04-26T10:24:22.546052+0000","last_became_peered":"2024-04-26T10:24:22.546052+0000","last_unstale":"2024-04-26T10:24:33.175676+0000","last_undegraded":"2024-04-26T10:24:33.175676+0000","last_fullsized":"2024-04-26T10:24:33.175676+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:26.334069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174879+0000","last_change":"2024-04-26T10:24:22.547981+0000","last_active":"2024-04-26T10:24:33.174879+0000","last_peered":"2024-04-26T10:24:33.174879+0000","last_clean":"2024-04-26T10:24:33.174879+0000","last_became_active":"2024-04-26T10:24:22.547663+0000","last_became_peered":"2024-04-26T10:24:22.547663+0000","last_unstale":"2024-04-26T10:24:33.174879+0000","last_undegraded":"2024-04-26T10:24:33.174879+0000","last_fullsized":"2024-04-26T10:24:33.174879+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:07.105037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181281+0000","last_change":"2024-04-26T10:22:09.749283+0000","last_active":"2024-04-26T10:24:33.181281+0000","last_peered":"2024-04-26T10:24:33.181281+0000","last_clean":"2024-04-26T10:24:33.181281+0000","last_became_active":"2024-04-26T10:22:09.748755+0000","last_became_peered":"2024-04-26T10:22:09.748755+0000","last_unstale":"2024-04-26T10:24:33.181281+0000","last_undegraded":"2024-04-26T10:24:33.181281+0000","last_fullsized":"2024-04-26T10:24:33.181281+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:40.910715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317029+0000","last_change":"2024-04-26T10:24:22.684668+0000","last_active":"2024-04-26T10:24:33.317029+0000","last_peered":"2024-04-26T10:24:33.317029+0000","last_clean":"2024-04-26T10:24:33.317029+0000","last_became_active":"2024-04-26T10:24:22.683921+0000","last_became_peered":"2024-04-26T10:24:22.683921+0000","last_unstale":"2024-04-26T10:24:33.317029+0000","last_undegraded":"2024-04-26T10:24:33.317029+0000","last_fullsized":"2024-04-26T10:24:33.317029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.930781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182162+0000","last_change":"2024-04-26T10:24:22.535052+0000","last_active":"2024-04-26T10:24:33.182162+0000","last_peered":"2024-04-26T10:24:33.182162+0000","last_clean":"2024-04-26T10:24:33.182162+0000","last_became_active":"2024-04-26T10:24:22.534674+0000","last_became_peered":"2024-04-26T10:24:22.534674+0000","last_unstale":"2024-04-26T10:24:33.182162+0000","last_undegraded":"2024-04-26T10:24:33.182162+0000","last_fullsized":"2024-04-26T10:24:33.182162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:10.969425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974384+0000","last_change":"2024-04-26T10:24:31.601262+0000","last_active":"2024-04-26T10:24:33.974384+0000","last_peered":"2024-04-26T10:24:33.974384+0000","last_clean":"2024-04-26T10:24:33.974384+0000","last_became_active":"2024-04-26T10:24:31.600815+0000","last_became_peered":"2024-04-26T10:24:31.600815+0000","last_unstale":"2024-04-26T10:24:33.974384+0000","last_undegraded":"2024-04-26T10:24:33.974384+0000","last_fullsized":"2024-04-26T10:24:33.974384+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:02.552727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319258+0000","last_change":"2024-04-26T10:24:22.684739+0000","last_active":"2024-04-26T10:24:33.319258+0000","last_peered":"2024-04-26T10:24:33.319258+0000","last_clean":"2024-04-26T10:24:33.319258+0000","last_became_active":"2024-04-26T10:24:22.683959+0000","last_became_peered":"2024-04-26T10:24:22.683959+0000","last_unstale":"2024-04-26T10:24:33.319258+0000","last_undegraded":"2024-04-26T10:24:33.319258+0000","last_fullsized":"2024-04-26T10:24:33.319258+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:07.840236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":79,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175977+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:24:33.175977+0000","last_peered":"2024-04-26T10:24:33.175977+0000","last_clean":"2024-04-26T10:24:33.175977+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:24:33.175977+0000","last_undegraded":"2024-04-26T10:24:33.175977+0000","last_fullsized":"2024-04-26T10:24:33.175977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:39.394937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974137+0000","last_change":"2024-04-26T10:24:31.602078+0000","last_active":"2024-04-26T10:24:33.974137+0000","last_peered":"2024-04-26T10:24:33.974137+0000","last_clean":"2024-04-26T10:24:33.974137+0000","last_became_active":"2024-04-26T10:24:31.601299+0000","last_became_peered":"2024-04-26T10:24:31.601299+0000","last_unstale":"2024-04-26T10:24:33.974137+0000","last_undegraded":"2024-04-26T10:24:33.974137+0000","last_fullsized":"2024-04-26T10:24:33.974137+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:43.374493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317271+0000","last_change":"2024-04-26T10:24:31.741152+0000","last_active":"2024-04-26T10:24:33.317271+0000","last_peered":"2024-04-26T10:24:33.317271+0000","last_clean":"2024-04-26T10:24:33.317271+0000","last_became_active":"2024-04-26T10:24:31.740626+0000","last_became_peered":"2024-04-26T10:24:31.740626+0000","last_unstale":"2024-04-26T10:24:33.317271+0000","last_undegraded":"2024-04-26T10:24:33.317271+0000","last_fullsized":"2024-04-26T10:24:33.317271+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:23.323149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181503+0000","last_change":"2024-04-26T10:22:09.750562+0000","last_active":"2024-04-26T10:24:33.181503+0000","last_peered":"2024-04-26T10:24:33.181503+0000","last_clean":"2024-04-26T10:24:33.181503+0000","last_became_active":"2024-04-26T10:22:09.750286+0000","last_became_peered":"2024-04-26T10:22:09.750286+0000","last_unstale":"2024-04-26T10:24:33.181503+0000","last_undegraded":"2024-04-26T10:24:33.181503+0000","last_fullsized":"2024-04-26T10:24:33.181503+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:52.795517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317979+0000","last_change":"2024-04-26T10:24:31.741008+0000","last_active":"2024-04-26T10:24:33.317979+0000","last_peered":"2024-04-26T10:24:33.317979+0000","last_clean":"2024-04-26T10:24:33.317979+0000","last_became_active":"2024-04-26T10:24:31.740518+0000","last_became_peered":"2024-04-26T10:24:31.740518+0000","last_unstale":"2024-04-26T10:24:33.317979+0000","last_undegraded":"2024-04-26T10:24:33.317979+0000","last_fullsized":"2024-04-26T10:24:33.317979+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:11:59.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173926+0000","last_change":"2024-04-26T10:24:22.540161+0000","last_active":"2024-04-26T10:24:33.173926+0000","last_peered":"2024-04-26T10:24:33.173926+0000","last_clean":"2024-04-26T10:24:33.173926+0000","last_became_active":"2024-04-26T10:24:22.539106+0000","last_became_peered":"2024-04-26T10:24:22.539106+0000","last_unstale":"2024-04-26T10:24:33.173926+0000","last_undegraded":"2024-04-26T10:24:33.173926+0000","last_fullsized":"2024-04-26T10:24:33.173926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:09.208422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974115+0000","last_change":"2024-04-26T10:24:31.599487+0000","last_active":"2024-04-26T10:24:33.974115+0000","last_peered":"2024-04-26T10:24:33.974115+0000","last_clean":"2024-04-26T10:24:33.974115+0000","last_became_active":"2024-04-26T10:24:31.598307+0000","last_became_peered":"2024-04-26T10:24:31.598307+0000","last_unstale":"2024-04-26T10:24:33.974115+0000","last_undegraded":"2024-04-26T10:24:33.974115+0000","last_fullsized":"2024-04-26T10:24:33.974115+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:11.881961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174602+0000","last_change":"2024-04-26T10:24:22.547974+0000","last_active":"2024-04-26T10:24:33.174602+0000","last_peered":"2024-04-26T10:24:33.174602+0000","last_clean":"2024-04-26T10:24:33.174602+0000","last_became_active":"2024-04-26T10:24:22.546794+0000","last_became_peered":"2024-04-26T10:24:22.546794+0000","last_unstale":"2024-04-26T10:24:33.174602+0000","last_undegraded":"2024-04-26T10:24:33.174602+0000","last_fullsized":"2024-04-26T10:24:33.174602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:28.897600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974196+0000","last_change":"2024-04-26T10:24:31.597848+0000","last_active":"2024-04-26T10:24:33.974196+0000","last_peered":"2024-04-26T10:24:33.974196+0000","last_clean":"2024-04-26T10:24:33.974196+0000","last_became_active":"2024-04-26T10:24:31.596297+0000","last_became_peered":"2024-04-26T10:24:31.596297+0000","last_unstale":"2024-04-26T10:24:33.974196+0000","last_undegraded":"2024-04-26T10:24:33.974196+0000","last_fullsized":"2024-04-26T10:24:33.974196+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:09.585450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317333+0000","last_change":"2024-04-26T10:24:22.684913+0000","last_active":"2024-04-26T10:24:33.317333+0000","last_peered":"2024-04-26T10:24:33.317333+0000","last_clean":"2024-04-26T10:24:33.317333+0000","last_became_active":"2024-04-26T10:24:22.684541+0000","last_became_peered":"2024-04-26T10:24:22.684541+0000","last_unstale":"2024-04-26T10:24:33.317333+0000","last_undegraded":"2024-04-26T10:24:33.317333+0000","last_fullsized":"2024-04-26T10:24:33.317333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:32.802131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318520+0000","last_change":"2024-04-26T10:24:22.683787+0000","last_active":"2024-04-26T10:24:33.318520+0000","last_peered":"2024-04-26T10:24:33.318520+0000","last_clean":"2024-04-26T10:24:33.318520+0000","last_became_active":"2024-04-26T10:24:22.682650+0000","last_became_peered":"2024-04-26T10:24:22.682650+0000","last_unstale":"2024-04-26T10:24:33.318520+0000","last_undegraded":"2024-04-26T10:24:33.318520+0000","last_fullsized":"2024-04-26T10:24:33.318520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:29.301512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973911+0000","last_change":"2024-04-26T10:24:31.601959+0000","last_active":"2024-04-26T10:24:33.973911+0000","last_peered":"2024-04-26T10:24:33.973911+0000","last_clean":"2024-04-26T10:24:33.973911+0000","last_became_active":"2024-04-26T10:24:31.601091+0000","last_became_peered":"2024-04-26T10:24:31.601091+0000","last_unstale":"2024-04-26T10:24:33.973911+0000","last_undegraded":"2024-04-26T10:24:33.973911+0000","last_fullsized":"2024-04-26T10:24:33.973911+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:46.182880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318431+0000","last_change":"2024-04-26T10:24:22.684603+0000","last_active":"2024-04-26T10:24:33.318431+0000","last_peered":"2024-04-26T10:24:33.318431+0000","last_clean":"2024-04-26T10:24:33.318431+0000","last_became_active":"2024-04-26T10:24:22.684213+0000","last_became_peered":"2024-04-26T10:24:22.684213+0000","last_unstale":"2024-04-26T10:24:33.318431+0000","last_undegraded":"2024-04-26T10:24:33.318431+0000","last_fullsized":"2024-04-26T10:24:33.318431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:41.006428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":134,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173541+0000","last_change":"2024-04-26T10:24:31.613086+0000","last_active":"2024-04-26T10:24:33.173541+0000","last_peered":"2024-04-26T10:24:33.173541+0000","last_clean":"2024-04-26T10:24:33.173541+0000","last_became_active":"2024-04-26T10:24:31.604402+0000","last_became_peered":"2024-04-26T10:24:31.604402+0000","last_unstale":"2024-04-26T10:24:33.173541+0000","last_undegraded":"2024-04-26T10:24:33.173541+0000","last_fullsized":"2024-04-26T10:24:33.173541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:52.355783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":115,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175870+0000","last_change":"2024-04-26T10:24:31.624641+0000","last_active":"2024-04-26T10:24:33.175870+0000","last_peered":"2024-04-26T10:24:33.175870+0000","last_clean":"2024-04-26T10:24:33.175870+0000","last_became_active":"2024-04-26T10:24:31.604744+0000","last_became_peered":"2024-04-26T10:24:31.604744+0000","last_unstale":"2024-04-26T10:24:33.175870+0000","last_undegraded":"2024-04-26T10:24:33.175870+0000","last_fullsized":"2024-04-26T10:24:33.175870+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:44.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182275+0000","last_change":"2024-04-26T10:22:09.750173+0000","last_active":"2024-04-26T10:24:33.182275+0000","last_peered":"2024-04-26T10:24:33.182275+0000","last_clean":"2024-04-26T10:24:33.182275+0000","last_became_active":"2024-04-26T10:22:09.749862+0000","last_became_peered":"2024-04-26T10:22:09.749862+0000","last_unstale":"2024-04-26T10:24:33.182275+0000","last_undegraded":"2024-04-26T10:24:33.182275+0000","last_fullsized":"2024-04-26T10:24:33.182275+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:53.204364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182816+0000","last_change":"2024-04-26T10:22:09.750224+0000","last_active":"2024-04-26T10:24:33.182816+0000","last_peered":"2024-04-26T10:24:33.182816+0000","last_clean":"2024-04-26T10:24:33.182816+0000","last_became_active":"2024-04-26T10:22:09.749852+0000","last_became_peered":"2024-04-26T10:22:09.749852+0000","last_unstale":"2024-04-26T10:24:33.182816+0000","last_undegraded":"2024-04-26T10:24:33.182816+0000","last_fullsized":"2024-04-26T10:24:33.182816+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:44.923542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973891+0000","last_change":"2024-04-26T10:24:31.597157+0000","last_active":"2024-04-26T10:24:33.973891+0000","last_peered":"2024-04-26T10:24:33.973891+0000","last_clean":"2024-04-26T10:24:33.973891+0000","last_became_active":"2024-04-26T10:24:31.596335+0000","last_became_peered":"2024-04-26T10:24:31.596335+0000","last_unstale":"2024-04-26T10:24:33.973891+0000","last_undegraded":"2024-04-26T10:24:33.973891+0000","last_fullsized":"2024-04-26T10:24:33.973891+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:07.652892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":81,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175501+0000","last_change":"2024-04-26T10:21:08.935133+0000","last_active":"2024-04-26T10:24:33.175501+0000","last_peered":"2024-04-26T10:24:33.175501+0000","last_clean":"2024-04-26T10:24:33.175501+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:24:33.175501+0000","last_undegraded":"2024-04-26T10:24:33.175501+0000","last_fullsized":"2024-04-26T10:24:33.175501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:25.498249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174259+0000","last_change":"2024-04-26T10:24:22.549411+0000","last_active":"2024-04-26T10:24:33.174259+0000","last_peered":"2024-04-26T10:24:33.174259+0000","last_clean":"2024-04-26T10:24:33.174259+0000","last_became_active":"2024-04-26T10:24:22.549230+0000","last_became_peered":"2024-04-26T10:24:22.549230+0000","last_unstale":"2024-04-26T10:24:33.174259+0000","last_undegraded":"2024-04-26T10:24:33.174259+0000","last_fullsized":"2024-04-26T10:24:33.174259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:00.343304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175419+0000","last_change":"2024-04-26T10:24:22.541409+0000","last_active":"2024-04-26T10:24:33.175419+0000","last_peered":"2024-04-26T10:24:33.175419+0000","last_clean":"2024-04-26T10:24:33.175419+0000","last_became_active":"2024-04-26T10:24:22.540611+0000","last_became_peered":"2024-04-26T10:24:22.540611+0000","last_unstale":"2024-04-26T10:24:33.175419+0000","last_undegraded":"2024-04-26T10:24:33.175419+0000","last_fullsized":"2024-04-26T10:24:33.175419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:48.882187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319142+0000","last_change":"2024-04-26T10:24:22.687178+0000","last_active":"2024-04-26T10:24:33.319142+0000","last_peered":"2024-04-26T10:24:33.319142+0000","last_clean":"2024-04-26T10:24:33.319142+0000","last_became_active":"2024-04-26T10:24:22.686841+0000","last_became_peered":"2024-04-26T10:24:22.686841+0000","last_unstale":"2024-04-26T10:24:33.319142+0000","last_undegraded":"2024-04-26T10:24:33.319142+0000","last_fullsized":"2024-04-26T10:24:33.319142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:52.907696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318078+0000","last_change":"2024-04-26T10:24:22.687183+0000","last_active":"2024-04-26T10:24:33.318078+0000","last_peered":"2024-04-26T10:24:33.318078+0000","last_clean":"2024-04-26T10:24:33.318078+0000","last_became_active":"2024-04-26T10:24:22.686846+0000","last_became_peered":"2024-04-26T10:24:22.686846+0000","last_unstale":"2024-04-26T10:24:33.318078+0000","last_undegraded":"2024-04-26T10:24:33.318078+0000","last_fullsized":"2024-04-26T10:24:33.318078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:37.083683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175590+0000","last_change":"2024-04-26T10:24:22.546117+0000","last_active":"2024-04-26T10:24:33.175590+0000","last_peered":"2024-04-26T10:24:33.175590+0000","last_clean":"2024-04-26T10:24:33.175590+0000","last_became_active":"2024-04-26T10:24:22.545616+0000","last_became_peered":"2024-04-26T10:24:22.545616+0000","last_unstale":"2024-04-26T10:24:33.175590+0000","last_undegraded":"2024-04-26T10:24:33.175590+0000","last_fullsized":"2024-04-26T10:24:33.175590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:09.247826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174530+0000","last_change":"2024-04-26T10:24:22.540185+0000","last_active":"2024-04-26T10:24:33.174530+0000","last_peered":"2024-04-26T10:24:33.174530+0000","last_clean":"2024-04-26T10:24:33.174530+0000","last_became_active":"2024-04-26T10:24:22.538982+0000","last_became_peered":"2024-04-26T10:24:22.538982+0000","last_unstale":"2024-04-26T10:24:33.174530+0000","last_undegraded":"2024-04-26T10:24:33.174530+0000","last_fullsized":"2024-04-26T10:24:33.174530+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:27.225284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":79,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174662+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:24:33.174662+0000","last_peered":"2024-04-26T10:24:33.174662+0000","last_clean":"2024-04-26T10:24:33.174662+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:24:33.174662+0000","last_undegraded":"2024-04-26T10:24:33.174662+0000","last_fullsized":"2024-04-26T10:24:33.174662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181167+0000","last_change":"2024-04-26T10:22:09.748616+0000","last_active":"2024-04-26T10:24:33.181167+0000","last_peered":"2024-04-26T10:24:33.181167+0000","last_clean":"2024-04-26T10:24:33.181167+0000","last_became_active":"2024-04-26T10:22:09.748256+0000","last_became_peered":"2024-04-26T10:22:09.748256+0000","last_unstale":"2024-04-26T10:24:33.181167+0000","last_undegraded":"2024-04-26T10:24:33.181167+0000","last_fullsized":"2024-04-26T10:24:33.181167+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:19.402647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174461+0000","last_change":"2024-04-26T10:24:31.604150+0000","last_active":"2024-04-26T10:24:33.174461+0000","last_peered":"2024-04-26T10:24:33.174461+0000","last_clean":"2024-04-26T10:24:33.174461+0000","last_became_active":"2024-04-26T10:24:31.603620+0000","last_became_peered":"2024-04-26T10:24:31.603620+0000","last_unstale":"2024-04-26T10:24:33.174461+0000","last_undegraded":"2024-04-26T10:24:33.174461+0000","last_fullsized":"2024-04-26T10:24:33.174461+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:17.085344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973830+0000","last_change":"2024-04-26T10:24:31.598521+0000","last_active":"2024-04-26T10:24:33.973830+0000","last_peered":"2024-04-26T10:24:33.973830+0000","last_clean":"2024-04-26T10:24:33.973830+0000","last_became_active":"2024-04-26T10:24:31.598120+0000","last_became_peered":"2024-04-26T10:24:31.598120+0000","last_unstale":"2024-04-26T10:24:33.973830+0000","last_undegraded":"2024-04-26T10:24:33.973830+0000","last_fullsized":"2024-04-26T10:24:33.973830+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:23.723355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319166+0000","last_change":"2024-04-26T10:24:22.680557+0000","last_active":"2024-04-26T10:24:33.319166+0000","last_peered":"2024-04-26T10:24:33.319166+0000","last_clean":"2024-04-26T10:24:33.319166+0000","last_became_active":"2024-04-26T10:24:22.679940+0000","last_became_peered":"2024-04-26T10:24:22.679940+0000","last_unstale":"2024-04-26T10:24:33.319166+0000","last_undegraded":"2024-04-26T10:24:33.319166+0000","last_fullsized":"2024-04-26T10:24:33.319166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:06.379234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":333,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185235+0000","last_change":"2024-04-26T10:24:34.185235+0000","last_active":"2024-04-26T10:24:34.185235+0000","last_peered":"2024-04-26T10:24:34.185235+0000","last_clean":"2024-04-26T10:24:34.185235+0000","last_became_active":"2024-04-26T10:24:34.184490+0000","last_became_peered":"2024-04-26T10:24:34.184490+0000","last_unstale":"2024-04-26T10:24:34.185235+0000","last_undegraded":"2024-04-26T10:24:34.185235+0000","last_fullsized":"2024-04-26T10:24:34.185235+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:33.812288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174100+0000","last_change":"2024-04-26T10:24:22.547708+0000","last_active":"2024-04-26T10:24:33.174100+0000","last_peered":"2024-04-26T10:24:33.174100+0000","last_clean":"2024-04-26T10:24:33.174100+0000","last_became_active":"2024-04-26T10:24:22.546650+0000","last_became_peered":"2024-04-26T10:24:22.546650+0000","last_unstale":"2024-04-26T10:24:33.174100+0000","last_undegraded":"2024-04-26T10:24:33.174100+0000","last_fullsized":"2024-04-26T10:24:33.174100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:55.474931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317752+0000","last_change":"2024-04-26T10:24:22.676755+0000","last_active":"2024-04-26T10:24:33.317752+0000","last_peered":"2024-04-26T10:24:33.317752+0000","last_clean":"2024-04-26T10:24:33.317752+0000","last_became_active":"2024-04-26T10:24:22.676489+0000","last_became_peered":"2024-04-26T10:24:22.676489+0000","last_unstale":"2024-04-26T10:24:33.317752+0000","last_undegraded":"2024-04-26T10:24:33.317752+0000","last_fullsized":"2024-04-26T10:24:33.317752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:38.979532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174906+0000","last_change":"2024-04-26T10:24:31.603833+0000","last_active":"2024-04-26T10:24:33.174906+0000","last_peered":"2024-04-26T10:24:33.174906+0000","last_clean":"2024-04-26T10:24:33.174906+0000","last_became_active":"2024-04-26T10:24:31.603498+0000","last_became_peered":"2024-04-26T10:24:31.603498+0000","last_unstale":"2024-04-26T10:24:33.174906+0000","last_undegraded":"2024-04-26T10:24:33.174906+0000","last_fullsized":"2024-04-26T10:24:33.174906+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:58.952460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174671+0000","last_change":"2024-04-26T10:24:31.603067+0000","last_active":"2024-04-26T10:24:33.174671+0000","last_peered":"2024-04-26T10:24:33.174671+0000","last_clean":"2024-04-26T10:24:33.174671+0000","last_became_active":"2024-04-26T10:24:31.602611+0000","last_became_peered":"2024-04-26T10:24:31.602611+0000","last_unstale":"2024-04-26T10:24:33.174671+0000","last_undegraded":"2024-04-26T10:24:33.174671+0000","last_fullsized":"2024-04-26T10:24:33.174671+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:14.943135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316711+0000","last_change":"2024-04-26T10:24:22.685554+0000","last_active":"2024-04-26T10:24:33.316711+0000","last_peered":"2024-04-26T10:24:33.316711+0000","last_clean":"2024-04-26T10:24:33.316711+0000","last_became_active":"2024-04-26T10:24:22.685051+0000","last_became_peered":"2024-04-26T10:24:22.685051+0000","last_unstale":"2024-04-26T10:24:33.316711+0000","last_undegraded":"2024-04-26T10:24:33.316711+0000","last_fullsized":"2024-04-26T10:24:33.316711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:59.389895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182836+0000","last_change":"2024-04-26T10:24:22.538294+0000","last_active":"2024-04-26T10:24:33.182836+0000","last_peered":"2024-04-26T10:24:33.182836+0000","last_clean":"2024-04-26T10:24:33.182836+0000","last_became_active":"2024-04-26T10:24:22.537983+0000","last_became_peered":"2024-04-26T10:24:22.537983+0000","last_unstale":"2024-04-26T10:24:33.182836+0000","last_undegraded":"2024-04-26T10:24:33.182836+0000","last_fullsized":"2024-04-26T10:24:33.182836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:54.064158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317277+0000","last_change":"2024-04-26T10:24:22.679231+0000","last_active":"2024-04-26T10:24:33.317277+0000","last_peered":"2024-04-26T10:24:33.317277+0000","last_clean":"2024-04-26T10:24:33.317277+0000","last_became_active":"2024-04-26T10:24:22.678866+0000","last_became_peered":"2024-04-26T10:24:22.678866+0000","last_unstale":"2024-04-26T10:24:33.317277+0000","last_undegraded":"2024-04-26T10:24:33.317277+0000","last_fullsized":"2024-04-26T10:24:33.317277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:26.179423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182367+0000","last_change":"2024-04-26T10:22:09.750297+0000","last_active":"2024-04-26T10:24:33.182367+0000","last_peered":"2024-04-26T10:24:33.182367+0000","last_clean":"2024-04-26T10:24:33.182367+0000","last_became_active":"2024-04-26T10:22:09.749935+0000","last_became_peered":"2024-04-26T10:22:09.749935+0000","last_unstale":"2024-04-26T10:24:33.182367+0000","last_undegraded":"2024-04-26T10:24:33.182367+0000","last_fullsized":"2024-04-26T10:24:33.182367+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:51.197306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319145+0000","last_change":"2024-04-26T10:24:31.745820+0000","last_active":"2024-04-26T10:24:33.319145+0000","last_peered":"2024-04-26T10:24:33.319145+0000","last_clean":"2024-04-26T10:24:33.319145+0000","last_became_active":"2024-04-26T10:24:31.745487+0000","last_became_peered":"2024-04-26T10:24:31.745487+0000","last_unstale":"2024-04-26T10:24:33.319145+0000","last_undegraded":"2024-04-26T10:24:33.319145+0000","last_fullsized":"2024-04-26T10:24:33.319145+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:00.239650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174768+0000","last_change":"2024-04-26T10:24:22.539761+0000","last_active":"2024-04-26T10:24:33.174768+0000","last_peered":"2024-04-26T10:24:33.174768+0000","last_clean":"2024-04-26T10:24:33.174768+0000","last_became_active":"2024-04-26T10:24:22.538993+0000","last_became_peered":"2024-04-26T10:24:22.538993+0000","last_unstale":"2024-04-26T10:24:33.174768+0000","last_undegraded":"2024-04-26T10:24:33.174768+0000","last_fullsized":"2024-04-26T10:24:33.174768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:24.782191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174356+0000","last_change":"2024-04-26T10:24:22.542774+0000","last_active":"2024-04-26T10:24:33.174356+0000","last_peered":"2024-04-26T10:24:33.174356+0000","last_clean":"2024-04-26T10:24:33.174356+0000","last_became_active":"2024-04-26T10:24:22.541795+0000","last_became_peered":"2024-04-26T10:24:22.541795+0000","last_unstale":"2024-04-26T10:24:33.174356+0000","last_undegraded":"2024-04-26T10:24:33.174356+0000","last_fullsized":"2024-04-26T10:24:33.174356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:07.303056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317944+0000","last_change":"2024-04-26T10:24:31.744717+0000","last_active":"2024-04-26T10:24:33.317944+0000","last_peered":"2024-04-26T10:24:33.317944+0000","last_clean":"2024-04-26T10:24:33.317944+0000","last_became_active":"2024-04-26T10:24:31.744373+0000","last_became_peered":"2024-04-26T10:24:31.744373+0000","last_unstale":"2024-04-26T10:24:33.317944+0000","last_undegraded":"2024-04-26T10:24:33.317944+0000","last_fullsized":"2024-04-26T10:24:33.317944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:10.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174262+0000","last_change":"2024-04-26T10:24:22.538573+0000","last_active":"2024-04-26T10:24:33.174262+0000","last_peered":"2024-04-26T10:24:33.174262+0000","last_clean":"2024-04-26T10:24:33.174262+0000","last_became_active":"2024-04-26T10:24:22.537041+0000","last_became_peered":"2024-04-26T10:24:22.537041+0000","last_unstale":"2024-04-26T10:24:33.174262+0000","last_undegraded":"2024-04-26T10:24:33.174262+0000","last_fullsized":"2024-04-26T10:24:33.174262+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:48.026637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318800+0000","last_change":"2024-04-26T10:24:31.744776+0000","last_active":"2024-04-26T10:24:33.318800+0000","last_peered":"2024-04-26T10:24:33.318800+0000","last_clean":"2024-04-26T10:24:33.318800+0000","last_became_active":"2024-04-26T10:24:31.744342+0000","last_became_peered":"2024-04-26T10:24:31.744342+0000","last_unstale":"2024-04-26T10:24:33.318800+0000","last_undegraded":"2024-04-26T10:24:33.318800+0000","last_fullsized":"2024-04-26T10:24:33.318800+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:08:33.941367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973980+0000","last_change":"2024-04-26T10:24:31.599193+0000","last_active":"2024-04-26T10:24:33.973980+0000","last_peered":"2024-04-26T10:24:33.973980+0000","last_clean":"2024-04-26T10:24:33.973980+0000","last_became_active":"2024-04-26T10:24:31.598432+0000","last_became_peered":"2024-04-26T10:24:31.598432+0000","last_unstale":"2024-04-26T10:24:33.973980+0000","last_undegraded":"2024-04-26T10:24:33.973980+0000","last_fullsized":"2024-04-26T10:24:33.973980+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:41.515775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318555+0000","last_change":"2024-04-26T10:24:31.745336+0000","last_active":"2024-04-26T10:24:33.318555+0000","last_peered":"2024-04-26T10:24:33.318555+0000","last_clean":"2024-04-26T10:24:33.318555+0000","last_became_active":"2024-04-26T10:24:31.745004+0000","last_became_peered":"2024-04-26T10:24:31.745004+0000","last_unstale":"2024-04-26T10:24:33.318555+0000","last_undegraded":"2024-04-26T10:24:33.318555+0000","last_fullsized":"2024-04-26T10:24:33.318555+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:15.275549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974267+0000","last_change":"2024-04-26T10:24:31.601585+0000","last_active":"2024-04-26T10:24:33.974267+0000","last_peered":"2024-04-26T10:24:33.974267+0000","last_clean":"2024-04-26T10:24:33.974267+0000","last_became_active":"2024-04-26T10:24:31.600977+0000","last_became_peered":"2024-04-26T10:24:31.600977+0000","last_unstale":"2024-04-26T10:24:33.974267+0000","last_undegraded":"2024-04-26T10:24:33.974267+0000","last_fullsized":"2024-04-26T10:24:33.974267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.329801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181771+0000","last_change":"2024-04-26T10:22:09.758116+0000","last_active":"2024-04-26T10:24:33.181771+0000","last_peered":"2024-04-26T10:24:33.181771+0000","last_clean":"2024-04-26T10:24:33.181771+0000","last_became_active":"2024-04-26T10:22:09.757813+0000","last_became_peered":"2024-04-26T10:22:09.757813+0000","last_unstale":"2024-04-26T10:24:33.181771+0000","last_undegraded":"2024-04-26T10:24:33.181771+0000","last_fullsized":"2024-04-26T10:24:33.181771+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:01.195987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318177+0000","last_change":"2024-04-26T10:24:22.680137+0000","last_active":"2024-04-26T10:24:33.318177+0000","last_peered":"2024-04-26T10:24:33.318177+0000","last_clean":"2024-04-26T10:24:33.318177+0000","last_became_active":"2024-04-26T10:24:22.679497+0000","last_became_peered":"2024-04-26T10:24:22.679497+0000","last_unstale":"2024-04-26T10:24:33.318177+0000","last_undegraded":"2024-04-26T10:24:33.318177+0000","last_fullsized":"2024-04-26T10:24:33.318177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:00.401135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318093+0000","last_change":"2024-04-26T10:24:31.741102+0000","last_active":"2024-04-26T10:24:33.318093+0000","last_peered":"2024-04-26T10:24:33.318093+0000","last_clean":"2024-04-26T10:24:33.318093+0000","last_became_active":"2024-04-26T10:24:31.740589+0000","last_became_peered":"2024-04-26T10:24:31.740589+0000","last_unstale":"2024-04-26T10:24:33.318093+0000","last_undegraded":"2024-04-26T10:24:33.318093+0000","last_fullsized":"2024-04-26T10:24:33.318093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:38.170544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317410+0000","last_change":"2024-04-26T10:24:22.686404+0000","last_active":"2024-04-26T10:24:33.317410+0000","last_peered":"2024-04-26T10:24:33.317410+0000","last_clean":"2024-04-26T10:24:33.317410+0000","last_became_active":"2024-04-26T10:24:22.686094+0000","last_became_peered":"2024-04-26T10:24:22.686094+0000","last_unstale":"2024-04-26T10:24:33.317410+0000","last_undegraded":"2024-04-26T10:24:33.317410+0000","last_fullsized":"2024-04-26T10:24:33.317410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:37.911705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318296+0000","last_change":"2024-04-26T10:24:22.682344+0000","last_active":"2024-04-26T10:24:33.318296+0000","last_peered":"2024-04-26T10:24:33.318296+0000","last_clean":"2024-04-26T10:24:33.318296+0000","last_became_active":"2024-04-26T10:24:22.681977+0000","last_became_peered":"2024-04-26T10:24:22.681977+0000","last_unstale":"2024-04-26T10:24:33.318296+0000","last_undegraded":"2024-04-26T10:24:33.318296+0000","last_fullsized":"2024-04-26T10:24:33.318296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:56.544667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175850+0000","last_change":"2024-04-26T10:24:31.605320+0000","last_active":"2024-04-26T10:24:33.175850+0000","last_peered":"2024-04-26T10:24:33.175850+0000","last_clean":"2024-04-26T10:24:33.175850+0000","last_became_active":"2024-04-26T10:24:31.604158+0000","last_became_peered":"2024-04-26T10:24:31.604158+0000","last_unstale":"2024-04-26T10:24:33.175850+0000","last_undegraded":"2024-04-26T10:24:33.175850+0000","last_fullsized":"2024-04-26T10:24:33.175850+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:53.955856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973931+0000","last_change":"2024-04-26T10:24:31.601291+0000","last_active":"2024-04-26T10:24:33.973931+0000","last_peered":"2024-04-26T10:24:33.973931+0000","last_clean":"2024-04-26T10:24:33.973931+0000","last_became_active":"2024-04-26T10:24:31.600474+0000","last_became_peered":"2024-04-26T10:24:31.600474+0000","last_unstale":"2024-04-26T10:24:33.973931+0000","last_undegraded":"2024-04-26T10:24:33.973931+0000","last_fullsized":"2024-04-26T10:24:33.973931+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:30.284416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175157+0000","last_change":"2024-04-26T10:24:31.604975+0000","last_active":"2024-04-26T10:24:33.175157+0000","last_peered":"2024-04-26T10:24:33.175157+0000","last_clean":"2024-04-26T10:24:33.175157+0000","last_became_active":"2024-04-26T10:24:31.604609+0000","last_became_peered":"2024-04-26T10:24:31.604609+0000","last_unstale":"2024-04-26T10:24:33.175157+0000","last_undegraded":"2024-04-26T10:24:33.175157+0000","last_fullsized":"2024-04-26T10:24:33.175157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:04.412544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":132,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175190+0000","last_change":"2024-04-26T10:24:31.622111+0000","last_active":"2024-04-26T10:24:33.175190+0000","last_peered":"2024-04-26T10:24:33.175190+0000","last_clean":"2024-04-26T10:24:33.175190+0000","last_became_active":"2024-04-26T10:24:31.604884+0000","last_became_peered":"2024-04-26T10:24:31.604884+0000","last_unstale":"2024-04-26T10:24:33.175190+0000","last_undegraded":"2024-04-26T10:24:33.175190+0000","last_fullsized":"2024-04-26T10:24:33.175190+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:18.600081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317264+0000","last_change":"2024-04-26T10:24:31.739955+0000","last_active":"2024-04-26T10:24:33.317264+0000","last_peered":"2024-04-26T10:24:33.317264+0000","last_clean":"2024-04-26T10:24:33.317264+0000","last_became_active":"2024-04-26T10:24:31.739550+0000","last_became_peered":"2024-04-26T10:24:31.739550+0000","last_unstale":"2024-04-26T10:24:33.317264+0000","last_undegraded":"2024-04-26T10:24:33.317264+0000","last_fullsized":"2024-04-26T10:24:33.317264+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:31.253486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974245+0000","last_change":"2024-04-26T10:24:31.609788+0000","last_active":"2024-04-26T10:24:33.974245+0000","last_peered":"2024-04-26T10:24:33.974245+0000","last_clean":"2024-04-26T10:24:33.974245+0000","last_became_active":"2024-04-26T10:24:31.601218+0000","last_became_peered":"2024-04-26T10:24:31.601218+0000","last_unstale":"2024-04-26T10:24:33.974245+0000","last_undegraded":"2024-04-26T10:24:33.974245+0000","last_fullsized":"2024-04-26T10:24:33.974245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:39.380483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175533+0000","last_change":"2024-04-26T10:24:22.546807+0000","last_active":"2024-04-26T10:24:33.175533+0000","last_peered":"2024-04-26T10:24:33.175533+0000","last_clean":"2024-04-26T10:24:33.175533+0000","last_became_active":"2024-04-26T10:24:22.546378+0000","last_became_peered":"2024-04-26T10:24:22.546378+0000","last_unstale":"2024-04-26T10:24:33.175533+0000","last_undegraded":"2024-04-26T10:24:33.175533+0000","last_fullsized":"2024-04-26T10:24:33.175533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:06.866157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317068+0000","last_change":"2024-04-26T10:24:22.684096+0000","last_active":"2024-04-26T10:24:33.317068+0000","last_peered":"2024-04-26T10:24:33.317068+0000","last_clean":"2024-04-26T10:24:33.317068+0000","last_became_active":"2024-04-26T10:24:22.683558+0000","last_became_peered":"2024-04-26T10:24:22.683558+0000","last_unstale":"2024-04-26T10:24:33.317068+0000","last_undegraded":"2024-04-26T10:24:33.317068+0000","last_fullsized":"2024-04-26T10:24:33.317068+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:05.316682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318841+0000","last_change":"2024-04-26T10:24:22.684541+0000","last_active":"2024-04-26T10:24:33.318841+0000","last_peered":"2024-04-26T10:24:33.318841+0000","last_clean":"2024-04-26T10:24:33.318841+0000","last_became_active":"2024-04-26T10:24:22.684166+0000","last_became_peered":"2024-04-26T10:24:22.684166+0000","last_unstale":"2024-04-26T10:24:33.318841+0000","last_undegraded":"2024-04-26T10:24:33.318841+0000","last_fullsized":"2024-04-26T10:24:33.318841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:30.164642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317049+0000","last_change":"2024-04-26T10:24:31.745539+0000","last_active":"2024-04-26T10:24:33.317049+0000","last_peered":"2024-04-26T10:24:33.317049+0000","last_clean":"2024-04-26T10:24:33.317049+0000","last_became_active":"2024-04-26T10:24:31.745216+0000","last_became_peered":"2024-04-26T10:24:31.745216+0000","last_unstale":"2024-04-26T10:24:33.317049+0000","last_undegraded":"2024-04-26T10:24:33.317049+0000","last_fullsized":"2024-04-26T10:24:33.317049+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:55.390023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183305+0000","last_change":"2024-04-26T10:22:09.750605+0000","last_active":"2024-04-26T10:24:33.183305+0000","last_peered":"2024-04-26T10:24:33.183305+0000","last_clean":"2024-04-26T10:24:33.183305+0000","last_became_active":"2024-04-26T10:22:09.750359+0000","last_became_peered":"2024-04-26T10:22:09.750359+0000","last_unstale":"2024-04-26T10:24:33.183305+0000","last_undegraded":"2024-04-26T10:24:33.183305+0000","last_fullsized":"2024-04-26T10:24:33.183305+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:56.948741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316663+0000","last_change":"2024-04-26T10:24:31.740907+0000","last_active":"2024-04-26T10:24:33.316663+0000","last_peered":"2024-04-26T10:24:33.316663+0000","last_clean":"2024-04-26T10:24:33.316663+0000","last_became_active":"2024-04-26T10:24:31.740477+0000","last_became_peered":"2024-04-26T10:24:31.740477+0000","last_unstale":"2024-04-26T10:24:33.316663+0000","last_undegraded":"2024-04-26T10:24:33.316663+0000","last_fullsized":"2024-04-26T10:24:33.316663+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:30.206347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318888+0000","last_change":"2024-04-26T10:24:22.684108+0000","last_active":"2024-04-26T10:24:33.318888+0000","last_peered":"2024-04-26T10:24:33.318888+0000","last_clean":"2024-04-26T10:24:33.318888+0000","last_became_active":"2024-04-26T10:24:22.683501+0000","last_became_peered":"2024-04-26T10:24:22.683501+0000","last_unstale":"2024-04-26T10:24:33.318888+0000","last_undegraded":"2024-04-26T10:24:33.318888+0000","last_fullsized":"2024-04-26T10:24:33.318888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:17.355758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316745+0000","last_change":"2024-04-26T10:24:22.685228+0000","last_active":"2024-04-26T10:24:33.316745+0000","last_peered":"2024-04-26T10:24:33.316745+0000","last_clean":"2024-04-26T10:24:33.316745+0000","last_became_active":"2024-04-26T10:24:22.684469+0000","last_became_peered":"2024-04-26T10:24:22.684469+0000","last_unstale":"2024-04-26T10:24:33.316745+0000","last_undegraded":"2024-04-26T10:24:33.316745+0000","last_fullsized":"2024-04-26T10:24:33.316745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:53.834583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182003+0000","last_change":"2024-04-26T10:22:09.753136+0000","last_active":"2024-04-26T10:24:33.182003+0000","last_peered":"2024-04-26T10:24:33.182003+0000","last_clean":"2024-04-26T10:24:33.182003+0000","last_became_active":"2024-04-26T10:22:09.752856+0000","last_became_peered":"2024-04-26T10:22:09.752856+0000","last_unstale":"2024-04-26T10:24:33.182003+0000","last_undegraded":"2024-04-26T10:24:33.182003+0000","last_fullsized":"2024-04-26T10:24:33.182003+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:48.541930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":88,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181723+0000","last_change":"2024-04-26T10:24:22.535413+0000","last_active":"2024-04-26T10:24:33.181723+0000","last_peered":"2024-04-26T10:24:33.181723+0000","last_clean":"2024-04-26T10:24:33.181723+0000","last_became_active":"2024-04-26T10:24:22.535036+0000","last_became_peered":"2024-04-26T10:24:22.535036+0000","last_unstale":"2024-04-26T10:24:33.181723+0000","last_undegraded":"2024-04-26T10:24:33.181723+0000","last_fullsized":"2024-04-26T10:24:33.181723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:43.756504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183058+0000","last_change":"2024-04-26T10:24:22.535819+0000","last_active":"2024-04-26T10:24:33.183058+0000","last_peered":"2024-04-26T10:24:33.183058+0000","last_clean":"2024-04-26T10:24:33.183058+0000","last_became_active":"2024-04-26T10:24:22.535562+0000","last_became_peered":"2024-04-26T10:24:22.535562+0000","last_unstale":"2024-04-26T10:24:33.183058+0000","last_undegraded":"2024-04-26T10:24:33.183058+0000","last_fullsized":"2024-04-26T10:24:33.183058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:24.845621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974051+0000","last_change":"2024-04-26T10:24:31.600594+0000","last_active":"2024-04-26T10:24:33.974051+0000","last_peered":"2024-04-26T10:24:33.974051+0000","last_clean":"2024-04-26T10:24:33.974051+0000","last_became_active":"2024-04-26T10:24:31.600121+0000","last_became_peered":"2024-04-26T10:24:31.600121+0000","last_unstale":"2024-04-26T10:24:33.974051+0000","last_undegraded":"2024-04-26T10:24:33.974051+0000","last_fullsized":"2024-04-26T10:24:33.974051+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:05.491069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175273+0000","last_change":"2024-04-26T10:24:22.542755+0000","last_active":"2024-04-26T10:24:33.175273+0000","last_peered":"2024-04-26T10:24:33.175273+0000","last_clean":"2024-04-26T10:24:33.175273+0000","last_became_active":"2024-04-26T10:24:22.541543+0000","last_became_peered":"2024-04-26T10:24:22.541543+0000","last_unstale":"2024-04-26T10:24:33.175273+0000","last_undegraded":"2024-04-26T10:24:33.175273+0000","last_fullsized":"2024-04-26T10:24:33.175273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:50.942528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175459+0000","last_change":"2024-04-26T10:24:22.541418+0000","last_active":"2024-04-26T10:24:33.175459+0000","last_peered":"2024-04-26T10:24:33.175459+0000","last_clean":"2024-04-26T10:24:33.175459+0000","last_became_active":"2024-04-26T10:24:22.540767+0000","last_became_peered":"2024-04-26T10:24:22.540767+0000","last_unstale":"2024-04-26T10:24:33.175459+0000","last_undegraded":"2024-04-26T10:24:33.175459+0000","last_fullsized":"2024-04-26T10:24:33.175459+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:26.684306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174534+0000","last_change":"2024-04-26T10:24:22.547294+0000","last_active":"2024-04-26T10:24:33.174534+0000","last_peered":"2024-04-26T10:24:33.174534+0000","last_clean":"2024-04-26T10:24:33.174534+0000","last_became_active":"2024-04-26T10:24:22.546811+0000","last_became_peered":"2024-04-26T10:24:22.546811+0000","last_unstale":"2024-04-26T10:24:33.174534+0000","last_undegraded":"2024-04-26T10:24:33.174534+0000","last_fullsized":"2024-04-26T10:24:33.174534+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:03.037283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182738+0000","last_change":"2024-04-26T10:22:09.753438+0000","last_active":"2024-04-26T10:24:33.182738+0000","last_peered":"2024-04-26T10:24:33.182738+0000","last_clean":"2024-04-26T10:24:33.182738+0000","last_became_active":"2024-04-26T10:22:09.753211+0000","last_became_peered":"2024-04-26T10:22:09.753211+0000","last_unstale":"2024-04-26T10:24:33.182738+0000","last_undegraded":"2024-04-26T10:24:33.182738+0000","last_fullsized":"2024-04-26T10:24:33.182738+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:39.406859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973960+0000","last_change":"2024-04-26T10:24:31.600935+0000","last_active":"2024-04-26T10:24:33.973960+0000","last_peered":"2024-04-26T10:24:33.973960+0000","last_clean":"2024-04-26T10:24:33.973960+0000","last_became_active":"2024-04-26T10:24:31.600088+0000","last_became_peered":"2024-04-26T10:24:31.600088+0000","last_unstale":"2024-04-26T10:24:33.973960+0000","last_undegraded":"2024-04-26T10:24:33.973960+0000","last_fullsized":"2024-04-26T10:24:33.973960+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:58.341684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319737+0000","last_change":"2024-04-26T10:24:22.680082+0000","last_active":"2024-04-26T10:24:33.319737+0000","last_peered":"2024-04-26T10:24:33.319737+0000","last_clean":"2024-04-26T10:24:33.319737+0000","last_became_active":"2024-04-26T10:24:22.679652+0000","last_became_peered":"2024-04-26T10:24:22.679652+0000","last_unstale":"2024-04-26T10:24:33.319737+0000","last_undegraded":"2024-04-26T10:24:33.319737+0000","last_fullsized":"2024-04-26T10:24:33.319737+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:37.821623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173304+0000","last_change":"2024-04-26T10:24:22.540326+0000","last_active":"2024-04-26T10:24:33.173304+0000","last_peered":"2024-04-26T10:24:33.173304+0000","last_clean":"2024-04-26T10:24:33.173304+0000","last_became_active":"2024-04-26T10:24:22.538895+0000","last_became_peered":"2024-04-26T10:24:22.538895+0000","last_unstale":"2024-04-26T10:24:33.173304+0000","last_undegraded":"2024-04-26T10:24:33.173304+0000","last_fullsized":"2024-04-26T10:24:33.173304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:29.709972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319358+0000","last_change":"2024-04-26T10:24:22.685454+0000","last_active":"2024-04-26T10:24:33.319358+0000","last_peered":"2024-04-26T10:24:33.319358+0000","last_clean":"2024-04-26T10:24:33.319358+0000","last_became_active":"2024-04-26T10:24:22.684863+0000","last_became_peered":"2024-04-26T10:24:22.684863+0000","last_unstale":"2024-04-26T10:24:33.319358+0000","last_undegraded":"2024-04-26T10:24:33.319358+0000","last_fullsized":"2024-04-26T10:24:33.319358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:33.027447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":21541,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673009,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279076,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":278014,"kb_avail":94092764,"statfs":{"total":96636764160,"available":96350990336,"internally_reserved":0,"allocated":1064960,"data_stored":1035671,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":284686790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:24:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55000000000000004,"15min":0.51600000000000001},"min":{"1min":0.25800000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.67500000000000004,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.53900000000000003},"min":{"1min":0.28000000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.754,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":0,"up_from":10,"seq":42949673008,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487484,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":486398,"kb_avail":93884356,"statfs":{"total":96636764160,"available":96137580544,"internally_reserved":0,"allocated":1089536,"data_stored":1036287,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":498072006},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:24:04 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.65600000000000003,"15min":0.56599999999999995},"min":{"1min":0.21099999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":4.1369999999999996,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.25900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.748,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":2,"up_from":80,"seq":343597383685,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38380,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":37369,"kb_avail":94333460,"statfs":{"total":96636764160,"available":96597463040,"internally_reserved":0,"allocated":1007616,"data_stored":444173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6879,"internal_metadata":38266145},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:24:41.480 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T10:24:41.480 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:24:41.792 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:24:41.794 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:24:41.807 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-04-26T10:24:40.042309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1184088,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":211,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":804940,"kb_used_data":3088,"kb_used_omap":9,"kb_used_meta":801782,"kb_avail":282310580,"statfs":{"total":289910292480,"available":289086033920,"internally_reserved":0,"allocated":3162112,"data_stored":2516131,"data_compressed":14075,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":10067,"internal_metadata":821024941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":592044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.449631"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974365+0000","last_change":"2024-04-26T10:24:31.598789+0000","last_active":"2024-04-26T10:24:33.974365+0000","last_peered":"2024-04-26T10:24:33.974365+0000","last_clean":"2024-04-26T10:24:33.974365+0000","last_became_active":"2024-04-26T10:24:31.598170+0000","last_became_peered":"2024-04-26T10:24:31.598170+0000","last_unstale":"2024-04-26T10:24:33.974365+0000","last_undegraded":"2024-04-26T10:24:33.974365+0000","last_fullsized":"2024-04-26T10:24:33.974365+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:46.718423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182259+0000","last_change":"2024-04-26T10:24:22.536264+0000","last_active":"2024-04-26T10:24:33.182259+0000","last_peered":"2024-04-26T10:24:33.182259+0000","last_clean":"2024-04-26T10:24:33.182259+0000","last_became_active":"2024-04-26T10:24:22.535998+0000","last_became_peered":"2024-04-26T10:24:22.535998+0000","last_unstale":"2024-04-26T10:24:33.182259+0000","last_undegraded":"2024-04-26T10:24:33.182259+0000","last_fullsized":"2024-04-26T10:24:33.182259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:54.491369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":79,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.176175+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:24:33.176175+0000","last_peered":"2024-04-26T10:24:33.176175+0000","last_clean":"2024-04-26T10:24:33.176175+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:24:33.176175+0000","last_undegraded":"2024-04-26T10:24:33.176175+0000","last_fullsized":"2024-04-26T10:24:33.176175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:01.883964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175776+0000","last_change":"2024-04-26T10:24:22.549067+0000","last_active":"2024-04-26T10:24:33.175776+0000","last_peered":"2024-04-26T10:24:33.175776+0000","last_clean":"2024-04-26T10:24:33.175776+0000","last_became_active":"2024-04-26T10:24:22.548485+0000","last_became_peered":"2024-04-26T10:24:22.548485+0000","last_unstale":"2024-04-26T10:24:33.175776+0000","last_undegraded":"2024-04-26T10:24:33.175776+0000","last_fullsized":"2024-04-26T10:24:33.175776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:31:19.263146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974073+0000","last_change":"2024-04-26T10:24:31.601925+0000","last_active":"2024-04-26T10:24:33.974073+0000","last_peered":"2024-04-26T10:24:33.974073+0000","last_clean":"2024-04-26T10:24:33.974073+0000","last_became_active":"2024-04-26T10:24:31.600986+0000","last_became_peered":"2024-04-26T10:24:31.600986+0000","last_unstale":"2024-04-26T10:24:33.974073+0000","last_undegraded":"2024-04-26T10:24:33.974073+0000","last_fullsized":"2024-04-26T10:24:33.974073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:52.125249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173997+0000","last_change":"2024-04-26T10:24:22.548245+0000","last_active":"2024-04-26T10:24:33.173997+0000","last_peered":"2024-04-26T10:24:33.173997+0000","last_clean":"2024-04-26T10:24:33.173997+0000","last_became_active":"2024-04-26T10:24:22.547731+0000","last_became_peered":"2024-04-26T10:24:22.547731+0000","last_unstale":"2024-04-26T10:24:33.173997+0000","last_undegraded":"2024-04-26T10:24:33.173997+0000","last_fullsized":"2024-04-26T10:24:33.173997+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:35:52.538672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173800+0000","last_change":"2024-04-26T10:24:22.549424+0000","last_active":"2024-04-26T10:24:33.173800+0000","last_peered":"2024-04-26T10:24:33.173800+0000","last_clean":"2024-04-26T10:24:33.173800+0000","last_became_active":"2024-04-26T10:24:22.549180+0000","last_became_peered":"2024-04-26T10:24:22.549180+0000","last_unstale":"2024-04-26T10:24:33.173800+0000","last_undegraded":"2024-04-26T10:24:33.173800+0000","last_fullsized":"2024-04-26T10:24:33.173800+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:13:49.915633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174913+0000","last_change":"2024-04-26T10:24:22.547840+0000","last_active":"2024-04-26T10:24:33.174913+0000","last_peered":"2024-04-26T10:24:33.174913+0000","last_clean":"2024-04-26T10:24:33.174913+0000","last_became_active":"2024-04-26T10:24:22.547284+0000","last_became_peered":"2024-04-26T10:24:22.547284+0000","last_unstale":"2024-04-26T10:24:33.174913+0000","last_undegraded":"2024-04-26T10:24:33.174913+0000","last_fullsized":"2024-04-26T10:24:33.174913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:20:09.731025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318637+0000","last_change":"2024-04-26T10:24:22.680232+0000","last_active":"2024-04-26T10:24:33.318637+0000","last_peered":"2024-04-26T10:24:33.318637+0000","last_clean":"2024-04-26T10:24:33.318637+0000","last_became_active":"2024-04-26T10:24:22.679648+0000","last_became_peered":"2024-04-26T10:24:22.679648+0000","last_unstale":"2024-04-26T10:24:33.318637+0000","last_undegraded":"2024-04-26T10:24:33.318637+0000","last_fullsized":"2024-04-26T10:24:33.318637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:58.174215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974286+0000","last_change":"2024-04-26T10:24:31.599182+0000","last_active":"2024-04-26T10:24:33.974286+0000","last_peered":"2024-04-26T10:24:33.974286+0000","last_clean":"2024-04-26T10:24:33.974286+0000","last_became_active":"2024-04-26T10:24:31.598187+0000","last_became_peered":"2024-04-26T10:24:31.598187+0000","last_unstale":"2024-04-26T10:24:33.974286+0000","last_undegraded":"2024-04-26T10:24:33.974286+0000","last_fullsized":"2024-04-26T10:24:33.974286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:24.255353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.176053+0000","last_change":"2024-04-26T10:24:22.547601+0000","last_active":"2024-04-26T10:24:33.176053+0000","last_peered":"2024-04-26T10:24:33.176053+0000","last_clean":"2024-04-26T10:24:33.176053+0000","last_became_active":"2024-04-26T10:24:22.546506+0000","last_became_peered":"2024-04-26T10:24:22.546506+0000","last_unstale":"2024-04-26T10:24:33.176053+0000","last_undegraded":"2024-04-26T10:24:33.176053+0000","last_fullsized":"2024-04-26T10:24:33.176053+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:09:21.263835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182904+0000","last_change":"2024-04-26T10:22:09.748232+0000","last_active":"2024-04-26T10:24:33.182904+0000","last_peered":"2024-04-26T10:24:33.182904+0000","last_clean":"2024-04-26T10:24:33.182904+0000","last_became_active":"2024-04-26T10:22:09.747822+0000","last_became_peered":"2024-04-26T10:22:09.747822+0000","last_unstale":"2024-04-26T10:24:33.182904+0000","last_undegraded":"2024-04-26T10:24:33.182904+0000","last_fullsized":"2024-04-26T10:24:33.182904+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.223031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974030+0000","last_change":"2024-04-26T10:24:31.598330+0000","last_active":"2024-04-26T10:24:33.974030+0000","last_peered":"2024-04-26T10:24:33.974030+0000","last_clean":"2024-04-26T10:24:33.974030+0000","last_became_active":"2024-04-26T10:24:31.597980+0000","last_became_peered":"2024-04-26T10:24:31.597980+0000","last_unstale":"2024-04-26T10:24:33.974030+0000","last_undegraded":"2024-04-26T10:24:33.974030+0000","last_fullsized":"2024-04-26T10:24:33.974030+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:38.711968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174108+0000","last_change":"2024-04-26T10:24:31.602827+0000","last_active":"2024-04-26T10:24:33.174108+0000","last_peered":"2024-04-26T10:24:33.174108+0000","last_clean":"2024-04-26T10:24:33.174108+0000","last_became_active":"2024-04-26T10:24:31.602539+0000","last_became_peered":"2024-04-26T10:24:31.602539+0000","last_unstale":"2024-04-26T10:24:33.174108+0000","last_undegraded":"2024-04-26T10:24:33.174108+0000","last_fullsized":"2024-04-26T10:24:33.174108+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:45.294898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173774+0000","last_change":"2024-04-26T10:24:31.602863+0000","last_active":"2024-04-26T10:24:33.173774+0000","last_peered":"2024-04-26T10:24:33.173774+0000","last_clean":"2024-04-26T10:24:33.173774+0000","last_became_active":"2024-04-26T10:24:31.602453+0000","last_became_peered":"2024-04-26T10:24:31.602453+0000","last_unstale":"2024-04-26T10:24:33.173774+0000","last_undegraded":"2024-04-26T10:24:33.173774+0000","last_fullsized":"2024-04-26T10:24:33.173774+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:32:51.661774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174475+0000","last_change":"2024-04-26T10:24:22.547543+0000","last_active":"2024-04-26T10:24:33.174475+0000","last_peered":"2024-04-26T10:24:33.174475+0000","last_clean":"2024-04-26T10:24:33.174475+0000","last_became_active":"2024-04-26T10:24:22.546856+0000","last_became_peered":"2024-04-26T10:24:22.546856+0000","last_unstale":"2024-04-26T10:24:33.174475+0000","last_undegraded":"2024-04-26T10:24:33.174475+0000","last_fullsized":"2024-04-26T10:24:33.174475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:08:34.240590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318406+0000","last_change":"2024-04-26T10:24:22.679885+0000","last_active":"2024-04-26T10:24:33.318406+0000","last_peered":"2024-04-26T10:24:33.318406+0000","last_clean":"2024-04-26T10:24:33.318406+0000","last_became_active":"2024-04-26T10:24:22.679350+0000","last_became_peered":"2024-04-26T10:24:22.679350+0000","last_unstale":"2024-04-26T10:24:33.318406+0000","last_undegraded":"2024-04-26T10:24:33.318406+0000","last_fullsized":"2024-04-26T10:24:33.318406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:06.039983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974316+0000","last_change":"2024-04-26T10:24:31.598857+0000","last_active":"2024-04-26T10:24:33.974316+0000","last_peered":"2024-04-26T10:24:33.974316+0000","last_clean":"2024-04-26T10:24:33.974316+0000","last_became_active":"2024-04-26T10:24:31.597563+0000","last_became_peered":"2024-04-26T10:24:31.597563+0000","last_unstale":"2024-04-26T10:24:33.974316+0000","last_undegraded":"2024-04-26T10:24:33.974316+0000","last_fullsized":"2024-04-26T10:24:33.974316+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:26.624180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317832+0000","last_change":"2024-04-26T10:24:22.679291+0000","last_active":"2024-04-26T10:24:33.317832+0000","last_peered":"2024-04-26T10:24:33.317832+0000","last_clean":"2024-04-26T10:24:33.317832+0000","last_became_active":"2024-04-26T10:24:22.678912+0000","last_became_peered":"2024-04-26T10:24:22.678912+0000","last_unstale":"2024-04-26T10:24:33.317832+0000","last_undegraded":"2024-04-26T10:24:33.317832+0000","last_fullsized":"2024-04-26T10:24:33.317832+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:49.260130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175676+0000","last_change":"2024-04-26T10:24:22.546669+0000","last_active":"2024-04-26T10:24:33.175676+0000","last_peered":"2024-04-26T10:24:33.175676+0000","last_clean":"2024-04-26T10:24:33.175676+0000","last_became_active":"2024-04-26T10:24:22.546052+0000","last_became_peered":"2024-04-26T10:24:22.546052+0000","last_unstale":"2024-04-26T10:24:33.175676+0000","last_undegraded":"2024-04-26T10:24:33.175676+0000","last_fullsized":"2024-04-26T10:24:33.175676+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:50:26.334069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174879+0000","last_change":"2024-04-26T10:24:22.547981+0000","last_active":"2024-04-26T10:24:33.174879+0000","last_peered":"2024-04-26T10:24:33.174879+0000","last_clean":"2024-04-26T10:24:33.174879+0000","last_became_active":"2024-04-26T10:24:22.547663+0000","last_became_peered":"2024-04-26T10:24:22.547663+0000","last_unstale":"2024-04-26T10:24:33.174879+0000","last_undegraded":"2024-04-26T10:24:33.174879+0000","last_fullsized":"2024-04-26T10:24:33.174879+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:44:07.105037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181281+0000","last_change":"2024-04-26T10:22:09.749283+0000","last_active":"2024-04-26T10:24:33.181281+0000","last_peered":"2024-04-26T10:24:33.181281+0000","last_clean":"2024-04-26T10:24:33.181281+0000","last_became_active":"2024-04-26T10:22:09.748755+0000","last_became_peered":"2024-04-26T10:22:09.748755+0000","last_unstale":"2024-04-26T10:24:33.181281+0000","last_undegraded":"2024-04-26T10:24:33.181281+0000","last_fullsized":"2024-04-26T10:24:33.181281+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:40.910715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317029+0000","last_change":"2024-04-26T10:24:22.684668+0000","last_active":"2024-04-26T10:24:33.317029+0000","last_peered":"2024-04-26T10:24:33.317029+0000","last_clean":"2024-04-26T10:24:33.317029+0000","last_became_active":"2024-04-26T10:24:22.683921+0000","last_became_peered":"2024-04-26T10:24:22.683921+0000","last_unstale":"2024-04-26T10:24:33.317029+0000","last_undegraded":"2024-04-26T10:24:33.317029+0000","last_fullsized":"2024-04-26T10:24:33.317029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.930781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182162+0000","last_change":"2024-04-26T10:24:22.535052+0000","last_active":"2024-04-26T10:24:33.182162+0000","last_peered":"2024-04-26T10:24:33.182162+0000","last_clean":"2024-04-26T10:24:33.182162+0000","last_became_active":"2024-04-26T10:24:22.534674+0000","last_became_peered":"2024-04-26T10:24:22.534674+0000","last_unstale":"2024-04-26T10:24:33.182162+0000","last_undegraded":"2024-04-26T10:24:33.182162+0000","last_fullsized":"2024-04-26T10:24:33.182162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:10.969425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974384+0000","last_change":"2024-04-26T10:24:31.601262+0000","last_active":"2024-04-26T10:24:33.974384+0000","last_peered":"2024-04-26T10:24:33.974384+0000","last_clean":"2024-04-26T10:24:33.974384+0000","last_became_active":"2024-04-26T10:24:31.600815+0000","last_became_peered":"2024-04-26T10:24:31.600815+0000","last_unstale":"2024-04-26T10:24:33.974384+0000","last_undegraded":"2024-04-26T10:24:33.974384+0000","last_fullsized":"2024-04-26T10:24:33.974384+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:02.552727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319258+0000","last_change":"2024-04-26T10:24:22.684739+0000","last_active":"2024-04-26T10:24:33.319258+0000","last_peered":"2024-04-26T10:24:33.319258+0000","last_clean":"2024-04-26T10:24:33.319258+0000","last_became_active":"2024-04-26T10:24:22.683959+0000","last_became_peered":"2024-04-26T10:24:22.683959+0000","last_unstale":"2024-04-26T10:24:33.319258+0000","last_undegraded":"2024-04-26T10:24:33.319258+0000","last_fullsized":"2024-04-26T10:24:33.319258+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:07.840236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":79,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175977+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:24:33.175977+0000","last_peered":"2024-04-26T10:24:33.175977+0000","last_clean":"2024-04-26T10:24:33.175977+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:24:33.175977+0000","last_undegraded":"2024-04-26T10:24:33.175977+0000","last_fullsized":"2024-04-26T10:24:33.175977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:30:39.394937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974137+0000","last_change":"2024-04-26T10:24:31.602078+0000","last_active":"2024-04-26T10:24:33.974137+0000","last_peered":"2024-04-26T10:24:33.974137+0000","last_clean":"2024-04-26T10:24:33.974137+0000","last_became_active":"2024-04-26T10:24:31.601299+0000","last_became_peered":"2024-04-26T10:24:31.601299+0000","last_unstale":"2024-04-26T10:24:33.974137+0000","last_undegraded":"2024-04-26T10:24:33.974137+0000","last_fullsized":"2024-04-26T10:24:33.974137+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:43.374493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317271+0000","last_change":"2024-04-26T10:24:31.741152+0000","last_active":"2024-04-26T10:24:33.317271+0000","last_peered":"2024-04-26T10:24:33.317271+0000","last_clean":"2024-04-26T10:24:33.317271+0000","last_became_active":"2024-04-26T10:24:31.740626+0000","last_became_peered":"2024-04-26T10:24:31.740626+0000","last_unstale":"2024-04-26T10:24:33.317271+0000","last_undegraded":"2024-04-26T10:24:33.317271+0000","last_fullsized":"2024-04-26T10:24:33.317271+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:23.323149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181503+0000","last_change":"2024-04-26T10:22:09.750562+0000","last_active":"2024-04-26T10:24:33.181503+0000","last_peered":"2024-04-26T10:24:33.181503+0000","last_clean":"2024-04-26T10:24:33.181503+0000","last_became_active":"2024-04-26T10:22:09.750286+0000","last_became_peered":"2024-04-26T10:22:09.750286+0000","last_unstale":"2024-04-26T10:24:33.181503+0000","last_undegraded":"2024-04-26T10:24:33.181503+0000","last_fullsized":"2024-04-26T10:24:33.181503+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:52.795517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317979+0000","last_change":"2024-04-26T10:24:31.741008+0000","last_active":"2024-04-26T10:24:33.317979+0000","last_peered":"2024-04-26T10:24:33.317979+0000","last_clean":"2024-04-26T10:24:33.317979+0000","last_became_active":"2024-04-26T10:24:31.740518+0000","last_became_peered":"2024-04-26T10:24:31.740518+0000","last_unstale":"2024-04-26T10:24:33.317979+0000","last_undegraded":"2024-04-26T10:24:33.317979+0000","last_fullsized":"2024-04-26T10:24:33.317979+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:11:59.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173926+0000","last_change":"2024-04-26T10:24:22.540161+0000","last_active":"2024-04-26T10:24:33.173926+0000","last_peered":"2024-04-26T10:24:33.173926+0000","last_clean":"2024-04-26T10:24:33.173926+0000","last_became_active":"2024-04-26T10:24:22.539106+0000","last_became_peered":"2024-04-26T10:24:22.539106+0000","last_unstale":"2024-04-26T10:24:33.173926+0000","last_undegraded":"2024-04-26T10:24:33.173926+0000","last_fullsized":"2024-04-26T10:24:33.173926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:15:09.208422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974115+0000","last_change":"2024-04-26T10:24:31.599487+0000","last_active":"2024-04-26T10:24:33.974115+0000","last_peered":"2024-04-26T10:24:33.974115+0000","last_clean":"2024-04-26T10:24:33.974115+0000","last_became_active":"2024-04-26T10:24:31.598307+0000","last_became_peered":"2024-04-26T10:24:31.598307+0000","last_unstale":"2024-04-26T10:24:33.974115+0000","last_undegraded":"2024-04-26T10:24:33.974115+0000","last_fullsized":"2024-04-26T10:24:33.974115+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:11.881961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174602+0000","last_change":"2024-04-26T10:24:22.547974+0000","last_active":"2024-04-26T10:24:33.174602+0000","last_peered":"2024-04-26T10:24:33.174602+0000","last_clean":"2024-04-26T10:24:33.174602+0000","last_became_active":"2024-04-26T10:24:22.546794+0000","last_became_peered":"2024-04-26T10:24:22.546794+0000","last_unstale":"2024-04-26T10:24:33.174602+0000","last_undegraded":"2024-04-26T10:24:33.174602+0000","last_fullsized":"2024-04-26T10:24:33.174602+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:44:28.897600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974196+0000","last_change":"2024-04-26T10:24:31.597848+0000","last_active":"2024-04-26T10:24:33.974196+0000","last_peered":"2024-04-26T10:24:33.974196+0000","last_clean":"2024-04-26T10:24:33.974196+0000","last_became_active":"2024-04-26T10:24:31.596297+0000","last_became_peered":"2024-04-26T10:24:31.596297+0000","last_unstale":"2024-04-26T10:24:33.974196+0000","last_undegraded":"2024-04-26T10:24:33.974196+0000","last_fullsized":"2024-04-26T10:24:33.974196+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:09.585450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317333+0000","last_change":"2024-04-26T10:24:22.684913+0000","last_active":"2024-04-26T10:24:33.317333+0000","last_peered":"2024-04-26T10:24:33.317333+0000","last_clean":"2024-04-26T10:24:33.317333+0000","last_became_active":"2024-04-26T10:24:22.684541+0000","last_became_peered":"2024-04-26T10:24:22.684541+0000","last_unstale":"2024-04-26T10:24:33.317333+0000","last_undegraded":"2024-04-26T10:24:33.317333+0000","last_fullsized":"2024-04-26T10:24:33.317333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:32.802131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318520+0000","last_change":"2024-04-26T10:24:22.683787+0000","last_active":"2024-04-26T10:24:33.318520+0000","last_peered":"2024-04-26T10:24:33.318520+0000","last_clean":"2024-04-26T10:24:33.318520+0000","last_became_active":"2024-04-26T10:24:22.682650+0000","last_became_peered":"2024-04-26T10:24:22.682650+0000","last_unstale":"2024-04-26T10:24:33.318520+0000","last_undegraded":"2024-04-26T10:24:33.318520+0000","last_fullsized":"2024-04-26T10:24:33.318520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:29.301512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973911+0000","last_change":"2024-04-26T10:24:31.601959+0000","last_active":"2024-04-26T10:24:33.973911+0000","last_peered":"2024-04-26T10:24:33.973911+0000","last_clean":"2024-04-26T10:24:33.973911+0000","last_became_active":"2024-04-26T10:24:31.601091+0000","last_became_peered":"2024-04-26T10:24:31.601091+0000","last_unstale":"2024-04-26T10:24:33.973911+0000","last_undegraded":"2024-04-26T10:24:33.973911+0000","last_fullsized":"2024-04-26T10:24:33.973911+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:46.182880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318431+0000","last_change":"2024-04-26T10:24:22.684603+0000","last_active":"2024-04-26T10:24:33.318431+0000","last_peered":"2024-04-26T10:24:33.318431+0000","last_clean":"2024-04-26T10:24:33.318431+0000","last_became_active":"2024-04-26T10:24:22.684213+0000","last_became_peered":"2024-04-26T10:24:22.684213+0000","last_unstale":"2024-04-26T10:24:33.318431+0000","last_undegraded":"2024-04-26T10:24:33.318431+0000","last_fullsized":"2024-04-26T10:24:33.318431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:41.006428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":134,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173541+0000","last_change":"2024-04-26T10:24:31.613086+0000","last_active":"2024-04-26T10:24:33.173541+0000","last_peered":"2024-04-26T10:24:33.173541+0000","last_clean":"2024-04-26T10:24:33.173541+0000","last_became_active":"2024-04-26T10:24:31.604402+0000","last_became_peered":"2024-04-26T10:24:31.604402+0000","last_unstale":"2024-04-26T10:24:33.173541+0000","last_undegraded":"2024-04-26T10:24:33.173541+0000","last_fullsized":"2024-04-26T10:24:33.173541+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:52.355783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":115,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175870+0000","last_change":"2024-04-26T10:24:31.624641+0000","last_active":"2024-04-26T10:24:33.175870+0000","last_peered":"2024-04-26T10:24:33.175870+0000","last_clean":"2024-04-26T10:24:33.175870+0000","last_became_active":"2024-04-26T10:24:31.604744+0000","last_became_peered":"2024-04-26T10:24:31.604744+0000","last_unstale":"2024-04-26T10:24:33.175870+0000","last_undegraded":"2024-04-26T10:24:33.175870+0000","last_fullsized":"2024-04-26T10:24:33.175870+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:44.677409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182275+0000","last_change":"2024-04-26T10:22:09.750173+0000","last_active":"2024-04-26T10:24:33.182275+0000","last_peered":"2024-04-26T10:24:33.182275+0000","last_clean":"2024-04-26T10:24:33.182275+0000","last_became_active":"2024-04-26T10:22:09.749862+0000","last_became_peered":"2024-04-26T10:22:09.749862+0000","last_unstale":"2024-04-26T10:24:33.182275+0000","last_undegraded":"2024-04-26T10:24:33.182275+0000","last_fullsized":"2024-04-26T10:24:33.182275+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:53.204364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182816+0000","last_change":"2024-04-26T10:22:09.750224+0000","last_active":"2024-04-26T10:24:33.182816+0000","last_peered":"2024-04-26T10:24:33.182816+0000","last_clean":"2024-04-26T10:24:33.182816+0000","last_became_active":"2024-04-26T10:22:09.749852+0000","last_became_peered":"2024-04-26T10:22:09.749852+0000","last_unstale":"2024-04-26T10:24:33.182816+0000","last_undegraded":"2024-04-26T10:24:33.182816+0000","last_fullsized":"2024-04-26T10:24:33.182816+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:44.923542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973891+0000","last_change":"2024-04-26T10:24:31.597157+0000","last_active":"2024-04-26T10:24:33.973891+0000","last_peered":"2024-04-26T10:24:33.973891+0000","last_clean":"2024-04-26T10:24:33.973891+0000","last_became_active":"2024-04-26T10:24:31.596335+0000","last_became_peered":"2024-04-26T10:24:31.596335+0000","last_unstale":"2024-04-26T10:24:33.973891+0000","last_undegraded":"2024-04-26T10:24:33.973891+0000","last_fullsized":"2024-04-26T10:24:33.973891+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:07.652892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":81,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175501+0000","last_change":"2024-04-26T10:21:08.935133+0000","last_active":"2024-04-26T10:24:33.175501+0000","last_peered":"2024-04-26T10:24:33.175501+0000","last_clean":"2024-04-26T10:24:33.175501+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:24:33.175501+0000","last_undegraded":"2024-04-26T10:24:33.175501+0000","last_fullsized":"2024-04-26T10:24:33.175501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:18:25.498249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174259+0000","last_change":"2024-04-26T10:24:22.549411+0000","last_active":"2024-04-26T10:24:33.174259+0000","last_peered":"2024-04-26T10:24:33.174259+0000","last_clean":"2024-04-26T10:24:33.174259+0000","last_became_active":"2024-04-26T10:24:22.549230+0000","last_became_peered":"2024-04-26T10:24:22.549230+0000","last_unstale":"2024-04-26T10:24:33.174259+0000","last_undegraded":"2024-04-26T10:24:33.174259+0000","last_fullsized":"2024-04-26T10:24:33.174259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:06:00.343304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175419+0000","last_change":"2024-04-26T10:24:22.541409+0000","last_active":"2024-04-26T10:24:33.175419+0000","last_peered":"2024-04-26T10:24:33.175419+0000","last_clean":"2024-04-26T10:24:33.175419+0000","last_became_active":"2024-04-26T10:24:22.540611+0000","last_became_peered":"2024-04-26T10:24:22.540611+0000","last_unstale":"2024-04-26T10:24:33.175419+0000","last_undegraded":"2024-04-26T10:24:33.175419+0000","last_fullsized":"2024-04-26T10:24:33.175419+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:05:48.882187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319142+0000","last_change":"2024-04-26T10:24:22.687178+0000","last_active":"2024-04-26T10:24:33.319142+0000","last_peered":"2024-04-26T10:24:33.319142+0000","last_clean":"2024-04-26T10:24:33.319142+0000","last_became_active":"2024-04-26T10:24:22.686841+0000","last_became_peered":"2024-04-26T10:24:22.686841+0000","last_unstale":"2024-04-26T10:24:33.319142+0000","last_undegraded":"2024-04-26T10:24:33.319142+0000","last_fullsized":"2024-04-26T10:24:33.319142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:52.907696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318078+0000","last_change":"2024-04-26T10:24:22.687183+0000","last_active":"2024-04-26T10:24:33.318078+0000","last_peered":"2024-04-26T10:24:33.318078+0000","last_clean":"2024-04-26T10:24:33.318078+0000","last_became_active":"2024-04-26T10:24:22.686846+0000","last_became_peered":"2024-04-26T10:24:22.686846+0000","last_unstale":"2024-04-26T10:24:33.318078+0000","last_undegraded":"2024-04-26T10:24:33.318078+0000","last_fullsized":"2024-04-26T10:24:33.318078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:37.083683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175590+0000","last_change":"2024-04-26T10:24:22.546117+0000","last_active":"2024-04-26T10:24:33.175590+0000","last_peered":"2024-04-26T10:24:33.175590+0000","last_clean":"2024-04-26T10:24:33.175590+0000","last_became_active":"2024-04-26T10:24:22.545616+0000","last_became_peered":"2024-04-26T10:24:22.545616+0000","last_unstale":"2024-04-26T10:24:33.175590+0000","last_undegraded":"2024-04-26T10:24:33.175590+0000","last_fullsized":"2024-04-26T10:24:33.175590+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:09.247826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174530+0000","last_change":"2024-04-26T10:24:22.540185+0000","last_active":"2024-04-26T10:24:33.174530+0000","last_peered":"2024-04-26T10:24:33.174530+0000","last_clean":"2024-04-26T10:24:33.174530+0000","last_became_active":"2024-04-26T10:24:22.538982+0000","last_became_peered":"2024-04-26T10:24:22.538982+0000","last_unstale":"2024-04-26T10:24:33.174530+0000","last_undegraded":"2024-04-26T10:24:33.174530+0000","last_fullsized":"2024-04-26T10:24:33.174530+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:11:27.225284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":79,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174662+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:24:33.174662+0000","last_peered":"2024-04-26T10:24:33.174662+0000","last_clean":"2024-04-26T10:24:33.174662+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:24:33.174662+0000","last_undegraded":"2024-04-26T10:24:33.174662+0000","last_fullsized":"2024-04-26T10:24:33.174662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:02.338164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181167+0000","last_change":"2024-04-26T10:22:09.748616+0000","last_active":"2024-04-26T10:24:33.181167+0000","last_peered":"2024-04-26T10:24:33.181167+0000","last_clean":"2024-04-26T10:24:33.181167+0000","last_became_active":"2024-04-26T10:22:09.748256+0000","last_became_peered":"2024-04-26T10:22:09.748256+0000","last_unstale":"2024-04-26T10:24:33.181167+0000","last_undegraded":"2024-04-26T10:24:33.181167+0000","last_fullsized":"2024-04-26T10:24:33.181167+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:19.402647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174461+0000","last_change":"2024-04-26T10:24:31.604150+0000","last_active":"2024-04-26T10:24:33.174461+0000","last_peered":"2024-04-26T10:24:33.174461+0000","last_clean":"2024-04-26T10:24:33.174461+0000","last_became_active":"2024-04-26T10:24:31.603620+0000","last_became_peered":"2024-04-26T10:24:31.603620+0000","last_unstale":"2024-04-26T10:24:33.174461+0000","last_undegraded":"2024-04-26T10:24:33.174461+0000","last_fullsized":"2024-04-26T10:24:33.174461+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:43:17.085344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973830+0000","last_change":"2024-04-26T10:24:31.598521+0000","last_active":"2024-04-26T10:24:33.973830+0000","last_peered":"2024-04-26T10:24:33.973830+0000","last_clean":"2024-04-26T10:24:33.973830+0000","last_became_active":"2024-04-26T10:24:31.598120+0000","last_became_peered":"2024-04-26T10:24:31.598120+0000","last_unstale":"2024-04-26T10:24:33.973830+0000","last_undegraded":"2024-04-26T10:24:33.973830+0000","last_fullsized":"2024-04-26T10:24:33.973830+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:23.723355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319166+0000","last_change":"2024-04-26T10:24:22.680557+0000","last_active":"2024-04-26T10:24:33.319166+0000","last_peered":"2024-04-26T10:24:33.319166+0000","last_clean":"2024-04-26T10:24:33.319166+0000","last_became_active":"2024-04-26T10:24:22.679940+0000","last_became_peered":"2024-04-26T10:24:22.679940+0000","last_unstale":"2024-04-26T10:24:33.319166+0000","last_undegraded":"2024-04-26T10:24:33.319166+0000","last_fullsized":"2024-04-26T10:24:33.319166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:06.379234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":333,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185235+0000","last_change":"2024-04-26T10:24:34.185235+0000","last_active":"2024-04-26T10:24:34.185235+0000","last_peered":"2024-04-26T10:24:34.185235+0000","last_clean":"2024-04-26T10:24:34.185235+0000","last_became_active":"2024-04-26T10:24:34.184490+0000","last_became_peered":"2024-04-26T10:24:34.184490+0000","last_unstale":"2024-04-26T10:24:34.185235+0000","last_undegraded":"2024-04-26T10:24:34.185235+0000","last_fullsized":"2024-04-26T10:24:34.185235+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:34:33.812288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174100+0000","last_change":"2024-04-26T10:24:22.547708+0000","last_active":"2024-04-26T10:24:33.174100+0000","last_peered":"2024-04-26T10:24:33.174100+0000","last_clean":"2024-04-26T10:24:33.174100+0000","last_became_active":"2024-04-26T10:24:22.546650+0000","last_became_peered":"2024-04-26T10:24:22.546650+0000","last_unstale":"2024-04-26T10:24:33.174100+0000","last_undegraded":"2024-04-26T10:24:33.174100+0000","last_fullsized":"2024-04-26T10:24:33.174100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:55.474931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317752+0000","last_change":"2024-04-26T10:24:22.676755+0000","last_active":"2024-04-26T10:24:33.317752+0000","last_peered":"2024-04-26T10:24:33.317752+0000","last_clean":"2024-04-26T10:24:33.317752+0000","last_became_active":"2024-04-26T10:24:22.676489+0000","last_became_peered":"2024-04-26T10:24:22.676489+0000","last_unstale":"2024-04-26T10:24:33.317752+0000","last_undegraded":"2024-04-26T10:24:33.317752+0000","last_fullsized":"2024-04-26T10:24:33.317752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:38.979532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174906+0000","last_change":"2024-04-26T10:24:31.603833+0000","last_active":"2024-04-26T10:24:33.174906+0000","last_peered":"2024-04-26T10:24:33.174906+0000","last_clean":"2024-04-26T10:24:33.174906+0000","last_became_active":"2024-04-26T10:24:31.603498+0000","last_became_peered":"2024-04-26T10:24:31.603498+0000","last_unstale":"2024-04-26T10:24:33.174906+0000","last_undegraded":"2024-04-26T10:24:33.174906+0000","last_fullsized":"2024-04-26T10:24:33.174906+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:55:58.952460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":109,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174671+0000","last_change":"2024-04-26T10:24:31.603067+0000","last_active":"2024-04-26T10:24:33.174671+0000","last_peered":"2024-04-26T10:24:33.174671+0000","last_clean":"2024-04-26T10:24:33.174671+0000","last_became_active":"2024-04-26T10:24:31.602611+0000","last_became_peered":"2024-04-26T10:24:31.602611+0000","last_unstale":"2024-04-26T10:24:33.174671+0000","last_undegraded":"2024-04-26T10:24:33.174671+0000","last_fullsized":"2024-04-26T10:24:33.174671+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:27:14.943135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316711+0000","last_change":"2024-04-26T10:24:22.685554+0000","last_active":"2024-04-26T10:24:33.316711+0000","last_peered":"2024-04-26T10:24:33.316711+0000","last_clean":"2024-04-26T10:24:33.316711+0000","last_became_active":"2024-04-26T10:24:22.685051+0000","last_became_peered":"2024-04-26T10:24:22.685051+0000","last_unstale":"2024-04-26T10:24:33.316711+0000","last_undegraded":"2024-04-26T10:24:33.316711+0000","last_fullsized":"2024-04-26T10:24:33.316711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:59.389895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182836+0000","last_change":"2024-04-26T10:24:22.538294+0000","last_active":"2024-04-26T10:24:33.182836+0000","last_peered":"2024-04-26T10:24:33.182836+0000","last_clean":"2024-04-26T10:24:33.182836+0000","last_became_active":"2024-04-26T10:24:22.537983+0000","last_became_peered":"2024-04-26T10:24:22.537983+0000","last_unstale":"2024-04-26T10:24:33.182836+0000","last_undegraded":"2024-04-26T10:24:33.182836+0000","last_fullsized":"2024-04-26T10:24:33.182836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:54.064158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317277+0000","last_change":"2024-04-26T10:24:22.679231+0000","last_active":"2024-04-26T10:24:33.317277+0000","last_peered":"2024-04-26T10:24:33.317277+0000","last_clean":"2024-04-26T10:24:33.317277+0000","last_became_active":"2024-04-26T10:24:22.678866+0000","last_became_peered":"2024-04-26T10:24:22.678866+0000","last_unstale":"2024-04-26T10:24:33.317277+0000","last_undegraded":"2024-04-26T10:24:33.317277+0000","last_fullsized":"2024-04-26T10:24:33.317277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:26.179423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182367+0000","last_change":"2024-04-26T10:22:09.750297+0000","last_active":"2024-04-26T10:24:33.182367+0000","last_peered":"2024-04-26T10:24:33.182367+0000","last_clean":"2024-04-26T10:24:33.182367+0000","last_became_active":"2024-04-26T10:22:09.749935+0000","last_became_peered":"2024-04-26T10:22:09.749935+0000","last_unstale":"2024-04-26T10:24:33.182367+0000","last_undegraded":"2024-04-26T10:24:33.182367+0000","last_fullsized":"2024-04-26T10:24:33.182367+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:51.197306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319145+0000","last_change":"2024-04-26T10:24:31.745820+0000","last_active":"2024-04-26T10:24:33.319145+0000","last_peered":"2024-04-26T10:24:33.319145+0000","last_clean":"2024-04-26T10:24:33.319145+0000","last_became_active":"2024-04-26T10:24:31.745487+0000","last_became_peered":"2024-04-26T10:24:31.745487+0000","last_unstale":"2024-04-26T10:24:33.319145+0000","last_undegraded":"2024-04-26T10:24:33.319145+0000","last_fullsized":"2024-04-26T10:24:33.319145+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:00.239650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174768+0000","last_change":"2024-04-26T10:24:22.539761+0000","last_active":"2024-04-26T10:24:33.174768+0000","last_peered":"2024-04-26T10:24:33.174768+0000","last_clean":"2024-04-26T10:24:33.174768+0000","last_became_active":"2024-04-26T10:24:22.538993+0000","last_became_peered":"2024-04-26T10:24:22.538993+0000","last_unstale":"2024-04-26T10:24:33.174768+0000","last_undegraded":"2024-04-26T10:24:33.174768+0000","last_fullsized":"2024-04-26T10:24:33.174768+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:40:24.782191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174356+0000","last_change":"2024-04-26T10:24:22.542774+0000","last_active":"2024-04-26T10:24:33.174356+0000","last_peered":"2024-04-26T10:24:33.174356+0000","last_clean":"2024-04-26T10:24:33.174356+0000","last_became_active":"2024-04-26T10:24:22.541795+0000","last_became_peered":"2024-04-26T10:24:22.541795+0000","last_unstale":"2024-04-26T10:24:33.174356+0000","last_undegraded":"2024-04-26T10:24:33.174356+0000","last_fullsized":"2024-04-26T10:24:33.174356+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:05:07.303056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317944+0000","last_change":"2024-04-26T10:24:31.744717+0000","last_active":"2024-04-26T10:24:33.317944+0000","last_peered":"2024-04-26T10:24:33.317944+0000","last_clean":"2024-04-26T10:24:33.317944+0000","last_became_active":"2024-04-26T10:24:31.744373+0000","last_became_peered":"2024-04-26T10:24:31.744373+0000","last_unstale":"2024-04-26T10:24:33.317944+0000","last_undegraded":"2024-04-26T10:24:33.317944+0000","last_fullsized":"2024-04-26T10:24:33.317944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:10.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174262+0000","last_change":"2024-04-26T10:24:22.538573+0000","last_active":"2024-04-26T10:24:33.174262+0000","last_peered":"2024-04-26T10:24:33.174262+0000","last_clean":"2024-04-26T10:24:33.174262+0000","last_became_active":"2024-04-26T10:24:22.537041+0000","last_became_peered":"2024-04-26T10:24:22.537041+0000","last_unstale":"2024-04-26T10:24:33.174262+0000","last_undegraded":"2024-04-26T10:24:33.174262+0000","last_fullsized":"2024-04-26T10:24:33.174262+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:45:48.026637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318800+0000","last_change":"2024-04-26T10:24:31.744776+0000","last_active":"2024-04-26T10:24:33.318800+0000","last_peered":"2024-04-26T10:24:33.318800+0000","last_clean":"2024-04-26T10:24:33.318800+0000","last_became_active":"2024-04-26T10:24:31.744342+0000","last_became_peered":"2024-04-26T10:24:31.744342+0000","last_unstale":"2024-04-26T10:24:33.318800+0000","last_undegraded":"2024-04-26T10:24:33.318800+0000","last_fullsized":"2024-04-26T10:24:33.318800+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:08:33.941367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973980+0000","last_change":"2024-04-26T10:24:31.599193+0000","last_active":"2024-04-26T10:24:33.973980+0000","last_peered":"2024-04-26T10:24:33.973980+0000","last_clean":"2024-04-26T10:24:33.973980+0000","last_became_active":"2024-04-26T10:24:31.598432+0000","last_became_peered":"2024-04-26T10:24:31.598432+0000","last_unstale":"2024-04-26T10:24:33.973980+0000","last_undegraded":"2024-04-26T10:24:33.973980+0000","last_fullsized":"2024-04-26T10:24:33.973980+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:41.515775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318555+0000","last_change":"2024-04-26T10:24:31.745336+0000","last_active":"2024-04-26T10:24:33.318555+0000","last_peered":"2024-04-26T10:24:33.318555+0000","last_clean":"2024-04-26T10:24:33.318555+0000","last_became_active":"2024-04-26T10:24:31.745004+0000","last_became_peered":"2024-04-26T10:24:31.745004+0000","last_unstale":"2024-04-26T10:24:33.318555+0000","last_undegraded":"2024-04-26T10:24:33.318555+0000","last_fullsized":"2024-04-26T10:24:33.318555+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:15.275549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974267+0000","last_change":"2024-04-26T10:24:31.601585+0000","last_active":"2024-04-26T10:24:33.974267+0000","last_peered":"2024-04-26T10:24:33.974267+0000","last_clean":"2024-04-26T10:24:33.974267+0000","last_became_active":"2024-04-26T10:24:31.600977+0000","last_became_peered":"2024-04-26T10:24:31.600977+0000","last_unstale":"2024-04-26T10:24:33.974267+0000","last_undegraded":"2024-04-26T10:24:33.974267+0000","last_fullsized":"2024-04-26T10:24:33.974267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.329801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181771+0000","last_change":"2024-04-26T10:22:09.758116+0000","last_active":"2024-04-26T10:24:33.181771+0000","last_peered":"2024-04-26T10:24:33.181771+0000","last_clean":"2024-04-26T10:24:33.181771+0000","last_became_active":"2024-04-26T10:22:09.757813+0000","last_became_peered":"2024-04-26T10:22:09.757813+0000","last_unstale":"2024-04-26T10:24:33.181771+0000","last_undegraded":"2024-04-26T10:24:33.181771+0000","last_fullsized":"2024-04-26T10:24:33.181771+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:01.195987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318177+0000","last_change":"2024-04-26T10:24:22.680137+0000","last_active":"2024-04-26T10:24:33.318177+0000","last_peered":"2024-04-26T10:24:33.318177+0000","last_clean":"2024-04-26T10:24:33.318177+0000","last_became_active":"2024-04-26T10:24:22.679497+0000","last_became_peered":"2024-04-26T10:24:22.679497+0000","last_unstale":"2024-04-26T10:24:33.318177+0000","last_undegraded":"2024-04-26T10:24:33.318177+0000","last_fullsized":"2024-04-26T10:24:33.318177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:00.401135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318093+0000","last_change":"2024-04-26T10:24:31.741102+0000","last_active":"2024-04-26T10:24:33.318093+0000","last_peered":"2024-04-26T10:24:33.318093+0000","last_clean":"2024-04-26T10:24:33.318093+0000","last_became_active":"2024-04-26T10:24:31.740589+0000","last_became_peered":"2024-04-26T10:24:31.740589+0000","last_unstale":"2024-04-26T10:24:33.318093+0000","last_undegraded":"2024-04-26T10:24:33.318093+0000","last_fullsized":"2024-04-26T10:24:33.318093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:38.170544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317410+0000","last_change":"2024-04-26T10:24:22.686404+0000","last_active":"2024-04-26T10:24:33.317410+0000","last_peered":"2024-04-26T10:24:33.317410+0000","last_clean":"2024-04-26T10:24:33.317410+0000","last_became_active":"2024-04-26T10:24:22.686094+0000","last_became_peered":"2024-04-26T10:24:22.686094+0000","last_unstale":"2024-04-26T10:24:33.317410+0000","last_undegraded":"2024-04-26T10:24:33.317410+0000","last_fullsized":"2024-04-26T10:24:33.317410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:37.911705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318296+0000","last_change":"2024-04-26T10:24:22.682344+0000","last_active":"2024-04-26T10:24:33.318296+0000","last_peered":"2024-04-26T10:24:33.318296+0000","last_clean":"2024-04-26T10:24:33.318296+0000","last_became_active":"2024-04-26T10:24:22.681977+0000","last_became_peered":"2024-04-26T10:24:22.681977+0000","last_unstale":"2024-04-26T10:24:33.318296+0000","last_undegraded":"2024-04-26T10:24:33.318296+0000","last_fullsized":"2024-04-26T10:24:33.318296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:56.544667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175850+0000","last_change":"2024-04-26T10:24:31.605320+0000","last_active":"2024-04-26T10:24:33.175850+0000","last_peered":"2024-04-26T10:24:33.175850+0000","last_clean":"2024-04-26T10:24:33.175850+0000","last_became_active":"2024-04-26T10:24:31.604158+0000","last_became_peered":"2024-04-26T10:24:31.604158+0000","last_unstale":"2024-04-26T10:24:33.175850+0000","last_undegraded":"2024-04-26T10:24:33.175850+0000","last_fullsized":"2024-04-26T10:24:33.175850+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:10:53.955856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973931+0000","last_change":"2024-04-26T10:24:31.601291+0000","last_active":"2024-04-26T10:24:33.973931+0000","last_peered":"2024-04-26T10:24:33.973931+0000","last_clean":"2024-04-26T10:24:33.973931+0000","last_became_active":"2024-04-26T10:24:31.600474+0000","last_became_peered":"2024-04-26T10:24:31.600474+0000","last_unstale":"2024-04-26T10:24:33.973931+0000","last_undegraded":"2024-04-26T10:24:33.973931+0000","last_fullsized":"2024-04-26T10:24:33.973931+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:30.284416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":105,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175157+0000","last_change":"2024-04-26T10:24:31.604975+0000","last_active":"2024-04-26T10:24:33.175157+0000","last_peered":"2024-04-26T10:24:33.175157+0000","last_clean":"2024-04-26T10:24:33.175157+0000","last_became_active":"2024-04-26T10:24:31.604609+0000","last_became_peered":"2024-04-26T10:24:31.604609+0000","last_unstale":"2024-04-26T10:24:33.175157+0000","last_undegraded":"2024-04-26T10:24:33.175157+0000","last_fullsized":"2024-04-26T10:24:33.175157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:30:04.412544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":132,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175190+0000","last_change":"2024-04-26T10:24:31.622111+0000","last_active":"2024-04-26T10:24:33.175190+0000","last_peered":"2024-04-26T10:24:33.175190+0000","last_clean":"2024-04-26T10:24:33.175190+0000","last_became_active":"2024-04-26T10:24:31.604884+0000","last_became_peered":"2024-04-26T10:24:31.604884+0000","last_unstale":"2024-04-26T10:24:33.175190+0000","last_undegraded":"2024-04-26T10:24:33.175190+0000","last_fullsized":"2024-04-26T10:24:33.175190+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:14:18.600081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317264+0000","last_change":"2024-04-26T10:24:31.739955+0000","last_active":"2024-04-26T10:24:33.317264+0000","last_peered":"2024-04-26T10:24:33.317264+0000","last_clean":"2024-04-26T10:24:33.317264+0000","last_became_active":"2024-04-26T10:24:31.739550+0000","last_became_peered":"2024-04-26T10:24:31.739550+0000","last_unstale":"2024-04-26T10:24:33.317264+0000","last_undegraded":"2024-04-26T10:24:33.317264+0000","last_fullsized":"2024-04-26T10:24:33.317264+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:31.253486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974245+0000","last_change":"2024-04-26T10:24:31.609788+0000","last_active":"2024-04-26T10:24:33.974245+0000","last_peered":"2024-04-26T10:24:33.974245+0000","last_clean":"2024-04-26T10:24:33.974245+0000","last_became_active":"2024-04-26T10:24:31.601218+0000","last_became_peered":"2024-04-26T10:24:31.601218+0000","last_unstale":"2024-04-26T10:24:33.974245+0000","last_undegraded":"2024-04-26T10:24:33.974245+0000","last_fullsized":"2024-04-26T10:24:33.974245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:39.380483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":93,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175533+0000","last_change":"2024-04-26T10:24:22.546807+0000","last_active":"2024-04-26T10:24:33.175533+0000","last_peered":"2024-04-26T10:24:33.175533+0000","last_clean":"2024-04-26T10:24:33.175533+0000","last_became_active":"2024-04-26T10:24:22.546378+0000","last_became_peered":"2024-04-26T10:24:22.546378+0000","last_unstale":"2024-04-26T10:24:33.175533+0000","last_undegraded":"2024-04-26T10:24:33.175533+0000","last_fullsized":"2024-04-26T10:24:33.175533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:33:06.866157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317068+0000","last_change":"2024-04-26T10:24:22.684096+0000","last_active":"2024-04-26T10:24:33.317068+0000","last_peered":"2024-04-26T10:24:33.317068+0000","last_clean":"2024-04-26T10:24:33.317068+0000","last_became_active":"2024-04-26T10:24:22.683558+0000","last_became_peered":"2024-04-26T10:24:22.683558+0000","last_unstale":"2024-04-26T10:24:33.317068+0000","last_undegraded":"2024-04-26T10:24:33.317068+0000","last_fullsized":"2024-04-26T10:24:33.317068+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:05.316682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318841+0000","last_change":"2024-04-26T10:24:22.684541+0000","last_active":"2024-04-26T10:24:33.318841+0000","last_peered":"2024-04-26T10:24:33.318841+0000","last_clean":"2024-04-26T10:24:33.318841+0000","last_became_active":"2024-04-26T10:24:22.684166+0000","last_became_peered":"2024-04-26T10:24:22.684166+0000","last_unstale":"2024-04-26T10:24:33.318841+0000","last_undegraded":"2024-04-26T10:24:33.318841+0000","last_fullsized":"2024-04-26T10:24:33.318841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:30.164642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317049+0000","last_change":"2024-04-26T10:24:31.745539+0000","last_active":"2024-04-26T10:24:33.317049+0000","last_peered":"2024-04-26T10:24:33.317049+0000","last_clean":"2024-04-26T10:24:33.317049+0000","last_became_active":"2024-04-26T10:24:31.745216+0000","last_became_peered":"2024-04-26T10:24:31.745216+0000","last_unstale":"2024-04-26T10:24:33.317049+0000","last_undegraded":"2024-04-26T10:24:33.317049+0000","last_fullsized":"2024-04-26T10:24:33.317049+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:55.390023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183305+0000","last_change":"2024-04-26T10:22:09.750605+0000","last_active":"2024-04-26T10:24:33.183305+0000","last_peered":"2024-04-26T10:24:33.183305+0000","last_clean":"2024-04-26T10:24:33.183305+0000","last_became_active":"2024-04-26T10:22:09.750359+0000","last_became_peered":"2024-04-26T10:22:09.750359+0000","last_unstale":"2024-04-26T10:24:33.183305+0000","last_undegraded":"2024-04-26T10:24:33.183305+0000","last_fullsized":"2024-04-26T10:24:33.183305+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:56.948741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316663+0000","last_change":"2024-04-26T10:24:31.740907+0000","last_active":"2024-04-26T10:24:33.316663+0000","last_peered":"2024-04-26T10:24:33.316663+0000","last_clean":"2024-04-26T10:24:33.316663+0000","last_became_active":"2024-04-26T10:24:31.740477+0000","last_became_peered":"2024-04-26T10:24:31.740477+0000","last_unstale":"2024-04-26T10:24:33.316663+0000","last_undegraded":"2024-04-26T10:24:33.316663+0000","last_fullsized":"2024-04-26T10:24:33.316663+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:30.206347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318888+0000","last_change":"2024-04-26T10:24:22.684108+0000","last_active":"2024-04-26T10:24:33.318888+0000","last_peered":"2024-04-26T10:24:33.318888+0000","last_clean":"2024-04-26T10:24:33.318888+0000","last_became_active":"2024-04-26T10:24:22.683501+0000","last_became_peered":"2024-04-26T10:24:22.683501+0000","last_unstale":"2024-04-26T10:24:33.318888+0000","last_undegraded":"2024-04-26T10:24:33.318888+0000","last_fullsized":"2024-04-26T10:24:33.318888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:17.355758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316745+0000","last_change":"2024-04-26T10:24:22.685228+0000","last_active":"2024-04-26T10:24:33.316745+0000","last_peered":"2024-04-26T10:24:33.316745+0000","last_clean":"2024-04-26T10:24:33.316745+0000","last_became_active":"2024-04-26T10:24:22.684469+0000","last_became_peered":"2024-04-26T10:24:22.684469+0000","last_unstale":"2024-04-26T10:24:33.316745+0000","last_undegraded":"2024-04-26T10:24:33.316745+0000","last_fullsized":"2024-04-26T10:24:33.316745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:53.834583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182003+0000","last_change":"2024-04-26T10:22:09.753136+0000","last_active":"2024-04-26T10:24:33.182003+0000","last_peered":"2024-04-26T10:24:33.182003+0000","last_clean":"2024-04-26T10:24:33.182003+0000","last_became_active":"2024-04-26T10:22:09.752856+0000","last_became_peered":"2024-04-26T10:22:09.752856+0000","last_unstale":"2024-04-26T10:24:33.182003+0000","last_undegraded":"2024-04-26T10:24:33.182003+0000","last_fullsized":"2024-04-26T10:24:33.182003+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:48.541930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":88,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181723+0000","last_change":"2024-04-26T10:24:22.535413+0000","last_active":"2024-04-26T10:24:33.181723+0000","last_peered":"2024-04-26T10:24:33.181723+0000","last_clean":"2024-04-26T10:24:33.181723+0000","last_became_active":"2024-04-26T10:24:22.535036+0000","last_became_peered":"2024-04-26T10:24:22.535036+0000","last_unstale":"2024-04-26T10:24:33.181723+0000","last_undegraded":"2024-04-26T10:24:33.181723+0000","last_fullsized":"2024-04-26T10:24:33.181723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:43.756504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183058+0000","last_change":"2024-04-26T10:24:22.535819+0000","last_active":"2024-04-26T10:24:33.183058+0000","last_peered":"2024-04-26T10:24:33.183058+0000","last_clean":"2024-04-26T10:24:33.183058+0000","last_became_active":"2024-04-26T10:24:22.535562+0000","last_became_peered":"2024-04-26T10:24:22.535562+0000","last_unstale":"2024-04-26T10:24:33.183058+0000","last_undegraded":"2024-04-26T10:24:33.183058+0000","last_fullsized":"2024-04-26T10:24:33.183058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:24.845621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974051+0000","last_change":"2024-04-26T10:24:31.600594+0000","last_active":"2024-04-26T10:24:33.974051+0000","last_peered":"2024-04-26T10:24:33.974051+0000","last_clean":"2024-04-26T10:24:33.974051+0000","last_became_active":"2024-04-26T10:24:31.600121+0000","last_became_peered":"2024-04-26T10:24:31.600121+0000","last_unstale":"2024-04-26T10:24:33.974051+0000","last_undegraded":"2024-04-26T10:24:33.974051+0000","last_fullsized":"2024-04-26T10:24:33.974051+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:05.491069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175273+0000","last_change":"2024-04-26T10:24:22.542755+0000","last_active":"2024-04-26T10:24:33.175273+0000","last_peered":"2024-04-26T10:24:33.175273+0000","last_clean":"2024-04-26T10:24:33.175273+0000","last_became_active":"2024-04-26T10:24:22.541543+0000","last_became_peered":"2024-04-26T10:24:22.541543+0000","last_unstale":"2024-04-26T10:24:33.175273+0000","last_undegraded":"2024-04-26T10:24:33.175273+0000","last_fullsized":"2024-04-26T10:24:33.175273+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:50.942528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.175459+0000","last_change":"2024-04-26T10:24:22.541418+0000","last_active":"2024-04-26T10:24:33.175459+0000","last_peered":"2024-04-26T10:24:33.175459+0000","last_clean":"2024-04-26T10:24:33.175459+0000","last_became_active":"2024-04-26T10:24:22.540767+0000","last_became_peered":"2024-04-26T10:24:22.540767+0000","last_unstale":"2024-04-26T10:24:33.175459+0000","last_undegraded":"2024-04-26T10:24:33.175459+0000","last_fullsized":"2024-04-26T10:24:33.175459+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:26.684306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.174534+0000","last_change":"2024-04-26T10:24:22.547294+0000","last_active":"2024-04-26T10:24:33.174534+0000","last_peered":"2024-04-26T10:24:33.174534+0000","last_clean":"2024-04-26T10:24:33.174534+0000","last_became_active":"2024-04-26T10:24:22.546811+0000","last_became_peered":"2024-04-26T10:24:22.546811+0000","last_unstale":"2024-04-26T10:24:33.174534+0000","last_undegraded":"2024-04-26T10:24:33.174534+0000","last_fullsized":"2024-04-26T10:24:33.174534+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:30:03.037283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182738+0000","last_change":"2024-04-26T10:22:09.753438+0000","last_active":"2024-04-26T10:24:33.182738+0000","last_peered":"2024-04-26T10:24:33.182738+0000","last_clean":"2024-04-26T10:24:33.182738+0000","last_became_active":"2024-04-26T10:22:09.753211+0000","last_became_peered":"2024-04-26T10:22:09.753211+0000","last_unstale":"2024-04-26T10:24:33.182738+0000","last_undegraded":"2024-04-26T10:24:33.182738+0000","last_fullsized":"2024-04-26T10:24:33.182738+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:39.406859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973960+0000","last_change":"2024-04-26T10:24:31.600935+0000","last_active":"2024-04-26T10:24:33.973960+0000","last_peered":"2024-04-26T10:24:33.973960+0000","last_clean":"2024-04-26T10:24:33.973960+0000","last_became_active":"2024-04-26T10:24:31.600088+0000","last_became_peered":"2024-04-26T10:24:31.600088+0000","last_unstale":"2024-04-26T10:24:33.973960+0000","last_undegraded":"2024-04-26T10:24:33.973960+0000","last_fullsized":"2024-04-26T10:24:33.973960+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:58.341684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319737+0000","last_change":"2024-04-26T10:24:22.680082+0000","last_active":"2024-04-26T10:24:33.319737+0000","last_peered":"2024-04-26T10:24:33.319737+0000","last_clean":"2024-04-26T10:24:33.319737+0000","last_became_active":"2024-04-26T10:24:22.679652+0000","last_became_peered":"2024-04-26T10:24:22.679652+0000","last_unstale":"2024-04-26T10:24:33.319737+0000","last_undegraded":"2024-04-26T10:24:33.319737+0000","last_fullsized":"2024-04-26T10:24:33.319737+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:37.821623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":92,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.173304+0000","last_change":"2024-04-26T10:24:22.540326+0000","last_active":"2024-04-26T10:24:33.173304+0000","last_peered":"2024-04-26T10:24:33.173304+0000","last_clean":"2024-04-26T10:24:33.173304+0000","last_became_active":"2024-04-26T10:24:22.538895+0000","last_became_peered":"2024-04-26T10:24:22.538895+0000","last_unstale":"2024-04-26T10:24:33.173304+0000","last_undegraded":"2024-04-26T10:24:33.173304+0000","last_fullsized":"2024-04-26T10:24:33.173304+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:29.709972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319358+0000","last_change":"2024-04-26T10:24:22.685454+0000","last_active":"2024-04-26T10:24:33.319358+0000","last_peered":"2024-04-26T10:24:33.319358+0000","last_clean":"2024-04-26T10:24:33.319358+0000","last_became_active":"2024-04-26T10:24:22.684863+0000","last_became_peered":"2024-04-26T10:24:22.684863+0000","last_unstale":"2024-04-26T10:24:33.319358+0000","last_undegraded":"2024-04-26T10:24:33.319358+0000","last_fullsized":"2024-04-26T10:24:33.319358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:33.027447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":21541,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673009,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279076,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":278014,"kb_avail":94092764,"statfs":{"total":96636764160,"available":96350990336,"internally_reserved":0,"allocated":1064960,"data_stored":1035671,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":284686790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:24:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55000000000000004,"15min":0.51600000000000001},"min":{"1min":0.25800000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.67500000000000004,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.53900000000000003},"min":{"1min":0.28000000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.754,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.68000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":0,"up_from":10,"seq":42949673008,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487484,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":486398,"kb_avail":93884356,"statfs":{"total":96636764160,"available":96137580544,"internally_reserved":0,"allocated":1089536,"data_stored":1036287,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":498072006},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:24:04 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.65600000000000003,"15min":0.56599999999999995},"min":{"1min":0.21099999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":4.1369999999999996,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.25900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.748,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":2,"up_from":80,"seq":343597383685,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38380,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":37369,"kb_avail":94333460,"statfs":{"total":96636764160,"available":96597463040,"internally_reserved":0,"allocated":1007616,"data_stored":444173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6879,"internal_metadata":38266145},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:24:41.811 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:24:42.156 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:24:42.156 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":91,"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","created":"2024-04-26T10:20:48.363934+0000","modified":"2024-04-26T10:24:34.168633+0000","last_up_change":"2024-04-26T10:24:21.506586+0000","last_in_change":"2024-04-26T10:20:49.575442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:20:59.994755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:21:03.866927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:21:07.853429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:21:08.285131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5e76c47-dfc4-40ca-88d3-2084cac6e35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":18193},{"type":"v1","addr":"172.21.15.120:6801","nonce":18193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":18193},{"type":"v1","addr":"172.21.15.120:6803","nonce":18193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":18193},{"type":"v1","addr":"172.21.15.120:6807","nonce":18193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":18193},{"type":"v1","addr":"172.21.15.120:6805","nonce":18193}]},"public_addr":"172.21.15.120:6801/18193","cluster_addr":"172.21.15.120:6803/18193","heartbeat_back_addr":"172.21.15.120:6807/18193","heartbeat_front_addr":"172.21.15.120:6805/18193","state":["exists","up"]},{"osd":1,"uuid":"2a8d530c-cf33-4540-9240-6bd7485e06ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":18226},{"type":"v1","addr":"172.21.15.154:6801","nonce":18226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":18226},{"type":"v1","addr":"172.21.15.154:6803","nonce":18226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":18226},{"type":"v1","addr":"172.21.15.154:6807","nonce":18226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":18226},{"type":"v1","addr":"172.21.15.154:6805","nonce":18226}]},"public_addr":"172.21.15.154:6801/18226","cluster_addr":"172.21.15.154:6803/18226","heartbeat_back_addr":"172.21.15.154:6807/18226","heartbeat_front_addr":"172.21.15.154:6805/18226","state":["exists","up"]},{"osd":2,"uuid":"484ab70f-4cad-4ff6-9405-8865ec5ee327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":28,"up_from":80,"up_thru":87,"down_at":29,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":1327},{"type":"v1","addr":"172.21.15.164:6801","nonce":1327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1327},{"type":"v1","addr":"172.21.15.164:6803","nonce":1327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":1327},{"type":"v1","addr":"172.21.15.164:6807","nonce":1327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":1327},{"type":"v1","addr":"172.21.15.164:6805","nonce":1327}]},"public_addr":"172.21.15.164:6801/1327","cluster_addr":"172.21.15.164:6803/1327","heartbeat_back_addr":"172.21.15.164:6807/1327","heartbeat_front_addr":"172.21.15.164:6805/1327","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.871567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.910527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.761919+0000","dead_epoch":28}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:24:43.178 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T10:24:43.178 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T10:24:43.346 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-26T10:24:43.346 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T10:24:43.346 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-26T10:24:43.362 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T10:24:43.678 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T10:24:43.688 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T10:24:43.689 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T10:24:43.837 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-26T10:24:43.838 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T10:24:43.838 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-26T10:24:43.851 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T10:24:44.165 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T10:24:44.176 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T10:24:44.176 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T10:24:44.334 INFO:teuthology.orchestra.run.smithi052.stdout:{ 2024-04-26T10:24:44.334 INFO:teuthology.orchestra.run.smithi052.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-26T10:24:44.334 INFO:teuthology.orchestra.run.smithi052.stdout:} 2024-04-26T10:24:44.348 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T10:24:44.662 INFO:teuthology.orchestra.run.smithi052.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T10:24:44.672 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:24:44.979 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:24:44.981 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:24:44.994 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2024-04-26T10:24:44.043815+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1184088,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":804940,"kb_used_data":3088,"kb_used_omap":9,"kb_used_meta":801782,"kb_avail":282310580,"statfs":{"total":289910292480,"available":289086033920,"internally_reserved":0,"allocated":3162112,"data_stored":2516131,"data_compressed":14075,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":10067,"internal_metadata":821024941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003320"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974365+0000","last_change":"2024-04-26T10:24:31.598789+0000","last_active":"2024-04-26T10:24:33.974365+0000","last_peered":"2024-04-26T10:24:33.974365+0000","last_clean":"2024-04-26T10:24:33.974365+0000","last_became_active":"2024-04-26T10:24:31.598170+0000","last_became_peered":"2024-04-26T10:24:31.598170+0000","last_unstale":"2024-04-26T10:24:33.974365+0000","last_undegraded":"2024-04-26T10:24:33.974365+0000","last_fullsized":"2024-04-26T10:24:33.974365+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:46.718423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182259+0000","last_change":"2024-04-26T10:24:22.536264+0000","last_active":"2024-04-26T10:24:33.182259+0000","last_peered":"2024-04-26T10:24:33.182259+0000","last_clean":"2024-04-26T10:24:33.182259+0000","last_became_active":"2024-04-26T10:24:22.535998+0000","last_became_peered":"2024-04-26T10:24:22.535998+0000","last_unstale":"2024-04-26T10:24:33.182259+0000","last_undegraded":"2024-04-26T10:24:33.182259+0000","last_fullsized":"2024-04-26T10:24:33.182259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:54.491369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":80,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181302+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:24:34.181302+0000","last_peered":"2024-04-26T10:24:34.181302+0000","last_clean":"2024-04-26T10:24:34.181302+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:24:34.181302+0000","last_undegraded":"2024-04-26T10:24:34.181302+0000","last_fullsized":"2024-04-26T10:24:34.181302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181065+0000","last_change":"2024-04-26T10:24:22.549067+0000","last_active":"2024-04-26T10:24:34.181065+0000","last_peered":"2024-04-26T10:24:34.181065+0000","last_clean":"2024-04-26T10:24:34.181065+0000","last_became_active":"2024-04-26T10:24:22.548485+0000","last_became_peered":"2024-04-26T10:24:22.548485+0000","last_unstale":"2024-04-26T10:24:34.181065+0000","last_undegraded":"2024-04-26T10:24:34.181065+0000","last_fullsized":"2024-04-26T10:24:34.181065+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974073+0000","last_change":"2024-04-26T10:24:31.601925+0000","last_active":"2024-04-26T10:24:33.974073+0000","last_peered":"2024-04-26T10:24:33.974073+0000","last_clean":"2024-04-26T10:24:33.974073+0000","last_became_active":"2024-04-26T10:24:31.600986+0000","last_became_peered":"2024-04-26T10:24:31.600986+0000","last_unstale":"2024-04-26T10:24:33.974073+0000","last_undegraded":"2024-04-26T10:24:33.974073+0000","last_fullsized":"2024-04-26T10:24:33.974073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:23:52.125249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179285+0000","last_change":"2024-04-26T10:24:22.548245+0000","last_active":"2024-04-26T10:24:34.179285+0000","last_peered":"2024-04-26T10:24:34.179285+0000","last_clean":"2024-04-26T10:24:34.179285+0000","last_became_active":"2024-04-26T10:24:22.547731+0000","last_became_peered":"2024-04-26T10:24:22.547731+0000","last_unstale":"2024-04-26T10:24:34.179285+0000","last_undegraded":"2024-04-26T10:24:34.179285+0000","last_fullsized":"2024-04-26T10:24:34.179285+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179085+0000","last_change":"2024-04-26T10:24:22.549424+0000","last_active":"2024-04-26T10:24:34.179085+0000","last_peered":"2024-04-26T10:24:34.179085+0000","last_clean":"2024-04-26T10:24:34.179085+0000","last_became_active":"2024-04-26T10:24:22.549180+0000","last_became_peered":"2024-04-26T10:24:22.549180+0000","last_unstale":"2024-04-26T10:24:34.179085+0000","last_undegraded":"2024-04-26T10:24:34.179085+0000","last_fullsized":"2024-04-26T10:24:34.179085+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180250+0000","last_change":"2024-04-26T10:24:22.547840+0000","last_active":"2024-04-26T10:24:34.180250+0000","last_peered":"2024-04-26T10:24:34.180250+0000","last_clean":"2024-04-26T10:24:34.180250+0000","last_became_active":"2024-04-26T10:24:22.547284+0000","last_became_peered":"2024-04-26T10:24:22.547284+0000","last_unstale":"2024-04-26T10:24:34.180250+0000","last_undegraded":"2024-04-26T10:24:34.180250+0000","last_fullsized":"2024-04-26T10:24:34.180250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318637+0000","last_change":"2024-04-26T10:24:22.680232+0000","last_active":"2024-04-26T10:24:33.318637+0000","last_peered":"2024-04-26T10:24:33.318637+0000","last_clean":"2024-04-26T10:24:33.318637+0000","last_became_active":"2024-04-26T10:24:22.679648+0000","last_became_peered":"2024-04-26T10:24:22.679648+0000","last_unstale":"2024-04-26T10:24:33.318637+0000","last_undegraded":"2024-04-26T10:24:33.318637+0000","last_fullsized":"2024-04-26T10:24:33.318637+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:04:58.174215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974286+0000","last_change":"2024-04-26T10:24:31.599182+0000","last_active":"2024-04-26T10:24:33.974286+0000","last_peered":"2024-04-26T10:24:33.974286+0000","last_clean":"2024-04-26T10:24:33.974286+0000","last_became_active":"2024-04-26T10:24:31.598187+0000","last_became_peered":"2024-04-26T10:24:31.598187+0000","last_unstale":"2024-04-26T10:24:33.974286+0000","last_undegraded":"2024-04-26T10:24:33.974286+0000","last_fullsized":"2024-04-26T10:24:33.974286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:33:24.255353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181251+0000","last_change":"2024-04-26T10:24:22.547601+0000","last_active":"2024-04-26T10:24:34.181251+0000","last_peered":"2024-04-26T10:24:34.181251+0000","last_clean":"2024-04-26T10:24:34.181251+0000","last_became_active":"2024-04-26T10:24:22.546506+0000","last_became_peered":"2024-04-26T10:24:22.546506+0000","last_unstale":"2024-04-26T10:24:34.181251+0000","last_undegraded":"2024-04-26T10:24:34.181251+0000","last_fullsized":"2024-04-26T10:24:34.181251+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182904+0000","last_change":"2024-04-26T10:22:09.748232+0000","last_active":"2024-04-26T10:24:33.182904+0000","last_peered":"2024-04-26T10:24:33.182904+0000","last_clean":"2024-04-26T10:24:33.182904+0000","last_became_active":"2024-04-26T10:22:09.747822+0000","last_became_peered":"2024-04-26T10:22:09.747822+0000","last_unstale":"2024-04-26T10:24:33.182904+0000","last_undegraded":"2024-04-26T10:24:33.182904+0000","last_fullsized":"2024-04-26T10:24:33.182904+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:24:58.223031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974030+0000","last_change":"2024-04-26T10:24:31.598330+0000","last_active":"2024-04-26T10:24:33.974030+0000","last_peered":"2024-04-26T10:24:33.974030+0000","last_clean":"2024-04-26T10:24:33.974030+0000","last_became_active":"2024-04-26T10:24:31.597980+0000","last_became_peered":"2024-04-26T10:24:31.597980+0000","last_unstale":"2024-04-26T10:24:33.974030+0000","last_undegraded":"2024-04-26T10:24:33.974030+0000","last_fullsized":"2024-04-26T10:24:33.974030+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:28:38.711968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179409+0000","last_change":"2024-04-26T10:24:31.602827+0000","last_active":"2024-04-26T10:24:34.179409+0000","last_peered":"2024-04-26T10:24:34.179409+0000","last_clean":"2024-04-26T10:24:34.179409+0000","last_became_active":"2024-04-26T10:24:31.602539+0000","last_became_peered":"2024-04-26T10:24:31.602539+0000","last_unstale":"2024-04-26T10:24:34.179409+0000","last_undegraded":"2024-04-26T10:24:34.179409+0000","last_fullsized":"2024-04-26T10:24:34.179409+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.178921+0000","last_change":"2024-04-26T10:24:31.602863+0000","last_active":"2024-04-26T10:24:34.178921+0000","last_peered":"2024-04-26T10:24:34.178921+0000","last_clean":"2024-04-26T10:24:34.178921+0000","last_became_active":"2024-04-26T10:24:31.602453+0000","last_became_peered":"2024-04-26T10:24:31.602453+0000","last_unstale":"2024-04-26T10:24:34.178921+0000","last_undegraded":"2024-04-26T10:24:34.178921+0000","last_fullsized":"2024-04-26T10:24:34.178921+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179940+0000","last_change":"2024-04-26T10:24:22.547543+0000","last_active":"2024-04-26T10:24:34.179940+0000","last_peered":"2024-04-26T10:24:34.179940+0000","last_clean":"2024-04-26T10:24:34.179940+0000","last_became_active":"2024-04-26T10:24:22.546856+0000","last_became_peered":"2024-04-26T10:24:22.546856+0000","last_unstale":"2024-04-26T10:24:34.179940+0000","last_undegraded":"2024-04-26T10:24:34.179940+0000","last_fullsized":"2024-04-26T10:24:34.179940+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318406+0000","last_change":"2024-04-26T10:24:22.679885+0000","last_active":"2024-04-26T10:24:33.318406+0000","last_peered":"2024-04-26T10:24:33.318406+0000","last_clean":"2024-04-26T10:24:33.318406+0000","last_became_active":"2024-04-26T10:24:22.679350+0000","last_became_peered":"2024-04-26T10:24:22.679350+0000","last_unstale":"2024-04-26T10:24:33.318406+0000","last_undegraded":"2024-04-26T10:24:33.318406+0000","last_fullsized":"2024-04-26T10:24:33.318406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:27:06.039983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974316+0000","last_change":"2024-04-26T10:24:31.598857+0000","last_active":"2024-04-26T10:24:33.974316+0000","last_peered":"2024-04-26T10:24:33.974316+0000","last_clean":"2024-04-26T10:24:33.974316+0000","last_became_active":"2024-04-26T10:24:31.597563+0000","last_became_peered":"2024-04-26T10:24:31.597563+0000","last_unstale":"2024-04-26T10:24:33.974316+0000","last_undegraded":"2024-04-26T10:24:33.974316+0000","last_fullsized":"2024-04-26T10:24:33.974316+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:22:26.624180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317832+0000","last_change":"2024-04-26T10:24:22.679291+0000","last_active":"2024-04-26T10:24:33.317832+0000","last_peered":"2024-04-26T10:24:33.317832+0000","last_clean":"2024-04-26T10:24:33.317832+0000","last_became_active":"2024-04-26T10:24:22.678912+0000","last_became_peered":"2024-04-26T10:24:22.678912+0000","last_unstale":"2024-04-26T10:24:33.317832+0000","last_undegraded":"2024-04-26T10:24:33.317832+0000","last_fullsized":"2024-04-26T10:24:33.317832+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:49.260130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181006+0000","last_change":"2024-04-26T10:24:22.546669+0000","last_active":"2024-04-26T10:24:34.181006+0000","last_peered":"2024-04-26T10:24:34.181006+0000","last_clean":"2024-04-26T10:24:34.181006+0000","last_became_active":"2024-04-26T10:24:22.546052+0000","last_became_peered":"2024-04-26T10:24:22.546052+0000","last_unstale":"2024-04-26T10:24:34.181006+0000","last_undegraded":"2024-04-26T10:24:34.181006+0000","last_fullsized":"2024-04-26T10:24:34.181006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179889+0000","last_change":"2024-04-26T10:24:22.547981+0000","last_active":"2024-04-26T10:24:34.179889+0000","last_peered":"2024-04-26T10:24:34.179889+0000","last_clean":"2024-04-26T10:24:34.179889+0000","last_became_active":"2024-04-26T10:24:22.547663+0000","last_became_peered":"2024-04-26T10:24:22.547663+0000","last_unstale":"2024-04-26T10:24:34.179889+0000","last_undegraded":"2024-04-26T10:24:34.179889+0000","last_fullsized":"2024-04-26T10:24:34.179889+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181281+0000","last_change":"2024-04-26T10:22:09.749283+0000","last_active":"2024-04-26T10:24:33.181281+0000","last_peered":"2024-04-26T10:24:33.181281+0000","last_clean":"2024-04-26T10:24:33.181281+0000","last_became_active":"2024-04-26T10:22:09.748755+0000","last_became_peered":"2024-04-26T10:22:09.748755+0000","last_unstale":"2024-04-26T10:24:33.181281+0000","last_undegraded":"2024-04-26T10:24:33.181281+0000","last_fullsized":"2024-04-26T10:24:33.181281+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:05:40.910715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317029+0000","last_change":"2024-04-26T10:24:22.684668+0000","last_active":"2024-04-26T10:24:33.317029+0000","last_peered":"2024-04-26T10:24:33.317029+0000","last_clean":"2024-04-26T10:24:33.317029+0000","last_became_active":"2024-04-26T10:24:22.683921+0000","last_became_peered":"2024-04-26T10:24:22.683921+0000","last_unstale":"2024-04-26T10:24:33.317029+0000","last_undegraded":"2024-04-26T10:24:33.317029+0000","last_fullsized":"2024-04-26T10:24:33.317029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:21:25.930781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182162+0000","last_change":"2024-04-26T10:24:22.535052+0000","last_active":"2024-04-26T10:24:33.182162+0000","last_peered":"2024-04-26T10:24:33.182162+0000","last_clean":"2024-04-26T10:24:33.182162+0000","last_became_active":"2024-04-26T10:24:22.534674+0000","last_became_peered":"2024-04-26T10:24:22.534674+0000","last_unstale":"2024-04-26T10:24:33.182162+0000","last_undegraded":"2024-04-26T10:24:33.182162+0000","last_fullsized":"2024-04-26T10:24:33.182162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:05:10.969425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974384+0000","last_change":"2024-04-26T10:24:31.601262+0000","last_active":"2024-04-26T10:24:33.974384+0000","last_peered":"2024-04-26T10:24:33.974384+0000","last_clean":"2024-04-26T10:24:33.974384+0000","last_became_active":"2024-04-26T10:24:31.600815+0000","last_became_peered":"2024-04-26T10:24:31.600815+0000","last_unstale":"2024-04-26T10:24:33.974384+0000","last_undegraded":"2024-04-26T10:24:33.974384+0000","last_fullsized":"2024-04-26T10:24:33.974384+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:02.552727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319258+0000","last_change":"2024-04-26T10:24:22.684739+0000","last_active":"2024-04-26T10:24:33.319258+0000","last_peered":"2024-04-26T10:24:33.319258+0000","last_clean":"2024-04-26T10:24:33.319258+0000","last_became_active":"2024-04-26T10:24:22.683959+0000","last_became_peered":"2024-04-26T10:24:22.683959+0000","last_unstale":"2024-04-26T10:24:33.319258+0000","last_undegraded":"2024-04-26T10:24:33.319258+0000","last_fullsized":"2024-04-26T10:24:33.319258+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:21:07.840236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":80,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181105+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:24:34.181105+0000","last_peered":"2024-04-26T10:24:34.181105+0000","last_clean":"2024-04-26T10:24:34.181105+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:24:34.181105+0000","last_undegraded":"2024-04-26T10:24:34.181105+0000","last_fullsized":"2024-04-26T10:24:34.181105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974137+0000","last_change":"2024-04-26T10:24:31.602078+0000","last_active":"2024-04-26T10:24:33.974137+0000","last_peered":"2024-04-26T10:24:33.974137+0000","last_clean":"2024-04-26T10:24:33.974137+0000","last_became_active":"2024-04-26T10:24:31.601299+0000","last_became_peered":"2024-04-26T10:24:31.601299+0000","last_unstale":"2024-04-26T10:24:33.974137+0000","last_undegraded":"2024-04-26T10:24:33.974137+0000","last_fullsized":"2024-04-26T10:24:33.974137+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:14:43.374493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317271+0000","last_change":"2024-04-26T10:24:31.741152+0000","last_active":"2024-04-26T10:24:33.317271+0000","last_peered":"2024-04-26T10:24:33.317271+0000","last_clean":"2024-04-26T10:24:33.317271+0000","last_became_active":"2024-04-26T10:24:31.740626+0000","last_became_peered":"2024-04-26T10:24:31.740626+0000","last_unstale":"2024-04-26T10:24:33.317271+0000","last_undegraded":"2024-04-26T10:24:33.317271+0000","last_fullsized":"2024-04-26T10:24:33.317271+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:18:23.323149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181503+0000","last_change":"2024-04-26T10:22:09.750562+0000","last_active":"2024-04-26T10:24:33.181503+0000","last_peered":"2024-04-26T10:24:33.181503+0000","last_clean":"2024-04-26T10:24:33.181503+0000","last_became_active":"2024-04-26T10:22:09.750286+0000","last_became_peered":"2024-04-26T10:22:09.750286+0000","last_unstale":"2024-04-26T10:24:33.181503+0000","last_undegraded":"2024-04-26T10:24:33.181503+0000","last_fullsized":"2024-04-26T10:24:33.181503+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:43:52.795517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317979+0000","last_change":"2024-04-26T10:24:31.741008+0000","last_active":"2024-04-26T10:24:33.317979+0000","last_peered":"2024-04-26T10:24:33.317979+0000","last_clean":"2024-04-26T10:24:33.317979+0000","last_became_active":"2024-04-26T10:24:31.740518+0000","last_became_peered":"2024-04-26T10:24:31.740518+0000","last_unstale":"2024-04-26T10:24:33.317979+0000","last_undegraded":"2024-04-26T10:24:33.317979+0000","last_fullsized":"2024-04-26T10:24:33.317979+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:11:59.904869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179847+0000","last_change":"2024-04-26T10:24:22.540161+0000","last_active":"2024-04-26T10:24:34.179847+0000","last_peered":"2024-04-26T10:24:34.179847+0000","last_clean":"2024-04-26T10:24:34.179847+0000","last_became_active":"2024-04-26T10:24:22.539106+0000","last_became_peered":"2024-04-26T10:24:22.539106+0000","last_unstale":"2024-04-26T10:24:34.179847+0000","last_undegraded":"2024-04-26T10:24:34.179847+0000","last_fullsized":"2024-04-26T10:24:34.179847+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974115+0000","last_change":"2024-04-26T10:24:31.599487+0000","last_active":"2024-04-26T10:24:33.974115+0000","last_peered":"2024-04-26T10:24:33.974115+0000","last_clean":"2024-04-26T10:24:33.974115+0000","last_became_active":"2024-04-26T10:24:31.598307+0000","last_became_peered":"2024-04-26T10:24:31.598307+0000","last_unstale":"2024-04-26T10:24:33.974115+0000","last_undegraded":"2024-04-26T10:24:33.974115+0000","last_fullsized":"2024-04-26T10:24:33.974115+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:11.881961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179856+0000","last_change":"2024-04-26T10:24:22.547974+0000","last_active":"2024-04-26T10:24:34.179856+0000","last_peered":"2024-04-26T10:24:34.179856+0000","last_clean":"2024-04-26T10:24:34.179856+0000","last_became_active":"2024-04-26T10:24:22.546794+0000","last_became_peered":"2024-04-26T10:24:22.546794+0000","last_unstale":"2024-04-26T10:24:34.179856+0000","last_undegraded":"2024-04-26T10:24:34.179856+0000","last_fullsized":"2024-04-26T10:24:34.179856+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974196+0000","last_change":"2024-04-26T10:24:31.597848+0000","last_active":"2024-04-26T10:24:33.974196+0000","last_peered":"2024-04-26T10:24:33.974196+0000","last_clean":"2024-04-26T10:24:33.974196+0000","last_became_active":"2024-04-26T10:24:31.596297+0000","last_became_peered":"2024-04-26T10:24:31.596297+0000","last_unstale":"2024-04-26T10:24:33.974196+0000","last_undegraded":"2024-04-26T10:24:33.974196+0000","last_fullsized":"2024-04-26T10:24:33.974196+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:41:09.585450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317333+0000","last_change":"2024-04-26T10:24:22.684913+0000","last_active":"2024-04-26T10:24:33.317333+0000","last_peered":"2024-04-26T10:24:33.317333+0000","last_clean":"2024-04-26T10:24:33.317333+0000","last_became_active":"2024-04-26T10:24:22.684541+0000","last_became_peered":"2024-04-26T10:24:22.684541+0000","last_unstale":"2024-04-26T10:24:33.317333+0000","last_undegraded":"2024-04-26T10:24:33.317333+0000","last_fullsized":"2024-04-26T10:24:33.317333+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:06:32.802131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318520+0000","last_change":"2024-04-26T10:24:22.683787+0000","last_active":"2024-04-26T10:24:33.318520+0000","last_peered":"2024-04-26T10:24:33.318520+0000","last_clean":"2024-04-26T10:24:33.318520+0000","last_became_active":"2024-04-26T10:24:22.682650+0000","last_became_peered":"2024-04-26T10:24:22.682650+0000","last_unstale":"2024-04-26T10:24:33.318520+0000","last_undegraded":"2024-04-26T10:24:33.318520+0000","last_fullsized":"2024-04-26T10:24:33.318520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:41:29.301512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973911+0000","last_change":"2024-04-26T10:24:31.601959+0000","last_active":"2024-04-26T10:24:33.973911+0000","last_peered":"2024-04-26T10:24:33.973911+0000","last_clean":"2024-04-26T10:24:33.973911+0000","last_became_active":"2024-04-26T10:24:31.601091+0000","last_became_peered":"2024-04-26T10:24:31.601091+0000","last_unstale":"2024-04-26T10:24:33.973911+0000","last_undegraded":"2024-04-26T10:24:33.973911+0000","last_fullsized":"2024-04-26T10:24:33.973911+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:10:46.182880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318431+0000","last_change":"2024-04-26T10:24:22.684603+0000","last_active":"2024-04-26T10:24:33.318431+0000","last_peered":"2024-04-26T10:24:33.318431+0000","last_clean":"2024-04-26T10:24:33.318431+0000","last_became_active":"2024-04-26T10:24:22.684213+0000","last_became_peered":"2024-04-26T10:24:22.684213+0000","last_unstale":"2024-04-26T10:24:33.318431+0000","last_undegraded":"2024-04-26T10:24:33.318431+0000","last_fullsized":"2024-04-26T10:24:33.318431+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:40:41.006428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179603+0000","last_change":"2024-04-26T10:24:31.613086+0000","last_active":"2024-04-26T10:24:34.179603+0000","last_peered":"2024-04-26T10:24:34.179603+0000","last_clean":"2024-04-26T10:24:34.179603+0000","last_became_active":"2024-04-26T10:24:31.604402+0000","last_became_peered":"2024-04-26T10:24:31.604402+0000","last_unstale":"2024-04-26T10:24:34.179603+0000","last_undegraded":"2024-04-26T10:24:34.179603+0000","last_fullsized":"2024-04-26T10:24:34.179603+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":116,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181661+0000","last_change":"2024-04-26T10:24:31.624641+0000","last_active":"2024-04-26T10:24:34.181661+0000","last_peered":"2024-04-26T10:24:34.181661+0000","last_clean":"2024-04-26T10:24:34.181661+0000","last_became_active":"2024-04-26T10:24:31.604744+0000","last_became_peered":"2024-04-26T10:24:31.604744+0000","last_unstale":"2024-04-26T10:24:34.181661+0000","last_undegraded":"2024-04-26T10:24:34.181661+0000","last_fullsized":"2024-04-26T10:24:34.181661+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182275+0000","last_change":"2024-04-26T10:22:09.750173+0000","last_active":"2024-04-26T10:24:33.182275+0000","last_peered":"2024-04-26T10:24:33.182275+0000","last_clean":"2024-04-26T10:24:33.182275+0000","last_became_active":"2024-04-26T10:22:09.749862+0000","last_became_peered":"2024-04-26T10:22:09.749862+0000","last_unstale":"2024-04-26T10:24:33.182275+0000","last_undegraded":"2024-04-26T10:24:33.182275+0000","last_fullsized":"2024-04-26T10:24:33.182275+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:30:53.204364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182816+0000","last_change":"2024-04-26T10:22:09.750224+0000","last_active":"2024-04-26T10:24:33.182816+0000","last_peered":"2024-04-26T10:24:33.182816+0000","last_clean":"2024-04-26T10:24:33.182816+0000","last_became_active":"2024-04-26T10:22:09.749852+0000","last_became_peered":"2024-04-26T10:22:09.749852+0000","last_unstale":"2024-04-26T10:24:33.182816+0000","last_undegraded":"2024-04-26T10:24:33.182816+0000","last_fullsized":"2024-04-26T10:24:33.182816+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:21:44.923542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973891+0000","last_change":"2024-04-26T10:24:31.597157+0000","last_active":"2024-04-26T10:24:33.973891+0000","last_peered":"2024-04-26T10:24:33.973891+0000","last_clean":"2024-04-26T10:24:33.973891+0000","last_became_active":"2024-04-26T10:24:31.596335+0000","last_became_peered":"2024-04-26T10:24:31.596335+0000","last_unstale":"2024-04-26T10:24:33.973891+0000","last_undegraded":"2024-04-26T10:24:33.973891+0000","last_fullsized":"2024-04-26T10:24:33.973891+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:24:07.652892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":82,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180625+0000","last_change":"2024-04-26T10:21:08.935133+0000","last_active":"2024-04-26T10:24:34.180625+0000","last_peered":"2024-04-26T10:24:34.180625+0000","last_clean":"2024-04-26T10:24:34.180625+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:24:34.180625+0000","last_undegraded":"2024-04-26T10:24:34.180625+0000","last_fullsized":"2024-04-26T10:24:34.180625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179483+0000","last_change":"2024-04-26T10:24:22.549411+0000","last_active":"2024-04-26T10:24:34.179483+0000","last_peered":"2024-04-26T10:24:34.179483+0000","last_clean":"2024-04-26T10:24:34.179483+0000","last_became_active":"2024-04-26T10:24:22.549230+0000","last_became_peered":"2024-04-26T10:24:22.549230+0000","last_unstale":"2024-04-26T10:24:34.179483+0000","last_undegraded":"2024-04-26T10:24:34.179483+0000","last_fullsized":"2024-04-26T10:24:34.179483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180750+0000","last_change":"2024-04-26T10:24:22.541409+0000","last_active":"2024-04-26T10:24:34.180750+0000","last_peered":"2024-04-26T10:24:34.180750+0000","last_clean":"2024-04-26T10:24:34.180750+0000","last_became_active":"2024-04-26T10:24:22.540611+0000","last_became_peered":"2024-04-26T10:24:22.540611+0000","last_unstale":"2024-04-26T10:24:34.180750+0000","last_undegraded":"2024-04-26T10:24:34.180750+0000","last_fullsized":"2024-04-26T10:24:34.180750+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319142+0000","last_change":"2024-04-26T10:24:22.687178+0000","last_active":"2024-04-26T10:24:33.319142+0000","last_peered":"2024-04-26T10:24:33.319142+0000","last_clean":"2024-04-26T10:24:33.319142+0000","last_became_active":"2024-04-26T10:24:22.686841+0000","last_became_peered":"2024-04-26T10:24:22.686841+0000","last_unstale":"2024-04-26T10:24:33.319142+0000","last_undegraded":"2024-04-26T10:24:33.319142+0000","last_fullsized":"2024-04-26T10:24:33.319142+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:40:52.907696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318078+0000","last_change":"2024-04-26T10:24:22.687183+0000","last_active":"2024-04-26T10:24:33.318078+0000","last_peered":"2024-04-26T10:24:33.318078+0000","last_clean":"2024-04-26T10:24:33.318078+0000","last_became_active":"2024-04-26T10:24:22.686846+0000","last_became_peered":"2024-04-26T10:24:22.686846+0000","last_unstale":"2024-04-26T10:24:33.318078+0000","last_undegraded":"2024-04-26T10:24:33.318078+0000","last_fullsized":"2024-04-26T10:24:33.318078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:37.083683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180736+0000","last_change":"2024-04-26T10:24:22.546117+0000","last_active":"2024-04-26T10:24:34.180736+0000","last_peered":"2024-04-26T10:24:34.180736+0000","last_clean":"2024-04-26T10:24:34.180736+0000","last_became_active":"2024-04-26T10:24:22.545616+0000","last_became_peered":"2024-04-26T10:24:22.545616+0000","last_unstale":"2024-04-26T10:24:34.180736+0000","last_undegraded":"2024-04-26T10:24:34.180736+0000","last_fullsized":"2024-04-26T10:24:34.180736+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179772+0000","last_change":"2024-04-26T10:24:22.540185+0000","last_active":"2024-04-26T10:24:34.179772+0000","last_peered":"2024-04-26T10:24:34.179772+0000","last_clean":"2024-04-26T10:24:34.179772+0000","last_became_active":"2024-04-26T10:24:22.538982+0000","last_became_peered":"2024-04-26T10:24:22.538982+0000","last_unstale":"2024-04-26T10:24:34.179772+0000","last_undegraded":"2024-04-26T10:24:34.179772+0000","last_fullsized":"2024-04-26T10:24:34.179772+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":80,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180846+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:24:34.180846+0000","last_peered":"2024-04-26T10:24:34.180846+0000","last_clean":"2024-04-26T10:24:34.180846+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:24:34.180846+0000","last_undegraded":"2024-04-26T10:24:34.180846+0000","last_fullsized":"2024-04-26T10:24:34.180846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181167+0000","last_change":"2024-04-26T10:22:09.748616+0000","last_active":"2024-04-26T10:24:33.181167+0000","last_peered":"2024-04-26T10:24:33.181167+0000","last_clean":"2024-04-26T10:24:33.181167+0000","last_became_active":"2024-04-26T10:22:09.748256+0000","last_became_peered":"2024-04-26T10:22:09.748256+0000","last_unstale":"2024-04-26T10:24:33.181167+0000","last_undegraded":"2024-04-26T10:24:33.181167+0000","last_fullsized":"2024-04-26T10:24:33.181167+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:47:19.402647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180622+0000","last_change":"2024-04-26T10:24:31.604150+0000","last_active":"2024-04-26T10:24:34.180622+0000","last_peered":"2024-04-26T10:24:34.180622+0000","last_clean":"2024-04-26T10:24:34.180622+0000","last_became_active":"2024-04-26T10:24:31.603620+0000","last_became_peered":"2024-04-26T10:24:31.603620+0000","last_unstale":"2024-04-26T10:24:34.180622+0000","last_undegraded":"2024-04-26T10:24:34.180622+0000","last_fullsized":"2024-04-26T10:24:34.180622+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973830+0000","last_change":"2024-04-26T10:24:31.598521+0000","last_active":"2024-04-26T10:24:33.973830+0000","last_peered":"2024-04-26T10:24:33.973830+0000","last_clean":"2024-04-26T10:24:33.973830+0000","last_became_active":"2024-04-26T10:24:31.598120+0000","last_became_peered":"2024-04-26T10:24:31.598120+0000","last_unstale":"2024-04-26T10:24:33.973830+0000","last_undegraded":"2024-04-26T10:24:33.973830+0000","last_fullsized":"2024-04-26T10:24:33.973830+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:24:23.723355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319166+0000","last_change":"2024-04-26T10:24:22.680557+0000","last_active":"2024-04-26T10:24:33.319166+0000","last_peered":"2024-04-26T10:24:33.319166+0000","last_clean":"2024-04-26T10:24:33.319166+0000","last_became_active":"2024-04-26T10:24:22.679940+0000","last_became_peered":"2024-04-26T10:24:22.679940+0000","last_unstale":"2024-04-26T10:24:33.319166+0000","last_undegraded":"2024-04-26T10:24:33.319166+0000","last_fullsized":"2024-04-26T10:24:33.319166+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:52:06.379234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":334,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.186743+0000","last_change":"2024-04-26T10:24:34.185235+0000","last_active":"2024-04-26T10:24:34.186743+0000","last_peered":"2024-04-26T10:24:34.186743+0000","last_clean":"2024-04-26T10:24:34.186743+0000","last_became_active":"2024-04-26T10:24:34.184490+0000","last_became_peered":"2024-04-26T10:24:34.184490+0000","last_unstale":"2024-04-26T10:24:34.186743+0000","last_undegraded":"2024-04-26T10:24:34.186743+0000","last_fullsized":"2024-04-26T10:24:34.186743+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":97,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179295+0000","last_change":"2024-04-26T10:24:22.547708+0000","last_active":"2024-04-26T10:24:34.179295+0000","last_peered":"2024-04-26T10:24:34.179295+0000","last_clean":"2024-04-26T10:24:34.179295+0000","last_became_active":"2024-04-26T10:24:22.546650+0000","last_became_peered":"2024-04-26T10:24:22.546650+0000","last_unstale":"2024-04-26T10:24:34.179295+0000","last_undegraded":"2024-04-26T10:24:34.179295+0000","last_fullsized":"2024-04-26T10:24:34.179295+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317752+0000","last_change":"2024-04-26T10:24:22.676755+0000","last_active":"2024-04-26T10:24:33.317752+0000","last_peered":"2024-04-26T10:24:33.317752+0000","last_clean":"2024-04-26T10:24:33.317752+0000","last_became_active":"2024-04-26T10:24:22.676489+0000","last_became_peered":"2024-04-26T10:24:22.676489+0000","last_unstale":"2024-04-26T10:24:33.317752+0000","last_undegraded":"2024-04-26T10:24:33.317752+0000","last_fullsized":"2024-04-26T10:24:33.317752+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:38.979532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180882+0000","last_change":"2024-04-26T10:24:31.603833+0000","last_active":"2024-04-26T10:24:34.180882+0000","last_peered":"2024-04-26T10:24:34.180882+0000","last_clean":"2024-04-26T10:24:34.180882+0000","last_became_active":"2024-04-26T10:24:31.603498+0000","last_became_peered":"2024-04-26T10:24:31.603498+0000","last_unstale":"2024-04-26T10:24:34.180882+0000","last_undegraded":"2024-04-26T10:24:34.180882+0000","last_fullsized":"2024-04-26T10:24:34.180882+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":110,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180007+0000","last_change":"2024-04-26T10:24:31.603067+0000","last_active":"2024-04-26T10:24:34.180007+0000","last_peered":"2024-04-26T10:24:34.180007+0000","last_clean":"2024-04-26T10:24:34.180007+0000","last_became_active":"2024-04-26T10:24:31.602611+0000","last_became_peered":"2024-04-26T10:24:31.602611+0000","last_unstale":"2024-04-26T10:24:34.180007+0000","last_undegraded":"2024-04-26T10:24:34.180007+0000","last_fullsized":"2024-04-26T10:24:34.180007+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316711+0000","last_change":"2024-04-26T10:24:22.685554+0000","last_active":"2024-04-26T10:24:33.316711+0000","last_peered":"2024-04-26T10:24:33.316711+0000","last_clean":"2024-04-26T10:24:33.316711+0000","last_became_active":"2024-04-26T10:24:22.685051+0000","last_became_peered":"2024-04-26T10:24:22.685051+0000","last_unstale":"2024-04-26T10:24:33.316711+0000","last_undegraded":"2024-04-26T10:24:33.316711+0000","last_fullsized":"2024-04-26T10:24:33.316711+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:32:59.389895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182836+0000","last_change":"2024-04-26T10:24:22.538294+0000","last_active":"2024-04-26T10:24:33.182836+0000","last_peered":"2024-04-26T10:24:33.182836+0000","last_clean":"2024-04-26T10:24:33.182836+0000","last_became_active":"2024-04-26T10:24:22.537983+0000","last_became_peered":"2024-04-26T10:24:22.537983+0000","last_unstale":"2024-04-26T10:24:33.182836+0000","last_undegraded":"2024-04-26T10:24:33.182836+0000","last_fullsized":"2024-04-26T10:24:33.182836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:55:54.064158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317277+0000","last_change":"2024-04-26T10:24:22.679231+0000","last_active":"2024-04-26T10:24:33.317277+0000","last_peered":"2024-04-26T10:24:33.317277+0000","last_clean":"2024-04-26T10:24:33.317277+0000","last_became_active":"2024-04-26T10:24:22.678866+0000","last_became_peered":"2024-04-26T10:24:22.678866+0000","last_unstale":"2024-04-26T10:24:33.317277+0000","last_undegraded":"2024-04-26T10:24:33.317277+0000","last_fullsized":"2024-04-26T10:24:33.317277+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:17:26.179423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":71,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182367+0000","last_change":"2024-04-26T10:22:09.750297+0000","last_active":"2024-04-26T10:24:33.182367+0000","last_peered":"2024-04-26T10:24:33.182367+0000","last_clean":"2024-04-26T10:24:33.182367+0000","last_became_active":"2024-04-26T10:22:09.749935+0000","last_became_peered":"2024-04-26T10:22:09.749935+0000","last_unstale":"2024-04-26T10:24:33.182367+0000","last_undegraded":"2024-04-26T10:24:33.182367+0000","last_fullsized":"2024-04-26T10:24:33.182367+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:51.197306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319145+0000","last_change":"2024-04-26T10:24:31.745820+0000","last_active":"2024-04-26T10:24:33.319145+0000","last_peered":"2024-04-26T10:24:33.319145+0000","last_clean":"2024-04-26T10:24:33.319145+0000","last_became_active":"2024-04-26T10:24:31.745487+0000","last_became_peered":"2024-04-26T10:24:31.745487+0000","last_unstale":"2024-04-26T10:24:33.319145+0000","last_undegraded":"2024-04-26T10:24:33.319145+0000","last_fullsized":"2024-04-26T10:24:33.319145+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:52:00.239650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":97,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179933+0000","last_change":"2024-04-26T10:24:22.539761+0000","last_active":"2024-04-26T10:24:34.179933+0000","last_peered":"2024-04-26T10:24:34.179933+0000","last_clean":"2024-04-26T10:24:34.179933+0000","last_became_active":"2024-04-26T10:24:22.538993+0000","last_became_peered":"2024-04-26T10:24:22.538993+0000","last_unstale":"2024-04-26T10:24:34.179933+0000","last_undegraded":"2024-04-26T10:24:34.179933+0000","last_fullsized":"2024-04-26T10:24:34.179933+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179686+0000","last_change":"2024-04-26T10:24:22.542774+0000","last_active":"2024-04-26T10:24:34.179686+0000","last_peered":"2024-04-26T10:24:34.179686+0000","last_clean":"2024-04-26T10:24:34.179686+0000","last_became_active":"2024-04-26T10:24:22.541795+0000","last_became_peered":"2024-04-26T10:24:22.541795+0000","last_unstale":"2024-04-26T10:24:34.179686+0000","last_undegraded":"2024-04-26T10:24:34.179686+0000","last_fullsized":"2024-04-26T10:24:34.179686+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317944+0000","last_change":"2024-04-26T10:24:31.744717+0000","last_active":"2024-04-26T10:24:33.317944+0000","last_peered":"2024-04-26T10:24:33.317944+0000","last_clean":"2024-04-26T10:24:33.317944+0000","last_became_active":"2024-04-26T10:24:31.744373+0000","last_became_peered":"2024-04-26T10:24:31.744373+0000","last_unstale":"2024-04-26T10:24:33.317944+0000","last_undegraded":"2024-04-26T10:24:33.317944+0000","last_fullsized":"2024-04-26T10:24:33.317944+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:48:10.589965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180484+0000","last_change":"2024-04-26T10:24:22.538573+0000","last_active":"2024-04-26T10:24:34.180484+0000","last_peered":"2024-04-26T10:24:34.180484+0000","last_clean":"2024-04-26T10:24:34.180484+0000","last_became_active":"2024-04-26T10:24:22.537041+0000","last_became_peered":"2024-04-26T10:24:22.537041+0000","last_unstale":"2024-04-26T10:24:34.180484+0000","last_undegraded":"2024-04-26T10:24:34.180484+0000","last_fullsized":"2024-04-26T10:24:34.180484+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318800+0000","last_change":"2024-04-26T10:24:31.744776+0000","last_active":"2024-04-26T10:24:33.318800+0000","last_peered":"2024-04-26T10:24:33.318800+0000","last_clean":"2024-04-26T10:24:33.318800+0000","last_became_active":"2024-04-26T10:24:31.744342+0000","last_became_peered":"2024-04-26T10:24:31.744342+0000","last_unstale":"2024-04-26T10:24:33.318800+0000","last_undegraded":"2024-04-26T10:24:33.318800+0000","last_fullsized":"2024-04-26T10:24:33.318800+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:08:33.941367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973980+0000","last_change":"2024-04-26T10:24:31.599193+0000","last_active":"2024-04-26T10:24:33.973980+0000","last_peered":"2024-04-26T10:24:33.973980+0000","last_clean":"2024-04-26T10:24:33.973980+0000","last_became_active":"2024-04-26T10:24:31.598432+0000","last_became_peered":"2024-04-26T10:24:31.598432+0000","last_unstale":"2024-04-26T10:24:33.973980+0000","last_undegraded":"2024-04-26T10:24:33.973980+0000","last_fullsized":"2024-04-26T10:24:33.973980+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:00:41.515775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318555+0000","last_change":"2024-04-26T10:24:31.745336+0000","last_active":"2024-04-26T10:24:33.318555+0000","last_peered":"2024-04-26T10:24:33.318555+0000","last_clean":"2024-04-26T10:24:33.318555+0000","last_became_active":"2024-04-26T10:24:31.745004+0000","last_became_peered":"2024-04-26T10:24:31.745004+0000","last_unstale":"2024-04-26T10:24:33.318555+0000","last_undegraded":"2024-04-26T10:24:33.318555+0000","last_fullsized":"2024-04-26T10:24:33.318555+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:15.275549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974267+0000","last_change":"2024-04-26T10:24:31.601585+0000","last_active":"2024-04-26T10:24:33.974267+0000","last_peered":"2024-04-26T10:24:33.974267+0000","last_clean":"2024-04-26T10:24:33.974267+0000","last_became_active":"2024-04-26T10:24:31.600977+0000","last_became_peered":"2024-04-26T10:24:31.600977+0000","last_unstale":"2024-04-26T10:24:33.974267+0000","last_undegraded":"2024-04-26T10:24:33.974267+0000","last_fullsized":"2024-04-26T10:24:33.974267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:51:13.329801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181771+0000","last_change":"2024-04-26T10:22:09.758116+0000","last_active":"2024-04-26T10:24:33.181771+0000","last_peered":"2024-04-26T10:24:33.181771+0000","last_clean":"2024-04-26T10:24:33.181771+0000","last_became_active":"2024-04-26T10:22:09.757813+0000","last_became_peered":"2024-04-26T10:22:09.757813+0000","last_unstale":"2024-04-26T10:24:33.181771+0000","last_undegraded":"2024-04-26T10:24:33.181771+0000","last_fullsized":"2024-04-26T10:24:33.181771+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:50:01.195987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318177+0000","last_change":"2024-04-26T10:24:22.680137+0000","last_active":"2024-04-26T10:24:33.318177+0000","last_peered":"2024-04-26T10:24:33.318177+0000","last_clean":"2024-04-26T10:24:33.318177+0000","last_became_active":"2024-04-26T10:24:22.679497+0000","last_became_peered":"2024-04-26T10:24:22.679497+0000","last_unstale":"2024-04-26T10:24:33.318177+0000","last_undegraded":"2024-04-26T10:24:33.318177+0000","last_fullsized":"2024-04-26T10:24:33.318177+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:00.401135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318093+0000","last_change":"2024-04-26T10:24:31.741102+0000","last_active":"2024-04-26T10:24:33.318093+0000","last_peered":"2024-04-26T10:24:33.318093+0000","last_clean":"2024-04-26T10:24:33.318093+0000","last_became_active":"2024-04-26T10:24:31.740589+0000","last_became_peered":"2024-04-26T10:24:31.740589+0000","last_unstale":"2024-04-26T10:24:33.318093+0000","last_undegraded":"2024-04-26T10:24:33.318093+0000","last_fullsized":"2024-04-26T10:24:33.318093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:38.170544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317410+0000","last_change":"2024-04-26T10:24:22.686404+0000","last_active":"2024-04-26T10:24:33.317410+0000","last_peered":"2024-04-26T10:24:33.317410+0000","last_clean":"2024-04-26T10:24:33.317410+0000","last_became_active":"2024-04-26T10:24:22.686094+0000","last_became_peered":"2024-04-26T10:24:22.686094+0000","last_unstale":"2024-04-26T10:24:33.317410+0000","last_undegraded":"2024-04-26T10:24:33.317410+0000","last_fullsized":"2024-04-26T10:24:33.317410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:04:37.911705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318296+0000","last_change":"2024-04-26T10:24:22.682344+0000","last_active":"2024-04-26T10:24:33.318296+0000","last_peered":"2024-04-26T10:24:33.318296+0000","last_clean":"2024-04-26T10:24:33.318296+0000","last_became_active":"2024-04-26T10:24:22.681977+0000","last_became_peered":"2024-04-26T10:24:22.681977+0000","last_unstale":"2024-04-26T10:24:33.318296+0000","last_undegraded":"2024-04-26T10:24:33.318296+0000","last_fullsized":"2024-04-26T10:24:33.318296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:11:56.544667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181635+0000","last_change":"2024-04-26T10:24:31.605320+0000","last_active":"2024-04-26T10:24:34.181635+0000","last_peered":"2024-04-26T10:24:34.181635+0000","last_clean":"2024-04-26T10:24:34.181635+0000","last_became_active":"2024-04-26T10:24:31.604158+0000","last_became_peered":"2024-04-26T10:24:31.604158+0000","last_unstale":"2024-04-26T10:24:34.181635+0000","last_undegraded":"2024-04-26T10:24:34.181635+0000","last_fullsized":"2024-04-26T10:24:34.181635+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973931+0000","last_change":"2024-04-26T10:24:31.601291+0000","last_active":"2024-04-26T10:24:33.973931+0000","last_peered":"2024-04-26T10:24:33.973931+0000","last_clean":"2024-04-26T10:24:33.973931+0000","last_became_active":"2024-04-26T10:24:31.600474+0000","last_became_peered":"2024-04-26T10:24:31.600474+0000","last_unstale":"2024-04-26T10:24:33.973931+0000","last_undegraded":"2024-04-26T10:24:33.973931+0000","last_fullsized":"2024-04-26T10:24:33.973931+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:24:30.284416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180365+0000","last_change":"2024-04-26T10:24:31.604975+0000","last_active":"2024-04-26T10:24:34.180365+0000","last_peered":"2024-04-26T10:24:34.180365+0000","last_clean":"2024-04-26T10:24:34.180365+0000","last_became_active":"2024-04-26T10:24:31.604609+0000","last_became_peered":"2024-04-26T10:24:31.604609+0000","last_unstale":"2024-04-26T10:24:34.180365+0000","last_undegraded":"2024-04-26T10:24:34.180365+0000","last_fullsized":"2024-04-26T10:24:34.180365+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180323+0000","last_change":"2024-04-26T10:24:31.622111+0000","last_active":"2024-04-26T10:24:34.180323+0000","last_peered":"2024-04-26T10:24:34.180323+0000","last_clean":"2024-04-26T10:24:34.180323+0000","last_became_active":"2024-04-26T10:24:31.604884+0000","last_became_peered":"2024-04-26T10:24:31.604884+0000","last_unstale":"2024-04-26T10:24:34.180323+0000","last_undegraded":"2024-04-26T10:24:34.180323+0000","last_fullsized":"2024-04-26T10:24:34.180323+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317264+0000","last_change":"2024-04-26T10:24:31.739955+0000","last_active":"2024-04-26T10:24:33.317264+0000","last_peered":"2024-04-26T10:24:33.317264+0000","last_clean":"2024-04-26T10:24:33.317264+0000","last_became_active":"2024-04-26T10:24:31.739550+0000","last_became_peered":"2024-04-26T10:24:31.739550+0000","last_unstale":"2024-04-26T10:24:33.317264+0000","last_undegraded":"2024-04-26T10:24:33.317264+0000","last_fullsized":"2024-04-26T10:24:33.317264+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:24:31.253486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974245+0000","last_change":"2024-04-26T10:24:31.609788+0000","last_active":"2024-04-26T10:24:33.974245+0000","last_peered":"2024-04-26T10:24:33.974245+0000","last_clean":"2024-04-26T10:24:33.974245+0000","last_became_active":"2024-04-26T10:24:31.601218+0000","last_became_peered":"2024-04-26T10:24:31.601218+0000","last_unstale":"2024-04-26T10:24:33.974245+0000","last_undegraded":"2024-04-26T10:24:33.974245+0000","last_fullsized":"2024-04-26T10:24:33.974245+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:33:39.380483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181348+0000","last_change":"2024-04-26T10:24:22.546807+0000","last_active":"2024-04-26T10:24:34.181348+0000","last_peered":"2024-04-26T10:24:34.181348+0000","last_clean":"2024-04-26T10:24:34.181348+0000","last_became_active":"2024-04-26T10:24:22.546378+0000","last_became_peered":"2024-04-26T10:24:22.546378+0000","last_unstale":"2024-04-26T10:24:34.181348+0000","last_undegraded":"2024-04-26T10:24:34.181348+0000","last_fullsized":"2024-04-26T10:24:34.181348+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317068+0000","last_change":"2024-04-26T10:24:22.684096+0000","last_active":"2024-04-26T10:24:33.317068+0000","last_peered":"2024-04-26T10:24:33.317068+0000","last_clean":"2024-04-26T10:24:33.317068+0000","last_became_active":"2024-04-26T10:24:22.683558+0000","last_became_peered":"2024-04-26T10:24:22.683558+0000","last_unstale":"2024-04-26T10:24:33.317068+0000","last_undegraded":"2024-04-26T10:24:33.317068+0000","last_fullsized":"2024-04-26T10:24:33.317068+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:52:05.316682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318841+0000","last_change":"2024-04-26T10:24:22.684541+0000","last_active":"2024-04-26T10:24:33.318841+0000","last_peered":"2024-04-26T10:24:33.318841+0000","last_clean":"2024-04-26T10:24:33.318841+0000","last_became_active":"2024-04-26T10:24:22.684166+0000","last_became_peered":"2024-04-26T10:24:22.684166+0000","last_unstale":"2024-04-26T10:24:33.318841+0000","last_undegraded":"2024-04-26T10:24:33.318841+0000","last_fullsized":"2024-04-26T10:24:33.318841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:08:30.164642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.317049+0000","last_change":"2024-04-26T10:24:31.745539+0000","last_active":"2024-04-26T10:24:33.317049+0000","last_peered":"2024-04-26T10:24:33.317049+0000","last_clean":"2024-04-26T10:24:33.317049+0000","last_became_active":"2024-04-26T10:24:31.745216+0000","last_became_peered":"2024-04-26T10:24:31.745216+0000","last_unstale":"2024-04-26T10:24:33.317049+0000","last_undegraded":"2024-04-26T10:24:33.317049+0000","last_fullsized":"2024-04-26T10:24:33.317049+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:55.390023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183305+0000","last_change":"2024-04-26T10:22:09.750605+0000","last_active":"2024-04-26T10:24:33.183305+0000","last_peered":"2024-04-26T10:24:33.183305+0000","last_clean":"2024-04-26T10:24:33.183305+0000","last_became_active":"2024-04-26T10:22:09.750359+0000","last_became_peered":"2024-04-26T10:22:09.750359+0000","last_unstale":"2024-04-26T10:24:33.183305+0000","last_undegraded":"2024-04-26T10:24:33.183305+0000","last_fullsized":"2024-04-26T10:24:33.183305+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:56:56.948741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316663+0000","last_change":"2024-04-26T10:24:31.740907+0000","last_active":"2024-04-26T10:24:33.316663+0000","last_peered":"2024-04-26T10:24:33.316663+0000","last_clean":"2024-04-26T10:24:33.316663+0000","last_became_active":"2024-04-26T10:24:31.740477+0000","last_became_peered":"2024-04-26T10:24:31.740477+0000","last_unstale":"2024-04-26T10:24:33.316663+0000","last_undegraded":"2024-04-26T10:24:33.316663+0000","last_fullsized":"2024-04-26T10:24:33.316663+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:53:30.206347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.318888+0000","last_change":"2024-04-26T10:24:22.684108+0000","last_active":"2024-04-26T10:24:33.318888+0000","last_peered":"2024-04-26T10:24:33.318888+0000","last_clean":"2024-04-26T10:24:33.318888+0000","last_became_active":"2024-04-26T10:24:22.683501+0000","last_became_peered":"2024-04-26T10:24:22.683501+0000","last_unstale":"2024-04-26T10:24:33.318888+0000","last_undegraded":"2024-04-26T10:24:33.318888+0000","last_fullsized":"2024-04-26T10:24:33.318888+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:06:17.355758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.316745+0000","last_change":"2024-04-26T10:24:22.685228+0000","last_active":"2024-04-26T10:24:33.316745+0000","last_peered":"2024-04-26T10:24:33.316745+0000","last_clean":"2024-04-26T10:24:33.316745+0000","last_became_active":"2024-04-26T10:24:22.684469+0000","last_became_peered":"2024-04-26T10:24:22.684469+0000","last_unstale":"2024-04-26T10:24:33.316745+0000","last_undegraded":"2024-04-26T10:24:33.316745+0000","last_fullsized":"2024-04-26T10:24:33.316745+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:01:53.834583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182003+0000","last_change":"2024-04-26T10:22:09.753136+0000","last_active":"2024-04-26T10:24:33.182003+0000","last_peered":"2024-04-26T10:24:33.182003+0000","last_clean":"2024-04-26T10:24:33.182003+0000","last_became_active":"2024-04-26T10:22:09.752856+0000","last_became_peered":"2024-04-26T10:22:09.752856+0000","last_unstale":"2024-04-26T10:24:33.182003+0000","last_undegraded":"2024-04-26T10:24:33.182003+0000","last_fullsized":"2024-04-26T10:24:33.182003+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:57:48.541930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":88,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.181723+0000","last_change":"2024-04-26T10:24:22.535413+0000","last_active":"2024-04-26T10:24:33.181723+0000","last_peered":"2024-04-26T10:24:33.181723+0000","last_clean":"2024-04-26T10:24:33.181723+0000","last_became_active":"2024-04-26T10:24:22.535036+0000","last_became_peered":"2024-04-26T10:24:22.535036+0000","last_unstale":"2024-04-26T10:24:33.181723+0000","last_undegraded":"2024-04-26T10:24:33.181723+0000","last_fullsized":"2024-04-26T10:24:33.181723+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:47:43.756504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":86,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.183058+0000","last_change":"2024-04-26T10:24:22.535819+0000","last_active":"2024-04-26T10:24:33.183058+0000","last_peered":"2024-04-26T10:24:33.183058+0000","last_clean":"2024-04-26T10:24:33.183058+0000","last_became_active":"2024-04-26T10:24:22.535562+0000","last_became_peered":"2024-04-26T10:24:22.535562+0000","last_unstale":"2024-04-26T10:24:33.183058+0000","last_undegraded":"2024-04-26T10:24:33.183058+0000","last_fullsized":"2024-04-26T10:24:33.183058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:37:24.845621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.974051+0000","last_change":"2024-04-26T10:24:31.600594+0000","last_active":"2024-04-26T10:24:33.974051+0000","last_peered":"2024-04-26T10:24:33.974051+0000","last_clean":"2024-04-26T10:24:33.974051+0000","last_became_active":"2024-04-26T10:24:31.600121+0000","last_became_peered":"2024-04-26T10:24:31.600121+0000","last_unstale":"2024-04-26T10:24:33.974051+0000","last_undegraded":"2024-04-26T10:24:33.974051+0000","last_fullsized":"2024-04-26T10:24:33.974051+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:49:05.491069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180293+0000","last_change":"2024-04-26T10:24:22.542755+0000","last_active":"2024-04-26T10:24:34.180293+0000","last_peered":"2024-04-26T10:24:34.180293+0000","last_clean":"2024-04-26T10:24:34.180293+0000","last_became_active":"2024-04-26T10:24:22.541543+0000","last_became_peered":"2024-04-26T10:24:22.541543+0000","last_unstale":"2024-04-26T10:24:34.180293+0000","last_undegraded":"2024-04-26T10:24:34.180293+0000","last_fullsized":"2024-04-26T10:24:34.180293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180600+0000","last_change":"2024-04-26T10:24:22.541418+0000","last_active":"2024-04-26T10:24:34.180600+0000","last_peered":"2024-04-26T10:24:34.180600+0000","last_clean":"2024-04-26T10:24:34.180600+0000","last_became_active":"2024-04-26T10:24:22.540767+0000","last_became_peered":"2024-04-26T10:24:22.540767+0000","last_unstale":"2024-04-26T10:24:34.180600+0000","last_undegraded":"2024-04-26T10:24:34.180600+0000","last_fullsized":"2024-04-26T10:24:34.180600+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179689+0000","last_change":"2024-04-26T10:24:22.547294+0000","last_active":"2024-04-26T10:24:34.179689+0000","last_peered":"2024-04-26T10:24:34.179689+0000","last_clean":"2024-04-26T10:24:34.179689+0000","last_became_active":"2024-04-26T10:24:22.546811+0000","last_became_peered":"2024-04-26T10:24:22.546811+0000","last_unstale":"2024-04-26T10:24:34.179689+0000","last_undegraded":"2024-04-26T10:24:34.179689+0000","last_fullsized":"2024-04-26T10:24:34.179689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":73,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.182738+0000","last_change":"2024-04-26T10:22:09.753438+0000","last_active":"2024-04-26T10:24:33.182738+0000","last_peered":"2024-04-26T10:24:33.182738+0000","last_clean":"2024-04-26T10:24:33.182738+0000","last_became_active":"2024-04-26T10:22:09.753211+0000","last_became_peered":"2024-04-26T10:22:09.753211+0000","last_unstale":"2024-04-26T10:24:33.182738+0000","last_undegraded":"2024-04-26T10:24:33.182738+0000","last_fullsized":"2024-04-26T10:24:33.182738+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:16:39.406859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.973960+0000","last_change":"2024-04-26T10:24:31.600935+0000","last_active":"2024-04-26T10:24:33.973960+0000","last_peered":"2024-04-26T10:24:33.973960+0000","last_clean":"2024-04-26T10:24:33.973960+0000","last_became_active":"2024-04-26T10:24:31.600088+0000","last_became_peered":"2024-04-26T10:24:31.600088+0000","last_unstale":"2024-04-26T10:24:33.973960+0000","last_undegraded":"2024-04-26T10:24:33.973960+0000","last_fullsized":"2024-04-26T10:24:33.973960+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:57:58.341684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319737+0000","last_change":"2024-04-26T10:24:22.680082+0000","last_active":"2024-04-26T10:24:33.319737+0000","last_peered":"2024-04-26T10:24:33.319737+0000","last_clean":"2024-04-26T10:24:33.319737+0000","last_became_active":"2024-04-26T10:24:22.679652+0000","last_became_peered":"2024-04-26T10:24:22.679652+0000","last_unstale":"2024-04-26T10:24:33.319737+0000","last_undegraded":"2024-04-26T10:24:33.319737+0000","last_fullsized":"2024-04-26T10:24:33.319737+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:37:37.821623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179527+0000","last_change":"2024-04-26T10:24:22.540326+0000","last_active":"2024-04-26T10:24:34.179527+0000","last_peered":"2024-04-26T10:24:34.179527+0000","last_clean":"2024-04-26T10:24:34.179527+0000","last_became_active":"2024-04-26T10:24:22.538895+0000","last_became_peered":"2024-04-26T10:24:22.538895+0000","last_unstale":"2024-04-26T10:24:34.179527+0000","last_undegraded":"2024-04-26T10:24:34.179527+0000","last_fullsized":"2024-04-26T10:24:34.179527+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-04-26T10:24:33.319358+0000","last_change":"2024-04-26T10:24:22.685454+0000","last_active":"2024-04-26T10:24:33.319358+0000","last_peered":"2024-04-26T10:24:33.319358+0000","last_clean":"2024-04-26T10:24:33.319358+0000","last_became_active":"2024-04-26T10:24:22.684863+0000","last_became_peered":"2024-04-26T10:24:22.684863+0000","last_unstale":"2024-04-26T10:24:33.319358+0000","last_undegraded":"2024-04-26T10:24:33.319358+0000","last_fullsized":"2024-04-26T10:24:33.319358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:02:33.027447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":21541,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673010,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279076,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":278014,"kb_avail":94092764,"statfs":{"total":96636764160,"available":96350990336,"internally_reserved":0,"allocated":1064960,"data_stored":1035671,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":284686790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:24:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55000000000000004,"15min":0.51600000000000001},"min":{"1min":0.25800000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.67500000000000004,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.53900000000000003},"min":{"1min":0.28000000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.754,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":0,"up_from":10,"seq":42949673009,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487484,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":486398,"kb_avail":93884356,"statfs":{"total":96636764160,"available":96137580544,"internally_reserved":0,"allocated":1089536,"data_stored":1036287,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":498072006},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:24:04 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.65600000000000003,"15min":0.56599999999999995},"min":{"1min":0.21099999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":4.1369999999999996,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.25900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.748,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":2,"up_from":80,"seq":343597383686,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38380,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":37369,"kb_avail":94333460,"statfs":{"total":96636764160,"available":96597463040,"internally_reserved":0,"allocated":1007616,"data_stored":444173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6879,"internal_metadata":38266145},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:24:45.001 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.002 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.002 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.002 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.002 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.002 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.002 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.002 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.002 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.002 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.003 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.003 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.003 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.003 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.003 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.003 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.003 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.003 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.003 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.004 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.004 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.004 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.004 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.004 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.004 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.004 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.004 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.004 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.004 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.005 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.005 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.005 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.005 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.005 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.005 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.005 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.005 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.005 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.006 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.006 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.006 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.006 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.006 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.006 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.006 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.006 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.006 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.007 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.007 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.007 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.007 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.007 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.007 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.007 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.007 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.007 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.008 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T10:21:00.797402+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.008 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.008 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.008 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.008 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.008 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.008 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.008 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.008 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.009 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.009 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.009 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.009 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.009 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.009 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.009 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.009 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.009 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.010 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.010 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.010 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.010 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.010 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.010 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.010 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.010 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.010 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.011 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.011 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.011 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.011 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.011 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.011 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.011 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.011 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.011 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.012 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.012 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.012 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.012 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.012 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.012 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.012 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.012 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.012 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.013 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.013 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.013 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.013 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:24:45.013 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:25:05.014 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:25:05.342 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:25:05.344 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:25:05.356 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-04-26T10:25:04.051228+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1184088,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":804904,"kb_used_data":3088,"kb_used_omap":9,"kb_used_meta":801782,"kb_avail":282310616,"statfs":{"total":289910292480,"available":289086070784,"internally_reserved":0,"allocated":3162112,"data_stored":2516131,"data_compressed":14075,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":10067,"internal_metadata":821024941},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004443"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185894+0000","last_change":"2024-04-26T10:24:31.598789+0000","last_active":"2024-04-26T10:24:34.185894+0000","last_peered":"2024-04-26T10:24:34.185894+0000","last_clean":"2024-04-26T10:24:34.185894+0000","last_became_active":"2024-04-26T10:24:31.598170+0000","last_became_peered":"2024-04-26T10:24:31.598170+0000","last_unstale":"2024-04-26T10:24:34.185894+0000","last_undegraded":"2024-04-26T10:24:34.185894+0000","last_fullsized":"2024-04-26T10:24:34.185894+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185794+0000","last_change":"2024-04-26T10:24:22.536264+0000","last_active":"2024-04-26T10:24:34.185794+0000","last_peered":"2024-04-26T10:24:34.185794+0000","last_clean":"2024-04-26T10:24:34.185794+0000","last_became_active":"2024-04-26T10:24:22.535998+0000","last_became_peered":"2024-04-26T10:24:22.535998+0000","last_unstale":"2024-04-26T10:24:34.185794+0000","last_undegraded":"2024-04-26T10:24:34.185794+0000","last_fullsized":"2024-04-26T10:24:34.185794+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":80,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181302+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:24:34.181302+0000","last_peered":"2024-04-26T10:24:34.181302+0000","last_clean":"2024-04-26T10:24:34.181302+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:24:34.181302+0000","last_undegraded":"2024-04-26T10:24:34.181302+0000","last_fullsized":"2024-04-26T10:24:34.181302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181065+0000","last_change":"2024-04-26T10:24:22.549067+0000","last_active":"2024-04-26T10:24:34.181065+0000","last_peered":"2024-04-26T10:24:34.181065+0000","last_clean":"2024-04-26T10:24:34.181065+0000","last_became_active":"2024-04-26T10:24:22.548485+0000","last_became_peered":"2024-04-26T10:24:22.548485+0000","last_unstale":"2024-04-26T10:24:34.181065+0000","last_undegraded":"2024-04-26T10:24:34.181065+0000","last_fullsized":"2024-04-26T10:24:34.181065+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:00.289761+0000","last_change":"2024-04-26T10:25:00.290012+0000","last_active":"2024-04-26T10:25:00.289761+0000","last_peered":"2024-04-26T10:25:00.289761+0000","last_clean":"2024-04-26T10:25:00.289761+0000","last_became_active":"2024-04-26T10:24:31.600986+0000","last_became_peered":"2024-04-26T10:24:31.600986+0000","last_unstale":"2024-04-26T10:25:00.289761+0000","last_undegraded":"2024-04-26T10:25:00.289761+0000","last_fullsized":"2024-04-26T10:25:00.289761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:00.289706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:00.289706+0000","last_clean_scrub_stamp":"2024-04-26T10:25:00.289706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:20.178292+0000","scrub_duration":0.015595131999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:52.225237+0000","last_change":"2024-04-26T10:24:52.225492+0000","last_active":"2024-04-26T10:24:52.225237+0000","last_peered":"2024-04-26T10:24:52.225237+0000","last_clean":"2024-04-26T10:24:52.225237+0000","last_became_active":"2024-04-26T10:24:22.547731+0000","last_became_peered":"2024-04-26T10:24:22.547731+0000","last_unstale":"2024-04-26T10:24:52.225237+0000","last_undegraded":"2024-04-26T10:24:52.225237+0000","last_fullsized":"2024-04-26T10:24:52.225237+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:52.225191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:52.225191+0000","last_clean_scrub_stamp":"2024-04-26T10:24:52.225191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:05.446400+0000","scrub_duration":0.003307118,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:46.143038+0000","last_change":"2024-04-26T10:24:46.143361+0000","last_active":"2024-04-26T10:24:46.143038+0000","last_peered":"2024-04-26T10:24:46.143038+0000","last_clean":"2024-04-26T10:24:46.143038+0000","last_became_active":"2024-04-26T10:24:22.549180+0000","last_became_peered":"2024-04-26T10:24:22.549180+0000","last_unstale":"2024-04-26T10:24:46.143038+0000","last_undegraded":"2024-04-26T10:24:46.143038+0000","last_fullsized":"2024-04-26T10:24:46.143038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:46.142953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:46.142953+0000","last_clean_scrub_stamp":"2024-04-26T10:24:46.142953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:47.298765+0000","scrub_duration":0.014784434000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180250+0000","last_change":"2024-04-26T10:24:22.547840+0000","last_active":"2024-04-26T10:24:34.180250+0000","last_peered":"2024-04-26T10:24:34.180250+0000","last_clean":"2024-04-26T10:24:34.180250+0000","last_became_active":"2024-04-26T10:24:22.547284+0000","last_became_peered":"2024-04-26T10:24:22.547284+0000","last_unstale":"2024-04-26T10:24:34.180250+0000","last_undegraded":"2024-04-26T10:24:34.180250+0000","last_fullsized":"2024-04-26T10:24:34.180250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:56.807533+0000","last_change":"2024-04-26T10:24:56.807646+0000","last_active":"2024-04-26T10:24:56.807533+0000","last_peered":"2024-04-26T10:24:56.807533+0000","last_clean":"2024-04-26T10:24:56.807533+0000","last_became_active":"2024-04-26T10:24:22.679648+0000","last_became_peered":"2024-04-26T10:24:22.679648+0000","last_unstale":"2024-04-26T10:24:56.807533+0000","last_undegraded":"2024-04-26T10:24:56.807533+0000","last_fullsized":"2024-04-26T10:24:56.807533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:56.807510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:56.807510+0000","last_clean_scrub_stamp":"2024-04-26T10:24:56.807510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:24.720449+0000","scrub_duration":0.029714911,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185761+0000","last_change":"2024-04-26T10:24:31.599182+0000","last_active":"2024-04-26T10:24:34.185761+0000","last_peered":"2024-04-26T10:24:34.185761+0000","last_clean":"2024-04-26T10:24:34.185761+0000","last_became_active":"2024-04-26T10:24:31.598187+0000","last_became_peered":"2024-04-26T10:24:31.598187+0000","last_unstale":"2024-04-26T10:24:34.185761+0000","last_undegraded":"2024-04-26T10:24:34.185761+0000","last_fullsized":"2024-04-26T10:24:34.185761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181251+0000","last_change":"2024-04-26T10:24:22.547601+0000","last_active":"2024-04-26T10:24:34.181251+0000","last_peered":"2024-04-26T10:24:34.181251+0000","last_clean":"2024-04-26T10:24:34.181251+0000","last_became_active":"2024-04-26T10:24:22.546506+0000","last_became_peered":"2024-04-26T10:24:22.546506+0000","last_unstale":"2024-04-26T10:24:34.181251+0000","last_undegraded":"2024-04-26T10:24:34.181251+0000","last_fullsized":"2024-04-26T10:24:34.181251+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":82,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:56.279912+0000","last_change":"2024-04-26T10:24:56.280129+0000","last_active":"2024-04-26T10:24:56.279912+0000","last_peered":"2024-04-26T10:24:56.279912+0000","last_clean":"2024-04-26T10:24:56.279912+0000","last_became_active":"2024-04-26T10:22:09.747822+0000","last_became_peered":"2024-04-26T10:22:09.747822+0000","last_unstale":"2024-04-26T10:24:56.279912+0000","last_undegraded":"2024-04-26T10:24:56.279912+0000","last_fullsized":"2024-04-26T10:24:56.279912+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:56.279865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:56.279865+0000","last_clean_scrub_stamp":"2024-04-26T10:24:56.279865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:18:56.107536+0000","scrub_duration":0.0031183439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.184653+0000","last_change":"2024-04-26T10:24:31.598330+0000","last_active":"2024-04-26T10:24:34.184653+0000","last_peered":"2024-04-26T10:24:34.184653+0000","last_clean":"2024-04-26T10:24:34.184653+0000","last_became_active":"2024-04-26T10:24:31.597980+0000","last_became_peered":"2024-04-26T10:24:31.597980+0000","last_unstale":"2024-04-26T10:24:34.184653+0000","last_undegraded":"2024-04-26T10:24:34.184653+0000","last_fullsized":"2024-04-26T10:24:34.184653+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":117,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:53.201478+0000","last_change":"2024-04-26T10:24:53.201710+0000","last_active":"2024-04-26T10:24:53.201478+0000","last_peered":"2024-04-26T10:24:53.201478+0000","last_clean":"2024-04-26T10:24:53.201478+0000","last_became_active":"2024-04-26T10:24:31.602539+0000","last_became_peered":"2024-04-26T10:24:31.602539+0000","last_unstale":"2024-04-26T10:24:53.201478+0000","last_undegraded":"2024-04-26T10:24:53.201478+0000","last_fullsized":"2024-04-26T10:24:53.201478+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:53.201431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:53.201431+0000","last_clean_scrub_stamp":"2024-04-26T10:24:53.201431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:31.514894+0000","scrub_duration":0.0033374949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":117,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:00.222743+0000","last_change":"2024-04-26T10:25:00.222988+0000","last_active":"2024-04-26T10:25:00.222743+0000","last_peered":"2024-04-26T10:25:00.222743+0000","last_clean":"2024-04-26T10:25:00.222743+0000","last_became_active":"2024-04-26T10:24:31.602453+0000","last_became_peered":"2024-04-26T10:24:31.602453+0000","last_unstale":"2024-04-26T10:25:00.222743+0000","last_undegraded":"2024-04-26T10:25:00.222743+0000","last_fullsized":"2024-04-26T10:25:00.222743+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:00.222698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:00.222698+0000","last_clean_scrub_stamp":"2024-04-26T10:25:00.222698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:45.583919+0000","scrub_duration":0.0030823560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179940+0000","last_change":"2024-04-26T10:24:22.547543+0000","last_active":"2024-04-26T10:24:34.179940+0000","last_peered":"2024-04-26T10:24:34.179940+0000","last_clean":"2024-04-26T10:24:34.179940+0000","last_became_active":"2024-04-26T10:24:22.546856+0000","last_became_peered":"2024-04-26T10:24:22.546856+0000","last_unstale":"2024-04-26T10:24:34.179940+0000","last_undegraded":"2024-04-26T10:24:34.179940+0000","last_fullsized":"2024-04-26T10:24:34.179940+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.320004+0000","last_change":"2024-04-26T10:24:22.679885+0000","last_active":"2024-04-26T10:24:34.320004+0000","last_peered":"2024-04-26T10:24:34.320004+0000","last_clean":"2024-04-26T10:24:34.320004+0000","last_became_active":"2024-04-26T10:24:22.679350+0000","last_became_peered":"2024-04-26T10:24:22.679350+0000","last_unstale":"2024-04-26T10:24:34.320004+0000","last_undegraded":"2024-04-26T10:24:34.320004+0000","last_fullsized":"2024-04-26T10:24:34.320004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185940+0000","last_change":"2024-04-26T10:24:31.598857+0000","last_active":"2024-04-26T10:24:34.185940+0000","last_peered":"2024-04-26T10:24:34.185940+0000","last_clean":"2024-04-26T10:24:34.185940+0000","last_became_active":"2024-04-26T10:24:31.597563+0000","last_became_peered":"2024-04-26T10:24:31.597563+0000","last_unstale":"2024-04-26T10:24:34.185940+0000","last_undegraded":"2024-04-26T10:24:34.185940+0000","last_fullsized":"2024-04-26T10:24:34.185940+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.319093+0000","last_change":"2024-04-26T10:24:22.679291+0000","last_active":"2024-04-26T10:24:34.319093+0000","last_peered":"2024-04-26T10:24:34.319093+0000","last_clean":"2024-04-26T10:24:34.319093+0000","last_became_active":"2024-04-26T10:24:22.678912+0000","last_became_peered":"2024-04-26T10:24:22.678912+0000","last_unstale":"2024-04-26T10:24:34.319093+0000","last_undegraded":"2024-04-26T10:24:34.319093+0000","last_fullsized":"2024-04-26T10:24:34.319093+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181006+0000","last_change":"2024-04-26T10:24:22.546669+0000","last_active":"2024-04-26T10:24:34.181006+0000","last_peered":"2024-04-26T10:24:34.181006+0000","last_clean":"2024-04-26T10:24:34.181006+0000","last_became_active":"2024-04-26T10:24:22.546052+0000","last_became_peered":"2024-04-26T10:24:22.546052+0000","last_unstale":"2024-04-26T10:24:34.181006+0000","last_undegraded":"2024-04-26T10:24:34.181006+0000","last_fullsized":"2024-04-26T10:24:34.181006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179889+0000","last_change":"2024-04-26T10:24:22.547981+0000","last_active":"2024-04-26T10:24:34.179889+0000","last_peered":"2024-04-26T10:24:34.179889+0000","last_clean":"2024-04-26T10:24:34.179889+0000","last_became_active":"2024-04-26T10:24:22.547663+0000","last_became_peered":"2024-04-26T10:24:22.547663+0000","last_unstale":"2024-04-26T10:24:34.179889+0000","last_undegraded":"2024-04-26T10:24:34.179889+0000","last_fullsized":"2024-04-26T10:24:34.179889+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":82,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:01.324571+0000","last_change":"2024-04-26T10:25:01.324901+0000","last_active":"2024-04-26T10:25:01.324571+0000","last_peered":"2024-04-26T10:25:01.324571+0000","last_clean":"2024-04-26T10:25:01.324571+0000","last_became_active":"2024-04-26T10:22:09.748755+0000","last_became_peered":"2024-04-26T10:22:09.748755+0000","last_unstale":"2024-04-26T10:25:01.324571+0000","last_undegraded":"2024-04-26T10:25:01.324571+0000","last_fullsized":"2024-04-26T10:25:01.324571+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:01.324527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:01.324527+0000","last_clean_scrub_stamp":"2024-04-26T10:25:01.324527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:42.317619+0000","scrub_duration":0.0030479109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.317851+0000","last_change":"2024-04-26T10:24:22.684668+0000","last_active":"2024-04-26T10:24:34.317851+0000","last_peered":"2024-04-26T10:24:34.317851+0000","last_clean":"2024-04-26T10:24:34.317851+0000","last_became_active":"2024-04-26T10:24:22.683921+0000","last_became_peered":"2024-04-26T10:24:22.683921+0000","last_unstale":"2024-04-26T10:24:34.317851+0000","last_undegraded":"2024-04-26T10:24:34.317851+0000","last_fullsized":"2024-04-26T10:24:34.317851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.184641+0000","last_change":"2024-04-26T10:24:22.535052+0000","last_active":"2024-04-26T10:24:34.184641+0000","last_peered":"2024-04-26T10:24:34.184641+0000","last_clean":"2024-04-26T10:24:34.184641+0000","last_became_active":"2024-04-26T10:24:22.534674+0000","last_became_peered":"2024-04-26T10:24:22.534674+0000","last_unstale":"2024-04-26T10:24:34.184641+0000","last_undegraded":"2024-04-26T10:24:34.184641+0000","last_fullsized":"2024-04-26T10:24:34.184641+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:48.293794+0000","last_change":"2024-04-26T10:24:48.293911+0000","last_active":"2024-04-26T10:24:48.293794+0000","last_peered":"2024-04-26T10:24:48.293794+0000","last_clean":"2024-04-26T10:24:48.293794+0000","last_became_active":"2024-04-26T10:24:31.600815+0000","last_became_peered":"2024-04-26T10:24:31.600815+0000","last_unstale":"2024-04-26T10:24:48.293794+0000","last_undegraded":"2024-04-26T10:24:48.293794+0000","last_fullsized":"2024-04-26T10:24:48.293794+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:48.293774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:48.293774+0000","last_clean_scrub_stamp":"2024-04-26T10:24:48.293774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:51.595218+0000","scrub_duration":0.058713007999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:51.769368+0000","last_change":"2024-04-26T10:24:51.769593+0000","last_active":"2024-04-26T10:24:51.769368+0000","last_peered":"2024-04-26T10:24:51.769368+0000","last_clean":"2024-04-26T10:24:51.769368+0000","last_became_active":"2024-04-26T10:24:22.683959+0000","last_became_peered":"2024-04-26T10:24:22.683959+0000","last_unstale":"2024-04-26T10:24:51.769368+0000","last_undegraded":"2024-04-26T10:24:51.769368+0000","last_fullsized":"2024-04-26T10:24:51.769368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:51.769321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:51.769321+0000","last_clean_scrub_stamp":"2024-04-26T10:24:51.769321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:05.665068+0000","scrub_duration":0.003275011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":80,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181105+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:24:34.181105+0000","last_peered":"2024-04-26T10:24:34.181105+0000","last_clean":"2024-04-26T10:24:34.181105+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:24:34.181105+0000","last_undegraded":"2024-04-26T10:24:34.181105+0000","last_fullsized":"2024-04-26T10:24:34.181105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185612+0000","last_change":"2024-04-26T10:24:31.602078+0000","last_active":"2024-04-26T10:24:34.185612+0000","last_peered":"2024-04-26T10:24:34.185612+0000","last_clean":"2024-04-26T10:24:34.185612+0000","last_became_active":"2024-04-26T10:24:31.601299+0000","last_became_peered":"2024-04-26T10:24:31.601299+0000","last_unstale":"2024-04-26T10:24:34.185612+0000","last_undegraded":"2024-04-26T10:24:34.185612+0000","last_fullsized":"2024-04-26T10:24:34.185612+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.318287+0000","last_change":"2024-04-26T10:24:31.741152+0000","last_active":"2024-04-26T10:24:34.318287+0000","last_peered":"2024-04-26T10:24:34.318287+0000","last_clean":"2024-04-26T10:24:34.318287+0000","last_became_active":"2024-04-26T10:24:31.740626+0000","last_became_peered":"2024-04-26T10:24:31.740626+0000","last_unstale":"2024-04-26T10:24:34.318287+0000","last_undegraded":"2024-04-26T10:24:34.318287+0000","last_fullsized":"2024-04-26T10:24:34.318287+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":71,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.184570+0000","last_change":"2024-04-26T10:22:09.750562+0000","last_active":"2024-04-26T10:24:34.184570+0000","last_peered":"2024-04-26T10:24:34.184570+0000","last_clean":"2024-04-26T10:24:34.184570+0000","last_became_active":"2024-04-26T10:22:09.750286+0000","last_became_peered":"2024-04-26T10:22:09.750286+0000","last_unstale":"2024-04-26T10:24:34.184570+0000","last_undegraded":"2024-04-26T10:24:34.184570+0000","last_fullsized":"2024-04-26T10:24:34.184570+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.318332+0000","last_change":"2024-04-26T10:24:31.741008+0000","last_active":"2024-04-26T10:24:34.318332+0000","last_peered":"2024-04-26T10:24:34.318332+0000","last_clean":"2024-04-26T10:24:34.318332+0000","last_became_active":"2024-04-26T10:24:31.740518+0000","last_became_peered":"2024-04-26T10:24:31.740518+0000","last_unstale":"2024-04-26T10:24:34.318332+0000","last_undegraded":"2024-04-26T10:24:34.318332+0000","last_fullsized":"2024-04-26T10:24:34.318332+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:44.170255+0000","last_change":"2024-04-26T10:24:44.170604+0000","last_active":"2024-04-26T10:24:44.170255+0000","last_peered":"2024-04-26T10:24:44.170255+0000","last_clean":"2024-04-26T10:24:44.170255+0000","last_became_active":"2024-04-26T10:24:22.539106+0000","last_became_peered":"2024-04-26T10:24:22.539106+0000","last_unstale":"2024-04-26T10:24:44.170255+0000","last_undegraded":"2024-04-26T10:24:44.170255+0000","last_fullsized":"2024-04-26T10:24:44.170255+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:44.170151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:44.170151+0000","last_clean_scrub_stamp":"2024-04-26T10:24:44.170151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:52.109209+0000","scrub_duration":0.010234752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185397+0000","last_change":"2024-04-26T10:24:31.599487+0000","last_active":"2024-04-26T10:24:34.185397+0000","last_peered":"2024-04-26T10:24:34.185397+0000","last_clean":"2024-04-26T10:24:34.185397+0000","last_became_active":"2024-04-26T10:24:31.598307+0000","last_became_peered":"2024-04-26T10:24:31.598307+0000","last_unstale":"2024-04-26T10:24:34.185397+0000","last_undegraded":"2024-04-26T10:24:34.185397+0000","last_fullsized":"2024-04-26T10:24:34.185397+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179856+0000","last_change":"2024-04-26T10:24:22.547974+0000","last_active":"2024-04-26T10:24:34.179856+0000","last_peered":"2024-04-26T10:24:34.179856+0000","last_clean":"2024-04-26T10:24:34.179856+0000","last_became_active":"2024-04-26T10:24:22.546794+0000","last_became_peered":"2024-04-26T10:24:22.546794+0000","last_unstale":"2024-04-26T10:24:34.179856+0000","last_undegraded":"2024-04-26T10:24:34.179856+0000","last_fullsized":"2024-04-26T10:24:34.179856+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:47.236229+0000","last_change":"2024-04-26T10:24:47.236463+0000","last_active":"2024-04-26T10:24:47.236229+0000","last_peered":"2024-04-26T10:24:47.236229+0000","last_clean":"2024-04-26T10:24:47.236229+0000","last_became_active":"2024-04-26T10:24:31.596297+0000","last_became_peered":"2024-04-26T10:24:31.596297+0000","last_unstale":"2024-04-26T10:24:47.236229+0000","last_undegraded":"2024-04-26T10:24:47.236229+0000","last_fullsized":"2024-04-26T10:24:47.236229+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:47.236175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:47.236175+0000","last_clean_scrub_stamp":"2024-04-26T10:24:47.236175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:31.442660+0000","scrub_duration":0.014903458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.318012+0000","last_change":"2024-04-26T10:24:22.684913+0000","last_active":"2024-04-26T10:24:34.318012+0000","last_peered":"2024-04-26T10:24:34.318012+0000","last_clean":"2024-04-26T10:24:34.318012+0000","last_became_active":"2024-04-26T10:24:22.684541+0000","last_became_peered":"2024-04-26T10:24:22.684541+0000","last_unstale":"2024-04-26T10:24:34.318012+0000","last_undegraded":"2024-04-26T10:24:34.318012+0000","last_fullsized":"2024-04-26T10:24:34.318012+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.319358+0000","last_change":"2024-04-26T10:24:22.683787+0000","last_active":"2024-04-26T10:24:34.319358+0000","last_peered":"2024-04-26T10:24:34.319358+0000","last_clean":"2024-04-26T10:24:34.319358+0000","last_became_active":"2024-04-26T10:24:22.682650+0000","last_became_peered":"2024-04-26T10:24:22.682650+0000","last_unstale":"2024-04-26T10:24:34.319358+0000","last_undegraded":"2024-04-26T10:24:34.319358+0000","last_fullsized":"2024-04-26T10:24:34.319358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.184101+0000","last_change":"2024-04-26T10:24:31.601959+0000","last_active":"2024-04-26T10:24:34.184101+0000","last_peered":"2024-04-26T10:24:34.184101+0000","last_clean":"2024-04-26T10:24:34.184101+0000","last_became_active":"2024-04-26T10:24:31.601091+0000","last_became_peered":"2024-04-26T10:24:31.601091+0000","last_unstale":"2024-04-26T10:24:34.184101+0000","last_undegraded":"2024-04-26T10:24:34.184101+0000","last_fullsized":"2024-04-26T10:24:34.184101+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.319799+0000","last_change":"2024-04-26T10:24:22.684603+0000","last_active":"2024-04-26T10:24:34.319799+0000","last_peered":"2024-04-26T10:24:34.319799+0000","last_clean":"2024-04-26T10:24:34.319799+0000","last_became_active":"2024-04-26T10:24:22.684213+0000","last_became_peered":"2024-04-26T10:24:22.684213+0000","last_unstale":"2024-04-26T10:24:34.319799+0000","last_undegraded":"2024-04-26T10:24:34.319799+0000","last_fullsized":"2024-04-26T10:24:34.319799+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179603+0000","last_change":"2024-04-26T10:24:31.613086+0000","last_active":"2024-04-26T10:24:34.179603+0000","last_peered":"2024-04-26T10:24:34.179603+0000","last_clean":"2024-04-26T10:24:34.179603+0000","last_became_active":"2024-04-26T10:24:31.604402+0000","last_became_peered":"2024-04-26T10:24:31.604402+0000","last_unstale":"2024-04-26T10:24:34.179603+0000","last_undegraded":"2024-04-26T10:24:34.179603+0000","last_fullsized":"2024-04-26T10:24:34.179603+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":116,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181661+0000","last_change":"2024-04-26T10:24:31.624641+0000","last_active":"2024-04-26T10:24:34.181661+0000","last_peered":"2024-04-26T10:24:34.181661+0000","last_clean":"2024-04-26T10:24:34.181661+0000","last_became_active":"2024-04-26T10:24:31.604744+0000","last_became_peered":"2024-04-26T10:24:31.604744+0000","last_unstale":"2024-04-26T10:24:34.181661+0000","last_undegraded":"2024-04-26T10:24:34.181661+0000","last_fullsized":"2024-04-26T10:24:34.181661+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":82,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:52.311859+0000","last_change":"2024-04-26T10:24:52.312203+0000","last_active":"2024-04-26T10:24:52.311859+0000","last_peered":"2024-04-26T10:24:52.311859+0000","last_clean":"2024-04-26T10:24:52.311859+0000","last_became_active":"2024-04-26T10:22:09.749862+0000","last_became_peered":"2024-04-26T10:22:09.749862+0000","last_unstale":"2024-04-26T10:24:52.311859+0000","last_undegraded":"2024-04-26T10:24:52.311859+0000","last_fullsized":"2024-04-26T10:24:52.311859+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:52.311773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:52.311773+0000","last_clean_scrub_stamp":"2024-04-26T10:24:52.311773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:12.624461+0000","scrub_duration":0.0034835349999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":74,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.186200+0000","last_change":"2024-04-26T10:22:09.750224+0000","last_active":"2024-04-26T10:24:34.186200+0000","last_peered":"2024-04-26T10:24:34.186200+0000","last_clean":"2024-04-26T10:24:34.186200+0000","last_became_active":"2024-04-26T10:22:09.749852+0000","last_became_peered":"2024-04-26T10:22:09.749852+0000","last_unstale":"2024-04-26T10:24:34.186200+0000","last_undegraded":"2024-04-26T10:24:34.186200+0000","last_fullsized":"2024-04-26T10:24:34.186200+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.184081+0000","last_change":"2024-04-26T10:24:31.597157+0000","last_active":"2024-04-26T10:24:34.184081+0000","last_peered":"2024-04-26T10:24:34.184081+0000","last_clean":"2024-04-26T10:24:34.184081+0000","last_became_active":"2024-04-26T10:24:31.596335+0000","last_became_peered":"2024-04-26T10:24:31.596335+0000","last_unstale":"2024-04-26T10:24:34.184081+0000","last_undegraded":"2024-04-26T10:24:34.184081+0000","last_fullsized":"2024-04-26T10:24:34.184081+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":82,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180625+0000","last_change":"2024-04-26T10:21:08.935133+0000","last_active":"2024-04-26T10:24:34.180625+0000","last_peered":"2024-04-26T10:24:34.180625+0000","last_clean":"2024-04-26T10:24:34.180625+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:24:34.180625+0000","last_undegraded":"2024-04-26T10:24:34.180625+0000","last_fullsized":"2024-04-26T10:24:34.180625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179483+0000","last_change":"2024-04-26T10:24:22.549411+0000","last_active":"2024-04-26T10:24:34.179483+0000","last_peered":"2024-04-26T10:24:34.179483+0000","last_clean":"2024-04-26T10:24:34.179483+0000","last_became_active":"2024-04-26T10:24:22.549230+0000","last_became_peered":"2024-04-26T10:24:22.549230+0000","last_unstale":"2024-04-26T10:24:34.179483+0000","last_undegraded":"2024-04-26T10:24:34.179483+0000","last_fullsized":"2024-04-26T10:24:34.179483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180750+0000","last_change":"2024-04-26T10:24:22.541409+0000","last_active":"2024-04-26T10:24:34.180750+0000","last_peered":"2024-04-26T10:24:34.180750+0000","last_clean":"2024-04-26T10:24:34.180750+0000","last_became_active":"2024-04-26T10:24:22.540611+0000","last_became_peered":"2024-04-26T10:24:22.540611+0000","last_unstale":"2024-04-26T10:24:34.180750+0000","last_undegraded":"2024-04-26T10:24:34.180750+0000","last_fullsized":"2024-04-26T10:24:34.180750+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.319103+0000","last_change":"2024-04-26T10:24:22.687178+0000","last_active":"2024-04-26T10:24:34.319103+0000","last_peered":"2024-04-26T10:24:34.319103+0000","last_clean":"2024-04-26T10:24:34.319103+0000","last_became_active":"2024-04-26T10:24:22.686841+0000","last_became_peered":"2024-04-26T10:24:22.686841+0000","last_unstale":"2024-04-26T10:24:34.319103+0000","last_undegraded":"2024-04-26T10:24:34.319103+0000","last_fullsized":"2024-04-26T10:24:34.319103+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.318824+0000","last_change":"2024-04-26T10:24:22.687183+0000","last_active":"2024-04-26T10:24:34.318824+0000","last_peered":"2024-04-26T10:24:34.318824+0000","last_clean":"2024-04-26T10:24:34.318824+0000","last_became_active":"2024-04-26T10:24:22.686846+0000","last_became_peered":"2024-04-26T10:24:22.686846+0000","last_unstale":"2024-04-26T10:24:34.318824+0000","last_undegraded":"2024-04-26T10:24:34.318824+0000","last_fullsized":"2024-04-26T10:24:34.318824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180736+0000","last_change":"2024-04-26T10:24:22.546117+0000","last_active":"2024-04-26T10:24:34.180736+0000","last_peered":"2024-04-26T10:24:34.180736+0000","last_clean":"2024-04-26T10:24:34.180736+0000","last_became_active":"2024-04-26T10:24:22.545616+0000","last_became_peered":"2024-04-26T10:24:22.545616+0000","last_unstale":"2024-04-26T10:24:34.180736+0000","last_undegraded":"2024-04-26T10:24:34.180736+0000","last_fullsized":"2024-04-26T10:24:34.180736+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179772+0000","last_change":"2024-04-26T10:24:22.540185+0000","last_active":"2024-04-26T10:24:34.179772+0000","last_peered":"2024-04-26T10:24:34.179772+0000","last_clean":"2024-04-26T10:24:34.179772+0000","last_became_active":"2024-04-26T10:24:22.538982+0000","last_became_peered":"2024-04-26T10:24:22.538982+0000","last_unstale":"2024-04-26T10:24:34.179772+0000","last_undegraded":"2024-04-26T10:24:34.179772+0000","last_fullsized":"2024-04-26T10:24:34.179772+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":80,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180846+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:24:34.180846+0000","last_peered":"2024-04-26T10:24:34.180846+0000","last_clean":"2024-04-26T10:24:34.180846+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:24:34.180846+0000","last_undegraded":"2024-04-26T10:24:34.180846+0000","last_fullsized":"2024-04-26T10:24:34.180846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.184516+0000","last_change":"2024-04-26T10:22:09.748616+0000","last_active":"2024-04-26T10:24:34.184516+0000","last_peered":"2024-04-26T10:24:34.184516+0000","last_clean":"2024-04-26T10:24:34.184516+0000","last_became_active":"2024-04-26T10:22:09.748256+0000","last_became_peered":"2024-04-26T10:22:09.748256+0000","last_unstale":"2024-04-26T10:24:34.184516+0000","last_undegraded":"2024-04-26T10:24:34.184516+0000","last_fullsized":"2024-04-26T10:24:34.184516+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180622+0000","last_change":"2024-04-26T10:24:31.604150+0000","last_active":"2024-04-26T10:24:34.180622+0000","last_peered":"2024-04-26T10:24:34.180622+0000","last_clean":"2024-04-26T10:24:34.180622+0000","last_became_active":"2024-04-26T10:24:31.603620+0000","last_became_peered":"2024-04-26T10:24:31.603620+0000","last_unstale":"2024-04-26T10:24:34.180622+0000","last_undegraded":"2024-04-26T10:24:34.180622+0000","last_fullsized":"2024-04-26T10:24:34.180622+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.184530+0000","last_change":"2024-04-26T10:24:31.598521+0000","last_active":"2024-04-26T10:24:34.184530+0000","last_peered":"2024-04-26T10:24:34.184530+0000","last_clean":"2024-04-26T10:24:34.184530+0000","last_became_active":"2024-04-26T10:24:31.598120+0000","last_became_peered":"2024-04-26T10:24:31.598120+0000","last_unstale":"2024-04-26T10:24:34.184530+0000","last_undegraded":"2024-04-26T10:24:34.184530+0000","last_fullsized":"2024-04-26T10:24:34.184530+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:57.789264+0000","last_change":"2024-04-26T10:24:57.789439+0000","last_active":"2024-04-26T10:24:57.789264+0000","last_peered":"2024-04-26T10:24:57.789264+0000","last_clean":"2024-04-26T10:24:57.789264+0000","last_became_active":"2024-04-26T10:24:22.679940+0000","last_became_peered":"2024-04-26T10:24:22.679940+0000","last_unstale":"2024-04-26T10:24:57.789264+0000","last_undegraded":"2024-04-26T10:24:57.789264+0000","last_fullsized":"2024-04-26T10:24:57.789264+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:57.789236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:57.789236+0000","last_clean_scrub_stamp":"2024-04-26T10:24:57.789236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:34.365027+0000","scrub_duration":0.045365677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":335,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674349+0000","last_change":"2024-04-26T10:24:34.185235+0000","last_active":"2024-04-26T10:24:43.674349+0000","last_peered":"2024-04-26T10:24:43.674349+0000","last_clean":"2024-04-26T10:24:43.674349+0000","last_became_active":"2024-04-26T10:24:34.184490+0000","last_became_peered":"2024-04-26T10:24:34.184490+0000","last_unstale":"2024-04-26T10:24:43.674349+0000","last_undegraded":"2024-04-26T10:24:43.674349+0000","last_fullsized":"2024-04-26T10:24:43.674349+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":97,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179295+0000","last_change":"2024-04-26T10:24:22.547708+0000","last_active":"2024-04-26T10:24:34.179295+0000","last_peered":"2024-04-26T10:24:34.179295+0000","last_clean":"2024-04-26T10:24:34.179295+0000","last_became_active":"2024-04-26T10:24:22.546650+0000","last_became_peered":"2024-04-26T10:24:22.546650+0000","last_unstale":"2024-04-26T10:24:34.179295+0000","last_undegraded":"2024-04-26T10:24:34.179295+0000","last_fullsized":"2024-04-26T10:24:34.179295+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:49.697780+0000","last_change":"2024-04-26T10:24:49.698037+0000","last_active":"2024-04-26T10:24:49.697780+0000","last_peered":"2024-04-26T10:24:49.697780+0000","last_clean":"2024-04-26T10:24:49.697780+0000","last_became_active":"2024-04-26T10:24:22.676489+0000","last_became_peered":"2024-04-26T10:24:22.676489+0000","last_unstale":"2024-04-26T10:24:49.697780+0000","last_undegraded":"2024-04-26T10:24:49.697780+0000","last_fullsized":"2024-04-26T10:24:49.697780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:49.697735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:49.697735+0000","last_clean_scrub_stamp":"2024-04-26T10:24:49.697735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:32.374320+0000","scrub_duration":0.0030634690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180882+0000","last_change":"2024-04-26T10:24:31.603833+0000","last_active":"2024-04-26T10:24:34.180882+0000","last_peered":"2024-04-26T10:24:34.180882+0000","last_clean":"2024-04-26T10:24:34.180882+0000","last_became_active":"2024-04-26T10:24:31.603498+0000","last_became_peered":"2024-04-26T10:24:31.603498+0000","last_unstale":"2024-04-26T10:24:34.180882+0000","last_undegraded":"2024-04-26T10:24:34.180882+0000","last_fullsized":"2024-04-26T10:24:34.180882+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":110,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180007+0000","last_change":"2024-04-26T10:24:31.603067+0000","last_active":"2024-04-26T10:24:34.180007+0000","last_peered":"2024-04-26T10:24:34.180007+0000","last_clean":"2024-04-26T10:24:34.180007+0000","last_became_active":"2024-04-26T10:24:31.602611+0000","last_became_peered":"2024-04-26T10:24:31.602611+0000","last_unstale":"2024-04-26T10:24:34.180007+0000","last_undegraded":"2024-04-26T10:24:34.180007+0000","last_fullsized":"2024-04-26T10:24:34.180007+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.317536+0000","last_change":"2024-04-26T10:24:22.685554+0000","last_active":"2024-04-26T10:24:34.317536+0000","last_peered":"2024-04-26T10:24:34.317536+0000","last_clean":"2024-04-26T10:24:34.317536+0000","last_became_active":"2024-04-26T10:24:22.685051+0000","last_became_peered":"2024-04-26T10:24:22.685051+0000","last_unstale":"2024-04-26T10:24:34.317536+0000","last_undegraded":"2024-04-26T10:24:34.317536+0000","last_fullsized":"2024-04-26T10:24:34.317536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.186096+0000","last_change":"2024-04-26T10:24:22.538294+0000","last_active":"2024-04-26T10:24:34.186096+0000","last_peered":"2024-04-26T10:24:34.186096+0000","last_clean":"2024-04-26T10:24:34.186096+0000","last_became_active":"2024-04-26T10:24:22.537983+0000","last_became_peered":"2024-04-26T10:24:22.537983+0000","last_unstale":"2024-04-26T10:24:34.186096+0000","last_undegraded":"2024-04-26T10:24:34.186096+0000","last_fullsized":"2024-04-26T10:24:34.186096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:47.630110+0000","last_change":"2024-04-26T10:24:47.630379+0000","last_active":"2024-04-26T10:24:47.630110+0000","last_peered":"2024-04-26T10:24:47.630110+0000","last_clean":"2024-04-26T10:24:47.630110+0000","last_became_active":"2024-04-26T10:24:22.678866+0000","last_became_peered":"2024-04-26T10:24:22.678866+0000","last_unstale":"2024-04-26T10:24:47.630110+0000","last_undegraded":"2024-04-26T10:24:47.630110+0000","last_fullsized":"2024-04-26T10:24:47.630110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:47.630061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:47.630061+0000","last_clean_scrub_stamp":"2024-04-26T10:24:47.630061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:03.378559+0000","scrub_duration":0.003470571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.184863+0000","last_change":"2024-04-26T10:22:09.750297+0000","last_active":"2024-04-26T10:24:34.184863+0000","last_peered":"2024-04-26T10:24:34.184863+0000","last_clean":"2024-04-26T10:24:34.184863+0000","last_became_active":"2024-04-26T10:22:09.749935+0000","last_became_peered":"2024-04-26T10:22:09.749935+0000","last_unstale":"2024-04-26T10:24:34.184863+0000","last_undegraded":"2024-04-26T10:24:34.184863+0000","last_fullsized":"2024-04-26T10:24:34.184863+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.320254+0000","last_change":"2024-04-26T10:24:31.745820+0000","last_active":"2024-04-26T10:24:34.320254+0000","last_peered":"2024-04-26T10:24:34.320254+0000","last_clean":"2024-04-26T10:24:34.320254+0000","last_became_active":"2024-04-26T10:24:31.745487+0000","last_became_peered":"2024-04-26T10:24:31.745487+0000","last_unstale":"2024-04-26T10:24:34.320254+0000","last_undegraded":"2024-04-26T10:24:34.320254+0000","last_fullsized":"2024-04-26T10:24:34.320254+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":97,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179933+0000","last_change":"2024-04-26T10:24:22.539761+0000","last_active":"2024-04-26T10:24:34.179933+0000","last_peered":"2024-04-26T10:24:34.179933+0000","last_clean":"2024-04-26T10:24:34.179933+0000","last_became_active":"2024-04-26T10:24:22.538993+0000","last_became_peered":"2024-04-26T10:24:22.538993+0000","last_unstale":"2024-04-26T10:24:34.179933+0000","last_undegraded":"2024-04-26T10:24:34.179933+0000","last_fullsized":"2024-04-26T10:24:34.179933+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179686+0000","last_change":"2024-04-26T10:24:22.542774+0000","last_active":"2024-04-26T10:24:34.179686+0000","last_peered":"2024-04-26T10:24:34.179686+0000","last_clean":"2024-04-26T10:24:34.179686+0000","last_became_active":"2024-04-26T10:24:22.541795+0000","last_became_peered":"2024-04-26T10:24:22.541795+0000","last_unstale":"2024-04-26T10:24:34.179686+0000","last_undegraded":"2024-04-26T10:24:34.179686+0000","last_fullsized":"2024-04-26T10:24:34.179686+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:46.642214+0000","last_change":"2024-04-26T10:24:46.642441+0000","last_active":"2024-04-26T10:24:46.642214+0000","last_peered":"2024-04-26T10:24:46.642214+0000","last_clean":"2024-04-26T10:24:46.642214+0000","last_became_active":"2024-04-26T10:24:31.744373+0000","last_became_peered":"2024-04-26T10:24:31.744373+0000","last_unstale":"2024-04-26T10:24:46.642214+0000","last_undegraded":"2024-04-26T10:24:46.642214+0000","last_fullsized":"2024-04-26T10:24:46.642214+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:46.642168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:46.642168+0000","last_clean_scrub_stamp":"2024-04-26T10:24:46.642168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:47.970345+0000","scrub_duration":0.0030956120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180484+0000","last_change":"2024-04-26T10:24:22.538573+0000","last_active":"2024-04-26T10:24:34.180484+0000","last_peered":"2024-04-26T10:24:34.180484+0000","last_clean":"2024-04-26T10:24:34.180484+0000","last_became_active":"2024-04-26T10:24:22.537041+0000","last_became_peered":"2024-04-26T10:24:22.537041+0000","last_unstale":"2024-04-26T10:24:34.180484+0000","last_undegraded":"2024-04-26T10:24:34.180484+0000","last_fullsized":"2024-04-26T10:24:34.180484+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.318684+0000","last_change":"2024-04-26T10:24:31.744776+0000","last_active":"2024-04-26T10:24:34.318684+0000","last_peered":"2024-04-26T10:24:34.318684+0000","last_clean":"2024-04-26T10:24:34.318684+0000","last_became_active":"2024-04-26T10:24:31.744342+0000","last_became_peered":"2024-04-26T10:24:31.744342+0000","last_unstale":"2024-04-26T10:24:34.318684+0000","last_undegraded":"2024-04-26T10:24:34.318684+0000","last_fullsized":"2024-04-26T10:24:34.318684+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:53.288634+0000","last_change":"2024-04-26T10:24:53.288881+0000","last_active":"2024-04-26T10:24:53.288634+0000","last_peered":"2024-04-26T10:24:53.288634+0000","last_clean":"2024-04-26T10:24:53.288634+0000","last_became_active":"2024-04-26T10:24:31.598432+0000","last_became_peered":"2024-04-26T10:24:31.598432+0000","last_unstale":"2024-04-26T10:24:53.288634+0000","last_undegraded":"2024-04-26T10:24:53.288634+0000","last_fullsized":"2024-04-26T10:24:53.288634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:53.288587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:53.288587+0000","last_clean_scrub_stamp":"2024-04-26T10:24:53.288587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:25.869325+0000","scrub_duration":0.003660567,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.319134+0000","last_change":"2024-04-26T10:24:31.745336+0000","last_active":"2024-04-26T10:24:34.319134+0000","last_peered":"2024-04-26T10:24:34.319134+0000","last_clean":"2024-04-26T10:24:34.319134+0000","last_became_active":"2024-04-26T10:24:31.745004+0000","last_became_peered":"2024-04-26T10:24:31.745004+0000","last_unstale":"2024-04-26T10:24:34.319134+0000","last_undegraded":"2024-04-26T10:24:34.319134+0000","last_fullsized":"2024-04-26T10:24:34.319134+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.186551+0000","last_change":"2024-04-26T10:24:31.601585+0000","last_active":"2024-04-26T10:24:34.186551+0000","last_peered":"2024-04-26T10:24:34.186551+0000","last_clean":"2024-04-26T10:24:34.186551+0000","last_became_active":"2024-04-26T10:24:31.600977+0000","last_became_peered":"2024-04-26T10:24:31.600977+0000","last_unstale":"2024-04-26T10:24:34.186551+0000","last_undegraded":"2024-04-26T10:24:34.186551+0000","last_fullsized":"2024-04-26T10:24:34.186551+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":82,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:03.280361+0000","last_change":"2024-04-26T10:25:03.280598+0000","last_active":"2024-04-26T10:25:03.280361+0000","last_peered":"2024-04-26T10:25:03.280361+0000","last_clean":"2024-04-26T10:25:03.280361+0000","last_became_active":"2024-04-26T10:22:09.757813+0000","last_became_peered":"2024-04-26T10:22:09.757813+0000","last_unstale":"2024-04-26T10:25:03.280361+0000","last_undegraded":"2024-04-26T10:25:03.280361+0000","last_fullsized":"2024-04-26T10:25:03.280361+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:03.280310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:03.280310+0000","last_clean_scrub_stamp":"2024-04-26T10:25:03.280310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:49.626354+0000","scrub_duration":0.0030957509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.319898+0000","last_change":"2024-04-26T10:24:22.680137+0000","last_active":"2024-04-26T10:24:34.319898+0000","last_peered":"2024-04-26T10:24:34.319898+0000","last_clean":"2024-04-26T10:24:34.319898+0000","last_became_active":"2024-04-26T10:24:22.679497+0000","last_became_peered":"2024-04-26T10:24:22.679497+0000","last_unstale":"2024-04-26T10:24:34.319898+0000","last_undegraded":"2024-04-26T10:24:34.319898+0000","last_fullsized":"2024-04-26T10:24:34.319898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.319521+0000","last_change":"2024-04-26T10:24:31.741102+0000","last_active":"2024-04-26T10:24:34.319521+0000","last_peered":"2024-04-26T10:24:34.319521+0000","last_clean":"2024-04-26T10:24:34.319521+0000","last_became_active":"2024-04-26T10:24:31.740589+0000","last_became_peered":"2024-04-26T10:24:31.740589+0000","last_unstale":"2024-04-26T10:24:34.319521+0000","last_undegraded":"2024-04-26T10:24:34.319521+0000","last_fullsized":"2024-04-26T10:24:34.319521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.317906+0000","last_change":"2024-04-26T10:24:22.686404+0000","last_active":"2024-04-26T10:24:34.317906+0000","last_peered":"2024-04-26T10:24:34.317906+0000","last_clean":"2024-04-26T10:24:34.317906+0000","last_became_active":"2024-04-26T10:24:22.686094+0000","last_became_peered":"2024-04-26T10:24:22.686094+0000","last_unstale":"2024-04-26T10:24:34.317906+0000","last_undegraded":"2024-04-26T10:24:34.317906+0000","last_fullsized":"2024-04-26T10:24:34.317906+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.319143+0000","last_change":"2024-04-26T10:24:22.682344+0000","last_active":"2024-04-26T10:24:34.319143+0000","last_peered":"2024-04-26T10:24:34.319143+0000","last_clean":"2024-04-26T10:24:34.319143+0000","last_became_active":"2024-04-26T10:24:22.681977+0000","last_became_peered":"2024-04-26T10:24:22.681977+0000","last_unstale":"2024-04-26T10:24:34.319143+0000","last_undegraded":"2024-04-26T10:24:34.319143+0000","last_fullsized":"2024-04-26T10:24:34.319143+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181635+0000","last_change":"2024-04-26T10:24:31.605320+0000","last_active":"2024-04-26T10:24:34.181635+0000","last_peered":"2024-04-26T10:24:34.181635+0000","last_clean":"2024-04-26T10:24:34.181635+0000","last_became_active":"2024-04-26T10:24:31.604158+0000","last_became_peered":"2024-04-26T10:24:31.604158+0000","last_unstale":"2024-04-26T10:24:34.181635+0000","last_undegraded":"2024-04-26T10:24:34.181635+0000","last_fullsized":"2024-04-26T10:24:34.181635+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.184280+0000","last_change":"2024-04-26T10:24:31.601291+0000","last_active":"2024-04-26T10:24:34.184280+0000","last_peered":"2024-04-26T10:24:34.184280+0000","last_clean":"2024-04-26T10:24:34.184280+0000","last_became_active":"2024-04-26T10:24:31.600474+0000","last_became_peered":"2024-04-26T10:24:31.600474+0000","last_unstale":"2024-04-26T10:24:34.184280+0000","last_undegraded":"2024-04-26T10:24:34.184280+0000","last_fullsized":"2024-04-26T10:24:34.184280+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":117,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:59.250105+0000","last_change":"2024-04-26T10:24:59.250347+0000","last_active":"2024-04-26T10:24:59.250105+0000","last_peered":"2024-04-26T10:24:59.250105+0000","last_clean":"2024-04-26T10:24:59.250105+0000","last_became_active":"2024-04-26T10:24:31.604609+0000","last_became_peered":"2024-04-26T10:24:31.604609+0000","last_unstale":"2024-04-26T10:24:59.250105+0000","last_undegraded":"2024-04-26T10:24:59.250105+0000","last_fullsized":"2024-04-26T10:24:59.250105+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:59.250058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:59.250058+0000","last_clean_scrub_stamp":"2024-04-26T10:24:59.250058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:27.888233+0000","scrub_duration":0.0035158640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":133,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180323+0000","last_change":"2024-04-26T10:24:31.622111+0000","last_active":"2024-04-26T10:24:34.180323+0000","last_peered":"2024-04-26T10:24:34.180323+0000","last_clean":"2024-04-26T10:24:34.180323+0000","last_became_active":"2024-04-26T10:24:31.604884+0000","last_became_peered":"2024-04-26T10:24:31.604884+0000","last_unstale":"2024-04-26T10:24:34.180323+0000","last_undegraded":"2024-04-26T10:24:34.180323+0000","last_fullsized":"2024-04-26T10:24:34.180323+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.317942+0000","last_change":"2024-04-26T10:24:31.739955+0000","last_active":"2024-04-26T10:24:34.317942+0000","last_peered":"2024-04-26T10:24:34.317942+0000","last_clean":"2024-04-26T10:24:34.317942+0000","last_became_active":"2024-04-26T10:24:31.739550+0000","last_became_peered":"2024-04-26T10:24:31.739550+0000","last_unstale":"2024-04-26T10:24:34.317942+0000","last_undegraded":"2024-04-26T10:24:34.317942+0000","last_fullsized":"2024-04-26T10:24:34.317942+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:02.311259+0000","last_change":"2024-04-26T10:25:02.311507+0000","last_active":"2024-04-26T10:25:02.311259+0000","last_peered":"2024-04-26T10:25:02.311259+0000","last_clean":"2024-04-26T10:25:02.311259+0000","last_became_active":"2024-04-26T10:24:31.601218+0000","last_became_peered":"2024-04-26T10:24:31.601218+0000","last_unstale":"2024-04-26T10:25:02.311259+0000","last_undegraded":"2024-04-26T10:25:02.311259+0000","last_fullsized":"2024-04-26T10:25:02.311259+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'5","last_scrub_stamp":"2024-04-26T10:25:02.311211+0000","last_deep_scrub":"91'5","last_deep_scrub_stamp":"2024-04-26T10:25:02.311211+0000","last_clean_scrub_stamp":"2024-04-26T10:25:02.311211+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:46.605747+0000","scrub_duration":0.0088437829999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181348+0000","last_change":"2024-04-26T10:24:22.546807+0000","last_active":"2024-04-26T10:24:34.181348+0000","last_peered":"2024-04-26T10:24:34.181348+0000","last_clean":"2024-04-26T10:24:34.181348+0000","last_became_active":"2024-04-26T10:24:22.546378+0000","last_became_peered":"2024-04-26T10:24:22.546378+0000","last_unstale":"2024-04-26T10:24:34.181348+0000","last_undegraded":"2024-04-26T10:24:34.181348+0000","last_fullsized":"2024-04-26T10:24:34.181348+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.317907+0000","last_change":"2024-04-26T10:24:22.684096+0000","last_active":"2024-04-26T10:24:34.317907+0000","last_peered":"2024-04-26T10:24:34.317907+0000","last_clean":"2024-04-26T10:24:34.317907+0000","last_became_active":"2024-04-26T10:24:22.683558+0000","last_became_peered":"2024-04-26T10:24:22.683558+0000","last_unstale":"2024-04-26T10:24:34.317907+0000","last_undegraded":"2024-04-26T10:24:34.317907+0000","last_fullsized":"2024-04-26T10:24:34.317907+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:50.729192+0000","last_change":"2024-04-26T10:24:50.729571+0000","last_active":"2024-04-26T10:24:50.729192+0000","last_peered":"2024-04-26T10:24:50.729192+0000","last_clean":"2024-04-26T10:24:50.729192+0000","last_became_active":"2024-04-26T10:24:22.684166+0000","last_became_peered":"2024-04-26T10:24:22.684166+0000","last_unstale":"2024-04-26T10:24:50.729192+0000","last_undegraded":"2024-04-26T10:24:50.729192+0000","last_fullsized":"2024-04-26T10:24:50.729192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:50.729143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:50.729143+0000","last_clean_scrub_stamp":"2024-04-26T10:24:50.729143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:54.166410+0000","scrub_duration":0.003288118,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.317715+0000","last_change":"2024-04-26T10:24:31.745539+0000","last_active":"2024-04-26T10:24:34.317715+0000","last_peered":"2024-04-26T10:24:34.317715+0000","last_clean":"2024-04-26T10:24:34.317715+0000","last_became_active":"2024-04-26T10:24:31.745216+0000","last_became_peered":"2024-04-26T10:24:31.745216+0000","last_unstale":"2024-04-26T10:24:34.317715+0000","last_undegraded":"2024-04-26T10:24:34.317715+0000","last_fullsized":"2024-04-26T10:24:34.317715+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":71,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.186379+0000","last_change":"2024-04-26T10:22:09.750605+0000","last_active":"2024-04-26T10:24:34.186379+0000","last_peered":"2024-04-26T10:24:34.186379+0000","last_clean":"2024-04-26T10:24:34.186379+0000","last_became_active":"2024-04-26T10:22:09.750359+0000","last_became_peered":"2024-04-26T10:22:09.750359+0000","last_unstale":"2024-04-26T10:24:34.186379+0000","last_undegraded":"2024-04-26T10:24:34.186379+0000","last_fullsized":"2024-04-26T10:24:34.186379+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.317461+0000","last_change":"2024-04-26T10:24:31.740907+0000","last_active":"2024-04-26T10:24:34.317461+0000","last_peered":"2024-04-26T10:24:34.317461+0000","last_clean":"2024-04-26T10:24:34.317461+0000","last_became_active":"2024-04-26T10:24:31.740477+0000","last_became_peered":"2024-04-26T10:24:31.740477+0000","last_unstale":"2024-04-26T10:24:34.317461+0000","last_undegraded":"2024-04-26T10:24:34.317461+0000","last_fullsized":"2024-04-26T10:24:34.317461+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:48.666410+0000","last_change":"2024-04-26T10:24:48.666739+0000","last_active":"2024-04-26T10:24:48.666410+0000","last_peered":"2024-04-26T10:24:48.666410+0000","last_clean":"2024-04-26T10:24:48.666410+0000","last_became_active":"2024-04-26T10:24:22.683501+0000","last_became_peered":"2024-04-26T10:24:22.683501+0000","last_unstale":"2024-04-26T10:24:48.666410+0000","last_undegraded":"2024-04-26T10:24:48.666410+0000","last_fullsized":"2024-04-26T10:24:48.666410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:48.666365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:48.666365+0000","last_clean_scrub_stamp":"2024-04-26T10:24:48.666365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:11.797360+0000","scrub_duration":0.003127285,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.317628+0000","last_change":"2024-04-26T10:24:22.685228+0000","last_active":"2024-04-26T10:24:34.317628+0000","last_peered":"2024-04-26T10:24:34.317628+0000","last_clean":"2024-04-26T10:24:34.317628+0000","last_became_active":"2024-04-26T10:24:22.684469+0000","last_became_peered":"2024-04-26T10:24:22.684469+0000","last_unstale":"2024-04-26T10:24:34.317628+0000","last_undegraded":"2024-04-26T10:24:34.317628+0000","last_fullsized":"2024-04-26T10:24:34.317628+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":71,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185564+0000","last_change":"2024-04-26T10:22:09.753136+0000","last_active":"2024-04-26T10:24:34.185564+0000","last_peered":"2024-04-26T10:24:34.185564+0000","last_clean":"2024-04-26T10:24:34.185564+0000","last_became_active":"2024-04-26T10:22:09.752856+0000","last_became_peered":"2024-04-26T10:22:09.752856+0000","last_unstale":"2024-04-26T10:24:34.185564+0000","last_undegraded":"2024-04-26T10:24:34.185564+0000","last_fullsized":"2024-04-26T10:24:34.185564+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185132+0000","last_change":"2024-04-26T10:24:22.535413+0000","last_active":"2024-04-26T10:24:34.185132+0000","last_peered":"2024-04-26T10:24:34.185132+0000","last_clean":"2024-04-26T10:24:34.185132+0000","last_became_active":"2024-04-26T10:24:22.535036+0000","last_became_peered":"2024-04-26T10:24:22.535036+0000","last_unstale":"2024-04-26T10:24:34.185132+0000","last_undegraded":"2024-04-26T10:24:34.185132+0000","last_fullsized":"2024-04-26T10:24:34.185132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185963+0000","last_change":"2024-04-26T10:24:22.535819+0000","last_active":"2024-04-26T10:24:34.185963+0000","last_peered":"2024-04-26T10:24:34.185963+0000","last_clean":"2024-04-26T10:24:34.185963+0000","last_became_active":"2024-04-26T10:24:22.535562+0000","last_became_peered":"2024-04-26T10:24:22.535562+0000","last_unstale":"2024-04-26T10:24:34.185963+0000","last_undegraded":"2024-04-26T10:24:34.185963+0000","last_fullsized":"2024-04-26T10:24:34.185963+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.184722+0000","last_change":"2024-04-26T10:24:31.600594+0000","last_active":"2024-04-26T10:24:34.184722+0000","last_peered":"2024-04-26T10:24:34.184722+0000","last_clean":"2024-04-26T10:24:34.184722+0000","last_became_active":"2024-04-26T10:24:31.600121+0000","last_became_peered":"2024-04-26T10:24:31.600121+0000","last_unstale":"2024-04-26T10:24:34.184722+0000","last_undegraded":"2024-04-26T10:24:34.184722+0000","last_fullsized":"2024-04-26T10:24:34.184722+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180293+0000","last_change":"2024-04-26T10:24:22.542755+0000","last_active":"2024-04-26T10:24:34.180293+0000","last_peered":"2024-04-26T10:24:34.180293+0000","last_clean":"2024-04-26T10:24:34.180293+0000","last_became_active":"2024-04-26T10:24:22.541543+0000","last_became_peered":"2024-04-26T10:24:22.541543+0000","last_unstale":"2024-04-26T10:24:34.180293+0000","last_undegraded":"2024-04-26T10:24:34.180293+0000","last_fullsized":"2024-04-26T10:24:34.180293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"91'3","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:02.282549+0000","last_change":"2024-04-26T10:25:02.282898+0000","last_active":"2024-04-26T10:25:02.282549+0000","last_peered":"2024-04-26T10:25:02.282549+0000","last_clean":"2024-04-26T10:25:02.282549+0000","last_became_active":"2024-04-26T10:24:22.540767+0000","last_became_peered":"2024-04-26T10:24:22.540767+0000","last_unstale":"2024-04-26T10:25:02.282549+0000","last_undegraded":"2024-04-26T10:25:02.282549+0000","last_fullsized":"2024-04-26T10:25:02.282549+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:02.282431+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:02.282431+0000","last_clean_scrub_stamp":"2024-04-26T10:25:02.282431+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:51.767663+0000","scrub_duration":0.0068591950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179689+0000","last_change":"2024-04-26T10:24:22.547294+0000","last_active":"2024-04-26T10:24:34.179689+0000","last_peered":"2024-04-26T10:24:34.179689+0000","last_clean":"2024-04-26T10:24:34.179689+0000","last_became_active":"2024-04-26T10:24:22.546811+0000","last_became_peered":"2024-04-26T10:24:22.546811+0000","last_unstale":"2024-04-26T10:24:34.179689+0000","last_undegraded":"2024-04-26T10:24:34.179689+0000","last_fullsized":"2024-04-26T10:24:34.179689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":74,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185835+0000","last_change":"2024-04-26T10:22:09.753438+0000","last_active":"2024-04-26T10:24:34.185835+0000","last_peered":"2024-04-26T10:24:34.185835+0000","last_clean":"2024-04-26T10:24:34.185835+0000","last_became_active":"2024-04-26T10:22:09.753211+0000","last_became_peered":"2024-04-26T10:22:09.753211+0000","last_unstale":"2024-04-26T10:24:34.185835+0000","last_undegraded":"2024-04-26T10:24:34.185835+0000","last_fullsized":"2024-04-26T10:24:34.185835+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:50.293783+0000","last_change":"2024-04-26T10:24:50.293998+0000","last_active":"2024-04-26T10:24:50.293783+0000","last_peered":"2024-04-26T10:24:50.293783+0000","last_clean":"2024-04-26T10:24:50.293783+0000","last_became_active":"2024-04-26T10:24:31.600088+0000","last_became_peered":"2024-04-26T10:24:31.600088+0000","last_unstale":"2024-04-26T10:24:50.293783+0000","last_undegraded":"2024-04-26T10:24:50.293783+0000","last_fullsized":"2024-04-26T10:24:50.293783+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:50.293726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:50.293726+0000","last_clean_scrub_stamp":"2024-04-26T10:24:50.293726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.398875+0000","scrub_duration":0.014652757000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.319929+0000","last_change":"2024-04-26T10:24:22.680082+0000","last_active":"2024-04-26T10:24:34.319929+0000","last_peered":"2024-04-26T10:24:34.319929+0000","last_clean":"2024-04-26T10:24:34.319929+0000","last_became_active":"2024-04-26T10:24:22.679652+0000","last_became_peered":"2024-04-26T10:24:22.679652+0000","last_unstale":"2024-04-26T10:24:34.319929+0000","last_undegraded":"2024-04-26T10:24:34.319929+0000","last_fullsized":"2024-04-26T10:24:34.319929+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:01.257225+0000","last_change":"2024-04-26T10:25:01.257447+0000","last_active":"2024-04-26T10:25:01.257225+0000","last_peered":"2024-04-26T10:25:01.257225+0000","last_clean":"2024-04-26T10:25:01.257225+0000","last_became_active":"2024-04-26T10:24:22.538895+0000","last_became_peered":"2024-04-26T10:24:22.538895+0000","last_unstale":"2024-04-26T10:25:01.257225+0000","last_undegraded":"2024-04-26T10:25:01.257225+0000","last_fullsized":"2024-04-26T10:25:01.257225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:01.257171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:01.257171+0000","last_clean_scrub_stamp":"2024-04-26T10:25:01.257171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:55.289475+0000","scrub_duration":0.0032699750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.320374+0000","last_change":"2024-04-26T10:24:22.685454+0000","last_active":"2024-04-26T10:24:34.320374+0000","last_peered":"2024-04-26T10:24:34.320374+0000","last_clean":"2024-04-26T10:24:34.320374+0000","last_became_active":"2024-04-26T10:24:22.684863+0000","last_became_peered":"2024-04-26T10:24:22.684863+0000","last_unstale":"2024-04-26T10:24:34.320374+0000","last_undegraded":"2024-04-26T10:24:34.320374+0000","last_fullsized":"2024-04-26T10:24:34.320374+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":21541,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673014,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279064,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":278014,"kb_avail":94092776,"statfs":{"total":96636764160,"available":96351002624,"internally_reserved":0,"allocated":1064960,"data_stored":1035671,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":284686790},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:24:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55000000000000004,"15min":0.51600000000000001},"min":{"1min":0.25800000000000001,"5min":0.192,"15min":0.192},"max":{"1min":0.67500000000000004,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.51800000000000002,"15min":0.53900000000000003},"min":{"1min":0.28000000000000003,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.754,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":0,"up_from":10,"seq":42949673013,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487472,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":486398,"kb_avail":93884368,"statfs":{"total":96636764160,"available":96137592832,"internally_reserved":0,"allocated":1089536,"data_stored":1036287,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":498072006},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:24:04 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.65600000000000003,"15min":0.56599999999999995},"min":{"1min":0.21099999999999999,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":4.1369999999999996,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.25900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.748,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.627}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":2,"up_from":80,"seq":343597383690,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38368,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":37369,"kb_avail":94333472,"statfs":{"total":96636764160,"available":96597475328,"internally_reserved":0,"allocated":1007616,"data_stored":444173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6879,"internal_metadata":38266145},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:25:05.361 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.361 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.361 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.361 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.362 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.362 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.362 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.362 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.362 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.362 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.362 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.362 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.363 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.363 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.363 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.363 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.363 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.363 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.363 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.363 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.363 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.364 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.364 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.364 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.364 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.364 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.364 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.364 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.364 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.364 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.365 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.365 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.365 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.365 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.365 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.365 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.365 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.365 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.365 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.366 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.366 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.366 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.366 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T10:21:00.797402+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.366 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.366 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.366 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.366 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.367 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.367 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.367 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.367 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.367 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.367 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.367 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.367 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.367 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.368 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.368 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.368 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.368 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.368 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.368 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.368 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.368 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.368 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.369 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.369 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.369 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.369 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.369 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.369 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.369 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.369 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.369 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.370 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.370 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.370 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.370 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.370 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:05.370 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:25:25.371 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:25:25.700 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:25:25.702 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:25:25.713 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2024-04-26T10:25:24.058660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1184088,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":788520,"kb_used_data":3088,"kb_used_omap":9,"kb_used_meta":785398,"kb_avail":282327000,"statfs":{"total":289910292480,"available":289102848000,"internally_reserved":0,"allocated":3162112,"data_stored":2516131,"data_compressed":14075,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":10067,"internal_metadata":804247725},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004434"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185894+0000","last_change":"2024-04-26T10:24:31.598789+0000","last_active":"2024-04-26T10:24:34.185894+0000","last_peered":"2024-04-26T10:24:34.185894+0000","last_clean":"2024-04-26T10:24:34.185894+0000","last_became_active":"2024-04-26T10:24:31.598170+0000","last_became_peered":"2024-04-26T10:24:31.598170+0000","last_unstale":"2024-04-26T10:24:34.185894+0000","last_undegraded":"2024-04-26T10:24:34.185894+0000","last_fullsized":"2024-04-26T10:24:34.185894+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:15.237609+0000","last_change":"2024-04-26T10:25:15.237609+0000","last_active":"2024-04-26T10:25:15.237609+0000","last_peered":"2024-04-26T10:25:15.237609+0000","last_clean":"2024-04-26T10:25:15.237609+0000","last_became_active":"2024-04-26T10:24:22.535998+0000","last_became_peered":"2024-04-26T10:24:22.535998+0000","last_unstale":"2024-04-26T10:25:15.237609+0000","last_undegraded":"2024-04-26T10:25:15.237609+0000","last_fullsized":"2024-04-26T10:25:15.237609+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:15.237328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:15.237328+0000","last_clean_scrub_stamp":"2024-04-26T10:25:15.237328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:09.529037+0000","scrub_duration":0.0032767389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":81,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.675457+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:24:43.675457+0000","last_peered":"2024-04-26T10:24:43.675457+0000","last_clean":"2024-04-26T10:24:43.675457+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:24:43.675457+0000","last_undegraded":"2024-04-26T10:24:43.675457+0000","last_fullsized":"2024-04-26T10:24:43.675457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.675449+0000","last_change":"2024-04-26T10:24:22.549067+0000","last_active":"2024-04-26T10:24:43.675449+0000","last_peered":"2024-04-26T10:24:43.675449+0000","last_clean":"2024-04-26T10:24:43.675449+0000","last_became_active":"2024-04-26T10:24:22.548485+0000","last_became_peered":"2024-04-26T10:24:22.548485+0000","last_unstale":"2024-04-26T10:24:43.675449+0000","last_undegraded":"2024-04-26T10:24:43.675449+0000","last_fullsized":"2024-04-26T10:24:43.675449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:00.289761+0000","last_change":"2024-04-26T10:25:00.290012+0000","last_active":"2024-04-26T10:25:00.289761+0000","last_peered":"2024-04-26T10:25:00.289761+0000","last_clean":"2024-04-26T10:25:00.289761+0000","last_became_active":"2024-04-26T10:24:31.600986+0000","last_became_peered":"2024-04-26T10:24:31.600986+0000","last_unstale":"2024-04-26T10:25:00.289761+0000","last_undegraded":"2024-04-26T10:25:00.289761+0000","last_fullsized":"2024-04-26T10:25:00.289761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:00.289706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:00.289706+0000","last_clean_scrub_stamp":"2024-04-26T10:25:00.289706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:20.178292+0000","scrub_duration":0.015595131999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:52.225237+0000","last_change":"2024-04-26T10:24:52.225492+0000","last_active":"2024-04-26T10:24:52.225237+0000","last_peered":"2024-04-26T10:24:52.225237+0000","last_clean":"2024-04-26T10:24:52.225237+0000","last_became_active":"2024-04-26T10:24:22.547731+0000","last_became_peered":"2024-04-26T10:24:22.547731+0000","last_unstale":"2024-04-26T10:24:52.225237+0000","last_undegraded":"2024-04-26T10:24:52.225237+0000","last_fullsized":"2024-04-26T10:24:52.225237+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:52.225191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:52.225191+0000","last_clean_scrub_stamp":"2024-04-26T10:24:52.225191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:05.446400+0000","scrub_duration":0.003307118,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:46.143038+0000","last_change":"2024-04-26T10:24:46.143361+0000","last_active":"2024-04-26T10:24:46.143038+0000","last_peered":"2024-04-26T10:24:46.143038+0000","last_clean":"2024-04-26T10:24:46.143038+0000","last_became_active":"2024-04-26T10:24:22.549180+0000","last_became_peered":"2024-04-26T10:24:22.549180+0000","last_unstale":"2024-04-26T10:24:46.143038+0000","last_undegraded":"2024-04-26T10:24:46.143038+0000","last_fullsized":"2024-04-26T10:24:46.143038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:46.142953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:46.142953+0000","last_clean_scrub_stamp":"2024-04-26T10:24:46.142953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:47.298765+0000","scrub_duration":0.014784434000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180250+0000","last_change":"2024-04-26T10:24:22.547840+0000","last_active":"2024-04-26T10:24:34.180250+0000","last_peered":"2024-04-26T10:24:34.180250+0000","last_clean":"2024-04-26T10:24:34.180250+0000","last_became_active":"2024-04-26T10:24:22.547284+0000","last_became_peered":"2024-04-26T10:24:22.547284+0000","last_unstale":"2024-04-26T10:24:34.180250+0000","last_undegraded":"2024-04-26T10:24:34.180250+0000","last_fullsized":"2024-04-26T10:24:34.180250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:56.807533+0000","last_change":"2024-04-26T10:24:56.807646+0000","last_active":"2024-04-26T10:24:56.807533+0000","last_peered":"2024-04-26T10:24:56.807533+0000","last_clean":"2024-04-26T10:24:56.807533+0000","last_became_active":"2024-04-26T10:24:22.679648+0000","last_became_peered":"2024-04-26T10:24:22.679648+0000","last_unstale":"2024-04-26T10:24:56.807533+0000","last_undegraded":"2024-04-26T10:24:56.807533+0000","last_fullsized":"2024-04-26T10:24:56.807533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:56.807510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:56.807510+0000","last_clean_scrub_stamp":"2024-04-26T10:24:56.807510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:24.720449+0000","scrub_duration":0.029714911,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:04.256728+0000","last_change":"2024-04-26T10:25:04.256968+0000","last_active":"2024-04-26T10:25:04.256728+0000","last_peered":"2024-04-26T10:25:04.256728+0000","last_clean":"2024-04-26T10:25:04.256728+0000","last_became_active":"2024-04-26T10:24:31.598187+0000","last_became_peered":"2024-04-26T10:24:31.598187+0000","last_unstale":"2024-04-26T10:25:04.256728+0000","last_undegraded":"2024-04-26T10:25:04.256728+0000","last_fullsized":"2024-04-26T10:25:04.256728+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:04.256683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:04.256683+0000","last_clean_scrub_stamp":"2024-04-26T10:25:04.256683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:01.571431+0000","scrub_duration":0.0034188460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181251+0000","last_change":"2024-04-26T10:24:22.547601+0000","last_active":"2024-04-26T10:24:34.181251+0000","last_peered":"2024-04-26T10:24:34.181251+0000","last_clean":"2024-04-26T10:24:34.181251+0000","last_became_active":"2024-04-26T10:24:22.546506+0000","last_became_peered":"2024-04-26T10:24:22.546506+0000","last_unstale":"2024-04-26T10:24:34.181251+0000","last_undegraded":"2024-04-26T10:24:34.181251+0000","last_fullsized":"2024-04-26T10:24:34.181251+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":82,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:56.279912+0000","last_change":"2024-04-26T10:24:56.280129+0000","last_active":"2024-04-26T10:24:56.279912+0000","last_peered":"2024-04-26T10:24:56.279912+0000","last_clean":"2024-04-26T10:24:56.279912+0000","last_became_active":"2024-04-26T10:22:09.747822+0000","last_became_peered":"2024-04-26T10:22:09.747822+0000","last_unstale":"2024-04-26T10:24:56.279912+0000","last_undegraded":"2024-04-26T10:24:56.279912+0000","last_fullsized":"2024-04-26T10:24:56.279912+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:56.279865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:56.279865+0000","last_clean_scrub_stamp":"2024-04-26T10:24:56.279865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:18:56.107536+0000","scrub_duration":0.0031183439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:09.228824+0000","last_change":"2024-04-26T10:25:09.229056+0000","last_active":"2024-04-26T10:25:09.228824+0000","last_peered":"2024-04-26T10:25:09.228824+0000","last_clean":"2024-04-26T10:25:09.228824+0000","last_became_active":"2024-04-26T10:24:31.597980+0000","last_became_peered":"2024-04-26T10:24:31.597980+0000","last_unstale":"2024-04-26T10:25:09.228824+0000","last_undegraded":"2024-04-26T10:25:09.228824+0000","last_fullsized":"2024-04-26T10:25:09.228824+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:09.228760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:09.228760+0000","last_clean_scrub_stamp":"2024-04-26T10:25:09.228760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:16.641297+0000","scrub_duration":0.01109303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":117,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:53.201478+0000","last_change":"2024-04-26T10:24:53.201710+0000","last_active":"2024-04-26T10:24:53.201478+0000","last_peered":"2024-04-26T10:24:53.201478+0000","last_clean":"2024-04-26T10:24:53.201478+0000","last_became_active":"2024-04-26T10:24:31.602539+0000","last_became_peered":"2024-04-26T10:24:31.602539+0000","last_unstale":"2024-04-26T10:24:53.201478+0000","last_undegraded":"2024-04-26T10:24:53.201478+0000","last_fullsized":"2024-04-26T10:24:53.201478+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:53.201431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:53.201431+0000","last_clean_scrub_stamp":"2024-04-26T10:24:53.201431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:31.514894+0000","scrub_duration":0.0033374949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":117,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:00.222743+0000","last_change":"2024-04-26T10:25:00.222988+0000","last_active":"2024-04-26T10:25:00.222743+0000","last_peered":"2024-04-26T10:25:00.222743+0000","last_clean":"2024-04-26T10:25:00.222743+0000","last_became_active":"2024-04-26T10:24:31.602453+0000","last_became_peered":"2024-04-26T10:24:31.602453+0000","last_unstale":"2024-04-26T10:25:00.222743+0000","last_undegraded":"2024-04-26T10:25:00.222743+0000","last_fullsized":"2024-04-26T10:25:00.222743+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:00.222698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:00.222698+0000","last_clean_scrub_stamp":"2024-04-26T10:25:00.222698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:45.583919+0000","scrub_duration":0.0030823560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179940+0000","last_change":"2024-04-26T10:24:22.547543+0000","last_active":"2024-04-26T10:24:34.179940+0000","last_peered":"2024-04-26T10:24:34.179940+0000","last_clean":"2024-04-26T10:24:34.179940+0000","last_became_active":"2024-04-26T10:24:22.546856+0000","last_became_peered":"2024-04-26T10:24:22.546856+0000","last_unstale":"2024-04-26T10:24:34.179940+0000","last_undegraded":"2024-04-26T10:24:34.179940+0000","last_fullsized":"2024-04-26T10:24:34.179940+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.320004+0000","last_change":"2024-04-26T10:24:22.679885+0000","last_active":"2024-04-26T10:24:34.320004+0000","last_peered":"2024-04-26T10:24:34.320004+0000","last_clean":"2024-04-26T10:24:34.320004+0000","last_became_active":"2024-04-26T10:24:22.679350+0000","last_became_peered":"2024-04-26T10:24:22.679350+0000","last_unstale":"2024-04-26T10:24:34.320004+0000","last_undegraded":"2024-04-26T10:24:34.320004+0000","last_fullsized":"2024-04-26T10:24:34.320004+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185940+0000","last_change":"2024-04-26T10:24:31.598857+0000","last_active":"2024-04-26T10:24:34.185940+0000","last_peered":"2024-04-26T10:24:34.185940+0000","last_clean":"2024-04-26T10:24:34.185940+0000","last_became_active":"2024-04-26T10:24:31.597563+0000","last_became_peered":"2024-04-26T10:24:31.597563+0000","last_unstale":"2024-04-26T10:24:34.185940+0000","last_undegraded":"2024-04-26T10:24:34.185940+0000","last_fullsized":"2024-04-26T10:24:34.185940+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.319093+0000","last_change":"2024-04-26T10:24:22.679291+0000","last_active":"2024-04-26T10:24:34.319093+0000","last_peered":"2024-04-26T10:24:34.319093+0000","last_clean":"2024-04-26T10:24:34.319093+0000","last_became_active":"2024-04-26T10:24:22.678912+0000","last_became_peered":"2024-04-26T10:24:22.678912+0000","last_unstale":"2024-04-26T10:24:34.319093+0000","last_undegraded":"2024-04-26T10:24:34.319093+0000","last_fullsized":"2024-04-26T10:24:34.319093+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181006+0000","last_change":"2024-04-26T10:24:22.546669+0000","last_active":"2024-04-26T10:24:34.181006+0000","last_peered":"2024-04-26T10:24:34.181006+0000","last_clean":"2024-04-26T10:24:34.181006+0000","last_became_active":"2024-04-26T10:24:22.546052+0000","last_became_peered":"2024-04-26T10:24:22.546052+0000","last_unstale":"2024-04-26T10:24:34.181006+0000","last_undegraded":"2024-04-26T10:24:34.181006+0000","last_fullsized":"2024-04-26T10:24:34.181006+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:08.292791+0000","last_change":"2024-04-26T10:25:08.292897+0000","last_active":"2024-04-26T10:25:08.292791+0000","last_peered":"2024-04-26T10:25:08.292791+0000","last_clean":"2024-04-26T10:25:08.292791+0000","last_became_active":"2024-04-26T10:24:22.547663+0000","last_became_peered":"2024-04-26T10:24:22.547663+0000","last_unstale":"2024-04-26T10:25:08.292791+0000","last_undegraded":"2024-04-26T10:25:08.292791+0000","last_fullsized":"2024-04-26T10:25:08.292791+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:08.292772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:08.292772+0000","last_clean_scrub_stamp":"2024-04-26T10:25:08.292772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:35.112407+0000","scrub_duration":0.038060340999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":82,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:01.324571+0000","last_change":"2024-04-26T10:25:01.324901+0000","last_active":"2024-04-26T10:25:01.324571+0000","last_peered":"2024-04-26T10:25:01.324571+0000","last_clean":"2024-04-26T10:25:01.324571+0000","last_became_active":"2024-04-26T10:22:09.748755+0000","last_became_peered":"2024-04-26T10:22:09.748755+0000","last_unstale":"2024-04-26T10:25:01.324571+0000","last_undegraded":"2024-04-26T10:25:01.324571+0000","last_fullsized":"2024-04-26T10:25:01.324571+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:01.324527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:01.324527+0000","last_clean_scrub_stamp":"2024-04-26T10:25:01.324527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:42.317619+0000","scrub_duration":0.0030479109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.317851+0000","last_change":"2024-04-26T10:24:22.684668+0000","last_active":"2024-04-26T10:24:34.317851+0000","last_peered":"2024-04-26T10:24:34.317851+0000","last_clean":"2024-04-26T10:24:34.317851+0000","last_became_active":"2024-04-26T10:24:22.683921+0000","last_became_peered":"2024-04-26T10:24:22.683921+0000","last_unstale":"2024-04-26T10:24:34.317851+0000","last_undegraded":"2024-04-26T10:24:34.317851+0000","last_fullsized":"2024-04-26T10:24:34.317851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":98,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:22.231463+0000","last_change":"2024-04-26T10:25:22.231749+0000","last_active":"2024-04-26T10:25:22.231463+0000","last_peered":"2024-04-26T10:25:22.231463+0000","last_clean":"2024-04-26T10:25:22.231463+0000","last_became_active":"2024-04-26T10:24:22.534674+0000","last_became_peered":"2024-04-26T10:24:22.534674+0000","last_unstale":"2024-04-26T10:25:22.231463+0000","last_undegraded":"2024-04-26T10:25:22.231463+0000","last_fullsized":"2024-04-26T10:25:22.231463+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:22.231415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:22.231415+0000","last_clean_scrub_stamp":"2024-04-26T10:25:22.231415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:27.733690+0000","scrub_duration":0.0033621749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:48.293794+0000","last_change":"2024-04-26T10:24:48.293911+0000","last_active":"2024-04-26T10:24:48.293794+0000","last_peered":"2024-04-26T10:24:48.293794+0000","last_clean":"2024-04-26T10:24:48.293794+0000","last_became_active":"2024-04-26T10:24:31.600815+0000","last_became_peered":"2024-04-26T10:24:31.600815+0000","last_unstale":"2024-04-26T10:24:48.293794+0000","last_undegraded":"2024-04-26T10:24:48.293794+0000","last_fullsized":"2024-04-26T10:24:48.293794+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:48.293774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:48.293774+0000","last_clean_scrub_stamp":"2024-04-26T10:24:48.293774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:51.595218+0000","scrub_duration":0.058713007999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:51.769368+0000","last_change":"2024-04-26T10:24:51.769593+0000","last_active":"2024-04-26T10:24:51.769368+0000","last_peered":"2024-04-26T10:24:51.769368+0000","last_clean":"2024-04-26T10:24:51.769368+0000","last_became_active":"2024-04-26T10:24:22.683959+0000","last_became_peered":"2024-04-26T10:24:22.683959+0000","last_unstale":"2024-04-26T10:24:51.769368+0000","last_undegraded":"2024-04-26T10:24:51.769368+0000","last_fullsized":"2024-04-26T10:24:51.769368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:51.769321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:51.769321+0000","last_clean_scrub_stamp":"2024-04-26T10:24:51.769321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:05.665068+0000","scrub_duration":0.003275011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":80,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181105+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:24:34.181105+0000","last_peered":"2024-04-26T10:24:34.181105+0000","last_clean":"2024-04-26T10:24:34.181105+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:24:34.181105+0000","last_undegraded":"2024-04-26T10:24:34.181105+0000","last_fullsized":"2024-04-26T10:24:34.181105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185612+0000","last_change":"2024-04-26T10:24:31.602078+0000","last_active":"2024-04-26T10:24:34.185612+0000","last_peered":"2024-04-26T10:24:34.185612+0000","last_clean":"2024-04-26T10:24:34.185612+0000","last_became_active":"2024-04-26T10:24:31.601299+0000","last_became_peered":"2024-04-26T10:24:31.601299+0000","last_unstale":"2024-04-26T10:24:34.185612+0000","last_undegraded":"2024-04-26T10:24:34.185612+0000","last_fullsized":"2024-04-26T10:24:34.185612+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.318287+0000","last_change":"2024-04-26T10:24:31.741152+0000","last_active":"2024-04-26T10:24:34.318287+0000","last_peered":"2024-04-26T10:24:34.318287+0000","last_clean":"2024-04-26T10:24:34.318287+0000","last_became_active":"2024-04-26T10:24:31.740626+0000","last_became_peered":"2024-04-26T10:24:31.740626+0000","last_unstale":"2024-04-26T10:24:34.318287+0000","last_undegraded":"2024-04-26T10:24:34.318287+0000","last_fullsized":"2024-04-26T10:24:34.318287+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":72,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:44.163289+0000","last_change":"2024-04-26T10:22:09.750562+0000","last_active":"2024-04-26T10:24:44.163289+0000","last_peered":"2024-04-26T10:24:44.163289+0000","last_clean":"2024-04-26T10:24:44.163289+0000","last_became_active":"2024-04-26T10:22:09.750286+0000","last_became_peered":"2024-04-26T10:22:09.750286+0000","last_unstale":"2024-04-26T10:24:44.163289+0000","last_undegraded":"2024-04-26T10:24:44.163289+0000","last_fullsized":"2024-04-26T10:24:44.163289+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.318332+0000","last_change":"2024-04-26T10:24:31.741008+0000","last_active":"2024-04-26T10:24:34.318332+0000","last_peered":"2024-04-26T10:24:34.318332+0000","last_clean":"2024-04-26T10:24:34.318332+0000","last_became_active":"2024-04-26T10:24:31.740518+0000","last_became_peered":"2024-04-26T10:24:31.740518+0000","last_unstale":"2024-04-26T10:24:34.318332+0000","last_undegraded":"2024-04-26T10:24:34.318332+0000","last_fullsized":"2024-04-26T10:24:34.318332+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:44.170604+0000","last_change":"2024-04-26T10:24:44.170604+0000","last_active":"2024-04-26T10:24:44.170604+0000","last_peered":"2024-04-26T10:24:44.170604+0000","last_clean":"2024-04-26T10:24:44.170604+0000","last_became_active":"2024-04-26T10:24:22.539106+0000","last_became_peered":"2024-04-26T10:24:22.539106+0000","last_unstale":"2024-04-26T10:24:44.170604+0000","last_undegraded":"2024-04-26T10:24:44.170604+0000","last_fullsized":"2024-04-26T10:24:44.170604+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:44.170151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:44.170151+0000","last_clean_scrub_stamp":"2024-04-26T10:24:44.170151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:52.109209+0000","scrub_duration":0.010234752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185397+0000","last_change":"2024-04-26T10:24:31.599487+0000","last_active":"2024-04-26T10:24:34.185397+0000","last_peered":"2024-04-26T10:24:34.185397+0000","last_clean":"2024-04-26T10:24:34.185397+0000","last_became_active":"2024-04-26T10:24:31.598307+0000","last_became_peered":"2024-04-26T10:24:31.598307+0000","last_unstale":"2024-04-26T10:24:34.185397+0000","last_undegraded":"2024-04-26T10:24:34.185397+0000","last_fullsized":"2024-04-26T10:24:34.185397+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179856+0000","last_change":"2024-04-26T10:24:22.547974+0000","last_active":"2024-04-26T10:24:34.179856+0000","last_peered":"2024-04-26T10:24:34.179856+0000","last_clean":"2024-04-26T10:24:34.179856+0000","last_became_active":"2024-04-26T10:24:22.546794+0000","last_became_peered":"2024-04-26T10:24:22.546794+0000","last_unstale":"2024-04-26T10:24:34.179856+0000","last_undegraded":"2024-04-26T10:24:34.179856+0000","last_fullsized":"2024-04-26T10:24:34.179856+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:47.236229+0000","last_change":"2024-04-26T10:24:47.236463+0000","last_active":"2024-04-26T10:24:47.236229+0000","last_peered":"2024-04-26T10:24:47.236229+0000","last_clean":"2024-04-26T10:24:47.236229+0000","last_became_active":"2024-04-26T10:24:31.596297+0000","last_became_peered":"2024-04-26T10:24:31.596297+0000","last_unstale":"2024-04-26T10:24:47.236229+0000","last_undegraded":"2024-04-26T10:24:47.236229+0000","last_fullsized":"2024-04-26T10:24:47.236229+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:47.236175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:47.236175+0000","last_clean_scrub_stamp":"2024-04-26T10:24:47.236175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:31.442660+0000","scrub_duration":0.014903458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:12.635104+0000","last_change":"2024-04-26T10:25:12.635350+0000","last_active":"2024-04-26T10:25:12.635104+0000","last_peered":"2024-04-26T10:25:12.635104+0000","last_clean":"2024-04-26T10:25:12.635104+0000","last_became_active":"2024-04-26T10:24:22.684541+0000","last_became_peered":"2024-04-26T10:24:22.684541+0000","last_unstale":"2024-04-26T10:25:12.635104+0000","last_undegraded":"2024-04-26T10:25:12.635104+0000","last_fullsized":"2024-04-26T10:25:12.635104+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:12.635057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:12.635057+0000","last_clean_scrub_stamp":"2024-04-26T10:25:12.635057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:40.868547+0000","scrub_duration":0.0035574059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.319358+0000","last_change":"2024-04-26T10:24:22.683787+0000","last_active":"2024-04-26T10:24:34.319358+0000","last_peered":"2024-04-26T10:24:34.319358+0000","last_clean":"2024-04-26T10:24:34.319358+0000","last_became_active":"2024-04-26T10:24:22.682650+0000","last_became_peered":"2024-04-26T10:24:22.682650+0000","last_unstale":"2024-04-26T10:24:34.319358+0000","last_undegraded":"2024-04-26T10:24:34.319358+0000","last_fullsized":"2024-04-26T10:24:34.319358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.184101+0000","last_change":"2024-04-26T10:24:31.601959+0000","last_active":"2024-04-26T10:24:34.184101+0000","last_peered":"2024-04-26T10:24:34.184101+0000","last_clean":"2024-04-26T10:24:34.184101+0000","last_became_active":"2024-04-26T10:24:31.601091+0000","last_became_peered":"2024-04-26T10:24:31.601091+0000","last_unstale":"2024-04-26T10:24:34.184101+0000","last_undegraded":"2024-04-26T10:24:34.184101+0000","last_fullsized":"2024-04-26T10:24:34.184101+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:08.712500+0000","last_change":"2024-04-26T10:25:08.712611+0000","last_active":"2024-04-26T10:25:08.712500+0000","last_peered":"2024-04-26T10:25:08.712500+0000","last_clean":"2024-04-26T10:25:08.712500+0000","last_became_active":"2024-04-26T10:24:22.684213+0000","last_became_peered":"2024-04-26T10:24:22.684213+0000","last_unstale":"2024-04-26T10:25:08.712500+0000","last_undegraded":"2024-04-26T10:25:08.712500+0000","last_fullsized":"2024-04-26T10:25:08.712500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:08.712479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:08.712479+0000","last_clean_scrub_stamp":"2024-04-26T10:25:08.712479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:22.971123+0000","scrub_duration":0.069345404999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":135,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179603+0000","last_change":"2024-04-26T10:24:31.613086+0000","last_active":"2024-04-26T10:24:34.179603+0000","last_peered":"2024-04-26T10:24:34.179603+0000","last_clean":"2024-04-26T10:24:34.179603+0000","last_became_active":"2024-04-26T10:24:31.604402+0000","last_became_peered":"2024-04-26T10:24:31.604402+0000","last_unstale":"2024-04-26T10:24:34.179603+0000","last_undegraded":"2024-04-26T10:24:34.179603+0000","last_fullsized":"2024-04-26T10:24:34.179603+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":116,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181661+0000","last_change":"2024-04-26T10:24:31.624641+0000","last_active":"2024-04-26T10:24:34.181661+0000","last_peered":"2024-04-26T10:24:34.181661+0000","last_clean":"2024-04-26T10:24:34.181661+0000","last_became_active":"2024-04-26T10:24:31.604744+0000","last_became_peered":"2024-04-26T10:24:31.604744+0000","last_unstale":"2024-04-26T10:24:34.181661+0000","last_undegraded":"2024-04-26T10:24:34.181661+0000","last_fullsized":"2024-04-26T10:24:34.181661+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":82,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:52.311859+0000","last_change":"2024-04-26T10:24:52.312203+0000","last_active":"2024-04-26T10:24:52.311859+0000","last_peered":"2024-04-26T10:24:52.311859+0000","last_clean":"2024-04-26T10:24:52.311859+0000","last_became_active":"2024-04-26T10:22:09.749862+0000","last_became_peered":"2024-04-26T10:22:09.749862+0000","last_unstale":"2024-04-26T10:24:52.311859+0000","last_undegraded":"2024-04-26T10:24:52.311859+0000","last_fullsized":"2024-04-26T10:24:52.311859+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:52.311773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:52.311773+0000","last_clean_scrub_stamp":"2024-04-26T10:24:52.311773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:12.624461+0000","scrub_duration":0.0034835349999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"91'3","reported_seq":86,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:13.197095+0000","last_change":"2024-04-26T10:25:13.197344+0000","last_active":"2024-04-26T10:25:13.197095+0000","last_peered":"2024-04-26T10:25:13.197095+0000","last_clean":"2024-04-26T10:25:13.197095+0000","last_became_active":"2024-04-26T10:22:09.749852+0000","last_became_peered":"2024-04-26T10:22:09.749852+0000","last_unstale":"2024-04-26T10:25:13.197095+0000","last_undegraded":"2024-04-26T10:25:13.197095+0000","last_fullsized":"2024-04-26T10:25:13.197095+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:13.197045+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:13.197045+0000","last_clean_scrub_stamp":"2024-04-26T10:25:13.197045+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:01.578169+0000","scrub_duration":0.0064724919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.184081+0000","last_change":"2024-04-26T10:24:31.597157+0000","last_active":"2024-04-26T10:24:34.184081+0000","last_peered":"2024-04-26T10:24:34.184081+0000","last_clean":"2024-04-26T10:24:34.184081+0000","last_became_active":"2024-04-26T10:24:31.596335+0000","last_became_peered":"2024-04-26T10:24:31.596335+0000","last_unstale":"2024-04-26T10:24:34.184081+0000","last_undegraded":"2024-04-26T10:24:34.184081+0000","last_fullsized":"2024-04-26T10:24:34.184081+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":82,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180625+0000","last_change":"2024-04-26T10:21:08.935133+0000","last_active":"2024-04-26T10:24:34.180625+0000","last_peered":"2024-04-26T10:24:34.180625+0000","last_clean":"2024-04-26T10:24:34.180625+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:24:34.180625+0000","last_undegraded":"2024-04-26T10:24:34.180625+0000","last_fullsized":"2024-04-26T10:24:34.180625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179483+0000","last_change":"2024-04-26T10:24:22.549411+0000","last_active":"2024-04-26T10:24:34.179483+0000","last_peered":"2024-04-26T10:24:34.179483+0000","last_clean":"2024-04-26T10:24:34.179483+0000","last_became_active":"2024-04-26T10:24:22.549230+0000","last_became_peered":"2024-04-26T10:24:22.549230+0000","last_unstale":"2024-04-26T10:24:34.179483+0000","last_undegraded":"2024-04-26T10:24:34.179483+0000","last_fullsized":"2024-04-26T10:24:34.179483+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180750+0000","last_change":"2024-04-26T10:24:22.541409+0000","last_active":"2024-04-26T10:24:34.180750+0000","last_peered":"2024-04-26T10:24:34.180750+0000","last_clean":"2024-04-26T10:24:34.180750+0000","last_became_active":"2024-04-26T10:24:22.540611+0000","last_became_peered":"2024-04-26T10:24:22.540611+0000","last_unstale":"2024-04-26T10:24:34.180750+0000","last_undegraded":"2024-04-26T10:24:34.180750+0000","last_fullsized":"2024-04-26T10:24:34.180750+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:10.703734+0000","last_change":"2024-04-26T10:25:10.703884+0000","last_active":"2024-04-26T10:25:10.703734+0000","last_peered":"2024-04-26T10:25:10.703734+0000","last_clean":"2024-04-26T10:25:10.703734+0000","last_became_active":"2024-04-26T10:24:22.686841+0000","last_became_peered":"2024-04-26T10:24:22.686841+0000","last_unstale":"2024-04-26T10:25:10.703734+0000","last_undegraded":"2024-04-26T10:25:10.703734+0000","last_fullsized":"2024-04-26T10:25:10.703734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:10.703715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:10.703715+0000","last_clean_scrub_stamp":"2024-04-26T10:25:10.703715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:08.356723+0000","scrub_duration":0.01785925,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'3","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:02.685154+0000","last_change":"2024-04-26T10:25:02.685404+0000","last_active":"2024-04-26T10:25:02.685154+0000","last_peered":"2024-04-26T10:25:02.685154+0000","last_clean":"2024-04-26T10:25:02.685154+0000","last_became_active":"2024-04-26T10:24:22.686846+0000","last_became_peered":"2024-04-26T10:24:22.686846+0000","last_unstale":"2024-04-26T10:25:02.685154+0000","last_undegraded":"2024-04-26T10:25:02.685154+0000","last_fullsized":"2024-04-26T10:25:02.685154+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:02.685093+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:02.685093+0000","last_clean_scrub_stamp":"2024-04-26T10:25:02.685093+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:29.685511+0000","scrub_duration":0.0064629550000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180736+0000","last_change":"2024-04-26T10:24:22.546117+0000","last_active":"2024-04-26T10:24:34.180736+0000","last_peered":"2024-04-26T10:24:34.180736+0000","last_clean":"2024-04-26T10:24:34.180736+0000","last_became_active":"2024-04-26T10:24:22.545616+0000","last_became_peered":"2024-04-26T10:24:22.545616+0000","last_unstale":"2024-04-26T10:24:34.180736+0000","last_undegraded":"2024-04-26T10:24:34.180736+0000","last_fullsized":"2024-04-26T10:24:34.180736+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179772+0000","last_change":"2024-04-26T10:24:22.540185+0000","last_active":"2024-04-26T10:24:34.179772+0000","last_peered":"2024-04-26T10:24:34.179772+0000","last_clean":"2024-04-26T10:24:34.179772+0000","last_became_active":"2024-04-26T10:24:22.538982+0000","last_became_peered":"2024-04-26T10:24:22.538982+0000","last_unstale":"2024-04-26T10:24:34.179772+0000","last_undegraded":"2024-04-26T10:24:34.179772+0000","last_fullsized":"2024-04-26T10:24:34.179772+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":80,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180846+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:24:34.180846+0000","last_peered":"2024-04-26T10:24:34.180846+0000","last_clean":"2024-04-26T10:24:34.180846+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:24:34.180846+0000","last_undegraded":"2024-04-26T10:24:34.180846+0000","last_fullsized":"2024-04-26T10:24:34.180846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:07.248208+0000","last_change":"2024-04-26T10:25:07.248434+0000","last_active":"2024-04-26T10:25:07.248208+0000","last_peered":"2024-04-26T10:25:07.248208+0000","last_clean":"2024-04-26T10:25:07.248208+0000","last_became_active":"2024-04-26T10:22:09.748256+0000","last_became_peered":"2024-04-26T10:22:09.748256+0000","last_unstale":"2024-04-26T10:25:07.248208+0000","last_undegraded":"2024-04-26T10:25:07.248208+0000","last_fullsized":"2024-04-26T10:25:07.248208+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:07.248161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:07.248161+0000","last_clean_scrub_stamp":"2024-04-26T10:25:07.248161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:25.723449+0000","scrub_duration":0.003118071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180622+0000","last_change":"2024-04-26T10:24:31.604150+0000","last_active":"2024-04-26T10:24:34.180622+0000","last_peered":"2024-04-26T10:24:34.180622+0000","last_clean":"2024-04-26T10:24:34.180622+0000","last_became_active":"2024-04-26T10:24:31.603620+0000","last_became_peered":"2024-04-26T10:24:31.603620+0000","last_unstale":"2024-04-26T10:24:34.180622+0000","last_undegraded":"2024-04-26T10:24:34.180622+0000","last_fullsized":"2024-04-26T10:24:34.180622+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.184530+0000","last_change":"2024-04-26T10:24:31.598521+0000","last_active":"2024-04-26T10:24:34.184530+0000","last_peered":"2024-04-26T10:24:34.184530+0000","last_clean":"2024-04-26T10:24:34.184530+0000","last_became_active":"2024-04-26T10:24:31.598120+0000","last_became_peered":"2024-04-26T10:24:31.598120+0000","last_unstale":"2024-04-26T10:24:34.184530+0000","last_undegraded":"2024-04-26T10:24:34.184530+0000","last_fullsized":"2024-04-26T10:24:34.184530+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:57.789264+0000","last_change":"2024-04-26T10:24:57.789439+0000","last_active":"2024-04-26T10:24:57.789264+0000","last_peered":"2024-04-26T10:24:57.789264+0000","last_clean":"2024-04-26T10:24:57.789264+0000","last_became_active":"2024-04-26T10:24:22.679940+0000","last_became_peered":"2024-04-26T10:24:22.679940+0000","last_unstale":"2024-04-26T10:24:57.789264+0000","last_undegraded":"2024-04-26T10:24:57.789264+0000","last_fullsized":"2024-04-26T10:24:57.789264+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:57.789236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:57.789236+0000","last_clean_scrub_stamp":"2024-04-26T10:24:57.789236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:34.365027+0000","scrub_duration":0.045365677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":335,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674349+0000","last_change":"2024-04-26T10:24:34.185235+0000","last_active":"2024-04-26T10:24:43.674349+0000","last_peered":"2024-04-26T10:24:43.674349+0000","last_clean":"2024-04-26T10:24:43.674349+0000","last_became_active":"2024-04-26T10:24:34.184490+0000","last_became_peered":"2024-04-26T10:24:34.184490+0000","last_unstale":"2024-04-26T10:24:43.674349+0000","last_undegraded":"2024-04-26T10:24:43.674349+0000","last_fullsized":"2024-04-26T10:24:43.674349+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674360+0000","last_change":"2024-04-26T10:24:22.547708+0000","last_active":"2024-04-26T10:24:43.674360+0000","last_peered":"2024-04-26T10:24:43.674360+0000","last_clean":"2024-04-26T10:24:43.674360+0000","last_became_active":"2024-04-26T10:24:22.546650+0000","last_became_peered":"2024-04-26T10:24:22.546650+0000","last_unstale":"2024-04-26T10:24:43.674360+0000","last_undegraded":"2024-04-26T10:24:43.674360+0000","last_fullsized":"2024-04-26T10:24:43.674360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:49.697780+0000","last_change":"2024-04-26T10:24:49.698037+0000","last_active":"2024-04-26T10:24:49.697780+0000","last_peered":"2024-04-26T10:24:49.697780+0000","last_clean":"2024-04-26T10:24:49.697780+0000","last_became_active":"2024-04-26T10:24:22.676489+0000","last_became_peered":"2024-04-26T10:24:22.676489+0000","last_unstale":"2024-04-26T10:24:49.697780+0000","last_undegraded":"2024-04-26T10:24:49.697780+0000","last_fullsized":"2024-04-26T10:24:49.697780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:49.697735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:49.697735+0000","last_clean_scrub_stamp":"2024-04-26T10:24:49.697735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:32.374320+0000","scrub_duration":0.0030634690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:12.176501+0000","last_change":"2024-04-26T10:25:12.176501+0000","last_active":"2024-04-26T10:25:12.176501+0000","last_peered":"2024-04-26T10:25:12.176501+0000","last_clean":"2024-04-26T10:25:12.176501+0000","last_became_active":"2024-04-26T10:24:31.603498+0000","last_became_peered":"2024-04-26T10:24:31.603498+0000","last_unstale":"2024-04-26T10:25:12.176501+0000","last_undegraded":"2024-04-26T10:25:12.176501+0000","last_fullsized":"2024-04-26T10:25:12.176501+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:12.176170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:12.176170+0000","last_clean_scrub_stamp":"2024-04-26T10:25:12.176170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:31.663887+0000","scrub_duration":0.003223147,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674391+0000","last_change":"2024-04-26T10:24:31.603067+0000","last_active":"2024-04-26T10:24:43.674391+0000","last_peered":"2024-04-26T10:24:43.674391+0000","last_clean":"2024-04-26T10:24:43.674391+0000","last_became_active":"2024-04-26T10:24:31.602611+0000","last_became_peered":"2024-04-26T10:24:31.602611+0000","last_unstale":"2024-04-26T10:24:43.674391+0000","last_undegraded":"2024-04-26T10:24:43.674391+0000","last_fullsized":"2024-04-26T10:24:43.674391+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.317536+0000","last_change":"2024-04-26T10:24:22.685554+0000","last_active":"2024-04-26T10:24:34.317536+0000","last_peered":"2024-04-26T10:24:34.317536+0000","last_clean":"2024-04-26T10:24:34.317536+0000","last_became_active":"2024-04-26T10:24:22.685051+0000","last_became_peered":"2024-04-26T10:24:22.685051+0000","last_unstale":"2024-04-26T10:24:34.317536+0000","last_undegraded":"2024-04-26T10:24:34.317536+0000","last_fullsized":"2024-04-26T10:24:34.317536+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.186096+0000","last_change":"2024-04-26T10:24:22.538294+0000","last_active":"2024-04-26T10:24:34.186096+0000","last_peered":"2024-04-26T10:24:34.186096+0000","last_clean":"2024-04-26T10:24:34.186096+0000","last_became_active":"2024-04-26T10:24:22.537983+0000","last_became_peered":"2024-04-26T10:24:22.537983+0000","last_unstale":"2024-04-26T10:24:34.186096+0000","last_undegraded":"2024-04-26T10:24:34.186096+0000","last_fullsized":"2024-04-26T10:24:34.186096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:47.630110+0000","last_change":"2024-04-26T10:24:47.630379+0000","last_active":"2024-04-26T10:24:47.630110+0000","last_peered":"2024-04-26T10:24:47.630110+0000","last_clean":"2024-04-26T10:24:47.630110+0000","last_became_active":"2024-04-26T10:24:22.678866+0000","last_became_peered":"2024-04-26T10:24:22.678866+0000","last_unstale":"2024-04-26T10:24:47.630110+0000","last_undegraded":"2024-04-26T10:24:47.630110+0000","last_fullsized":"2024-04-26T10:24:47.630110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:47.630061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:47.630061+0000","last_clean_scrub_stamp":"2024-04-26T10:24:47.630061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:03.378559+0000","scrub_duration":0.003470571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":73,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:44.162496+0000","last_change":"2024-04-26T10:22:09.750297+0000","last_active":"2024-04-26T10:24:44.162496+0000","last_peered":"2024-04-26T10:24:44.162496+0000","last_clean":"2024-04-26T10:24:44.162496+0000","last_became_active":"2024-04-26T10:22:09.749935+0000","last_became_peered":"2024-04-26T10:22:09.749935+0000","last_unstale":"2024-04-26T10:24:44.162496+0000","last_undegraded":"2024-04-26T10:24:44.162496+0000","last_fullsized":"2024-04-26T10:24:44.162496+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.320254+0000","last_change":"2024-04-26T10:24:31.745820+0000","last_active":"2024-04-26T10:24:34.320254+0000","last_peered":"2024-04-26T10:24:34.320254+0000","last_clean":"2024-04-26T10:24:34.320254+0000","last_became_active":"2024-04-26T10:24:31.745487+0000","last_became_peered":"2024-04-26T10:24:31.745487+0000","last_unstale":"2024-04-26T10:24:34.320254+0000","last_undegraded":"2024-04-26T10:24:34.320254+0000","last_fullsized":"2024-04-26T10:24:34.320254+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674367+0000","last_change":"2024-04-26T10:24:22.539761+0000","last_active":"2024-04-26T10:24:43.674367+0000","last_peered":"2024-04-26T10:24:43.674367+0000","last_clean":"2024-04-26T10:24:43.674367+0000","last_became_active":"2024-04-26T10:24:22.538993+0000","last_became_peered":"2024-04-26T10:24:22.538993+0000","last_unstale":"2024-04-26T10:24:43.674367+0000","last_undegraded":"2024-04-26T10:24:43.674367+0000","last_fullsized":"2024-04-26T10:24:43.674367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674849+0000","last_change":"2024-04-26T10:24:22.542774+0000","last_active":"2024-04-26T10:24:43.674849+0000","last_peered":"2024-04-26T10:24:43.674849+0000","last_clean":"2024-04-26T10:24:43.674849+0000","last_became_active":"2024-04-26T10:24:22.541795+0000","last_became_peered":"2024-04-26T10:24:22.541795+0000","last_unstale":"2024-04-26T10:24:43.674849+0000","last_undegraded":"2024-04-26T10:24:43.674849+0000","last_fullsized":"2024-04-26T10:24:43.674849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:46.642214+0000","last_change":"2024-04-26T10:24:46.642441+0000","last_active":"2024-04-26T10:24:46.642214+0000","last_peered":"2024-04-26T10:24:46.642214+0000","last_clean":"2024-04-26T10:24:46.642214+0000","last_became_active":"2024-04-26T10:24:31.744373+0000","last_became_peered":"2024-04-26T10:24:31.744373+0000","last_unstale":"2024-04-26T10:24:46.642214+0000","last_undegraded":"2024-04-26T10:24:46.642214+0000","last_fullsized":"2024-04-26T10:24:46.642214+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:46.642168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:46.642168+0000","last_clean_scrub_stamp":"2024-04-26T10:24:46.642168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:47.970345+0000","scrub_duration":0.0030956120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674609+0000","last_change":"2024-04-26T10:24:22.538573+0000","last_active":"2024-04-26T10:24:43.674609+0000","last_peered":"2024-04-26T10:24:43.674609+0000","last_clean":"2024-04-26T10:24:43.674609+0000","last_became_active":"2024-04-26T10:24:22.537041+0000","last_became_peered":"2024-04-26T10:24:22.537041+0000","last_unstale":"2024-04-26T10:24:43.674609+0000","last_undegraded":"2024-04-26T10:24:43.674609+0000","last_fullsized":"2024-04-26T10:24:43.674609+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.318684+0000","last_change":"2024-04-26T10:24:31.744776+0000","last_active":"2024-04-26T10:24:34.318684+0000","last_peered":"2024-04-26T10:24:34.318684+0000","last_clean":"2024-04-26T10:24:34.318684+0000","last_became_active":"2024-04-26T10:24:31.744342+0000","last_became_peered":"2024-04-26T10:24:31.744342+0000","last_unstale":"2024-04-26T10:24:34.318684+0000","last_undegraded":"2024-04-26T10:24:34.318684+0000","last_fullsized":"2024-04-26T10:24:34.318684+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:53.288634+0000","last_change":"2024-04-26T10:24:53.288881+0000","last_active":"2024-04-26T10:24:53.288634+0000","last_peered":"2024-04-26T10:24:53.288634+0000","last_clean":"2024-04-26T10:24:53.288634+0000","last_became_active":"2024-04-26T10:24:31.598432+0000","last_became_peered":"2024-04-26T10:24:31.598432+0000","last_unstale":"2024-04-26T10:24:53.288634+0000","last_undegraded":"2024-04-26T10:24:53.288634+0000","last_fullsized":"2024-04-26T10:24:53.288634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:53.288587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:53.288587+0000","last_clean_scrub_stamp":"2024-04-26T10:24:53.288587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:25.869325+0000","scrub_duration":0.003660567,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.319134+0000","last_change":"2024-04-26T10:24:31.745336+0000","last_active":"2024-04-26T10:24:34.319134+0000","last_peered":"2024-04-26T10:24:34.319134+0000","last_clean":"2024-04-26T10:24:34.319134+0000","last_became_active":"2024-04-26T10:24:31.745004+0000","last_became_peered":"2024-04-26T10:24:31.745004+0000","last_unstale":"2024-04-26T10:24:34.319134+0000","last_undegraded":"2024-04-26T10:24:34.319134+0000","last_fullsized":"2024-04-26T10:24:34.319134+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:12.232393+0000","last_change":"2024-04-26T10:25:12.232642+0000","last_active":"2024-04-26T10:25:12.232393+0000","last_peered":"2024-04-26T10:25:12.232393+0000","last_clean":"2024-04-26T10:25:12.232393+0000","last_became_active":"2024-04-26T10:24:31.600977+0000","last_became_peered":"2024-04-26T10:24:31.600977+0000","last_unstale":"2024-04-26T10:25:12.232393+0000","last_undegraded":"2024-04-26T10:25:12.232393+0000","last_fullsized":"2024-04-26T10:25:12.232393+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:12.232350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:12.232350+0000","last_clean_scrub_stamp":"2024-04-26T10:25:12.232350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:54.306540+0000","scrub_duration":0.0033972550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:03.280598+0000","last_change":"2024-04-26T10:25:03.280598+0000","last_active":"2024-04-26T10:25:03.280598+0000","last_peered":"2024-04-26T10:25:03.280598+0000","last_clean":"2024-04-26T10:25:03.280598+0000","last_became_active":"2024-04-26T10:22:09.757813+0000","last_became_peered":"2024-04-26T10:22:09.757813+0000","last_unstale":"2024-04-26T10:25:03.280598+0000","last_undegraded":"2024-04-26T10:25:03.280598+0000","last_fullsized":"2024-04-26T10:25:03.280598+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:03.280310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:03.280310+0000","last_clean_scrub_stamp":"2024-04-26T10:25:03.280310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:49.626354+0000","scrub_duration":0.0030957509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.319898+0000","last_change":"2024-04-26T10:24:22.680137+0000","last_active":"2024-04-26T10:24:34.319898+0000","last_peered":"2024-04-26T10:24:34.319898+0000","last_clean":"2024-04-26T10:24:34.319898+0000","last_became_active":"2024-04-26T10:24:22.679497+0000","last_became_peered":"2024-04-26T10:24:22.679497+0000","last_unstale":"2024-04-26T10:24:34.319898+0000","last_undegraded":"2024-04-26T10:24:34.319898+0000","last_fullsized":"2024-04-26T10:24:34.319898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.319521+0000","last_change":"2024-04-26T10:24:31.741102+0000","last_active":"2024-04-26T10:24:34.319521+0000","last_peered":"2024-04-26T10:24:34.319521+0000","last_clean":"2024-04-26T10:24:34.319521+0000","last_became_active":"2024-04-26T10:24:31.740589+0000","last_became_peered":"2024-04-26T10:24:31.740589+0000","last_unstale":"2024-04-26T10:24:34.319521+0000","last_undegraded":"2024-04-26T10:24:34.319521+0000","last_fullsized":"2024-04-26T10:24:34.319521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.317906+0000","last_change":"2024-04-26T10:24:22.686404+0000","last_active":"2024-04-26T10:24:34.317906+0000","last_peered":"2024-04-26T10:24:34.317906+0000","last_clean":"2024-04-26T10:24:34.317906+0000","last_became_active":"2024-04-26T10:24:22.686094+0000","last_became_peered":"2024-04-26T10:24:22.686094+0000","last_unstale":"2024-04-26T10:24:34.317906+0000","last_undegraded":"2024-04-26T10:24:34.317906+0000","last_fullsized":"2024-04-26T10:24:34.317906+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.319143+0000","last_change":"2024-04-26T10:24:22.682344+0000","last_active":"2024-04-26T10:24:34.319143+0000","last_peered":"2024-04-26T10:24:34.319143+0000","last_clean":"2024-04-26T10:24:34.319143+0000","last_became_active":"2024-04-26T10:24:22.681977+0000","last_became_peered":"2024-04-26T10:24:22.681977+0000","last_unstale":"2024-04-26T10:24:34.319143+0000","last_undegraded":"2024-04-26T10:24:34.319143+0000","last_fullsized":"2024-04-26T10:24:34.319143+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181635+0000","last_change":"2024-04-26T10:24:31.605320+0000","last_active":"2024-04-26T10:24:34.181635+0000","last_peered":"2024-04-26T10:24:34.181635+0000","last_clean":"2024-04-26T10:24:34.181635+0000","last_became_active":"2024-04-26T10:24:31.604158+0000","last_became_peered":"2024-04-26T10:24:31.604158+0000","last_unstale":"2024-04-26T10:24:34.181635+0000","last_undegraded":"2024-04-26T10:24:34.181635+0000","last_fullsized":"2024-04-26T10:24:34.181635+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:06.220952+0000","last_change":"2024-04-26T10:25:06.221246+0000","last_active":"2024-04-26T10:25:06.220952+0000","last_peered":"2024-04-26T10:25:06.220952+0000","last_clean":"2024-04-26T10:25:06.220952+0000","last_became_active":"2024-04-26T10:24:31.600474+0000","last_became_peered":"2024-04-26T10:24:31.600474+0000","last_unstale":"2024-04-26T10:25:06.220952+0000","last_undegraded":"2024-04-26T10:25:06.220952+0000","last_fullsized":"2024-04-26T10:25:06.220952+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:06.220907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:06.220907+0000","last_clean_scrub_stamp":"2024-04-26T10:25:06.220907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:58.924774+0000","scrub_duration":0.0032236180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":117,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:59.250105+0000","last_change":"2024-04-26T10:24:59.250347+0000","last_active":"2024-04-26T10:24:59.250105+0000","last_peered":"2024-04-26T10:24:59.250105+0000","last_clean":"2024-04-26T10:24:59.250105+0000","last_became_active":"2024-04-26T10:24:31.604609+0000","last_became_peered":"2024-04-26T10:24:31.604609+0000","last_unstale":"2024-04-26T10:24:59.250105+0000","last_undegraded":"2024-04-26T10:24:59.250105+0000","last_fullsized":"2024-04-26T10:24:59.250105+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:59.250058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:59.250058+0000","last_clean_scrub_stamp":"2024-04-26T10:24:59.250058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:27.888233+0000","scrub_duration":0.0035158640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"91'10","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:09.225903+0000","last_change":"2024-04-26T10:25:09.226253+0000","last_active":"2024-04-26T10:25:09.225903+0000","last_peered":"2024-04-26T10:25:09.225903+0000","last_clean":"2024-04-26T10:25:09.225903+0000","last_became_active":"2024-04-26T10:24:31.604884+0000","last_became_peered":"2024-04-26T10:24:31.604884+0000","last_unstale":"2024-04-26T10:25:09.225903+0000","last_undegraded":"2024-04-26T10:25:09.225903+0000","last_fullsized":"2024-04-26T10:25:09.225903+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2024-04-26T10:25:09.225844+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2024-04-26T10:25:09.225844+0000","last_clean_scrub_stamp":"2024-04-26T10:25:09.225844+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:43.565487+0000","scrub_duration":0.0099065019999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.317942+0000","last_change":"2024-04-26T10:24:31.739955+0000","last_active":"2024-04-26T10:24:34.317942+0000","last_peered":"2024-04-26T10:24:34.317942+0000","last_clean":"2024-04-26T10:24:34.317942+0000","last_became_active":"2024-04-26T10:24:31.739550+0000","last_became_peered":"2024-04-26T10:24:31.739550+0000","last_unstale":"2024-04-26T10:24:34.317942+0000","last_undegraded":"2024-04-26T10:24:34.317942+0000","last_fullsized":"2024-04-26T10:24:34.317942+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:02.311259+0000","last_change":"2024-04-26T10:25:02.311507+0000","last_active":"2024-04-26T10:25:02.311259+0000","last_peered":"2024-04-26T10:25:02.311259+0000","last_clean":"2024-04-26T10:25:02.311259+0000","last_became_active":"2024-04-26T10:24:31.601218+0000","last_became_peered":"2024-04-26T10:24:31.601218+0000","last_unstale":"2024-04-26T10:25:02.311259+0000","last_undegraded":"2024-04-26T10:25:02.311259+0000","last_fullsized":"2024-04-26T10:25:02.311259+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'5","last_scrub_stamp":"2024-04-26T10:25:02.311211+0000","last_deep_scrub":"91'5","last_deep_scrub_stamp":"2024-04-26T10:25:02.311211+0000","last_clean_scrub_stamp":"2024-04-26T10:25:02.311211+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:46.605747+0000","scrub_duration":0.0088437829999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:07.220841+0000","last_change":"2024-04-26T10:25:07.221072+0000","last_active":"2024-04-26T10:25:07.220841+0000","last_peered":"2024-04-26T10:25:07.220841+0000","last_clean":"2024-04-26T10:25:07.220841+0000","last_became_active":"2024-04-26T10:24:22.546378+0000","last_became_peered":"2024-04-26T10:24:22.546378+0000","last_unstale":"2024-04-26T10:25:07.220841+0000","last_undegraded":"2024-04-26T10:25:07.220841+0000","last_fullsized":"2024-04-26T10:25:07.220841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:07.220796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:07.220796+0000","last_clean_scrub_stamp":"2024-04-26T10:25:07.220796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:33.432321+0000","scrub_duration":0.0036655839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:04.628990+0000","last_change":"2024-04-26T10:25:04.629253+0000","last_active":"2024-04-26T10:25:04.628990+0000","last_peered":"2024-04-26T10:25:04.628990+0000","last_clean":"2024-04-26T10:25:04.628990+0000","last_became_active":"2024-04-26T10:24:22.683558+0000","last_became_peered":"2024-04-26T10:24:22.683558+0000","last_unstale":"2024-04-26T10:25:04.628990+0000","last_undegraded":"2024-04-26T10:25:04.628990+0000","last_fullsized":"2024-04-26T10:25:04.628990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:04.628905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:04.628905+0000","last_clean_scrub_stamp":"2024-04-26T10:25:04.628905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:20:44.078968+0000","scrub_duration":0.0037325380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:50.729192+0000","last_change":"2024-04-26T10:24:50.729571+0000","last_active":"2024-04-26T10:24:50.729192+0000","last_peered":"2024-04-26T10:24:50.729192+0000","last_clean":"2024-04-26T10:24:50.729192+0000","last_became_active":"2024-04-26T10:24:22.684166+0000","last_became_peered":"2024-04-26T10:24:22.684166+0000","last_unstale":"2024-04-26T10:24:50.729192+0000","last_undegraded":"2024-04-26T10:24:50.729192+0000","last_fullsized":"2024-04-26T10:24:50.729192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:50.729143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:50.729143+0000","last_clean_scrub_stamp":"2024-04-26T10:24:50.729143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:54.166410+0000","scrub_duration":0.003288118,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.317715+0000","last_change":"2024-04-26T10:24:31.745539+0000","last_active":"2024-04-26T10:24:34.317715+0000","last_peered":"2024-04-26T10:24:34.317715+0000","last_clean":"2024-04-26T10:24:34.317715+0000","last_became_active":"2024-04-26T10:24:31.745216+0000","last_became_peered":"2024-04-26T10:24:31.745216+0000","last_unstale":"2024-04-26T10:24:34.317715+0000","last_undegraded":"2024-04-26T10:24:34.317715+0000","last_fullsized":"2024-04-26T10:24:34.317715+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:10.271098+0000","last_change":"2024-04-26T10:25:10.271098+0000","last_active":"2024-04-26T10:25:10.271098+0000","last_peered":"2024-04-26T10:25:10.271098+0000","last_clean":"2024-04-26T10:25:10.271098+0000","last_became_active":"2024-04-26T10:22:09.750359+0000","last_became_peered":"2024-04-26T10:22:09.750359+0000","last_unstale":"2024-04-26T10:25:10.271098+0000","last_undegraded":"2024-04-26T10:25:10.271098+0000","last_fullsized":"2024-04-26T10:25:10.271098+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:10.270958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:10.270958+0000","last_clean_scrub_stamp":"2024-04-26T10:25:10.270958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:37.572061+0000","scrub_duration":0.098704475999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:14.648804+0000","last_change":"2024-04-26T10:25:14.649052+0000","last_active":"2024-04-26T10:25:14.648804+0000","last_peered":"2024-04-26T10:25:14.648804+0000","last_clean":"2024-04-26T10:25:14.648804+0000","last_became_active":"2024-04-26T10:24:31.740477+0000","last_became_peered":"2024-04-26T10:24:31.740477+0000","last_unstale":"2024-04-26T10:25:14.648804+0000","last_undegraded":"2024-04-26T10:25:14.648804+0000","last_fullsized":"2024-04-26T10:25:14.648804+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:14.648757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:14.648757+0000","last_clean_scrub_stamp":"2024-04-26T10:25:14.648757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:15.311203+0000","scrub_duration":0.0031660170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:48.666410+0000","last_change":"2024-04-26T10:24:48.666739+0000","last_active":"2024-04-26T10:24:48.666410+0000","last_peered":"2024-04-26T10:24:48.666410+0000","last_clean":"2024-04-26T10:24:48.666410+0000","last_became_active":"2024-04-26T10:24:22.683501+0000","last_became_peered":"2024-04-26T10:24:22.683501+0000","last_unstale":"2024-04-26T10:24:48.666410+0000","last_undegraded":"2024-04-26T10:24:48.666410+0000","last_fullsized":"2024-04-26T10:24:48.666410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:48.666365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:48.666365+0000","last_clean_scrub_stamp":"2024-04-26T10:24:48.666365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:11.797360+0000","scrub_duration":0.003127285,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.317628+0000","last_change":"2024-04-26T10:24:22.685228+0000","last_active":"2024-04-26T10:24:34.317628+0000","last_peered":"2024-04-26T10:24:34.317628+0000","last_clean":"2024-04-26T10:24:34.317628+0000","last_became_active":"2024-04-26T10:24:22.684469+0000","last_became_peered":"2024-04-26T10:24:22.684469+0000","last_unstale":"2024-04-26T10:24:34.317628+0000","last_undegraded":"2024-04-26T10:24:34.317628+0000","last_fullsized":"2024-04-26T10:24:34.317628+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":82,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:05.256881+0000","last_change":"2024-04-26T10:25:05.257118+0000","last_active":"2024-04-26T10:25:05.256881+0000","last_peered":"2024-04-26T10:25:05.256881+0000","last_clean":"2024-04-26T10:25:05.256881+0000","last_became_active":"2024-04-26T10:22:09.752856+0000","last_became_peered":"2024-04-26T10:22:09.752856+0000","last_unstale":"2024-04-26T10:25:05.256881+0000","last_undegraded":"2024-04-26T10:25:05.256881+0000","last_fullsized":"2024-04-26T10:25:05.256881+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:05.256836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:05.256836+0000","last_clean_scrub_stamp":"2024-04-26T10:25:05.256836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:22.884251+0000","scrub_duration":0.0032355069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:17.277775+0000","last_change":"2024-04-26T10:25:17.278034+0000","last_active":"2024-04-26T10:25:17.277775+0000","last_peered":"2024-04-26T10:25:17.277775+0000","last_clean":"2024-04-26T10:25:17.277775+0000","last_became_active":"2024-04-26T10:24:22.535036+0000","last_became_peered":"2024-04-26T10:24:22.535036+0000","last_unstale":"2024-04-26T10:25:17.277775+0000","last_undegraded":"2024-04-26T10:25:17.277775+0000","last_fullsized":"2024-04-26T10:25:17.277775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-26T10:25:17.277726+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-26T10:25:17.277726+0000","last_clean_scrub_stamp":"2024-04-26T10:25:17.277726+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:30.647501+0000","scrub_duration":0.0033671420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":98,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:14.219808+0000","last_change":"2024-04-26T10:25:14.220039+0000","last_active":"2024-04-26T10:25:14.219808+0000","last_peered":"2024-04-26T10:25:14.219808+0000","last_clean":"2024-04-26T10:25:14.219808+0000","last_became_active":"2024-04-26T10:24:22.535562+0000","last_became_peered":"2024-04-26T10:24:22.535562+0000","last_unstale":"2024-04-26T10:25:14.219808+0000","last_undegraded":"2024-04-26T10:25:14.219808+0000","last_fullsized":"2024-04-26T10:25:14.219808+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:14.219757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:14.219757+0000","last_clean_scrub_stamp":"2024-04-26T10:25:14.219757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:48.012965+0000","scrub_duration":0.0030851279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.184722+0000","last_change":"2024-04-26T10:24:31.600594+0000","last_active":"2024-04-26T10:24:34.184722+0000","last_peered":"2024-04-26T10:24:34.184722+0000","last_clean":"2024-04-26T10:24:34.184722+0000","last_became_active":"2024-04-26T10:24:31.600121+0000","last_became_peered":"2024-04-26T10:24:31.600121+0000","last_unstale":"2024-04-26T10:24:34.184722+0000","last_undegraded":"2024-04-26T10:24:34.184722+0000","last_fullsized":"2024-04-26T10:24:34.184722+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180293+0000","last_change":"2024-04-26T10:24:22.542755+0000","last_active":"2024-04-26T10:24:34.180293+0000","last_peered":"2024-04-26T10:24:34.180293+0000","last_clean":"2024-04-26T10:24:34.180293+0000","last_became_active":"2024-04-26T10:24:22.541543+0000","last_became_peered":"2024-04-26T10:24:22.541543+0000","last_unstale":"2024-04-26T10:24:34.180293+0000","last_undegraded":"2024-04-26T10:24:34.180293+0000","last_fullsized":"2024-04-26T10:24:34.180293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"91'3","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:02.282549+0000","last_change":"2024-04-26T10:25:02.282898+0000","last_active":"2024-04-26T10:25:02.282549+0000","last_peered":"2024-04-26T10:25:02.282549+0000","last_clean":"2024-04-26T10:25:02.282549+0000","last_became_active":"2024-04-26T10:24:22.540767+0000","last_became_peered":"2024-04-26T10:24:22.540767+0000","last_unstale":"2024-04-26T10:25:02.282549+0000","last_undegraded":"2024-04-26T10:25:02.282549+0000","last_fullsized":"2024-04-26T10:25:02.282549+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:02.282431+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:02.282431+0000","last_clean_scrub_stamp":"2024-04-26T10:25:02.282431+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:51.767663+0000","scrub_duration":0.0068591950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:04.207307+0000","last_change":"2024-04-26T10:25:04.207642+0000","last_active":"2024-04-26T10:25:04.207307+0000","last_peered":"2024-04-26T10:25:04.207307+0000","last_clean":"2024-04-26T10:25:04.207307+0000","last_became_active":"2024-04-26T10:24:22.546811+0000","last_became_peered":"2024-04-26T10:24:22.546811+0000","last_unstale":"2024-04-26T10:25:04.207307+0000","last_undegraded":"2024-04-26T10:25:04.207307+0000","last_fullsized":"2024-04-26T10:25:04.207307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:04.207258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:04.207258+0000","last_clean_scrub_stamp":"2024-04-26T10:25:04.207258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:28.549935+0000","scrub_duration":0.0033412889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":74,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185835+0000","last_change":"2024-04-26T10:22:09.753438+0000","last_active":"2024-04-26T10:24:34.185835+0000","last_peered":"2024-04-26T10:24:34.185835+0000","last_clean":"2024-04-26T10:24:34.185835+0000","last_became_active":"2024-04-26T10:22:09.753211+0000","last_became_peered":"2024-04-26T10:22:09.753211+0000","last_unstale":"2024-04-26T10:24:34.185835+0000","last_undegraded":"2024-04-26T10:24:34.185835+0000","last_fullsized":"2024-04-26T10:24:34.185835+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:50.293783+0000","last_change":"2024-04-26T10:24:50.293998+0000","last_active":"2024-04-26T10:24:50.293783+0000","last_peered":"2024-04-26T10:24:50.293783+0000","last_clean":"2024-04-26T10:24:50.293783+0000","last_became_active":"2024-04-26T10:24:31.600088+0000","last_became_peered":"2024-04-26T10:24:31.600088+0000","last_unstale":"2024-04-26T10:24:50.293783+0000","last_undegraded":"2024-04-26T10:24:50.293783+0000","last_fullsized":"2024-04-26T10:24:50.293783+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:50.293726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:50.293726+0000","last_clean_scrub_stamp":"2024-04-26T10:24:50.293726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.398875+0000","scrub_duration":0.014652757000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:06.613275+0000","last_change":"2024-04-26T10:25:06.613576+0000","last_active":"2024-04-26T10:25:06.613275+0000","last_peered":"2024-04-26T10:25:06.613275+0000","last_clean":"2024-04-26T10:25:06.613275+0000","last_became_active":"2024-04-26T10:24:22.679652+0000","last_became_peered":"2024-04-26T10:24:22.679652+0000","last_unstale":"2024-04-26T10:25:06.613275+0000","last_undegraded":"2024-04-26T10:25:06.613275+0000","last_fullsized":"2024-04-26T10:25:06.613275+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-26T10:25:06.613222+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-26T10:25:06.613222+0000","last_clean_scrub_stamp":"2024-04-26T10:25:06.613222+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:12.597334+0000","scrub_duration":0.0032988710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:01.257225+0000","last_change":"2024-04-26T10:25:01.257447+0000","last_active":"2024-04-26T10:25:01.257225+0000","last_peered":"2024-04-26T10:25:01.257225+0000","last_clean":"2024-04-26T10:25:01.257225+0000","last_became_active":"2024-04-26T10:24:22.538895+0000","last_became_peered":"2024-04-26T10:24:22.538895+0000","last_unstale":"2024-04-26T10:25:01.257225+0000","last_undegraded":"2024-04-26T10:25:01.257225+0000","last_fullsized":"2024-04-26T10:25:01.257225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:01.257171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:01.257171+0000","last_clean_scrub_stamp":"2024-04-26T10:25:01.257171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:55.289475+0000","scrub_duration":0.0032699750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:03.668000+0000","last_change":"2024-04-26T10:25:03.668244+0000","last_active":"2024-04-26T10:25:03.668000+0000","last_peered":"2024-04-26T10:25:03.668000+0000","last_clean":"2024-04-26T10:25:03.668000+0000","last_became_active":"2024-04-26T10:24:22.684863+0000","last_became_peered":"2024-04-26T10:24:22.684863+0000","last_unstale":"2024-04-26T10:25:03.668000+0000","last_undegraded":"2024-04-26T10:25:03.668000+0000","last_fullsized":"2024-04-26T10:25:03.668000+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'6","last_scrub_stamp":"2024-04-26T10:25:03.667947+0000","last_deep_scrub":"91'6","last_deep_scrub_stamp":"2024-04-26T10:25:03.667947+0000","last_clean_scrub_stamp":"2024-04-26T10:25:03.667947+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:48.437612+0000","scrub_duration":0.0076333440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},"log_size":50,"ondisk_log_size":50,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":21541,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673018,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262680,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94109160,"statfs":{"total":96636764160,"available":96367779840,"internally_reserved":0,"allocated":1064960,"data_stored":1035671,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:25:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57299999999999995,"15min":0.52300000000000002},"min":{"1min":0.52400000000000002,"5min":0.192,"15min":0.192},"max":{"1min":0.72799999999999998,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.63},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.52700000000000002,"15min":0.54200000000000004},"min":{"1min":0.52800000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.70399999999999996,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.76000000000000001}]},{"osd":2,"last update":"Fri Apr 26 10:25:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.66100000000000003}]}]},{"osd":0,"up_from":10,"seq":42949673017,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487472,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":486398,"kb_avail":93884368,"statfs":{"total":96636764160,"available":96137592832,"internally_reserved":0,"allocated":1089536,"data_stored":1036287,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":498072006},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:25:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68000000000000005,"15min":0.57399999999999995},"min":{"1min":0.57999999999999996,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.73799999999999999,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57599999999999996,"15min":0.57899999999999996},"min":{"1min":0.51600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.77400000000000002,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.72899999999999998}]},{"osd":2,"last update":"Fri Apr 26 10:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.67300000000000004}]}]},{"osd":2,"up_from":80,"seq":343597383694,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38368,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":37369,"kb_avail":94333472,"statfs":{"total":96636764160,"available":96597475328,"internally_reserved":0,"allocated":1007616,"data_stored":444173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6879,"internal_metadata":38266145},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:25:25.718 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.718 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.719 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.719 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.719 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.719 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.719 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.719 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.719 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.719 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.720 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.720 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.720 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.720 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.720 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.720 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.720 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.720 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.721 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.721 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.721 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.721 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.721 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.721 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.721 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.721 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.722 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.722 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.722 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.722 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.722 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.722 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T10:21:00.797402+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.722 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.722 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.723 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.723 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.723 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.723 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.723 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.723 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.723 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.723 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.723 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.724 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.724 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.724 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.724 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.724 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.724 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.724 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.724 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.725 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.725 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.725 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:25.725 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:25:45.726 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:25:46.052 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:25:46.054 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:25:46.065 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2024-04-26T10:25:44.066429+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1184088,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":788520,"kb_used_data":3088,"kb_used_omap":9,"kb_used_meta":785398,"kb_avail":282327000,"statfs":{"total":289910292480,"available":289102848000,"internally_reserved":0,"allocated":3162112,"data_stored":2516131,"data_compressed":14075,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":10067,"internal_metadata":804247725},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004655"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:38.189816+0000","last_change":"2024-04-26T10:25:38.189928+0000","last_active":"2024-04-26T10:25:38.189816+0000","last_peered":"2024-04-26T10:25:38.189816+0000","last_clean":"2024-04-26T10:25:38.189816+0000","last_became_active":"2024-04-26T10:24:31.598170+0000","last_became_peered":"2024-04-26T10:24:31.598170+0000","last_unstale":"2024-04-26T10:25:38.189816+0000","last_undegraded":"2024-04-26T10:25:38.189816+0000","last_fullsized":"2024-04-26T10:25:38.189816+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:38.189795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:38.189795+0000","last_clean_scrub_stamp":"2024-04-26T10:25:38.189795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:47.271296+0000","scrub_duration":0.074777972999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:15.237609+0000","last_change":"2024-04-26T10:25:15.237609+0000","last_active":"2024-04-26T10:25:15.237609+0000","last_peered":"2024-04-26T10:25:15.237609+0000","last_clean":"2024-04-26T10:25:15.237609+0000","last_became_active":"2024-04-26T10:24:22.535998+0000","last_became_peered":"2024-04-26T10:24:22.535998+0000","last_unstale":"2024-04-26T10:25:15.237609+0000","last_undegraded":"2024-04-26T10:25:15.237609+0000","last_fullsized":"2024-04-26T10:25:15.237609+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:15.237328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:15.237328+0000","last_clean_scrub_stamp":"2024-04-26T10:25:15.237328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:09.529037+0000","scrub_duration":0.0032767389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":81,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.675457+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:24:43.675457+0000","last_peered":"2024-04-26T10:24:43.675457+0000","last_clean":"2024-04-26T10:24:43.675457+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:24:43.675457+0000","last_undegraded":"2024-04-26T10:24:43.675457+0000","last_fullsized":"2024-04-26T10:24:43.675457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.675449+0000","last_change":"2024-04-26T10:24:22.549067+0000","last_active":"2024-04-26T10:24:43.675449+0000","last_peered":"2024-04-26T10:24:43.675449+0000","last_clean":"2024-04-26T10:24:43.675449+0000","last_became_active":"2024-04-26T10:24:22.548485+0000","last_became_peered":"2024-04-26T10:24:22.548485+0000","last_unstale":"2024-04-26T10:24:43.675449+0000","last_undegraded":"2024-04-26T10:24:43.675449+0000","last_fullsized":"2024-04-26T10:24:43.675449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:00.289761+0000","last_change":"2024-04-26T10:25:00.290012+0000","last_active":"2024-04-26T10:25:00.289761+0000","last_peered":"2024-04-26T10:25:00.289761+0000","last_clean":"2024-04-26T10:25:00.289761+0000","last_became_active":"2024-04-26T10:24:31.600986+0000","last_became_peered":"2024-04-26T10:24:31.600986+0000","last_unstale":"2024-04-26T10:25:00.289761+0000","last_undegraded":"2024-04-26T10:25:00.289761+0000","last_fullsized":"2024-04-26T10:25:00.289761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:00.289706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:00.289706+0000","last_clean_scrub_stamp":"2024-04-26T10:25:00.289706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:20.178292+0000","scrub_duration":0.015595131999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:52.225237+0000","last_change":"2024-04-26T10:24:52.225492+0000","last_active":"2024-04-26T10:24:52.225237+0000","last_peered":"2024-04-26T10:24:52.225237+0000","last_clean":"2024-04-26T10:24:52.225237+0000","last_became_active":"2024-04-26T10:24:22.547731+0000","last_became_peered":"2024-04-26T10:24:22.547731+0000","last_unstale":"2024-04-26T10:24:52.225237+0000","last_undegraded":"2024-04-26T10:24:52.225237+0000","last_fullsized":"2024-04-26T10:24:52.225237+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:52.225191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:52.225191+0000","last_clean_scrub_stamp":"2024-04-26T10:24:52.225191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:05.446400+0000","scrub_duration":0.003307118,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:46.143038+0000","last_change":"2024-04-26T10:24:46.143361+0000","last_active":"2024-04-26T10:24:46.143038+0000","last_peered":"2024-04-26T10:24:46.143038+0000","last_clean":"2024-04-26T10:24:46.143038+0000","last_became_active":"2024-04-26T10:24:22.549180+0000","last_became_peered":"2024-04-26T10:24:22.549180+0000","last_unstale":"2024-04-26T10:24:46.143038+0000","last_undegraded":"2024-04-26T10:24:46.143038+0000","last_fullsized":"2024-04-26T10:24:46.143038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:46.142953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:46.142953+0000","last_clean_scrub_stamp":"2024-04-26T10:24:46.142953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:47.298765+0000","scrub_duration":0.014784434000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180250+0000","last_change":"2024-04-26T10:24:22.547840+0000","last_active":"2024-04-26T10:24:34.180250+0000","last_peered":"2024-04-26T10:24:34.180250+0000","last_clean":"2024-04-26T10:24:34.180250+0000","last_became_active":"2024-04-26T10:24:22.547284+0000","last_became_peered":"2024-04-26T10:24:22.547284+0000","last_unstale":"2024-04-26T10:24:34.180250+0000","last_undegraded":"2024-04-26T10:24:34.180250+0000","last_fullsized":"2024-04-26T10:24:34.180250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:56.807533+0000","last_change":"2024-04-26T10:24:56.807646+0000","last_active":"2024-04-26T10:24:56.807533+0000","last_peered":"2024-04-26T10:24:56.807533+0000","last_clean":"2024-04-26T10:24:56.807533+0000","last_became_active":"2024-04-26T10:24:22.679648+0000","last_became_peered":"2024-04-26T10:24:22.679648+0000","last_unstale":"2024-04-26T10:24:56.807533+0000","last_undegraded":"2024-04-26T10:24:56.807533+0000","last_fullsized":"2024-04-26T10:24:56.807533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:56.807510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:56.807510+0000","last_clean_scrub_stamp":"2024-04-26T10:24:56.807510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:24.720449+0000","scrub_duration":0.029714911,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:04.256728+0000","last_change":"2024-04-26T10:25:04.256968+0000","last_active":"2024-04-26T10:25:04.256728+0000","last_peered":"2024-04-26T10:25:04.256728+0000","last_clean":"2024-04-26T10:25:04.256728+0000","last_became_active":"2024-04-26T10:24:31.598187+0000","last_became_peered":"2024-04-26T10:24:31.598187+0000","last_unstale":"2024-04-26T10:25:04.256728+0000","last_undegraded":"2024-04-26T10:25:04.256728+0000","last_fullsized":"2024-04-26T10:25:04.256728+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:04.256683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:04.256683+0000","last_clean_scrub_stamp":"2024-04-26T10:25:04.256683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:01.571431+0000","scrub_duration":0.0034188460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.181251+0000","last_change":"2024-04-26T10:24:22.547601+0000","last_active":"2024-04-26T10:24:34.181251+0000","last_peered":"2024-04-26T10:24:34.181251+0000","last_clean":"2024-04-26T10:24:34.181251+0000","last_became_active":"2024-04-26T10:24:22.546506+0000","last_became_peered":"2024-04-26T10:24:22.546506+0000","last_unstale":"2024-04-26T10:24:34.181251+0000","last_undegraded":"2024-04-26T10:24:34.181251+0000","last_fullsized":"2024-04-26T10:24:34.181251+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":82,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:56.279912+0000","last_change":"2024-04-26T10:24:56.280129+0000","last_active":"2024-04-26T10:24:56.279912+0000","last_peered":"2024-04-26T10:24:56.279912+0000","last_clean":"2024-04-26T10:24:56.279912+0000","last_became_active":"2024-04-26T10:22:09.747822+0000","last_became_peered":"2024-04-26T10:22:09.747822+0000","last_unstale":"2024-04-26T10:24:56.279912+0000","last_undegraded":"2024-04-26T10:24:56.279912+0000","last_fullsized":"2024-04-26T10:24:56.279912+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:56.279865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:56.279865+0000","last_clean_scrub_stamp":"2024-04-26T10:24:56.279865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:18:56.107536+0000","scrub_duration":0.0031183439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:09.228824+0000","last_change":"2024-04-26T10:25:09.229056+0000","last_active":"2024-04-26T10:25:09.228824+0000","last_peered":"2024-04-26T10:25:09.228824+0000","last_clean":"2024-04-26T10:25:09.228824+0000","last_became_active":"2024-04-26T10:24:31.597980+0000","last_became_peered":"2024-04-26T10:24:31.597980+0000","last_unstale":"2024-04-26T10:25:09.228824+0000","last_undegraded":"2024-04-26T10:25:09.228824+0000","last_fullsized":"2024-04-26T10:25:09.228824+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:09.228760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:09.228760+0000","last_clean_scrub_stamp":"2024-04-26T10:25:09.228760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:16.641297+0000","scrub_duration":0.01109303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":117,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:53.201478+0000","last_change":"2024-04-26T10:24:53.201710+0000","last_active":"2024-04-26T10:24:53.201478+0000","last_peered":"2024-04-26T10:24:53.201478+0000","last_clean":"2024-04-26T10:24:53.201478+0000","last_became_active":"2024-04-26T10:24:31.602539+0000","last_became_peered":"2024-04-26T10:24:31.602539+0000","last_unstale":"2024-04-26T10:24:53.201478+0000","last_undegraded":"2024-04-26T10:24:53.201478+0000","last_fullsized":"2024-04-26T10:24:53.201478+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:53.201431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:53.201431+0000","last_clean_scrub_stamp":"2024-04-26T10:24:53.201431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:31.514894+0000","scrub_duration":0.0033374949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":117,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:00.222743+0000","last_change":"2024-04-26T10:25:00.222988+0000","last_active":"2024-04-26T10:25:00.222743+0000","last_peered":"2024-04-26T10:25:00.222743+0000","last_clean":"2024-04-26T10:25:00.222743+0000","last_became_active":"2024-04-26T10:24:31.602453+0000","last_became_peered":"2024-04-26T10:24:31.602453+0000","last_unstale":"2024-04-26T10:25:00.222743+0000","last_undegraded":"2024-04-26T10:25:00.222743+0000","last_fullsized":"2024-04-26T10:25:00.222743+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:00.222698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:00.222698+0000","last_clean_scrub_stamp":"2024-04-26T10:25:00.222698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:45.583919+0000","scrub_duration":0.0030823560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.179940+0000","last_change":"2024-04-26T10:24:22.547543+0000","last_active":"2024-04-26T10:24:34.179940+0000","last_peered":"2024-04-26T10:24:34.179940+0000","last_clean":"2024-04-26T10:24:34.179940+0000","last_became_active":"2024-04-26T10:24:22.546856+0000","last_became_peered":"2024-04-26T10:24:22.546856+0000","last_unstale":"2024-04-26T10:24:34.179940+0000","last_undegraded":"2024-04-26T10:24:34.179940+0000","last_fullsized":"2024-04-26T10:24:34.179940+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:34.846197+0000","last_change":"2024-04-26T10:25:34.846363+0000","last_active":"2024-04-26T10:25:34.846197+0000","last_peered":"2024-04-26T10:25:34.846197+0000","last_clean":"2024-04-26T10:25:34.846197+0000","last_became_active":"2024-04-26T10:24:22.679350+0000","last_became_peered":"2024-04-26T10:24:22.679350+0000","last_unstale":"2024-04-26T10:25:34.846197+0000","last_undegraded":"2024-04-26T10:25:34.846197+0000","last_fullsized":"2024-04-26T10:25:34.846197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:34.846164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:34.846164+0000","last_clean_scrub_stamp":"2024-04-26T10:25:34.846164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:48.771890+0000","scrub_duration":0.052228093000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:36.161111+0000","last_change":"2024-04-26T10:25:36.161340+0000","last_active":"2024-04-26T10:25:36.161111+0000","last_peered":"2024-04-26T10:25:36.161111+0000","last_clean":"2024-04-26T10:25:36.161111+0000","last_became_active":"2024-04-26T10:24:31.597563+0000","last_became_peered":"2024-04-26T10:24:31.597563+0000","last_unstale":"2024-04-26T10:25:36.161111+0000","last_undegraded":"2024-04-26T10:25:36.161111+0000","last_fullsized":"2024-04-26T10:25:36.161111+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:36.161060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:36.161060+0000","last_clean_scrub_stamp":"2024-04-26T10:25:36.161060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:55.224036+0000","scrub_duration":0.003288694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:22.717671+0000","last_change":"2024-04-26T10:25:22.717781+0000","last_active":"2024-04-26T10:25:22.717671+0000","last_peered":"2024-04-26T10:25:22.717671+0000","last_clean":"2024-04-26T10:25:22.717671+0000","last_became_active":"2024-04-26T10:24:22.678912+0000","last_became_peered":"2024-04-26T10:24:22.678912+0000","last_unstale":"2024-04-26T10:25:22.717671+0000","last_undegraded":"2024-04-26T10:25:22.717671+0000","last_fullsized":"2024-04-26T10:25:22.717671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:22.717652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:22.717652+0000","last_clean_scrub_stamp":"2024-04-26T10:25:22.717652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:29.694277+0000","scrub_duration":0.017936198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.675165+0000","last_change":"2024-04-26T10:24:22.546669+0000","last_active":"2024-04-26T10:24:43.675165+0000","last_peered":"2024-04-26T10:24:43.675165+0000","last_clean":"2024-04-26T10:24:43.675165+0000","last_became_active":"2024-04-26T10:24:22.546052+0000","last_became_peered":"2024-04-26T10:24:22.546052+0000","last_unstale":"2024-04-26T10:24:43.675165+0000","last_undegraded":"2024-04-26T10:24:43.675165+0000","last_fullsized":"2024-04-26T10:24:43.675165+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:08.292897+0000","last_change":"2024-04-26T10:25:08.292897+0000","last_active":"2024-04-26T10:25:08.292897+0000","last_peered":"2024-04-26T10:25:08.292897+0000","last_clean":"2024-04-26T10:25:08.292897+0000","last_became_active":"2024-04-26T10:24:22.547663+0000","last_became_peered":"2024-04-26T10:24:22.547663+0000","last_unstale":"2024-04-26T10:25:08.292897+0000","last_undegraded":"2024-04-26T10:25:08.292897+0000","last_fullsized":"2024-04-26T10:25:08.292897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:08.292772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:08.292772+0000","last_clean_scrub_stamp":"2024-04-26T10:25:08.292772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:35.112407+0000","scrub_duration":0.038060340999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:01.324901+0000","last_change":"2024-04-26T10:25:01.324901+0000","last_active":"2024-04-26T10:25:01.324901+0000","last_peered":"2024-04-26T10:25:01.324901+0000","last_clean":"2024-04-26T10:25:01.324901+0000","last_became_active":"2024-04-26T10:22:09.748755+0000","last_became_peered":"2024-04-26T10:22:09.748755+0000","last_unstale":"2024-04-26T10:25:01.324901+0000","last_undegraded":"2024-04-26T10:25:01.324901+0000","last_fullsized":"2024-04-26T10:25:01.324901+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:01.324527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:01.324527+0000","last_clean_scrub_stamp":"2024-04-26T10:25:01.324527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:42.317619+0000","scrub_duration":0.0030479109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:31.855132+0000","last_change":"2024-04-26T10:25:31.855451+0000","last_active":"2024-04-26T10:25:31.855132+0000","last_peered":"2024-04-26T10:25:31.855132+0000","last_clean":"2024-04-26T10:25:31.855132+0000","last_became_active":"2024-04-26T10:24:22.683921+0000","last_became_peered":"2024-04-26T10:24:22.683921+0000","last_unstale":"2024-04-26T10:25:31.855132+0000","last_undegraded":"2024-04-26T10:25:31.855132+0000","last_fullsized":"2024-04-26T10:25:31.855132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:31.855041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:31.855041+0000","last_clean_scrub_stamp":"2024-04-26T10:25:31.855041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:04.764581+0000","scrub_duration":0.003368359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:22.231749+0000","last_change":"2024-04-26T10:25:22.231749+0000","last_active":"2024-04-26T10:25:22.231749+0000","last_peered":"2024-04-26T10:25:22.231749+0000","last_clean":"2024-04-26T10:25:22.231749+0000","last_became_active":"2024-04-26T10:24:22.534674+0000","last_became_peered":"2024-04-26T10:24:22.534674+0000","last_unstale":"2024-04-26T10:25:22.231749+0000","last_undegraded":"2024-04-26T10:25:22.231749+0000","last_fullsized":"2024-04-26T10:25:22.231749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:22.231415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:22.231415+0000","last_clean_scrub_stamp":"2024-04-26T10:25:22.231415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:27.733690+0000","scrub_duration":0.0033621749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:48.293794+0000","last_change":"2024-04-26T10:24:48.293911+0000","last_active":"2024-04-26T10:24:48.293794+0000","last_peered":"2024-04-26T10:24:48.293794+0000","last_clean":"2024-04-26T10:24:48.293794+0000","last_became_active":"2024-04-26T10:24:31.600815+0000","last_became_peered":"2024-04-26T10:24:31.600815+0000","last_unstale":"2024-04-26T10:24:48.293794+0000","last_undegraded":"2024-04-26T10:24:48.293794+0000","last_fullsized":"2024-04-26T10:24:48.293794+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:48.293774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:48.293774+0000","last_clean_scrub_stamp":"2024-04-26T10:24:48.293774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:51.595218+0000","scrub_duration":0.058713007999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:51.769368+0000","last_change":"2024-04-26T10:24:51.769593+0000","last_active":"2024-04-26T10:24:51.769368+0000","last_peered":"2024-04-26T10:24:51.769368+0000","last_clean":"2024-04-26T10:24:51.769368+0000","last_became_active":"2024-04-26T10:24:22.683959+0000","last_became_peered":"2024-04-26T10:24:22.683959+0000","last_unstale":"2024-04-26T10:24:51.769368+0000","last_undegraded":"2024-04-26T10:24:51.769368+0000","last_fullsized":"2024-04-26T10:24:51.769368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:51.769321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:51.769321+0000","last_clean_scrub_stamp":"2024-04-26T10:24:51.769321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:05.665068+0000","scrub_duration":0.003275011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":81,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.675147+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:24:43.675147+0000","last_peered":"2024-04-26T10:24:43.675147+0000","last_clean":"2024-04-26T10:24:43.675147+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:24:43.675147+0000","last_undegraded":"2024-04-26T10:24:43.675147+0000","last_fullsized":"2024-04-26T10:24:43.675147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185612+0000","last_change":"2024-04-26T10:24:31.602078+0000","last_active":"2024-04-26T10:24:34.185612+0000","last_peered":"2024-04-26T10:24:34.185612+0000","last_clean":"2024-04-26T10:24:34.185612+0000","last_became_active":"2024-04-26T10:24:31.601299+0000","last_became_peered":"2024-04-26T10:24:31.601299+0000","last_unstale":"2024-04-26T10:24:34.185612+0000","last_undegraded":"2024-04-26T10:24:34.185612+0000","last_fullsized":"2024-04-26T10:24:34.185612+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.318287+0000","last_change":"2024-04-26T10:24:31.741152+0000","last_active":"2024-04-26T10:24:34.318287+0000","last_peered":"2024-04-26T10:24:34.318287+0000","last_clean":"2024-04-26T10:24:34.318287+0000","last_became_active":"2024-04-26T10:24:31.740626+0000","last_became_peered":"2024-04-26T10:24:31.740626+0000","last_unstale":"2024-04-26T10:24:34.318287+0000","last_undegraded":"2024-04-26T10:24:34.318287+0000","last_fullsized":"2024-04-26T10:24:34.318287+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:31.074103+0000","last_change":"2024-04-26T10:25:31.074332+0000","last_active":"2024-04-26T10:25:31.074103+0000","last_peered":"2024-04-26T10:25:31.074103+0000","last_clean":"2024-04-26T10:25:31.074103+0000","last_became_active":"2024-04-26T10:22:09.750286+0000","last_became_peered":"2024-04-26T10:22:09.750286+0000","last_unstale":"2024-04-26T10:25:31.074103+0000","last_undegraded":"2024-04-26T10:25:31.074103+0000","last_fullsized":"2024-04-26T10:25:31.074103+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:31.074058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:31.074058+0000","last_clean_scrub_stamp":"2024-04-26T10:25:31.074058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:39.699950+0000","scrub_duration":0.003248187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.318332+0000","last_change":"2024-04-26T10:24:31.741008+0000","last_active":"2024-04-26T10:24:34.318332+0000","last_peered":"2024-04-26T10:24:34.318332+0000","last_clean":"2024-04-26T10:24:34.318332+0000","last_became_active":"2024-04-26T10:24:31.740518+0000","last_became_peered":"2024-04-26T10:24:31.740518+0000","last_unstale":"2024-04-26T10:24:34.318332+0000","last_undegraded":"2024-04-26T10:24:34.318332+0000","last_fullsized":"2024-04-26T10:24:34.318332+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:44.170604+0000","last_change":"2024-04-26T10:24:44.170604+0000","last_active":"2024-04-26T10:24:44.170604+0000","last_peered":"2024-04-26T10:24:44.170604+0000","last_clean":"2024-04-26T10:24:44.170604+0000","last_became_active":"2024-04-26T10:24:22.539106+0000","last_became_peered":"2024-04-26T10:24:22.539106+0000","last_unstale":"2024-04-26T10:24:44.170604+0000","last_undegraded":"2024-04-26T10:24:44.170604+0000","last_fullsized":"2024-04-26T10:24:44.170604+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:44.170151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:44.170151+0000","last_clean_scrub_stamp":"2024-04-26T10:24:44.170151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:52.109209+0000","scrub_duration":0.010234752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.185397+0000","last_change":"2024-04-26T10:24:31.599487+0000","last_active":"2024-04-26T10:24:34.185397+0000","last_peered":"2024-04-26T10:24:34.185397+0000","last_clean":"2024-04-26T10:24:34.185397+0000","last_became_active":"2024-04-26T10:24:31.598307+0000","last_became_peered":"2024-04-26T10:24:31.598307+0000","last_unstale":"2024-04-26T10:24:34.185397+0000","last_undegraded":"2024-04-26T10:24:34.185397+0000","last_fullsized":"2024-04-26T10:24:34.185397+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"91'4","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:34.241038+0000","last_change":"2024-04-26T10:25:34.241275+0000","last_active":"2024-04-26T10:25:34.241038+0000","last_peered":"2024-04-26T10:25:34.241038+0000","last_clean":"2024-04-26T10:25:34.241038+0000","last_became_active":"2024-04-26T10:24:22.546794+0000","last_became_peered":"2024-04-26T10:24:22.546794+0000","last_unstale":"2024-04-26T10:25:34.241038+0000","last_undegraded":"2024-04-26T10:25:34.241038+0000","last_fullsized":"2024-04-26T10:25:34.241038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-04-26T10:25:34.240988+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-04-26T10:25:34.240988+0000","last_clean_scrub_stamp":"2024-04-26T10:25:34.240988+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:09.512473+0000","scrub_duration":0.0082918269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:47.236229+0000","last_change":"2024-04-26T10:24:47.236463+0000","last_active":"2024-04-26T10:24:47.236229+0000","last_peered":"2024-04-26T10:24:47.236229+0000","last_clean":"2024-04-26T10:24:47.236229+0000","last_became_active":"2024-04-26T10:24:31.596297+0000","last_became_peered":"2024-04-26T10:24:31.596297+0000","last_unstale":"2024-04-26T10:24:47.236229+0000","last_undegraded":"2024-04-26T10:24:47.236229+0000","last_fullsized":"2024-04-26T10:24:47.236229+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:47.236175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:47.236175+0000","last_clean_scrub_stamp":"2024-04-26T10:24:47.236175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:31.442660+0000","scrub_duration":0.014903458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:12.635104+0000","last_change":"2024-04-26T10:25:12.635350+0000","last_active":"2024-04-26T10:25:12.635104+0000","last_peered":"2024-04-26T10:25:12.635104+0000","last_clean":"2024-04-26T10:25:12.635104+0000","last_became_active":"2024-04-26T10:24:22.684541+0000","last_became_peered":"2024-04-26T10:24:22.684541+0000","last_unstale":"2024-04-26T10:25:12.635104+0000","last_undegraded":"2024-04-26T10:25:12.635104+0000","last_fullsized":"2024-04-26T10:25:12.635104+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:12.635057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:12.635057+0000","last_clean_scrub_stamp":"2024-04-26T10:25:12.635057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:40.868547+0000","scrub_duration":0.0035574059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:33.793616+0000","last_change":"2024-04-26T10:25:33.793857+0000","last_active":"2024-04-26T10:25:33.793616+0000","last_peered":"2024-04-26T10:25:33.793616+0000","last_clean":"2024-04-26T10:25:33.793616+0000","last_became_active":"2024-04-26T10:24:22.682650+0000","last_became_peered":"2024-04-26T10:24:22.682650+0000","last_unstale":"2024-04-26T10:25:33.793616+0000","last_undegraded":"2024-04-26T10:25:33.793616+0000","last_fullsized":"2024-04-26T10:25:33.793616+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:33.793569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:33.793569+0000","last_clean_scrub_stamp":"2024-04-26T10:25:33.793569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:42:31.145665+0000","scrub_duration":0.0030047139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:34.094073+0000","last_change":"2024-04-26T10:25:34.094279+0000","last_active":"2024-04-26T10:25:34.094073+0000","last_peered":"2024-04-26T10:25:34.094073+0000","last_clean":"2024-04-26T10:25:34.094073+0000","last_became_active":"2024-04-26T10:24:31.601091+0000","last_became_peered":"2024-04-26T10:24:31.601091+0000","last_unstale":"2024-04-26T10:25:34.094073+0000","last_undegraded":"2024-04-26T10:25:34.094073+0000","last_fullsized":"2024-04-26T10:25:34.094073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:34.094025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:34.094025+0000","last_clean_scrub_stamp":"2024-04-26T10:25:34.094025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:48.013784+0000","scrub_duration":0.003459784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:08.712500+0000","last_change":"2024-04-26T10:25:08.712611+0000","last_active":"2024-04-26T10:25:08.712500+0000","last_peered":"2024-04-26T10:25:08.712500+0000","last_clean":"2024-04-26T10:25:08.712500+0000","last_became_active":"2024-04-26T10:24:22.684213+0000","last_became_peered":"2024-04-26T10:24:22.684213+0000","last_unstale":"2024-04-26T10:25:08.712500+0000","last_undegraded":"2024-04-26T10:25:08.712500+0000","last_fullsized":"2024-04-26T10:25:08.712500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:08.712479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:08.712479+0000","last_clean_scrub_stamp":"2024-04-26T10:25:08.712479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:22.971123+0000","scrub_duration":0.069345404999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"91'12","reported_seq":150,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:27.254518+0000","last_change":"2024-04-26T10:25:27.254757+0000","last_active":"2024-04-26T10:25:27.254518+0000","last_peered":"2024-04-26T10:25:27.254518+0000","last_clean":"2024-04-26T10:25:27.254518+0000","last_became_active":"2024-04-26T10:24:31.604402+0000","last_became_peered":"2024-04-26T10:24:31.604402+0000","last_unstale":"2024-04-26T10:25:27.254518+0000","last_undegraded":"2024-04-26T10:25:27.254518+0000","last_fullsized":"2024-04-26T10:25:27.254518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'12","last_scrub_stamp":"2024-04-26T10:25:27.254465+0000","last_deep_scrub":"91'12","last_deep_scrub_stamp":"2024-04-26T10:25:27.254465+0000","last_clean_scrub_stamp":"2024-04-26T10:25:27.254465+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:52.325925+0000","scrub_duration":0.0093417299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"91'2","reported_seq":129,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:36.183977+0000","last_change":"2024-04-26T10:25:36.183977+0000","last_active":"2024-04-26T10:25:36.183977+0000","last_peered":"2024-04-26T10:25:36.183977+0000","last_clean":"2024-04-26T10:25:36.183977+0000","last_became_active":"2024-04-26T10:24:31.604744+0000","last_became_peered":"2024-04-26T10:24:31.604744+0000","last_unstale":"2024-04-26T10:25:36.183977+0000","last_undegraded":"2024-04-26T10:25:36.183977+0000","last_fullsized":"2024-04-26T10:25:36.183977+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-04-26T10:25:36.183521+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-04-26T10:25:36.183521+0000","last_clean_scrub_stamp":"2024-04-26T10:25:36.183521+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:59.590522+0000","scrub_duration":0.0073008739999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:52.312203+0000","last_change":"2024-04-26T10:24:52.312203+0000","last_active":"2024-04-26T10:24:52.312203+0000","last_peered":"2024-04-26T10:24:52.312203+0000","last_clean":"2024-04-26T10:24:52.312203+0000","last_became_active":"2024-04-26T10:22:09.749862+0000","last_became_peered":"2024-04-26T10:22:09.749862+0000","last_unstale":"2024-04-26T10:24:52.312203+0000","last_undegraded":"2024-04-26T10:24:52.312203+0000","last_fullsized":"2024-04-26T10:24:52.312203+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:52.311773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:52.311773+0000","last_clean_scrub_stamp":"2024-04-26T10:24:52.311773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:12.624461+0000","scrub_duration":0.0034835349999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"91'3","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:13.197344+0000","last_change":"2024-04-26T10:25:13.197344+0000","last_active":"2024-04-26T10:25:13.197344+0000","last_peered":"2024-04-26T10:25:13.197344+0000","last_clean":"2024-04-26T10:25:13.197344+0000","last_became_active":"2024-04-26T10:22:09.749852+0000","last_became_peered":"2024-04-26T10:22:09.749852+0000","last_unstale":"2024-04-26T10:25:13.197344+0000","last_undegraded":"2024-04-26T10:25:13.197344+0000","last_fullsized":"2024-04-26T10:25:13.197344+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:13.197045+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:13.197045+0000","last_clean_scrub_stamp":"2024-04-26T10:25:13.197045+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:01.578169+0000","scrub_duration":0.0064724919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.184081+0000","last_change":"2024-04-26T10:24:31.597157+0000","last_active":"2024-04-26T10:24:34.184081+0000","last_peered":"2024-04-26T10:24:34.184081+0000","last_clean":"2024-04-26T10:24:34.184081+0000","last_became_active":"2024-04-26T10:24:31.596335+0000","last_became_peered":"2024-04-26T10:24:31.596335+0000","last_unstale":"2024-04-26T10:24:34.184081+0000","last_undegraded":"2024-04-26T10:24:34.184081+0000","last_fullsized":"2024-04-26T10:24:34.184081+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"91'2","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:42.239060+0000","last_change":"2024-04-26T10:25:42.239422+0000","last_active":"2024-04-26T10:25:42.239060+0000","last_peered":"2024-04-26T10:25:42.239060+0000","last_clean":"2024-04-26T10:25:42.239060+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:25:42.239060+0000","last_undegraded":"2024-04-26T10:25:42.239060+0000","last_fullsized":"2024-04-26T10:25:42.239060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-04-26T10:25:42.238933+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-04-26T10:25:42.238933+0000","last_clean_scrub_stamp":"2024-04-26T10:25:42.238933+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:18.940962+0000","scrub_duration":0.0070962710000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:35.198370+0000","last_change":"2024-04-26T10:25:35.198666+0000","last_active":"2024-04-26T10:25:35.198370+0000","last_peered":"2024-04-26T10:25:35.198370+0000","last_clean":"2024-04-26T10:25:35.198370+0000","last_became_active":"2024-04-26T10:24:22.549230+0000","last_became_peered":"2024-04-26T10:24:22.549230+0000","last_unstale":"2024-04-26T10:25:35.198370+0000","last_undegraded":"2024-04-26T10:25:35.198370+0000","last_fullsized":"2024-04-26T10:25:35.198370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:35.198322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:35.198322+0000","last_clean_scrub_stamp":"2024-04-26T10:25:35.198322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:02.241610+0000","scrub_duration":0.0034907969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674685+0000","last_change":"2024-04-26T10:24:22.541409+0000","last_active":"2024-04-26T10:24:43.674685+0000","last_peered":"2024-04-26T10:24:43.674685+0000","last_clean":"2024-04-26T10:24:43.674685+0000","last_became_active":"2024-04-26T10:24:22.540611+0000","last_became_peered":"2024-04-26T10:24:22.540611+0000","last_unstale":"2024-04-26T10:24:43.674685+0000","last_undegraded":"2024-04-26T10:24:43.674685+0000","last_fullsized":"2024-04-26T10:24:43.674685+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:10.703734+0000","last_change":"2024-04-26T10:25:10.703884+0000","last_active":"2024-04-26T10:25:10.703734+0000","last_peered":"2024-04-26T10:25:10.703734+0000","last_clean":"2024-04-26T10:25:10.703734+0000","last_became_active":"2024-04-26T10:24:22.686841+0000","last_became_peered":"2024-04-26T10:24:22.686841+0000","last_unstale":"2024-04-26T10:25:10.703734+0000","last_undegraded":"2024-04-26T10:25:10.703734+0000","last_fullsized":"2024-04-26T10:25:10.703734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:10.703715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:10.703715+0000","last_clean_scrub_stamp":"2024-04-26T10:25:10.703715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:08.356723+0000","scrub_duration":0.01785925,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'3","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:02.685154+0000","last_change":"2024-04-26T10:25:02.685404+0000","last_active":"2024-04-26T10:25:02.685154+0000","last_peered":"2024-04-26T10:25:02.685154+0000","last_clean":"2024-04-26T10:25:02.685154+0000","last_became_active":"2024-04-26T10:24:22.686846+0000","last_became_peered":"2024-04-26T10:24:22.686846+0000","last_unstale":"2024-04-26T10:25:02.685154+0000","last_undegraded":"2024-04-26T10:25:02.685154+0000","last_fullsized":"2024-04-26T10:25:02.685154+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:02.685093+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:02.685093+0000","last_clean_scrub_stamp":"2024-04-26T10:25:02.685093+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:29.685511+0000","scrub_duration":0.0064629550000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:32.237246+0000","last_change":"2024-04-26T10:25:32.237246+0000","last_active":"2024-04-26T10:25:32.237246+0000","last_peered":"2024-04-26T10:25:32.237246+0000","last_clean":"2024-04-26T10:25:32.237246+0000","last_became_active":"2024-04-26T10:24:22.545616+0000","last_became_peered":"2024-04-26T10:24:22.545616+0000","last_unstale":"2024-04-26T10:25:32.237246+0000","last_undegraded":"2024-04-26T10:25:32.237246+0000","last_fullsized":"2024-04-26T10:25:32.237246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:32.236967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:32.236967+0000","last_clean_scrub_stamp":"2024-04-26T10:25:32.236967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:18.701998+0000","scrub_duration":0.0034163280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674541+0000","last_change":"2024-04-26T10:24:22.540185+0000","last_active":"2024-04-26T10:24:43.674541+0000","last_peered":"2024-04-26T10:24:43.674541+0000","last_clean":"2024-04-26T10:24:43.674541+0000","last_became_active":"2024-04-26T10:24:22.538982+0000","last_became_peered":"2024-04-26T10:24:22.538982+0000","last_unstale":"2024-04-26T10:24:43.674541+0000","last_undegraded":"2024-04-26T10:24:43.674541+0000","last_fullsized":"2024-04-26T10:24:43.674541+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":81,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674915+0000","last_change":"2024-04-26T10:21:09.320655+0000","last_active":"2024-04-26T10:24:43.674915+0000","last_peered":"2024-04-26T10:24:43.674915+0000","last_clean":"2024-04-26T10:24:43.674915+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:24:43.674915+0000","last_undegraded":"2024-04-26T10:24:43.674915+0000","last_fullsized":"2024-04-26T10:24:43.674915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":84,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:07.248434+0000","last_change":"2024-04-26T10:25:07.248434+0000","last_active":"2024-04-26T10:25:07.248434+0000","last_peered":"2024-04-26T10:25:07.248434+0000","last_clean":"2024-04-26T10:25:07.248434+0000","last_became_active":"2024-04-26T10:22:09.748256+0000","last_became_peered":"2024-04-26T10:22:09.748256+0000","last_unstale":"2024-04-26T10:25:07.248434+0000","last_undegraded":"2024-04-26T10:25:07.248434+0000","last_fullsized":"2024-04-26T10:25:07.248434+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:07.248161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:07.248161+0000","last_clean_scrub_stamp":"2024-04-26T10:25:07.248161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:25.723449+0000","scrub_duration":0.003118071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:41.225747+0000","last_change":"2024-04-26T10:25:41.225747+0000","last_active":"2024-04-26T10:25:41.225747+0000","last_peered":"2024-04-26T10:25:41.225747+0000","last_clean":"2024-04-26T10:25:41.225747+0000","last_became_active":"2024-04-26T10:24:31.603620+0000","last_became_peered":"2024-04-26T10:24:31.603620+0000","last_unstale":"2024-04-26T10:25:41.225747+0000","last_undegraded":"2024-04-26T10:25:41.225747+0000","last_fullsized":"2024-04-26T10:25:41.225747+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:41.225468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:41.225468+0000","last_clean_scrub_stamp":"2024-04-26T10:25:41.225468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.344665+0000","scrub_duration":0.0031305310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:37.156489+0000","last_change":"2024-04-26T10:25:37.156720+0000","last_active":"2024-04-26T10:25:37.156489+0000","last_peered":"2024-04-26T10:25:37.156489+0000","last_clean":"2024-04-26T10:25:37.156489+0000","last_became_active":"2024-04-26T10:24:31.598120+0000","last_became_peered":"2024-04-26T10:24:31.598120+0000","last_unstale":"2024-04-26T10:25:37.156489+0000","last_undegraded":"2024-04-26T10:25:37.156489+0000","last_fullsized":"2024-04-26T10:25:37.156489+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:37.156442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:37.156442+0000","last_clean_scrub_stamp":"2024-04-26T10:25:37.156442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:09.426539+0000","scrub_duration":0.0032247579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:57.789264+0000","last_change":"2024-04-26T10:24:57.789439+0000","last_active":"2024-04-26T10:24:57.789264+0000","last_peered":"2024-04-26T10:24:57.789264+0000","last_clean":"2024-04-26T10:24:57.789264+0000","last_became_active":"2024-04-26T10:24:22.679940+0000","last_became_peered":"2024-04-26T10:24:22.679940+0000","last_unstale":"2024-04-26T10:24:57.789264+0000","last_undegraded":"2024-04-26T10:24:57.789264+0000","last_fullsized":"2024-04-26T10:24:57.789264+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:57.789236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:57.789236+0000","last_clean_scrub_stamp":"2024-04-26T10:24:57.789236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:34.365027+0000","scrub_duration":0.045365677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":335,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674349+0000","last_change":"2024-04-26T10:24:34.185235+0000","last_active":"2024-04-26T10:24:43.674349+0000","last_peered":"2024-04-26T10:24:43.674349+0000","last_clean":"2024-04-26T10:24:43.674349+0000","last_became_active":"2024-04-26T10:24:34.184490+0000","last_became_peered":"2024-04-26T10:24:34.184490+0000","last_unstale":"2024-04-26T10:24:43.674349+0000","last_undegraded":"2024-04-26T10:24:43.674349+0000","last_fullsized":"2024-04-26T10:24:43.674349+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:00.797402+0000","last_clean_scrub_stamp":"2024-04-26T10:21:00.797402+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":98,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674360+0000","last_change":"2024-04-26T10:24:22.547708+0000","last_active":"2024-04-26T10:24:43.674360+0000","last_peered":"2024-04-26T10:24:43.674360+0000","last_clean":"2024-04-26T10:24:43.674360+0000","last_became_active":"2024-04-26T10:24:22.546650+0000","last_became_peered":"2024-04-26T10:24:22.546650+0000","last_unstale":"2024-04-26T10:24:43.674360+0000","last_undegraded":"2024-04-26T10:24:43.674360+0000","last_fullsized":"2024-04-26T10:24:43.674360+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:49.697780+0000","last_change":"2024-04-26T10:24:49.698037+0000","last_active":"2024-04-26T10:24:49.697780+0000","last_peered":"2024-04-26T10:24:49.697780+0000","last_clean":"2024-04-26T10:24:49.697780+0000","last_became_active":"2024-04-26T10:24:22.676489+0000","last_became_peered":"2024-04-26T10:24:22.676489+0000","last_unstale":"2024-04-26T10:24:49.697780+0000","last_undegraded":"2024-04-26T10:24:49.697780+0000","last_fullsized":"2024-04-26T10:24:49.697780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:49.697735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:49.697735+0000","last_clean_scrub_stamp":"2024-04-26T10:24:49.697735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:32.374320+0000","scrub_duration":0.0030634690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:12.176501+0000","last_change":"2024-04-26T10:25:12.176501+0000","last_active":"2024-04-26T10:25:12.176501+0000","last_peered":"2024-04-26T10:25:12.176501+0000","last_clean":"2024-04-26T10:25:12.176501+0000","last_became_active":"2024-04-26T10:24:31.603498+0000","last_became_peered":"2024-04-26T10:24:31.603498+0000","last_unstale":"2024-04-26T10:25:12.176501+0000","last_undegraded":"2024-04-26T10:25:12.176501+0000","last_fullsized":"2024-04-26T10:25:12.176501+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:12.176170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:12.176170+0000","last_clean_scrub_stamp":"2024-04-26T10:25:12.176170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:31.663887+0000","scrub_duration":0.003223147,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":111,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674391+0000","last_change":"2024-04-26T10:24:31.603067+0000","last_active":"2024-04-26T10:24:43.674391+0000","last_peered":"2024-04-26T10:24:43.674391+0000","last_clean":"2024-04-26T10:24:43.674391+0000","last_became_active":"2024-04-26T10:24:31.602611+0000","last_became_peered":"2024-04-26T10:24:31.602611+0000","last_unstale":"2024-04-26T10:24:43.674391+0000","last_undegraded":"2024-04-26T10:24:43.674391+0000","last_fullsized":"2024-04-26T10:24:43.674391+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:28.757145+0000","last_change":"2024-04-26T10:25:28.757380+0000","last_active":"2024-04-26T10:25:28.757145+0000","last_peered":"2024-04-26T10:25:28.757145+0000","last_clean":"2024-04-26T10:25:28.757145+0000","last_became_active":"2024-04-26T10:24:22.685051+0000","last_became_peered":"2024-04-26T10:24:22.685051+0000","last_unstale":"2024-04-26T10:25:28.757145+0000","last_undegraded":"2024-04-26T10:25:28.757145+0000","last_fullsized":"2024-04-26T10:25:28.757145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:28.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:28.757100+0000","last_clean_scrub_stamp":"2024-04-26T10:25:28.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:42.473787+0000","scrub_duration":0.0030427010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:24.210591+0000","last_change":"2024-04-26T10:25:24.210591+0000","last_active":"2024-04-26T10:25:24.210591+0000","last_peered":"2024-04-26T10:25:24.210591+0000","last_clean":"2024-04-26T10:25:24.210591+0000","last_became_active":"2024-04-26T10:24:22.537983+0000","last_became_peered":"2024-04-26T10:24:22.537983+0000","last_unstale":"2024-04-26T10:25:24.210591+0000","last_undegraded":"2024-04-26T10:25:24.210591+0000","last_fullsized":"2024-04-26T10:25:24.210591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:24.210327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:24.210327+0000","last_clean_scrub_stamp":"2024-04-26T10:25:24.210327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:19.630117+0000","scrub_duration":0.003228014,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:47.630110+0000","last_change":"2024-04-26T10:24:47.630379+0000","last_active":"2024-04-26T10:24:47.630110+0000","last_peered":"2024-04-26T10:24:47.630110+0000","last_clean":"2024-04-26T10:24:47.630110+0000","last_became_active":"2024-04-26T10:24:22.678866+0000","last_became_peered":"2024-04-26T10:24:22.678866+0000","last_unstale":"2024-04-26T10:24:47.630110+0000","last_undegraded":"2024-04-26T10:24:47.630110+0000","last_fullsized":"2024-04-26T10:24:47.630110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:47.630061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:47.630061+0000","last_clean_scrub_stamp":"2024-04-26T10:24:47.630061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:03.378559+0000","scrub_duration":0.003470571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":84,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:25.191632+0000","last_change":"2024-04-26T10:25:25.191896+0000","last_active":"2024-04-26T10:25:25.191632+0000","last_peered":"2024-04-26T10:25:25.191632+0000","last_clean":"2024-04-26T10:25:25.191632+0000","last_became_active":"2024-04-26T10:22:09.749935+0000","last_became_peered":"2024-04-26T10:22:09.749935+0000","last_unstale":"2024-04-26T10:25:25.191632+0000","last_undegraded":"2024-04-26T10:25:25.191632+0000","last_fullsized":"2024-04-26T10:25:25.191632+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:25.191588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:25.191588+0000","last_clean_scrub_stamp":"2024-04-26T10:25:25.191588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:58.190318+0000","scrub_duration":0.0035868789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.320254+0000","last_change":"2024-04-26T10:24:31.745820+0000","last_active":"2024-04-26T10:24:34.320254+0000","last_peered":"2024-04-26T10:24:34.320254+0000","last_clean":"2024-04-26T10:24:34.320254+0000","last_became_active":"2024-04-26T10:24:31.745487+0000","last_became_peered":"2024-04-26T10:24:31.745487+0000","last_unstale":"2024-04-26T10:24:34.320254+0000","last_undegraded":"2024-04-26T10:24:34.320254+0000","last_fullsized":"2024-04-26T10:24:34.320254+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":98,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674367+0000","last_change":"2024-04-26T10:24:22.539761+0000","last_active":"2024-04-26T10:24:43.674367+0000","last_peered":"2024-04-26T10:24:43.674367+0000","last_clean":"2024-04-26T10:24:43.674367+0000","last_became_active":"2024-04-26T10:24:22.538993+0000","last_became_peered":"2024-04-26T10:24:22.538993+0000","last_unstale":"2024-04-26T10:24:43.674367+0000","last_undegraded":"2024-04-26T10:24:43.674367+0000","last_fullsized":"2024-04-26T10:24:43.674367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674849+0000","last_change":"2024-04-26T10:24:22.542774+0000","last_active":"2024-04-26T10:24:43.674849+0000","last_peered":"2024-04-26T10:24:43.674849+0000","last_clean":"2024-04-26T10:24:43.674849+0000","last_became_active":"2024-04-26T10:24:22.541795+0000","last_became_peered":"2024-04-26T10:24:22.541795+0000","last_unstale":"2024-04-26T10:24:43.674849+0000","last_undegraded":"2024-04-26T10:24:43.674849+0000","last_fullsized":"2024-04-26T10:24:43.674849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:46.642214+0000","last_change":"2024-04-26T10:24:46.642441+0000","last_active":"2024-04-26T10:24:46.642214+0000","last_peered":"2024-04-26T10:24:46.642214+0000","last_clean":"2024-04-26T10:24:46.642214+0000","last_became_active":"2024-04-26T10:24:31.744373+0000","last_became_peered":"2024-04-26T10:24:31.744373+0000","last_unstale":"2024-04-26T10:24:46.642214+0000","last_undegraded":"2024-04-26T10:24:46.642214+0000","last_fullsized":"2024-04-26T10:24:46.642214+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:46.642168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:46.642168+0000","last_clean_scrub_stamp":"2024-04-26T10:24:46.642168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:47.970345+0000","scrub_duration":0.0030956120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674609+0000","last_change":"2024-04-26T10:24:22.538573+0000","last_active":"2024-04-26T10:24:43.674609+0000","last_peered":"2024-04-26T10:24:43.674609+0000","last_clean":"2024-04-26T10:24:43.674609+0000","last_became_active":"2024-04-26T10:24:22.537041+0000","last_became_peered":"2024-04-26T10:24:22.537041+0000","last_unstale":"2024-04-26T10:24:43.674609+0000","last_undegraded":"2024-04-26T10:24:43.674609+0000","last_fullsized":"2024-04-26T10:24:43.674609+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.318684+0000","last_change":"2024-04-26T10:24:31.744776+0000","last_active":"2024-04-26T10:24:34.318684+0000","last_peered":"2024-04-26T10:24:34.318684+0000","last_clean":"2024-04-26T10:24:34.318684+0000","last_became_active":"2024-04-26T10:24:31.744342+0000","last_became_peered":"2024-04-26T10:24:31.744342+0000","last_unstale":"2024-04-26T10:24:34.318684+0000","last_undegraded":"2024-04-26T10:24:34.318684+0000","last_fullsized":"2024-04-26T10:24:34.318684+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:53.288634+0000","last_change":"2024-04-26T10:24:53.288881+0000","last_active":"2024-04-26T10:24:53.288634+0000","last_peered":"2024-04-26T10:24:53.288634+0000","last_clean":"2024-04-26T10:24:53.288634+0000","last_became_active":"2024-04-26T10:24:31.598432+0000","last_became_peered":"2024-04-26T10:24:31.598432+0000","last_unstale":"2024-04-26T10:24:53.288634+0000","last_undegraded":"2024-04-26T10:24:53.288634+0000","last_fullsized":"2024-04-26T10:24:53.288634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:53.288587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:53.288587+0000","last_clean_scrub_stamp":"2024-04-26T10:24:53.288587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:25.869325+0000","scrub_duration":0.003660567,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.319134+0000","last_change":"2024-04-26T10:24:31.745336+0000","last_active":"2024-04-26T10:24:34.319134+0000","last_peered":"2024-04-26T10:24:34.319134+0000","last_clean":"2024-04-26T10:24:34.319134+0000","last_became_active":"2024-04-26T10:24:31.745004+0000","last_became_peered":"2024-04-26T10:24:31.745004+0000","last_unstale":"2024-04-26T10:24:34.319134+0000","last_undegraded":"2024-04-26T10:24:34.319134+0000","last_fullsized":"2024-04-26T10:24:34.319134+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:12.232393+0000","last_change":"2024-04-26T10:25:12.232642+0000","last_active":"2024-04-26T10:25:12.232393+0000","last_peered":"2024-04-26T10:25:12.232393+0000","last_clean":"2024-04-26T10:25:12.232393+0000","last_became_active":"2024-04-26T10:24:31.600977+0000","last_became_peered":"2024-04-26T10:24:31.600977+0000","last_unstale":"2024-04-26T10:25:12.232393+0000","last_undegraded":"2024-04-26T10:25:12.232393+0000","last_fullsized":"2024-04-26T10:25:12.232393+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:12.232350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:12.232350+0000","last_clean_scrub_stamp":"2024-04-26T10:25:12.232350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:54.306540+0000","scrub_duration":0.0033972550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:03.280598+0000","last_change":"2024-04-26T10:25:03.280598+0000","last_active":"2024-04-26T10:25:03.280598+0000","last_peered":"2024-04-26T10:25:03.280598+0000","last_clean":"2024-04-26T10:25:03.280598+0000","last_became_active":"2024-04-26T10:22:09.757813+0000","last_became_peered":"2024-04-26T10:22:09.757813+0000","last_unstale":"2024-04-26T10:25:03.280598+0000","last_undegraded":"2024-04-26T10:25:03.280598+0000","last_fullsized":"2024-04-26T10:25:03.280598+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:03.280310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:03.280310+0000","last_clean_scrub_stamp":"2024-04-26T10:25:03.280310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:49.626354+0000","scrub_duration":0.0030957509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"91'3","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:29.795203+0000","last_change":"2024-04-26T10:25:29.795539+0000","last_active":"2024-04-26T10:25:29.795203+0000","last_peered":"2024-04-26T10:25:29.795203+0000","last_clean":"2024-04-26T10:25:29.795203+0000","last_became_active":"2024-04-26T10:24:22.679497+0000","last_became_peered":"2024-04-26T10:24:22.679497+0000","last_unstale":"2024-04-26T10:25:29.795203+0000","last_undegraded":"2024-04-26T10:25:29.795203+0000","last_fullsized":"2024-04-26T10:25:29.795203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:29.795145+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:29.795145+0000","last_clean_scrub_stamp":"2024-04-26T10:25:29.795145+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:54.475564+0000","scrub_duration":0.0065687940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.319521+0000","last_change":"2024-04-26T10:24:31.741102+0000","last_active":"2024-04-26T10:24:34.319521+0000","last_peered":"2024-04-26T10:24:34.319521+0000","last_clean":"2024-04-26T10:24:34.319521+0000","last_became_active":"2024-04-26T10:24:31.740589+0000","last_became_peered":"2024-04-26T10:24:31.740589+0000","last_unstale":"2024-04-26T10:24:34.319521+0000","last_undegraded":"2024-04-26T10:24:34.319521+0000","last_fullsized":"2024-04-26T10:24:34.319521+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:36.821505+0000","last_change":"2024-04-26T10:25:36.821844+0000","last_active":"2024-04-26T10:25:36.821505+0000","last_peered":"2024-04-26T10:25:36.821505+0000","last_clean":"2024-04-26T10:25:36.821505+0000","last_became_active":"2024-04-26T10:24:22.686094+0000","last_became_peered":"2024-04-26T10:24:22.686094+0000","last_unstale":"2024-04-26T10:25:36.821505+0000","last_undegraded":"2024-04-26T10:25:36.821505+0000","last_fullsized":"2024-04-26T10:25:36.821505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:36.821405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:36.821405+0000","last_clean_scrub_stamp":"2024-04-26T10:25:36.821405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:37.980133+0000","scrub_duration":0.0037491249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"91'2","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:30.823094+0000","last_change":"2024-04-26T10:25:30.823328+0000","last_active":"2024-04-26T10:25:30.823094+0000","last_peered":"2024-04-26T10:25:30.823094+0000","last_clean":"2024-04-26T10:25:30.823094+0000","last_became_active":"2024-04-26T10:24:22.681977+0000","last_became_peered":"2024-04-26T10:24:22.681977+0000","last_unstale":"2024-04-26T10:25:30.823094+0000","last_undegraded":"2024-04-26T10:25:30.823094+0000","last_fullsized":"2024-04-26T10:25:30.823094+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-04-26T10:25:30.823041+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-04-26T10:25:30.823041+0000","last_clean_scrub_stamp":"2024-04-26T10:25:30.823041+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:56.165886+0000","scrub_duration":0.0068473839999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":111,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674352+0000","last_change":"2024-04-26T10:24:31.605320+0000","last_active":"2024-04-26T10:24:43.674352+0000","last_peered":"2024-04-26T10:24:43.674352+0000","last_clean":"2024-04-26T10:24:43.674352+0000","last_became_active":"2024-04-26T10:24:31.604158+0000","last_became_peered":"2024-04-26T10:24:31.604158+0000","last_unstale":"2024-04-26T10:24:43.674352+0000","last_undegraded":"2024-04-26T10:24:43.674352+0000","last_fullsized":"2024-04-26T10:24:43.674352+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:03.873212+0000","last_clean_scrub_stamp":"2024-04-26T10:21:03.873212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:06.220952+0000","last_change":"2024-04-26T10:25:06.221246+0000","last_active":"2024-04-26T10:25:06.220952+0000","last_peered":"2024-04-26T10:25:06.220952+0000","last_clean":"2024-04-26T10:25:06.220952+0000","last_became_active":"2024-04-26T10:24:31.600474+0000","last_became_peered":"2024-04-26T10:24:31.600474+0000","last_unstale":"2024-04-26T10:25:06.220952+0000","last_undegraded":"2024-04-26T10:25:06.220952+0000","last_fullsized":"2024-04-26T10:25:06.220952+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:06.220907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:06.220907+0000","last_clean_scrub_stamp":"2024-04-26T10:25:06.220907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:58.924774+0000","scrub_duration":0.0032236180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":117,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:59.250105+0000","last_change":"2024-04-26T10:24:59.250347+0000","last_active":"2024-04-26T10:24:59.250105+0000","last_peered":"2024-04-26T10:24:59.250105+0000","last_clean":"2024-04-26T10:24:59.250105+0000","last_became_active":"2024-04-26T10:24:31.604609+0000","last_became_peered":"2024-04-26T10:24:31.604609+0000","last_unstale":"2024-04-26T10:24:59.250105+0000","last_undegraded":"2024-04-26T10:24:59.250105+0000","last_fullsized":"2024-04-26T10:24:59.250105+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:59.250058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:59.250058+0000","last_clean_scrub_stamp":"2024-04-26T10:24:59.250058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:27.888233+0000","scrub_duration":0.0035158640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"91'10","reported_seq":148,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:09.225903+0000","last_change":"2024-04-26T10:25:09.226253+0000","last_active":"2024-04-26T10:25:09.225903+0000","last_peered":"2024-04-26T10:25:09.225903+0000","last_clean":"2024-04-26T10:25:09.225903+0000","last_became_active":"2024-04-26T10:24:31.604884+0000","last_became_peered":"2024-04-26T10:24:31.604884+0000","last_unstale":"2024-04-26T10:25:09.225903+0000","last_undegraded":"2024-04-26T10:25:09.225903+0000","last_fullsized":"2024-04-26T10:25:09.225903+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2024-04-26T10:25:09.225844+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2024-04-26T10:25:09.225844+0000","last_clean_scrub_stamp":"2024-04-26T10:25:09.225844+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:43.565487+0000","scrub_duration":0.0099065019999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.317942+0000","last_change":"2024-04-26T10:24:31.739955+0000","last_active":"2024-04-26T10:24:34.317942+0000","last_peered":"2024-04-26T10:24:34.317942+0000","last_clean":"2024-04-26T10:24:34.317942+0000","last_became_active":"2024-04-26T10:24:31.739550+0000","last_became_peered":"2024-04-26T10:24:31.739550+0000","last_unstale":"2024-04-26T10:24:34.317942+0000","last_undegraded":"2024-04-26T10:24:34.317942+0000","last_fullsized":"2024-04-26T10:24:34.317942+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:02.311259+0000","last_change":"2024-04-26T10:25:02.311507+0000","last_active":"2024-04-26T10:25:02.311259+0000","last_peered":"2024-04-26T10:25:02.311259+0000","last_clean":"2024-04-26T10:25:02.311259+0000","last_became_active":"2024-04-26T10:24:31.601218+0000","last_became_peered":"2024-04-26T10:24:31.601218+0000","last_unstale":"2024-04-26T10:25:02.311259+0000","last_undegraded":"2024-04-26T10:25:02.311259+0000","last_fullsized":"2024-04-26T10:25:02.311259+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'5","last_scrub_stamp":"2024-04-26T10:25:02.311211+0000","last_deep_scrub":"91'5","last_deep_scrub_stamp":"2024-04-26T10:25:02.311211+0000","last_clean_scrub_stamp":"2024-04-26T10:25:02.311211+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:46.605747+0000","scrub_duration":0.0088437829999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:07.220841+0000","last_change":"2024-04-26T10:25:07.221072+0000","last_active":"2024-04-26T10:25:07.220841+0000","last_peered":"2024-04-26T10:25:07.220841+0000","last_clean":"2024-04-26T10:25:07.220841+0000","last_became_active":"2024-04-26T10:24:22.546378+0000","last_became_peered":"2024-04-26T10:24:22.546378+0000","last_unstale":"2024-04-26T10:25:07.220841+0000","last_undegraded":"2024-04-26T10:25:07.220841+0000","last_fullsized":"2024-04-26T10:25:07.220841+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:07.220796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:07.220796+0000","last_clean_scrub_stamp":"2024-04-26T10:25:07.220796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:33.432321+0000","scrub_duration":0.0036655839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:04.628990+0000","last_change":"2024-04-26T10:25:04.629253+0000","last_active":"2024-04-26T10:25:04.628990+0000","last_peered":"2024-04-26T10:25:04.628990+0000","last_clean":"2024-04-26T10:25:04.628990+0000","last_became_active":"2024-04-26T10:24:22.683558+0000","last_became_peered":"2024-04-26T10:24:22.683558+0000","last_unstale":"2024-04-26T10:25:04.628990+0000","last_undegraded":"2024-04-26T10:25:04.628990+0000","last_fullsized":"2024-04-26T10:25:04.628990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:04.628905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:04.628905+0000","last_clean_scrub_stamp":"2024-04-26T10:25:04.628905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:20:44.078968+0000","scrub_duration":0.0037325380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:50.729192+0000","last_change":"2024-04-26T10:24:50.729571+0000","last_active":"2024-04-26T10:24:50.729192+0000","last_peered":"2024-04-26T10:24:50.729192+0000","last_clean":"2024-04-26T10:24:50.729192+0000","last_became_active":"2024-04-26T10:24:22.684166+0000","last_became_peered":"2024-04-26T10:24:22.684166+0000","last_unstale":"2024-04-26T10:24:50.729192+0000","last_undegraded":"2024-04-26T10:24:50.729192+0000","last_fullsized":"2024-04-26T10:24:50.729192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:50.729143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:50.729143+0000","last_clean_scrub_stamp":"2024-04-26T10:24:50.729143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:54.166410+0000","scrub_duration":0.003288118,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:39.844396+0000","last_change":"2024-04-26T10:25:39.844673+0000","last_active":"2024-04-26T10:25:39.844396+0000","last_peered":"2024-04-26T10:25:39.844396+0000","last_clean":"2024-04-26T10:25:39.844396+0000","last_became_active":"2024-04-26T10:24:31.745216+0000","last_became_peered":"2024-04-26T10:24:31.745216+0000","last_unstale":"2024-04-26T10:25:39.844396+0000","last_undegraded":"2024-04-26T10:25:39.844396+0000","last_fullsized":"2024-04-26T10:25:39.844396+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:39.844349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:39.844349+0000","last_clean_scrub_stamp":"2024-04-26T10:25:39.844349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:48.381149+0000","scrub_duration":0.0035234730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:10.271098+0000","last_change":"2024-04-26T10:25:10.271098+0000","last_active":"2024-04-26T10:25:10.271098+0000","last_peered":"2024-04-26T10:25:10.271098+0000","last_clean":"2024-04-26T10:25:10.271098+0000","last_became_active":"2024-04-26T10:22:09.750359+0000","last_became_peered":"2024-04-26T10:22:09.750359+0000","last_unstale":"2024-04-26T10:25:10.271098+0000","last_undegraded":"2024-04-26T10:25:10.271098+0000","last_fullsized":"2024-04-26T10:25:10.271098+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:10.270958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:10.270958+0000","last_clean_scrub_stamp":"2024-04-26T10:25:10.270958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:37.572061+0000","scrub_duration":0.098704475999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:14.648804+0000","last_change":"2024-04-26T10:25:14.649052+0000","last_active":"2024-04-26T10:25:14.648804+0000","last_peered":"2024-04-26T10:25:14.648804+0000","last_clean":"2024-04-26T10:25:14.648804+0000","last_became_active":"2024-04-26T10:24:31.740477+0000","last_became_peered":"2024-04-26T10:24:31.740477+0000","last_unstale":"2024-04-26T10:25:14.648804+0000","last_undegraded":"2024-04-26T10:25:14.648804+0000","last_fullsized":"2024-04-26T10:25:14.648804+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:14.648757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:14.648757+0000","last_clean_scrub_stamp":"2024-04-26T10:25:14.648757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:15.311203+0000","scrub_duration":0.0031660170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:48.666410+0000","last_change":"2024-04-26T10:24:48.666739+0000","last_active":"2024-04-26T10:24:48.666410+0000","last_peered":"2024-04-26T10:24:48.666410+0000","last_clean":"2024-04-26T10:24:48.666410+0000","last_became_active":"2024-04-26T10:24:22.683501+0000","last_became_peered":"2024-04-26T10:24:22.683501+0000","last_unstale":"2024-04-26T10:24:48.666410+0000","last_undegraded":"2024-04-26T10:24:48.666410+0000","last_fullsized":"2024-04-26T10:24:48.666410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:48.666365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:48.666365+0000","last_clean_scrub_stamp":"2024-04-26T10:24:48.666365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:11.797360+0000","scrub_duration":0.003127285,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:23.695908+0000","last_change":"2024-04-26T10:25:23.696226+0000","last_active":"2024-04-26T10:25:23.695908+0000","last_peered":"2024-04-26T10:25:23.695908+0000","last_clean":"2024-04-26T10:25:23.695908+0000","last_became_active":"2024-04-26T10:24:22.684469+0000","last_became_peered":"2024-04-26T10:24:22.684469+0000","last_unstale":"2024-04-26T10:25:23.695908+0000","last_undegraded":"2024-04-26T10:25:23.695908+0000","last_fullsized":"2024-04-26T10:25:23.695908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:23.695862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:23.695862+0000","last_clean_scrub_stamp":"2024-04-26T10:25:23.695862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:21.975628+0000","scrub_duration":0.0034938339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":82,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:05.256881+0000","last_change":"2024-04-26T10:25:05.257118+0000","last_active":"2024-04-26T10:25:05.256881+0000","last_peered":"2024-04-26T10:25:05.256881+0000","last_clean":"2024-04-26T10:25:05.256881+0000","last_became_active":"2024-04-26T10:22:09.752856+0000","last_became_peered":"2024-04-26T10:22:09.752856+0000","last_unstale":"2024-04-26T10:25:05.256881+0000","last_undegraded":"2024-04-26T10:25:05.256881+0000","last_fullsized":"2024-04-26T10:25:05.256881+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:05.256836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:05.256836+0000","last_clean_scrub_stamp":"2024-04-26T10:25:05.256836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:22.884251+0000","scrub_duration":0.0032355069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:17.277775+0000","last_change":"2024-04-26T10:25:17.278034+0000","last_active":"2024-04-26T10:25:17.277775+0000","last_peered":"2024-04-26T10:25:17.277775+0000","last_clean":"2024-04-26T10:25:17.277775+0000","last_became_active":"2024-04-26T10:24:22.535036+0000","last_became_peered":"2024-04-26T10:24:22.535036+0000","last_unstale":"2024-04-26T10:25:17.277775+0000","last_undegraded":"2024-04-26T10:25:17.277775+0000","last_fullsized":"2024-04-26T10:25:17.277775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-26T10:25:17.277726+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-26T10:25:17.277726+0000","last_clean_scrub_stamp":"2024-04-26T10:25:17.277726+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:30.647501+0000","scrub_duration":0.0033671420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":98,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:14.219808+0000","last_change":"2024-04-26T10:25:14.220039+0000","last_active":"2024-04-26T10:25:14.219808+0000","last_peered":"2024-04-26T10:25:14.219808+0000","last_clean":"2024-04-26T10:25:14.219808+0000","last_became_active":"2024-04-26T10:24:22.535562+0000","last_became_peered":"2024-04-26T10:24:22.535562+0000","last_unstale":"2024-04-26T10:25:14.219808+0000","last_undegraded":"2024-04-26T10:25:14.219808+0000","last_fullsized":"2024-04-26T10:25:14.219808+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:14.219757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:14.219757+0000","last_clean_scrub_stamp":"2024-04-26T10:25:14.219757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:48.012965+0000","scrub_duration":0.0030851279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.184722+0000","last_change":"2024-04-26T10:24:31.600594+0000","last_active":"2024-04-26T10:24:34.184722+0000","last_peered":"2024-04-26T10:24:34.184722+0000","last_clean":"2024-04-26T10:24:34.184722+0000","last_became_active":"2024-04-26T10:24:31.600121+0000","last_became_peered":"2024-04-26T10:24:31.600121+0000","last_unstale":"2024-04-26T10:24:34.184722+0000","last_undegraded":"2024-04-26T10:24:34.184722+0000","last_fullsized":"2024-04-26T10:24:34.184722+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180293+0000","last_change":"2024-04-26T10:24:22.542755+0000","last_active":"2024-04-26T10:24:34.180293+0000","last_peered":"2024-04-26T10:24:34.180293+0000","last_clean":"2024-04-26T10:24:34.180293+0000","last_became_active":"2024-04-26T10:24:22.541543+0000","last_became_peered":"2024-04-26T10:24:22.541543+0000","last_unstale":"2024-04-26T10:24:34.180293+0000","last_undegraded":"2024-04-26T10:24:34.180293+0000","last_fullsized":"2024-04-26T10:24:34.180293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"91'3","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:02.282549+0000","last_change":"2024-04-26T10:25:02.282898+0000","last_active":"2024-04-26T10:25:02.282549+0000","last_peered":"2024-04-26T10:25:02.282549+0000","last_clean":"2024-04-26T10:25:02.282549+0000","last_became_active":"2024-04-26T10:24:22.540767+0000","last_became_peered":"2024-04-26T10:24:22.540767+0000","last_unstale":"2024-04-26T10:25:02.282549+0000","last_undegraded":"2024-04-26T10:25:02.282549+0000","last_fullsized":"2024-04-26T10:25:02.282549+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:02.282431+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:02.282431+0000","last_clean_scrub_stamp":"2024-04-26T10:25:02.282431+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:51.767663+0000","scrub_duration":0.0068591950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:04.207307+0000","last_change":"2024-04-26T10:25:04.207642+0000","last_active":"2024-04-26T10:25:04.207307+0000","last_peered":"2024-04-26T10:25:04.207307+0000","last_clean":"2024-04-26T10:25:04.207307+0000","last_became_active":"2024-04-26T10:24:22.546811+0000","last_became_peered":"2024-04-26T10:24:22.546811+0000","last_unstale":"2024-04-26T10:25:04.207307+0000","last_undegraded":"2024-04-26T10:25:04.207307+0000","last_fullsized":"2024-04-26T10:25:04.207307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:04.207258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:04.207258+0000","last_clean_scrub_stamp":"2024-04-26T10:25:04.207258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:28.549935+0000","scrub_duration":0.0033412889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"91'3","reported_seq":86,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:33.118026+0000","last_change":"2024-04-26T10:25:33.118265+0000","last_active":"2024-04-26T10:25:33.118026+0000","last_peered":"2024-04-26T10:25:33.118026+0000","last_clean":"2024-04-26T10:25:33.118026+0000","last_became_active":"2024-04-26T10:22:09.753211+0000","last_became_peered":"2024-04-26T10:22:09.753211+0000","last_unstale":"2024-04-26T10:25:33.118026+0000","last_undegraded":"2024-04-26T10:25:33.118026+0000","last_fullsized":"2024-04-26T10:25:33.118026+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:33.117975+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:33.117975+0000","last_clean_scrub_stamp":"2024-04-26T10:25:33.117975+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:48.526455+0000","scrub_duration":0.0059958340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:50.293783+0000","last_change":"2024-04-26T10:24:50.293998+0000","last_active":"2024-04-26T10:24:50.293783+0000","last_peered":"2024-04-26T10:24:50.293783+0000","last_clean":"2024-04-26T10:24:50.293783+0000","last_became_active":"2024-04-26T10:24:31.600088+0000","last_became_peered":"2024-04-26T10:24:31.600088+0000","last_unstale":"2024-04-26T10:24:50.293783+0000","last_undegraded":"2024-04-26T10:24:50.293783+0000","last_fullsized":"2024-04-26T10:24:50.293783+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:50.293726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:50.293726+0000","last_clean_scrub_stamp":"2024-04-26T10:24:50.293726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.398875+0000","scrub_duration":0.014652757000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:06.613275+0000","last_change":"2024-04-26T10:25:06.613576+0000","last_active":"2024-04-26T10:25:06.613275+0000","last_peered":"2024-04-26T10:25:06.613275+0000","last_clean":"2024-04-26T10:25:06.613275+0000","last_became_active":"2024-04-26T10:24:22.679652+0000","last_became_peered":"2024-04-26T10:24:22.679652+0000","last_unstale":"2024-04-26T10:25:06.613275+0000","last_undegraded":"2024-04-26T10:25:06.613275+0000","last_fullsized":"2024-04-26T10:25:06.613275+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-26T10:25:06.613222+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-26T10:25:06.613222+0000","last_clean_scrub_stamp":"2024-04-26T10:25:06.613222+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:12.597334+0000","scrub_duration":0.0032988710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:01.257225+0000","last_change":"2024-04-26T10:25:01.257447+0000","last_active":"2024-04-26T10:25:01.257225+0000","last_peered":"2024-04-26T10:25:01.257225+0000","last_clean":"2024-04-26T10:25:01.257225+0000","last_became_active":"2024-04-26T10:24:22.538895+0000","last_became_peered":"2024-04-26T10:24:22.538895+0000","last_unstale":"2024-04-26T10:25:01.257225+0000","last_undegraded":"2024-04-26T10:25:01.257225+0000","last_fullsized":"2024-04-26T10:25:01.257225+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:01.257171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:01.257171+0000","last_clean_scrub_stamp":"2024-04-26T10:25:01.257171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:55.289475+0000","scrub_duration":0.0032699750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:03.668000+0000","last_change":"2024-04-26T10:25:03.668244+0000","last_active":"2024-04-26T10:25:03.668000+0000","last_peered":"2024-04-26T10:25:03.668000+0000","last_clean":"2024-04-26T10:25:03.668000+0000","last_became_active":"2024-04-26T10:24:22.684863+0000","last_became_peered":"2024-04-26T10:24:22.684863+0000","last_unstale":"2024-04-26T10:25:03.668000+0000","last_undegraded":"2024-04-26T10:25:03.668000+0000","last_fullsized":"2024-04-26T10:25:03.668000+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'6","last_scrub_stamp":"2024-04-26T10:25:03.667947+0000","last_deep_scrub":"91'6","last_deep_scrub_stamp":"2024-04-26T10:25:03.667947+0000","last_clean_scrub_stamp":"2024-04-26T10:25:03.667947+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:48.437612+0000","scrub_duration":0.0076333440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":21541,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673022,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262680,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94109160,"statfs":{"total":96636764160,"available":96367779840,"internally_reserved":0,"allocated":1064960,"data_stored":1035671,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:25:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57299999999999995,"15min":0.52300000000000002},"min":{"1min":0.52400000000000002,"5min":0.192,"15min":0.192},"max":{"1min":0.72799999999999998,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.52700000000000002,"15min":0.54200000000000004},"min":{"1min":0.52800000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.70399999999999996,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.61799999999999999}]},{"osd":2,"last update":"Fri Apr 26 10:25:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.747}]}]},{"osd":0,"up_from":10,"seq":42949673021,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487472,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":486398,"kb_avail":93884368,"statfs":{"total":96636764160,"available":96137592832,"internally_reserved":0,"allocated":1089536,"data_stored":1036287,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":498072006},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:25:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68000000000000005,"15min":0.57399999999999995},"min":{"1min":0.57999999999999996,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.73799999999999999,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.62},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57599999999999996,"15min":0.57899999999999996},"min":{"1min":0.51600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.77400000000000002,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri Apr 26 10:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55300000000000005}]}]},{"osd":2,"up_from":80,"seq":343597383698,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38368,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":37369,"kb_avail":94333472,"statfs":{"total":96636764160,"available":96597475328,"internally_reserved":0,"allocated":1007616,"data_stored":444173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6879,"internal_metadata":38266145},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.70399999999999996}]},{"osd":1,"last update":"Fri Apr 26 10:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.67400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:25:46.071 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.071 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.071 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.071 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.071 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.072 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.072 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.072 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.072 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.072 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.073 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.073 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.073 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.073 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.073 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.073 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-26T10:21:00.797402+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=0, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.073 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.074 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.074 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.074 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.074 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.074 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.074 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.074 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.075 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.075 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-26T10:21:03.873212+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=3, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.075 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.075 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.075 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:25:46.075 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:26:06.076 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:26:06.404 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:26:06.406 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:26:06.418 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":242,"stamp":"2024-04-26T10:26:06.075177+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1184088,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":788520,"kb_used_data":3088,"kb_used_omap":9,"kb_used_meta":785398,"kb_avail":282327000,"statfs":{"total":289910292480,"available":289102848000,"internally_reserved":0,"allocated":3162112,"data_stored":2516131,"data_compressed":14075,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":10067,"internal_metadata":804247725},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004738"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:38.189816+0000","last_change":"2024-04-26T10:25:38.189928+0000","last_active":"2024-04-26T10:25:38.189816+0000","last_peered":"2024-04-26T10:25:38.189816+0000","last_clean":"2024-04-26T10:25:38.189816+0000","last_became_active":"2024-04-26T10:24:31.598170+0000","last_became_peered":"2024-04-26T10:24:31.598170+0000","last_unstale":"2024-04-26T10:25:38.189816+0000","last_undegraded":"2024-04-26T10:25:38.189816+0000","last_fullsized":"2024-04-26T10:25:38.189816+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:38.189795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:38.189795+0000","last_clean_scrub_stamp":"2024-04-26T10:25:38.189795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:47.271296+0000","scrub_duration":0.074777972999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:15.237609+0000","last_change":"2024-04-26T10:25:15.237609+0000","last_active":"2024-04-26T10:25:15.237609+0000","last_peered":"2024-04-26T10:25:15.237609+0000","last_clean":"2024-04-26T10:25:15.237609+0000","last_became_active":"2024-04-26T10:24:22.535998+0000","last_became_peered":"2024-04-26T10:24:22.535998+0000","last_unstale":"2024-04-26T10:25:15.237609+0000","last_undegraded":"2024-04-26T10:25:15.237609+0000","last_fullsized":"2024-04-26T10:25:15.237609+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:15.237328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:15.237328+0000","last_clean_scrub_stamp":"2024-04-26T10:25:15.237328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:09.529037+0000","scrub_duration":0.0032767389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":81,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.675457+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:24:43.675457+0000","last_peered":"2024-04-26T10:24:43.675457+0000","last_clean":"2024-04-26T10:24:43.675457+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:24:43.675457+0000","last_undegraded":"2024-04-26T10:24:43.675457+0000","last_fullsized":"2024-04-26T10:24:43.675457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.675449+0000","last_change":"2024-04-26T10:24:22.549067+0000","last_active":"2024-04-26T10:24:43.675449+0000","last_peered":"2024-04-26T10:24:43.675449+0000","last_clean":"2024-04-26T10:24:43.675449+0000","last_became_active":"2024-04-26T10:24:22.548485+0000","last_became_peered":"2024-04-26T10:24:22.548485+0000","last_unstale":"2024-04-26T10:24:43.675449+0000","last_undegraded":"2024-04-26T10:24:43.675449+0000","last_fullsized":"2024-04-26T10:24:43.675449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:00.289761+0000","last_change":"2024-04-26T10:25:00.290012+0000","last_active":"2024-04-26T10:25:00.289761+0000","last_peered":"2024-04-26T10:25:00.289761+0000","last_clean":"2024-04-26T10:25:00.289761+0000","last_became_active":"2024-04-26T10:24:31.600986+0000","last_became_peered":"2024-04-26T10:24:31.600986+0000","last_unstale":"2024-04-26T10:25:00.289761+0000","last_undegraded":"2024-04-26T10:25:00.289761+0000","last_fullsized":"2024-04-26T10:25:00.289761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:00.289706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:00.289706+0000","last_clean_scrub_stamp":"2024-04-26T10:25:00.289706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:20.178292+0000","scrub_duration":0.015595131999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:52.225237+0000","last_change":"2024-04-26T10:24:52.225492+0000","last_active":"2024-04-26T10:24:52.225237+0000","last_peered":"2024-04-26T10:24:52.225237+0000","last_clean":"2024-04-26T10:24:52.225237+0000","last_became_active":"2024-04-26T10:24:22.547731+0000","last_became_peered":"2024-04-26T10:24:22.547731+0000","last_unstale":"2024-04-26T10:24:52.225237+0000","last_undegraded":"2024-04-26T10:24:52.225237+0000","last_fullsized":"2024-04-26T10:24:52.225237+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:52.225191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:52.225191+0000","last_clean_scrub_stamp":"2024-04-26T10:24:52.225191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:05.446400+0000","scrub_duration":0.003307118,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:46.143038+0000","last_change":"2024-04-26T10:24:46.143361+0000","last_active":"2024-04-26T10:24:46.143038+0000","last_peered":"2024-04-26T10:24:46.143038+0000","last_clean":"2024-04-26T10:24:46.143038+0000","last_became_active":"2024-04-26T10:24:22.549180+0000","last_became_peered":"2024-04-26T10:24:22.549180+0000","last_unstale":"2024-04-26T10:24:46.143038+0000","last_undegraded":"2024-04-26T10:24:46.143038+0000","last_fullsized":"2024-04-26T10:24:46.143038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:46.142953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:46.142953+0000","last_clean_scrub_stamp":"2024-04-26T10:24:46.142953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:47.298765+0000","scrub_duration":0.014784434000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180250+0000","last_change":"2024-04-26T10:24:22.547840+0000","last_active":"2024-04-26T10:24:34.180250+0000","last_peered":"2024-04-26T10:24:34.180250+0000","last_clean":"2024-04-26T10:24:34.180250+0000","last_became_active":"2024-04-26T10:24:22.547284+0000","last_became_peered":"2024-04-26T10:24:22.547284+0000","last_unstale":"2024-04-26T10:24:34.180250+0000","last_undegraded":"2024-04-26T10:24:34.180250+0000","last_fullsized":"2024-04-26T10:24:34.180250+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:56.807533+0000","last_change":"2024-04-26T10:24:56.807646+0000","last_active":"2024-04-26T10:24:56.807533+0000","last_peered":"2024-04-26T10:24:56.807533+0000","last_clean":"2024-04-26T10:24:56.807533+0000","last_became_active":"2024-04-26T10:24:22.679648+0000","last_became_peered":"2024-04-26T10:24:22.679648+0000","last_unstale":"2024-04-26T10:24:56.807533+0000","last_undegraded":"2024-04-26T10:24:56.807533+0000","last_fullsized":"2024-04-26T10:24:56.807533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:56.807510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:56.807510+0000","last_clean_scrub_stamp":"2024-04-26T10:24:56.807510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:24.720449+0000","scrub_duration":0.029714911,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:04.256728+0000","last_change":"2024-04-26T10:25:04.256968+0000","last_active":"2024-04-26T10:25:04.256728+0000","last_peered":"2024-04-26T10:25:04.256728+0000","last_clean":"2024-04-26T10:25:04.256728+0000","last_became_active":"2024-04-26T10:24:31.598187+0000","last_became_peered":"2024-04-26T10:24:31.598187+0000","last_unstale":"2024-04-26T10:25:04.256728+0000","last_undegraded":"2024-04-26T10:25:04.256728+0000","last_fullsized":"2024-04-26T10:25:04.256728+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:04.256683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:04.256683+0000","last_clean_scrub_stamp":"2024-04-26T10:25:04.256683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:01.571431+0000","scrub_duration":0.0034188460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.675278+0000","last_change":"2024-04-26T10:24:22.547601+0000","last_active":"2024-04-26T10:24:43.675278+0000","last_peered":"2024-04-26T10:24:43.675278+0000","last_clean":"2024-04-26T10:24:43.675278+0000","last_became_active":"2024-04-26T10:24:22.546506+0000","last_became_peered":"2024-04-26T10:24:22.546506+0000","last_unstale":"2024-04-26T10:24:43.675278+0000","last_undegraded":"2024-04-26T10:24:43.675278+0000","last_fullsized":"2024-04-26T10:24:43.675278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:56.280129+0000","last_change":"2024-04-26T10:24:56.280129+0000","last_active":"2024-04-26T10:24:56.280129+0000","last_peered":"2024-04-26T10:24:56.280129+0000","last_clean":"2024-04-26T10:24:56.280129+0000","last_became_active":"2024-04-26T10:22:09.747822+0000","last_became_peered":"2024-04-26T10:22:09.747822+0000","last_unstale":"2024-04-26T10:24:56.280129+0000","last_undegraded":"2024-04-26T10:24:56.280129+0000","last_fullsized":"2024-04-26T10:24:56.280129+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:56.279865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:56.279865+0000","last_clean_scrub_stamp":"2024-04-26T10:24:56.279865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:18:56.107536+0000","scrub_duration":0.0031183439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:09.228824+0000","last_change":"2024-04-26T10:25:09.229056+0000","last_active":"2024-04-26T10:25:09.228824+0000","last_peered":"2024-04-26T10:25:09.228824+0000","last_clean":"2024-04-26T10:25:09.228824+0000","last_became_active":"2024-04-26T10:24:31.597980+0000","last_became_peered":"2024-04-26T10:24:31.597980+0000","last_unstale":"2024-04-26T10:25:09.228824+0000","last_undegraded":"2024-04-26T10:25:09.228824+0000","last_fullsized":"2024-04-26T10:25:09.228824+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:09.228760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:09.228760+0000","last_clean_scrub_stamp":"2024-04-26T10:25:09.228760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:16.641297+0000","scrub_duration":0.01109303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:53.201710+0000","last_change":"2024-04-26T10:24:53.201710+0000","last_active":"2024-04-26T10:24:53.201710+0000","last_peered":"2024-04-26T10:24:53.201710+0000","last_clean":"2024-04-26T10:24:53.201710+0000","last_became_active":"2024-04-26T10:24:31.602539+0000","last_became_peered":"2024-04-26T10:24:31.602539+0000","last_unstale":"2024-04-26T10:24:53.201710+0000","last_undegraded":"2024-04-26T10:24:53.201710+0000","last_fullsized":"2024-04-26T10:24:53.201710+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:53.201431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:53.201431+0000","last_clean_scrub_stamp":"2024-04-26T10:24:53.201431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:31.514894+0000","scrub_duration":0.0033374949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:00.222988+0000","last_change":"2024-04-26T10:25:00.222988+0000","last_active":"2024-04-26T10:25:00.222988+0000","last_peered":"2024-04-26T10:25:00.222988+0000","last_clean":"2024-04-26T10:25:00.222988+0000","last_became_active":"2024-04-26T10:24:31.602453+0000","last_became_peered":"2024-04-26T10:24:31.602453+0000","last_unstale":"2024-04-26T10:25:00.222988+0000","last_undegraded":"2024-04-26T10:25:00.222988+0000","last_fullsized":"2024-04-26T10:25:00.222988+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:00.222698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:00.222698+0000","last_clean_scrub_stamp":"2024-04-26T10:25:00.222698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:45.583919+0000","scrub_duration":0.0030823560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.675201+0000","last_change":"2024-04-26T10:24:22.547543+0000","last_active":"2024-04-26T10:24:43.675201+0000","last_peered":"2024-04-26T10:24:43.675201+0000","last_clean":"2024-04-26T10:24:43.675201+0000","last_became_active":"2024-04-26T10:24:22.546856+0000","last_became_peered":"2024-04-26T10:24:22.546856+0000","last_unstale":"2024-04-26T10:24:43.675201+0000","last_undegraded":"2024-04-26T10:24:43.675201+0000","last_fullsized":"2024-04-26T10:24:43.675201+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:34.846197+0000","last_change":"2024-04-26T10:25:34.846363+0000","last_active":"2024-04-26T10:25:34.846197+0000","last_peered":"2024-04-26T10:25:34.846197+0000","last_clean":"2024-04-26T10:25:34.846197+0000","last_became_active":"2024-04-26T10:24:22.679350+0000","last_became_peered":"2024-04-26T10:24:22.679350+0000","last_unstale":"2024-04-26T10:25:34.846197+0000","last_undegraded":"2024-04-26T10:25:34.846197+0000","last_fullsized":"2024-04-26T10:25:34.846197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:34.846164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:34.846164+0000","last_clean_scrub_stamp":"2024-04-26T10:25:34.846164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:48.771890+0000","scrub_duration":0.052228093000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:36.161111+0000","last_change":"2024-04-26T10:25:36.161340+0000","last_active":"2024-04-26T10:25:36.161111+0000","last_peered":"2024-04-26T10:25:36.161111+0000","last_clean":"2024-04-26T10:25:36.161111+0000","last_became_active":"2024-04-26T10:24:31.597563+0000","last_became_peered":"2024-04-26T10:24:31.597563+0000","last_unstale":"2024-04-26T10:25:36.161111+0000","last_undegraded":"2024-04-26T10:25:36.161111+0000","last_fullsized":"2024-04-26T10:25:36.161111+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:36.161060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:36.161060+0000","last_clean_scrub_stamp":"2024-04-26T10:25:36.161060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:55.224036+0000","scrub_duration":0.003288694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:22.717671+0000","last_change":"2024-04-26T10:25:22.717781+0000","last_active":"2024-04-26T10:25:22.717671+0000","last_peered":"2024-04-26T10:25:22.717671+0000","last_clean":"2024-04-26T10:25:22.717671+0000","last_became_active":"2024-04-26T10:24:22.678912+0000","last_became_peered":"2024-04-26T10:24:22.678912+0000","last_unstale":"2024-04-26T10:25:22.717671+0000","last_undegraded":"2024-04-26T10:25:22.717671+0000","last_fullsized":"2024-04-26T10:25:22.717671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:22.717652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:22.717652+0000","last_clean_scrub_stamp":"2024-04-26T10:25:22.717652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:29.694277+0000","scrub_duration":0.017936198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.675165+0000","last_change":"2024-04-26T10:24:22.546669+0000","last_active":"2024-04-26T10:24:43.675165+0000","last_peered":"2024-04-26T10:24:43.675165+0000","last_clean":"2024-04-26T10:24:43.675165+0000","last_became_active":"2024-04-26T10:24:22.546052+0000","last_became_peered":"2024-04-26T10:24:22.546052+0000","last_unstale":"2024-04-26T10:24:43.675165+0000","last_undegraded":"2024-04-26T10:24:43.675165+0000","last_fullsized":"2024-04-26T10:24:43.675165+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:08.292897+0000","last_change":"2024-04-26T10:25:08.292897+0000","last_active":"2024-04-26T10:25:08.292897+0000","last_peered":"2024-04-26T10:25:08.292897+0000","last_clean":"2024-04-26T10:25:08.292897+0000","last_became_active":"2024-04-26T10:24:22.547663+0000","last_became_peered":"2024-04-26T10:24:22.547663+0000","last_unstale":"2024-04-26T10:25:08.292897+0000","last_undegraded":"2024-04-26T10:25:08.292897+0000","last_fullsized":"2024-04-26T10:25:08.292897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:08.292772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:08.292772+0000","last_clean_scrub_stamp":"2024-04-26T10:25:08.292772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:35.112407+0000","scrub_duration":0.038060340999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:01.324901+0000","last_change":"2024-04-26T10:25:01.324901+0000","last_active":"2024-04-26T10:25:01.324901+0000","last_peered":"2024-04-26T10:25:01.324901+0000","last_clean":"2024-04-26T10:25:01.324901+0000","last_became_active":"2024-04-26T10:22:09.748755+0000","last_became_peered":"2024-04-26T10:22:09.748755+0000","last_unstale":"2024-04-26T10:25:01.324901+0000","last_undegraded":"2024-04-26T10:25:01.324901+0000","last_fullsized":"2024-04-26T10:25:01.324901+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:01.324527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:01.324527+0000","last_clean_scrub_stamp":"2024-04-26T10:25:01.324527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:42.317619+0000","scrub_duration":0.0030479109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:31.855132+0000","last_change":"2024-04-26T10:25:31.855451+0000","last_active":"2024-04-26T10:25:31.855132+0000","last_peered":"2024-04-26T10:25:31.855132+0000","last_clean":"2024-04-26T10:25:31.855132+0000","last_became_active":"2024-04-26T10:24:22.683921+0000","last_became_peered":"2024-04-26T10:24:22.683921+0000","last_unstale":"2024-04-26T10:25:31.855132+0000","last_undegraded":"2024-04-26T10:25:31.855132+0000","last_fullsized":"2024-04-26T10:25:31.855132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:31.855041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:31.855041+0000","last_clean_scrub_stamp":"2024-04-26T10:25:31.855041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:04.764581+0000","scrub_duration":0.003368359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:22.231749+0000","last_change":"2024-04-26T10:25:22.231749+0000","last_active":"2024-04-26T10:25:22.231749+0000","last_peered":"2024-04-26T10:25:22.231749+0000","last_clean":"2024-04-26T10:25:22.231749+0000","last_became_active":"2024-04-26T10:24:22.534674+0000","last_became_peered":"2024-04-26T10:24:22.534674+0000","last_unstale":"2024-04-26T10:25:22.231749+0000","last_undegraded":"2024-04-26T10:25:22.231749+0000","last_fullsized":"2024-04-26T10:25:22.231749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:22.231415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:22.231415+0000","last_clean_scrub_stamp":"2024-04-26T10:25:22.231415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:27.733690+0000","scrub_duration":0.0033621749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:48.293794+0000","last_change":"2024-04-26T10:24:48.293911+0000","last_active":"2024-04-26T10:24:48.293794+0000","last_peered":"2024-04-26T10:24:48.293794+0000","last_clean":"2024-04-26T10:24:48.293794+0000","last_became_active":"2024-04-26T10:24:31.600815+0000","last_became_peered":"2024-04-26T10:24:31.600815+0000","last_unstale":"2024-04-26T10:24:48.293794+0000","last_undegraded":"2024-04-26T10:24:48.293794+0000","last_fullsized":"2024-04-26T10:24:48.293794+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:48.293774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:48.293774+0000","last_clean_scrub_stamp":"2024-04-26T10:24:48.293774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:51.595218+0000","scrub_duration":0.058713007999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:51.769368+0000","last_change":"2024-04-26T10:24:51.769593+0000","last_active":"2024-04-26T10:24:51.769368+0000","last_peered":"2024-04-26T10:24:51.769368+0000","last_clean":"2024-04-26T10:24:51.769368+0000","last_became_active":"2024-04-26T10:24:22.683959+0000","last_became_peered":"2024-04-26T10:24:22.683959+0000","last_unstale":"2024-04-26T10:24:51.769368+0000","last_undegraded":"2024-04-26T10:24:51.769368+0000","last_fullsized":"2024-04-26T10:24:51.769368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:51.769321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:51.769321+0000","last_clean_scrub_stamp":"2024-04-26T10:24:51.769321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:05.665068+0000","scrub_duration":0.003275011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":81,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.675147+0000","last_change":"2024-04-26T10:21:09.316415+0000","last_active":"2024-04-26T10:24:43.675147+0000","last_peered":"2024-04-26T10:24:43.675147+0000","last_clean":"2024-04-26T10:24:43.675147+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:24:43.675147+0000","last_undegraded":"2024-04-26T10:24:43.675147+0000","last_fullsized":"2024-04-26T10:24:43.675147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:53.260575+0000","last_change":"2024-04-26T10:25:53.260900+0000","last_active":"2024-04-26T10:25:53.260575+0000","last_peered":"2024-04-26T10:25:53.260575+0000","last_clean":"2024-04-26T10:25:53.260575+0000","last_became_active":"2024-04-26T10:24:31.601299+0000","last_became_peered":"2024-04-26T10:24:31.601299+0000","last_unstale":"2024-04-26T10:25:53.260575+0000","last_undegraded":"2024-04-26T10:25:53.260575+0000","last_fullsized":"2024-04-26T10:25:53.260575+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:53.260529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:53.260529+0000","last_clean_scrub_stamp":"2024-04-26T10:25:53.260529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:40.287907+0000","scrub_duration":0.003123584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:40.887294+0000","last_change":"2024-04-26T10:25:40.887406+0000","last_active":"2024-04-26T10:25:40.887294+0000","last_peered":"2024-04-26T10:25:40.887294+0000","last_clean":"2024-04-26T10:25:40.887294+0000","last_became_active":"2024-04-26T10:24:31.740626+0000","last_became_peered":"2024-04-26T10:24:31.740626+0000","last_unstale":"2024-04-26T10:25:40.887294+0000","last_undegraded":"2024-04-26T10:25:40.887294+0000","last_fullsized":"2024-04-26T10:25:40.887294+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:40.887274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:40.887274+0000","last_clean_scrub_stamp":"2024-04-26T10:25:40.887274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:03.140762+0000","scrub_duration":0.017197324,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:31.074103+0000","last_change":"2024-04-26T10:25:31.074332+0000","last_active":"2024-04-26T10:25:31.074103+0000","last_peered":"2024-04-26T10:25:31.074103+0000","last_clean":"2024-04-26T10:25:31.074103+0000","last_became_active":"2024-04-26T10:22:09.750286+0000","last_became_peered":"2024-04-26T10:22:09.750286+0000","last_unstale":"2024-04-26T10:25:31.074103+0000","last_undegraded":"2024-04-26T10:25:31.074103+0000","last_fullsized":"2024-04-26T10:25:31.074103+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:31.074058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:31.074058+0000","last_clean_scrub_stamp":"2024-04-26T10:25:31.074058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:39.699950+0000","scrub_duration":0.003248187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:01.978502+0000","last_change":"2024-04-26T10:26:01.978857+0000","last_active":"2024-04-26T10:26:01.978502+0000","last_peered":"2024-04-26T10:26:01.978502+0000","last_clean":"2024-04-26T10:26:01.978502+0000","last_became_active":"2024-04-26T10:24:31.740518+0000","last_became_peered":"2024-04-26T10:24:31.740518+0000","last_unstale":"2024-04-26T10:26:01.978502+0000","last_undegraded":"2024-04-26T10:26:01.978502+0000","last_fullsized":"2024-04-26T10:26:01.978502+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:01.978406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:01.978406+0000","last_clean_scrub_stamp":"2024-04-26T10:26:01.978406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:58:52.163295+0000","scrub_duration":0.0033284709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:44.170604+0000","last_change":"2024-04-26T10:24:44.170604+0000","last_active":"2024-04-26T10:24:44.170604+0000","last_peered":"2024-04-26T10:24:44.170604+0000","last_clean":"2024-04-26T10:24:44.170604+0000","last_became_active":"2024-04-26T10:24:22.539106+0000","last_became_peered":"2024-04-26T10:24:22.539106+0000","last_unstale":"2024-04-26T10:24:44.170604+0000","last_undegraded":"2024-04-26T10:24:44.170604+0000","last_fullsized":"2024-04-26T10:24:44.170604+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:44.170151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:44.170151+0000","last_clean_scrub_stamp":"2024-04-26T10:24:44.170151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:52.109209+0000","scrub_duration":0.010234752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:54.298622+0000","last_change":"2024-04-26T10:25:54.298852+0000","last_active":"2024-04-26T10:25:54.298622+0000","last_peered":"2024-04-26T10:25:54.298622+0000","last_clean":"2024-04-26T10:25:54.298622+0000","last_became_active":"2024-04-26T10:24:31.598307+0000","last_became_peered":"2024-04-26T10:24:31.598307+0000","last_unstale":"2024-04-26T10:25:54.298622+0000","last_undegraded":"2024-04-26T10:25:54.298622+0000","last_fullsized":"2024-04-26T10:25:54.298622+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:54.298577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:54.298577+0000","last_clean_scrub_stamp":"2024-04-26T10:25:54.298577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:13.596052+0000","scrub_duration":0.0031942189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"91'4","reported_seq":110,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:34.241275+0000","last_change":"2024-04-26T10:25:34.241275+0000","last_active":"2024-04-26T10:25:34.241275+0000","last_peered":"2024-04-26T10:25:34.241275+0000","last_clean":"2024-04-26T10:25:34.241275+0000","last_became_active":"2024-04-26T10:24:22.546794+0000","last_became_peered":"2024-04-26T10:24:22.546794+0000","last_unstale":"2024-04-26T10:25:34.241275+0000","last_undegraded":"2024-04-26T10:25:34.241275+0000","last_fullsized":"2024-04-26T10:25:34.241275+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-04-26T10:25:34.240988+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-04-26T10:25:34.240988+0000","last_clean_scrub_stamp":"2024-04-26T10:25:34.240988+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:09.512473+0000","scrub_duration":0.0082918269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:47.236229+0000","last_change":"2024-04-26T10:24:47.236463+0000","last_active":"2024-04-26T10:24:47.236229+0000","last_peered":"2024-04-26T10:24:47.236229+0000","last_clean":"2024-04-26T10:24:47.236229+0000","last_became_active":"2024-04-26T10:24:31.596297+0000","last_became_peered":"2024-04-26T10:24:31.596297+0000","last_unstale":"2024-04-26T10:24:47.236229+0000","last_undegraded":"2024-04-26T10:24:47.236229+0000","last_fullsized":"2024-04-26T10:24:47.236229+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:47.236175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:47.236175+0000","last_clean_scrub_stamp":"2024-04-26T10:24:47.236175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:31.442660+0000","scrub_duration":0.014903458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:12.635104+0000","last_change":"2024-04-26T10:25:12.635350+0000","last_active":"2024-04-26T10:25:12.635104+0000","last_peered":"2024-04-26T10:25:12.635104+0000","last_clean":"2024-04-26T10:25:12.635104+0000","last_became_active":"2024-04-26T10:24:22.684541+0000","last_became_peered":"2024-04-26T10:24:22.684541+0000","last_unstale":"2024-04-26T10:25:12.635104+0000","last_undegraded":"2024-04-26T10:25:12.635104+0000","last_fullsized":"2024-04-26T10:25:12.635104+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:12.635057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:12.635057+0000","last_clean_scrub_stamp":"2024-04-26T10:25:12.635057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:40.868547+0000","scrub_duration":0.0035574059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:33.793616+0000","last_change":"2024-04-26T10:25:33.793857+0000","last_active":"2024-04-26T10:25:33.793616+0000","last_peered":"2024-04-26T10:25:33.793616+0000","last_clean":"2024-04-26T10:25:33.793616+0000","last_became_active":"2024-04-26T10:24:22.682650+0000","last_became_peered":"2024-04-26T10:24:22.682650+0000","last_unstale":"2024-04-26T10:25:33.793616+0000","last_undegraded":"2024-04-26T10:25:33.793616+0000","last_fullsized":"2024-04-26T10:25:33.793616+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:33.793569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:33.793569+0000","last_clean_scrub_stamp":"2024-04-26T10:25:33.793569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:42:31.145665+0000","scrub_duration":0.0030047139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:34.094073+0000","last_change":"2024-04-26T10:25:34.094279+0000","last_active":"2024-04-26T10:25:34.094073+0000","last_peered":"2024-04-26T10:25:34.094073+0000","last_clean":"2024-04-26T10:25:34.094073+0000","last_became_active":"2024-04-26T10:24:31.601091+0000","last_became_peered":"2024-04-26T10:24:31.601091+0000","last_unstale":"2024-04-26T10:25:34.094073+0000","last_undegraded":"2024-04-26T10:25:34.094073+0000","last_fullsized":"2024-04-26T10:25:34.094073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:34.094025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:34.094025+0000","last_clean_scrub_stamp":"2024-04-26T10:25:34.094025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:48.013784+0000","scrub_duration":0.003459784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:08.712500+0000","last_change":"2024-04-26T10:25:08.712611+0000","last_active":"2024-04-26T10:25:08.712500+0000","last_peered":"2024-04-26T10:25:08.712500+0000","last_clean":"2024-04-26T10:25:08.712500+0000","last_became_active":"2024-04-26T10:24:22.684213+0000","last_became_peered":"2024-04-26T10:24:22.684213+0000","last_unstale":"2024-04-26T10:25:08.712500+0000","last_undegraded":"2024-04-26T10:25:08.712500+0000","last_fullsized":"2024-04-26T10:25:08.712500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:08.712479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:08.712479+0000","last_clean_scrub_stamp":"2024-04-26T10:25:08.712479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:22.971123+0000","scrub_duration":0.069345404999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"91'12","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:27.254757+0000","last_change":"2024-04-26T10:25:27.254757+0000","last_active":"2024-04-26T10:25:27.254757+0000","last_peered":"2024-04-26T10:25:27.254757+0000","last_clean":"2024-04-26T10:25:27.254757+0000","last_became_active":"2024-04-26T10:24:31.604402+0000","last_became_peered":"2024-04-26T10:24:31.604402+0000","last_unstale":"2024-04-26T10:25:27.254757+0000","last_undegraded":"2024-04-26T10:25:27.254757+0000","last_fullsized":"2024-04-26T10:25:27.254757+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'12","last_scrub_stamp":"2024-04-26T10:25:27.254465+0000","last_deep_scrub":"91'12","last_deep_scrub_stamp":"2024-04-26T10:25:27.254465+0000","last_clean_scrub_stamp":"2024-04-26T10:25:27.254465+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:52.325925+0000","scrub_duration":0.0093417299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"91'2","reported_seq":129,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:36.183977+0000","last_change":"2024-04-26T10:25:36.183977+0000","last_active":"2024-04-26T10:25:36.183977+0000","last_peered":"2024-04-26T10:25:36.183977+0000","last_clean":"2024-04-26T10:25:36.183977+0000","last_became_active":"2024-04-26T10:24:31.604744+0000","last_became_peered":"2024-04-26T10:24:31.604744+0000","last_unstale":"2024-04-26T10:25:36.183977+0000","last_undegraded":"2024-04-26T10:25:36.183977+0000","last_fullsized":"2024-04-26T10:25:36.183977+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-04-26T10:25:36.183521+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-04-26T10:25:36.183521+0000","last_clean_scrub_stamp":"2024-04-26T10:25:36.183521+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:59.590522+0000","scrub_duration":0.0073008739999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:52.312203+0000","last_change":"2024-04-26T10:24:52.312203+0000","last_active":"2024-04-26T10:24:52.312203+0000","last_peered":"2024-04-26T10:24:52.312203+0000","last_clean":"2024-04-26T10:24:52.312203+0000","last_became_active":"2024-04-26T10:22:09.749862+0000","last_became_peered":"2024-04-26T10:22:09.749862+0000","last_unstale":"2024-04-26T10:24:52.312203+0000","last_undegraded":"2024-04-26T10:24:52.312203+0000","last_fullsized":"2024-04-26T10:24:52.312203+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:52.311773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:52.311773+0000","last_clean_scrub_stamp":"2024-04-26T10:24:52.311773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:12.624461+0000","scrub_duration":0.0034835349999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"91'3","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:13.197344+0000","last_change":"2024-04-26T10:25:13.197344+0000","last_active":"2024-04-26T10:25:13.197344+0000","last_peered":"2024-04-26T10:25:13.197344+0000","last_clean":"2024-04-26T10:25:13.197344+0000","last_became_active":"2024-04-26T10:22:09.749852+0000","last_became_peered":"2024-04-26T10:22:09.749852+0000","last_unstale":"2024-04-26T10:25:13.197344+0000","last_undegraded":"2024-04-26T10:25:13.197344+0000","last_fullsized":"2024-04-26T10:25:13.197344+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:13.197045+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:13.197045+0000","last_clean_scrub_stamp":"2024-04-26T10:25:13.197045+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:01.578169+0000","scrub_duration":0.0064724919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:48.164900+0000","last_change":"2024-04-26T10:25:48.165132+0000","last_active":"2024-04-26T10:25:48.164900+0000","last_peered":"2024-04-26T10:25:48.164900+0000","last_clean":"2024-04-26T10:25:48.164900+0000","last_became_active":"2024-04-26T10:24:31.596335+0000","last_became_peered":"2024-04-26T10:24:31.596335+0000","last_unstale":"2024-04-26T10:25:48.164900+0000","last_undegraded":"2024-04-26T10:25:48.164900+0000","last_fullsized":"2024-04-26T10:25:48.164900+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:48.164842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:48.164842+0000","last_clean_scrub_stamp":"2024-04-26T10:25:48.164842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:27.230715+0000","scrub_duration":0.0031925389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"91'2","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:42.239060+0000","last_change":"2024-04-26T10:25:42.239422+0000","last_active":"2024-04-26T10:25:42.239060+0000","last_peered":"2024-04-26T10:25:42.239060+0000","last_clean":"2024-04-26T10:25:42.239060+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:25:42.239060+0000","last_undegraded":"2024-04-26T10:25:42.239060+0000","last_fullsized":"2024-04-26T10:25:42.239060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-04-26T10:25:42.238933+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-04-26T10:25:42.238933+0000","last_clean_scrub_stamp":"2024-04-26T10:25:42.238933+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:18.940962+0000","scrub_duration":0.0070962710000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:35.198370+0000","last_change":"2024-04-26T10:25:35.198666+0000","last_active":"2024-04-26T10:25:35.198370+0000","last_peered":"2024-04-26T10:25:35.198370+0000","last_clean":"2024-04-26T10:25:35.198370+0000","last_became_active":"2024-04-26T10:24:22.549230+0000","last_became_peered":"2024-04-26T10:24:22.549230+0000","last_unstale":"2024-04-26T10:25:35.198370+0000","last_undegraded":"2024-04-26T10:25:35.198370+0000","last_fullsized":"2024-04-26T10:25:35.198370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:35.198322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:35.198322+0000","last_clean_scrub_stamp":"2024-04-26T10:25:35.198322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:02.241610+0000","scrub_duration":0.0034907969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:50.245134+0000","last_change":"2024-04-26T10:25:50.245370+0000","last_active":"2024-04-26T10:25:50.245134+0000","last_peered":"2024-04-26T10:25:50.245134+0000","last_clean":"2024-04-26T10:25:50.245134+0000","last_became_active":"2024-04-26T10:24:22.540611+0000","last_became_peered":"2024-04-26T10:24:22.540611+0000","last_unstale":"2024-04-26T10:25:50.245134+0000","last_undegraded":"2024-04-26T10:25:50.245134+0000","last_fullsized":"2024-04-26T10:25:50.245134+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:50.245085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:50.245085+0000","last_clean_scrub_stamp":"2024-04-26T10:25:50.245085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:22.376739+0000","scrub_duration":0.003113513,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:10.703734+0000","last_change":"2024-04-26T10:25:10.703884+0000","last_active":"2024-04-26T10:25:10.703734+0000","last_peered":"2024-04-26T10:25:10.703734+0000","last_clean":"2024-04-26T10:25:10.703734+0000","last_became_active":"2024-04-26T10:24:22.686841+0000","last_became_peered":"2024-04-26T10:24:22.686841+0000","last_unstale":"2024-04-26T10:25:10.703734+0000","last_undegraded":"2024-04-26T10:25:10.703734+0000","last_fullsized":"2024-04-26T10:25:10.703734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:10.703715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:10.703715+0000","last_clean_scrub_stamp":"2024-04-26T10:25:10.703715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:08.356723+0000","scrub_duration":0.01785925,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'3","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:02.685154+0000","last_change":"2024-04-26T10:25:02.685404+0000","last_active":"2024-04-26T10:25:02.685154+0000","last_peered":"2024-04-26T10:25:02.685154+0000","last_clean":"2024-04-26T10:25:02.685154+0000","last_became_active":"2024-04-26T10:24:22.686846+0000","last_became_peered":"2024-04-26T10:24:22.686846+0000","last_unstale":"2024-04-26T10:25:02.685154+0000","last_undegraded":"2024-04-26T10:25:02.685154+0000","last_fullsized":"2024-04-26T10:25:02.685154+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:02.685093+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:02.685093+0000","last_clean_scrub_stamp":"2024-04-26T10:25:02.685093+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:29.685511+0000","scrub_duration":0.0064629550000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:32.237246+0000","last_change":"2024-04-26T10:25:32.237246+0000","last_active":"2024-04-26T10:25:32.237246+0000","last_peered":"2024-04-26T10:25:32.237246+0000","last_clean":"2024-04-26T10:25:32.237246+0000","last_became_active":"2024-04-26T10:24:22.545616+0000","last_became_peered":"2024-04-26T10:24:22.545616+0000","last_unstale":"2024-04-26T10:25:32.237246+0000","last_undegraded":"2024-04-26T10:25:32.237246+0000","last_fullsized":"2024-04-26T10:25:32.237246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:32.236967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:32.236967+0000","last_clean_scrub_stamp":"2024-04-26T10:25:32.236967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:18.701998+0000","scrub_duration":0.0034163280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674541+0000","last_change":"2024-04-26T10:24:22.540185+0000","last_active":"2024-04-26T10:24:43.674541+0000","last_peered":"2024-04-26T10:24:43.674541+0000","last_clean":"2024-04-26T10:24:43.674541+0000","last_became_active":"2024-04-26T10:24:22.538982+0000","last_became_peered":"2024-04-26T10:24:22.538982+0000","last_unstale":"2024-04-26T10:24:43.674541+0000","last_undegraded":"2024-04-26T10:24:43.674541+0000","last_fullsized":"2024-04-26T10:24:43.674541+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":92,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:49.285356+0000","last_change":"2024-04-26T10:25:49.285724+0000","last_active":"2024-04-26T10:25:49.285356+0000","last_peered":"2024-04-26T10:25:49.285356+0000","last_clean":"2024-04-26T10:25:49.285356+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:25:49.285356+0000","last_undegraded":"2024-04-26T10:25:49.285356+0000","last_fullsized":"2024-04-26T10:25:49.285356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:49.285262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:49.285262+0000","last_clean_scrub_stamp":"2024-04-26T10:25:49.285262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:29.659904+0000","scrub_duration":0.0035995300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":84,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:07.248434+0000","last_change":"2024-04-26T10:25:07.248434+0000","last_active":"2024-04-26T10:25:07.248434+0000","last_peered":"2024-04-26T10:25:07.248434+0000","last_clean":"2024-04-26T10:25:07.248434+0000","last_became_active":"2024-04-26T10:22:09.748256+0000","last_became_peered":"2024-04-26T10:22:09.748256+0000","last_unstale":"2024-04-26T10:25:07.248434+0000","last_undegraded":"2024-04-26T10:25:07.248434+0000","last_fullsized":"2024-04-26T10:25:07.248434+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:07.248161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:07.248161+0000","last_clean_scrub_stamp":"2024-04-26T10:25:07.248161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:25.723449+0000","scrub_duration":0.003118071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:41.225747+0000","last_change":"2024-04-26T10:25:41.225747+0000","last_active":"2024-04-26T10:25:41.225747+0000","last_peered":"2024-04-26T10:25:41.225747+0000","last_clean":"2024-04-26T10:25:41.225747+0000","last_became_active":"2024-04-26T10:24:31.603620+0000","last_became_peered":"2024-04-26T10:24:31.603620+0000","last_unstale":"2024-04-26T10:25:41.225747+0000","last_undegraded":"2024-04-26T10:25:41.225747+0000","last_fullsized":"2024-04-26T10:25:41.225747+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:41.225468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:41.225468+0000","last_clean_scrub_stamp":"2024-04-26T10:25:41.225468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.344665+0000","scrub_duration":0.0031305310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:37.156489+0000","last_change":"2024-04-26T10:25:37.156720+0000","last_active":"2024-04-26T10:25:37.156489+0000","last_peered":"2024-04-26T10:25:37.156489+0000","last_clean":"2024-04-26T10:25:37.156489+0000","last_became_active":"2024-04-26T10:24:31.598120+0000","last_became_peered":"2024-04-26T10:24:31.598120+0000","last_unstale":"2024-04-26T10:25:37.156489+0000","last_undegraded":"2024-04-26T10:25:37.156489+0000","last_fullsized":"2024-04-26T10:25:37.156489+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:37.156442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:37.156442+0000","last_clean_scrub_stamp":"2024-04-26T10:25:37.156442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:09.426539+0000","scrub_duration":0.0032247579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:57.789264+0000","last_change":"2024-04-26T10:24:57.789439+0000","last_active":"2024-04-26T10:24:57.789264+0000","last_peered":"2024-04-26T10:24:57.789264+0000","last_clean":"2024-04-26T10:24:57.789264+0000","last_became_active":"2024-04-26T10:24:22.679940+0000","last_became_peered":"2024-04-26T10:24:22.679940+0000","last_unstale":"2024-04-26T10:24:57.789264+0000","last_undegraded":"2024-04-26T10:24:57.789264+0000","last_fullsized":"2024-04-26T10:24:57.789264+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:57.789236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:57.789236+0000","last_clean_scrub_stamp":"2024-04-26T10:24:57.789236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:34.365027+0000","scrub_duration":0.045365677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"91'159","reported_seq":348,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:55.216932+0000","last_change":"2024-04-26T10:25:55.217213+0000","last_active":"2024-04-26T10:25:55.216932+0000","last_peered":"2024-04-26T10:25:55.216932+0000","last_clean":"2024-04-26T10:25:55.216932+0000","last_became_active":"2024-04-26T10:24:34.184490+0000","last_became_peered":"2024-04-26T10:24:34.184490+0000","last_unstale":"2024-04-26T10:25:55.216932+0000","last_undegraded":"2024-04-26T10:25:55.216932+0000","last_fullsized":"2024-04-26T10:25:55.216932+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'159","last_scrub_stamp":"2024-04-26T10:25:55.216878+0000","last_deep_scrub":"91'159","last_deep_scrub_stamp":"2024-04-26T10:25:55.216878+0000","last_clean_scrub_stamp":"2024-04-26T10:25:55.216878+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:35:53.332492+0000","scrub_duration":0.01063709,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:01.252793+0000","last_change":"2024-04-26T10:26:01.253028+0000","last_active":"2024-04-26T10:26:01.252793+0000","last_peered":"2024-04-26T10:26:01.252793+0000","last_clean":"2024-04-26T10:26:01.252793+0000","last_became_active":"2024-04-26T10:24:22.546650+0000","last_became_peered":"2024-04-26T10:24:22.546650+0000","last_unstale":"2024-04-26T10:26:01.252793+0000","last_undegraded":"2024-04-26T10:26:01.252793+0000","last_fullsized":"2024-04-26T10:26:01.252793+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:01.252748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:01.252748+0000","last_clean_scrub_stamp":"2024-04-26T10:26:01.252748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:39.132139+0000","scrub_duration":0.0031193200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:49.697780+0000","last_change":"2024-04-26T10:24:49.698037+0000","last_active":"2024-04-26T10:24:49.697780+0000","last_peered":"2024-04-26T10:24:49.697780+0000","last_clean":"2024-04-26T10:24:49.697780+0000","last_became_active":"2024-04-26T10:24:22.676489+0000","last_became_peered":"2024-04-26T10:24:22.676489+0000","last_unstale":"2024-04-26T10:24:49.697780+0000","last_undegraded":"2024-04-26T10:24:49.697780+0000","last_fullsized":"2024-04-26T10:24:49.697780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:49.697735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:49.697735+0000","last_clean_scrub_stamp":"2024-04-26T10:24:49.697735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:32.374320+0000","scrub_duration":0.0030634690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:12.176501+0000","last_change":"2024-04-26T10:25:12.176501+0000","last_active":"2024-04-26T10:25:12.176501+0000","last_peered":"2024-04-26T10:25:12.176501+0000","last_clean":"2024-04-26T10:25:12.176501+0000","last_became_active":"2024-04-26T10:24:31.603498+0000","last_became_peered":"2024-04-26T10:24:31.603498+0000","last_unstale":"2024-04-26T10:25:12.176501+0000","last_undegraded":"2024-04-26T10:25:12.176501+0000","last_fullsized":"2024-04-26T10:25:12.176501+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:12.176170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:12.176170+0000","last_clean_scrub_stamp":"2024-04-26T10:25:12.176170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:31.663887+0000","scrub_duration":0.003223147,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":122,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:58.199601+0000","last_change":"2024-04-26T10:25:58.199850+0000","last_active":"2024-04-26T10:25:58.199601+0000","last_peered":"2024-04-26T10:25:58.199601+0000","last_clean":"2024-04-26T10:25:58.199601+0000","last_became_active":"2024-04-26T10:24:31.602611+0000","last_became_peered":"2024-04-26T10:24:31.602611+0000","last_unstale":"2024-04-26T10:25:58.199601+0000","last_undegraded":"2024-04-26T10:25:58.199601+0000","last_fullsized":"2024-04-26T10:25:58.199601+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:58.199556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:58.199556+0000","last_clean_scrub_stamp":"2024-04-26T10:25:58.199556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:16.447456+0000","scrub_duration":0.003443134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:28.757145+0000","last_change":"2024-04-26T10:25:28.757380+0000","last_active":"2024-04-26T10:25:28.757145+0000","last_peered":"2024-04-26T10:25:28.757145+0000","last_clean":"2024-04-26T10:25:28.757145+0000","last_became_active":"2024-04-26T10:24:22.685051+0000","last_became_peered":"2024-04-26T10:24:22.685051+0000","last_unstale":"2024-04-26T10:25:28.757145+0000","last_undegraded":"2024-04-26T10:25:28.757145+0000","last_fullsized":"2024-04-26T10:25:28.757145+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:28.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:28.757100+0000","last_clean_scrub_stamp":"2024-04-26T10:25:28.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:42.473787+0000","scrub_duration":0.0030427010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:24.210591+0000","last_change":"2024-04-26T10:25:24.210591+0000","last_active":"2024-04-26T10:25:24.210591+0000","last_peered":"2024-04-26T10:25:24.210591+0000","last_clean":"2024-04-26T10:25:24.210591+0000","last_became_active":"2024-04-26T10:24:22.537983+0000","last_became_peered":"2024-04-26T10:24:22.537983+0000","last_unstale":"2024-04-26T10:25:24.210591+0000","last_undegraded":"2024-04-26T10:25:24.210591+0000","last_fullsized":"2024-04-26T10:25:24.210591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:24.210327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:24.210327+0000","last_clean_scrub_stamp":"2024-04-26T10:25:24.210327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:19.630117+0000","scrub_duration":0.003228014,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:47.630110+0000","last_change":"2024-04-26T10:24:47.630379+0000","last_active":"2024-04-26T10:24:47.630110+0000","last_peered":"2024-04-26T10:24:47.630110+0000","last_clean":"2024-04-26T10:24:47.630110+0000","last_became_active":"2024-04-26T10:24:22.678866+0000","last_became_peered":"2024-04-26T10:24:22.678866+0000","last_unstale":"2024-04-26T10:24:47.630110+0000","last_undegraded":"2024-04-26T10:24:47.630110+0000","last_fullsized":"2024-04-26T10:24:47.630110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:47.630061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:47.630061+0000","last_clean_scrub_stamp":"2024-04-26T10:24:47.630061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:03.378559+0000","scrub_duration":0.003470571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":84,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:25.191632+0000","last_change":"2024-04-26T10:25:25.191896+0000","last_active":"2024-04-26T10:25:25.191632+0000","last_peered":"2024-04-26T10:25:25.191632+0000","last_clean":"2024-04-26T10:25:25.191632+0000","last_became_active":"2024-04-26T10:22:09.749935+0000","last_became_peered":"2024-04-26T10:22:09.749935+0000","last_unstale":"2024-04-26T10:25:25.191632+0000","last_undegraded":"2024-04-26T10:25:25.191632+0000","last_fullsized":"2024-04-26T10:25:25.191632+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:25.191588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:25.191588+0000","last_clean_scrub_stamp":"2024-04-26T10:25:25.191588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:58.190318+0000","scrub_duration":0.0035868789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:56.919322+0000","last_change":"2024-04-26T10:25:56.919436+0000","last_active":"2024-04-26T10:25:56.919322+0000","last_peered":"2024-04-26T10:25:56.919322+0000","last_clean":"2024-04-26T10:25:56.919322+0000","last_became_active":"2024-04-26T10:24:31.745487+0000","last_became_peered":"2024-04-26T10:24:31.745487+0000","last_unstale":"2024-04-26T10:25:56.919322+0000","last_undegraded":"2024-04-26T10:25:56.919322+0000","last_fullsized":"2024-04-26T10:25:56.919322+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:56.919301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:56.919301+0000","last_clean_scrub_stamp":"2024-04-26T10:25:56.919301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:18.728459+0000","scrub_duration":0.028941299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:00.260545+0000","last_change":"2024-04-26T10:26:00.260824+0000","last_active":"2024-04-26T10:26:00.260545+0000","last_peered":"2024-04-26T10:26:00.260545+0000","last_clean":"2024-04-26T10:26:00.260545+0000","last_became_active":"2024-04-26T10:24:22.538993+0000","last_became_peered":"2024-04-26T10:24:22.538993+0000","last_unstale":"2024-04-26T10:26:00.260545+0000","last_undegraded":"2024-04-26T10:26:00.260545+0000","last_fullsized":"2024-04-26T10:26:00.260545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:00.260356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:00.260356+0000","last_clean_scrub_stamp":"2024-04-26T10:26:00.260356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:35.337680+0000","scrub_duration":0.003414331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674849+0000","last_change":"2024-04-26T10:24:22.542774+0000","last_active":"2024-04-26T10:24:43.674849+0000","last_peered":"2024-04-26T10:24:43.674849+0000","last_clean":"2024-04-26T10:24:43.674849+0000","last_became_active":"2024-04-26T10:24:22.541795+0000","last_became_peered":"2024-04-26T10:24:22.541795+0000","last_unstale":"2024-04-26T10:24:43.674849+0000","last_undegraded":"2024-04-26T10:24:43.674849+0000","last_fullsized":"2024-04-26T10:24:43.674849+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:46.642214+0000","last_change":"2024-04-26T10:24:46.642441+0000","last_active":"2024-04-26T10:24:46.642214+0000","last_peered":"2024-04-26T10:24:46.642214+0000","last_clean":"2024-04-26T10:24:46.642214+0000","last_became_active":"2024-04-26T10:24:31.744373+0000","last_became_peered":"2024-04-26T10:24:31.744373+0000","last_unstale":"2024-04-26T10:24:46.642214+0000","last_undegraded":"2024-04-26T10:24:46.642214+0000","last_fullsized":"2024-04-26T10:24:46.642214+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:46.642168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:46.642168+0000","last_clean_scrub_stamp":"2024-04-26T10:24:46.642168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:47.970345+0000","scrub_duration":0.0030956120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.674609+0000","last_change":"2024-04-26T10:24:22.538573+0000","last_active":"2024-04-26T10:24:43.674609+0000","last_peered":"2024-04-26T10:24:43.674609+0000","last_clean":"2024-04-26T10:24:43.674609+0000","last_became_active":"2024-04-26T10:24:22.537041+0000","last_became_peered":"2024-04-26T10:24:22.537041+0000","last_unstale":"2024-04-26T10:24:43.674609+0000","last_undegraded":"2024-04-26T10:24:43.674609+0000","last_fullsized":"2024-04-26T10:24:43.674609+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:07.893071+0000","last_clean_scrub_stamp":"2024-04-26T10:21:07.893071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:52.905058+0000","last_change":"2024-04-26T10:25:52.905280+0000","last_active":"2024-04-26T10:25:52.905058+0000","last_peered":"2024-04-26T10:25:52.905058+0000","last_clean":"2024-04-26T10:25:52.905058+0000","last_became_active":"2024-04-26T10:24:31.744342+0000","last_became_peered":"2024-04-26T10:24:31.744342+0000","last_unstale":"2024-04-26T10:25:52.905058+0000","last_undegraded":"2024-04-26T10:25:52.905058+0000","last_fullsized":"2024-04-26T10:25:52.905058+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:52.905009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:52.905009+0000","last_clean_scrub_stamp":"2024-04-26T10:25:52.905009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:30.922185+0000","scrub_duration":0.0032611319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:53.288634+0000","last_change":"2024-04-26T10:24:53.288881+0000","last_active":"2024-04-26T10:24:53.288634+0000","last_peered":"2024-04-26T10:24:53.288634+0000","last_clean":"2024-04-26T10:24:53.288634+0000","last_became_active":"2024-04-26T10:24:31.598432+0000","last_became_peered":"2024-04-26T10:24:31.598432+0000","last_unstale":"2024-04-26T10:24:53.288634+0000","last_undegraded":"2024-04-26T10:24:53.288634+0000","last_fullsized":"2024-04-26T10:24:53.288634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:53.288587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:53.288587+0000","last_clean_scrub_stamp":"2024-04-26T10:24:53.288587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:25.869325+0000","scrub_duration":0.003660567,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:02.962878+0000","last_change":"2024-04-26T10:26:02.963196+0000","last_active":"2024-04-26T10:26:02.962878+0000","last_peered":"2024-04-26T10:26:02.962878+0000","last_clean":"2024-04-26T10:26:02.962878+0000","last_became_active":"2024-04-26T10:24:31.745004+0000","last_became_peered":"2024-04-26T10:24:31.745004+0000","last_unstale":"2024-04-26T10:26:02.962878+0000","last_undegraded":"2024-04-26T10:26:02.962878+0000","last_fullsized":"2024-04-26T10:26:02.962878+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:02.962834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:02.962834+0000","last_clean_scrub_stamp":"2024-04-26T10:26:02.962834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:02.796843+0000","scrub_duration":0.0032636729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:12.232393+0000","last_change":"2024-04-26T10:25:12.232642+0000","last_active":"2024-04-26T10:25:12.232393+0000","last_peered":"2024-04-26T10:25:12.232393+0000","last_clean":"2024-04-26T10:25:12.232393+0000","last_became_active":"2024-04-26T10:24:31.600977+0000","last_became_peered":"2024-04-26T10:24:31.600977+0000","last_unstale":"2024-04-26T10:25:12.232393+0000","last_undegraded":"2024-04-26T10:25:12.232393+0000","last_fullsized":"2024-04-26T10:25:12.232393+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:12.232350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:12.232350+0000","last_clean_scrub_stamp":"2024-04-26T10:25:12.232350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:54.306540+0000","scrub_duration":0.0033972550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:03.280598+0000","last_change":"2024-04-26T10:25:03.280598+0000","last_active":"2024-04-26T10:25:03.280598+0000","last_peered":"2024-04-26T10:25:03.280598+0000","last_clean":"2024-04-26T10:25:03.280598+0000","last_became_active":"2024-04-26T10:22:09.757813+0000","last_became_peered":"2024-04-26T10:22:09.757813+0000","last_unstale":"2024-04-26T10:25:03.280598+0000","last_undegraded":"2024-04-26T10:25:03.280598+0000","last_fullsized":"2024-04-26T10:25:03.280598+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:03.280310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:03.280310+0000","last_clean_scrub_stamp":"2024-04-26T10:25:03.280310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:49.626354+0000","scrub_duration":0.0030957509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"91'3","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:29.795203+0000","last_change":"2024-04-26T10:25:29.795539+0000","last_active":"2024-04-26T10:25:29.795203+0000","last_peered":"2024-04-26T10:25:29.795203+0000","last_clean":"2024-04-26T10:25:29.795203+0000","last_became_active":"2024-04-26T10:24:22.679497+0000","last_became_peered":"2024-04-26T10:24:22.679497+0000","last_unstale":"2024-04-26T10:25:29.795203+0000","last_undegraded":"2024-04-26T10:25:29.795203+0000","last_fullsized":"2024-04-26T10:25:29.795203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:29.795145+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:29.795145+0000","last_clean_scrub_stamp":"2024-04-26T10:25:29.795145+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:54.475564+0000","scrub_duration":0.0065687940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:51.867157+0000","last_change":"2024-04-26T10:25:51.867424+0000","last_active":"2024-04-26T10:25:51.867157+0000","last_peered":"2024-04-26T10:25:51.867157+0000","last_clean":"2024-04-26T10:25:51.867157+0000","last_became_active":"2024-04-26T10:24:31.740589+0000","last_became_peered":"2024-04-26T10:24:31.740589+0000","last_unstale":"2024-04-26T10:25:51.867157+0000","last_undegraded":"2024-04-26T10:25:51.867157+0000","last_fullsized":"2024-04-26T10:25:51.867157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:51.867105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:51.867105+0000","last_clean_scrub_stamp":"2024-04-26T10:25:51.867105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:28.725553+0000","scrub_duration":0.003137379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:36.821505+0000","last_change":"2024-04-26T10:25:36.821844+0000","last_active":"2024-04-26T10:25:36.821505+0000","last_peered":"2024-04-26T10:25:36.821505+0000","last_clean":"2024-04-26T10:25:36.821505+0000","last_became_active":"2024-04-26T10:24:22.686094+0000","last_became_peered":"2024-04-26T10:24:22.686094+0000","last_unstale":"2024-04-26T10:25:36.821505+0000","last_undegraded":"2024-04-26T10:25:36.821505+0000","last_fullsized":"2024-04-26T10:25:36.821505+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:36.821405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:36.821405+0000","last_clean_scrub_stamp":"2024-04-26T10:25:36.821405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:37.980133+0000","scrub_duration":0.0037491249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"91'2","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:30.823094+0000","last_change":"2024-04-26T10:25:30.823328+0000","last_active":"2024-04-26T10:25:30.823094+0000","last_peered":"2024-04-26T10:25:30.823094+0000","last_clean":"2024-04-26T10:25:30.823094+0000","last_became_active":"2024-04-26T10:24:22.681977+0000","last_became_peered":"2024-04-26T10:24:22.681977+0000","last_unstale":"2024-04-26T10:25:30.823094+0000","last_undegraded":"2024-04-26T10:25:30.823094+0000","last_fullsized":"2024-04-26T10:25:30.823094+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-04-26T10:25:30.823041+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-04-26T10:25:30.823041+0000","last_clean_scrub_stamp":"2024-04-26T10:25:30.823041+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:56.165886+0000","scrub_duration":0.0068473839999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":122,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:03.239253+0000","last_change":"2024-04-26T10:26:03.239508+0000","last_active":"2024-04-26T10:26:03.239253+0000","last_peered":"2024-04-26T10:26:03.239253+0000","last_clean":"2024-04-26T10:26:03.239253+0000","last_became_active":"2024-04-26T10:24:31.604158+0000","last_became_peered":"2024-04-26T10:24:31.604158+0000","last_unstale":"2024-04-26T10:26:03.239253+0000","last_undegraded":"2024-04-26T10:26:03.239253+0000","last_fullsized":"2024-04-26T10:26:03.239253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:03.239209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:03.239209+0000","last_clean_scrub_stamp":"2024-04-26T10:26:03.239209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:38.356864+0000","scrub_duration":0.0033795040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:06.220952+0000","last_change":"2024-04-26T10:25:06.221246+0000","last_active":"2024-04-26T10:25:06.220952+0000","last_peered":"2024-04-26T10:25:06.220952+0000","last_clean":"2024-04-26T10:25:06.220952+0000","last_became_active":"2024-04-26T10:24:31.600474+0000","last_became_peered":"2024-04-26T10:24:31.600474+0000","last_unstale":"2024-04-26T10:25:06.220952+0000","last_undegraded":"2024-04-26T10:25:06.220952+0000","last_fullsized":"2024-04-26T10:25:06.220952+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:06.220907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:06.220907+0000","last_clean_scrub_stamp":"2024-04-26T10:25:06.220907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:58.924774+0000","scrub_duration":0.0032236180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:59.250347+0000","last_change":"2024-04-26T10:24:59.250347+0000","last_active":"2024-04-26T10:24:59.250347+0000","last_peered":"2024-04-26T10:24:59.250347+0000","last_clean":"2024-04-26T10:24:59.250347+0000","last_became_active":"2024-04-26T10:24:31.604609+0000","last_became_peered":"2024-04-26T10:24:31.604609+0000","last_unstale":"2024-04-26T10:24:59.250347+0000","last_undegraded":"2024-04-26T10:24:59.250347+0000","last_fullsized":"2024-04-26T10:24:59.250347+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:59.250058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:59.250058+0000","last_clean_scrub_stamp":"2024-04-26T10:24:59.250058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:27.888233+0000","scrub_duration":0.0035158640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"91'10","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:09.226253+0000","last_change":"2024-04-26T10:25:09.226253+0000","last_active":"2024-04-26T10:25:09.226253+0000","last_peered":"2024-04-26T10:25:09.226253+0000","last_clean":"2024-04-26T10:25:09.226253+0000","last_became_active":"2024-04-26T10:24:31.604884+0000","last_became_peered":"2024-04-26T10:24:31.604884+0000","last_unstale":"2024-04-26T10:25:09.226253+0000","last_undegraded":"2024-04-26T10:25:09.226253+0000","last_fullsized":"2024-04-26T10:25:09.226253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2024-04-26T10:25:09.225844+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2024-04-26T10:25:09.225844+0000","last_clean_scrub_stamp":"2024-04-26T10:25:09.225844+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:43.565487+0000","scrub_duration":0.0099065019999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:45.020842+0000","last_change":"2024-04-26T10:25:45.021090+0000","last_active":"2024-04-26T10:25:45.020842+0000","last_peered":"2024-04-26T10:25:45.020842+0000","last_clean":"2024-04-26T10:25:45.020842+0000","last_became_active":"2024-04-26T10:24:31.739550+0000","last_became_peered":"2024-04-26T10:24:31.739550+0000","last_unstale":"2024-04-26T10:25:45.020842+0000","last_undegraded":"2024-04-26T10:25:45.020842+0000","last_fullsized":"2024-04-26T10:25:45.020842+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:45.020789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:45.020789+0000","last_clean_scrub_stamp":"2024-04-26T10:25:45.020789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:16.947170+0000","scrub_duration":0.0032832579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:02.311259+0000","last_change":"2024-04-26T10:25:02.311507+0000","last_active":"2024-04-26T10:25:02.311259+0000","last_peered":"2024-04-26T10:25:02.311259+0000","last_clean":"2024-04-26T10:25:02.311259+0000","last_became_active":"2024-04-26T10:24:31.601218+0000","last_became_peered":"2024-04-26T10:24:31.601218+0000","last_unstale":"2024-04-26T10:25:02.311259+0000","last_undegraded":"2024-04-26T10:25:02.311259+0000","last_fullsized":"2024-04-26T10:25:02.311259+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'5","last_scrub_stamp":"2024-04-26T10:25:02.311211+0000","last_deep_scrub":"91'5","last_deep_scrub_stamp":"2024-04-26T10:25:02.311211+0000","last_clean_scrub_stamp":"2024-04-26T10:25:02.311211+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:46.605747+0000","scrub_duration":0.0088437829999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:07.221072+0000","last_change":"2024-04-26T10:25:07.221072+0000","last_active":"2024-04-26T10:25:07.221072+0000","last_peered":"2024-04-26T10:25:07.221072+0000","last_clean":"2024-04-26T10:25:07.221072+0000","last_became_active":"2024-04-26T10:24:22.546378+0000","last_became_peered":"2024-04-26T10:24:22.546378+0000","last_unstale":"2024-04-26T10:25:07.221072+0000","last_undegraded":"2024-04-26T10:25:07.221072+0000","last_fullsized":"2024-04-26T10:25:07.221072+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:07.220796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:07.220796+0000","last_clean_scrub_stamp":"2024-04-26T10:25:07.220796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:33.432321+0000","scrub_duration":0.0036655839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:04.628990+0000","last_change":"2024-04-26T10:25:04.629253+0000","last_active":"2024-04-26T10:25:04.628990+0000","last_peered":"2024-04-26T10:25:04.628990+0000","last_clean":"2024-04-26T10:25:04.628990+0000","last_became_active":"2024-04-26T10:24:22.683558+0000","last_became_peered":"2024-04-26T10:24:22.683558+0000","last_unstale":"2024-04-26T10:25:04.628990+0000","last_undegraded":"2024-04-26T10:25:04.628990+0000","last_fullsized":"2024-04-26T10:25:04.628990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:04.628905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:04.628905+0000","last_clean_scrub_stamp":"2024-04-26T10:25:04.628905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:20:44.078968+0000","scrub_duration":0.0037325380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:50.729192+0000","last_change":"2024-04-26T10:24:50.729571+0000","last_active":"2024-04-26T10:24:50.729192+0000","last_peered":"2024-04-26T10:24:50.729192+0000","last_clean":"2024-04-26T10:24:50.729192+0000","last_became_active":"2024-04-26T10:24:22.684166+0000","last_became_peered":"2024-04-26T10:24:22.684166+0000","last_unstale":"2024-04-26T10:24:50.729192+0000","last_undegraded":"2024-04-26T10:24:50.729192+0000","last_fullsized":"2024-04-26T10:24:50.729192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:50.729143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:50.729143+0000","last_clean_scrub_stamp":"2024-04-26T10:24:50.729143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:54.166410+0000","scrub_duration":0.003288118,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:39.844396+0000","last_change":"2024-04-26T10:25:39.844673+0000","last_active":"2024-04-26T10:25:39.844396+0000","last_peered":"2024-04-26T10:25:39.844396+0000","last_clean":"2024-04-26T10:25:39.844396+0000","last_became_active":"2024-04-26T10:24:31.745216+0000","last_became_peered":"2024-04-26T10:24:31.745216+0000","last_unstale":"2024-04-26T10:25:39.844396+0000","last_undegraded":"2024-04-26T10:25:39.844396+0000","last_fullsized":"2024-04-26T10:25:39.844396+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:39.844349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:39.844349+0000","last_clean_scrub_stamp":"2024-04-26T10:25:39.844349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:48.381149+0000","scrub_duration":0.0035234730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:10.271098+0000","last_change":"2024-04-26T10:25:10.271098+0000","last_active":"2024-04-26T10:25:10.271098+0000","last_peered":"2024-04-26T10:25:10.271098+0000","last_clean":"2024-04-26T10:25:10.271098+0000","last_became_active":"2024-04-26T10:22:09.750359+0000","last_became_peered":"2024-04-26T10:22:09.750359+0000","last_unstale":"2024-04-26T10:25:10.271098+0000","last_undegraded":"2024-04-26T10:25:10.271098+0000","last_fullsized":"2024-04-26T10:25:10.271098+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:10.270958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:10.270958+0000","last_clean_scrub_stamp":"2024-04-26T10:25:10.270958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:37.572061+0000","scrub_duration":0.098704475999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:14.648804+0000","last_change":"2024-04-26T10:25:14.649052+0000","last_active":"2024-04-26T10:25:14.648804+0000","last_peered":"2024-04-26T10:25:14.648804+0000","last_clean":"2024-04-26T10:25:14.648804+0000","last_became_active":"2024-04-26T10:24:31.740477+0000","last_became_peered":"2024-04-26T10:24:31.740477+0000","last_unstale":"2024-04-26T10:25:14.648804+0000","last_undegraded":"2024-04-26T10:25:14.648804+0000","last_fullsized":"2024-04-26T10:25:14.648804+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:14.648757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:14.648757+0000","last_clean_scrub_stamp":"2024-04-26T10:25:14.648757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:15.311203+0000","scrub_duration":0.0031660170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:48.666410+0000","last_change":"2024-04-26T10:24:48.666739+0000","last_active":"2024-04-26T10:24:48.666410+0000","last_peered":"2024-04-26T10:24:48.666410+0000","last_clean":"2024-04-26T10:24:48.666410+0000","last_became_active":"2024-04-26T10:24:22.683501+0000","last_became_peered":"2024-04-26T10:24:22.683501+0000","last_unstale":"2024-04-26T10:24:48.666410+0000","last_undegraded":"2024-04-26T10:24:48.666410+0000","last_fullsized":"2024-04-26T10:24:48.666410+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:48.666365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:48.666365+0000","last_clean_scrub_stamp":"2024-04-26T10:24:48.666365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:11.797360+0000","scrub_duration":0.003127285,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:23.695908+0000","last_change":"2024-04-26T10:25:23.696226+0000","last_active":"2024-04-26T10:25:23.695908+0000","last_peered":"2024-04-26T10:25:23.695908+0000","last_clean":"2024-04-26T10:25:23.695908+0000","last_became_active":"2024-04-26T10:24:22.684469+0000","last_became_peered":"2024-04-26T10:24:22.684469+0000","last_unstale":"2024-04-26T10:25:23.695908+0000","last_undegraded":"2024-04-26T10:25:23.695908+0000","last_fullsized":"2024-04-26T10:25:23.695908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:23.695862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:23.695862+0000","last_clean_scrub_stamp":"2024-04-26T10:25:23.695862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:21.975628+0000","scrub_duration":0.0034938339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":82,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:05.256881+0000","last_change":"2024-04-26T10:25:05.257118+0000","last_active":"2024-04-26T10:25:05.256881+0000","last_peered":"2024-04-26T10:25:05.256881+0000","last_clean":"2024-04-26T10:25:05.256881+0000","last_became_active":"2024-04-26T10:22:09.752856+0000","last_became_peered":"2024-04-26T10:22:09.752856+0000","last_unstale":"2024-04-26T10:25:05.256881+0000","last_undegraded":"2024-04-26T10:25:05.256881+0000","last_fullsized":"2024-04-26T10:25:05.256881+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:05.256836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:05.256836+0000","last_clean_scrub_stamp":"2024-04-26T10:25:05.256836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:22.884251+0000","scrub_duration":0.0032355069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:17.277775+0000","last_change":"2024-04-26T10:25:17.278034+0000","last_active":"2024-04-26T10:25:17.277775+0000","last_peered":"2024-04-26T10:25:17.277775+0000","last_clean":"2024-04-26T10:25:17.277775+0000","last_became_active":"2024-04-26T10:24:22.535036+0000","last_became_peered":"2024-04-26T10:24:22.535036+0000","last_unstale":"2024-04-26T10:25:17.277775+0000","last_undegraded":"2024-04-26T10:25:17.277775+0000","last_fullsized":"2024-04-26T10:25:17.277775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-26T10:25:17.277726+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-26T10:25:17.277726+0000","last_clean_scrub_stamp":"2024-04-26T10:25:17.277726+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:30.647501+0000","scrub_duration":0.0033671420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":98,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:14.219808+0000","last_change":"2024-04-26T10:25:14.220039+0000","last_active":"2024-04-26T10:25:14.219808+0000","last_peered":"2024-04-26T10:25:14.219808+0000","last_clean":"2024-04-26T10:25:14.219808+0000","last_became_active":"2024-04-26T10:24:22.535562+0000","last_became_peered":"2024-04-26T10:24:22.535562+0000","last_unstale":"2024-04-26T10:25:14.219808+0000","last_undegraded":"2024-04-26T10:25:14.219808+0000","last_fullsized":"2024-04-26T10:25:14.219808+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:14.219757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:14.219757+0000","last_clean_scrub_stamp":"2024-04-26T10:25:14.219757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:48.012965+0000","scrub_duration":0.0030851279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:51.212563+0000","last_change":"2024-04-26T10:25:51.212833+0000","last_active":"2024-04-26T10:25:51.212563+0000","last_peered":"2024-04-26T10:25:51.212563+0000","last_clean":"2024-04-26T10:25:51.212563+0000","last_became_active":"2024-04-26T10:24:31.600121+0000","last_became_peered":"2024-04-26T10:24:31.600121+0000","last_unstale":"2024-04-26T10:25:51.212563+0000","last_undegraded":"2024-04-26T10:25:51.212563+0000","last_fullsized":"2024-04-26T10:25:51.212563+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-26T10:25:51.212513+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-26T10:25:51.212513+0000","last_clean_scrub_stamp":"2024-04-26T10:25:51.212513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:10.847443+0000","scrub_duration":0.0037555000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:34.180293+0000","last_change":"2024-04-26T10:24:22.542755+0000","last_active":"2024-04-26T10:24:34.180293+0000","last_peered":"2024-04-26T10:24:34.180293+0000","last_clean":"2024-04-26T10:24:34.180293+0000","last_became_active":"2024-04-26T10:24:22.541543+0000","last_became_peered":"2024-04-26T10:24:22.541543+0000","last_unstale":"2024-04-26T10:24:34.180293+0000","last_undegraded":"2024-04-26T10:24:34.180293+0000","last_fullsized":"2024-04-26T10:24:34.180293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"91'3","reported_seq":108,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:02.282549+0000","last_change":"2024-04-26T10:25:02.282898+0000","last_active":"2024-04-26T10:25:02.282549+0000","last_peered":"2024-04-26T10:25:02.282549+0000","last_clean":"2024-04-26T10:25:02.282549+0000","last_became_active":"2024-04-26T10:24:22.540767+0000","last_became_peered":"2024-04-26T10:24:22.540767+0000","last_unstale":"2024-04-26T10:25:02.282549+0000","last_undegraded":"2024-04-26T10:25:02.282549+0000","last_fullsized":"2024-04-26T10:25:02.282549+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:02.282431+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:02.282431+0000","last_clean_scrub_stamp":"2024-04-26T10:25:02.282431+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:51.767663+0000","scrub_duration":0.0068591950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":104,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:04.207307+0000","last_change":"2024-04-26T10:25:04.207642+0000","last_active":"2024-04-26T10:25:04.207307+0000","last_peered":"2024-04-26T10:25:04.207307+0000","last_clean":"2024-04-26T10:25:04.207307+0000","last_became_active":"2024-04-26T10:24:22.546811+0000","last_became_peered":"2024-04-26T10:24:22.546811+0000","last_unstale":"2024-04-26T10:25:04.207307+0000","last_undegraded":"2024-04-26T10:25:04.207307+0000","last_fullsized":"2024-04-26T10:25:04.207307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:04.207258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:04.207258+0000","last_clean_scrub_stamp":"2024-04-26T10:25:04.207258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:28.549935+0000","scrub_duration":0.0033412889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"91'3","reported_seq":86,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:33.118026+0000","last_change":"2024-04-26T10:25:33.118265+0000","last_active":"2024-04-26T10:25:33.118026+0000","last_peered":"2024-04-26T10:25:33.118026+0000","last_clean":"2024-04-26T10:25:33.118026+0000","last_became_active":"2024-04-26T10:22:09.753211+0000","last_became_peered":"2024-04-26T10:22:09.753211+0000","last_unstale":"2024-04-26T10:25:33.118026+0000","last_undegraded":"2024-04-26T10:25:33.118026+0000","last_fullsized":"2024-04-26T10:25:33.118026+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:33.117975+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:33.117975+0000","last_clean_scrub_stamp":"2024-04-26T10:25:33.117975+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:48.526455+0000","scrub_duration":0.0059958340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:50.293783+0000","last_change":"2024-04-26T10:24:50.293998+0000","last_active":"2024-04-26T10:24:50.293783+0000","last_peered":"2024-04-26T10:24:50.293783+0000","last_clean":"2024-04-26T10:24:50.293783+0000","last_became_active":"2024-04-26T10:24:31.600088+0000","last_became_peered":"2024-04-26T10:24:31.600088+0000","last_unstale":"2024-04-26T10:24:50.293783+0000","last_undegraded":"2024-04-26T10:24:50.293783+0000","last_fullsized":"2024-04-26T10:24:50.293783+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:50.293726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:50.293726+0000","last_clean_scrub_stamp":"2024-04-26T10:24:50.293726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.398875+0000","scrub_duration":0.014652757000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:06.613275+0000","last_change":"2024-04-26T10:25:06.613576+0000","last_active":"2024-04-26T10:25:06.613275+0000","last_peered":"2024-04-26T10:25:06.613275+0000","last_clean":"2024-04-26T10:25:06.613275+0000","last_became_active":"2024-04-26T10:24:22.679652+0000","last_became_peered":"2024-04-26T10:24:22.679652+0000","last_unstale":"2024-04-26T10:25:06.613275+0000","last_undegraded":"2024-04-26T10:25:06.613275+0000","last_fullsized":"2024-04-26T10:25:06.613275+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-26T10:25:06.613222+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-26T10:25:06.613222+0000","last_clean_scrub_stamp":"2024-04-26T10:25:06.613222+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:12.597334+0000","scrub_duration":0.0032988710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:01.257447+0000","last_change":"2024-04-26T10:25:01.257447+0000","last_active":"2024-04-26T10:25:01.257447+0000","last_peered":"2024-04-26T10:25:01.257447+0000","last_clean":"2024-04-26T10:25:01.257447+0000","last_became_active":"2024-04-26T10:24:22.538895+0000","last_became_peered":"2024-04-26T10:24:22.538895+0000","last_unstale":"2024-04-26T10:25:01.257447+0000","last_undegraded":"2024-04-26T10:25:01.257447+0000","last_fullsized":"2024-04-26T10:25:01.257447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:01.257171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:01.257171+0000","last_clean_scrub_stamp":"2024-04-26T10:25:01.257171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:55.289475+0000","scrub_duration":0.0032699750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:03.668000+0000","last_change":"2024-04-26T10:25:03.668244+0000","last_active":"2024-04-26T10:25:03.668000+0000","last_peered":"2024-04-26T10:25:03.668000+0000","last_clean":"2024-04-26T10:25:03.668000+0000","last_became_active":"2024-04-26T10:24:22.684863+0000","last_became_peered":"2024-04-26T10:24:22.684863+0000","last_unstale":"2024-04-26T10:25:03.668000+0000","last_undegraded":"2024-04-26T10:25:03.668000+0000","last_fullsized":"2024-04-26T10:25:03.668000+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'6","last_scrub_stamp":"2024-04-26T10:25:03.667947+0000","last_deep_scrub":"91'6","last_deep_scrub_stamp":"2024-04-26T10:25:03.667947+0000","last_clean_scrub_stamp":"2024-04-26T10:25:03.667947+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:48.437612+0000","scrub_duration":0.0076333440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":21541,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673026,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262680,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94109160,"statfs":{"total":96636764160,"available":96367779840,"internally_reserved":0,"allocated":1064960,"data_stored":1035671,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:25:05 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57299999999999995,"15min":0.52300000000000002},"min":{"1min":0.52400000000000002,"5min":0.192,"15min":0.192},"max":{"1min":0.72799999999999998,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.52700000000000002,"15min":0.54200000000000004},"min":{"1min":0.52800000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.70399999999999996,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.59999999999999998}]},{"osd":2,"last update":"Fri Apr 26 10:25:21 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.69199999999999995}]}]},{"osd":0,"up_from":10,"seq":42949673025,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487472,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":486398,"kb_avail":93884368,"statfs":{"total":96636764160,"available":96137592832,"internally_reserved":0,"allocated":1089536,"data_stored":1036287,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":498072006},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:25:04 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.68000000000000005,"15min":0.57399999999999995},"min":{"1min":0.57999999999999996,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.73799999999999999,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57599999999999996,"15min":0.57899999999999996},"min":{"1min":0.51600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.77400000000000002,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.71399999999999997}]},{"osd":2,"last update":"Fri Apr 26 10:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.745}]}]},{"osd":2,"up_from":80,"seq":343597383703,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38368,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":37369,"kb_avail":94333472,"statfs":{"total":96636764160,"available":96597475328,"internally_reserved":0,"allocated":1007616,"data_stored":444173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6879,"internal_metadata":38266145},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.55700000000000005}]},{"osd":1,"last update":"Fri Apr 26 10:25:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.67400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:26:06.423 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:26:06.423 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:26:06.423 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:26:06.423 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:26:06.423 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:26:06.424 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:26:06.424 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:26:06.424 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:26:06.425 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:26:06.425 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-26T10:21:07.893071+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:26:06.425 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:26:06.425 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:26:26.426 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:26:26.753 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:26:26.755 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:26:26.767 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":252,"stamp":"2024-04-26T10:26:26.082430+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1184088,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":788520,"kb_used_data":3088,"kb_used_omap":9,"kb_used_meta":785398,"kb_avail":282327000,"statfs":{"total":289910292480,"available":289102848000,"internally_reserved":0,"allocated":3162112,"data_stored":2516131,"data_compressed":14075,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":10067,"internal_metadata":804247725},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004444"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:38.189816+0000","last_change":"2024-04-26T10:25:38.189928+0000","last_active":"2024-04-26T10:25:38.189816+0000","last_peered":"2024-04-26T10:25:38.189816+0000","last_clean":"2024-04-26T10:25:38.189816+0000","last_became_active":"2024-04-26T10:24:31.598170+0000","last_became_peered":"2024-04-26T10:24:31.598170+0000","last_unstale":"2024-04-26T10:25:38.189816+0000","last_undegraded":"2024-04-26T10:25:38.189816+0000","last_fullsized":"2024-04-26T10:25:38.189816+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:38.189795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:38.189795+0000","last_clean_scrub_stamp":"2024-04-26T10:25:38.189795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:47.271296+0000","scrub_duration":0.074777972999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:15.237609+0000","last_change":"2024-04-26T10:25:15.237609+0000","last_active":"2024-04-26T10:25:15.237609+0000","last_peered":"2024-04-26T10:25:15.237609+0000","last_clean":"2024-04-26T10:25:15.237609+0000","last_became_active":"2024-04-26T10:24:22.535998+0000","last_became_peered":"2024-04-26T10:24:22.535998+0000","last_unstale":"2024-04-26T10:25:15.237609+0000","last_undegraded":"2024-04-26T10:25:15.237609+0000","last_fullsized":"2024-04-26T10:25:15.237609+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:15.237328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:15.237328+0000","last_clean_scrub_stamp":"2024-04-26T10:25:15.237328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:09.529037+0000","scrub_duration":0.0032767389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":81,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.675457+0000","last_change":"2024-04-26T10:21:09.319893+0000","last_active":"2024-04-26T10:24:43.675457+0000","last_peered":"2024-04-26T10:24:43.675457+0000","last_clean":"2024-04-26T10:24:43.675457+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:24:43.675457+0000","last_undegraded":"2024-04-26T10:24:43.675457+0000","last_fullsized":"2024-04-26T10:24:43.675457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:17.164418+0000","last_change":"2024-04-26T10:26:17.164669+0000","last_active":"2024-04-26T10:26:17.164418+0000","last_peered":"2024-04-26T10:26:17.164418+0000","last_clean":"2024-04-26T10:26:17.164418+0000","last_became_active":"2024-04-26T10:24:22.548485+0000","last_became_peered":"2024-04-26T10:24:22.548485+0000","last_unstale":"2024-04-26T10:26:17.164418+0000","last_undegraded":"2024-04-26T10:26:17.164418+0000","last_fullsized":"2024-04-26T10:26:17.164418+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:17.164369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:17.164369+0000","last_clean_scrub_stamp":"2024-04-26T10:26:17.164369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:45.402486+0000","scrub_duration":0.003388364,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:00.289761+0000","last_change":"2024-04-26T10:25:00.290012+0000","last_active":"2024-04-26T10:25:00.289761+0000","last_peered":"2024-04-26T10:25:00.289761+0000","last_clean":"2024-04-26T10:25:00.289761+0000","last_became_active":"2024-04-26T10:24:31.600986+0000","last_became_peered":"2024-04-26T10:24:31.600986+0000","last_unstale":"2024-04-26T10:25:00.289761+0000","last_undegraded":"2024-04-26T10:25:00.289761+0000","last_fullsized":"2024-04-26T10:25:00.289761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:00.289706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:00.289706+0000","last_clean_scrub_stamp":"2024-04-26T10:25:00.289706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:20.178292+0000","scrub_duration":0.015595131999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:52.225492+0000","last_change":"2024-04-26T10:24:52.225492+0000","last_active":"2024-04-26T10:24:52.225492+0000","last_peered":"2024-04-26T10:24:52.225492+0000","last_clean":"2024-04-26T10:24:52.225492+0000","last_became_active":"2024-04-26T10:24:22.547731+0000","last_became_peered":"2024-04-26T10:24:22.547731+0000","last_unstale":"2024-04-26T10:24:52.225492+0000","last_undegraded":"2024-04-26T10:24:52.225492+0000","last_fullsized":"2024-04-26T10:24:52.225492+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:52.225191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:52.225191+0000","last_clean_scrub_stamp":"2024-04-26T10:24:52.225191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:05.446400+0000","scrub_duration":0.003307118,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:46.143361+0000","last_change":"2024-04-26T10:24:46.143361+0000","last_active":"2024-04-26T10:24:46.143361+0000","last_peered":"2024-04-26T10:24:46.143361+0000","last_clean":"2024-04-26T10:24:46.143361+0000","last_became_active":"2024-04-26T10:24:22.549180+0000","last_became_peered":"2024-04-26T10:24:22.549180+0000","last_unstale":"2024-04-26T10:24:46.143361+0000","last_undegraded":"2024-04-26T10:24:46.143361+0000","last_fullsized":"2024-04-26T10:24:46.143361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:46.142953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:46.142953+0000","last_clean_scrub_stamp":"2024-04-26T10:24:46.142953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:47.298765+0000","scrub_duration":0.014784434000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.675528+0000","last_change":"2024-04-26T10:24:22.547840+0000","last_active":"2024-04-26T10:24:43.675528+0000","last_peered":"2024-04-26T10:24:43.675528+0000","last_clean":"2024-04-26T10:24:43.675528+0000","last_became_active":"2024-04-26T10:24:22.547284+0000","last_became_peered":"2024-04-26T10:24:22.547284+0000","last_unstale":"2024-04-26T10:24:43.675528+0000","last_undegraded":"2024-04-26T10:24:43.675528+0000","last_fullsized":"2024-04-26T10:24:43.675528+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:56.807533+0000","last_change":"2024-04-26T10:24:56.807646+0000","last_active":"2024-04-26T10:24:56.807533+0000","last_peered":"2024-04-26T10:24:56.807533+0000","last_clean":"2024-04-26T10:24:56.807533+0000","last_became_active":"2024-04-26T10:24:22.679648+0000","last_became_peered":"2024-04-26T10:24:22.679648+0000","last_unstale":"2024-04-26T10:24:56.807533+0000","last_undegraded":"2024-04-26T10:24:56.807533+0000","last_fullsized":"2024-04-26T10:24:56.807533+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:56.807510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:56.807510+0000","last_clean_scrub_stamp":"2024-04-26T10:24:56.807510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:24.720449+0000","scrub_duration":0.029714911,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:04.256728+0000","last_change":"2024-04-26T10:25:04.256968+0000","last_active":"2024-04-26T10:25:04.256728+0000","last_peered":"2024-04-26T10:25:04.256728+0000","last_clean":"2024-04-26T10:25:04.256728+0000","last_became_active":"2024-04-26T10:24:31.598187+0000","last_became_peered":"2024-04-26T10:24:31.598187+0000","last_unstale":"2024-04-26T10:25:04.256728+0000","last_undegraded":"2024-04-26T10:25:04.256728+0000","last_fullsized":"2024-04-26T10:25:04.256728+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:04.256683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:04.256683+0000","last_clean_scrub_stamp":"2024-04-26T10:25:04.256683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:01.571431+0000","scrub_duration":0.0034188460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.675278+0000","last_change":"2024-04-26T10:24:22.547601+0000","last_active":"2024-04-26T10:24:43.675278+0000","last_peered":"2024-04-26T10:24:43.675278+0000","last_clean":"2024-04-26T10:24:43.675278+0000","last_became_active":"2024-04-26T10:24:22.546506+0000","last_became_peered":"2024-04-26T10:24:22.546506+0000","last_unstale":"2024-04-26T10:24:43.675278+0000","last_undegraded":"2024-04-26T10:24:43.675278+0000","last_fullsized":"2024-04-26T10:24:43.675278+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:56.280129+0000","last_change":"2024-04-26T10:24:56.280129+0000","last_active":"2024-04-26T10:24:56.280129+0000","last_peered":"2024-04-26T10:24:56.280129+0000","last_clean":"2024-04-26T10:24:56.280129+0000","last_became_active":"2024-04-26T10:22:09.747822+0000","last_became_peered":"2024-04-26T10:22:09.747822+0000","last_unstale":"2024-04-26T10:24:56.280129+0000","last_undegraded":"2024-04-26T10:24:56.280129+0000","last_fullsized":"2024-04-26T10:24:56.280129+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:56.279865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:56.279865+0000","last_clean_scrub_stamp":"2024-04-26T10:24:56.279865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:18:56.107536+0000","scrub_duration":0.0031183439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:09.228824+0000","last_change":"2024-04-26T10:25:09.229056+0000","last_active":"2024-04-26T10:25:09.228824+0000","last_peered":"2024-04-26T10:25:09.228824+0000","last_clean":"2024-04-26T10:25:09.228824+0000","last_became_active":"2024-04-26T10:24:31.597980+0000","last_became_peered":"2024-04-26T10:24:31.597980+0000","last_unstale":"2024-04-26T10:25:09.228824+0000","last_undegraded":"2024-04-26T10:25:09.228824+0000","last_fullsized":"2024-04-26T10:25:09.228824+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:09.228760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:09.228760+0000","last_clean_scrub_stamp":"2024-04-26T10:25:09.228760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:16.641297+0000","scrub_duration":0.01109303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:53.201710+0000","last_change":"2024-04-26T10:24:53.201710+0000","last_active":"2024-04-26T10:24:53.201710+0000","last_peered":"2024-04-26T10:24:53.201710+0000","last_clean":"2024-04-26T10:24:53.201710+0000","last_became_active":"2024-04-26T10:24:31.602539+0000","last_became_peered":"2024-04-26T10:24:31.602539+0000","last_unstale":"2024-04-26T10:24:53.201710+0000","last_undegraded":"2024-04-26T10:24:53.201710+0000","last_fullsized":"2024-04-26T10:24:53.201710+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:53.201431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:53.201431+0000","last_clean_scrub_stamp":"2024-04-26T10:24:53.201431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:31.514894+0000","scrub_duration":0.0033374949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:00.222988+0000","last_change":"2024-04-26T10:25:00.222988+0000","last_active":"2024-04-26T10:25:00.222988+0000","last_peered":"2024-04-26T10:25:00.222988+0000","last_clean":"2024-04-26T10:25:00.222988+0000","last_became_active":"2024-04-26T10:24:31.602453+0000","last_became_peered":"2024-04-26T10:24:31.602453+0000","last_unstale":"2024-04-26T10:25:00.222988+0000","last_undegraded":"2024-04-26T10:25:00.222988+0000","last_fullsized":"2024-04-26T10:25:00.222988+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:00.222698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:00.222698+0000","last_clean_scrub_stamp":"2024-04-26T10:25:00.222698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:45.583919+0000","scrub_duration":0.0030823560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:21.272106+0000","last_change":"2024-04-26T10:26:21.272377+0000","last_active":"2024-04-26T10:26:21.272106+0000","last_peered":"2024-04-26T10:26:21.272106+0000","last_clean":"2024-04-26T10:26:21.272106+0000","last_became_active":"2024-04-26T10:24:22.546856+0000","last_became_peered":"2024-04-26T10:24:22.546856+0000","last_unstale":"2024-04-26T10:26:21.272106+0000","last_undegraded":"2024-04-26T10:26:21.272106+0000","last_fullsized":"2024-04-26T10:26:21.272106+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:21.272060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:21.272060+0000","last_clean_scrub_stamp":"2024-04-26T10:26:21.272060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:32.283263+0000","scrub_duration":0.0032835529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:34.846197+0000","last_change":"2024-04-26T10:25:34.846363+0000","last_active":"2024-04-26T10:25:34.846197+0000","last_peered":"2024-04-26T10:25:34.846197+0000","last_clean":"2024-04-26T10:25:34.846197+0000","last_became_active":"2024-04-26T10:24:22.679350+0000","last_became_peered":"2024-04-26T10:24:22.679350+0000","last_unstale":"2024-04-26T10:25:34.846197+0000","last_undegraded":"2024-04-26T10:25:34.846197+0000","last_fullsized":"2024-04-26T10:25:34.846197+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:34.846164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:34.846164+0000","last_clean_scrub_stamp":"2024-04-26T10:25:34.846164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:48.771890+0000","scrub_duration":0.052228093000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:36.161111+0000","last_change":"2024-04-26T10:25:36.161340+0000","last_active":"2024-04-26T10:25:36.161111+0000","last_peered":"2024-04-26T10:25:36.161111+0000","last_clean":"2024-04-26T10:25:36.161111+0000","last_became_active":"2024-04-26T10:24:31.597563+0000","last_became_peered":"2024-04-26T10:24:31.597563+0000","last_unstale":"2024-04-26T10:25:36.161111+0000","last_undegraded":"2024-04-26T10:25:36.161111+0000","last_fullsized":"2024-04-26T10:25:36.161111+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:36.161060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:36.161060+0000","last_clean_scrub_stamp":"2024-04-26T10:25:36.161060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:55.224036+0000","scrub_duration":0.003288694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:22.717671+0000","last_change":"2024-04-26T10:25:22.717781+0000","last_active":"2024-04-26T10:25:22.717671+0000","last_peered":"2024-04-26T10:25:22.717671+0000","last_clean":"2024-04-26T10:25:22.717671+0000","last_became_active":"2024-04-26T10:24:22.678912+0000","last_became_peered":"2024-04-26T10:24:22.678912+0000","last_unstale":"2024-04-26T10:25:22.717671+0000","last_undegraded":"2024-04-26T10:25:22.717671+0000","last_fullsized":"2024-04-26T10:25:22.717671+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:22.717652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:22.717652+0000","last_clean_scrub_stamp":"2024-04-26T10:25:22.717652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:29.694277+0000","scrub_duration":0.017936198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:11.297872+0000","last_change":"2024-04-26T10:26:11.298292+0000","last_active":"2024-04-26T10:26:11.297872+0000","last_peered":"2024-04-26T10:26:11.297872+0000","last_clean":"2024-04-26T10:26:11.297872+0000","last_became_active":"2024-04-26T10:24:22.546052+0000","last_became_peered":"2024-04-26T10:24:22.546052+0000","last_unstale":"2024-04-26T10:26:11.297872+0000","last_undegraded":"2024-04-26T10:26:11.297872+0000","last_fullsized":"2024-04-26T10:26:11.297872+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:11.297782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:11.297782+0000","last_clean_scrub_stamp":"2024-04-26T10:26:11.297782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:34:31.203553+0000","scrub_duration":0.0031962520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:08.292897+0000","last_change":"2024-04-26T10:25:08.292897+0000","last_active":"2024-04-26T10:25:08.292897+0000","last_peered":"2024-04-26T10:25:08.292897+0000","last_clean":"2024-04-26T10:25:08.292897+0000","last_became_active":"2024-04-26T10:24:22.547663+0000","last_became_peered":"2024-04-26T10:24:22.547663+0000","last_unstale":"2024-04-26T10:25:08.292897+0000","last_undegraded":"2024-04-26T10:25:08.292897+0000","last_fullsized":"2024-04-26T10:25:08.292897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:08.292772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:08.292772+0000","last_clean_scrub_stamp":"2024-04-26T10:25:08.292772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:35.112407+0000","scrub_duration":0.038060340999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:01.324901+0000","last_change":"2024-04-26T10:25:01.324901+0000","last_active":"2024-04-26T10:25:01.324901+0000","last_peered":"2024-04-26T10:25:01.324901+0000","last_clean":"2024-04-26T10:25:01.324901+0000","last_became_active":"2024-04-26T10:22:09.748755+0000","last_became_peered":"2024-04-26T10:22:09.748755+0000","last_unstale":"2024-04-26T10:25:01.324901+0000","last_undegraded":"2024-04-26T10:25:01.324901+0000","last_fullsized":"2024-04-26T10:25:01.324901+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:01.324527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:01.324527+0000","last_clean_scrub_stamp":"2024-04-26T10:25:01.324527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:42.317619+0000","scrub_duration":0.0030479109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:31.855132+0000","last_change":"2024-04-26T10:25:31.855451+0000","last_active":"2024-04-26T10:25:31.855132+0000","last_peered":"2024-04-26T10:25:31.855132+0000","last_clean":"2024-04-26T10:25:31.855132+0000","last_became_active":"2024-04-26T10:24:22.683921+0000","last_became_peered":"2024-04-26T10:24:22.683921+0000","last_unstale":"2024-04-26T10:25:31.855132+0000","last_undegraded":"2024-04-26T10:25:31.855132+0000","last_fullsized":"2024-04-26T10:25:31.855132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:31.855041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:31.855041+0000","last_clean_scrub_stamp":"2024-04-26T10:25:31.855041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:04.764581+0000","scrub_duration":0.003368359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:22.231749+0000","last_change":"2024-04-26T10:25:22.231749+0000","last_active":"2024-04-26T10:25:22.231749+0000","last_peered":"2024-04-26T10:25:22.231749+0000","last_clean":"2024-04-26T10:25:22.231749+0000","last_became_active":"2024-04-26T10:24:22.534674+0000","last_became_peered":"2024-04-26T10:24:22.534674+0000","last_unstale":"2024-04-26T10:25:22.231749+0000","last_undegraded":"2024-04-26T10:25:22.231749+0000","last_fullsized":"2024-04-26T10:25:22.231749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:22.231415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:22.231415+0000","last_clean_scrub_stamp":"2024-04-26T10:25:22.231415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:27.733690+0000","scrub_duration":0.0033621749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:48.293794+0000","last_change":"2024-04-26T10:24:48.293911+0000","last_active":"2024-04-26T10:24:48.293794+0000","last_peered":"2024-04-26T10:24:48.293794+0000","last_clean":"2024-04-26T10:24:48.293794+0000","last_became_active":"2024-04-26T10:24:31.600815+0000","last_became_peered":"2024-04-26T10:24:31.600815+0000","last_unstale":"2024-04-26T10:24:48.293794+0000","last_undegraded":"2024-04-26T10:24:48.293794+0000","last_fullsized":"2024-04-26T10:24:48.293794+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:48.293774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:48.293774+0000","last_clean_scrub_stamp":"2024-04-26T10:24:48.293774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:51.595218+0000","scrub_duration":0.058713007999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:51.769368+0000","last_change":"2024-04-26T10:24:51.769593+0000","last_active":"2024-04-26T10:24:51.769368+0000","last_peered":"2024-04-26T10:24:51.769368+0000","last_clean":"2024-04-26T10:24:51.769368+0000","last_became_active":"2024-04-26T10:24:22.683959+0000","last_became_peered":"2024-04-26T10:24:22.683959+0000","last_unstale":"2024-04-26T10:24:51.769368+0000","last_undegraded":"2024-04-26T10:24:51.769368+0000","last_fullsized":"2024-04-26T10:24:51.769368+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:51.769321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:51.769321+0000","last_clean_scrub_stamp":"2024-04-26T10:24:51.769321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:05.665068+0000","scrub_duration":0.003275011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":92,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:23.297456+0000","last_change":"2024-04-26T10:26:23.297721+0000","last_active":"2024-04-26T10:26:23.297456+0000","last_peered":"2024-04-26T10:26:23.297456+0000","last_clean":"2024-04-26T10:26:23.297456+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:26:23.297456+0000","last_undegraded":"2024-04-26T10:26:23.297456+0000","last_fullsized":"2024-04-26T10:26:23.297456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:23.297406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:23.297406+0000","last_clean_scrub_stamp":"2024-04-26T10:26:23.297406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:39.677599+0000","scrub_duration":0.0032507930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:53.260575+0000","last_change":"2024-04-26T10:25:53.260900+0000","last_active":"2024-04-26T10:25:53.260575+0000","last_peered":"2024-04-26T10:25:53.260575+0000","last_clean":"2024-04-26T10:25:53.260575+0000","last_became_active":"2024-04-26T10:24:31.601299+0000","last_became_peered":"2024-04-26T10:24:31.601299+0000","last_unstale":"2024-04-26T10:25:53.260575+0000","last_undegraded":"2024-04-26T10:25:53.260575+0000","last_fullsized":"2024-04-26T10:25:53.260575+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:53.260529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:53.260529+0000","last_clean_scrub_stamp":"2024-04-26T10:25:53.260529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:40.287907+0000","scrub_duration":0.003123584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:40.887406+0000","last_change":"2024-04-26T10:25:40.887406+0000","last_active":"2024-04-26T10:25:40.887406+0000","last_peered":"2024-04-26T10:25:40.887406+0000","last_clean":"2024-04-26T10:25:40.887406+0000","last_became_active":"2024-04-26T10:24:31.740626+0000","last_became_peered":"2024-04-26T10:24:31.740626+0000","last_unstale":"2024-04-26T10:25:40.887406+0000","last_undegraded":"2024-04-26T10:25:40.887406+0000","last_fullsized":"2024-04-26T10:25:40.887406+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:40.887274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:40.887274+0000","last_clean_scrub_stamp":"2024-04-26T10:25:40.887274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:03.140762+0000","scrub_duration":0.017197324,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:31.074103+0000","last_change":"2024-04-26T10:25:31.074332+0000","last_active":"2024-04-26T10:25:31.074103+0000","last_peered":"2024-04-26T10:25:31.074103+0000","last_clean":"2024-04-26T10:25:31.074103+0000","last_became_active":"2024-04-26T10:22:09.750286+0000","last_became_peered":"2024-04-26T10:22:09.750286+0000","last_unstale":"2024-04-26T10:25:31.074103+0000","last_undegraded":"2024-04-26T10:25:31.074103+0000","last_fullsized":"2024-04-26T10:25:31.074103+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:31.074058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:31.074058+0000","last_clean_scrub_stamp":"2024-04-26T10:25:31.074058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:39.699950+0000","scrub_duration":0.003248187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:01.978857+0000","last_change":"2024-04-26T10:26:01.978857+0000","last_active":"2024-04-26T10:26:01.978857+0000","last_peered":"2024-04-26T10:26:01.978857+0000","last_clean":"2024-04-26T10:26:01.978857+0000","last_became_active":"2024-04-26T10:24:31.740518+0000","last_became_peered":"2024-04-26T10:24:31.740518+0000","last_unstale":"2024-04-26T10:26:01.978857+0000","last_undegraded":"2024-04-26T10:26:01.978857+0000","last_fullsized":"2024-04-26T10:26:01.978857+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:01.978406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:01.978406+0000","last_clean_scrub_stamp":"2024-04-26T10:26:01.978406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:58:52.163295+0000","scrub_duration":0.0033284709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:44.170604+0000","last_change":"2024-04-26T10:24:44.170604+0000","last_active":"2024-04-26T10:24:44.170604+0000","last_peered":"2024-04-26T10:24:44.170604+0000","last_clean":"2024-04-26T10:24:44.170604+0000","last_became_active":"2024-04-26T10:24:22.539106+0000","last_became_peered":"2024-04-26T10:24:22.539106+0000","last_unstale":"2024-04-26T10:24:44.170604+0000","last_undegraded":"2024-04-26T10:24:44.170604+0000","last_fullsized":"2024-04-26T10:24:44.170604+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:44.170151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:44.170151+0000","last_clean_scrub_stamp":"2024-04-26T10:24:44.170151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:52.109209+0000","scrub_duration":0.010234752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:54.298622+0000","last_change":"2024-04-26T10:25:54.298852+0000","last_active":"2024-04-26T10:25:54.298622+0000","last_peered":"2024-04-26T10:25:54.298622+0000","last_clean":"2024-04-26T10:25:54.298622+0000","last_became_active":"2024-04-26T10:24:31.598307+0000","last_became_peered":"2024-04-26T10:24:31.598307+0000","last_unstale":"2024-04-26T10:25:54.298622+0000","last_undegraded":"2024-04-26T10:25:54.298622+0000","last_fullsized":"2024-04-26T10:25:54.298622+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:54.298577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:54.298577+0000","last_clean_scrub_stamp":"2024-04-26T10:25:54.298577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:13.596052+0000","scrub_duration":0.0031942189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"91'4","reported_seq":110,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:34.241275+0000","last_change":"2024-04-26T10:25:34.241275+0000","last_active":"2024-04-26T10:25:34.241275+0000","last_peered":"2024-04-26T10:25:34.241275+0000","last_clean":"2024-04-26T10:25:34.241275+0000","last_became_active":"2024-04-26T10:24:22.546794+0000","last_became_peered":"2024-04-26T10:24:22.546794+0000","last_unstale":"2024-04-26T10:25:34.241275+0000","last_undegraded":"2024-04-26T10:25:34.241275+0000","last_fullsized":"2024-04-26T10:25:34.241275+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-04-26T10:25:34.240988+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-04-26T10:25:34.240988+0000","last_clean_scrub_stamp":"2024-04-26T10:25:34.240988+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:09.512473+0000","scrub_duration":0.0082918269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:47.236229+0000","last_change":"2024-04-26T10:24:47.236463+0000","last_active":"2024-04-26T10:24:47.236229+0000","last_peered":"2024-04-26T10:24:47.236229+0000","last_clean":"2024-04-26T10:24:47.236229+0000","last_became_active":"2024-04-26T10:24:31.596297+0000","last_became_peered":"2024-04-26T10:24:31.596297+0000","last_unstale":"2024-04-26T10:24:47.236229+0000","last_undegraded":"2024-04-26T10:24:47.236229+0000","last_fullsized":"2024-04-26T10:24:47.236229+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:47.236175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:47.236175+0000","last_clean_scrub_stamp":"2024-04-26T10:24:47.236175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:31.442660+0000","scrub_duration":0.014903458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:12.635104+0000","last_change":"2024-04-26T10:25:12.635350+0000","last_active":"2024-04-26T10:25:12.635104+0000","last_peered":"2024-04-26T10:25:12.635104+0000","last_clean":"2024-04-26T10:25:12.635104+0000","last_became_active":"2024-04-26T10:24:22.684541+0000","last_became_peered":"2024-04-26T10:24:22.684541+0000","last_unstale":"2024-04-26T10:25:12.635104+0000","last_undegraded":"2024-04-26T10:25:12.635104+0000","last_fullsized":"2024-04-26T10:25:12.635104+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:12.635057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:12.635057+0000","last_clean_scrub_stamp":"2024-04-26T10:25:12.635057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:40.868547+0000","scrub_duration":0.0035574059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:33.793616+0000","last_change":"2024-04-26T10:25:33.793857+0000","last_active":"2024-04-26T10:25:33.793616+0000","last_peered":"2024-04-26T10:25:33.793616+0000","last_clean":"2024-04-26T10:25:33.793616+0000","last_became_active":"2024-04-26T10:24:22.682650+0000","last_became_peered":"2024-04-26T10:24:22.682650+0000","last_unstale":"2024-04-26T10:25:33.793616+0000","last_undegraded":"2024-04-26T10:25:33.793616+0000","last_fullsized":"2024-04-26T10:25:33.793616+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:33.793569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:33.793569+0000","last_clean_scrub_stamp":"2024-04-26T10:25:33.793569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:42:31.145665+0000","scrub_duration":0.0030047139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:34.094073+0000","last_change":"2024-04-26T10:25:34.094279+0000","last_active":"2024-04-26T10:25:34.094073+0000","last_peered":"2024-04-26T10:25:34.094073+0000","last_clean":"2024-04-26T10:25:34.094073+0000","last_became_active":"2024-04-26T10:24:31.601091+0000","last_became_peered":"2024-04-26T10:24:31.601091+0000","last_unstale":"2024-04-26T10:25:34.094073+0000","last_undegraded":"2024-04-26T10:25:34.094073+0000","last_fullsized":"2024-04-26T10:25:34.094073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:34.094025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:34.094025+0000","last_clean_scrub_stamp":"2024-04-26T10:25:34.094025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:48.013784+0000","scrub_duration":0.003459784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:08.712500+0000","last_change":"2024-04-26T10:25:08.712611+0000","last_active":"2024-04-26T10:25:08.712500+0000","last_peered":"2024-04-26T10:25:08.712500+0000","last_clean":"2024-04-26T10:25:08.712500+0000","last_became_active":"2024-04-26T10:24:22.684213+0000","last_became_peered":"2024-04-26T10:24:22.684213+0000","last_unstale":"2024-04-26T10:25:08.712500+0000","last_undegraded":"2024-04-26T10:25:08.712500+0000","last_fullsized":"2024-04-26T10:25:08.712500+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:08.712479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:08.712479+0000","last_clean_scrub_stamp":"2024-04-26T10:25:08.712479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:22.971123+0000","scrub_duration":0.069345404999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"91'12","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:27.254757+0000","last_change":"2024-04-26T10:25:27.254757+0000","last_active":"2024-04-26T10:25:27.254757+0000","last_peered":"2024-04-26T10:25:27.254757+0000","last_clean":"2024-04-26T10:25:27.254757+0000","last_became_active":"2024-04-26T10:24:31.604402+0000","last_became_peered":"2024-04-26T10:24:31.604402+0000","last_unstale":"2024-04-26T10:25:27.254757+0000","last_undegraded":"2024-04-26T10:25:27.254757+0000","last_fullsized":"2024-04-26T10:25:27.254757+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'12","last_scrub_stamp":"2024-04-26T10:25:27.254465+0000","last_deep_scrub":"91'12","last_deep_scrub_stamp":"2024-04-26T10:25:27.254465+0000","last_clean_scrub_stamp":"2024-04-26T10:25:27.254465+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:52.325925+0000","scrub_duration":0.0093417299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"91'2","reported_seq":129,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:36.183977+0000","last_change":"2024-04-26T10:25:36.183977+0000","last_active":"2024-04-26T10:25:36.183977+0000","last_peered":"2024-04-26T10:25:36.183977+0000","last_clean":"2024-04-26T10:25:36.183977+0000","last_became_active":"2024-04-26T10:24:31.604744+0000","last_became_peered":"2024-04-26T10:24:31.604744+0000","last_unstale":"2024-04-26T10:25:36.183977+0000","last_undegraded":"2024-04-26T10:25:36.183977+0000","last_fullsized":"2024-04-26T10:25:36.183977+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-04-26T10:25:36.183521+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-04-26T10:25:36.183521+0000","last_clean_scrub_stamp":"2024-04-26T10:25:36.183521+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:59.590522+0000","scrub_duration":0.0073008739999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:52.312203+0000","last_change":"2024-04-26T10:24:52.312203+0000","last_active":"2024-04-26T10:24:52.312203+0000","last_peered":"2024-04-26T10:24:52.312203+0000","last_clean":"2024-04-26T10:24:52.312203+0000","last_became_active":"2024-04-26T10:22:09.749862+0000","last_became_peered":"2024-04-26T10:22:09.749862+0000","last_unstale":"2024-04-26T10:24:52.312203+0000","last_undegraded":"2024-04-26T10:24:52.312203+0000","last_fullsized":"2024-04-26T10:24:52.312203+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:52.311773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:52.311773+0000","last_clean_scrub_stamp":"2024-04-26T10:24:52.311773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:12.624461+0000","scrub_duration":0.0034835349999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"91'3","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:13.197344+0000","last_change":"2024-04-26T10:25:13.197344+0000","last_active":"2024-04-26T10:25:13.197344+0000","last_peered":"2024-04-26T10:25:13.197344+0000","last_clean":"2024-04-26T10:25:13.197344+0000","last_became_active":"2024-04-26T10:22:09.749852+0000","last_became_peered":"2024-04-26T10:22:09.749852+0000","last_unstale":"2024-04-26T10:25:13.197344+0000","last_undegraded":"2024-04-26T10:25:13.197344+0000","last_fullsized":"2024-04-26T10:25:13.197344+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:13.197045+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:13.197045+0000","last_clean_scrub_stamp":"2024-04-26T10:25:13.197045+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:01.578169+0000","scrub_duration":0.0064724919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:48.164900+0000","last_change":"2024-04-26T10:25:48.165132+0000","last_active":"2024-04-26T10:25:48.164900+0000","last_peered":"2024-04-26T10:25:48.164900+0000","last_clean":"2024-04-26T10:25:48.164900+0000","last_became_active":"2024-04-26T10:24:31.596335+0000","last_became_peered":"2024-04-26T10:24:31.596335+0000","last_unstale":"2024-04-26T10:25:48.164900+0000","last_undegraded":"2024-04-26T10:25:48.164900+0000","last_fullsized":"2024-04-26T10:25:48.164900+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:48.164842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:48.164842+0000","last_clean_scrub_stamp":"2024-04-26T10:25:48.164842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:27.230715+0000","scrub_duration":0.0031925389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"91'2","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:42.239060+0000","last_change":"2024-04-26T10:25:42.239422+0000","last_active":"2024-04-26T10:25:42.239060+0000","last_peered":"2024-04-26T10:25:42.239060+0000","last_clean":"2024-04-26T10:25:42.239060+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:25:42.239060+0000","last_undegraded":"2024-04-26T10:25:42.239060+0000","last_fullsized":"2024-04-26T10:25:42.239060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-04-26T10:25:42.238933+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-04-26T10:25:42.238933+0000","last_clean_scrub_stamp":"2024-04-26T10:25:42.238933+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:18.940962+0000","scrub_duration":0.0070962710000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:35.198370+0000","last_change":"2024-04-26T10:25:35.198666+0000","last_active":"2024-04-26T10:25:35.198370+0000","last_peered":"2024-04-26T10:25:35.198370+0000","last_clean":"2024-04-26T10:25:35.198370+0000","last_became_active":"2024-04-26T10:24:22.549230+0000","last_became_peered":"2024-04-26T10:24:22.549230+0000","last_unstale":"2024-04-26T10:25:35.198370+0000","last_undegraded":"2024-04-26T10:25:35.198370+0000","last_fullsized":"2024-04-26T10:25:35.198370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:35.198322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:35.198322+0000","last_clean_scrub_stamp":"2024-04-26T10:25:35.198322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:02.241610+0000","scrub_duration":0.0034907969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:50.245134+0000","last_change":"2024-04-26T10:25:50.245370+0000","last_active":"2024-04-26T10:25:50.245134+0000","last_peered":"2024-04-26T10:25:50.245134+0000","last_clean":"2024-04-26T10:25:50.245134+0000","last_became_active":"2024-04-26T10:24:22.540611+0000","last_became_peered":"2024-04-26T10:24:22.540611+0000","last_unstale":"2024-04-26T10:25:50.245134+0000","last_undegraded":"2024-04-26T10:25:50.245134+0000","last_fullsized":"2024-04-26T10:25:50.245134+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:50.245085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:50.245085+0000","last_clean_scrub_stamp":"2024-04-26T10:25:50.245085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:22.376739+0000","scrub_duration":0.003113513,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:10.703734+0000","last_change":"2024-04-26T10:25:10.703884+0000","last_active":"2024-04-26T10:25:10.703734+0000","last_peered":"2024-04-26T10:25:10.703734+0000","last_clean":"2024-04-26T10:25:10.703734+0000","last_became_active":"2024-04-26T10:24:22.686841+0000","last_became_peered":"2024-04-26T10:24:22.686841+0000","last_unstale":"2024-04-26T10:25:10.703734+0000","last_undegraded":"2024-04-26T10:25:10.703734+0000","last_fullsized":"2024-04-26T10:25:10.703734+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:10.703715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:10.703715+0000","last_clean_scrub_stamp":"2024-04-26T10:25:10.703715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:08.356723+0000","scrub_duration":0.01785925,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'3","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:02.685154+0000","last_change":"2024-04-26T10:25:02.685404+0000","last_active":"2024-04-26T10:25:02.685154+0000","last_peered":"2024-04-26T10:25:02.685154+0000","last_clean":"2024-04-26T10:25:02.685154+0000","last_became_active":"2024-04-26T10:24:22.686846+0000","last_became_peered":"2024-04-26T10:24:22.686846+0000","last_unstale":"2024-04-26T10:25:02.685154+0000","last_undegraded":"2024-04-26T10:25:02.685154+0000","last_fullsized":"2024-04-26T10:25:02.685154+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:02.685093+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:02.685093+0000","last_clean_scrub_stamp":"2024-04-26T10:25:02.685093+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:29.685511+0000","scrub_duration":0.0064629550000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:32.237246+0000","last_change":"2024-04-26T10:25:32.237246+0000","last_active":"2024-04-26T10:25:32.237246+0000","last_peered":"2024-04-26T10:25:32.237246+0000","last_clean":"2024-04-26T10:25:32.237246+0000","last_became_active":"2024-04-26T10:24:22.545616+0000","last_became_peered":"2024-04-26T10:24:22.545616+0000","last_unstale":"2024-04-26T10:25:32.237246+0000","last_undegraded":"2024-04-26T10:25:32.237246+0000","last_fullsized":"2024-04-26T10:25:32.237246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:32.236967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:32.236967+0000","last_clean_scrub_stamp":"2024-04-26T10:25:32.236967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:18.701998+0000","scrub_duration":0.0034163280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:10.308591+0000","last_change":"2024-04-26T10:26:10.308845+0000","last_active":"2024-04-26T10:26:10.308591+0000","last_peered":"2024-04-26T10:26:10.308591+0000","last_clean":"2024-04-26T10:26:10.308591+0000","last_became_active":"2024-04-26T10:24:22.538982+0000","last_became_peered":"2024-04-26T10:24:22.538982+0000","last_unstale":"2024-04-26T10:26:10.308591+0000","last_undegraded":"2024-04-26T10:26:10.308591+0000","last_fullsized":"2024-04-26T10:26:10.308591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:10.308540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:10.308540+0000","last_clean_scrub_stamp":"2024-04-26T10:26:10.308540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:10.400365+0000","scrub_duration":0.0031209660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":92,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:49.285356+0000","last_change":"2024-04-26T10:25:49.285724+0000","last_active":"2024-04-26T10:25:49.285356+0000","last_peered":"2024-04-26T10:25:49.285356+0000","last_clean":"2024-04-26T10:25:49.285356+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:25:49.285356+0000","last_undegraded":"2024-04-26T10:25:49.285356+0000","last_fullsized":"2024-04-26T10:25:49.285356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:49.285262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:49.285262+0000","last_clean_scrub_stamp":"2024-04-26T10:25:49.285262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:29.659904+0000","scrub_duration":0.0035995300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":84,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:07.248434+0000","last_change":"2024-04-26T10:25:07.248434+0000","last_active":"2024-04-26T10:25:07.248434+0000","last_peered":"2024-04-26T10:25:07.248434+0000","last_clean":"2024-04-26T10:25:07.248434+0000","last_became_active":"2024-04-26T10:22:09.748256+0000","last_became_peered":"2024-04-26T10:22:09.748256+0000","last_unstale":"2024-04-26T10:25:07.248434+0000","last_undegraded":"2024-04-26T10:25:07.248434+0000","last_fullsized":"2024-04-26T10:25:07.248434+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:07.248161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:07.248161+0000","last_clean_scrub_stamp":"2024-04-26T10:25:07.248161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:25.723449+0000","scrub_duration":0.003118071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:41.225747+0000","last_change":"2024-04-26T10:25:41.225747+0000","last_active":"2024-04-26T10:25:41.225747+0000","last_peered":"2024-04-26T10:25:41.225747+0000","last_clean":"2024-04-26T10:25:41.225747+0000","last_became_active":"2024-04-26T10:24:31.603620+0000","last_became_peered":"2024-04-26T10:24:31.603620+0000","last_unstale":"2024-04-26T10:25:41.225747+0000","last_undegraded":"2024-04-26T10:25:41.225747+0000","last_fullsized":"2024-04-26T10:25:41.225747+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:41.225468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:41.225468+0000","last_clean_scrub_stamp":"2024-04-26T10:25:41.225468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.344665+0000","scrub_duration":0.0031305310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:37.156489+0000","last_change":"2024-04-26T10:25:37.156720+0000","last_active":"2024-04-26T10:25:37.156489+0000","last_peered":"2024-04-26T10:25:37.156489+0000","last_clean":"2024-04-26T10:25:37.156489+0000","last_became_active":"2024-04-26T10:24:31.598120+0000","last_became_peered":"2024-04-26T10:24:31.598120+0000","last_unstale":"2024-04-26T10:25:37.156489+0000","last_undegraded":"2024-04-26T10:25:37.156489+0000","last_fullsized":"2024-04-26T10:25:37.156489+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:37.156442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:37.156442+0000","last_clean_scrub_stamp":"2024-04-26T10:25:37.156442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:09.426539+0000","scrub_duration":0.0032247579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:57.789264+0000","last_change":"2024-04-26T10:24:57.789439+0000","last_active":"2024-04-26T10:24:57.789264+0000","last_peered":"2024-04-26T10:24:57.789264+0000","last_clean":"2024-04-26T10:24:57.789264+0000","last_became_active":"2024-04-26T10:24:22.679940+0000","last_became_peered":"2024-04-26T10:24:22.679940+0000","last_unstale":"2024-04-26T10:24:57.789264+0000","last_undegraded":"2024-04-26T10:24:57.789264+0000","last_fullsized":"2024-04-26T10:24:57.789264+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:57.789236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:57.789236+0000","last_clean_scrub_stamp":"2024-04-26T10:24:57.789236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:34.365027+0000","scrub_duration":0.045365677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"91'159","reported_seq":348,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:55.216932+0000","last_change":"2024-04-26T10:25:55.217213+0000","last_active":"2024-04-26T10:25:55.216932+0000","last_peered":"2024-04-26T10:25:55.216932+0000","last_clean":"2024-04-26T10:25:55.216932+0000","last_became_active":"2024-04-26T10:24:34.184490+0000","last_became_peered":"2024-04-26T10:24:34.184490+0000","last_unstale":"2024-04-26T10:25:55.216932+0000","last_undegraded":"2024-04-26T10:25:55.216932+0000","last_fullsized":"2024-04-26T10:25:55.216932+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'159","last_scrub_stamp":"2024-04-26T10:25:55.216878+0000","last_deep_scrub":"91'159","last_deep_scrub_stamp":"2024-04-26T10:25:55.216878+0000","last_clean_scrub_stamp":"2024-04-26T10:25:55.216878+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:35:53.332492+0000","scrub_duration":0.01063709,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:01.252793+0000","last_change":"2024-04-26T10:26:01.253028+0000","last_active":"2024-04-26T10:26:01.252793+0000","last_peered":"2024-04-26T10:26:01.252793+0000","last_clean":"2024-04-26T10:26:01.252793+0000","last_became_active":"2024-04-26T10:24:22.546650+0000","last_became_peered":"2024-04-26T10:24:22.546650+0000","last_unstale":"2024-04-26T10:26:01.252793+0000","last_undegraded":"2024-04-26T10:26:01.252793+0000","last_fullsized":"2024-04-26T10:26:01.252793+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:01.252748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:01.252748+0000","last_clean_scrub_stamp":"2024-04-26T10:26:01.252748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:39.132139+0000","scrub_duration":0.0031193200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:49.698037+0000","last_change":"2024-04-26T10:24:49.698037+0000","last_active":"2024-04-26T10:24:49.698037+0000","last_peered":"2024-04-26T10:24:49.698037+0000","last_clean":"2024-04-26T10:24:49.698037+0000","last_became_active":"2024-04-26T10:24:22.676489+0000","last_became_peered":"2024-04-26T10:24:22.676489+0000","last_unstale":"2024-04-26T10:24:49.698037+0000","last_undegraded":"2024-04-26T10:24:49.698037+0000","last_fullsized":"2024-04-26T10:24:49.698037+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:49.697735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:49.697735+0000","last_clean_scrub_stamp":"2024-04-26T10:24:49.697735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:32.374320+0000","scrub_duration":0.0030634690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:12.176501+0000","last_change":"2024-04-26T10:25:12.176501+0000","last_active":"2024-04-26T10:25:12.176501+0000","last_peered":"2024-04-26T10:25:12.176501+0000","last_clean":"2024-04-26T10:25:12.176501+0000","last_became_active":"2024-04-26T10:24:31.603498+0000","last_became_peered":"2024-04-26T10:24:31.603498+0000","last_unstale":"2024-04-26T10:25:12.176501+0000","last_undegraded":"2024-04-26T10:25:12.176501+0000","last_fullsized":"2024-04-26T10:25:12.176501+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:12.176170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:12.176170+0000","last_clean_scrub_stamp":"2024-04-26T10:25:12.176170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:31.663887+0000","scrub_duration":0.003223147,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":122,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:58.199601+0000","last_change":"2024-04-26T10:25:58.199850+0000","last_active":"2024-04-26T10:25:58.199601+0000","last_peered":"2024-04-26T10:25:58.199601+0000","last_clean":"2024-04-26T10:25:58.199601+0000","last_became_active":"2024-04-26T10:24:31.602611+0000","last_became_peered":"2024-04-26T10:24:31.602611+0000","last_unstale":"2024-04-26T10:25:58.199601+0000","last_undegraded":"2024-04-26T10:25:58.199601+0000","last_fullsized":"2024-04-26T10:25:58.199601+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:58.199556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:58.199556+0000","last_clean_scrub_stamp":"2024-04-26T10:25:58.199556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:16.447456+0000","scrub_duration":0.003443134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:28.757380+0000","last_change":"2024-04-26T10:25:28.757380+0000","last_active":"2024-04-26T10:25:28.757380+0000","last_peered":"2024-04-26T10:25:28.757380+0000","last_clean":"2024-04-26T10:25:28.757380+0000","last_became_active":"2024-04-26T10:24:22.685051+0000","last_became_peered":"2024-04-26T10:24:22.685051+0000","last_unstale":"2024-04-26T10:25:28.757380+0000","last_undegraded":"2024-04-26T10:25:28.757380+0000","last_fullsized":"2024-04-26T10:25:28.757380+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:28.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:28.757100+0000","last_clean_scrub_stamp":"2024-04-26T10:25:28.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:42.473787+0000","scrub_duration":0.0030427010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:24.210591+0000","last_change":"2024-04-26T10:25:24.210591+0000","last_active":"2024-04-26T10:25:24.210591+0000","last_peered":"2024-04-26T10:25:24.210591+0000","last_clean":"2024-04-26T10:25:24.210591+0000","last_became_active":"2024-04-26T10:24:22.537983+0000","last_became_peered":"2024-04-26T10:24:22.537983+0000","last_unstale":"2024-04-26T10:25:24.210591+0000","last_undegraded":"2024-04-26T10:25:24.210591+0000","last_fullsized":"2024-04-26T10:25:24.210591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:24.210327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:24.210327+0000","last_clean_scrub_stamp":"2024-04-26T10:25:24.210327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:19.630117+0000","scrub_duration":0.003228014,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:47.630379+0000","last_change":"2024-04-26T10:24:47.630379+0000","last_active":"2024-04-26T10:24:47.630379+0000","last_peered":"2024-04-26T10:24:47.630379+0000","last_clean":"2024-04-26T10:24:47.630379+0000","last_became_active":"2024-04-26T10:24:22.678866+0000","last_became_peered":"2024-04-26T10:24:22.678866+0000","last_unstale":"2024-04-26T10:24:47.630379+0000","last_undegraded":"2024-04-26T10:24:47.630379+0000","last_fullsized":"2024-04-26T10:24:47.630379+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:47.630061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:47.630061+0000","last_clean_scrub_stamp":"2024-04-26T10:24:47.630061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:03.378559+0000","scrub_duration":0.003470571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":84,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:25.191632+0000","last_change":"2024-04-26T10:25:25.191896+0000","last_active":"2024-04-26T10:25:25.191632+0000","last_peered":"2024-04-26T10:25:25.191632+0000","last_clean":"2024-04-26T10:25:25.191632+0000","last_became_active":"2024-04-26T10:22:09.749935+0000","last_became_peered":"2024-04-26T10:22:09.749935+0000","last_unstale":"2024-04-26T10:25:25.191632+0000","last_undegraded":"2024-04-26T10:25:25.191632+0000","last_fullsized":"2024-04-26T10:25:25.191632+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:25.191588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:25.191588+0000","last_clean_scrub_stamp":"2024-04-26T10:25:25.191588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:58.190318+0000","scrub_duration":0.0035868789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:56.919322+0000","last_change":"2024-04-26T10:25:56.919436+0000","last_active":"2024-04-26T10:25:56.919322+0000","last_peered":"2024-04-26T10:25:56.919322+0000","last_clean":"2024-04-26T10:25:56.919322+0000","last_became_active":"2024-04-26T10:24:31.745487+0000","last_became_peered":"2024-04-26T10:24:31.745487+0000","last_unstale":"2024-04-26T10:25:56.919322+0000","last_undegraded":"2024-04-26T10:25:56.919322+0000","last_fullsized":"2024-04-26T10:25:56.919322+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:56.919301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:56.919301+0000","last_clean_scrub_stamp":"2024-04-26T10:25:56.919301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:18.728459+0000","scrub_duration":0.028941299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:00.260545+0000","last_change":"2024-04-26T10:26:00.260824+0000","last_active":"2024-04-26T10:26:00.260545+0000","last_peered":"2024-04-26T10:26:00.260545+0000","last_clean":"2024-04-26T10:26:00.260545+0000","last_became_active":"2024-04-26T10:24:22.538993+0000","last_became_peered":"2024-04-26T10:24:22.538993+0000","last_unstale":"2024-04-26T10:26:00.260545+0000","last_undegraded":"2024-04-26T10:26:00.260545+0000","last_fullsized":"2024-04-26T10:26:00.260545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:00.260356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:00.260356+0000","last_clean_scrub_stamp":"2024-04-26T10:26:00.260356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:35.337680+0000","scrub_duration":0.003414331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:07.270026+0000","last_change":"2024-04-26T10:26:07.270271+0000","last_active":"2024-04-26T10:26:07.270026+0000","last_peered":"2024-04-26T10:26:07.270026+0000","last_clean":"2024-04-26T10:26:07.270026+0000","last_became_active":"2024-04-26T10:24:22.541795+0000","last_became_peered":"2024-04-26T10:24:22.541795+0000","last_unstale":"2024-04-26T10:26:07.270026+0000","last_undegraded":"2024-04-26T10:26:07.270026+0000","last_fullsized":"2024-04-26T10:26:07.270026+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:07.269957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:07.269957+0000","last_clean_scrub_stamp":"2024-04-26T10:26:07.269957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:35.069203+0000","scrub_duration":0.0033643560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:46.642441+0000","last_change":"2024-04-26T10:24:46.642441+0000","last_active":"2024-04-26T10:24:46.642441+0000","last_peered":"2024-04-26T10:24:46.642441+0000","last_clean":"2024-04-26T10:24:46.642441+0000","last_became_active":"2024-04-26T10:24:31.744373+0000","last_became_peered":"2024-04-26T10:24:31.744373+0000","last_unstale":"2024-04-26T10:24:46.642441+0000","last_undegraded":"2024-04-26T10:24:46.642441+0000","last_fullsized":"2024-04-26T10:24:46.642441+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:46.642168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:46.642168+0000","last_clean_scrub_stamp":"2024-04-26T10:24:46.642168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:47.970345+0000","scrub_duration":0.0030956120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:08.246286+0000","last_change":"2024-04-26T10:26:08.246526+0000","last_active":"2024-04-26T10:26:08.246286+0000","last_peered":"2024-04-26T10:26:08.246286+0000","last_clean":"2024-04-26T10:26:08.246286+0000","last_became_active":"2024-04-26T10:24:22.537041+0000","last_became_peered":"2024-04-26T10:24:22.537041+0000","last_unstale":"2024-04-26T10:26:08.246286+0000","last_undegraded":"2024-04-26T10:26:08.246286+0000","last_fullsized":"2024-04-26T10:26:08.246286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:08.246238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:08.246238+0000","last_clean_scrub_stamp":"2024-04-26T10:26:08.246238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:18.709788+0000","scrub_duration":0.003287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:52.905280+0000","last_change":"2024-04-26T10:25:52.905280+0000","last_active":"2024-04-26T10:25:52.905280+0000","last_peered":"2024-04-26T10:25:52.905280+0000","last_clean":"2024-04-26T10:25:52.905280+0000","last_became_active":"2024-04-26T10:24:31.744342+0000","last_became_peered":"2024-04-26T10:24:31.744342+0000","last_unstale":"2024-04-26T10:25:52.905280+0000","last_undegraded":"2024-04-26T10:25:52.905280+0000","last_fullsized":"2024-04-26T10:25:52.905280+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:52.905009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:52.905009+0000","last_clean_scrub_stamp":"2024-04-26T10:25:52.905009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:30.922185+0000","scrub_duration":0.0032611319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:53.288634+0000","last_change":"2024-04-26T10:24:53.288881+0000","last_active":"2024-04-26T10:24:53.288634+0000","last_peered":"2024-04-26T10:24:53.288634+0000","last_clean":"2024-04-26T10:24:53.288634+0000","last_became_active":"2024-04-26T10:24:31.598432+0000","last_became_peered":"2024-04-26T10:24:31.598432+0000","last_unstale":"2024-04-26T10:24:53.288634+0000","last_undegraded":"2024-04-26T10:24:53.288634+0000","last_fullsized":"2024-04-26T10:24:53.288634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:53.288587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:53.288587+0000","last_clean_scrub_stamp":"2024-04-26T10:24:53.288587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:25.869325+0000","scrub_duration":0.003660567,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:02.963196+0000","last_change":"2024-04-26T10:26:02.963196+0000","last_active":"2024-04-26T10:26:02.963196+0000","last_peered":"2024-04-26T10:26:02.963196+0000","last_clean":"2024-04-26T10:26:02.963196+0000","last_became_active":"2024-04-26T10:24:31.745004+0000","last_became_peered":"2024-04-26T10:24:31.745004+0000","last_unstale":"2024-04-26T10:26:02.963196+0000","last_undegraded":"2024-04-26T10:26:02.963196+0000","last_fullsized":"2024-04-26T10:26:02.963196+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:02.962834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:02.962834+0000","last_clean_scrub_stamp":"2024-04-26T10:26:02.962834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:02.796843+0000","scrub_duration":0.0032636729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:12.232393+0000","last_change":"2024-04-26T10:25:12.232642+0000","last_active":"2024-04-26T10:25:12.232393+0000","last_peered":"2024-04-26T10:25:12.232393+0000","last_clean":"2024-04-26T10:25:12.232393+0000","last_became_active":"2024-04-26T10:24:31.600977+0000","last_became_peered":"2024-04-26T10:24:31.600977+0000","last_unstale":"2024-04-26T10:25:12.232393+0000","last_undegraded":"2024-04-26T10:25:12.232393+0000","last_fullsized":"2024-04-26T10:25:12.232393+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:12.232350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:12.232350+0000","last_clean_scrub_stamp":"2024-04-26T10:25:12.232350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:54.306540+0000","scrub_duration":0.0033972550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:03.280598+0000","last_change":"2024-04-26T10:25:03.280598+0000","last_active":"2024-04-26T10:25:03.280598+0000","last_peered":"2024-04-26T10:25:03.280598+0000","last_clean":"2024-04-26T10:25:03.280598+0000","last_became_active":"2024-04-26T10:22:09.757813+0000","last_became_peered":"2024-04-26T10:22:09.757813+0000","last_unstale":"2024-04-26T10:25:03.280598+0000","last_undegraded":"2024-04-26T10:25:03.280598+0000","last_fullsized":"2024-04-26T10:25:03.280598+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:03.280310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:03.280310+0000","last_clean_scrub_stamp":"2024-04-26T10:25:03.280310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:49.626354+0000","scrub_duration":0.0030957509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"91'3","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:29.795203+0000","last_change":"2024-04-26T10:25:29.795539+0000","last_active":"2024-04-26T10:25:29.795203+0000","last_peered":"2024-04-26T10:25:29.795203+0000","last_clean":"2024-04-26T10:25:29.795203+0000","last_became_active":"2024-04-26T10:24:22.679497+0000","last_became_peered":"2024-04-26T10:24:22.679497+0000","last_unstale":"2024-04-26T10:25:29.795203+0000","last_undegraded":"2024-04-26T10:25:29.795203+0000","last_fullsized":"2024-04-26T10:25:29.795203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:29.795145+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:29.795145+0000","last_clean_scrub_stamp":"2024-04-26T10:25:29.795145+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:54.475564+0000","scrub_duration":0.0065687940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:51.867157+0000","last_change":"2024-04-26T10:25:51.867424+0000","last_active":"2024-04-26T10:25:51.867157+0000","last_peered":"2024-04-26T10:25:51.867157+0000","last_clean":"2024-04-26T10:25:51.867157+0000","last_became_active":"2024-04-26T10:24:31.740589+0000","last_became_peered":"2024-04-26T10:24:31.740589+0000","last_unstale":"2024-04-26T10:25:51.867157+0000","last_undegraded":"2024-04-26T10:25:51.867157+0000","last_fullsized":"2024-04-26T10:25:51.867157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:51.867105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:51.867105+0000","last_clean_scrub_stamp":"2024-04-26T10:25:51.867105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:28.725553+0000","scrub_duration":0.003137379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:36.821844+0000","last_change":"2024-04-26T10:25:36.821844+0000","last_active":"2024-04-26T10:25:36.821844+0000","last_peered":"2024-04-26T10:25:36.821844+0000","last_clean":"2024-04-26T10:25:36.821844+0000","last_became_active":"2024-04-26T10:24:22.686094+0000","last_became_peered":"2024-04-26T10:24:22.686094+0000","last_unstale":"2024-04-26T10:25:36.821844+0000","last_undegraded":"2024-04-26T10:25:36.821844+0000","last_fullsized":"2024-04-26T10:25:36.821844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:36.821405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:36.821405+0000","last_clean_scrub_stamp":"2024-04-26T10:25:36.821405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:37.980133+0000","scrub_duration":0.0037491249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"91'2","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:30.823094+0000","last_change":"2024-04-26T10:25:30.823328+0000","last_active":"2024-04-26T10:25:30.823094+0000","last_peered":"2024-04-26T10:25:30.823094+0000","last_clean":"2024-04-26T10:25:30.823094+0000","last_became_active":"2024-04-26T10:24:22.681977+0000","last_became_peered":"2024-04-26T10:24:22.681977+0000","last_unstale":"2024-04-26T10:25:30.823094+0000","last_undegraded":"2024-04-26T10:25:30.823094+0000","last_fullsized":"2024-04-26T10:25:30.823094+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-04-26T10:25:30.823041+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-04-26T10:25:30.823041+0000","last_clean_scrub_stamp":"2024-04-26T10:25:30.823041+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:56.165886+0000","scrub_duration":0.0068473839999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":122,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:03.239253+0000","last_change":"2024-04-26T10:26:03.239508+0000","last_active":"2024-04-26T10:26:03.239253+0000","last_peered":"2024-04-26T10:26:03.239253+0000","last_clean":"2024-04-26T10:26:03.239253+0000","last_became_active":"2024-04-26T10:24:31.604158+0000","last_became_peered":"2024-04-26T10:24:31.604158+0000","last_unstale":"2024-04-26T10:26:03.239253+0000","last_undegraded":"2024-04-26T10:26:03.239253+0000","last_fullsized":"2024-04-26T10:26:03.239253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:03.239209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:03.239209+0000","last_clean_scrub_stamp":"2024-04-26T10:26:03.239209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:38.356864+0000","scrub_duration":0.0033795040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:06.220952+0000","last_change":"2024-04-26T10:25:06.221246+0000","last_active":"2024-04-26T10:25:06.220952+0000","last_peered":"2024-04-26T10:25:06.220952+0000","last_clean":"2024-04-26T10:25:06.220952+0000","last_became_active":"2024-04-26T10:24:31.600474+0000","last_became_peered":"2024-04-26T10:24:31.600474+0000","last_unstale":"2024-04-26T10:25:06.220952+0000","last_undegraded":"2024-04-26T10:25:06.220952+0000","last_fullsized":"2024-04-26T10:25:06.220952+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:06.220907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:06.220907+0000","last_clean_scrub_stamp":"2024-04-26T10:25:06.220907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:58.924774+0000","scrub_duration":0.0032236180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:59.250347+0000","last_change":"2024-04-26T10:24:59.250347+0000","last_active":"2024-04-26T10:24:59.250347+0000","last_peered":"2024-04-26T10:24:59.250347+0000","last_clean":"2024-04-26T10:24:59.250347+0000","last_became_active":"2024-04-26T10:24:31.604609+0000","last_became_peered":"2024-04-26T10:24:31.604609+0000","last_unstale":"2024-04-26T10:24:59.250347+0000","last_undegraded":"2024-04-26T10:24:59.250347+0000","last_fullsized":"2024-04-26T10:24:59.250347+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:59.250058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:59.250058+0000","last_clean_scrub_stamp":"2024-04-26T10:24:59.250058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:27.888233+0000","scrub_duration":0.0035158640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"91'10","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:09.226253+0000","last_change":"2024-04-26T10:25:09.226253+0000","last_active":"2024-04-26T10:25:09.226253+0000","last_peered":"2024-04-26T10:25:09.226253+0000","last_clean":"2024-04-26T10:25:09.226253+0000","last_became_active":"2024-04-26T10:24:31.604884+0000","last_became_peered":"2024-04-26T10:24:31.604884+0000","last_unstale":"2024-04-26T10:25:09.226253+0000","last_undegraded":"2024-04-26T10:25:09.226253+0000","last_fullsized":"2024-04-26T10:25:09.226253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2024-04-26T10:25:09.225844+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2024-04-26T10:25:09.225844+0000","last_clean_scrub_stamp":"2024-04-26T10:25:09.225844+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:43.565487+0000","scrub_duration":0.0099065019999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:45.020842+0000","last_change":"2024-04-26T10:25:45.021090+0000","last_active":"2024-04-26T10:25:45.020842+0000","last_peered":"2024-04-26T10:25:45.020842+0000","last_clean":"2024-04-26T10:25:45.020842+0000","last_became_active":"2024-04-26T10:24:31.739550+0000","last_became_peered":"2024-04-26T10:24:31.739550+0000","last_unstale":"2024-04-26T10:25:45.020842+0000","last_undegraded":"2024-04-26T10:25:45.020842+0000","last_fullsized":"2024-04-26T10:25:45.020842+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:45.020789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:45.020789+0000","last_clean_scrub_stamp":"2024-04-26T10:25:45.020789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:16.947170+0000","scrub_duration":0.0032832579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:02.311259+0000","last_change":"2024-04-26T10:25:02.311507+0000","last_active":"2024-04-26T10:25:02.311259+0000","last_peered":"2024-04-26T10:25:02.311259+0000","last_clean":"2024-04-26T10:25:02.311259+0000","last_became_active":"2024-04-26T10:24:31.601218+0000","last_became_peered":"2024-04-26T10:24:31.601218+0000","last_unstale":"2024-04-26T10:25:02.311259+0000","last_undegraded":"2024-04-26T10:25:02.311259+0000","last_fullsized":"2024-04-26T10:25:02.311259+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'5","last_scrub_stamp":"2024-04-26T10:25:02.311211+0000","last_deep_scrub":"91'5","last_deep_scrub_stamp":"2024-04-26T10:25:02.311211+0000","last_clean_scrub_stamp":"2024-04-26T10:25:02.311211+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:46.605747+0000","scrub_duration":0.0088437829999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:07.221072+0000","last_change":"2024-04-26T10:25:07.221072+0000","last_active":"2024-04-26T10:25:07.221072+0000","last_peered":"2024-04-26T10:25:07.221072+0000","last_clean":"2024-04-26T10:25:07.221072+0000","last_became_active":"2024-04-26T10:24:22.546378+0000","last_became_peered":"2024-04-26T10:24:22.546378+0000","last_unstale":"2024-04-26T10:25:07.221072+0000","last_undegraded":"2024-04-26T10:25:07.221072+0000","last_fullsized":"2024-04-26T10:25:07.221072+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:07.220796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:07.220796+0000","last_clean_scrub_stamp":"2024-04-26T10:25:07.220796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:33.432321+0000","scrub_duration":0.0036655839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:04.628990+0000","last_change":"2024-04-26T10:25:04.629253+0000","last_active":"2024-04-26T10:25:04.628990+0000","last_peered":"2024-04-26T10:25:04.628990+0000","last_clean":"2024-04-26T10:25:04.628990+0000","last_became_active":"2024-04-26T10:24:22.683558+0000","last_became_peered":"2024-04-26T10:24:22.683558+0000","last_unstale":"2024-04-26T10:25:04.628990+0000","last_undegraded":"2024-04-26T10:25:04.628990+0000","last_fullsized":"2024-04-26T10:25:04.628990+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:04.628905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:04.628905+0000","last_clean_scrub_stamp":"2024-04-26T10:25:04.628905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:20:44.078968+0000","scrub_duration":0.0037325380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:50.729192+0000","last_change":"2024-04-26T10:24:50.729571+0000","last_active":"2024-04-26T10:24:50.729192+0000","last_peered":"2024-04-26T10:24:50.729192+0000","last_clean":"2024-04-26T10:24:50.729192+0000","last_became_active":"2024-04-26T10:24:22.684166+0000","last_became_peered":"2024-04-26T10:24:22.684166+0000","last_unstale":"2024-04-26T10:24:50.729192+0000","last_undegraded":"2024-04-26T10:24:50.729192+0000","last_fullsized":"2024-04-26T10:24:50.729192+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:50.729143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:50.729143+0000","last_clean_scrub_stamp":"2024-04-26T10:24:50.729143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:54.166410+0000","scrub_duration":0.003288118,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:39.844396+0000","last_change":"2024-04-26T10:25:39.844673+0000","last_active":"2024-04-26T10:25:39.844396+0000","last_peered":"2024-04-26T10:25:39.844396+0000","last_clean":"2024-04-26T10:25:39.844396+0000","last_became_active":"2024-04-26T10:24:31.745216+0000","last_became_peered":"2024-04-26T10:24:31.745216+0000","last_unstale":"2024-04-26T10:25:39.844396+0000","last_undegraded":"2024-04-26T10:25:39.844396+0000","last_fullsized":"2024-04-26T10:25:39.844396+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:39.844349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:39.844349+0000","last_clean_scrub_stamp":"2024-04-26T10:25:39.844349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:48.381149+0000","scrub_duration":0.0035234730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:10.271098+0000","last_change":"2024-04-26T10:25:10.271098+0000","last_active":"2024-04-26T10:25:10.271098+0000","last_peered":"2024-04-26T10:25:10.271098+0000","last_clean":"2024-04-26T10:25:10.271098+0000","last_became_active":"2024-04-26T10:22:09.750359+0000","last_became_peered":"2024-04-26T10:22:09.750359+0000","last_unstale":"2024-04-26T10:25:10.271098+0000","last_undegraded":"2024-04-26T10:25:10.271098+0000","last_fullsized":"2024-04-26T10:25:10.271098+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:10.270958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:10.270958+0000","last_clean_scrub_stamp":"2024-04-26T10:25:10.270958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:37.572061+0000","scrub_duration":0.098704475999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:14.648804+0000","last_change":"2024-04-26T10:25:14.649052+0000","last_active":"2024-04-26T10:25:14.648804+0000","last_peered":"2024-04-26T10:25:14.648804+0000","last_clean":"2024-04-26T10:25:14.648804+0000","last_became_active":"2024-04-26T10:24:31.740477+0000","last_became_peered":"2024-04-26T10:24:31.740477+0000","last_unstale":"2024-04-26T10:25:14.648804+0000","last_undegraded":"2024-04-26T10:25:14.648804+0000","last_fullsized":"2024-04-26T10:25:14.648804+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:14.648757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:14.648757+0000","last_clean_scrub_stamp":"2024-04-26T10:25:14.648757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:15.311203+0000","scrub_duration":0.0031660170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:48.666739+0000","last_change":"2024-04-26T10:24:48.666739+0000","last_active":"2024-04-26T10:24:48.666739+0000","last_peered":"2024-04-26T10:24:48.666739+0000","last_clean":"2024-04-26T10:24:48.666739+0000","last_became_active":"2024-04-26T10:24:22.683501+0000","last_became_peered":"2024-04-26T10:24:22.683501+0000","last_unstale":"2024-04-26T10:24:48.666739+0000","last_undegraded":"2024-04-26T10:24:48.666739+0000","last_fullsized":"2024-04-26T10:24:48.666739+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:48.666365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:48.666365+0000","last_clean_scrub_stamp":"2024-04-26T10:24:48.666365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:11.797360+0000","scrub_duration":0.003127285,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:23.695908+0000","last_change":"2024-04-26T10:25:23.696226+0000","last_active":"2024-04-26T10:25:23.695908+0000","last_peered":"2024-04-26T10:25:23.695908+0000","last_clean":"2024-04-26T10:25:23.695908+0000","last_became_active":"2024-04-26T10:24:22.684469+0000","last_became_peered":"2024-04-26T10:24:22.684469+0000","last_unstale":"2024-04-26T10:25:23.695908+0000","last_undegraded":"2024-04-26T10:25:23.695908+0000","last_fullsized":"2024-04-26T10:25:23.695908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:23.695862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:23.695862+0000","last_clean_scrub_stamp":"2024-04-26T10:25:23.695862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:21.975628+0000","scrub_duration":0.0034938339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:05.257118+0000","last_change":"2024-04-26T10:25:05.257118+0000","last_active":"2024-04-26T10:25:05.257118+0000","last_peered":"2024-04-26T10:25:05.257118+0000","last_clean":"2024-04-26T10:25:05.257118+0000","last_became_active":"2024-04-26T10:22:09.752856+0000","last_became_peered":"2024-04-26T10:22:09.752856+0000","last_unstale":"2024-04-26T10:25:05.257118+0000","last_undegraded":"2024-04-26T10:25:05.257118+0000","last_fullsized":"2024-04-26T10:25:05.257118+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:05.256836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:05.256836+0000","last_clean_scrub_stamp":"2024-04-26T10:25:05.256836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:22.884251+0000","scrub_duration":0.0032355069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:17.278034+0000","last_change":"2024-04-26T10:25:17.278034+0000","last_active":"2024-04-26T10:25:17.278034+0000","last_peered":"2024-04-26T10:25:17.278034+0000","last_clean":"2024-04-26T10:25:17.278034+0000","last_became_active":"2024-04-26T10:24:22.535036+0000","last_became_peered":"2024-04-26T10:24:22.535036+0000","last_unstale":"2024-04-26T10:25:17.278034+0000","last_undegraded":"2024-04-26T10:25:17.278034+0000","last_fullsized":"2024-04-26T10:25:17.278034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-26T10:25:17.277726+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-26T10:25:17.277726+0000","last_clean_scrub_stamp":"2024-04-26T10:25:17.277726+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:30.647501+0000","scrub_duration":0.0033671420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:14.220039+0000","last_change":"2024-04-26T10:25:14.220039+0000","last_active":"2024-04-26T10:25:14.220039+0000","last_peered":"2024-04-26T10:25:14.220039+0000","last_clean":"2024-04-26T10:25:14.220039+0000","last_became_active":"2024-04-26T10:24:22.535562+0000","last_became_peered":"2024-04-26T10:24:22.535562+0000","last_unstale":"2024-04-26T10:25:14.220039+0000","last_undegraded":"2024-04-26T10:25:14.220039+0000","last_fullsized":"2024-04-26T10:25:14.220039+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:14.219757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:14.219757+0000","last_clean_scrub_stamp":"2024-04-26T10:25:14.219757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:48.012965+0000","scrub_duration":0.0030851279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:51.212563+0000","last_change":"2024-04-26T10:25:51.212833+0000","last_active":"2024-04-26T10:25:51.212563+0000","last_peered":"2024-04-26T10:25:51.212563+0000","last_clean":"2024-04-26T10:25:51.212563+0000","last_became_active":"2024-04-26T10:24:31.600121+0000","last_became_peered":"2024-04-26T10:24:31.600121+0000","last_unstale":"2024-04-26T10:25:51.212563+0000","last_undegraded":"2024-04-26T10:25:51.212563+0000","last_fullsized":"2024-04-26T10:25:51.212563+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-26T10:25:51.212513+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-26T10:25:51.212513+0000","last_clean_scrub_stamp":"2024-04-26T10:25:51.212513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:10.847443+0000","scrub_duration":0.0037555000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:43.675018+0000","last_change":"2024-04-26T10:24:22.542755+0000","last_active":"2024-04-26T10:24:43.675018+0000","last_peered":"2024-04-26T10:24:43.675018+0000","last_clean":"2024-04-26T10:24:43.675018+0000","last_became_active":"2024-04-26T10:24:22.541543+0000","last_became_peered":"2024-04-26T10:24:22.541543+0000","last_unstale":"2024-04-26T10:24:43.675018+0000","last_undegraded":"2024-04-26T10:24:43.675018+0000","last_fullsized":"2024-04-26T10:24:43.675018+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:21:08.902808+0000","last_clean_scrub_stamp":"2024-04-26T10:21:08.902808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"91'3","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:02.282898+0000","last_change":"2024-04-26T10:25:02.282898+0000","last_active":"2024-04-26T10:25:02.282898+0000","last_peered":"2024-04-26T10:25:02.282898+0000","last_clean":"2024-04-26T10:25:02.282898+0000","last_became_active":"2024-04-26T10:24:22.540767+0000","last_became_peered":"2024-04-26T10:24:22.540767+0000","last_unstale":"2024-04-26T10:25:02.282898+0000","last_undegraded":"2024-04-26T10:25:02.282898+0000","last_fullsized":"2024-04-26T10:25:02.282898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:02.282431+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:02.282431+0000","last_clean_scrub_stamp":"2024-04-26T10:25:02.282431+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:51.767663+0000","scrub_duration":0.0068591950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:04.207642+0000","last_change":"2024-04-26T10:25:04.207642+0000","last_active":"2024-04-26T10:25:04.207642+0000","last_peered":"2024-04-26T10:25:04.207642+0000","last_clean":"2024-04-26T10:25:04.207642+0000","last_became_active":"2024-04-26T10:24:22.546811+0000","last_became_peered":"2024-04-26T10:24:22.546811+0000","last_unstale":"2024-04-26T10:25:04.207642+0000","last_undegraded":"2024-04-26T10:25:04.207642+0000","last_fullsized":"2024-04-26T10:25:04.207642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:04.207258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:04.207258+0000","last_clean_scrub_stamp":"2024-04-26T10:25:04.207258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:28.549935+0000","scrub_duration":0.0033412889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"91'3","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:33.118265+0000","last_change":"2024-04-26T10:25:33.118265+0000","last_active":"2024-04-26T10:25:33.118265+0000","last_peered":"2024-04-26T10:25:33.118265+0000","last_clean":"2024-04-26T10:25:33.118265+0000","last_became_active":"2024-04-26T10:22:09.753211+0000","last_became_peered":"2024-04-26T10:22:09.753211+0000","last_unstale":"2024-04-26T10:25:33.118265+0000","last_undegraded":"2024-04-26T10:25:33.118265+0000","last_fullsized":"2024-04-26T10:25:33.118265+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:33.117975+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:33.117975+0000","last_clean_scrub_stamp":"2024-04-26T10:25:33.117975+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:48.526455+0000","scrub_duration":0.0059958340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:50.293783+0000","last_change":"2024-04-26T10:24:50.293998+0000","last_active":"2024-04-26T10:24:50.293783+0000","last_peered":"2024-04-26T10:24:50.293783+0000","last_clean":"2024-04-26T10:24:50.293783+0000","last_became_active":"2024-04-26T10:24:31.600088+0000","last_became_peered":"2024-04-26T10:24:31.600088+0000","last_unstale":"2024-04-26T10:24:50.293783+0000","last_undegraded":"2024-04-26T10:24:50.293783+0000","last_fullsized":"2024-04-26T10:24:50.293783+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:50.293726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:50.293726+0000","last_clean_scrub_stamp":"2024-04-26T10:24:50.293726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.398875+0000","scrub_duration":0.014652757000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:06.613576+0000","last_change":"2024-04-26T10:25:06.613576+0000","last_active":"2024-04-26T10:25:06.613576+0000","last_peered":"2024-04-26T10:25:06.613576+0000","last_clean":"2024-04-26T10:25:06.613576+0000","last_became_active":"2024-04-26T10:24:22.679652+0000","last_became_peered":"2024-04-26T10:24:22.679652+0000","last_unstale":"2024-04-26T10:25:06.613576+0000","last_undegraded":"2024-04-26T10:25:06.613576+0000","last_fullsized":"2024-04-26T10:25:06.613576+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-26T10:25:06.613222+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-26T10:25:06.613222+0000","last_clean_scrub_stamp":"2024-04-26T10:25:06.613222+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:12.597334+0000","scrub_duration":0.0032988710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:01.257447+0000","last_change":"2024-04-26T10:25:01.257447+0000","last_active":"2024-04-26T10:25:01.257447+0000","last_peered":"2024-04-26T10:25:01.257447+0000","last_clean":"2024-04-26T10:25:01.257447+0000","last_became_active":"2024-04-26T10:24:22.538895+0000","last_became_peered":"2024-04-26T10:24:22.538895+0000","last_unstale":"2024-04-26T10:25:01.257447+0000","last_undegraded":"2024-04-26T10:25:01.257447+0000","last_fullsized":"2024-04-26T10:25:01.257447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:01.257171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:01.257171+0000","last_clean_scrub_stamp":"2024-04-26T10:25:01.257171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:55.289475+0000","scrub_duration":0.0032699750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:03.668244+0000","last_change":"2024-04-26T10:25:03.668244+0000","last_active":"2024-04-26T10:25:03.668244+0000","last_peered":"2024-04-26T10:25:03.668244+0000","last_clean":"2024-04-26T10:25:03.668244+0000","last_became_active":"2024-04-26T10:24:22.684863+0000","last_became_peered":"2024-04-26T10:24:22.684863+0000","last_unstale":"2024-04-26T10:25:03.668244+0000","last_undegraded":"2024-04-26T10:25:03.668244+0000","last_fullsized":"2024-04-26T10:25:03.668244+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'6","last_scrub_stamp":"2024-04-26T10:25:03.667947+0000","last_deep_scrub":"91'6","last_deep_scrub_stamp":"2024-04-26T10:25:03.667947+0000","last_clean_scrub_stamp":"2024-04-26T10:25:03.667947+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:48.437612+0000","scrub_duration":0.0076333440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":21541,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673030,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262680,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94109160,"statfs":{"total":96636764160,"available":96367779840,"internally_reserved":0,"allocated":1064960,"data_stored":1035671,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59999999999999998,"15min":0.53200000000000003},"min":{"1min":0.47099999999999997,"5min":0.192,"15min":0.192},"max":{"1min":0.80100000000000005,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.47899999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.79600000000000004,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Fri Apr 26 10:26:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.59099999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.749,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69499999999999995,"15min":0.69699999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.754,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.58499999999999996}]}]},{"osd":0,"up_from":10,"seq":42949673029,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487472,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":486398,"kb_avail":93884368,"statfs":{"total":96636764160,"available":96137592832,"internally_reserved":0,"allocated":1089536,"data_stored":1036287,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":498072006},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.70399999999999996,"15min":0.58199999999999996},"min":{"1min":0.434,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.745,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.504,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.80400000000000005,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Apr 26 10:25:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.629},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.57599999999999996}]}]},{"osd":2,"up_from":80,"seq":343597383707,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38368,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":37369,"kb_avail":94333472,"statfs":{"total":96636764160,"available":96597475328,"internally_reserved":0,"allocated":1007616,"data_stored":444173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6879,"internal_metadata":38266145},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:26:24 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.58499999999999996,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60399999999999998,"15min":0.59899999999999998},"min":{"1min":0.52100000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Apr 26 10:26:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.60399999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.79700000000000004,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.66100000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.72799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:26:26.772 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:26:26.772 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:26:26.772 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:26:26.774 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-26T10:21:08.902808+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=4, tm_yday=117, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=10, tm_min=24, tm_sec=42, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T10:26:26.774 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T10:26:46.775 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T10:26:47.097 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:26:47.099 INFO:teuthology.orchestra.run.smithi052.stderr:dumped all 2024-04-26T10:26:47.109 INFO:teuthology.orchestra.run.smithi052.stdout:{"pg_ready":true,"pg_map":{"version":262,"stamp":"2024-04-26T10:26:46.089734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1184088,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":788520,"kb_used_data":3088,"kb_used_omap":9,"kb_used_meta":785398,"kb_avail":282327000,"statfs":{"total":289910292480,"available":289102848000,"internally_reserved":0,"allocated":3162112,"data_stored":2516131,"data_compressed":14075,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":10067,"internal_metadata":804247725},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004443"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:38.189928+0000","last_change":"2024-04-26T10:25:38.189928+0000","last_active":"2024-04-26T10:25:38.189928+0000","last_peered":"2024-04-26T10:25:38.189928+0000","last_clean":"2024-04-26T10:25:38.189928+0000","last_became_active":"2024-04-26T10:24:31.598170+0000","last_became_peered":"2024-04-26T10:24:31.598170+0000","last_unstale":"2024-04-26T10:25:38.189928+0000","last_undegraded":"2024-04-26T10:25:38.189928+0000","last_fullsized":"2024-04-26T10:25:38.189928+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:38.189795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:38.189795+0000","last_clean_scrub_stamp":"2024-04-26T10:25:38.189795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:40:47.271296+0000","scrub_duration":0.074777972999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:15.237609+0000","last_change":"2024-04-26T10:25:15.237609+0000","last_active":"2024-04-26T10:25:15.237609+0000","last_peered":"2024-04-26T10:25:15.237609+0000","last_clean":"2024-04-26T10:25:15.237609+0000","last_became_active":"2024-04-26T10:24:22.535998+0000","last_became_peered":"2024-04-26T10:24:22.535998+0000","last_unstale":"2024-04-26T10:25:15.237609+0000","last_undegraded":"2024-04-26T10:25:15.237609+0000","last_fullsized":"2024-04-26T10:25:15.237609+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:15.237328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:15.237328+0000","last_clean_scrub_stamp":"2024-04-26T10:25:15.237328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:35:09.529037+0000","scrub_duration":0.0032767389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":92,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:36.432847+0000","last_change":"2024-04-26T10:26:36.433083+0000","last_active":"2024-04-26T10:26:36.432847+0000","last_peered":"2024-04-26T10:26:36.432847+0000","last_clean":"2024-04-26T10:26:36.432847+0000","last_became_active":"2024-04-26T10:21:09.319552+0000","last_became_peered":"2024-04-26T10:21:09.319552+0000","last_unstale":"2024-04-26T10:26:36.432847+0000","last_undegraded":"2024-04-26T10:26:36.432847+0000","last_fullsized":"2024-04-26T10:26:36.432847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:36.432801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:36.432801+0000","last_clean_scrub_stamp":"2024-04-26T10:26:36.432801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:34:08.010643+0000","scrub_duration":0.0033207549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:17.164418+0000","last_change":"2024-04-26T10:26:17.164669+0000","last_active":"2024-04-26T10:26:17.164418+0000","last_peered":"2024-04-26T10:26:17.164418+0000","last_clean":"2024-04-26T10:26:17.164418+0000","last_became_active":"2024-04-26T10:24:22.548485+0000","last_became_peered":"2024-04-26T10:24:22.548485+0000","last_unstale":"2024-04-26T10:26:17.164418+0000","last_undegraded":"2024-04-26T10:26:17.164418+0000","last_fullsized":"2024-04-26T10:26:17.164418+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:17.164369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:17.164369+0000","last_clean_scrub_stamp":"2024-04-26T10:26:17.164369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:45:45.402486+0000","scrub_duration":0.003388364,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:00.289761+0000","last_change":"2024-04-26T10:25:00.290012+0000","last_active":"2024-04-26T10:25:00.289761+0000","last_peered":"2024-04-26T10:25:00.289761+0000","last_clean":"2024-04-26T10:25:00.289761+0000","last_became_active":"2024-04-26T10:24:31.600986+0000","last_became_peered":"2024-04-26T10:24:31.600986+0000","last_unstale":"2024-04-26T10:25:00.289761+0000","last_undegraded":"2024-04-26T10:25:00.289761+0000","last_fullsized":"2024-04-26T10:25:00.289761+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:00.289706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:00.289706+0000","last_clean_scrub_stamp":"2024-04-26T10:25:00.289706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:11:20.178292+0000","scrub_duration":0.015595131999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:52.225492+0000","last_change":"2024-04-26T10:24:52.225492+0000","last_active":"2024-04-26T10:24:52.225492+0000","last_peered":"2024-04-26T10:24:52.225492+0000","last_clean":"2024-04-26T10:24:52.225492+0000","last_became_active":"2024-04-26T10:24:22.547731+0000","last_became_peered":"2024-04-26T10:24:22.547731+0000","last_unstale":"2024-04-26T10:24:52.225492+0000","last_undegraded":"2024-04-26T10:24:52.225492+0000","last_fullsized":"2024-04-26T10:24:52.225492+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:52.225191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:52.225191+0000","last_clean_scrub_stamp":"2024-04-26T10:24:52.225191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:49:05.446400+0000","scrub_duration":0.003307118,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:46.143361+0000","last_change":"2024-04-26T10:24:46.143361+0000","last_active":"2024-04-26T10:24:46.143361+0000","last_peered":"2024-04-26T10:24:46.143361+0000","last_clean":"2024-04-26T10:24:46.143361+0000","last_became_active":"2024-04-26T10:24:22.549180+0000","last_became_peered":"2024-04-26T10:24:22.549180+0000","last_unstale":"2024-04-26T10:24:46.143361+0000","last_undegraded":"2024-04-26T10:24:46.143361+0000","last_fullsized":"2024-04-26T10:24:46.143361+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:46.142953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:46.142953+0000","last_clean_scrub_stamp":"2024-04-26T10:24:46.142953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:01:47.298765+0000","scrub_duration":0.014784434000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:30.314161+0000","last_change":"2024-04-26T10:26:30.314461+0000","last_active":"2024-04-26T10:26:30.314161+0000","last_peered":"2024-04-26T10:26:30.314161+0000","last_clean":"2024-04-26T10:26:30.314161+0000","last_became_active":"2024-04-26T10:24:22.547284+0000","last_became_peered":"2024-04-26T10:24:22.547284+0000","last_unstale":"2024-04-26T10:26:30.314161+0000","last_undegraded":"2024-04-26T10:26:30.314161+0000","last_fullsized":"2024-04-26T10:26:30.314161+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:30.314113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:30.314113+0000","last_clean_scrub_stamp":"2024-04-26T10:26:30.314113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:31:41.608671+0000","scrub_duration":0.0032711229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:56.807646+0000","last_change":"2024-04-26T10:24:56.807646+0000","last_active":"2024-04-26T10:24:56.807646+0000","last_peered":"2024-04-26T10:24:56.807646+0000","last_clean":"2024-04-26T10:24:56.807646+0000","last_became_active":"2024-04-26T10:24:22.679648+0000","last_became_peered":"2024-04-26T10:24:22.679648+0000","last_unstale":"2024-04-26T10:24:56.807646+0000","last_undegraded":"2024-04-26T10:24:56.807646+0000","last_fullsized":"2024-04-26T10:24:56.807646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:56.807510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:56.807510+0000","last_clean_scrub_stamp":"2024-04-26T10:24:56.807510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:16:24.720449+0000","scrub_duration":0.029714911,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:04.256728+0000","last_change":"2024-04-26T10:25:04.256968+0000","last_active":"2024-04-26T10:25:04.256728+0000","last_peered":"2024-04-26T10:25:04.256728+0000","last_clean":"2024-04-26T10:25:04.256728+0000","last_became_active":"2024-04-26T10:24:31.598187+0000","last_became_peered":"2024-04-26T10:24:31.598187+0000","last_unstale":"2024-04-26T10:25:04.256728+0000","last_undegraded":"2024-04-26T10:25:04.256728+0000","last_fullsized":"2024-04-26T10:25:04.256728+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:04.256683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:04.256683+0000","last_clean_scrub_stamp":"2024-04-26T10:25:04.256683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:04:01.571431+0000","scrub_duration":0.0034188460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:33.390051+0000","last_change":"2024-04-26T10:26:33.390297+0000","last_active":"2024-04-26T10:26:33.390051+0000","last_peered":"2024-04-26T10:26:33.390051+0000","last_clean":"2024-04-26T10:26:33.390051+0000","last_became_active":"2024-04-26T10:24:22.546506+0000","last_became_peered":"2024-04-26T10:24:22.546506+0000","last_unstale":"2024-04-26T10:26:33.390051+0000","last_undegraded":"2024-04-26T10:26:33.390051+0000","last_fullsized":"2024-04-26T10:26:33.390051+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:33.389974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:33.389974+0000","last_clean_scrub_stamp":"2024-04-26T10:26:33.389974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:50:46.417753+0000","scrub_duration":0.014482577999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:56.280129+0000","last_change":"2024-04-26T10:24:56.280129+0000","last_active":"2024-04-26T10:24:56.280129+0000","last_peered":"2024-04-26T10:24:56.280129+0000","last_clean":"2024-04-26T10:24:56.280129+0000","last_became_active":"2024-04-26T10:22:09.747822+0000","last_became_peered":"2024-04-26T10:22:09.747822+0000","last_unstale":"2024-04-26T10:24:56.280129+0000","last_undegraded":"2024-04-26T10:24:56.280129+0000","last_fullsized":"2024-04-26T10:24:56.280129+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:56.279865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:56.279865+0000","last_clean_scrub_stamp":"2024-04-26T10:24:56.279865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:18:56.107536+0000","scrub_duration":0.0031183439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:09.228824+0000","last_change":"2024-04-26T10:25:09.229056+0000","last_active":"2024-04-26T10:25:09.228824+0000","last_peered":"2024-04-26T10:25:09.228824+0000","last_clean":"2024-04-26T10:25:09.228824+0000","last_became_active":"2024-04-26T10:24:31.597980+0000","last_became_peered":"2024-04-26T10:24:31.597980+0000","last_unstale":"2024-04-26T10:25:09.228824+0000","last_undegraded":"2024-04-26T10:25:09.228824+0000","last_fullsized":"2024-04-26T10:25:09.228824+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:09.228760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:09.228760+0000","last_clean_scrub_stamp":"2024-04-26T10:25:09.228760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T22:18:16.641297+0000","scrub_duration":0.01109303,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:53.201710+0000","last_change":"2024-04-26T10:24:53.201710+0000","last_active":"2024-04-26T10:24:53.201710+0000","last_peered":"2024-04-26T10:24:53.201710+0000","last_clean":"2024-04-26T10:24:53.201710+0000","last_became_active":"2024-04-26T10:24:31.602539+0000","last_became_peered":"2024-04-26T10:24:31.602539+0000","last_unstale":"2024-04-26T10:24:53.201710+0000","last_undegraded":"2024-04-26T10:24:53.201710+0000","last_fullsized":"2024-04-26T10:24:53.201710+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:53.201431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:53.201431+0000","last_clean_scrub_stamp":"2024-04-26T10:24:53.201431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:31.514894+0000","scrub_duration":0.0033374949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:00.222988+0000","last_change":"2024-04-26T10:25:00.222988+0000","last_active":"2024-04-26T10:25:00.222988+0000","last_peered":"2024-04-26T10:25:00.222988+0000","last_clean":"2024-04-26T10:25:00.222988+0000","last_became_active":"2024-04-26T10:24:31.602453+0000","last_became_peered":"2024-04-26T10:24:31.602453+0000","last_unstale":"2024-04-26T10:25:00.222988+0000","last_undegraded":"2024-04-26T10:25:00.222988+0000","last_fullsized":"2024-04-26T10:25:00.222988+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:00.222698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:00.222698+0000","last_clean_scrub_stamp":"2024-04-26T10:25:00.222698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:45.583919+0000","scrub_duration":0.0030823560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:21.272106+0000","last_change":"2024-04-26T10:26:21.272377+0000","last_active":"2024-04-26T10:26:21.272106+0000","last_peered":"2024-04-26T10:26:21.272106+0000","last_clean":"2024-04-26T10:26:21.272106+0000","last_became_active":"2024-04-26T10:24:22.546856+0000","last_became_peered":"2024-04-26T10:24:22.546856+0000","last_unstale":"2024-04-26T10:26:21.272106+0000","last_undegraded":"2024-04-26T10:26:21.272106+0000","last_fullsized":"2024-04-26T10:26:21.272106+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:21.272060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:21.272060+0000","last_clean_scrub_stamp":"2024-04-26T10:26:21.272060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:59:32.283263+0000","scrub_duration":0.0032835529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:34.846363+0000","last_change":"2024-04-26T10:25:34.846363+0000","last_active":"2024-04-26T10:25:34.846363+0000","last_peered":"2024-04-26T10:25:34.846363+0000","last_clean":"2024-04-26T10:25:34.846363+0000","last_became_active":"2024-04-26T10:24:22.679350+0000","last_became_peered":"2024-04-26T10:24:22.679350+0000","last_unstale":"2024-04-26T10:25:34.846363+0000","last_undegraded":"2024-04-26T10:25:34.846363+0000","last_fullsized":"2024-04-26T10:25:34.846363+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:34.846164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:34.846164+0000","last_clean_scrub_stamp":"2024-04-26T10:25:34.846164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:35:48.771890+0000","scrub_duration":0.052228093000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:36.161111+0000","last_change":"2024-04-26T10:25:36.161340+0000","last_active":"2024-04-26T10:25:36.161111+0000","last_peered":"2024-04-26T10:25:36.161111+0000","last_clean":"2024-04-26T10:25:36.161111+0000","last_became_active":"2024-04-26T10:24:31.597563+0000","last_became_peered":"2024-04-26T10:24:31.597563+0000","last_unstale":"2024-04-26T10:25:36.161111+0000","last_undegraded":"2024-04-26T10:25:36.161111+0000","last_fullsized":"2024-04-26T10:25:36.161111+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:36.161060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:36.161060+0000","last_clean_scrub_stamp":"2024-04-26T10:25:36.161060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:25:55.224036+0000","scrub_duration":0.003288694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:22.717781+0000","last_change":"2024-04-26T10:25:22.717781+0000","last_active":"2024-04-26T10:25:22.717781+0000","last_peered":"2024-04-26T10:25:22.717781+0000","last_clean":"2024-04-26T10:25:22.717781+0000","last_became_active":"2024-04-26T10:24:22.678912+0000","last_became_peered":"2024-04-26T10:24:22.678912+0000","last_unstale":"2024-04-26T10:25:22.717781+0000","last_undegraded":"2024-04-26T10:25:22.717781+0000","last_fullsized":"2024-04-26T10:25:22.717781+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:22.717652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:22.717652+0000","last_clean_scrub_stamp":"2024-04-26T10:25:22.717652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:41:29.694277+0000","scrub_duration":0.017936198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:11.297872+0000","last_change":"2024-04-26T10:26:11.298292+0000","last_active":"2024-04-26T10:26:11.297872+0000","last_peered":"2024-04-26T10:26:11.297872+0000","last_clean":"2024-04-26T10:26:11.297872+0000","last_became_active":"2024-04-26T10:24:22.546052+0000","last_became_peered":"2024-04-26T10:24:22.546052+0000","last_unstale":"2024-04-26T10:26:11.297872+0000","last_undegraded":"2024-04-26T10:26:11.297872+0000","last_fullsized":"2024-04-26T10:26:11.297872+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:11.297782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:11.297782+0000","last_clean_scrub_stamp":"2024-04-26T10:26:11.297782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:34:31.203553+0000","scrub_duration":0.0031962520000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:08.292897+0000","last_change":"2024-04-26T10:25:08.292897+0000","last_active":"2024-04-26T10:25:08.292897+0000","last_peered":"2024-04-26T10:25:08.292897+0000","last_clean":"2024-04-26T10:25:08.292897+0000","last_became_active":"2024-04-26T10:24:22.547663+0000","last_became_peered":"2024-04-26T10:24:22.547663+0000","last_unstale":"2024-04-26T10:25:08.292897+0000","last_undegraded":"2024-04-26T10:25:08.292897+0000","last_fullsized":"2024-04-26T10:25:08.292897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:08.292772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:08.292772+0000","last_clean_scrub_stamp":"2024-04-26T10:25:08.292772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:56:35.112407+0000","scrub_duration":0.038060340999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:01.324901+0000","last_change":"2024-04-26T10:25:01.324901+0000","last_active":"2024-04-26T10:25:01.324901+0000","last_peered":"2024-04-26T10:25:01.324901+0000","last_clean":"2024-04-26T10:25:01.324901+0000","last_became_active":"2024-04-26T10:22:09.748755+0000","last_became_peered":"2024-04-26T10:22:09.748755+0000","last_unstale":"2024-04-26T10:25:01.324901+0000","last_undegraded":"2024-04-26T10:25:01.324901+0000","last_fullsized":"2024-04-26T10:25:01.324901+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:01.324527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:01.324527+0000","last_clean_scrub_stamp":"2024-04-26T10:25:01.324527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:52:42.317619+0000","scrub_duration":0.0030479109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:31.855451+0000","last_change":"2024-04-26T10:25:31.855451+0000","last_active":"2024-04-26T10:25:31.855451+0000","last_peered":"2024-04-26T10:25:31.855451+0000","last_clean":"2024-04-26T10:25:31.855451+0000","last_became_active":"2024-04-26T10:24:22.683921+0000","last_became_peered":"2024-04-26T10:24:22.683921+0000","last_unstale":"2024-04-26T10:25:31.855451+0000","last_undegraded":"2024-04-26T10:25:31.855451+0000","last_fullsized":"2024-04-26T10:25:31.855451+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:31.855041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:31.855041+0000","last_clean_scrub_stamp":"2024-04-26T10:25:31.855041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:04:04.764581+0000","scrub_duration":0.003368359,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:22.231749+0000","last_change":"2024-04-26T10:25:22.231749+0000","last_active":"2024-04-26T10:25:22.231749+0000","last_peered":"2024-04-26T10:25:22.231749+0000","last_clean":"2024-04-26T10:25:22.231749+0000","last_became_active":"2024-04-26T10:24:22.534674+0000","last_became_peered":"2024-04-26T10:24:22.534674+0000","last_unstale":"2024-04-26T10:25:22.231749+0000","last_undegraded":"2024-04-26T10:25:22.231749+0000","last_fullsized":"2024-04-26T10:25:22.231749+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:22.231415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:22.231415+0000","last_clean_scrub_stamp":"2024-04-26T10:25:22.231415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:30:27.733690+0000","scrub_duration":0.0033621749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:48.293911+0000","last_change":"2024-04-26T10:24:48.293911+0000","last_active":"2024-04-26T10:24:48.293911+0000","last_peered":"2024-04-26T10:24:48.293911+0000","last_clean":"2024-04-26T10:24:48.293911+0000","last_became_active":"2024-04-26T10:24:31.600815+0000","last_became_peered":"2024-04-26T10:24:31.600815+0000","last_unstale":"2024-04-26T10:24:48.293911+0000","last_undegraded":"2024-04-26T10:24:48.293911+0000","last_fullsized":"2024-04-26T10:24:48.293911+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:48.293774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:48.293774+0000","last_clean_scrub_stamp":"2024-04-26T10:24:48.293774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:13:51.595218+0000","scrub_duration":0.058713007999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:51.769593+0000","last_change":"2024-04-26T10:24:51.769593+0000","last_active":"2024-04-26T10:24:51.769593+0000","last_peered":"2024-04-26T10:24:51.769593+0000","last_clean":"2024-04-26T10:24:51.769593+0000","last_became_active":"2024-04-26T10:24:22.683959+0000","last_became_peered":"2024-04-26T10:24:22.683959+0000","last_unstale":"2024-04-26T10:24:51.769593+0000","last_undegraded":"2024-04-26T10:24:51.769593+0000","last_fullsized":"2024-04-26T10:24:51.769593+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:51.769321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:51.769321+0000","last_clean_scrub_stamp":"2024-04-26T10:24:51.769321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:19:05.665068+0000","scrub_duration":0.003275011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":92,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:23.297456+0000","last_change":"2024-04-26T10:26:23.297721+0000","last_active":"2024-04-26T10:26:23.297456+0000","last_peered":"2024-04-26T10:26:23.297456+0000","last_clean":"2024-04-26T10:26:23.297456+0000","last_became_active":"2024-04-26T10:21:09.315636+0000","last_became_peered":"2024-04-26T10:21:09.315636+0000","last_unstale":"2024-04-26T10:26:23.297456+0000","last_undegraded":"2024-04-26T10:26:23.297456+0000","last_fullsized":"2024-04-26T10:26:23.297456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:23.297406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:23.297406+0000","last_clean_scrub_stamp":"2024-04-26T10:26:23.297406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:24:39.677599+0000","scrub_duration":0.0032507930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:53.260900+0000","last_change":"2024-04-26T10:25:53.260900+0000","last_active":"2024-04-26T10:25:53.260900+0000","last_peered":"2024-04-26T10:25:53.260900+0000","last_clean":"2024-04-26T10:25:53.260900+0000","last_became_active":"2024-04-26T10:24:31.601299+0000","last_became_peered":"2024-04-26T10:24:31.601299+0000","last_unstale":"2024-04-26T10:25:53.260900+0000","last_undegraded":"2024-04-26T10:25:53.260900+0000","last_fullsized":"2024-04-26T10:25:53.260900+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:53.260529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:53.260529+0000","last_clean_scrub_stamp":"2024-04-26T10:25:53.260529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:12:40.287907+0000","scrub_duration":0.003123584,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:40.887406+0000","last_change":"2024-04-26T10:25:40.887406+0000","last_active":"2024-04-26T10:25:40.887406+0000","last_peered":"2024-04-26T10:25:40.887406+0000","last_clean":"2024-04-26T10:25:40.887406+0000","last_became_active":"2024-04-26T10:24:31.740626+0000","last_became_peered":"2024-04-26T10:24:31.740626+0000","last_unstale":"2024-04-26T10:25:40.887406+0000","last_undegraded":"2024-04-26T10:25:40.887406+0000","last_fullsized":"2024-04-26T10:25:40.887406+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:40.887274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:40.887274+0000","last_clean_scrub_stamp":"2024-04-26T10:25:40.887274+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:31:03.140762+0000","scrub_duration":0.017197324,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:31.074103+0000","last_change":"2024-04-26T10:25:31.074332+0000","last_active":"2024-04-26T10:25:31.074103+0000","last_peered":"2024-04-26T10:25:31.074103+0000","last_clean":"2024-04-26T10:25:31.074103+0000","last_became_active":"2024-04-26T10:22:09.750286+0000","last_became_peered":"2024-04-26T10:22:09.750286+0000","last_unstale":"2024-04-26T10:25:31.074103+0000","last_undegraded":"2024-04-26T10:25:31.074103+0000","last_fullsized":"2024-04-26T10:25:31.074103+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:31.074058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:31.074058+0000","last_clean_scrub_stamp":"2024-04-26T10:25:31.074058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:16:39.699950+0000","scrub_duration":0.003248187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:01.978857+0000","last_change":"2024-04-26T10:26:01.978857+0000","last_active":"2024-04-26T10:26:01.978857+0000","last_peered":"2024-04-26T10:26:01.978857+0000","last_clean":"2024-04-26T10:26:01.978857+0000","last_became_active":"2024-04-26T10:24:31.740518+0000","last_became_peered":"2024-04-26T10:24:31.740518+0000","last_unstale":"2024-04-26T10:26:01.978857+0000","last_undegraded":"2024-04-26T10:26:01.978857+0000","last_fullsized":"2024-04-26T10:26:01.978857+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:01.978406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:01.978406+0000","last_clean_scrub_stamp":"2024-04-26T10:26:01.978406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:58:52.163295+0000","scrub_duration":0.0033284709999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:44.170604+0000","last_change":"2024-04-26T10:24:44.170604+0000","last_active":"2024-04-26T10:24:44.170604+0000","last_peered":"2024-04-26T10:24:44.170604+0000","last_clean":"2024-04-26T10:24:44.170604+0000","last_became_active":"2024-04-26T10:24:22.539106+0000","last_became_peered":"2024-04-26T10:24:22.539106+0000","last_unstale":"2024-04-26T10:24:44.170604+0000","last_undegraded":"2024-04-26T10:24:44.170604+0000","last_fullsized":"2024-04-26T10:24:44.170604+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:44.170151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:44.170151+0000","last_clean_scrub_stamp":"2024-04-26T10:24:44.170151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:52.109209+0000","scrub_duration":0.010234752,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:54.298622+0000","last_change":"2024-04-26T10:25:54.298852+0000","last_active":"2024-04-26T10:25:54.298622+0000","last_peered":"2024-04-26T10:25:54.298622+0000","last_clean":"2024-04-26T10:25:54.298622+0000","last_became_active":"2024-04-26T10:24:31.598307+0000","last_became_peered":"2024-04-26T10:24:31.598307+0000","last_unstale":"2024-04-26T10:25:54.298622+0000","last_undegraded":"2024-04-26T10:25:54.298622+0000","last_fullsized":"2024-04-26T10:25:54.298622+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:54.298577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:54.298577+0000","last_clean_scrub_stamp":"2024-04-26T10:25:54.298577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:27:13.596052+0000","scrub_duration":0.0031942189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"91'4","reported_seq":110,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:34.241275+0000","last_change":"2024-04-26T10:25:34.241275+0000","last_active":"2024-04-26T10:25:34.241275+0000","last_peered":"2024-04-26T10:25:34.241275+0000","last_clean":"2024-04-26T10:25:34.241275+0000","last_became_active":"2024-04-26T10:24:22.546794+0000","last_became_peered":"2024-04-26T10:24:22.546794+0000","last_unstale":"2024-04-26T10:25:34.241275+0000","last_undegraded":"2024-04-26T10:25:34.241275+0000","last_fullsized":"2024-04-26T10:25:34.241275+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'4","last_scrub_stamp":"2024-04-26T10:25:34.240988+0000","last_deep_scrub":"91'4","last_deep_scrub_stamp":"2024-04-26T10:25:34.240988+0000","last_clean_scrub_stamp":"2024-04-26T10:25:34.240988+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:09.512473+0000","scrub_duration":0.0082918269999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:47.236229+0000","last_change":"2024-04-26T10:24:47.236463+0000","last_active":"2024-04-26T10:24:47.236229+0000","last_peered":"2024-04-26T10:24:47.236229+0000","last_clean":"2024-04-26T10:24:47.236229+0000","last_became_active":"2024-04-26T10:24:31.596297+0000","last_became_peered":"2024-04-26T10:24:31.596297+0000","last_unstale":"2024-04-26T10:24:47.236229+0000","last_undegraded":"2024-04-26T10:24:47.236229+0000","last_fullsized":"2024-04-26T10:24:47.236229+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:47.236175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:47.236175+0000","last_clean_scrub_stamp":"2024-04-26T10:24:47.236175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:39:31.442660+0000","scrub_duration":0.014903458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:12.635350+0000","last_change":"2024-04-26T10:25:12.635350+0000","last_active":"2024-04-26T10:25:12.635350+0000","last_peered":"2024-04-26T10:25:12.635350+0000","last_clean":"2024-04-26T10:25:12.635350+0000","last_became_active":"2024-04-26T10:24:22.684541+0000","last_became_peered":"2024-04-26T10:24:22.684541+0000","last_unstale":"2024-04-26T10:25:12.635350+0000","last_undegraded":"2024-04-26T10:25:12.635350+0000","last_fullsized":"2024-04-26T10:25:12.635350+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:12.635057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:12.635057+0000","last_clean_scrub_stamp":"2024-04-26T10:25:12.635057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:40.868547+0000","scrub_duration":0.0035574059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:33.793857+0000","last_change":"2024-04-26T10:25:33.793857+0000","last_active":"2024-04-26T10:25:33.793857+0000","last_peered":"2024-04-26T10:25:33.793857+0000","last_clean":"2024-04-26T10:25:33.793857+0000","last_became_active":"2024-04-26T10:24:22.682650+0000","last_became_peered":"2024-04-26T10:24:22.682650+0000","last_unstale":"2024-04-26T10:25:33.793857+0000","last_undegraded":"2024-04-26T10:25:33.793857+0000","last_fullsized":"2024-04-26T10:25:33.793857+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:33.793569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:33.793569+0000","last_clean_scrub_stamp":"2024-04-26T10:25:33.793569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:42:31.145665+0000","scrub_duration":0.0030047139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:34.094073+0000","last_change":"2024-04-26T10:25:34.094279+0000","last_active":"2024-04-26T10:25:34.094073+0000","last_peered":"2024-04-26T10:25:34.094073+0000","last_clean":"2024-04-26T10:25:34.094073+0000","last_became_active":"2024-04-26T10:24:31.601091+0000","last_became_peered":"2024-04-26T10:24:31.601091+0000","last_unstale":"2024-04-26T10:25:34.094073+0000","last_undegraded":"2024-04-26T10:25:34.094073+0000","last_fullsized":"2024-04-26T10:25:34.094073+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:34.094025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:34.094025+0000","last_clean_scrub_stamp":"2024-04-26T10:25:34.094025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:10:48.013784+0000","scrub_duration":0.003459784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:08.712611+0000","last_change":"2024-04-26T10:25:08.712611+0000","last_active":"2024-04-26T10:25:08.712611+0000","last_peered":"2024-04-26T10:25:08.712611+0000","last_clean":"2024-04-26T10:25:08.712611+0000","last_became_active":"2024-04-26T10:24:22.684213+0000","last_became_peered":"2024-04-26T10:24:22.684213+0000","last_unstale":"2024-04-26T10:25:08.712611+0000","last_undegraded":"2024-04-26T10:25:08.712611+0000","last_fullsized":"2024-04-26T10:25:08.712611+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:08.712479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:08.712479+0000","last_clean_scrub_stamp":"2024-04-26T10:25:08.712479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:07:22.971123+0000","scrub_duration":0.069345404999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"91'12","reported_seq":151,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:27.254757+0000","last_change":"2024-04-26T10:25:27.254757+0000","last_active":"2024-04-26T10:25:27.254757+0000","last_peered":"2024-04-26T10:25:27.254757+0000","last_clean":"2024-04-26T10:25:27.254757+0000","last_became_active":"2024-04-26T10:24:31.604402+0000","last_became_peered":"2024-04-26T10:24:31.604402+0000","last_unstale":"2024-04-26T10:25:27.254757+0000","last_undegraded":"2024-04-26T10:25:27.254757+0000","last_fullsized":"2024-04-26T10:25:27.254757+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'12","last_scrub_stamp":"2024-04-26T10:25:27.254465+0000","last_deep_scrub":"91'12","last_deep_scrub_stamp":"2024-04-26T10:25:27.254465+0000","last_clean_scrub_stamp":"2024-04-26T10:25:27.254465+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:32:52.325925+0000","scrub_duration":0.0093417299999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"91'2","reported_seq":129,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:36.183977+0000","last_change":"2024-04-26T10:25:36.183977+0000","last_active":"2024-04-26T10:25:36.183977+0000","last_peered":"2024-04-26T10:25:36.183977+0000","last_clean":"2024-04-26T10:25:36.183977+0000","last_became_active":"2024-04-26T10:24:31.604744+0000","last_became_peered":"2024-04-26T10:24:31.604744+0000","last_unstale":"2024-04-26T10:25:36.183977+0000","last_undegraded":"2024-04-26T10:25:36.183977+0000","last_fullsized":"2024-04-26T10:25:36.183977+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-04-26T10:25:36.183521+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-04-26T10:25:36.183521+0000","last_clean_scrub_stamp":"2024-04-26T10:25:36.183521+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:14:59.590522+0000","scrub_duration":0.0073008739999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":44,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:52.312203+0000","last_change":"2024-04-26T10:24:52.312203+0000","last_active":"2024-04-26T10:24:52.312203+0000","last_peered":"2024-04-26T10:24:52.312203+0000","last_clean":"2024-04-26T10:24:52.312203+0000","last_became_active":"2024-04-26T10:22:09.749862+0000","last_became_peered":"2024-04-26T10:22:09.749862+0000","last_unstale":"2024-04-26T10:24:52.312203+0000","last_undegraded":"2024-04-26T10:24:52.312203+0000","last_fullsized":"2024-04-26T10:24:52.312203+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:52.311773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:52.311773+0000","last_clean_scrub_stamp":"2024-04-26T10:24:52.311773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:59:12.624461+0000","scrub_duration":0.0034835349999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"91'3","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:13.197344+0000","last_change":"2024-04-26T10:25:13.197344+0000","last_active":"2024-04-26T10:25:13.197344+0000","last_peered":"2024-04-26T10:25:13.197344+0000","last_clean":"2024-04-26T10:25:13.197344+0000","last_became_active":"2024-04-26T10:22:09.749852+0000","last_became_peered":"2024-04-26T10:22:09.749852+0000","last_unstale":"2024-04-26T10:25:13.197344+0000","last_undegraded":"2024-04-26T10:25:13.197344+0000","last_fullsized":"2024-04-26T10:25:13.197344+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:13.197045+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:13.197045+0000","last_clean_scrub_stamp":"2024-04-26T10:25:13.197045+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:26:01.578169+0000","scrub_duration":0.0064724919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:48.165132+0000","last_change":"2024-04-26T10:25:48.165132+0000","last_active":"2024-04-26T10:25:48.165132+0000","last_peered":"2024-04-26T10:25:48.165132+0000","last_clean":"2024-04-26T10:25:48.165132+0000","last_became_active":"2024-04-26T10:24:31.596335+0000","last_became_peered":"2024-04-26T10:24:31.596335+0000","last_unstale":"2024-04-26T10:25:48.165132+0000","last_undegraded":"2024-04-26T10:25:48.165132+0000","last_fullsized":"2024-04-26T10:25:48.165132+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:48.164842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:48.164842+0000","last_clean_scrub_stamp":"2024-04-26T10:25:48.164842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:36:27.230715+0000","scrub_duration":0.0031925389999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"91'2","reported_seq":95,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:42.239060+0000","last_change":"2024-04-26T10:25:42.239422+0000","last_active":"2024-04-26T10:25:42.239060+0000","last_peered":"2024-04-26T10:25:42.239060+0000","last_clean":"2024-04-26T10:25:42.239060+0000","last_became_active":"2024-04-26T10:21:08.934693+0000","last_became_peered":"2024-04-26T10:21:08.934693+0000","last_unstale":"2024-04-26T10:25:42.239060+0000","last_undegraded":"2024-04-26T10:25:42.239060+0000","last_fullsized":"2024-04-26T10:25:42.239060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-04-26T10:25:42.238933+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-04-26T10:25:42.238933+0000","last_clean_scrub_stamp":"2024-04-26T10:25:42.238933+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:28:18.940962+0000","scrub_duration":0.0070962710000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:35.198370+0000","last_change":"2024-04-26T10:25:35.198666+0000","last_active":"2024-04-26T10:25:35.198370+0000","last_peered":"2024-04-26T10:25:35.198370+0000","last_clean":"2024-04-26T10:25:35.198370+0000","last_became_active":"2024-04-26T10:24:22.549230+0000","last_became_peered":"2024-04-26T10:24:22.549230+0000","last_unstale":"2024-04-26T10:25:35.198370+0000","last_undegraded":"2024-04-26T10:25:35.198370+0000","last_fullsized":"2024-04-26T10:25:35.198370+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:35.198322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:35.198322+0000","last_clean_scrub_stamp":"2024-04-26T10:25:35.198322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:35:02.241610+0000","scrub_duration":0.0034907969999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:50.245134+0000","last_change":"2024-04-26T10:25:50.245370+0000","last_active":"2024-04-26T10:25:50.245134+0000","last_peered":"2024-04-26T10:25:50.245134+0000","last_clean":"2024-04-26T10:25:50.245134+0000","last_became_active":"2024-04-26T10:24:22.540611+0000","last_became_peered":"2024-04-26T10:24:22.540611+0000","last_unstale":"2024-04-26T10:25:50.245134+0000","last_undegraded":"2024-04-26T10:25:50.245134+0000","last_fullsized":"2024-04-26T10:25:50.245134+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:50.245085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:50.245085+0000","last_clean_scrub_stamp":"2024-04-26T10:25:50.245085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:13:22.376739+0000","scrub_duration":0.003113513,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:10.703884+0000","last_change":"2024-04-26T10:25:10.703884+0000","last_active":"2024-04-26T10:25:10.703884+0000","last_peered":"2024-04-26T10:25:10.703884+0000","last_clean":"2024-04-26T10:25:10.703884+0000","last_became_active":"2024-04-26T10:24:22.686841+0000","last_became_peered":"2024-04-26T10:24:22.686841+0000","last_unstale":"2024-04-26T10:25:10.703884+0000","last_undegraded":"2024-04-26T10:25:10.703884+0000","last_fullsized":"2024-04-26T10:25:10.703884+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:10.703715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:10.703715+0000","last_clean_scrub_stamp":"2024-04-26T10:25:10.703715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:11:08.356723+0000","scrub_duration":0.01785925,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'3","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:02.685404+0000","last_change":"2024-04-26T10:25:02.685404+0000","last_active":"2024-04-26T10:25:02.685404+0000","last_peered":"2024-04-26T10:25:02.685404+0000","last_clean":"2024-04-26T10:25:02.685404+0000","last_became_active":"2024-04-26T10:24:22.686846+0000","last_became_peered":"2024-04-26T10:24:22.686846+0000","last_unstale":"2024-04-26T10:25:02.685404+0000","last_undegraded":"2024-04-26T10:25:02.685404+0000","last_fullsized":"2024-04-26T10:25:02.685404+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:02.685093+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:02.685093+0000","last_clean_scrub_stamp":"2024-04-26T10:25:02.685093+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:32:29.685511+0000","scrub_duration":0.0064629550000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:32.237246+0000","last_change":"2024-04-26T10:25:32.237246+0000","last_active":"2024-04-26T10:25:32.237246+0000","last_peered":"2024-04-26T10:25:32.237246+0000","last_clean":"2024-04-26T10:25:32.237246+0000","last_became_active":"2024-04-26T10:24:22.545616+0000","last_became_peered":"2024-04-26T10:24:22.545616+0000","last_unstale":"2024-04-26T10:25:32.237246+0000","last_undegraded":"2024-04-26T10:25:32.237246+0000","last_fullsized":"2024-04-26T10:25:32.237246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:32.236967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:32.236967+0000","last_clean_scrub_stamp":"2024-04-26T10:25:32.236967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:54:18.701998+0000","scrub_duration":0.0034163280000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:10.308591+0000","last_change":"2024-04-26T10:26:10.308845+0000","last_active":"2024-04-26T10:26:10.308591+0000","last_peered":"2024-04-26T10:26:10.308591+0000","last_clean":"2024-04-26T10:26:10.308591+0000","last_became_active":"2024-04-26T10:24:22.538982+0000","last_became_peered":"2024-04-26T10:24:22.538982+0000","last_unstale":"2024-04-26T10:26:10.308591+0000","last_undegraded":"2024-04-26T10:26:10.308591+0000","last_fullsized":"2024-04-26T10:26:10.308591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:10.308540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:10.308540+0000","last_clean_scrub_stamp":"2024-04-26T10:26:10.308540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:45:10.400365+0000","scrub_duration":0.0031209660000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":92,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:49.285356+0000","last_change":"2024-04-26T10:25:49.285724+0000","last_active":"2024-04-26T10:25:49.285356+0000","last_peered":"2024-04-26T10:25:49.285356+0000","last_clean":"2024-04-26T10:25:49.285356+0000","last_became_active":"2024-04-26T10:21:09.319962+0000","last_became_peered":"2024-04-26T10:21:09.319962+0000","last_unstale":"2024-04-26T10:25:49.285356+0000","last_undegraded":"2024-04-26T10:25:49.285356+0000","last_fullsized":"2024-04-26T10:25:49.285356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:49.285262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:49.285262+0000","last_clean_scrub_stamp":"2024-04-26T10:25:49.285262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:22:29.659904+0000","scrub_duration":0.0035995300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":84,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:07.248434+0000","last_change":"2024-04-26T10:25:07.248434+0000","last_active":"2024-04-26T10:25:07.248434+0000","last_peered":"2024-04-26T10:25:07.248434+0000","last_clean":"2024-04-26T10:25:07.248434+0000","last_became_active":"2024-04-26T10:22:09.748256+0000","last_became_peered":"2024-04-26T10:22:09.748256+0000","last_unstale":"2024-04-26T10:25:07.248434+0000","last_undegraded":"2024-04-26T10:25:07.248434+0000","last_fullsized":"2024-04-26T10:25:07.248434+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:07.248161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:07.248161+0000","last_clean_scrub_stamp":"2024-04-26T10:25:07.248161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:19:25.723449+0000","scrub_duration":0.003118071,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:41.225747+0000","last_change":"2024-04-26T10:25:41.225747+0000","last_active":"2024-04-26T10:25:41.225747+0000","last_peered":"2024-04-26T10:25:41.225747+0000","last_clean":"2024-04-26T10:25:41.225747+0000","last_became_active":"2024-04-26T10:24:31.603620+0000","last_became_peered":"2024-04-26T10:24:31.603620+0000","last_unstale":"2024-04-26T10:25:41.225747+0000","last_undegraded":"2024-04-26T10:25:41.225747+0000","last_fullsized":"2024-04-26T10:25:41.225747+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:41.225468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:41.225468+0000","last_clean_scrub_stamp":"2024-04-26T10:25:41.225468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:17:10.344665+0000","scrub_duration":0.0031305310000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:37.156720+0000","last_change":"2024-04-26T10:25:37.156720+0000","last_active":"2024-04-26T10:25:37.156720+0000","last_peered":"2024-04-26T10:25:37.156720+0000","last_clean":"2024-04-26T10:25:37.156720+0000","last_became_active":"2024-04-26T10:24:31.598120+0000","last_became_peered":"2024-04-26T10:24:31.598120+0000","last_unstale":"2024-04-26T10:25:37.156720+0000","last_undegraded":"2024-04-26T10:25:37.156720+0000","last_fullsized":"2024-04-26T10:25:37.156720+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:37.156442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:37.156442+0000","last_clean_scrub_stamp":"2024-04-26T10:25:37.156442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:40:09.426539+0000","scrub_duration":0.0032247579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:57.789439+0000","last_change":"2024-04-26T10:24:57.789439+0000","last_active":"2024-04-26T10:24:57.789439+0000","last_peered":"2024-04-26T10:24:57.789439+0000","last_clean":"2024-04-26T10:24:57.789439+0000","last_became_active":"2024-04-26T10:24:22.679940+0000","last_became_peered":"2024-04-26T10:24:22.679940+0000","last_unstale":"2024-04-26T10:24:57.789439+0000","last_undegraded":"2024-04-26T10:24:57.789439+0000","last_fullsized":"2024-04-26T10:24:57.789439+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:57.789236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:57.789236+0000","last_clean_scrub_stamp":"2024-04-26T10:24:57.789236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:48:34.365027+0000","scrub_duration":0.045365677,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"91'159","reported_seq":348,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:55.216932+0000","last_change":"2024-04-26T10:25:55.217213+0000","last_active":"2024-04-26T10:25:55.216932+0000","last_peered":"2024-04-26T10:25:55.216932+0000","last_clean":"2024-04-26T10:25:55.216932+0000","last_became_active":"2024-04-26T10:24:34.184490+0000","last_became_peered":"2024-04-26T10:24:34.184490+0000","last_unstale":"2024-04-26T10:25:55.216932+0000","last_undegraded":"2024-04-26T10:25:55.216932+0000","last_fullsized":"2024-04-26T10:25:55.216932+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'159","last_scrub_stamp":"2024-04-26T10:25:55.216878+0000","last_deep_scrub":"91'159","last_deep_scrub_stamp":"2024-04-26T10:25:55.216878+0000","last_clean_scrub_stamp":"2024-04-26T10:25:55.216878+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:35:53.332492+0000","scrub_duration":0.01063709,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:01.252793+0000","last_change":"2024-04-26T10:26:01.253028+0000","last_active":"2024-04-26T10:26:01.252793+0000","last_peered":"2024-04-26T10:26:01.252793+0000","last_clean":"2024-04-26T10:26:01.252793+0000","last_became_active":"2024-04-26T10:24:22.546650+0000","last_became_peered":"2024-04-26T10:24:22.546650+0000","last_unstale":"2024-04-26T10:26:01.252793+0000","last_undegraded":"2024-04-26T10:26:01.252793+0000","last_fullsized":"2024-04-26T10:26:01.252793+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:01.252748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:01.252748+0000","last_clean_scrub_stamp":"2024-04-26T10:26:01.252748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:01:39.132139+0000","scrub_duration":0.0031193200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:49.698037+0000","last_change":"2024-04-26T10:24:49.698037+0000","last_active":"2024-04-26T10:24:49.698037+0000","last_peered":"2024-04-26T10:24:49.698037+0000","last_clean":"2024-04-26T10:24:49.698037+0000","last_became_active":"2024-04-26T10:24:22.676489+0000","last_became_peered":"2024-04-26T10:24:22.676489+0000","last_unstale":"2024-04-26T10:24:49.698037+0000","last_undegraded":"2024-04-26T10:24:49.698037+0000","last_fullsized":"2024-04-26T10:24:49.698037+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:49.697735+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:49.697735+0000","last_clean_scrub_stamp":"2024-04-26T10:24:49.697735+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:29:32.374320+0000","scrub_duration":0.0030634690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:12.176501+0000","last_change":"2024-04-26T10:25:12.176501+0000","last_active":"2024-04-26T10:25:12.176501+0000","last_peered":"2024-04-26T10:25:12.176501+0000","last_clean":"2024-04-26T10:25:12.176501+0000","last_became_active":"2024-04-26T10:24:31.603498+0000","last_became_peered":"2024-04-26T10:24:31.603498+0000","last_unstale":"2024-04-26T10:25:12.176501+0000","last_undegraded":"2024-04-26T10:25:12.176501+0000","last_fullsized":"2024-04-26T10:25:12.176501+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:12.176170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:12.176170+0000","last_clean_scrub_stamp":"2024-04-26T10:25:12.176170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:17:31.663887+0000","scrub_duration":0.003223147,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":122,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:58.199601+0000","last_change":"2024-04-26T10:25:58.199850+0000","last_active":"2024-04-26T10:25:58.199601+0000","last_peered":"2024-04-26T10:25:58.199601+0000","last_clean":"2024-04-26T10:25:58.199601+0000","last_became_active":"2024-04-26T10:24:31.602611+0000","last_became_peered":"2024-04-26T10:24:31.602611+0000","last_unstale":"2024-04-26T10:25:58.199601+0000","last_undegraded":"2024-04-26T10:25:58.199601+0000","last_fullsized":"2024-04-26T10:25:58.199601+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:58.199556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:58.199556+0000","last_clean_scrub_stamp":"2024-04-26T10:25:58.199556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:57:16.447456+0000","scrub_duration":0.003443134,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:28.757380+0000","last_change":"2024-04-26T10:25:28.757380+0000","last_active":"2024-04-26T10:25:28.757380+0000","last_peered":"2024-04-26T10:25:28.757380+0000","last_clean":"2024-04-26T10:25:28.757380+0000","last_became_active":"2024-04-26T10:24:22.685051+0000","last_became_peered":"2024-04-26T10:24:22.685051+0000","last_unstale":"2024-04-26T10:25:28.757380+0000","last_undegraded":"2024-04-26T10:25:28.757380+0000","last_fullsized":"2024-04-26T10:25:28.757380+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:28.757100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:28.757100+0000","last_clean_scrub_stamp":"2024-04-26T10:25:28.757100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:13:42.473787+0000","scrub_duration":0.0030427010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:24.210591+0000","last_change":"2024-04-26T10:25:24.210591+0000","last_active":"2024-04-26T10:25:24.210591+0000","last_peered":"2024-04-26T10:25:24.210591+0000","last_clean":"2024-04-26T10:25:24.210591+0000","last_became_active":"2024-04-26T10:24:22.537983+0000","last_became_peered":"2024-04-26T10:24:22.537983+0000","last_unstale":"2024-04-26T10:25:24.210591+0000","last_undegraded":"2024-04-26T10:25:24.210591+0000","last_fullsized":"2024-04-26T10:25:24.210591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:24.210327+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:24.210327+0000","last_clean_scrub_stamp":"2024-04-26T10:25:24.210327+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:47:19.630117+0000","scrub_duration":0.003228014,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:47.630379+0000","last_change":"2024-04-26T10:24:47.630379+0000","last_active":"2024-04-26T10:24:47.630379+0000","last_peered":"2024-04-26T10:24:47.630379+0000","last_clean":"2024-04-26T10:24:47.630379+0000","last_became_active":"2024-04-26T10:24:22.678866+0000","last_became_peered":"2024-04-26T10:24:22.678866+0000","last_unstale":"2024-04-26T10:24:47.630379+0000","last_undegraded":"2024-04-26T10:24:47.630379+0000","last_fullsized":"2024-04-26T10:24:47.630379+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:47.630061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:47.630061+0000","last_clean_scrub_stamp":"2024-04-26T10:24:47.630061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:44:03.378559+0000","scrub_duration":0.003470571,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":84,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:25.191632+0000","last_change":"2024-04-26T10:25:25.191896+0000","last_active":"2024-04-26T10:25:25.191632+0000","last_peered":"2024-04-26T10:25:25.191632+0000","last_clean":"2024-04-26T10:25:25.191632+0000","last_became_active":"2024-04-26T10:22:09.749935+0000","last_became_peered":"2024-04-26T10:22:09.749935+0000","last_unstale":"2024-04-26T10:25:25.191632+0000","last_undegraded":"2024-04-26T10:25:25.191632+0000","last_fullsized":"2024-04-26T10:25:25.191632+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:25.191588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:25.191588+0000","last_clean_scrub_stamp":"2024-04-26T10:25:25.191588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:42:58.190318+0000","scrub_duration":0.0035868789999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:56.919436+0000","last_change":"2024-04-26T10:25:56.919436+0000","last_active":"2024-04-26T10:25:56.919436+0000","last_peered":"2024-04-26T10:25:56.919436+0000","last_clean":"2024-04-26T10:25:56.919436+0000","last_became_active":"2024-04-26T10:24:31.745487+0000","last_became_peered":"2024-04-26T10:24:31.745487+0000","last_unstale":"2024-04-26T10:25:56.919436+0000","last_undegraded":"2024-04-26T10:25:56.919436+0000","last_fullsized":"2024-04-26T10:25:56.919436+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:56.919301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:56.919301+0000","last_clean_scrub_stamp":"2024-04-26T10:25:56.919301+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:15:18.728459+0000","scrub_duration":0.028941299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:00.260545+0000","last_change":"2024-04-26T10:26:00.260824+0000","last_active":"2024-04-26T10:26:00.260545+0000","last_peered":"2024-04-26T10:26:00.260545+0000","last_clean":"2024-04-26T10:26:00.260545+0000","last_became_active":"2024-04-26T10:24:22.538993+0000","last_became_peered":"2024-04-26T10:24:22.538993+0000","last_unstale":"2024-04-26T10:26:00.260545+0000","last_undegraded":"2024-04-26T10:26:00.260545+0000","last_fullsized":"2024-04-26T10:26:00.260545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:00.260356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:00.260356+0000","last_clean_scrub_stamp":"2024-04-26T10:26:00.260356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:50:35.337680+0000","scrub_duration":0.003414331,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:07.270026+0000","last_change":"2024-04-26T10:26:07.270271+0000","last_active":"2024-04-26T10:26:07.270026+0000","last_peered":"2024-04-26T10:26:07.270026+0000","last_clean":"2024-04-26T10:26:07.270026+0000","last_became_active":"2024-04-26T10:24:22.541795+0000","last_became_peered":"2024-04-26T10:24:22.541795+0000","last_unstale":"2024-04-26T10:26:07.270026+0000","last_undegraded":"2024-04-26T10:26:07.270026+0000","last_fullsized":"2024-04-26T10:26:07.270026+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:07.269957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:07.269957+0000","last_clean_scrub_stamp":"2024-04-26T10:26:07.269957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:46:35.069203+0000","scrub_duration":0.0033643560000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:46.642441+0000","last_change":"2024-04-26T10:24:46.642441+0000","last_active":"2024-04-26T10:24:46.642441+0000","last_peered":"2024-04-26T10:24:46.642441+0000","last_clean":"2024-04-26T10:24:46.642441+0000","last_became_active":"2024-04-26T10:24:31.744373+0000","last_became_peered":"2024-04-26T10:24:31.744373+0000","last_unstale":"2024-04-26T10:24:46.642441+0000","last_undegraded":"2024-04-26T10:24:46.642441+0000","last_fullsized":"2024-04-26T10:24:46.642441+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:46.642168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:46.642168+0000","last_clean_scrub_stamp":"2024-04-26T10:24:46.642168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:46:47.970345+0000","scrub_duration":0.0030956120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:08.246286+0000","last_change":"2024-04-26T10:26:08.246526+0000","last_active":"2024-04-26T10:26:08.246286+0000","last_peered":"2024-04-26T10:26:08.246286+0000","last_clean":"2024-04-26T10:26:08.246286+0000","last_became_active":"2024-04-26T10:24:22.537041+0000","last_became_peered":"2024-04-26T10:24:22.537041+0000","last_unstale":"2024-04-26T10:26:08.246286+0000","last_undegraded":"2024-04-26T10:26:08.246286+0000","last_fullsized":"2024-04-26T10:26:08.246286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:08.246238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:08.246238+0000","last_clean_scrub_stamp":"2024-04-26T10:26:08.246238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:45:18.709788+0000","scrub_duration":0.003287,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:52.905280+0000","last_change":"2024-04-26T10:25:52.905280+0000","last_active":"2024-04-26T10:25:52.905280+0000","last_peered":"2024-04-26T10:25:52.905280+0000","last_clean":"2024-04-26T10:25:52.905280+0000","last_became_active":"2024-04-26T10:24:31.744342+0000","last_became_peered":"2024-04-26T10:24:31.744342+0000","last_unstale":"2024-04-26T10:25:52.905280+0000","last_undegraded":"2024-04-26T10:25:52.905280+0000","last_fullsized":"2024-04-26T10:25:52.905280+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:52.905009+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:52.905009+0000","last_clean_scrub_stamp":"2024-04-26T10:25:52.905009+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:37:30.922185+0000","scrub_duration":0.0032611319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:53.288881+0000","last_change":"2024-04-26T10:24:53.288881+0000","last_active":"2024-04-26T10:24:53.288881+0000","last_peered":"2024-04-26T10:24:53.288881+0000","last_clean":"2024-04-26T10:24:53.288881+0000","last_became_active":"2024-04-26T10:24:31.598432+0000","last_became_peered":"2024-04-26T10:24:31.598432+0000","last_unstale":"2024-04-26T10:24:53.288881+0000","last_undegraded":"2024-04-26T10:24:53.288881+0000","last_fullsized":"2024-04-26T10:24:53.288881+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:53.288587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:53.288587+0000","last_clean_scrub_stamp":"2024-04-26T10:24:53.288587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:21:25.869325+0000","scrub_duration":0.003660567,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:02.963196+0000","last_change":"2024-04-26T10:26:02.963196+0000","last_active":"2024-04-26T10:26:02.963196+0000","last_peered":"2024-04-26T10:26:02.963196+0000","last_clean":"2024-04-26T10:26:02.963196+0000","last_became_active":"2024-04-26T10:24:31.745004+0000","last_became_peered":"2024-04-26T10:24:31.745004+0000","last_unstale":"2024-04-26T10:26:02.963196+0000","last_undegraded":"2024-04-26T10:26:02.963196+0000","last_fullsized":"2024-04-26T10:26:02.963196+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:02.962834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:02.962834+0000","last_clean_scrub_stamp":"2024-04-26T10:26:02.962834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:38:02.796843+0000","scrub_duration":0.0032636729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:12.232642+0000","last_change":"2024-04-26T10:25:12.232642+0000","last_active":"2024-04-26T10:25:12.232642+0000","last_peered":"2024-04-26T10:25:12.232642+0000","last_clean":"2024-04-26T10:25:12.232642+0000","last_became_active":"2024-04-26T10:24:31.600977+0000","last_became_peered":"2024-04-26T10:24:31.600977+0000","last_unstale":"2024-04-26T10:25:12.232642+0000","last_undegraded":"2024-04-26T10:25:12.232642+0000","last_fullsized":"2024-04-26T10:25:12.232642+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:12.232350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:12.232350+0000","last_clean_scrub_stamp":"2024-04-26T10:25:12.232350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:54.306540+0000","scrub_duration":0.0033972550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:03.280598+0000","last_change":"2024-04-26T10:25:03.280598+0000","last_active":"2024-04-26T10:25:03.280598+0000","last_peered":"2024-04-26T10:25:03.280598+0000","last_clean":"2024-04-26T10:25:03.280598+0000","last_became_active":"2024-04-26T10:22:09.757813+0000","last_became_peered":"2024-04-26T10:22:09.757813+0000","last_unstale":"2024-04-26T10:25:03.280598+0000","last_undegraded":"2024-04-26T10:25:03.280598+0000","last_fullsized":"2024-04-26T10:25:03.280598+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:03.280310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:03.280310+0000","last_clean_scrub_stamp":"2024-04-26T10:25:03.280310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T19:33:49.626354+0000","scrub_duration":0.0030957509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"91'3","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:29.795539+0000","last_change":"2024-04-26T10:25:29.795539+0000","last_active":"2024-04-26T10:25:29.795539+0000","last_peered":"2024-04-26T10:25:29.795539+0000","last_clean":"2024-04-26T10:25:29.795539+0000","last_became_active":"2024-04-26T10:24:22.679497+0000","last_became_peered":"2024-04-26T10:24:22.679497+0000","last_unstale":"2024-04-26T10:25:29.795539+0000","last_undegraded":"2024-04-26T10:25:29.795539+0000","last_fullsized":"2024-04-26T10:25:29.795539+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:29.795145+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:29.795145+0000","last_clean_scrub_stamp":"2024-04-26T10:25:29.795145+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:38:54.475564+0000","scrub_duration":0.0065687940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:51.867424+0000","last_change":"2024-04-26T10:25:51.867424+0000","last_active":"2024-04-26T10:25:51.867424+0000","last_peered":"2024-04-26T10:25:51.867424+0000","last_clean":"2024-04-26T10:25:51.867424+0000","last_became_active":"2024-04-26T10:24:31.740589+0000","last_became_peered":"2024-04-26T10:24:31.740589+0000","last_unstale":"2024-04-26T10:25:51.867424+0000","last_undegraded":"2024-04-26T10:25:51.867424+0000","last_fullsized":"2024-04-26T10:25:51.867424+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:51.867105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:51.867105+0000","last_clean_scrub_stamp":"2024-04-26T10:25:51.867105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:25:28.725553+0000","scrub_duration":0.003137379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:36.821844+0000","last_change":"2024-04-26T10:25:36.821844+0000","last_active":"2024-04-26T10:25:36.821844+0000","last_peered":"2024-04-26T10:25:36.821844+0000","last_clean":"2024-04-26T10:25:36.821844+0000","last_became_active":"2024-04-26T10:24:22.686094+0000","last_became_peered":"2024-04-26T10:24:22.686094+0000","last_unstale":"2024-04-26T10:25:36.821844+0000","last_undegraded":"2024-04-26T10:25:36.821844+0000","last_fullsized":"2024-04-26T10:25:36.821844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:36.821405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:36.821405+0000","last_clean_scrub_stamp":"2024-04-26T10:25:36.821405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:37:37.980133+0000","scrub_duration":0.0037491249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"91'2","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:30.823328+0000","last_change":"2024-04-26T10:25:30.823328+0000","last_active":"2024-04-26T10:25:30.823328+0000","last_peered":"2024-04-26T10:25:30.823328+0000","last_clean":"2024-04-26T10:25:30.823328+0000","last_became_active":"2024-04-26T10:24:22.681977+0000","last_became_peered":"2024-04-26T10:24:22.681977+0000","last_unstale":"2024-04-26T10:25:30.823328+0000","last_undegraded":"2024-04-26T10:25:30.823328+0000","last_fullsized":"2024-04-26T10:25:30.823328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'2","last_scrub_stamp":"2024-04-26T10:25:30.823041+0000","last_deep_scrub":"91'2","last_deep_scrub_stamp":"2024-04-26T10:25:30.823041+0000","last_clean_scrub_stamp":"2024-04-26T10:25:30.823041+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:28:56.165886+0000","scrub_duration":0.0068473839999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":122,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:03.239253+0000","last_change":"2024-04-26T10:26:03.239508+0000","last_active":"2024-04-26T10:26:03.239253+0000","last_peered":"2024-04-26T10:26:03.239253+0000","last_clean":"2024-04-26T10:26:03.239253+0000","last_became_active":"2024-04-26T10:24:31.604158+0000","last_became_peered":"2024-04-26T10:24:31.604158+0000","last_unstale":"2024-04-26T10:26:03.239253+0000","last_undegraded":"2024-04-26T10:26:03.239253+0000","last_fullsized":"2024-04-26T10:26:03.239253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:03.239209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:03.239209+0000","last_clean_scrub_stamp":"2024-04-26T10:26:03.239209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:42:38.356864+0000","scrub_duration":0.0033795040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:06.221246+0000","last_change":"2024-04-26T10:25:06.221246+0000","last_active":"2024-04-26T10:25:06.221246+0000","last_peered":"2024-04-26T10:25:06.221246+0000","last_clean":"2024-04-26T10:25:06.221246+0000","last_became_active":"2024-04-26T10:24:31.600474+0000","last_became_peered":"2024-04-26T10:24:31.600474+0000","last_unstale":"2024-04-26T10:25:06.221246+0000","last_undegraded":"2024-04-26T10:25:06.221246+0000","last_fullsized":"2024-04-26T10:25:06.221246+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:06.220907+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:06.220907+0000","last_clean_scrub_stamp":"2024-04-26T10:25:06.220907+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:22:58.924774+0000","scrub_duration":0.0032236180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":118,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:59.250347+0000","last_change":"2024-04-26T10:24:59.250347+0000","last_active":"2024-04-26T10:24:59.250347+0000","last_peered":"2024-04-26T10:24:59.250347+0000","last_clean":"2024-04-26T10:24:59.250347+0000","last_became_active":"2024-04-26T10:24:31.604609+0000","last_became_peered":"2024-04-26T10:24:31.604609+0000","last_unstale":"2024-04-26T10:24:59.250347+0000","last_undegraded":"2024-04-26T10:24:59.250347+0000","last_fullsized":"2024-04-26T10:24:59.250347+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:59.250058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:59.250058+0000","last_clean_scrub_stamp":"2024-04-26T10:24:59.250058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:19:27.888233+0000","scrub_duration":0.0035158640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.14","version":"91'10","reported_seq":149,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:09.226253+0000","last_change":"2024-04-26T10:25:09.226253+0000","last_active":"2024-04-26T10:25:09.226253+0000","last_peered":"2024-04-26T10:25:09.226253+0000","last_clean":"2024-04-26T10:25:09.226253+0000","last_became_active":"2024-04-26T10:24:31.604884+0000","last_became_peered":"2024-04-26T10:24:31.604884+0000","last_unstale":"2024-04-26T10:25:09.226253+0000","last_undegraded":"2024-04-26T10:25:09.226253+0000","last_fullsized":"2024-04-26T10:25:09.226253+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'10","last_scrub_stamp":"2024-04-26T10:25:09.225844+0000","last_deep_scrub":"91'10","last_deep_scrub_stamp":"2024-04-26T10:25:09.225844+0000","last_clean_scrub_stamp":"2024-04-26T10:25:09.225844+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:09:43.565487+0000","scrub_duration":0.0099065019999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":3128,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:45.021090+0000","last_change":"2024-04-26T10:25:45.021090+0000","last_active":"2024-04-26T10:25:45.021090+0000","last_peered":"2024-04-26T10:25:45.021090+0000","last_clean":"2024-04-26T10:25:45.021090+0000","last_became_active":"2024-04-26T10:24:31.739550+0000","last_became_peered":"2024-04-26T10:24:31.739550+0000","last_unstale":"2024-04-26T10:25:45.021090+0000","last_undegraded":"2024-04-26T10:25:45.021090+0000","last_fullsized":"2024-04-26T10:25:45.021090+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:45.020789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:45.020789+0000","last_clean_scrub_stamp":"2024-04-26T10:25:45.020789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:28:16.947170+0000","scrub_duration":0.0032832579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"91'5","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:02.311259+0000","last_change":"2024-04-26T10:25:02.311507+0000","last_active":"2024-04-26T10:25:02.311259+0000","last_peered":"2024-04-26T10:25:02.311259+0000","last_clean":"2024-04-26T10:25:02.311259+0000","last_became_active":"2024-04-26T10:24:31.601218+0000","last_became_peered":"2024-04-26T10:24:31.601218+0000","last_unstale":"2024-04-26T10:25:02.311259+0000","last_undegraded":"2024-04-26T10:25:02.311259+0000","last_fullsized":"2024-04-26T10:25:02.311259+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'5","last_scrub_stamp":"2024-04-26T10:25:02.311211+0000","last_deep_scrub":"91'5","last_deep_scrub_stamp":"2024-04-26T10:25:02.311211+0000","last_clean_scrub_stamp":"2024-04-26T10:25:02.311211+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:41:46.605747+0000","scrub_duration":0.0088437829999999992,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":180,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":106,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:07.221072+0000","last_change":"2024-04-26T10:25:07.221072+0000","last_active":"2024-04-26T10:25:07.221072+0000","last_peered":"2024-04-26T10:25:07.221072+0000","last_clean":"2024-04-26T10:25:07.221072+0000","last_became_active":"2024-04-26T10:24:22.546378+0000","last_became_peered":"2024-04-26T10:24:22.546378+0000","last_unstale":"2024-04-26T10:25:07.221072+0000","last_undegraded":"2024-04-26T10:25:07.221072+0000","last_fullsized":"2024-04-26T10:25:07.221072+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:07.220796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:07.220796+0000","last_clean_scrub_stamp":"2024-04-26T10:25:07.220796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:45:33.432321+0000","scrub_duration":0.0036655839999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:04.629253+0000","last_change":"2024-04-26T10:25:04.629253+0000","last_active":"2024-04-26T10:25:04.629253+0000","last_peered":"2024-04-26T10:25:04.629253+0000","last_clean":"2024-04-26T10:25:04.629253+0000","last_became_active":"2024-04-26T10:24:22.683558+0000","last_became_peered":"2024-04-26T10:24:22.683558+0000","last_unstale":"2024-04-26T10:25:04.629253+0000","last_undegraded":"2024-04-26T10:25:04.629253+0000","last_fullsized":"2024-04-26T10:25:04.629253+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:04.628905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:04.628905+0000","last_clean_scrub_stamp":"2024-04-26T10:25:04.628905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:20:44.078968+0000","scrub_duration":0.0037325380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:50.729571+0000","last_change":"2024-04-26T10:24:50.729571+0000","last_active":"2024-04-26T10:24:50.729571+0000","last_peered":"2024-04-26T10:24:50.729571+0000","last_clean":"2024-04-26T10:24:50.729571+0000","last_became_active":"2024-04-26T10:24:22.684166+0000","last_became_peered":"2024-04-26T10:24:22.684166+0000","last_unstale":"2024-04-26T10:24:50.729571+0000","last_undegraded":"2024-04-26T10:24:50.729571+0000","last_fullsized":"2024-04-26T10:24:50.729571+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:50.729143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:50.729143+0000","last_clean_scrub_stamp":"2024-04-26T10:24:50.729143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T15:50:54.166410+0000","scrub_duration":0.003288118,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:39.844673+0000","last_change":"2024-04-26T10:25:39.844673+0000","last_active":"2024-04-26T10:25:39.844673+0000","last_peered":"2024-04-26T10:25:39.844673+0000","last_clean":"2024-04-26T10:25:39.844673+0000","last_became_active":"2024-04-26T10:24:31.745216+0000","last_became_peered":"2024-04-26T10:24:31.745216+0000","last_unstale":"2024-04-26T10:25:39.844673+0000","last_undegraded":"2024-04-26T10:25:39.844673+0000","last_fullsized":"2024-04-26T10:25:39.844673+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:39.844349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:39.844349+0000","last_clean_scrub_stamp":"2024-04-26T10:25:39.844349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:42:48.381149+0000","scrub_duration":0.0035234730000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:10.271098+0000","last_change":"2024-04-26T10:25:10.271098+0000","last_active":"2024-04-26T10:25:10.271098+0000","last_peered":"2024-04-26T10:25:10.271098+0000","last_clean":"2024-04-26T10:25:10.271098+0000","last_became_active":"2024-04-26T10:22:09.750359+0000","last_became_peered":"2024-04-26T10:22:09.750359+0000","last_unstale":"2024-04-26T10:25:10.271098+0000","last_undegraded":"2024-04-26T10:25:10.271098+0000","last_fullsized":"2024-04-26T10:25:10.271098+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:10.270958+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:10.270958+0000","last_clean_scrub_stamp":"2024-04-26T10:25:10.270958+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T16:04:37.572061+0000","scrub_duration":0.098704475999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:14.649052+0000","last_change":"2024-04-26T10:25:14.649052+0000","last_active":"2024-04-26T10:25:14.649052+0000","last_peered":"2024-04-26T10:25:14.649052+0000","last_clean":"2024-04-26T10:25:14.649052+0000","last_became_active":"2024-04-26T10:24:31.740477+0000","last_became_peered":"2024-04-26T10:24:31.740477+0000","last_unstale":"2024-04-26T10:25:14.649052+0000","last_undegraded":"2024-04-26T10:25:14.649052+0000","last_fullsized":"2024-04-26T10:25:14.649052+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:14.648757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:14.648757+0000","last_clean_scrub_stamp":"2024-04-26T10:25:14.648757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:15:15.311203+0000","scrub_duration":0.0031660170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:48.666739+0000","last_change":"2024-04-26T10:24:48.666739+0000","last_active":"2024-04-26T10:24:48.666739+0000","last_peered":"2024-04-26T10:24:48.666739+0000","last_clean":"2024-04-26T10:24:48.666739+0000","last_became_active":"2024-04-26T10:24:22.683501+0000","last_became_peered":"2024-04-26T10:24:22.683501+0000","last_unstale":"2024-04-26T10:24:48.666739+0000","last_undegraded":"2024-04-26T10:24:48.666739+0000","last_fullsized":"2024-04-26T10:24:48.666739+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:48.666365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:48.666365+0000","last_clean_scrub_stamp":"2024-04-26T10:24:48.666365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:23:11.797360+0000","scrub_duration":0.003127285,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:23.696226+0000","last_change":"2024-04-26T10:25:23.696226+0000","last_active":"2024-04-26T10:25:23.696226+0000","last_peered":"2024-04-26T10:25:23.696226+0000","last_clean":"2024-04-26T10:25:23.696226+0000","last_became_active":"2024-04-26T10:24:22.684469+0000","last_became_peered":"2024-04-26T10:24:22.684469+0000","last_unstale":"2024-04-26T10:25:23.696226+0000","last_undegraded":"2024-04-26T10:25:23.696226+0000","last_fullsized":"2024-04-26T10:25:23.696226+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:23.695862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:23.695862+0000","last_clean_scrub_stamp":"2024-04-26T10:25:23.695862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:38:21.975628+0000","scrub_duration":0.0034938339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:05.257118+0000","last_change":"2024-04-26T10:25:05.257118+0000","last_active":"2024-04-26T10:25:05.257118+0000","last_peered":"2024-04-26T10:25:05.257118+0000","last_clean":"2024-04-26T10:25:05.257118+0000","last_became_active":"2024-04-26T10:22:09.752856+0000","last_became_peered":"2024-04-26T10:22:09.752856+0000","last_unstale":"2024-04-26T10:25:05.257118+0000","last_undegraded":"2024-04-26T10:25:05.257118+0000","last_fullsized":"2024-04-26T10:25:05.257118+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:05.256836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:05.256836+0000","last_clean_scrub_stamp":"2024-04-26T10:25:05.256836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:38:22.884251+0000","scrub_duration":0.0032355069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:17.278034+0000","last_change":"2024-04-26T10:25:17.278034+0000","last_active":"2024-04-26T10:25:17.278034+0000","last_peered":"2024-04-26T10:25:17.278034+0000","last_clean":"2024-04-26T10:25:17.278034+0000","last_became_active":"2024-04-26T10:24:22.535036+0000","last_became_peered":"2024-04-26T10:24:22.535036+0000","last_unstale":"2024-04-26T10:25:17.278034+0000","last_undegraded":"2024-04-26T10:25:17.278034+0000","last_fullsized":"2024-04-26T10:25:17.278034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-26T10:25:17.277726+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-26T10:25:17.277726+0000","last_clean_scrub_stamp":"2024-04-26T10:25:17.277726+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T20:48:30.647501+0000","scrub_duration":0.0033671420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:14.220039+0000","last_change":"2024-04-26T10:25:14.220039+0000","last_active":"2024-04-26T10:25:14.220039+0000","last_peered":"2024-04-26T10:25:14.220039+0000","last_clean":"2024-04-26T10:25:14.220039+0000","last_became_active":"2024-04-26T10:24:22.535562+0000","last_became_peered":"2024-04-26T10:24:22.535562+0000","last_unstale":"2024-04-26T10:25:14.220039+0000","last_undegraded":"2024-04-26T10:25:14.220039+0000","last_fullsized":"2024-04-26T10:25:14.220039+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:14.219757+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:14.219757+0000","last_clean_scrub_stamp":"2024-04-26T10:25:14.219757+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:07:48.012965+0000","scrub_duration":0.0030851279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:51.212563+0000","last_change":"2024-04-26T10:25:51.212833+0000","last_active":"2024-04-26T10:25:51.212563+0000","last_peered":"2024-04-26T10:25:51.212563+0000","last_clean":"2024-04-26T10:25:51.212563+0000","last_became_active":"2024-04-26T10:24:31.600121+0000","last_became_peered":"2024-04-26T10:24:31.600121+0000","last_unstale":"2024-04-26T10:25:51.212563+0000","last_undegraded":"2024-04-26T10:25:51.212563+0000","last_fullsized":"2024-04-26T10:25:51.212563+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-26T10:25:51.212513+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-26T10:25:51.212513+0000","last_clean_scrub_stamp":"2024-04-26T10:25:51.212513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:01:10.847443+0000","scrub_duration":0.0037555000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:26:24.366916+0000","last_change":"2024-04-26T10:26:24.367028+0000","last_active":"2024-04-26T10:26:24.366916+0000","last_peered":"2024-04-26T10:26:24.366916+0000","last_clean":"2024-04-26T10:26:24.366916+0000","last_became_active":"2024-04-26T10:24:22.541543+0000","last_became_peered":"2024-04-26T10:24:22.541543+0000","last_unstale":"2024-04-26T10:26:24.366916+0000","last_undegraded":"2024-04-26T10:26:24.366916+0000","last_fullsized":"2024-04-26T10:26:24.366916+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:26:24.366897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:26:24.366897+0000","last_clean_scrub_stamp":"2024-04-26T10:26:24.366897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T18:36:29.516810+0000","scrub_duration":0.073689674999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"91'3","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:02.282898+0000","last_change":"2024-04-26T10:25:02.282898+0000","last_active":"2024-04-26T10:25:02.282898+0000","last_peered":"2024-04-26T10:25:02.282898+0000","last_clean":"2024-04-26T10:25:02.282898+0000","last_became_active":"2024-04-26T10:24:22.540767+0000","last_became_peered":"2024-04-26T10:24:22.540767+0000","last_unstale":"2024-04-26T10:25:02.282898+0000","last_undegraded":"2024-04-26T10:25:02.282898+0000","last_fullsized":"2024-04-26T10:25:02.282898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:02.282431+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:02.282431+0000","last_clean_scrub_stamp":"2024-04-26T10:25:02.282431+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T14:56:51.767663+0000","scrub_duration":0.0068591950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:04.207642+0000","last_change":"2024-04-26T10:25:04.207642+0000","last_active":"2024-04-26T10:25:04.207642+0000","last_peered":"2024-04-26T10:25:04.207642+0000","last_clean":"2024-04-26T10:25:04.207642+0000","last_became_active":"2024-04-26T10:24:22.546811+0000","last_became_peered":"2024-04-26T10:24:22.546811+0000","last_unstale":"2024-04-26T10:25:04.207642+0000","last_undegraded":"2024-04-26T10:25:04.207642+0000","last_fullsized":"2024-04-26T10:25:04.207642+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:04.207258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:04.207258+0000","last_clean_scrub_stamp":"2024-04-26T10:25:04.207258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:30:28.549935+0000","scrub_duration":0.0033412889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"91'3","reported_seq":87,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:33.118265+0000","last_change":"2024-04-26T10:25:33.118265+0000","last_active":"2024-04-26T10:25:33.118265+0000","last_peered":"2024-04-26T10:25:33.118265+0000","last_clean":"2024-04-26T10:25:33.118265+0000","last_became_active":"2024-04-26T10:22:09.753211+0000","last_became_peered":"2024-04-26T10:22:09.753211+0000","last_unstale":"2024-04-26T10:25:33.118265+0000","last_undegraded":"2024-04-26T10:25:33.118265+0000","last_fullsized":"2024-04-26T10:25:33.118265+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'3","last_scrub_stamp":"2024-04-26T10:25:33.117975+0000","last_deep_scrub":"91'3","last_deep_scrub_stamp":"2024-04-26T10:25:33.117975+0000","last_clean_scrub_stamp":"2024-04-26T10:25:33.117975+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T13:00:48.526455+0000","scrub_duration":0.0059958340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:24:50.293783+0000","last_change":"2024-04-26T10:24:50.293998+0000","last_active":"2024-04-26T10:24:50.293783+0000","last_peered":"2024-04-26T10:24:50.293783+0000","last_clean":"2024-04-26T10:24:50.293783+0000","last_became_active":"2024-04-26T10:24:31.600088+0000","last_became_peered":"2024-04-26T10:24:31.600088+0000","last_unstale":"2024-04-26T10:24:50.293783+0000","last_undegraded":"2024-04-26T10:24:50.293783+0000","last_fullsized":"2024-04-26T10:24:50.293783+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:24:50.293726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:24:50.293726+0000","last_clean_scrub_stamp":"2024-04-26T10:24:50.293726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T21:14:29.398875+0000","scrub_duration":0.014652757000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:06.613576+0000","last_change":"2024-04-26T10:25:06.613576+0000","last_active":"2024-04-26T10:25:06.613576+0000","last_peered":"2024-04-26T10:25:06.613576+0000","last_clean":"2024-04-26T10:25:06.613576+0000","last_became_active":"2024-04-26T10:24:22.679652+0000","last_became_peered":"2024-04-26T10:24:22.679652+0000","last_unstale":"2024-04-26T10:25:06.613576+0000","last_undegraded":"2024-04-26T10:25:06.613576+0000","last_fullsized":"2024-04-26T10:25:06.613576+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-26T10:25:06.613222+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-26T10:25:06.613222+0000","last_clean_scrub_stamp":"2024-04-26T10:25:06.613222+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T12:25:12.597334+0000","scrub_duration":0.0032988710000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":105,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:01.257447+0000","last_change":"2024-04-26T10:25:01.257447+0000","last_active":"2024-04-26T10:25:01.257447+0000","last_peered":"2024-04-26T10:25:01.257447+0000","last_clean":"2024-04-26T10:25:01.257447+0000","last_became_active":"2024-04-26T10:24:22.538895+0000","last_became_peered":"2024-04-26T10:24:22.538895+0000","last_unstale":"2024-04-26T10:25:01.257447+0000","last_undegraded":"2024-04-26T10:25:01.257447+0000","last_fullsized":"2024-04-26T10:25:01.257447+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T10:25:01.257171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T10:25:01.257171+0000","last_clean_scrub_stamp":"2024-04-26T10:25:01.257171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:59:55.289475+0000","scrub_duration":0.0032699750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-26T10:25:03.668244+0000","last_change":"2024-04-26T10:25:03.668244+0000","last_active":"2024-04-26T10:25:03.668244+0000","last_peered":"2024-04-26T10:25:03.668244+0000","last_clean":"2024-04-26T10:25:03.668244+0000","last_became_active":"2024-04-26T10:24:22.684863+0000","last_became_peered":"2024-04-26T10:24:22.684863+0000","last_unstale":"2024-04-26T10:25:03.668244+0000","last_undegraded":"2024-04-26T10:25:03.668244+0000","last_fullsized":"2024-04-26T10:25:03.668244+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"91'6","last_scrub_stamp":"2024-04-26T10:25:03.667947+0000","last_deep_scrub":"91'6","last_deep_scrub_stamp":"2024-04-26T10:25:03.667947+0000","last_clean_scrub_stamp":"2024-04-26T10:25:03.667947+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T17:58:48.437612+0000","scrub_duration":0.0076333440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":3352,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":21541,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":1,"up_from":10,"seq":42949673034,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":262680,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94109160,"statfs":{"total":96636764160,"available":96367779840,"internally_reserved":0,"allocated":1064960,"data_stored":1035671,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":267909574},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.59999999999999998,"15min":0.53200000000000003},"min":{"1min":0.47099999999999997,"5min":0.192,"15min":0.192},"max":{"1min":0.80100000000000005,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.47899999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.79600000000000004,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.63600000000000001}]},{"osd":2,"last update":"Fri Apr 26 10:26:22 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.59099999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.749,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69499999999999995,"15min":0.69699999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.754,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.71999999999999997}]}]},{"osd":0,"up_from":10,"seq":42949673033,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":487472,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":486398,"kb_avail":93884368,"statfs":{"total":96636764160,"available":96137592832,"internally_reserved":0,"allocated":1089536,"data_stored":1036287,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":498072006},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 26 10:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.70399999999999996,"15min":0.58199999999999996},"min":{"1min":0.434,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.745,"5min":4.2839999999999998,"15min":4.2839999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.504,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.80400000000000005,"5min":2.7559999999999998,"15min":2.7559999999999998},"last":0.68600000000000005}]},{"osd":2,"last update":"Fri Apr 26 10:26:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70499999999999996,"15min":0.70899999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.79200000000000004,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67900000000000005,"15min":0.68100000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.76000000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.72299999999999998}]}]},{"osd":2,"up_from":80,"seq":343597383711,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38368,"kb_used_data":984,"kb_used_omap":6,"kb_used_meta":37369,"kb_avail":94333472,"statfs":{"total":96636764160,"available":96597475328,"internally_reserved":0,"allocated":1007616,"data_stored":444173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6879,"internal_metadata":38266145},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 26 10:26:24 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.624,"15min":0.62},"min":{"1min":0.58499999999999996,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60399999999999998,"15min":0.59899999999999998},"min":{"1min":0.52100000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.60299999999999998}]},{"osd":1,"last update":"Fri Apr 26 10:26:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.60399999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.79700000000000004,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70699999999999996,"15min":0.70499999999999996},"min":{"1min":0.66100000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.64800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":6609,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":7466,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5285,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T10:26:47.116 DEBUG:teuthology.orchestra.run.smithi052:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T10:26:47.449 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-26T10:26:47.450 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:26:47.783 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:26:47.784 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T10:21:09.285446+0000","modified":"2024-04-26T10:21:12.296930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4233":{"gid":4233,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6803/2540560872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2540560872},{"type":"v1","addr":"172.21.15.52:6803","nonce":2540560872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T10:26:47.787 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 6 2024-04-26T10:26:47.799 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-26T10:26:48.132 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:26:48.132 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-26T10:21:09.285446+0000","modified":"2024-04-26T10:21:12.296930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4233":{"gid":4233,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.52:6803/2540560872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.52:6802","nonce":2540560872},{"type":"v1","addr":"172.21.15.52:6803","nonce":2540560872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-26T10:26:48.135 INFO:teuthology.orchestra.run.smithi052.stderr:dumped fsmap epoch 6 2024-04-26T10:26:48.147 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T10:26:48.456 INFO:teuthology.orchestra.run.smithi052.stdout: 2024-04-26T10:26:48.456 INFO:teuthology.orchestra.run.smithi052.stdout:{"epoch":91,"fsid":"485c78cb-ad62-4584-aba6-316dd9c93a12","created":"2024-04-26T10:20:48.363934+0000","modified":"2024-04-26T10:24:34.168633+0000","last_up_change":"2024-04-26T10:24:21.506586+0000","last_in_change":"2024-04-26T10:20:49.575442+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-26T10:20:59.994755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-26T10:21:03.866927+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-26T10:21:07.853429+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-26T10:21:08.285131+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c5e76c47-dfc4-40ca-88d3-2084cac6e35c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6800","nonce":18193},{"type":"v1","addr":"172.21.15.120:6801","nonce":18193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6802","nonce":18193},{"type":"v1","addr":"172.21.15.120:6803","nonce":18193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6806","nonce":18193},{"type":"v1","addr":"172.21.15.120:6807","nonce":18193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.120:6804","nonce":18193},{"type":"v1","addr":"172.21.15.120:6805","nonce":18193}]},"public_addr":"172.21.15.120:6801/18193","cluster_addr":"172.21.15.120:6803/18193","heartbeat_back_addr":"172.21.15.120:6807/18193","heartbeat_front_addr":"172.21.15.120:6805/18193","state":["exists","up"]},{"osd":1,"uuid":"2a8d530c-cf33-4540-9240-6bd7485e06ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":18226},{"type":"v1","addr":"172.21.15.154:6801","nonce":18226}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":18226},{"type":"v1","addr":"172.21.15.154:6803","nonce":18226}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":18226},{"type":"v1","addr":"172.21.15.154:6807","nonce":18226}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":18226},{"type":"v1","addr":"172.21.15.154:6805","nonce":18226}]},"public_addr":"172.21.15.154:6801/18226","cluster_addr":"172.21.15.154:6803/18226","heartbeat_back_addr":"172.21.15.154:6807/18226","heartbeat_front_addr":"172.21.15.154:6805/18226","state":["exists","up"]},{"osd":2,"uuid":"484ab70f-4cad-4ff6-9405-8865ec5ee327","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":28,"up_from":80,"up_thru":87,"down_at":29,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":1327},{"type":"v1","addr":"172.21.15.164:6801","nonce":1327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":1327},{"type":"v1","addr":"172.21.15.164:6803","nonce":1327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":1327},{"type":"v1","addr":"172.21.15.164:6807","nonce":1327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":1327},{"type":"v1","addr":"172.21.15.164:6805","nonce":1327}]},"public_addr":"172.21.15.164:6801/1327","cluster_addr":"172.21.15.164:6803/1327","heartbeat_back_addr":"172.21.15.164:6807/1327","heartbeat_front_addr":"172.21.15.164:6805/1327","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.871567+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.910527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-26T10:20:54.761919+0000","dead_epoch":28}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T10:26:48.470 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-26T10:26:48.810 INFO:teuthology.orchestra.run.smithi052.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-26T10:26:48.821 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-26T10:26:48.835 INFO:tasks.ceph.mds.a.smithi052.stdout:starting mds.a at 2024-04-26T10:26:49.828 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-26T10:26:50.822 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_metadata' removed 2024-04-26T10:26:50.834 DEBUG:teuthology.orchestra.run.smithi052:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-26T10:26:51.825 INFO:teuthology.orchestra.run.smithi052.stderr:pool 'cephfs_data' removed 2024-04-26T10:26:51.837 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T10:26:51.837 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-26T10:26:51.838 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:26:51.849 INFO:tasks.ceph.mds.a:Stopped 2024-04-26T10:26:51.850 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T10:26:51.850 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T10:26:51.850 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:26:53.970 INFO:tasks.ceph.mgr.x.smithi052.stderr:2024-04-26T10:26:53.964+0000 7f182aa00700 -1 calc_pg_upmaps abort due to max <= 0 2024-04-26T10:26:54.092 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-26T10:26:57.951 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T10:26:57.952 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T10:26:57.952 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:26:59.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-26T10:26:59.697 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-26T10:27:04.054 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T10:27:04.055 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T10:27:04.055 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:27:04.146 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T10:27:04.146 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T10:27:04.147 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T10:27:04.147 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:27:04.180 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T10:27:04.181 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-26T10:27:04.181 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:27:04.202 INFO:tasks.ceph.mgr.y:Stopped 2024-04-26T10:27:04.202 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T10:27:04.203 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T10:27:04.203 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:27:04.257 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T10:27:04.257 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T10:27:04.257 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:27:04.309 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T10:27:04.309 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T10:27:04.309 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T10:27:04.363 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T10:27:04.363 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T10:27:04.364 DEBUG:teuthology.orchestra.run.smithi052:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-04-26T10:27:04.385 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi120.front.sepia.ceph.com 2024-04-26T10:27:04.386 DEBUG:teuthology.orchestra.run.smithi120:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T10:27:04.508 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi154.front.sepia.ceph.com 2024-04-26T10:27:04.508 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T10:27:04.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-26T10:27:04.751 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi164.front.sepia.ceph.com 2024-04-26T10:27:04.752 DEBUG:teuthology.orchestra.run.smithi164:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T10:27:04.925 INFO:tasks.ceph:Archiving mon data... 2024-04-26T10:27:04.927 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112/data/mon.a.tgz 2024-04-26T10:27:04.927 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-04-26T10:27:04.934 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.tK6IWJXaPK 2024-04-26T10:27:04.934 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.tK6IWJXaPK 2024-04-26T10:27:05.043 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.tK6IWJXaPK 2024-04-26T10:27:05.067 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.tK6IWJXaPK is 433KB 2024-04-26T10:27:05.126 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.tK6IWJXaPK 2024-04-26T10:27:05.133 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112/data/mon.b.tgz 2024-04-26T10:27:05.133 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-04-26T10:27:05.181 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.WCIwyufkgJ 2024-04-26T10:27:05.181 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.WCIwyufkgJ 2024-04-26T10:27:05.327 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.WCIwyufkgJ 2024-04-26T10:27:05.350 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.WCIwyufkgJ is 582KB 2024-04-26T10:27:05.417 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.WCIwyufkgJ 2024-04-26T10:27:05.424 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112/data/mon.c.tgz 2024-04-26T10:27:05.424 DEBUG:teuthology.orchestra.run.smithi052:> mktemp 2024-04-26T10:27:05.430 INFO:teuthology.orchestra.run.smithi052.stdout:/tmp/tmp.LWW4FN395c 2024-04-26T10:27:05.430 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.LWW4FN395c 2024-04-26T10:27:05.621 DEBUG:teuthology.orchestra.run.smithi052:> sudo chmod 0666 /tmp/tmp.LWW4FN395c 2024-04-26T10:27:05.641 DEBUG:teuthology.orchestra.remote:smithi052:/tmp/tmp.LWW4FN395c is 582KB 2024-04-26T10:27:05.709 DEBUG:teuthology.orchestra.run.smithi052:> rm -fr /tmp/tmp.LWW4FN395c 2024-04-26T10:27:05.718 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T10:27:05.719 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T10:27:05.722 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T10:27:05.724 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T10:27:05.726 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T10:27:05.760 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-26T10:27:05.760 DEBUG:teuthology.orchestra.run.smithi052:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T10:27:05.780 DEBUG:teuthology.orchestra.run.smithi120:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T10:27:05.782 DEBUG:teuthology.orchestra.run.smithi154:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T10:27:05.784 DEBUG:teuthology.orchestra.run.smithi164:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-26T10:27:05.800 INFO:teuthology.orchestra.run.smithi052.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T10:27:05.815 INFO:teuthology.orchestra.run.smithi120.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T10:27:05.830 INFO:teuthology.orchestra.run.smithi154.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T10:27:05.836 INFO:teuthology.orchestra.run.smithi164.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-26T10:27:05.843 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T10:27:05.844 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112/remote/smithi052/crash 2024-04-26T10:27:05.845 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T10:27:05.861 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112/remote/smithi120/crash 2024-04-26T10:27:05.862 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T10:27:05.879 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112/remote/smithi154/crash 2024-04-26T10:27:05.880 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T10:27:05.898 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112/remote/smithi164/crash 2024-04-26T10:27:05.899 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T10:27:05.936 INFO:tasks.ceph:Compressing logs... 2024-04-26T10:27:05.937 DEBUG:teuthology.orchestra.run.smithi052:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:27:05.939 DEBUG:teuthology.orchestra.run.smithi120:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:27:05.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:27:05.944 DEBUG:teuthology.orchestra.run.smithi164:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:27:50.944 INFO:tasks.ceph:Archiving logs... 2024-04-26T10:27:50.945 DEBUG:teuthology.misc:Transferring archived files from smithi052:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112/remote/smithi052/log 2024-04-26T10:27:50.946 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T10:27:51.246 DEBUG:teuthology.misc:Transferring archived files from smithi120:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112/remote/smithi120/log 2024-04-26T10:27:51.247 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T10:27:56.916 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112/remote/smithi154/log 2024-04-26T10:27:56.917 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T10:28:01.546 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112/remote/smithi164/log 2024-04-26T10:28:01.547 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T10:28:02.357 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T10:28:02.366 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T10:28:02.366 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T10:28:02.369 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T10:28:02.371 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T10:28:02.373 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T10:28:02.484 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T10:28:02.498 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T10:28:02.499 DEBUG:teuthology.orchestra.run.smithi052:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:28:02.501 DEBUG:teuthology.orchestra.run.smithi120:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:28:02.503 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:28:02.505 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T10:28:02.521 INFO:teuthology.orchestra.run.smithi052.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T10:28:02.521 INFO:teuthology.orchestra.run.smithi052.stdout:============================================================================== 2024-04-26T10:28:02.521 INFO:teuthology.orchestra.run.smithi052.stdout:+hv01.front.sepi 67.205.162.81 3 u 21 64 377 0.098 1.742 1.778 2024-04-26T10:28:02.521 INFO:teuthology.orchestra.run.smithi052.stdout:+hv02.front.sepi 63.231.80.2 3 u 27 64 377 0.080 3.506 0.992 2024-04-26T10:28:02.521 INFO:teuthology.orchestra.run.smithi052.stdout:*hv03.front.sepi 74.6.168.72 3 u 26 64 377 0.076 2.371 1.647 2024-04-26T10:28:02.521 INFO:teuthology.orchestra.run.smithi052.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2024-04-26T10:28:02.524 INFO:teuthology.orchestra.run.smithi120.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T10:28:02.524 INFO:teuthology.orchestra.run.smithi120.stdout:============================================================================== 2024-04-26T10:28:02.524 INFO:teuthology.orchestra.run.smithi120.stdout:+hv01.front.sepi 67.205.162.81 3 u 23 64 377 0.074 -0.845 0.206 2024-04-26T10:28:02.524 INFO:teuthology.orchestra.run.smithi120.stdout:+hv02.front.sepi 63.231.80.2 3 u 25 64 377 0.093 1.971 0.173 2024-04-26T10:28:02.524 INFO:teuthology.orchestra.run.smithi120.stdout:*hv03.front.sepi 74.6.168.72 3 u 23 64 377 0.087 -0.424 0.328 2024-04-26T10:28:02.524 INFO:teuthology.orchestra.run.smithi120.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2024-04-26T10:28:02.526 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T10:28:02.526 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2024-04-26T10:28:02.526 INFO:teuthology.orchestra.run.smithi154.stdout:+hv01.front.sepi 67.205.162.81 3 u 12 64 377 0.059 -2.135 0.398 2024-04-26T10:28:02.526 INFO:teuthology.orchestra.run.smithi154.stdout:+hv02.front.sepi 63.231.80.2 3 u 26 64 377 0.082 0.969 0.461 2024-04-26T10:28:02.526 INFO:teuthology.orchestra.run.smithi154.stdout:*hv03.front.sepi 74.6.168.72 3 u 15 64 377 0.074 -1.354 0.493 2024-04-26T10:28:02.526 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2024-04-26T10:28:02.551 INFO:teuthology.orchestra.run.smithi164.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T10:28:02.551 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================== 2024-04-26T10:28:02.551 INFO:teuthology.orchestra.run.smithi164.stdout: hv01.front.sepi 67.205.162.81 3 u 38 64 1 0.122 -0.643 0.000 2024-04-26T10:28:02.551 INFO:teuthology.orchestra.run.smithi164.stdout: hv02.front.sepi 63.231.80.2 3 u 39 64 1 0.114 2.259 0.000 2024-04-26T10:28:02.551 INFO:teuthology.orchestra.run.smithi164.stdout: hv03.front.sepi 74.6.168.72 3 u 35 64 1 0.128 0.027 0.000 2024-04-26T10:28:02.551 INFO:teuthology.orchestra.run.smithi164.stdout: hv04.front.sepi .STEP. 16 u - 64 0 0.000 0.000 0.000 2024-04-26T10:28:02.552 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T10:28:02.561 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T10:28:02.562 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T10:28:02.596 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T10:28:02.647 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T10:28:02.697 INFO:teuthology.task.internal:Duration was 968.427695 seconds 2024-04-26T10:28:02.698 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T10:28:02.747 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T10:28:02.747 DEBUG:teuthology.orchestra.run.smithi052:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T10:28:02.750 DEBUG:teuthology.orchestra.run.smithi120:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T10:28:02.752 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T10:28:02.755 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T10:28:02.820 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T10:28:02.820 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi052.front.sepia.ceph.com 2024-04-26T10:28:02.820 DEBUG:teuthology.orchestra.run.smithi052:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T10:28:02.835 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi120.front.sepia.ceph.com 2024-04-26T10:28:02.835 DEBUG:teuthology.orchestra.run.smithi120:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T10:28:02.851 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-04-26T10:28:02.851 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T10:28:02.865 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2024-04-26T10:28:02.866 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T10:28:02.880 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T10:28:02.880 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:28:02.882 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:28:02.885 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:28:02.911 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T10:28:03.000 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T10:28:03.000 DEBUG:teuthology.orchestra.run.smithi052:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T10:28:03.002 DEBUG:teuthology.orchestra.run.smithi120:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T10:28:03.005 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T10:28:03.007 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T10:28:03.127 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T10:28:03.137 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T10:28:03.137 DEBUG:teuthology.orchestra.run.smithi052:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T10:28:03.154 DEBUG:teuthology.orchestra.run.smithi120:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T10:28:03.171 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T10:28:03.186 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T10:28:03.203 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T10:28:03.213 DEBUG:teuthology.orchestra.run.smithi052:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:28:03.215 DEBUG:teuthology.orchestra.run.smithi120:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:28:03.217 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:28:03.228 INFO:teuthology.orchestra.run.smithi052.stdout:kernel.core_pattern = core 2024-04-26T10:28:03.230 INFO:teuthology.orchestra.run.smithi120.stdout:kernel.core_pattern = core 2024-04-26T10:28:03.232 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:28:03.244 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-04-26T10:28:03.275 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2024-04-26T10:28:03.309 DEBUG:teuthology.orchestra.run.smithi052:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:28:03.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:28:03.315 DEBUG:teuthology.orchestra.run.smithi120:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:28:03.320 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:28:03.321 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:28:03.326 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:28:03.327 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T10:28:03.332 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T10:28:03.333 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T10:28:03.343 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T10:28:03.344 DEBUG:teuthology.misc:Transferring archived files from smithi052:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112/remote/smithi052 2024-04-26T10:28:03.344 DEBUG:teuthology.orchestra.run.smithi052:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T10:28:03.370 DEBUG:teuthology.misc:Transferring archived files from smithi120:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112/remote/smithi120 2024-04-26T10:28:03.370 DEBUG:teuthology.orchestra.run.smithi120:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T10:28:03.396 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112/remote/smithi154 2024-04-26T10:28:03.396 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T10:28:03.422 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_22:32:02-powercycle-reef-distro-default-smithi/7674112/remote/smithi164 2024-04-26T10:28:03.422 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T10:28:03.446 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T10:28:03.446 DEBUG:teuthology.orchestra.run.smithi052:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T10:28:03.448 DEBUG:teuthology.orchestra.run.smithi120:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T10:28:03.450 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T10:28:03.463 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T10:28:03.470 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T10:28:03.481 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T10:28:03.481 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T10:28:03.515 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T10:28:03.515 DEBUG:teuthology.orchestra.run.smithi052:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T10:28:03.517 DEBUG:teuthology.orchestra.run.smithi120:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T10:28:03.519 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T10:28:03.522 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T10:28:03.523 INFO:teuthology.orchestra.run.smithi052.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 10:28 /home/ubuntu/cephtest 2024-04-26T10:28:03.525 INFO:teuthology.orchestra.run.smithi120.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 10:28 /home/ubuntu/cephtest 2024-04-26T10:28:03.527 INFO:teuthology.orchestra.run.smithi154.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 10:28 /home/ubuntu/cephtest 2024-04-26T10:28:03.530 INFO:teuthology.orchestra.run.smithi164.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 10:28 /home/ubuntu/cephtest 2024-04-26T10:28:03.532 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T10:28:03.565 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T10:28:03.667 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/ubuntu_20.04 tasks/admin_socket_objecter_requests thrashosds-health} duration: 968.4276945590973 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-26T10:28:03.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T10:28:03.860 INFO:teuthology.run:pass